yes in few cases, such as some problems with all the niche, but this depends on what referral sites!
the 1st idea got in my mind is that you may got some issues in your website, so carefully check your website as it may got new internal errors in some pages!