Does cloudflare make google struggle to index pages ?

M4DM4X

Elite Member
Joined
Jan 21, 2015
Messages
2,909
Reaction score
1,754
Hi,
I'd like to install cloudflare on my site bu I am worrying about the fact it could block some of the google bots.
Do you have any experience about this?
I know cloudflare has a white list of bots, including those from google, but maybe it's not enough, don't know
Thanks
 
Don't worry, Cloudflare won't affect your website's indexing.
 
No issues with indexing. But lately I find it annoying when the cloudfare page hits before the website loads. I'm pretty sure I'm not alone. It's definitely impacting the bounce rate.
 
No, Cloudflare doesn't make Google struggle to index your pages. It automatically allows verified bots like Googlebot to access your site. Indexing issues usually happen only if you set very strict firewall or security rules. With default settings or by whitelisting Google's crawlers, your site will be indexed normally. In fact, Cloudflare can even improve your site speed and SEO performance.
 
Cloudflare is safe for Google bots as long as you keep its default “Verified Bots” whitelist enabled.
 
Hi,
I'd like to install cloudflare on my site bu I am worrying about the fact it could block some of the google bots.
Do you have any experience about this?
I know cloudflare has a white list of bots, including those from google, but maybe it's not enough, don't know
Thanks
Never had that experience. I think there's a setting to block AI bots if you want but it doesn't block Google bot.

Your site would index just fine.
 
Cloudflare won’t block Google bots it recognizes and whitelists them automatically, so your site indexing is safe.
 
No need to worry , Cloudflare won’t block Google bots. It automatically recognises and allows verified bots like Google bot to crawl your site safely.
 
Cloudflare is fine. Choose any random search term you want and see how many of the top ten results use Cloudflare. Chances are it will be more than half.
 
Using Cloudflare on several sites, no issues with Google bots at all. As long as you keep the default security settings, Google crawlers pass through just fine.
 
Cloudflare won’t randomly block legitimate Google crawlers if you don’t misconfigure rules, but misconfigured WAF/firewall/rate-limit rules can cause Googlebot to be challenged or blocked.
 
Thank you much guys I'm reassured now
 
I have multiple sites with cloudflare and seen no problem at all so you should not be worried about it.
 
Using Cloudflare shouldn’t interfere with Google’s ability to index your pages — as long as your firewall, bot-filtering settings, and security rules aren’t overly restrictive. In most cases, default setups keep legitimate bots and crawlers allowed, so you won’t see major indexing problems.
 
I had used hundreds of website but didn't notice any issues until now.

Though you could make your own experiment and see if it works from your side. Also let the client know about it if you are planned for your client site.
 
Hi,
I'd like to install cloudflare on my site bu I am worrying about the fact it could block some of the google bots.
Do you have any experience about this?
I know cloudflare has a white list of bots, including those from google, but maybe it's not enough, don't know
Thanks
I was actually about to set up Cloudflare on my site last week but stopped due to the same reason. Hoping someone here has the real experience about this and can help us out.
 
Cloudflare is safe for Googlebot. It automatically whitelists verified bots like Google. Just avoid strict firewall or Bot Fight Mode most top sites use Cloudflare without crawl issues.
 
Back
Top