Do you suggest to enable "Crawler Hints" at Cloudflare?

CaptainCrypto

Regular Member
Joined
Feb 7, 2019
Messages
415
Reaction score
196
I was reading Bing docs in order to find out why they deindexed my site...

As far as I tell there is no reason, they deindexed my site several months ago.
I contacted support in January and they replied in May informing "did not meet the standards set by Bing the last time it was crawled."

So today I was trying to find out the reason but I see no reason, not even a hint...

Then I came to know about Bing's "IndexNow" thing and it took me to enabling Cloudflare's "Crawler Hints"
So wondering if it's something important and should I enable it or not... What you guys suggest?

Thanks for your time and kind suggestions...
 
I've had the same "did not meet the standards set by Bing the last time it was crawled" issue for well over a year now. My site doesn't appear on Bing at all, including when I search for the site's name.

I've had Cloudflare's Crawler Hints enabled for a long time now but just realized today that Cloudflare was submitting images (5-10 per day) through IndexNow, which I can see in the IndexNow tab of Bing Webmaster Tools. My hunch is that having those images crawled may be why Bing has removed my site from the index. The images are from old blog posts yet they're still being submitted months/years later by Cloudflare.

To be fair, I'm mostly grasping at straws here, since Bing gives ZERO help on why my site (which isn't black hat at all) would be removed from the index. Anyway, I switched off Crawler Hints in Cloudflare and I'll comment here if my site gets re-indexed by Bing again.
 
https://www.bikegremlin.net/threads/seo-microsoft-bing-site-gone-from-serp-overnight-article-comments.98/ I came across that may be relevant for anyone else having the same issue. The author (BikeGremlin) says this in his latest comment (Feb 4, 2024):

This is an interesting read. Like you, my well performing site was delisted in Bing.
I saw lots of false directories / files that are apparently in Bing’s index of this site. These don’t exist, and never have. They seem to be basic exploit attempts. Some examples:
/admin
/blogs
/store
/backup

...
So the question was why are these being associated with my site? Well, it seems the answer is Cloudflare’s Crawler Hints as under IndexNow in Bing Webmaster Tools I see exploit URLs being submitted by Cloudflare.
I’ve reached out to Cloudflare about this, and also have a ticket open with Bing.
 
Back
Top