Discussion in 'Black Hat SEO' started by WeWontBeAlone, Jun 21, 2017.
How to block all bots/crawlers apart from search engines?
Need it with .htaccess
Doesn't work, i need like a Default ALL except for SEARCHES ENGINES
It's more complicated than one line in htaccess. You need PHP. Cuz probably the bots you want the block are using Googlebot agent name when visiting your websites.
So, you want to check first if it's really google (W/E search engine you are targeting) then serve the content you want. If not, then block the content.
You don't xD
Will first one, the .htaccess block all bots/crawlers except for google/yahoo/bing?
U clearly a noob...so try all in one seo plugin and block it from there.
Not what I asked lol
it`s exactly what u asked. All in one seo has an bad bot blocker feature.
I asked for .htaccess
Separate names with a comma.