I've been trying on several sites with different combinations of code to block majestic crawlers through htaccess, but it just doesn't work. I'm having no problem with the other bots like ahrefs and OSE. Don't want to leave a footprint by using neither the robots file, nor spyderspanker/other plugins right now. But I was thinking, wouldn't it be possible to block all bots except for those coming from search engines? I've been looking around and trying to learn how to put this into code, but can't seem to figure it out. So I'm wondering: - Do you think this would be possible without obstructing the bots you want to have crawling the site? - Is there a way to distinguish between bots and real people/browsers in htaccess?