I have seen 2 methods of blocking bots through htaccess floating around and cannot see the operating difference.
Can someone please...
a small plugin (2.40kb) that writes code to .htaccess to block seo crawlers.
user agents that plugin blocks:
rogerbot - opensiteexplorer...
Separate names with a comma.