Is there any reason to not simply block every bot and just allow ones you want through?
ie. something like (adding other SE's & services you use):
User-agent: *
Disallow: /
User-agent: Googlebot
Allow: /
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.