I have a page which I wish to keep hidden from the spiders and cannot have it listed in the serps, how can i do this? is it possible with .htaccess, or should i go with robots.txt, i'm not entirely sure how to do either really. what should i do?
However, just to warn you, robots.txt only blocks "good" spiders like Gbot and Ybot; it won't stop the Al3xa bot or human readers from accessing the page.
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.
