killzone Regular Member Joined Jan 3, 2009 Messages 250 Reaction score 92 May 25, 2009 #1 Hey, I have a cloned site that I want to prevent Google from indexing. How can I ensure that google doesn't index it? I'm assuming robots.txt and User Agents? Anyone have a list of all the search engine useragents?
Hey, I have a cloned site that I want to prevent Google from indexing. How can I ensure that google doesn't index it? I'm assuming robots.txt and User Agents? Anyone have a list of all the search engine useragents?
killzone Regular Member Joined Jan 3, 2009 Messages 250 Reaction score 92 May 25, 2009 Thread Starter Thread Starter #2 Nvm shoulda just googled it Code: [url]http://www.robotstxt.org/robotstxt.html[/url]
