URGENT help robots.txt

MariosElGreco

Regular Member
Joined
May 31, 2014
Messages
277
Reaction score
10
I have the site eas-seo.com that i like SE visit it ,
I have the sub site eas-seo.com/examples that i dont like SE visit it.
If i use robots.txt on eas-seo.com/example those lines it means that SE would not visit any page on eas-seo.com too , or only the eas-seo.com/examples ?
User-agent: *
Disallow: /
Disallow: /cgi-bin/
Sitemap: http://eas-seo.com/examples/sitemap.xml
 
Add to your robots.txt:
Disallow: /example/

and robots wont visit site.com/example but will visit site.com and other links
 
Back
Top