Discussion in 'Black Hat SEO' started by garymoore321, Mar 25, 2013.
what is Robots.txt and how it useful in SEO?? Can any one help on this??
hey check out wikipedia and type in robots.txt in there
Follow step by step
also can i use robot.txt to hide certain databases ? s
Your database is always hidden as long as you havent posted your login details in public.
There are a lot of thread on Robots.txt, try to read the old thread by using search button.
I mostly use robots to block bots from indexing my mobile content on the sites I have which aren't wordpress and have a duplicated site for mobile visitors. I'm not sure if it's the ideal way to go about it, but I figure it will help avoid duplicate content issues.
Separate names with a comma.