googlebis
Power Member
- Feb 7, 2017
- 519
- 224
I want to allow every thing but 3 pages in robots.txt is it correct to do it like this :
User-agent: *
Allow:
Disallow: /p/terms.html
Disallow: /p/privacy.html
Disallow: /p/contact.html
Sitemap: http://www.example.com/atom.xml?redirect=false&start-index=1&max-results=500
i google it and that's what i found but when i test for example /p/terms.html , and run test it says that it's allowed !
User-agent: *
Allow:
Disallow: /p/terms.html
Disallow: /p/privacy.html
Disallow: /p/contact.html
Sitemap: http://www.example.com/atom.xml?redirect=false&start-index=1&max-results=500
i google it and that's what i found but when i test for example /p/terms.html , and run test it says that it's allowed !
