kaizersuzi
Junior Member
- Dec 31, 2008
- 107
- 133
Hi all,
I'm using wp for my PE site. I did some changes to my robot.txt below and noticed that my latest articles were never indexed after a few days (normally all my posts used to take an hour, few hours at most).
I'm not sure if there is something in my robot that caused this issue.
Please have a look at my robot and let me know if you found something.
BTW, my metatags read like this:
Tite: post title
Description: post description
Keywords: post keywords
Robot: noarchive
Here is my robot.txt:
Thanks in advance for your help.
I'm using wp for my PE site. I did some changes to my robot.txt below and noticed that my latest articles were never indexed after a few days (normally all my posts used to take an hour, few hours at most).
I'm not sure if there is something in my robot that caused this issue.
Please have a look at my robot and let me know if you found something.
BTW, my metatags read like this:
Tite: post title
Description: post description
Keywords: post keywords
Robot: noarchive
Here is my robot.txt:
Code:
User-agent: *
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback
Disallow: /feed
Disallow: */trackback
Disallow: */feed
Disallow: /author
Disallow: /search/*/feed
Disallow: /search/*/*
Disallow: /privacy-policy/
Disallow: /about/
Disallow: /disclaimer/
Disallow: /contact-us/
Disallow: /images/
Disallow:/uncategorized/
Disallow:/submit-your-site/
Disallow:/tag/
Disallow:/out/
Disallow:/category/
Disallow:/penisenlargement/penis-enlargement/extender/sizegenetics/
Sitemap:http://www.example.com/sitemap.xml
User-agent: Googlebot-Image
Allow: /
User-agent: Googlebot-Mobile
Allow: /
User-agent: ia_archiver-web.archive.org
Disallow: /Thanks in advance for your help.