You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an alternative browser.
You should upgrade or use an alternative browser.
Best setting for robot.txt?
- Thread starter Xpired
- Start date
Hi... your question it is a little bit too general.
What is your goal?
For example... in some cases I completely disallow the image folder because for some website I do not care at all about indexing images.... In some other cases, images bring me a lot of qualified traffic.
Normaly with wordpress I disallow everything is not necessary from a SEO point of view like for examples: /wp-admin/ /wp-includes/ /wp-content/plugins/ /wp-content/cache/ /wp-content/themes/
If you have on your webspace directories like stats or cgi-bin, disallow them too.I
If you need to delete all urls with question markes (for example) from search engine indexes try to disallow also /*?
I hope my answer was helpfull to you.
What is your goal?
For example... in some cases I completely disallow the image folder because for some website I do not care at all about indexing images.... In some other cases, images bring me a lot of qualified traffic.
Normaly with wordpress I disallow everything is not necessary from a SEO point of view like for examples: /wp-admin/ /wp-includes/ /wp-content/plugins/ /wp-content/cache/ /wp-content/themes/
If you have on your webspace directories like stats or cgi-bin, disallow them too.I
If you need to delete all urls with question markes (for example) from search engine indexes try to disallow also /*?
I hope my answer was helpfull to you.