Robot txt template for wordpress

Robot txt template for wordpressHi all,
I have been advise that my previous robot text was rubbish, yet most of the information was taken from the websites regarding the best seo practises for wordpress. I would like to know on your thoughts of the best template robot txt disallows / allows / no index for wordpress websites?
Thank you

It depends really on yours site. For most wordpress sites all site is set for indexing (without wp-admin). Sometimes it is good to block tags/pagination/category but it can be done with plugins like All in Seo etc

ekapek said:

It depends really on yours site. For most wordpress sites all site is set for indexing (without wp-admin). Sometimes it is good to block tags/pagination/category but it can be done with plugins like All in Seo etc

Click to expand...

Thanks, I really looking for the best setup for seo, everyone says its important to have robot txt.

Here is the syntex:

User-Agent: *
2 Allow: /wp-content/uploads/
3 Disallow: /wp-content/plugins/
4 Disallow: /readme.html


But, I would like to tell you that now there is no need to block access to your wp-includes directory and your plugins directory or wp-admin. if you block any URL using robots.txt then crawler will not crawl that website and also will now distribute link value pointing at those pages. If you don’t do anything, WordPress has (by my doing) a robots meta x-http header on the admin pages that prevents search engines from showing these pages in the search results..

For more information you can check https://yoast.com/wordpress-robots-txt-example/.