Recent content by sirron

thanks for the help here. I'm likely going to take another route which is to dynamically insert the Noindex tags. Going to use something like this to add noindex tags on pages that matched the criteria for being excluded (in PHP) if (preg_match($regex, $_SERVER['REQUEST_URI'])) {...

I have a site with 60K+ pages and am looking to EXclude URLs from my sitemap, or prevent Google indexing, if the URLs contain certain keywords. Using disallow on robots.txt doesn't work because the URLs I'm looking to exclude are not in a particular directory. Any thoughts much appreciated.