Recent content by websemgem

First create XML, image, video sitemaps as applicable (if you have a large website try A1 Sitemap Generator) Then make sure only your content URLs is included (if you use noindex, canonicals etc. correctly you will only have wanted URLs, but otherwise use the output filters exclude options to...

TechSEO360

Indeed - the indexed number in Google Webmaster Tools makes more sense if you read it as URLs confirmed by Google Webmaster Tools as being indexed in Google Search Index At leas in the past you could even prove this quite easily. E.g. by having a fully indexed sitemap and keeping it. Then...

Are the URLs from the same website? Or do you just need to bulk import a list of URLs and have them checked? If either of those - you can try TechSEO360 - it also supports command line so you can schedule it to run through multiple websites if need to be.

A1 Website Analyzer (or for free alternatives XENU and GSiteCrawler)

As others have mentioned downloading and spinning articles is one way, but it is both a little unethical and dangerous :) If you are okay using noindex / robots.txt you could just buy an article package (or even use a free) I am not much into hat sort of thing any longer, but in the past, there...

XENU or A1 Website Analyzer (the latter can also extract top keywords of each page for you from titles, headers and content)

Late to the pary, but you can automate A1 Website Analyzer for this to some degree: 1) Create a project file using the settings you want. Set root domain to e.g: example com 2) Now call A1 Website Analyzer command line from e.g. a bat file. In the parameters, specify the project file and...

Create a sitemap of your content pages (e.g. if using WordPress you can use a plugin that will select only those) and noindex tag and category pages. (That way, you won't really need robots.txt alhough it will of course be time well spent learning about it)

A1 Website Analyzer (cheaper if you need support for more than 500 URLs)

If you end up needing an alternative, you can also try A1 Sitemap Generator - it has a ton of options

Your sitemaps should ideally not contain URLs that error (and redirect in my opinion) - suggest you regenrate your sitemap and make sure the tool you use does not include duplicate or error URLs

Step #1 Create a video sitemap of your website (if you use a CMS use a plugin like Yoast, otherwise use software like A1 Sitemap Generator with "video" scan preset) Step #2 Buiild and find your video sitemap XML file Step #3 Upload it to your website if not already there Step #4 Submit it in...

You could also check A1 Website Analyzer (broken links, see how link juice flows, fix duplicate titles, headers, descriptions etc. and search for code/text through all pages)

If I understand you correct, I think you can do what you need with A1 Sitemap Generator if you are willing to automate using the command line. (If you disable "Simplified easy mode" you can configure the options to pick the kinds of URLs you want. Then load that project using command line and...