Best way to find sitemaps?

G0D0VERY0U

Regular Member
Joined
Apr 6, 2010
Messages
439
Reaction score
284
Hey guys - anyone have a good thought for finding a BE site's .xml sitemap?

I can't really find a good search operator for the task and I have a lot of blogs to locate sitemaps for.
 
Why would you want the sitemap? HTTRACK might be able to get the job done.
 
Because the sitemap will give me every blog post on a blog.

If you scrape Google you will find results indexed, but not all filtered out byt the dup content filter. In addition, what about the posts not indexed yet? I want those.

Basically I'm trying to take one auto-approve post and turn into into hundreds. The best way to do that is find a weak blog, get it's site map, scrape all of the blog post urls off the sitemap and comment on them. Since one was auto-approve, the others may be as well.

I'll try what you suggested :)
 
Back
Top