Scrape Sitemap Posts

Googleplex said:

Hey buddy! I didn't get what you are trying to do, do you want to scrape a sitemap into a CSV or use the sitemap to scrape the site's content?
could you rephrase what you want?

Click to expand...

ThisIsMyLife said:

Yes, Use the sitemap to open every url in it and scrape its content and repost this to blog

Click to expand...

Googleplex said:

OK. I got it. Unfortunately I don't know if there is already a tool to automate this process. but if you are willing to code one I can help you with that.

Click to expand...

Googleplex said:

OK. I got it. Unfortunately I don't know if there is already a tool to automate this process. but if you are willing to code one I can help you with that.

Click to expand...

Festinger said:

Selling is not allowed without a Jr VIP membership, you should know that.

Click to expand...

PandaBusters said:

Unless the URL number is about the same, as you go from "site map to site map", say, in Bing, it's hard to do. If you make the whole site map page one tex files, extract them from Bing or some unusual directory for site maps (most directories are called maps anyway, like "weedmaps"), place it in a single cell column of text in a CSV spreadsheet (I use WebHarvy.com), extract the URL's with convertcsv.com, and then place the URL's into a fresh CSV file for merging, say, with the the best spinner. Let me know if we're in sync.

Click to expand...