Data Harvesting tools Suggestion

jani

Power Member
Joined
Jun 30, 2016
Messages
569
Reaction score
88
Hi mates,

I want to extract content from the whole website in Excel Format is there any tool that do so for me. for Example, I want to extract xyz. com whole site content from its post. according to my given specification any one using such kind of tools. Please suggest if you are using it and have got good results from it
 
Depend on what exactly you need from the site, what technology the site uses (eg lazy loading with JavaScript), how much you are willing to pay ...
 
If it is simple text data. No Java then Webscraper.io
It's simple, it works from within Chrome or I think you can have a standalone.
It grabs the sitemap and you can select what elements you need grabbing. It's pretty simple.

I've used a load of scrapers and the general rule is - the more powerful the scraper the higher the cost and learning curve.
Scrapbox with a custom scraper (it's a built in feature) could do it but you'd need to write the REGEX yourself.
 
Back
Top