Which is the best content scraper youve used?

waitier

Power Member
Joined
Sep 5, 2013
Messages
738
Reaction score
208
I have a need to scrape articles from custom sites whereby I just input the URL, it will then scrape all the links with the title+content and then output into a format that i can just upload to wordpress. If you want to call it autoblogging, then that's what it is.

I plan to re post sources found in places like techrunch or any other major sites as a post in my own site.

I found a bunch of them online and was unsure which ones does the job with ease, something like a one click button?

Webharvy
WP robot
Cyberseo
..And a bunch of wp plugins found in official repo..

I've tried mostly the free ones and their limitation and bugs is just way too annoying. Some of them managed to take the RSS feed and extract them to full text, while some kept it as a freemium feature which i hate the most.

RSS feed to post type of plugins worked to a certain extend, but in the text sometimes ends up jumbled up and left garbage text in there which i have to manually clean it up defeating the purpose.
 
Import.io is a browser based web scraping tool, give it a try.
 
Oh i forgot to mention that one as well. These visual web scraper they are one thing, it says it's easy, but it's so complicated at the same time.

Technically the template i needed just isn't there. It seems easy, or at least it's the easiest thing and most common thing any article scrapper can spit out.

I've tried to add the elements using import.io, point and click, but umm they don't click into the links to extract the body content. Can't find that function either.. am i missing something?
 
Content foundry is my favourite, It allows you to scrape from loads of websites and has built in proxy support. Only downside is it has a monthly fee.
 
Import.io will be good , they hav also free package
 
You can select a specific data point, a price, a rating etc and then use your browser menu: click Scrape Similar and you will get multiple options to export or copy your data to Excel or Google Docs. This plugin is really basic but does the job it is built for fast and easy screen scraping.
 
Back
Top