(Free) tool to scrape articles from a specific site

iliketurtles

iliketurtles

Regular Member
Joined
Dec 10, 2008
Messages
286
Reaction score
10
I've found a good site I would like to scrape, and then translate the articles to my language. There are hundreds of articles so it'll take hours and hours to copy and paste. So do you know of a tool I can use to scrape this one site? Wouldn't mind if it's free, cuz I will most likely use it like once a year or something, if that.
 
Advertise on BHW
As a programmer I can say it all depends on the site. To parse data out of a site you need to use a regex to pick out the article from the html. I won't bore you with the details but if it's a rather unheard of site chances are there is no tool for it.
 
Crap.. One article a time it is, then. :prof10:
 
been looking into this a little, but haven't got far yet :). I was looking at going into wordpress. My plan was to use httrack to download the pages and then use 'html import 2' plugin to bring it in. The plugin needs you to be able to specify the div tag that the content is in.
 
Do you make custom scrapers? How much will that cost?
 
yea i do. it would cost what you can afford really. i enjoy programming scrapers. you can get ahold of me at arsynseo.com if your interested
 
The plugin let me download the content on a certain page, but i still gotta do it one page at the time, and all the formatting is lost.
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top