Blog harvesting solution

Joined
Jul 6, 2012
Messages
22
Reaction score
4
Hi,
i want to write a script (probably linux based, via perl) which will harvest blog content. Now my question is: afaik blogs are pinging to some service like pingomatik as soon they have new content. Do you guys know such a service i can attach my script to get notified about new coming posts please? Thank you guys!
 
Did you ever write the software? Why dont you write the script so it will do it from lists of urls you feed it? This way we can just use scrapebox to look for the content we want to scrape?
 
I don't get it what seems to be the problem? Just get your blogs of interest and parse their RSS feed for content. That's the way most autoblogs fetch content. It is futile to try to reinvent the wheel. If I misunderstood your problem, please clarify.
 
Back
Top