1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Blog harvesting solution

Discussion in 'Black Hat SEO Tools' started by thespiderwomen, Jul 19, 2012.

  1. thespiderwomen

    thespiderwomen Newbie

    Joined:
    Jul 6, 2012
    Messages:
    21
    Likes Received:
    4
    Hi,
    i want to write a script (probably linux based, via perl) which will harvest blog content. Now my question is: afaik blogs are pinging to some service like pingomatik as soon they have new content. Do you guys know such a service i can attach my script to get notified about new coming posts please? Thank you guys!
     
  2. Bostoncab

    Bostoncab Elite Member

    Joined:
    Dec 31, 2009
    Messages:
    2,255
    Likes Received:
    514
    Occupation:
    pain in the ass cabbie
    Location:
    Boston,Ma.
    Home Page:
    Did you ever write the software? Why dont you write the script so it will do it from lists of urls you feed it? This way we can just use scrapebox to look for the content we want to scrape?
     
  3. closedCaption

    closedCaption Regular Member

    Joined:
    Oct 3, 2011
    Messages:
    289
    Likes Received:
    111
    I don't get it what seems to be the problem? Just get your blogs of interest and parse their RSS feed for content. That's the way most autoblogs fetch content. It is futile to try to reinvent the wheel. If I misunderstood your problem, please clarify.