How to scrape HUGE RSS list and convert to articles?

Discussion in 'Black Hat SEO Tools' started by psychotix, Aug 23, 2009.

  1. psychotix

    psychotix Regular Member

    Joined:
    Nov 28, 2008
    Messages:
    202
    Likes Received:
    56
    Hi all,

    So I have hundreds of RSS I'd like scraped and saved to my hard drive. Afterwards I like to convert them to txt files to be imported to Xsitepro.

    What tools, hopefully free ones can I use?
    TNx
     
  2. letusgo

    letusgo Junior Member

    Joined:
    Nov 15, 2008
    Messages:
    199
    Likes Received:
    125
    I think you could try rss to html and then convert html to text.
    Just hit them on google.
     
    • Thanks Thanks x 1
  3. psychotix

    psychotix Regular Member

    Joined:
    Nov 28, 2008
    Messages:
    202
    Likes Received:
    56
    Thanks, but as I said I have hundreds of RSS, and rss2html only allows 1 at a time.
    Are there other tools?
     
  4. Chris Devon

    Chris Devon Power Member

    Joined:
    Jul 2, 2008
    Messages:
    509
    Likes Received:
    192
    Rss is XML, so if you know PHP or other programing language it wont be a problem to parse the feed and store the data in to a DB. From the DB you can do anything you want with the data
     
    • Thanks Thanks x 1
  5. kveldulv

    kveldulv Junior Member

    Joined:
    Aug 19, 2009
    Messages:
    107
    Likes Received:
    45
    Textpipe Pro might be what you're after. It isn't free, but is absolutely fantastic for text processing of any sort.
     
    • Thanks Thanks x 1
  6. psychotix

    psychotix Regular Member

    Joined:
    Nov 28, 2008
    Messages:
    202
    Likes Received:
    56
    Tnx guys.
    I have textpipe pro that I got from demonoid. I hope this solves it!
     
  7. yazzou

    yazzou Registered Member

    Joined:
    Dec 19, 2008
    Messages:
    61
    Likes Received:
    7
    screen scraper is a wonderful tool