1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to scrape HUGE RSS list and convert to articles?

Discussion in 'Black Hat SEO Tools' started by psychotix, Aug 23, 2009.

  1. psychotix

    psychotix Junior Member

    Joined:
    Nov 28, 2008
    Messages:
    199
    Likes Received:
    55
    Hi all,

    So I have hundreds of RSS I'd like scraped and saved to my hard drive. Afterwards I like to convert them to txt files to be imported to Xsitepro.

    What tools, hopefully free ones can I use?
    TNx
     
  2. letusgo

    letusgo Junior Member

    Joined:
    Nov 15, 2008
    Messages:
    199
    Likes Received:
    125
    I think you could try rss to html and then convert html to text.
    Just hit them on google.
     
    • Thanks Thanks x 1
  3. psychotix

    psychotix Junior Member

    Joined:
    Nov 28, 2008
    Messages:
    199
    Likes Received:
    55
    Thanks, but as I said I have hundreds of RSS, and rss2html only allows 1 at a time.
    Are there other tools?
     
  4. Chris Devon

    Chris Devon Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 2, 2008
    Messages:
    507
    Likes Received:
    192
    Rss is XML, so if you know PHP or other programing language it wont be a problem to parse the feed and store the data in to a DB. From the DB you can do anything you want with the data
     
    • Thanks Thanks x 1
  5. kveldulv

    kveldulv Registered Member

    Joined:
    Aug 19, 2009
    Messages:
    76
    Likes Received:
    33
    Textpipe Pro might be what you're after. It isn't free, but is absolutely fantastic for text processing of any sort.
     
    • Thanks Thanks x 1
  6. psychotix

    psychotix Junior Member

    Joined:
    Nov 28, 2008
    Messages:
    199
    Likes Received:
    55
    Tnx guys.
    I have textpipe pro that I got from demonoid. I hope this solves it!
     
  7. yazzou

    yazzou Registered Member

    Joined:
    Dec 19, 2008
    Messages:
    61
    Likes Received:
    7
    screen scraper is a wonderful tool