How to scrape HUGE RSS list and convert to articles?

P

psychotix

Regular Member

Nov 28, 2008

205

57

• Aug 23, 2009

• #1

Hi all,

So I have hundreds of RSS I'd like scraped and saved to my hard drive. Afterwards I like to convert them to txt files to be imported to Xsitepro.

What tools, hopefully free ones can I use?
TNx

 

L

letusgo

Junior Member

Nov 15, 2008

199

126

• Aug 23, 2009

• #2

I think you could try rss to html and then convert html to text.
Just hit them on google.

 

P

psychotix

Regular Member

Nov 28, 2008

205

57

• Aug 24, 2009
• Thread Starter Thread Starter

• #3

Thanks, but as I said I have hundreds of RSS, and rss2html only allows 1 at a time.
Are there other tools?

 

Chris Devon

Power Member

Jul 2, 2008

526

305

• Aug 24, 2009

• #4

Rss is XML, so if you know PHP or other programing language it wont be a problem to parse the feed and store the data in to a DB. From the DB you can do anything you want with the data

 

kveldulv

Regular Member

Aug 19, 2009

223

91

• Aug 24, 2009

• #5

Textpipe Pro might be what you're after. It isn't free, but is absolutely fantastic for text processing of any sort.

 

P

psychotix

Regular Member

Nov 28, 2008

205

57

• Aug 25, 2009
• Thread Starter Thread Starter

• #6

Tnx guys.
I have textpipe pro that I got from demonoid. I hope this solves it!

 

Y

yazzou

Registered Member

Dec 19, 2008

61

7

• Aug 26, 2009

• #7

screen scraper is a wonderful tool