Forum Scraper?

[ghands]

Hey Guys,

I am looking for a desktop app or web service that will scrape forum posts, and store a new copy each time a post is edited. Is there anything that will do that available or do I have to code my own ?

Cheers

GHands

 

[Daniel-MD]

Never heard of this I think you have to create your own ..but thinking ..how are you gonna store ALL the messages from forums and then crawl the site each day to see which one is edited ..
Just thought .are u trying to get unique content with this ..coz darn looks like a way to hard to do way to get UC

 

[Radz]

this must be very expert work... Think How Googlebot Index your Forum pages again and again... ??

 

[superman]

do mean a forum poster ???

 

[ghands]

No, I don't mean a forum poster. I meant something that could archive a forum, in a way.

 

[blackknyt]

I ended up writing one for myself when I was doing ppi, I think this has to be custom made depending on the board typ, restrictions plus the template being used. If you know basic php there are a bunch of classes floating around that can allow you to do that.

 

[karum]

For which forum are you looking for. I am planning to write a scraper for vbulletin forums.

 

[conxway]

You can take them from yahoo answers thats about it right now. Instadigi content generator works. Its not unique but hey its instant content.

 

[cashcow]

There are tons of forum scripts out there, it may be quite time consuming to scrape everything...

 

[shibumila]

Try Teleport or Website Ripper Copier to download the site.

 

[Loak]

you will need to get someone to code it.

 

[defendercom]

i've looked at a bunch of software in the past used to use teleport which was nice but switched over to offline explorer enterprise

http://www.metaproducts.com/

great program will do what you want and then some! grab yourself a copy at the your local torrent shop. you can also look into screen scraping

http://en.wikipedia.org/wiki/Screen_scraping

 

[james89]

I need it too, can anyone give it.....

 

[forgot]

Use ICO, or instadigi, they are only yYA SCPS

 

[neo3187]

use the auto blogging software by carty, its semi automatic but works like a charm.

 

[erdistfroh]

Not sure what you could use to do this :S