1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Forum Scraper?

Discussion in 'Black Hat SEO Tools' started by ghands, Jun 26, 2008.

  1. ghands

    ghands Junior Member

    Joined:
    Feb 28, 2008
    Messages:
    101
    Likes Received:
    11
    Occupation:
    IT Technician
    Location:
    Dewsbury, Yorkshire, UK
    Hey Guys,

    I am looking for a desktop app or web service that will scrape forum posts, and store a new copy each time a post is edited. Is there anything that will do that available or do I have to code my own ?

    Cheers

    GHands
     
  2. MoneyMafia

    MoneyMafia Regular Member

    Joined:
    Dec 2, 2007
    Messages:
    290
    Likes Received:
    310
    Never heard of this I think you have to create your own ..but thinking ..how are you gonna store ALL the messages from forums and then crawl the site each day to see which one is edited ..
    Just thought .are u trying to get unique content with this ..coz darn looks like a way to hard to do way to get UC
     
  3. Radz

    Radz Jr. VIP Jr. VIP Premium Member

    Joined:
    Dec 28, 2007
    Messages:
    143
    Likes Received:
    1,804
    Occupation:
    Webmaster
    Location:
    Mars
    this must be very expert work... Think How Googlebot Index your Forum pages again and again... ??
     
  4. superman

    superman BANNED BANNED

    Joined:
    Dec 10, 2006
    Messages:
    418
    Likes Received:
    43
    do mean a forum poster ???
     
  5. ghands

    ghands Junior Member

    Joined:
    Feb 28, 2008
    Messages:
    101
    Likes Received:
    11
    Occupation:
    IT Technician
    Location:
    Dewsbury, Yorkshire, UK
    No, I don't mean a forum poster. I meant something that could archive a forum, in a way.
     
  6. blackknyt

    blackknyt Newbie

    Joined:
    Mar 9, 2008
    Messages:
    12
    Likes Received:
    0
    I ended up writing one for myself when I was doing ppi, I think this has to be custom made depending on the board typ, restrictions plus the template being used. If you know basic php there are a bunch of classes floating around that can allow you to do that.
     
  7. karum

    karum Jr. VIP Jr. VIP Premium Member

    Joined:
    Feb 9, 2008
    Messages:
    214
    Likes Received:
    45
    For which forum are you looking for. I am planning to write a scraper for vbulletin forums.
     
  8. conxway

    conxway Newbie

    Joined:
    Feb 20, 2008
    Messages:
    17
    Likes Received:
    27
    You can take them from yahoo answers thats about it right now. Instadigi content generator works. Its not unique but hey its instant content.
     
  9. cashcow

    cashcow Junior Member

    Joined:
    Sep 15, 2008
    Messages:
    162
    Likes Received:
    22
    There are tons of forum scripts out there, it may be quite time consuming to scrape everything...
     
  10. shibumila

    shibumila Registered Member

    Joined:
    Apr 8, 2008
    Messages:
    67
    Likes Received:
    10
    Try Teleport or Website Ripper Copier to download the site.
     
  11. Loak

    Loak Jr. VIP Jr. VIP

    Joined:
    Apr 21, 2008
    Messages:
    314
    Likes Received:
    109
    you will need to get someone to code it.
     
  12. defendercom

    defendercom Newbie

    Joined:
    Jul 23, 2008
    Messages:
    37
    Likes Received:
    4
    i've looked at a bunch of software in the past used to use teleport which was nice but switched over to offline explorer enterprise
    Code:
    http://www.metaproducts.com/
    great program will do what you want and then some! grab yourself a copy at the your local torrent shop. you can also look into screen scraping
    Code:
    http://en.wikipedia.org/wiki/Screen_scraping
     
  13. james89

    james89 Newbie

    Joined:
    Mar 25, 2008
    Messages:
    17
    Likes Received:
    4
    I need it too, can anyone give it.....
     
  14. forgot

    forgot Jr. VIP Jr. VIP Premium Member

    Joined:
    May 3, 2008
    Messages:
    936
    Likes Received:
    706
    Location:
    BlackhatWorld
    Use ICO, or instadigi, they are only yYA SCPS
     
  15. neo3187

    neo3187 Senior Member

    Joined:
    Sep 19, 2010
    Messages:
    868
    Likes Received:
    360
    use the auto blogging software by carty, its semi automatic but works like a charm.
     
  16. erdistfroh

    erdistfroh Newbie

    Joined:
    Oct 20, 2010
    Messages:
    15
    Likes Received:
    0
    Not sure what you could use to do this :S