1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Is there any way (or tool) to scrape threads from forum and post in another?

Discussion in 'Black Hat SEO Tools' started by gorgonite, Dec 25, 2008.

  1. gorgonite

    gorgonite BANNED BANNED

    Joined:
    Dec 20, 2008
    Messages:
    54
    Likes Received:
    1
    Hi guys..

    my title says pretty much what I'm trying to find out..

    I saw a tool once that scraped a forum, but everythin in a .sql file and then you just had to dump it in yoir db, getting all the posts, usernames.. everything...

    is there a "free" tool out there?
     
  2. scriptkiddies

    scriptkiddies Junior Member

    Joined:
    Aug 5, 2008
    Messages:
    121
    Likes Received:
    207
    mysql :)
    phpmyadmin !
     
  3. gorgonite

    gorgonite BANNED BANNED

    Joined:
    Dec 20, 2008
    Messages:
    54
    Likes Received:
    1

    yes, but how do I get the dump in the first place in order to import it in my db with phpmyadmin?
     
  4. 195471

    195471 Regular Member

    Joined:
    Oct 11, 2008
    Messages:
    417
    Likes Received:
    261
    Yeah, the "free" tool is one that you code yourself. :)

    To my knowledge, there's no tool that can scrape any forum. Scraping a web site requires that you have access to the site's HTML code (which you can get by viewing the source). The scraper has to be coded to look for certain parts of the target site's HTML code, or else it won't work. If and when the target site updates its HTML, the scraper will also need to be updated.

    If you want to get into scraping, have a look at this book:

    Code:
    http://nostarch.com/webbots.htm
    You might also want to check out the services of this company:

    Code:
    http://www.screen-scraper.com/
     
  5. bbyte

    bbyte Registered Member

    Joined:
    Oct 24, 2008
    Messages:
    86
    Likes Received:
    70
    Here's the eBook that's mentioned in the previous post, a great read if you're into stuff like this:

    Code:
    http://www.mediafire.com/download.php?ghdxmbmmzym
     
    • Thanks Thanks x 3
  6. gorgonite

    gorgonite BANNED BANNED

    Joined:
    Dec 20, 2008
    Messages:
    54
    Likes Received:
    1

    thanks buddy.. downloading now...
     
  7. wingchun3

    wingchun3 Newbie

    Joined:
    Nov 1, 2008
    Messages:
    26
    Likes Received:
    11
    i have made a tool that scrapes forum posts and then adds to my forum

    i used many of the libs form that book, check out the website for the book and all the tools you need to build you scrper from are there

    also you will need to google a few examples of loggin into a site, extracting certian post keys and then using these in your curl script

    the basic process is

    first go around registering accounts on various forums (most use capthca)

    make a little function to

    1: login into the forum with your username - password
    2: extract any post keys or session ids
    3: then post up your new topic ( or comment on existing threads)


    take alook at the auto form commenter i posted up in the tools sction, this just coments to random threads in vb forums

    you can very easily modify this to post new threads in stead of commenting on existing threads

    the problem is tho if your spamming rndom crap, its easy to hide in exisitng posts, instead of starting your own new threads

    i'm just working on my forum poster now, making more funtcion s to post to other forums including vb, phpbb3 and smf

    if you make any more scipts or addons post them up here for sharing or hit me up to share some of my tools
     
  8. oqsales

    oqsales Junior Member

    Joined:
    Jul 17, 2008
    Messages:
    160
    Likes Received:
    4
    I'd like to pay someone to scrape and populate my SMF
    forum with posts related to my websites topic, scraped from similar forums. Posts should be auto-rewritten.

    If this works out well I have many other sties I'd like to do this for.
     
  9. Tirade

    Tirade Registered Member

    Joined:
    Jul 22, 2009
    Messages:
    70
    Likes Received:
    27

    I realize that this is a very old thread, but I'd really appreciate if someone could please upload this ebook (the mediafire link is obviously down after all of this time). I've already tried using the search function and haven't been able to find this anywhere.
     
  10. 195471

    195471 Regular Member

    Joined:
    Oct 11, 2008
    Messages:
    417
    Likes Received:
    261
    Here you go:

    Code:
    http://www.mediafire.com/?6mece08nshn6e6z
     
    • Thanks Thanks x 1
  11. 195471

    195471 Regular Member

    Joined:
    Oct 11, 2008
    Messages:
    417
    Likes Received:
    261
    double post
     
    Last edited: Jan 5, 2011