1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How do you scrape forum urls?

Discussion in 'Black Hat SEO' started by nathandegrave, Nov 25, 2011.

  1. nathandegrave

    nathandegrave Newbie

    Joined:
    Feb 14, 2010
    Messages:
    17
    Likes Received:
    1
    Probably a simple question but I did some searching and can't find any clear answers. What software can you use to put in keywords to find relevant forums about your niche to post in?

    I have hrefer, scrapebox, and xrumer. Still learning them so not sure which capabilities each one have; can I scrape url's from any of those programs, which one, and how can I do it? Once I have them, can I use scrapebox to post to them? Or is that a job of Xrumer? Thanks and sorry for all the newbie questions lol
     
  2. SethTurin

    SethTurin Jr. VIP Jr. VIP

    Joined:
    Nov 19, 2011
    Messages:
    226
    Likes Received:
    123
    Occupation:
    President and CEO of Seth Turin Media, Inc. - Crea
    Home Page:
    So you are looking for forums about your keyword?
    I don't use scrapebox, but my understanding is that you would search for a footprint (like "powered by vbulletin") in addition to your keywords, and it would spit such a thing out. I know it's more complicated than that, but if you haven't gotten that far yet, there's a start!
     
  3. charmol

    charmol Junior Member

    Joined:
    Oct 7, 2011
    Messages:
    173
    Likes Received:
    84
    Location:
    ~| TrOpiCaL PaRaDiSe |~
    Hey, hrefer is by far the best way to scrape your forums, then use xrumer to post on them. You can also use scrapebox to scrape the URLs.

    Here is an example of a footprint you could use, to find phpBB forums:

    Code:
    <keyword> inurl:"viewforum.php?f="
    There is a thread somewhere in here that has literally thousands of footprints for finding blogs and forums, I'll need to have a look and see if I can find it and post back.

    Use xrumer to post on the forums and Scrapebox on the blogs.

    ~|ChaRoN|~
     
  4. charmol

    charmol Junior Member

    Joined:
    Oct 7, 2011
    Messages:
    173
    Likes Received:
    84
    Location:
    ~| TrOpiCaL PaRaDiSe |~
    OK, I found a couple of threads using google, was better than the forums search function:

    This one is a huge list of footprints for use with scrapebox, not only forums but guestbooks blogs etc.:

    Code:
    http://www.blackhatworld.com/blackhat-seo/black-hat-seo-tools/230815-scrapebox-footprints.html
    And this one says it's for forums to get profile backlinks.

    Code:
    http://www.blackhatworld.com/blackhat-seo/black-hat-seo/215132-some-forum-footprints-through-you-can-find-profile-backlinks.html
    If you want to find them in your niche, just put your keyword onto the end of the footprint, like in the example I gave above, and scrape with SB, I assume you can do this hrefer too, but I've never used it so you'd need to get someone else to confirm that.

    ~|ChaRoN|~