1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

how to scrape the url's of a forum using scrapebox?

Discussion in 'Black Hat SEO' started by xrumerexpert, Sep 16, 2010.

  1. xrumerexpert

    xrumerexpert Newbie

    Joined:
    Sep 2, 2010
    Messages:
    25
    Likes Received:
    0
    Hmmmm...My question is not getting posted!!!!

    So, ill make it short...

    To scrape all the urls from a forum using scrapebox(without keywords, just using footprint), do i need private proxies ?

    please help...thanks :)
     
    Last edited: Sep 16, 2010
  2. hitman247

    hitman247 Executive VIP Premium Member

    Joined:
    Oct 12, 2008
    Messages:
    739
    Likes Received:
    1,851
    Occupation:
    Full Time IM
    Location:
    Your Six O'clock
    Home Page:
    Edited.
     
    Last edited: Sep 16, 2010
  3. washington

    washington Newbie

    Joined:
    Oct 4, 2009
    Messages:
    43
    Likes Received:
    2
    i dont know tooo !:)
     
  4. virtualc08

    virtualc08 Supreme Member

    Joined:
    Mar 23, 2010
    Messages:
    1,379
    Likes Received:
    951
    Use custom foost prints like "Powered by vbulletin" or "Powered by phpbb"
     
  5. rprabu

    rprabu Power Member

    Joined:
    Feb 11, 2009
    Messages:
    580
    Likes Received:
    261
    Location:
    Home :-)
    public proxies will do..
     
  6. rprabu

    rprabu Power Member

    Joined:
    Feb 11, 2009
    Messages:
    580
    Likes Received:
    261
    Location:
    Home :-)
    Looks like OP is looking to scrape all the URLs of a single forum..
    Correct me if wrong
     
  7. hitman247

    hitman247 Executive VIP Premium Member

    Joined:
    Oct 12, 2008
    Messages:
    739
    Likes Received:
    1,851
    Occupation:
    Full Time IM
    Location:
    Your Six O'clock
    Home Page:
    No, the public proxies should be fine for an scraping. Use private proxies for posting. And consider changing your BHW name to something else :)
     
  8. xrumerexpert

    xrumerexpert Newbie

    Joined:
    Sep 2, 2010
    Messages:
    25
    Likes Received:
    0
    i WANT TO GET URL'S FROM A SPECIFIC FORUM LIKE BHW:) WHAT TO DO?


     
  9. virtualc08

    virtualc08 Supreme Member

    Joined:
    Mar 23, 2010
    Messages:
    1,379
    Likes Received:
    951
    Ahh ok ok ... click on custom foot print and in the keywords type in the domain name and hit harvest and it will harvest all the URLs of that forum...
     
  10. virtualc08

    virtualc08 Supreme Member

    Joined:
    Mar 23, 2010
    Messages:
    1,379
    Likes Received:
    951
    lol:d:d
     
  11. No Limits

    No Limits Junior Member

    Joined:
    Feb 20, 2009
    Messages:
    111
    Likes Received:
    79
    Now, THAT'S funny.

    So, Xrumer expert, did you figure it out? Post your results...
     
  12. xrumerexpert

    xrumerexpert Newbie

    Joined:
    Sep 2, 2010
    Messages:
    25
    Likes Received:
    0
    but its getting only 1000 results/keyword ?????


     
  13. xiphre

    xiphre Regular Member

    Joined:
    Jun 9, 2007
    Messages:
    290
    Likes Received:
    84
    Location:
    EU
    Why would you need to use proxies to scrape a forum lol - done it 1000s of times without problems. Just use a software like pagesucker or use "wget" in linux (if you want the content that is..). Now if you were talking about only indexed pages its of course another thing..