how to scrape the url's of a forum using scrapebox?

xrumerexpert

Newbie
Joined
Sep 2, 2010
Messages
25
Reaction score
0
Hmmmm...My question is not getting posted!!!!

So, ill make it short...

To scrape all the urls from a forum using scrapebox(without keywords, just using footprint), do i need private proxies ?

please help...thanks :)
 
Last edited:
Use custom foost prints like "Powered by vbulletin" or "Powered by phpbb"
 
No, the public proxies should be fine for an scraping. Use private proxies for posting. And consider changing your BHW name to something else :)
 
Ahh ok ok ... click on custom foot print and in the keywords type in the domain name and hit harvest and it will harvest all the URLs of that forum...
 
No, the public proxies should be fine for an scraping. Use private proxies for posting. And consider changing your BHW name to something else :)

Now, THAT'S funny.

So, Xrumer expert, did you figure it out? Post your results...
 
but its getting only 1000 results/keyword ?????


Ahh ok ok ... click on custom foot print and in the keywords type in the domain name and hit harvest and it will harvest all the URLs of that forum...
 
Why would you need to use proxies to scrape a forum lol - done it 1000s of times without problems. Just use a software like pagesucker or use "wget" in linux (if you want the content that is..). Now if you were talking about only indexed pages its of course another thing..
 
Back
Top