Fastest way to harvest relevant URLs

[postcd]

Hi,

Im using URL Harvester 2008 to harvest URLs from the net.

It saves URLs from Google, but the problem is that google ban you when accessing it too many times per time period.

So my question is what software or method You are using to harvest URLs from the net. What is the fastest method?

Thank you much

 

[jesdon2]

Buy Scrapebox. You can scrape thousands of urls, with custom footprints, using random proxies and then remove all duplicates and sort the list by pagerank. Very useful tool.

 

[liangtvdotcom]

For example I wana scrape all the URLs links from www. xxx . com what keyword should i type?

"www. xxx . com /urls/"
or
site:www . xxx .com / urls ?

using scapebox? i tried alot of ways but cant get thousands of them

 

[keverone]

Buy Scrapebox. You can scrape thousands of urls, with custom footprints, using random proxies and then remove all duplicates and sort the list by pagerank. Very useful tool.

You can ... just go get scrapbox it is sold on BHW search it out..

 

[ericsson]