[scrape request]

Status
Not open for further replies.

bertalting

Newbie
Joined
May 3, 2014
Messages
18
Reaction score
1
Dear friends,

I really need help to scrape a website

transportation-services.findthebest.com

1,4 million addresses from transport companies in the US are listed here with email addresses.
When i use scraping bots i will be blocked within a few minutes.
So i thought maybe when i set the visiting time to the website at 10 seconds (1 mail per 10 seconds) i also will be blocked.

Do you guys know anything how to scrape this mf-er.


If anyone can scrape this for me i will ofcourse offer some $$$

 
I can code a custom scraper in about 2-3 days.
If interested pm me with an offer.
 
I can code a custom scraper in about 2-3 days.
If interested pm me with an offer.


There is one problem with that website. You will get blocked if you connection rate is too high.
I tried it with 1 connection per 10 seconds. Afterwards i was blocked :(
 
There is one problem with that website. You will get blocked if you connection rate is too high.
I tried it with 1 connection per 10 seconds. Afterwards i was blocked :(

proxies ?
-=-
 
then i need about 5000 proxies... anybody?
 
You can get 5000 public proxies in one day.
 
Status
Not open for further replies.
This thread has been auto closed due to the forum's thread age policy. Read more.
Back
Top