What search engine won't throw a captcha if I send like 10requests/second

**olgart** · 02-02-2013, 09:20 AM

as in the title.

**Pansophical** · 02-02-2013, 09:26 AM

The best search engines that have a high amount of users will have CAPTCHA. To be honest, I don't think there are any that doesn't use CAPTCHA services if there are too many requests.

**bubbaranks** · 02-02-2013, 02:48 PM

Just use proxies you will not face this problem, I harvest at 100 threads with 1500 proxies and never get hit for captcha, the only programme I have ever seen ask for captcha is spyglass, I think that was because I had the proxy settings wrong.

**no4h~** · 02-02-2013, 03:44 PM

Originally Posted by bubbaranks

Just use proxies you will not face this problem, I harvest at 100 threads with 1500 proxies and never get hit for captcha, the only programme I have ever seen ask for captcha is spyglass, I think that was because I had the proxy settings wrong.

Came here to say exactly this.

Use proxies. They're cheap, and you'll stop getting the captcha's completely.

**BHopkins** · 02-02-2013, 04:14 PM

Gotta use proxies if you're serious about scraping.

**ChEcKeD** · 02-02-2013, 06:35 PM

Make your own search engine.

**olgart** · 02-03-2013, 07:43 AM

Thanks

.

**myownhero** · 02-03-2013, 07:52 AM

Think of it this way: any search engine that didn't throw up captchas for making 10 requests/second from one IP probably wouldn't be around long enough to abuse anyways. Proxies are definitely the way to go here.

**jimdones** · 02-04-2013, 06:45 PM

need a truckload of proxies. private proxies are useless (as you can never buy that many). scrapebox has some proxy sources, plus you can add some sources of your own, buy proxy lists from HMA and so on.