1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

What search engine won't throw a captcha if I send like 10requests/second

Discussion in 'Black Hat SEO' started by olgart, Feb 2, 2013.

  1. olgart

    olgart Newbie

    Joined:
    Jan 31, 2012
    Messages:
    49
    Likes Received:
    1
    as in the title.
     
  2. Pansophical

    Pansophical Newbie

    Joined:
    Feb 16, 2012
    Messages:
    14
    Likes Received:
    0
    The best search engines that have a high amount of users will have CAPTCHA. To be honest, I don't think there are any that doesn't use CAPTCHA services if there are too many requests.
     
  3. bubbaranks

    bubbaranks Junior Member

    Joined:
    Jan 29, 2013
    Messages:
    187
    Likes Received:
    23
    Occupation:
    Living off big G
    Location:
    UK
    Just use proxies you will not face this problem, I harvest at 100 threads with 1500 proxies and never get hit for captcha, the only programme I have ever seen ask for captcha is spyglass, I think that was because I had the proxy settings wrong.
     
    • Thanks Thanks x 1
  4. no4h~

    no4h~ Regular Member

    Joined:
    Apr 11, 2011
    Messages:
    456
    Likes Received:
    330
    Came here to say exactly this.

    Use proxies. They're cheap, and you'll stop getting the captcha's completely.
     
  5. BHopkins

    BHopkins Moderator Staff Member Moderator Jr. VIP

    Joined:
    Dec 31, 2010
    Messages:
    2,311
    Likes Received:
    1,387
    Gender:
    Male
    Occupation:
    ORM and SEO company owner
    Location:
    California
    Home Page:
    Gotta use proxies if you're serious about scraping.
     
  6. ChEcKeD

    ChEcKeD Senior Member

    Joined:
    Aug 27, 2012
    Messages:
    984
    Likes Received:
    467
    Occupation:
    ☺☺☺☺
    Location:
    ☺☺☺☺
    Make your own search engine.
     
  7. olgart

    olgart Newbie

    Joined:
    Jan 31, 2012
    Messages:
    49
    Likes Received:
    1
    Thanks :).
     
  8. myownhero

    myownhero Power Member Premium Member

    Joined:
    Mar 13, 2012
    Messages:
    763
    Likes Received:
    713
    Occupation:
    SEO Analyst / Link Builder
    Location:
    United States
    Home Page:
    Think of it this way: any search engine that didn't throw up captchas for making 10 requests/second from one IP probably wouldn't be around long enough to abuse anyways. Proxies are definitely the way to go here.
     
  9. jimdones

    jimdones Junior Member

    Joined:
    May 25, 2012
    Messages:
    116
    Likes Received:
    19
    need a truckload of proxies. private proxies are useless (as you can never buy that many). scrapebox has some proxy sources, plus you can add some sources of your own, buy proxy lists from HMA and so on.