1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Scrapping google and bans

Discussion in 'Black Hat SEO' started by yack09, Sep 3, 2009.

  1. yack09

    yack09 Newbie

    Joined:
    Jul 6, 2009
    Messages:
    48
    Likes Received:
    2
    HI

    How fast google bans IP if i scrap natural search results?
    i mean how many searches i can make until ip ban?
     
  2. bobbylove321

    bobbylove321 BANNED BANNED

    Joined:
    Nov 8, 2008
    Messages:
    1,987
    Likes Received:
    2,198
    There's no set limit on how much will get you banned. Some will get banned fast, some never get banned. I wouldn't be using my own IP if I was you. Anything that you think has a risk of getting your IP ban, then you should look for ways around it.
     
  3. justone

    justone Elite Member

    Joined:
    Oct 12, 2008
    Messages:
    1,516
    Likes Received:
    1,037
    Occupation:
    -
    Location:
    Europe
    I've been scraping millions of hits from google for a project of mine.

    Actually I got banned very fast when testing around, first they give you a captcha.
    You can solve it and google will still work (a cookie is placed).
    Next is (sometimes) a permanent captcha, one that comes back for every search result.
    Next is a temporary ban of the IP, I've witnessed that it came back (with captcha) some time after that.
    Next is a prolonged ban (no idea how long and if the subnet is affected).

    I've been using 200 proxies for the scraping and the problems were gone, I could run the tool for weeks without any outages.


    Mindfuck #1:
    Google is the largest scraper on earth, by far ! And they disallow that people scrape them. Isn't that just fucked up ?
     
  4. yack09

    yack09 Newbie

    Joined:
    Jul 6, 2009
    Messages:
    48
    Likes Received:
    2
    http://www.blackhatworld.com/blackhat-seo/members/22215-bobbylove321.html
    Nah, i dont think so. I was scrapping google suggest and it was averagin 4000 queries per ip before ban so i think there is similiar ban at normal results
     
  5. yack09

    yack09 Newbie

    Joined:
    Jul 6, 2009
    Messages:
    48
    Likes Received:
    2
    Thanks for answer justone,

    and

    Thats exactly what i thought :D
     
  6. the_demon

    the_demon Jr. Executive VIP

    Joined:
    Nov 23, 2008
    Messages:
    3,177
    Likes Received:
    1,563
    Occupation:
    Search Engine Marketing
    Location:
    The Internet
    I've been banned with a captcha or temp-ip after a few rapid hits. Or by rapidly querying deeply into the pages.