1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Google detect footprints and ban proxies. How do you scrape these days?

Discussion in 'Black Hat SEO' started by Penumbra, Nov 3, 2015.

  1. Penumbra

    Penumbra Power Member

    Joined:
    Apr 23, 2014
    Messages:
    738
    Likes Received:
    225
    Location:
    Antarctica
    I tried first with gsa ser footprints, then tried some custom ones, but scrapebox wont scrape at all, google detects it and block it. I tried elite google passed proxies, then 250 backconnect proxies that change every 10 minutes but still same, what you are doing to avoid this problem, and problem is without doubt footprints.
     
  2. TheGypsy

    TheGypsy Newbie

    Joined:
    Aug 15, 2014
    Messages:
    25
    Likes Received:
    9
    Location:
    Madrid
    You may try to lower your scraping threads or increase the number of proxies for your thread. I haven't used private proxies for a while now for scraping but I saw people recommending a bunch of proxies per thread. Some proxy providers even state that their proxies aren't for scraping anymore, you may check the small print in their ToS page.
     
  3. SuperLinks

    SuperLinks Elite Member

    Joined:
    Jul 14, 2008
    Messages:
    2,903
    Likes Received:
    847
    Location:
    New York
    Scraping sure is tougher than it used to be so I'd love to hear feedback on what others are doing that works.

    Personally I've got a few different VPS's and have my delay's set very high and run it nearly around the clock without problems. The main issue though is it's not producing quick results.
     
  4. pixelgrinder

    pixelgrinder Jr. VIP Jr. VIP

    Joined:
    Apr 1, 2008
    Messages:
    657
    Likes Received:
    340
    More proxies :p
     
    • Thanks Thanks x 1
  5. skyflash

    skyflash Jr. VIP Jr. VIP

    Joined:
    Jan 28, 2014
    Messages:
    247
    Likes Received:
    33
    Google blocks IPs temporary and only if it detects spammy activities, may be you can try virgin fully dedicated proxies.
     
  6. FireSoftLimited

    FireSoftLimited Junior Member

    Joined:
    Apr 27, 2013
    Messages:
    119
    Likes Received:
    25
    Location:
    Google UK
    That is really bad news as I wanted to ask about good proxy footprints for ahref for 2015 :/ (I have to start doing some SEO again and after 3 years break).

    What kind of waiting time are we talking about (between loading next result page for IP) ? 10-90 seconds ?