1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Has Google gone hard on proxies?

Discussion in 'Black Hat SEO' started by mlkykhan, Aug 19, 2014.

  1. mlkykhan

    mlkykhan Newbie

    Joined:
    Jan 19, 2012
    Messages:
    43
    Likes Received:
    7
    Location:
    Quetta
    Home Page:
    I am using 20 private proxies in Scrapebox and had my max connections set to 10% of proxies i.e 2 connections. But after harvesting 40k links google bans the proxies. I tried to harvest with 5% max connections i.e 1 connection. It completed a harvest of 140k links.

    Is it just me, my proxies or everyone else is facing difficulty with selecting 10% of proxies as Max connections?
     
  2. SerpEvil

    SerpEvil Supreme Member

    Joined:
    Jan 1, 2012
    Messages:
    1,494
    Likes Received:
    445
    Gender:
    Male
    Occupation:
    WebMaster
    Location:
    Top 3 On Google
    i usually use 3-5k public proxies for scraping,and i change them every few hours,so i get millions of urls.20 proxies is a very low number for scraping.
     
    • Thanks Thanks x 1
  3. American Trends

    American Trends Jr. VIP Jr. VIP

    Joined:
    Mar 14, 2014
    Messages:
    695
    Likes Received:
    107
    Occupation:
    White Hat SEO Company
    Location:
    American Trends
    I too face proxy ban most of the time. Even it happens frequently.
     
    Last edited: Aug 19, 2014
  4. cipango

    cipango Junior Member

    Joined:
    Mar 16, 2011
    Messages:
    178
    Likes Received:
    40
    40 proxies at 1 connection would be a better number for Google.
     
    • Thanks Thanks x 1
  5. mlkykhan

    mlkykhan Newbie

    Joined:
    Jan 19, 2012
    Messages:
    43
    Likes Received:
    7
    Location:
    Quetta
    Home Page:
    SB skips a public proxy if it dies during scraping or it doesn't return results for the keyword on which the proxy dies?

    I am asking because I heard a lot that scraping with public proxies is a bad idea.
     
  6. lover

    lover Jr. VIP Jr. VIP Premium Member

    Joined:
    Sep 25, 2007
    Messages:
    2,148
    Likes Received:
    811
    Location:
    BHW
    What proxy service do you use?
     
  7. DannyZhang

    DannyZhang Regular Member

    Joined:
    Apr 2, 2014
    Messages:
    233
    Likes Received:
    69
    Don't use scrapebox if you are doing heavy scrapping. It's great for the other functions but it's not really good when you need to scrape urls in the millions.

    You are better off with Gscraper of Hrefer
     
    • Thanks Thanks x 1
  8. watsonovedades

    watsonovedades Senior Member

    Joined:
    Mar 10, 2011
    Messages:
    922
    Likes Received:
    233
    Location:
    Mexico
    Maybe someting wrong with your proxies?
    are they private or semi-private? if they are semi-private you can be sharing the same proxies with heavy spammers marketers and they banned the proxies for all the rest of you (semi.private are shared between 2 or more users)
     
    • Thanks Thanks x 1
  9. delta_squadron

    delta_squadron Registered Member

    Joined:
    Mar 29, 2013
    Messages:
    55
    Likes Received:
    18
    With so few proxies you should avoid scraping with advanced search operators like inurl, etc in order to avoid proxy bans.
     
    • Thanks Thanks x 1
  10. BreaknBrix

    BreaknBrix Power Member

    Joined:
    Mar 25, 2014
    Messages:
    751
    Likes Received:
    4,189
    Location:
    NE US
    It's not rocket science man. You need wayyy more proxies.

    I usually scrape around 1000 then replace them every 4 hours or so.
     
    • Thanks Thanks x 1
  11. SerpEvil

    SerpEvil Supreme Member

    Joined:
    Jan 1, 2012
    Messages:
    1,494
    Likes Received:
    445
    Gender:
    Male
    Occupation:
    WebMaster
    Location:
    Top 3 On Google
    i use Shani service red-proxy.net/
     
    • Thanks Thanks x 1
  12. gu3sswh0

    gu3sswh0 Regular Member

    Joined:
    Mar 22, 2011
    Messages:
    287
    Likes Received:
    78
    Location:
    Strip Club
    For scraping you are better off using public proxy list that are Google passed.
     
    • Thanks Thanks x 1
  13. lover

    lover Jr. VIP Jr. VIP Premium Member

    Joined:
    Sep 25, 2007
    Messages:
    2,148
    Likes Received:
    811
    Location:
    BHW
    Great, i use same service but i scrape with Gscraper.
     
    • Thanks Thanks x 1
  14. SerpEvil

    SerpEvil Supreme Member

    Joined:
    Jan 1, 2012
    Messages:
    1,494
    Likes Received:
    445
    Gender:
    Male
    Occupation:
    WebMaster
    Location:
    Top 3 On Google
    gscraper is the only tool i use for scraping and is the best one on the market
     
    • Thanks Thanks x 1
  15. mlkykhan

    mlkykhan Newbie

    Joined:
    Jan 19, 2012
    Messages:
    43
    Likes Received:
    7
    Location:
    Quetta
    Home Page:
    Proxies are private. From NewIpNow.org. May be I should contact support.
     
  16. mlkykhan

    mlkykhan Newbie

    Joined:
    Jan 19, 2012
    Messages:
    43
    Likes Received:
    7
    Location:
    Quetta
    Home Page:


    Which public proxy service do you recommend? I tried scraping lots but only a few were google passed and died very quickly.
     
  17. laur.laurix

    laur.laurix Regular Member

    Joined:
    May 8, 2013
    Messages:
    408
    Likes Received:
    154
    Location:
    Mars
    Dont waste ur money on public proxies they burn fast. Buy 50 private proxies set sb to 2 connections rnd delay min 35 sec max 60 sec ( very important) and fire it up. As we speak my sb is harvesting 60-80 urls/ sec with 2 connections. Pros: the harvesting session is stable, u can scrape for days like this without stopping.
    Cons: u wont get 15k urls/s this way:)
     
    • Thanks Thanks x 1
  18. mlkykhan

    mlkykhan Newbie

    Joined:
    Jan 19, 2012
    Messages:
    43
    Likes Received:
    7
    Location:
    Quetta
    Home Page:
    Thank you. That is why I started with buying 20 private proxies. I guess I will buy some more now. I will test mixing private proxies with share-private proxies too and share result :)
     
  19. gary2

    gary2 Jr. VIP Jr. VIP Premium Member

    Joined:
    Jan 20, 2013
    Messages:
    969
    Likes Received:
    82
    Occupation:
    Inbound Marketer. Blogger. Author.
    Location:
    Near River
    proxie bans happen with everyone... i dont think there is a reason to worry...