1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

I need proxies to scrape Google

Discussion in 'Proxies' started by playboy, Oct 19, 2011.

  1. playboy

    playboy Regular Member

    Joined:
    Mar 7, 2010
    Messages:
    266
    Likes Received:
    56
    Location:
    Bangkok
    I'm using squidproxies, but they don't let me scrape anymore. WTF.

    I need to scrape some stuff off Google. The proxies must allow scraping.

    Anybody know where I can get some scraping proxies?
     
  2. proxygo

    proxygo Jr. VIP Jr. VIP

    Joined:
    Nov 2, 2008
    Messages:
    20,232
    Likes Received:
    10,420
    Gender:
    Male
    Occupation:
    PROXIES .
    Location:
    UK - ALWAYS ON BHW
    Home Page:
  3. Autobuyer

    Autobuyer Registered Member

    Joined:
    Jun 11, 2011
    Messages:
    67
    Likes Received:
    26
    Gender:
    Male
    Occupation:
    Founder & CEO
    Location:
    United Kingdom
     
  4. benjaminp

    benjaminp Registered Member

    Joined:
    Aug 7, 2011
    Messages:
    67
    Likes Received:
    21
    Of course your private proxies are going to get banned by Google if your scraping massive amounts. Grab public ones for scraping.
     
  5. proxygo

    proxygo Jr. VIP Jr. VIP

    Joined:
    Nov 2, 2008
    Messages:
    20,232
    Likes Received:
    10,420
    Gender:
    Male
    Occupation:
    PROXIES .
    Location:
    UK - ALWAYS ON BHW
    Home Page:
     
    Last edited: Oct 20, 2011
  6. IPXPRT

    IPXPRT Jr. VIP Jr. VIP

    Joined:
    Oct 25, 2010
    Messages:
    3,856
    Likes Received:
    1,257
    Home Page:
  7. proxygo

    proxygo Jr. VIP Jr. VIP

    Joined:
    Nov 2, 2008
    Messages:
    20,232
    Likes Received:
    10,420
    Gender:
    Male
    Occupation:
    PROXIES .
    Location:
    UK - ALWAYS ON BHW
    Home Page:
    there u go try IPXPRT for a cheap
    service of a few hundred s/box proxies.

    mine isnt his service i provide 700-1000+
    google passed proxies a day
    with 1 payment sign up, hence my price
    is to cover long term, not month to month
     
  8. eternalfrost

    eternalfrost Regular Member

    Joined:
    Apr 9, 2011
    Messages:
    213
    Likes Received:
    54
    the problem is not with the proxy service itself, it is how you are using them. if you blast thousands of queries at google, they will blacklist that ip temporarily. keep repeating this and youll get blacklisted for longer/permanently.

    the point is, any ip number, from any provider, will get banned. you need to either scrape less aggressively, spread over a larger number of proxies, or ind an option to rotate through fresh addresses when they get blacklisted.
     
  9. proxygo

    proxygo Jr. VIP Jr. VIP

    Joined:
    Nov 2, 2008
    Messages:
    20,232
    Likes Received:
    10,420
    Gender:
    Male
    Occupation:
    PROXIES .
    Location:
    UK - ALWAYS ON BHW
    Home Page:
    i dont provide proxies for blasting
    there for scraping . replaced everyday
    so getting them band doesnt matter
     
  10. NIXMY

    NIXMY Regular Member Premium Member

    Joined:
    Sep 26, 2010
    Messages:
    481
    Likes Received:
    321
    Location:
    myproxylists.com
    Home Page:
    This is why I've system that does rotation/scraping 24/7/365 fully automatically. No need do nothing expect to check that the servers hardware is working ;)