1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Scrapebox Error 302 IP Blocked

Discussion in 'Black Hat SEO' started by Maddrax, Jul 19, 2011.

  1. Maddrax

    Maddrax Registered Member

    Joined:
    Jun 26, 2011
    Messages:
    71
    Likes Received:
    12
    Hey guys,

    I have been fiddeling around lately a little bit with Scrapebox. Still trying to master the art of footprints and how to harvest well :) Lately, I am experiencing a problem:

    Whenever I try to harvest URLs Scrapebox says that my proxies are blocked by google. I have 10 Proxies from Squid Proxies and 10 from Yourprivateproxy to test them out and all proxies seemed to die after a little harvest (30.000 URLs).

    I know I should do the heavy lifting with public proxies but was a little lazy harvesting them, however, I think private proxies should last longer.

    Also, if I browse with Firefox those 'supposedly' dead proxies are working just fine, I can access Google and do my searches. So I think there might be a problem with my Scrapebox settings. I am still a newbie so definately I am missing something and thought you could give me a hint.

    I tried to set different connections starting with 90 which gave me around 160URLs/s but lowering quickly to 100 and below, is that normal?

    Thanks for your help.
     
  2. cyberzilla

    cyberzilla Elite Member Premium Member

    Joined:
    Nov 15, 2009
    Messages:
    2,204
    Likes Received:
    3,364
    Location:
    zeta reticuli
    Harvesting using private proxies is not recommended. Search engines treat both public and private in the same manner when it comes to scraping. They soft block the IP at one point when the proxies reach the maximum search queries threshold. No body knows exactly how many queries SEs accepts per day from an IP. But the count varies between SEs. For example, Yah0o allows you to do more automated searches than G0ogle.

    So either use bunch of pubic proxies for harvesting or use just Yah0o alone for scraping. You can even scrape from Yah00 without proxies for longer period.
     
    • Thanks Thanks x 2
  3. Maddrax

    Maddrax Registered Member

    Joined:
    Jun 26, 2011
    Messages:
    71
    Likes Received:
    12
    Thanks for your reply! The only thing that astounded me was that I could and still can access google manually via my browser over the blocked proxies...

    But probably Google treats Scrapebox's access differently or something like that.

    Is there a way to reach more than 150 URLs/s with public proxies? I have a VPS from xsserver, the $35 version so that should do it hardwarewise.
     
    Last edited: Jul 19, 2011