Scraping and proxies

Discussion in 'BlackHat Lounge' started by silenthawk, Mar 25, 2012.

  1. silenthawk

    silenthawk Newbie

    Joined:
    Mar 21, 2012
    Messages:
    36
    Likes Received:
    3
    Hi, Need some clarifications about Scrapebox and proxies.
    I got some proxies from this forum and checked via SB and filtered google proxies. Then i started scraping the urls i needed and well almost 95% proxies got 302 error ip blocked?
    My KWs are like inurl:sitedotcom keywords

    Q. How do you guys scrape? which proxies do you use?
    Suggestions much appreciated!
     
  2. Knoxgates

    Knoxgates Supreme Member

    Joined:
    Aug 9, 2008
    Messages:
    1,266
    Likes Received:
    919
    Your proxies will be burned fast if you use "Inurl" Operator.
    Guys who do it have more then 1000 public proxies at a time.
     
  3. silenthawk

    silenthawk Newbie

    Joined:
    Mar 21, 2012
    Messages:
    36
    Likes Received:
    3
    Thinking of doing it manually cz i only use it with inurl, site:, intitle etc...
     
  4. mrankin

    mrankin Jr. VIP Jr. VIP

    Joined:
    Oct 17, 2008
    Messages:
    1,287
    Likes Received:
    592
    Location:
    Australia
    Home Page:
    The 302 error or IP Blocked error is due to too many queries from that IP within a specified time frame. The block usually stays in place for about 15 minutes or so (depending on useage).

    Only happens occasionally with my users, but when it does it's because I have at least 2 users hammering Google to scrape results. Never seen the issue with Exclusive proxies though.
     
  5. silenthawk

    silenthawk Newbie

    Joined:
    Mar 21, 2012
    Messages:
    36
    Likes Received:
    3
    Really??
    I have a dynamic IP and i often use my own IP for scraping and dies after ONLY one keyword scrape. As i mentioned above that my kws contain inurl, and intitle etc and using these get proxies ban in a hurry.
    If your exclusive proxies never give error i am interested in trying them.