1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Scraping and proxies

Discussion in 'BlackHat Lounge' started by silenthawk, Mar 25, 2012.

  1. silenthawk

    silenthawk Newbie

    Joined:
    Mar 21, 2012
    Messages:
    36
    Likes Received:
    3
    Hi, Need some clarifications about Scrapebox and proxies.
    I got some proxies from this forum and checked via SB and filtered google proxies. Then i started scraping the urls i needed and well almost 95% proxies got 302 error ip blocked?
    My KWs are like inurl:sitedotcom keywords

    Q. How do you guys scrape? which proxies do you use?
    Suggestions much appreciated!
     
  2. Knoxgates

    Knoxgates Supreme Member

    Joined:
    Aug 9, 2008
    Messages:
    1,266
    Likes Received:
    918
    Your proxies will be burned fast if you use "Inurl" Operator.
    Guys who do it have more then 1000 public proxies at a time.
     
  3. silenthawk

    silenthawk Newbie

    Joined:
    Mar 21, 2012
    Messages:
    36
    Likes Received:
    3
    Thinking of doing it manually cz i only use it with inurl, site:, intitle etc...
     
  4. mrankin

    mrankin Jr. VIP Jr. VIP Premium Member

    Joined:
    Oct 17, 2008
    Messages:
    1,215
    Likes Received:
    571
    Location:
    Australia
    Home Page:
    The 302 error or IP Blocked error is due to too many queries from that IP within a specified time frame. The block usually stays in place for about 15 minutes or so (depending on useage).

    Only happens occasionally with my users, but when it does it's because I have at least 2 users hammering Google to scrape results. Never seen the issue with Exclusive proxies though.
     
  5. silenthawk

    silenthawk Newbie

    Joined:
    Mar 21, 2012
    Messages:
    36
    Likes Received:
    3
    Really??
    I have a dynamic IP and i often use my own IP for scraping and dies after ONLY one keyword scrape. As i mentioned above that my kws contain inurl, and intitle etc and using these get proxies ban in a hurry.
    If your exclusive proxies never give error i am interested in trying them.