1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

My scraprbox is not scraping URLsfrom google

Discussion in 'Black Hat SEO' started by thesmashge, Sep 26, 2010.

  1. thesmashge

    thesmashge Power Member

    Joined:
    Jan 14, 2009
    Messages:
    520
    Likes Received:
    519
    If i try to scrape some footprints ,My scrapebox is not scraping URLs from google...

    It scrapes from Bing,yahoo and the other search engines but not from google(the one that matters)

    What am i doing wrong?Does something break in scrapebox after google turned instant?
     
  2. Billw

    Billw Junior Member

    Joined:
    Jan 28, 2008
    Messages:
    182
    Likes Received:
    191
    You need some private proxies, G is blocking a lot of IPs because of overused proxies.
     
    • Thanks Thanks x 1
  3. thesmashge

    thesmashge Power Member

    Joined:
    Jan 14, 2009
    Messages:
    520
    Likes Received:
    519
    Thanks billw...but i would have only used scraping google once or twice and taht too with public proxies....anyone with same experience?
     
  4. redstone.1337

    redstone.1337 BANNED BANNED Jr. VIP Premium Member

    Joined:
    Dec 30, 2009
    Messages:
    1,259
    Likes Received:
    999
    Lots of people use Public Proxies so most of the times they are blocked soon. A guy here on BHW is selling Proxies List Subscription for 12.5$ a month. I use his proxies for scraping.

    Also, make sure Google is checked under the "Select Engines & Proxies" :)
     
  5. royalmice

    royalmice BANNED BANNED

    Joined:
    Aug 23, 2007
    Messages:
    1,186
    Likes Received:
    983
    Same here, having allot of problem lately scraping and i use premium private proxies. Seems only Bing is working and sometimes yahoo
     
  6. matt1972

    matt1972 Regular Member

    Joined:
    Nov 19, 2009
    Messages:
    499
    Likes Received:
    206
    Occupation:
    To make money
    Location:
    192.168.0.1
    You need to either get some private proxies (don't hammer them to hard or G will soft ban them) or go scrape some public proxies from places like Proxyfire or something then run them through the proxy checker. If they all come up green then your good to go for awhile.
     
  7. snaman

    snaman Newbie

    Joined:
    Sep 11, 2010
    Messages:
    49
    Likes Received:
    11
    Occupation:
    breaking necks and cashing checks
    I've been scraping with public ones and it's OK. Maybe you aren't refreshing them often enough?
     
  8. PetreTerror

    PetreTerror Newbie

    Joined:
    Dec 1, 2009
    Messages:
    17
    Likes Received:
    0
    it is working for me , but sometimes , it won't scrape because of proxys ...