1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Scrapebox can't harvest google urls only

Discussion in 'Black Hat SEO' started by tibbbs, Oct 30, 2015.

  1. tibbbs

    tibbbs Junior Member

    Joined:
    Jan 12, 2014
    Messages:
    111
    Likes Received:
    6
    Location:
    http://www.telekinesis.us/
    Home Page:
    I'm using Scrapebox. I'm still trying out on not and I'm not much of a pro.
    The only problem I have right now is that Scrapebox isn't harvesting any URL from google. It's harvesting from Bing, Yahoo, etc easily, but not google.
    The proxies I'm using are google approved according to Scrapebox's Proxy Tester. I'm using 22 Google approved proxies.
    Any help to further verify or troubleshoot the problem is much appreciated.
    PS. Forgot to mention, it's given an error 403. I've tried with no proxies at all and still it can't extract URL's from google.
     
  2. xrfanatic

    xrfanatic Jr. VIP Jr. VIP

    Joined:
    Aug 28, 2010
    Messages:
    419
    Likes Received:
    176
    Location:
    http://bit.ly/slb64
    Home Page:
    Do you have up to date version of Scrapebox ? Also have you tried scraping on virgin IP ? If not, give it a try, google tends to ban IPs very quickly these days so it might be a good idea to make a test scrape without proxies on up to 5 threads to see if it generates any results.
     
  3. bilbo

    bilbo Power Member

    Joined:
    Jan 26, 2009
    Messages:
    647
    Likes Received:
    1,136
    Occupation:
    an actor on wizard of oz - the 3rd munchkin
    Location:
    middle earth
    or go in the scrapebox thread...........or email support.................
     
  4. the_demon

    the_demon Jr. Executive VIP

    Joined:
    Nov 23, 2008
    Messages:
    3,220
    Likes Received:
    1,591
    Occupation:
    Search Engine Marketing
    Location:
    The Internet
    You'll need a lot of proxies, google is really good and fast at banning proxies.
     
  5. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,806
    Likes Received:
    2,027
    Gender:
    Male
    Home Page:
    Assuming you have gone to settings >> harvester engine configuration >> import >> download default engines - and your engines are not up to date, then it means that your ips are banned.
    There are different kinds of IP bans with Google. The proxy tester only tests against basic keyword search for google. However google can simultaneously allow basic keyword scraping and block other queries, especially advanced operators.

    Google can block on many levels for multiple different things. Here is a video further explains it:
    https://www.youtube.com/watch?v=P9CbGhfc1aY
     
  6. callingsupport

    callingsupport Newbie

    Joined:
    Oct 31, 2015
    Messages:
    6
    Likes Received:
    1
    Proxies are banned, that's for sure. Like they said, you have to at least have virgin proxies to get results from google as they are really bad nowadays.