1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

ScrapeBox unable to harvest Google even with private proxies.

Discussion in 'Black Hat SEO Tools' started by techaudible, Aug 11, 2016.

  1. techaudible

    techaudible Registered Member

    Joined:
    Nov 17, 2014
    Messages:
    78
    Likes Received:
    17
    Gender:
    Male
    Location:
    India
    Hi,

    I have purchased 10 private proxies from instantproxies.com and tested them to make sure they work with Google. I have tried scraping tumblrs using those proxies (75 connections with 90 second timeout) selecting only Google as the engine. Attached is the screenshot of the error.

    SB Harvest Fail.jpg

    It is still unable to harvest any URLs and I am getting zero results.

    Am I wrong in choosing Google as the engine as I have seen some posts which suggest using only Bing and Yahoo and to avoid Google for tumblr scraping?

    I am running ScrapeBox on AWS EC2 free tier if that matters.

    Edit:

    I am also getting continuous errors with Yahoo and Bing. It went smoothly till 30k URLs and since then the errors started piling up from 1k to 7k without any successful harvest since the 30k.

    CPU.jpg

    I have noticed that the ScrapeBox showed CPU is at 100%, wondering that is what messing up.

    Please help.

    Regards
    Naser
     
    Last edited: Aug 11, 2016
  2. Disloyal

    Disloyal Jr. VIP Jr. VIP

    Joined:
    May 3, 2012
    Messages:
    356
    Likes Received:
    221
    Occupation:
    Geek
    Location:
    Ethernet Cable
    Your first screenshot, doesn't show you're using proxies?
    Also, you're using too many connections for just 10 proxies. Use the detailed harvester instead(uses 1 connection).
    Your proxies are most likely banned by Yahoo and Bing as well since you were hitting them hard.
     
  3. techaudible

    techaudible Registered Member

    Joined:
    Nov 17, 2014
    Messages:
    78
    Likes Received:
    17
    Gender:
    Male
    Location:
    India
    Hi,

    It does show at the top, beside the harvester status.

    I just used it once. Will the proxies fry on just one use? I had 75 connections as I was using VPS and some threads here suggested that configuration.

    Its just messing with my brain :(
     
  4. AleeGS

    AleeGS Regular Member

    Joined:
    Jul 15, 2015
    Messages:
    312
    Likes Received:
    85
    Location:
    ARG
    I recommend you to change the proxy provider. Instantproxies is very slow and unstable.
     
    • Thanks Thanks x 1
  5. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,726
    Likes Received:
    1,993
    Gender:
    Male
    Home Page:
    You murdered your IPs. lol They are all banned, hence the errors. You used 75 connections and then later 10 connections with 10 private proxies.

    For bing you might get away with 1 or 2 connections for google you need 1 connection plus a big delay, maybe 30 or more (possibly a bit less) but if your using operators it gets blocked quicker.

    I have a video
     
    • Thanks Thanks x 1
  6. techaudible

    techaudible Registered Member

    Joined:
    Nov 17, 2014
    Messages:
    78
    Likes Received:
    17
    Gender:
    Male
    Location:
    India
    Thank you for suggestions loopline. Let's hope they get my proxies replaced.