ScrapeBox unable to harvest Google even with private proxies.

techaudible

Registered Member
Joined
Nov 17, 2014
Messages
92
Reaction score
18
Hi,

I have purchased 10 private proxies from instantproxies.com and tested them to make sure they work with Google. I have tried scraping tumblrs using those proxies (75 connections with 90 second timeout) selecting only Google as the engine. Attached is the screenshot of the error.

SB Harvest Fail.jpg

It is still unable to harvest any URLs and I am getting zero results.

Am I wrong in choosing Google as the engine as I have seen some posts which suggest using only Bing and Yahoo and to avoid Google for tumblr scraping?

I am running ScrapeBox on AWS EC2 free tier if that matters.

Edit:

I am also getting continuous errors with Yahoo and Bing. It went smoothly till 30k URLs and since then the errors started piling up from 1k to 7k without any successful harvest since the 30k.

CPU.jpg

I have noticed that the ScrapeBox showed CPU is at 100%, wondering that is what messing up.

Please help.

Regards
Naser
 
Last edited:
Your first screenshot, doesn't show you're using proxies?
Also, you're using too many connections for just 10 proxies. Use the detailed harvester instead(uses 1 connection).
Your proxies are most likely banned by Yahoo and Bing as well since you were hitting them hard.
 
Your first screenshot, doesn't show you're using proxies?
Also, you're using too many connections for just 10 proxies. Use the detailed harvester instead(uses 1 connection).
Your proxies are most likely banned by Yahoo and Bing as well since you were hitting them hard.

Hi,

It does show at the top, beside the harvester status.

I just used it once. Will the proxies fry on just one use? I had 75 connections as I was using VPS and some threads here suggested that configuration.

Its just messing with my brain :(
 
I recommend you to change the proxy provider. Instantproxies is very slow and unstable.
 
You murdered your IPs. lol They are all banned, hence the errors. You used 75 connections and then later 10 connections with 10 private proxies.

For bing you might get away with 1 or 2 connections for google you need 1 connection plus a big delay, maybe 30 or more (possibly a bit less) but if your using operators it gets blocked quicker.

I have a video
 
You murdered your IPs. lol They are all banned, hence the errors. You used 75 connections and then later 10 connections with 10 private proxies.

For bing you might get away with 1 or 2 connections for google you need 1 connection plus a big delay, maybe 30 or more (possibly a bit less) but if your using operators it gets blocked quicker.

I have a video

Thank you for suggestions loopline. Let's hope they get my proxies replaced.
 
Back
Top