Scrapebox Proxyrotator API help

Hello

I'm trying to setup a rotating proxy that i just purchased from ProxyRotator - but I'm not able to set it up on Scrapebox to successfully harvest from Google - it works for Bing but not for google for some strange reason

I put it in the edit field as IPort:Userass and it works for bing - i noticed there's something on their site about an API but I can't figure out how to use that - it might be possible that it requires an API with each request but I can't figure out how to put that into scrapebox - and the company is of no help

Anyone have any idea?

Ok i Just realized - I am able to use the Detailed Harvester (single thread) and get results from Google - but not the custom harvester - even with all the thread connections down to 5 or less it doesn't seem to work - What gives?

I was told "The Proxy Gateways require you to send the Basic Authentication header with your requests to perform user/pass authentication"

How do you put this into scrapebox? I see additional header settings under the engine config - I put Proxy-Authorization Basic Userass but it doesn't seem to work - Am i using the right syntax?

Its not going to work for bing and fail for google and be related to the user pass setup, it would work for everything or work for nothing if it was that.

The detailed harvester retries indefinitely, where as the custom one has a limit and then skips the keyword.

So duplicate your proxy gateway ip at least 10 times in the proxy box. Then go to settings >> connections timeouts and other settings >> addtional harvester options >> proxy retries - and max out the proxy retries.

then try it. At a point the custom harvester will skip keywords still if it exhausts the retries but your just running into a bunch of google blocked ips is the only issue.

Thats common with rotating proxies because google is the most sought after and thus the most used so the ips get blocked the fastest and google bans faster then bing anyway.

Jérémyzorro said:

Hello i have a problem with scrapebox
I can't scrape url with google. The other search engines work, but not google. I use anonymous private proxies. Why does Google not scrape url?

Click to expand...

Most probably the ip(s) are blocked by google.

So if you go to help >> show error log >> harvester - what are the errors? If its 302, 503 or 429 then that means the ip is blocked.

I know that with Storm Proxies the biggest issue is that if you reboot your PC or router and your IP changes and this doesn't match your gateway IP. Essentially if the source IP does not tally on Storm Proxies NONE OF THE PROXIES WORK.

MrThingy said:

I know that with Storm Proxies the biggest issue is that if you reboot your PC or router and your IP changes and this doesn't match your gateway IP. Essentially if the source IP does not tally on Storm Proxies NONE OF THE PROXIES WORK.

Click to expand...

Could be, I have always had a static IP. Do you have a dynamic ip?

There are services that you can use, just ask storm proxy what they recommend. I know I did this back in the day when I had an FTP server but thats been more then a decade, so I Cant' remember but I know they still exist. Storm proxies will have a solution for this most likely.