Scrapebox Proxy Question

jb2008

Senior Member
Joined
Jul 15, 2010
Messages
1,158
Reaction score
888
I've always scraped Yahoo only because of the need for proxies when scraping Google, but for some reason Yahoo is messing up with me giving 403 errors all over the place. I am wondering if this is due to the Yahoo API change which is due, er, today.

Anyway, whatever the case, I need to scrape Google as Yahoo doesn't appear to allow special characters such as those with accents. Or as I said it may just be Yahoo shutting down altogether.

For Google I need proxies but I have always found that I get a REALLY shitty success rate in terms of the number of keywords successfully completed at the end of a harvest, even with the excellent proxies from proxygo, then tested/filtered in SB and high latency proxies removed. The public proxies just seem to die to easily. Even when I use around 600 working proxies all with latency of under 1000 (!! ) I still get most of my keywords in the red (not completed).

Now my question is, if a proxy dies mid-keyword, or even at the beginning of a keyword, shouldn't the proxy be rotated and the same keyword be scraped again, until completion? Because I seem to be getting a hell of a lot of red 'not completed' keywords in Google when this darn thing should be rotating. How can you say the harvest is 'completed' when 85% of the keywords are not done due to proxies either dying or timing out?
 
I am interested in this subject too as I have bad results with Google when harvesting using public proxies, or it harvest too little than it should or not at all when results should be.
 
u would have thought if the proxie died mid keyword search
it would switch to the next live proxies and continue
rinse and repeat - as i dont use scrapebox as a tool only
a tester im guessing if the proxie fails mid scrape its going
to the next proxie and keyword ? if thats so
its a fix need for s/box to roate the keyword only after a successful
scrape not because the proxie died -- agreed ?
 
YES - that's exactly what I was thinking.

At the moment it just seems to go to the next keyword, leaving the previous keyword not complete.
 
If I remember correctly, the proxy management cycles to the next working proxy on fail when doing its magic in just about every sbox operation.

That said, I have read a bit lately about certain goog operations in sbox having some funkiness...not related to proxies per se, or even really an sbox bug, as much as another time goog changed something up...just a post I saw today about some probs with goog searches using...dammit I can't remember, certain operators...I'll take a look and see if I can find the post, unless another one of the helpers can recall.

peace - gregs.
 
well least that asnwers its not
the proxies i do or u would have
said something greg
 
No bro your proxies are great, but even your proxies die from time to time ;) Especially when they're doing very, very heavy lifting.
 
Back
Top