[Scrapebox] Harvester with proxies, not working across 4 VPS's

skohh

skohh

Regular Member
Joined
Sep 27, 2010
Messages
341
Reaction score
71
So guys, sorry if I missed it, tried to search but I am having serious problems scraping with scrapebox across many different PC's / Installs. I can scrape fine with no proxies, but even after a fresh harvest of proxies, nothing seems to be working. Anyone else experiencing this?
 
Advertise on BHW
skohh said:
So guys, sorry if I missed it, tried to search but I am having serious problems scraping with scrapebox across many different PC's / Installs. I can scrape fine with no proxies, but even after a fresh harvest of proxies, nothing seems to be working. Anyone else experiencing this?
Click to expand...

You are being a cheapskate! No insult intended but the free proxies are already done to death by the time you find them. You also have to check the proxies before you use them to find out whether or not they are already banned by the God of The Internet you worship. I not only recommend Scrapebox but I use it myself and I am a heretic, not bowing down to that "God".

I hate G**gle.

Tully.
 
CyberknightTully said:
You are being a cheapskate! No insult intended but the free proxies are already done to death by the time you find them. You also have to check the proxies before you use them to find out whether or not they are already banned by the God of The Internet you worship. I not only recommend Scrapebox but I use it myself and I am a heretic, not bowing down to that "God".

I hate G**gle.

Tully.
Click to expand...

Go easy on the lad!

Nothing wrong at all using public/free proxies to scrape with, I find a LOT of good ones to use, but OP, you have to test the proxies first and only use google passed ones.

Lately I've actually been thinking that the proxies that simply turn out as Anonymous can be used to scrape with and the fact they don't google pass is either they're temp blocked or it's a false negative.

When things went wrong and the developers had to make updates because of the proxy issue, almost no proxy would google pass, though a decent amount would be labeled Anonymous, and I was able to scrape using the Anonymous proxies that failed the google test.

SB is both great for/with proxies and very stubborn, which I guess is why I like it so much.
 
LakeForest said:
Go easy on the lad!

Nothing wrong at all using public/free proxies to scrape with, I find a LOT of good ones to use, but OP, you have to test the proxies first and only use google passed ones.

Lately I've actually been thinking that the proxies that simply turn out as Anonymous can be used to scrape with and the fact they don't google pass is either they're temp blocked or it's a false negative.

When things went wrong and the developers had to make updates because of the proxy issue, almost no proxy would google pass, though a decent amount would be labeled Anonymous, and I was able to scrape using the Anonymous proxies that failed the google test.

SB is both great for/with proxies and very stubborn, which I guess is why I like it so much.
Click to expand...

Yes indeed! Sorry to have come off so tough but it has been an interesting day here around my place and I am a bit stressed, so therefore perhaps a bit intolerant. Thank you for your advice and apologies to the OP!

Tully.
 
CyberknightTully said:
You are being a cheapskate! No insult intended but the free proxies are already done to death by the time you find them. You also have to check the proxies before you use them to find out whether or not they are already banned by the God of The Internet you worship. I not only recommend Scrapebox but I use it myself and I am a heretic, not bowing down to that "God".

I hate G**gle.

Tully.
Click to expand...

Not being a cheapskate, if I have to buy proxies to scrape I will. I thought the general rule of thumb was to scrape with public and post with private?
 
skohh said:
Not being a cheapskate, if I have to buy proxies to scrape I will. I thought the general rule of thumb was to scrape with public and post with private?
Click to expand...

Yep, you are right and again, sorry if I read as being tough on you.

You should harvest as many free proxies as you can but when you do, remember that those proxies are normally good only for the day that you get them or maybe only for a few hours! When you find them, use them fast before one of The Mad Russians bans them! I normally use several hundred freebies to harvest to keep from getting nailed quickly and to get around those which are banned even as I am loading them.

That may be a bit much for you but I got some deals going in which I need all those things to hide behind and I am using multiple licenses with mulitple instances on big assed Windows boxes.

LOL!

Tully.
 
skohh said:
Not being a cheapskate, if I have to buy proxies to scrape I will. I thought the general rule of thumb was to scrape with public and post with private?
Click to expand...

Although it is advised to use public proxies for scraping but I don't want to go through the whole process of testing the public proxies again and again so I use about 50 private proxies for scraping without any issues of them getting banned + scraping with private proxies is much faster compared to public proxies that are used by thousands of people at the same time.
 
BigFatWallet said:
Although it is advised to use public proxies for scraping but I don't want to go through the whole process of testing the public proxies again and again so I use about 50 private proxies for scraping without any issues of them getting banned + scraping with private proxies is much faster compared to public proxies that are used by thousands of people at the same time.
Click to expand...

What you have written is another way to go at it but I don't like to use the same set of paid proxies to harvest and post. I have seen many problems there but again, I'm running multiple instances.

Tully.
 
CyberknightTully said:
What you have written is another way to go at it but I don't like to use the same set of paid proxies to harvest and post. I have seen many problems there but again, I'm running multiple instances.

Tully.
Click to expand...

I'm using these private proxies to harvest and post across 3 different VPS without any issues whatsoever. :)

Could you please elaborate a bit more on what sort of issues do you face while scraping and posting with the same set of private proxies?
 
BigFatWallet said:
I'm using these private proxies to harvest and post across 3 different VPS without any issues whatsoever. :)

Could you please elaborate a bit more on what sort of issues do you face while scraping and posting with the same set of private proxies?
Click to expand...

I have found that using the same privates to scrape and post results in the proxies being banned in scrape mode by the Big G and then successful posting numbers go to shit. G also quickly shuts down the privates in scraping mode which yields shitty numbers. This only my experience and may not apply to others but this is what I have found.

Tully.
 
Yeah the proxies may get banned if you are scraping 24x7, however I don't think using proxies that are banned by G for scraping the shit out of their serps would make a difference to the posting success rate.
 
Same here, I'm unable to scrape Google with proxies (only). I've tried several sources and it's the same thing. Something must be off in the configuration. Can someone help?
 
Junkfood00 said:
Same here, I'm unable to scrape Google with proxies (only). I've tried several sources and it's the same thing. Something must be off in the configuration. Can someone help?
Click to expand...

Also having the same issue here. When scraping without proxies on my VPS it works fine. But using the proxies doesn't return any results. Whats up? :S
 
skohh said:
So guys, sorry if I missed it, tried to search but I am having serious problems scraping with scrapebox across many different PC's / Installs. I can scrape fine with no proxies, but even after a fresh harvest of proxies, nothing seems to be working. Anyone else experiencing this?
Click to expand...

If it works without proxies, and it doesn't work with proxies, its easy. Its the proxies. Plain and simple. The request that gets passed thru the proxies is the same request that gets passed without proxies. So the proxies are either not working in general, aka dead. Or the IP is banned. If they passed the proxy test then the IP is banned for whatever you are trying to scrape. I made a video about it a couple months back, see here:

[video=youtube_share;P9CbGhfc1aY]http://youtu.be/P9CbGhfc1aY[/video]
 
Also a general harvesting video in which I cover the vast majority of common harvesting issues.

[video=youtube_share;2QaLWgTXsRo]http://youtu.be/2QaLWgTXsRo[/video]


I have scraped tens of millions of urls in the past few days alone from google, using both private and public proxies. Including multiple instance on multiple servers scraping with proxies from google as I type this message. It works fine, check the vids.
 
might be a country specific issue, based in asia i have been unable to get any free proxies to work, private shared proxies still work fine though.
 
As I said, I tried tons of proxy sources, forums, sites, lists, including proxygo's proxies (free ones). Something must be wrong, I believe it's something else. Also the manager says all proxies are google passed.
 
Ok, please forget about this shit. It must be the proxies, people are hitting them harder than before. But how come SB marks them as google passed?
 
Junkfood00 said:
Ok, please forget about this shit. It must be the proxies, people are hitting them harder than before. But how come SB marks them as google passed?
Click to expand...

I answer this exact question in the video I posted above, but Ill post it again. :)

The issue is there are LOTS of different kinds of google IP bans, and while 1 type of query can ban an IP, another type of query will still deliver results for the same IP.

The proxy checker only checks for 1 type of query, not all of them, so you could be getting "passed" but its actually banned for the type of query you want to use. If you search this forum, you can see this discussed a hundred times, which is why I made the video. If the proxy checker tested for all types of queries, the sheer volume of people testing for some of the types of queries, would block the proxies for those types. So you could never use them, as they would all be blocked just from the testing.

Here is the vid
http://www.youtube.com/watch?v=P9CbGhfc1aY&feature=player_embedded

 
Last edited by a moderator:
Hi Everyone,

So I went ahead and bought scrapebox after reading all the positive reviews on this forum.

It worked great a for a few hours, but then it suddenly wouldent harvest anything from Google (without any error message). I thought it must have been due to public proxies. So I went ahead and bought some private ones. The problem still remains. I try to harvest for a simple keyword in Google and I get back 0 results with no errors. It only works when I dont use any proxies.

Whats going on here?

Any suggestions from the BHW community?

Cheers!
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Networking Downloads

Marketplace

Account Selling Content / Copywriting Hosting Images, Logos & Videos Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Misc

Making Money

Affiliate Programs Hire a Freelancer Making Money Pay Per Click Site Flipping

BlackHatWorld

BHW Merch Forum Suggestions & Feedback Introductions Lounge Dispute Resolution

Other

Domain Name Forum IM Journeys Web Hosting Newsletter
Back
Top