is 10 shared proxies enough for scrapebox scraping

J

JohnyJ

Junior Member
Joined
Sep 19, 2011
Messages
169
Reaction score
18
Im thinking to get 10 private and 10 shared proxies
i want to save a few private for creating web 2.0 and any manual stuff i do
the other private proxies will be used for scrapebox posting
is 10 shared proxies enough for scraping urls from scrapebox?
I'm gonna go with buyproxies, so no need for advertising guys
 
Advertise on BHW
what's your suggestion? I'm having a nightmare trying to get free ones, they die straight away
 
omida86 said:
It's not enough for scraping.
Click to expand...

Actually I would disagree with you on that. If the user uses the proxies in moderation and keeps the number of threads down to between 5-10 per proxy then scraping is a perfectly valid option.
 
JohnyJ said:
what's your suggestion? I'm having a nightmare trying to get free ones, they die straight away
Click to expand...

Get some cheap shared proxies, as these provide good value for money and are often just as good as private (depending on provider).

Or another option is too buy a proxy scraping service, I am sure there is one in the proxy for sale section, it's a one off payment and you get around 600 proxies delivered to you daily for life.
 
10 is more than enough for many people. It just depends on how aggressive you are and how fast you need results. The more proxies you have, the faster and more aggressive you can scrape.
 
thanks for the advice guys
its actually 20 shared proxies, my mistake.
i've got a couple more questions,
If proxies get banned by google for scraping don't they come back in 24 hours?
How many proxies should i have if i wanted to scrape 250,000 urls in one day with 20 connections at one time?
cheers for the help
 
I have been able to hit SB pretty hard with 10 private proxies over a long period of time. The public proxies SB was bringing back seemed to get worse and worse.
 
You don't need private proxies for SCRAPING.
You do want them for posting.

Just run the proxy harvester that comes with scrapebox. Should be very very easy to find at least 100 public proxies that work with google.
Don't dump a million keywords in 1 run and you should be fine if you refresh your list after every run.
 
Rext_ said:
You don't need private proxies for SCRAPING.
You do want them for posting.

Just run the proxy harvester that comes with scrapebox. Should be very very easy to find at least 100 public proxies that work with google.
Don't dump a million keywords in 1 run and you should be fine if you refresh your list after every run.
Click to expand...

I also agree with this. For harvesting, I use public proxies most of the time from Proxy Goblin that goes through my own lists and their premium list only. I don't even bother using the standard lists as they get burned instantly and just makes it take 4x longer.
 
it takes me a few hours to check all the scrapebox proxies, when i check them again afters finding about 100 live proxies, most of them have died
 
JohnyJ said:
it takes me a few hours to check all the scrapebox proxies, when i check them again afters finding about 100 live proxies, most of them have died
Click to expand...

Welcome to the world of public proxies :0

I get about 450 google friendly ones, but I use a good list to begin with and not reliant on scraping.
 
Not sure how many connections your run on the harvester but i think you can pretty much max it out at 100 on a somewhat decent connection.
You could also try to lower the time out.

This should make proxy checking quite a bit faster.
However the best tip i can give you when it comes to finding public proxies is add your own lists.
If you go on youtube and search for looplinescrapebox you'll find a good explanation of what i mean.
And while you're watching that I highly suggest you watch all his other vids.

Also, and this might sound very obvious, make sure you remove duplicate proxies before checking them.
 
Last edited:
ok thanks alot everyone,

i'm gonna read more into green goblin and i think i'm going to buy proxygo's service - 3000 proxies a day, its got good reviews. Hopefully thats enough for now
 
thanks for the advice Rext, im gonna check out his videos in a bit
 
An someone message me a good private proxy service. I buy about 10 a month and I want to increase but I'm not sure which place is the best.
 
If you're clever enough, you can find a way around and scrape some long-lasting public proxies. I've scraped about 12 of these and I've been using them for over a month and they're still alive.
 
you most likely want a lot of proxies. hundreds if possible. scraping public proxies is tough, and privates will burn quickly.
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top