lol
Automation is very important. That program of yours looks promising, will definitely give it a try. No demos or trials?
proxies getting banned faster on google
- Thread starter mazgalici
- Start date
lol
Automation is very important. That program of yours looks promising, will definitely give it a try. No demos or trials?
portalweb
Supreme Member
- Jan 7, 2010
- 1,435
- 579
We ran over 400 tests in the last 48 hours to be able to determine the pattern. Yes, G00gle has the stronger bot/proxy detection right now based on various access types (search, special commands, etc.).
Results: (Cliff notes version)
- My "test" private proxies are PERM-blocked by G00gle after using the special commands 3 times or more. When it happens (failed captcha entry), that IP is BLOCKED for good, only with a link to contact G00gle if you want to request to unblock IP (it will be very difficult). It happens if you have the same subnet IP block for the test. Fortunately these test IPs I have are junk anyway.
- My test "G00gle" proxies from proxylist.co/webproxylist.com have less chance of blocking due to the real mix of subnets (almost all of them are unique) when running the G00gle commands/basic searches. In other words, better results, due to large number of tested G00gle proxies from my system available.
It looks like the private proxy providers need to raise $$$ to charge the customers for the private proxies, plus, they need to require the customer to order large # of proxies, and would need to change the way they operate the business in order to protect their IPv4 private proxies. If the customer caused these IPs to be banned by G00gle, they (not private proxy providers) need to pay for the replacement costs. If the private proxy providers don't, they will be digging their own grave big time due to the dead/useless IPs.
Results: (Cliff notes version)
- My "test" private proxies are PERM-blocked by G00gle after using the special commands 3 times or more. When it happens (failed captcha entry), that IP is BLOCKED for good, only with a link to contact G00gle if you want to request to unblock IP (it will be very difficult). It happens if you have the same subnet IP block for the test. Fortunately these test IPs I have are junk anyway.
- My test "G00gle" proxies from proxylist.co/webproxylist.com have less chance of blocking due to the real mix of subnets (almost all of them are unique) when running the G00gle commands/basic searches. In other words, better results, due to large number of tested G00gle proxies from my system available.
It looks like the private proxy providers need to raise $$$ to charge the customers for the private proxies, plus, they need to require the customer to order large # of proxies, and would need to change the way they operate the business in order to protect their IPv4 private proxies. If the customer caused these IPs to be banned by G00gle, they (not private proxy providers) need to pay for the replacement costs. If the private proxy providers don't, they will be digging their own grave big time due to the dead/useless IPs.
Last edited:
MyOtherPersona
Newbie
- Sep 13, 2011
- 11
- 2
NIXMY
Regular Member
- Sep 26, 2010
- 481
- 322
Thanks for the information. I knew this day will come, and now it came. Who else you can blaim for this than the blackhat community? When people abuse something enough, for sure something will happend sooner or later. Google could make all SEO softwares pretty much useless in no time if they would want to do so.
I guess this was just a start.
I will testify that yes, it is much more aggressive now. I use freshest proxies yet (not port scanned premiums) and hell, within minutes their damn gone. It has gotten so bad it's a joke lol. It's depressing the fact that this is what drives our research further and effective, without it we'll be bogged down.
- Nov 2, 2008
- 59,100
- 26,627
well i spoke to some of my 500 subs - bare in mind for scraping purposes which
is what i base by reply on, the answers i got back rounded up as followed .
now baring in mind with my subs i promises a minimum amount of each
user getting 400 google passed proxies a day + a separate list of proxys
for scraping yahoo , this is the answer i got .
wombat: it IS effecting the amount i get... but the amount is still great.
Clarke: you're doing a great job mate
loopline: yeah I get a good proxy pass rate still, I even grab proxies
from your list a day old or so and test them. Still get good ones from those.
put simple there still getting there minimum 400 google passed proxies per day
everyday, but most average more. even with the 404's i havnt missed a target
in 3 yrs . as of now im still averaging 2.5k a day google passed proxies
and around 1-1.5k google failed but anonymous that will scrape yahoo.
if it stays like this - i can cope .
is what i base by reply on, the answers i got back rounded up as followed .
now baring in mind with my subs i promises a minimum amount of each
user getting 400 google passed proxies a day + a separate list of proxys
for scraping yahoo , this is the answer i got .
wombat: it IS effecting the amount i get... but the amount is still great.
Clarke: you're doing a great job mate
loopline: yeah I get a good proxy pass rate still, I even grab proxies
from your list a day old or so and test them. Still get good ones from those.
put simple there still getting there minimum 400 google passed proxies per day
everyday, but most average more. even with the 404's i havnt missed a target
in 3 yrs . as of now im still averaging 2.5k a day google passed proxies
and around 1-1.5k google failed but anonymous that will scrape yahoo.
if it stays like this - i can cope .
shareware2009
Newbie
- May 9, 2012
- 18
- 3
private proxies are the best option to avoid this
mazgalici
Supreme Member
- Jan 2, 2009
- 1,489
- 887
yeah... just post a noob tip just to increase your post number. All the proxies are affected, all the ips which will make a few searches can get banned
thetraveller
BANNED
- Mar 9, 2009
- 1,440
- 873
Yes I noticed 403 (payment request) from a few days already, thing I can do is just continue to the next good proxy. And if a subnet is banned because of only 3-4 used proxies this will gonna be hard.
- Nov 2, 2008
- 59,100
- 26,627
all i no is, yes the 404's have risen
but the results i get haven't changed that much
i still get just under 1k Google passed proxies in the morning
and approx 1.5k in the evening everyday, but, these arnt public
scraped proxies which everyone can use, mine are public port
scanned Google passed proxies, so less people have them,
so the change ive noticed is minimal.
that also doesn't include over 1k Google failed anon passed
that scrape Google fine
but the results i get haven't changed that much
i still get just under 1k Google passed proxies in the morning
and approx 1.5k in the evening everyday, but, these arnt public
scraped proxies which everyone can use, mine are public port
scanned Google passed proxies, so less people have them,
so the change ive noticed is minimal.
that also doesn't include over 1k Google failed anon passed
that scrape Google fine
MyOtherPersona
Newbie
- Sep 13, 2011
- 11
- 2
Proxygo, my account here has not enough posts to send you PM, but I would like to try your services. (I know you don't like to deal with new accounts, but I have already bought the wordlist that you advertise for)
We use much more than 1000 private proxies currently, but with the recent changes, I would be happy to try your public proxies as well to get more requests through.
My feeling is that this is related to subnet wide blocking, so with private proxies it really depends also on the other people that use the same subnet.
Please send me more information.
- Nov 2, 2008
- 59,100
- 26,627
MyOtherPersona
the 3 adverts in my sig - only 1 is mine - the proxy sig part
the other 2 service in my sig belong to 2 other donor members
i have no affiliation to the word list advert or the 500 followers
advert only that i allow them to advertise in my sig
the 3 adverts in my sig - only 1 is mine - the proxy sig part
the other 2 service in my sig belong to 2 other donor members
i have no affiliation to the word list advert or the 500 followers
advert only that i allow them to advertise in my sig
tinkerbellO
Newbie
- Aug 30, 2012
- 3
- 1
Hey dudes.
I need to scrape google search results. Mainly I need 20.000 keywords and the first 50 search results (5 pages).
A question to experts (like proxygo): How many public / private proxies do I need to achieve this task?
It should be done in between 1 day, so I have to do 1 URL request in about 1 second.
It would be awesome if this could work 24/7 by the same amount (100.000 requests per day).
Does anybody have a recommendation on how many private / public proxies I have to use
and which strategy to take that no proxies get banned? I think 100.000 requests per day isn't
that much, or am I wrong with this?
Thanks in advance
tinker
I need to scrape google search results. Mainly I need 20.000 keywords and the first 50 search results (5 pages).
A question to experts (like proxygo): How many public / private proxies do I need to achieve this task?
It should be done in between 1 day, so I have to do 1 URL request in about 1 second.
It would be awesome if this could work 24/7 by the same amount (100.000 requests per day).
Does anybody have a recommendation on how many private / public proxies I have to use
and which strategy to take that no proxies get banned? I think 100.000 requests per day isn't
that much, or am I wrong with this?
Thanks in advance
tinker
Last edited:
barrierreef
Newbie
- Aug 31, 2012
- 16
- 1
I've had a bunch of google bans recently too =(
- Nov 2, 2008
- 59,100
- 26,627
thanks for the update .
MyOtherPersona
Newbie
- Sep 13, 2011
- 11
- 2
Really safe limits seem to be to use 1 IP not more than once each minute on average. (you can go down to about 1 each 15 seconds if you like to push your luck).
So for 100,000 requests in 1 day, you would need about 70 proxies from several different class c nets.
However not all proxies are equal and Google has increased blocking based on requests from the same class c net. If you use shared proxies that have a lot of other users, then obviously you will need more to prevent blocking. If you have IPs from a class cm, where a lot of other users get banned then you need more.
