My scraprbox is not scraping URLsfrom google

thesmashge

Power Member

Jan 14, 2009

550

536

• Sep 26, 2010

• #1

If i try to scrape some footprints ,My scrapebox is not scraping URLs from google...

It scrapes from Bing,yahoo and the other search engines but not from google(the one that matters)

What am i doing wrong?Does something break in scrapebox after google turned instant?

 

Billw

Junior Member

Jan 28, 2008

180

192

• Sep 26, 2010

• #2

You need some private proxies, G is blocking a lot of IPs because of overused proxies.

 

thesmashge

Power Member

Jan 14, 2009

550

536

• Sep 26, 2010
• Thread Starter Thread Starter

• #3

Thanks billw...but i would have only used scraping google once or twice and taht too with public proxies....anyone with same experience?

 

redstone.1337

BANNED

Dec 30, 2009

1,258

1,000

• Sep 26, 2010

• #4

Lots of people use Public Proxies so most of the times they are blocked soon. A guy here on BHW is selling Proxies List Subscription for 12.5$ a month. I use his proxies for scraping.

Also, make sure Google is checked under the "Select Engines & Proxies"

 

royalmice

BANNED

Aug 23, 2007

1,186

990

• Sep 26, 2010

• #5

Same here, having allot of problem lately scraping and i use premium private proxies. Seems only Bing is working and sometimes yahoo

 

matt1972

Power Member

Nov 19, 2009

503

206

• Sep 26, 2010

• #6

You need to either get some private proxies (don't hammer them to hard or G will soft ban them) or go scrape some public proxies from places like Proxyfire or something then run them through the proxy checker. If they all come up green then your good to go for awhile.

 

S

snaman

Newbie

Sep 11, 2010

49

11

• Sep 26, 2010

• #7

I've been scraping with public ones and it's OK. Maybe you aren't refreshing them often enough?

 

P

PetreTerror

Newbie

Dec 1, 2009

17

0

• Sep 26, 2010

• #8

it is working for me , but sometimes , it won't scrape because of proxys ...