need help with google and scrapbox !!

stevelori

Newbie
Joined
Oct 5, 2010
Messages
40
Reaction score
0
hello
i need help with harvesting url on google
i just buy scarpbox but when i try to harves url from google i didnt find anything but when i do bing or yahoo just fine
what am i doing worng ??

tnk
 
I know this sounds stupid but did you check the box next to google, you might have overlooked it
 
Try search without having both google and bing checked, read that somewhere.

In longer scrapes, after 20-30k urls, google suddenly stops giving urls for me to. Maybe there have to be a larger delay between searches for google
 
i try only doing google ck but still nothing
its so weird only google dont work .. any one as any idea
 
yahoo and bing dont block IP, but G does..
You have to get good public proxies list to scrape and harvest with G
 
You should really go and read/watch some Scrapebox guides.
 
one thing I noticed from google is that whenever I tried scraping something like

inurl:123 or
"Powered by 123"

I get results that is close to none compared to yahoo/bing. However when I try to do it for normal keyword, google races ahead of yahoo and bing. I think google understood that we are scraping list to spam etc.
 
Try using private proxies. I use just 2 and pay like 3 buck a month for them
 
Yeah, you need some proxies man. Get some private ones for scraping.
 
where you get your proxies ?

i use:
Code:
anonymous-proxies.net

i have 3 now, and im doing some posting now and when i look at the live BW usage its about 30mbit/s, so they have good speed.
 
Last edited:
Is there a good rule of thumb on how many proxies you need per thousand urls?

If 2 proxies can handle a couple thousand scrapes/posts a week I've been wasting my time with public proxies.
 
Is there a good rule of thumb on how many proxies you need per thousand urls?

If 2 proxies can handle a couple thousand scrapes/posts a week I've been wasting my time with public proxies.

Yes, i have used 2 prox, but got another extra yesterday.
I dont use public proxies, they are slow, and like 1 of 1000 work :P, just time consuming crap.

Get 2, and try it out, works good for me.
 
inurl: more than a few times gets IP blocked immediately due to large scale bulletin board hack a few years ago that used this in the exploit.
 
Back
Top