Is Google blocking Scrapebox?

R

reggy

Junior Member
Joined
Mar 16, 2010
Messages
110
Reaction score
13
Hello,
I have noticed recently that i can no longer scrape as much URLs as before from Google even though i am using private proxies.

I currently use 70 private proxies from both yourprivateproxy and squidproxies!

I also run cc cleaner before each scraping run.

On a run where Bing and Yahoo might give me millions of URLs, Google would only bring back a few thousand, usually no more than 5 figures.

Does anyone have this same problem?

Is there something am doing wrong?

I use the exact SB settings that Loopline recommends

Thanks
 
Advertise on BHW
I think bookmarks are the only thing worth a crap now.
 
I don't know everything is fucked up this days,google,youtube,yahoo.Looking like they want to get rid of any SEO techiques,beside onpage SEO
 
acotut said:
...Looking like they want to get rid of any SEO techiques,beside onpage SEO
Click to expand...

Wouldn't surprise me a bit these days. It's all about control and they keep trying to put up more and more roadblocks. Some work some don't. The gov't and SEs seem hellbent on getting rid of most affiliates especially in U.S.

RM
 
So is anyone else having problems scraping Google with Scrapebox?
 
RebelMaster said:
Wouldn't surprise me a bit these days. It's all about control and they keep trying to put up more and more roadblocks. Some work some don't. The gov't and SEs seem hellbent on getting rid of most affiliates especially in U.S.

RM
Click to expand...

The government haz nothing to do with this.Google is just a search engine that wants only QUALLITY links to be posted on his first pages,else the adwords advertisers won't put as much money as they did.
This is a business,and will remain as one.There are Thousands of statistics that they care about...
If the affiliates would bring as much money as everyone else,you think they will try to stop them?
 
reggy said:
So is anyone else having problems scraping Google with Scrapebox?
Click to expand...

Can't say I have run in to this problem. Scraped around 4 million a few days ago from just Google. Maybe you're running too many threads and getting your proxies temp banned fast?
 
I've been having the same issue. A week ago I was able to get hundreds of thousands of scraped sites from google but today i'm only able to get a couple thousand and that is with using the same keywords list. If anyone knows a way around this i'd love to hear it. I'll be using bing/yahoo/aol for now :/
 
@scrapefox - i am running 20threads just like Loopline recommended!

How many threads do u run and what is ur random delay set at?
 
I had the same problem yesterday and two days ago.
But few minutes ago I scraped about 300 fresh public proxies and start to harvest. It seems google harvester is back to normal. My magic number of connections for google scrape is: 35. :D
 
@alaltaierii - how many urls r u able to scrape from Google?
 
It is getting slower but I think I'm starting to find a solution. Nothing solid yet.
 
reggy said:
@scrapefox - i am running 20threads just like Loopline recommended!

How many threads do u run and what is ur random delay set at?
Click to expand...

I think it really depends on the type of connection + computer. I harvest at 50 but I have a fast connection.

I've also just done a nice-sized run tonight. 200 public proxies ( I have a rather big list so I can grab these relatively easy). 500k+ blogs. etc etc.
 
Try scraping meta search engines that pull their results from Google (and other SEs).
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Networking Downloads

Marketplace

Content / Copywriting Hosting Images, Logos & Videos Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design Misc

Making Money

Affiliate Programs Hire a Freelancer Making Money Pay Per Click Site Flipping

BlackHatWorld

BHW Merch Forum Suggestions & Feedback Introductions Lounge Dispute Resolution

Other

Domain Name Forum IM Journeys Web Hosting Newsletter
Back
Top