Best BULK Autosuggest Keyword Scraper?

Total Noob

Banned - By Request
Joined
May 10, 2009
Messages
2,446
Reaction score
2,732
I'm using Scrapebox now, which works OK, but it is hard to reliably do large keyword scrapes. Certain engines are fine, but the important ones like Amazon YouTube Google etc. will frequently hang and crash after 500-2000 keywords. I can restart these scrapes immediately which means the issue is with Scrapebox and not the engines blocking me.

Does anyone know of an autosuggest scraper that can handle 50k - 100k+ keywords at once and not constantly crash?
 
I think problem is search engines give 404 error as soon as they discover mass scraping is going on. And scrapebox probably stop at that point and doesn't continue further that's why you can not scrape more than 400-500
I am going to make a scraper with proper delay and restart mechanism and will put in download section of the forum.
 
I think problem is search engines give 404 error as soon as they discover mass scraping is going on. And scrapebox probably stop at that point and doesn't continue further that's why you can not scrape more than 400-500
I am going to make a scraper with proper delay and restart mechanism and will put in download section of the forum.

That's what I thought too, but the numbers aren't consistent. For example if you use a VPN, you can do exactly 200 keyword scrapes from Google until it hangs, but if you're using a residential IP, the numbers fluctuate. For example on Amazon, I can do 500 searches one time, then 1,900 the next, then 31 the next... and I can restart the scrapes immediately after it freezes, so it's not like my IP was banned or anything. Regardless, I'll be on the lookout for your tool... if you decide to not give it away for free, please PM me so I can buy it :)
 
Back
Top