Here are the two option I can use fro scraping. I have 5 dedicated private proxies from buyproxies, but the other proxy providers give me pretty much the same result. 1) Use a simple python script that has a random delay between requests (just 1 - 2 seconds). - I can scrape for a day or more proxies do not get banned at all especially for complex queries such as site:. inurl doesn't work well. I can scrape comstantly all the time. It could be slow though as in the current script version use just one thread but still i can scrape hundreds of thousands of urls in one go for a day. 2) Use scrapebox - multithreading and just one thread. - Google scraper stop working after 20-30 minutes and all the proxies are banned. Yahoo and Bing seem to have around 10 results per page. I use the latest version of scrapebox. I can scrape around 10K results in one go and that's all. I find it hard to believe that a simple script can do much better than scrapebox. I guess there is something wrong with my setup. What is your experience with scrapebox scraping?