Scrape URLs from Google search for keyword X

Hey guys, not a blackhat tool request but I wonder if there are any solutions on the market. I need to search Google for some keyword from time to time and would like the tool to return a list of websites that will be found. Need that to research the competition to see which new websites appear in the niche.

Thanks for help!

Use ScrapeBox

Use Scrapebox with Some Proxies

Can I also limit ScrapeBox's search engine scraper to some specific country? Say France. Would I need French proxies in this case?

Made a small script tutorial that redirects through a web anonimizer service to scrape keywords. It's in the scripting section on this site(can't post links yet). Been working on a bing keyword scrapper. Promise when I get 15 posts so I can post links I post up a tutorial doing just this.

iVision said:

Can I also limit ScrapeBox's search engine scraper to some specific country? Say France. Would I need French proxies in this case?

Click to expand...

You don't need French proxies, as you could select only scraping from google.fr in Scrapebox. It is the mush have tool. And beside this, Scrapebox could do many other things. Check out their websites.

I mainly use it for scraping expired domains.

woodsea said:

You don't need French proxies, as you could select only scraping from google.fr in Scrapebox. It is the mush have tool. And beside this, Scrapebox could do many other things. Check out their websites.

I mainly use it for scraping expired domains.

Click to expand...

Happy Holidays Black Hatters.
Hope it helps some one out.

https://www.blackhatworld.com/seo/r...ith-selenium-and-python.988924/#post-10668174

I have built an unfinished but functional service for this called RedScrape- Unfortunately I can't link it since my account is very new, but you may search it yourself. Note that it is RedScrape and not the firm Redscraper.

Future features will include gathering emails from the scraped results and gathering metadata from the scraped results.

iVision said:

Hey guys, not a blackhat tool request but I wonder if there are any solutions on the market. I need to search Google for some keyword from time to time and would like the tool to return a list of websites that will be found. Need that to research the competition to see which new websites appear in the niche.

Thanks for help!

Click to expand...

As mentioned above, scrapebox will do it and there is a BHW discount, link is in first post
https://www.blackhatworld.com/seo/s...auto-blog-commenter-with-prstorm-mode.129096/

iVision said:

Can I also limit ScrapeBox's search engine scraper to some specific country? Say France. Would I need French proxies in this case?

Click to expand...

Yes, generally you will need french proxies. Keep reading below.

woodsea said:

You don't need French proxies, as you could select only scraping from google.fr in Scrapebox. It is the mush have tool. And beside this, Scrapebox could do many other things. Check out their websites.

I mainly use it for scraping expired domains.

Click to expand...

Google made changes in Nov of this year, so now even if you choose google.fr in a browser and you are in say the UK, you will get UK results. If you are in the USA, you will get USA results. Google now serves up results based on the geolocal of the ips used.

This doesn't really affect the language flag, you could still say you wanted sites only in french for example. But if you want to get true results from google.fr, you would now need french proxies.