[GUIDE] How to scrape Google search results without any scraper software

[kaudo]

Hi, gentlemen, a little guide here. Not everyone has earned enough yet to buy awesome yet expensive scraper tools, that´s why I would like to show to those who are interested how to do Google search results scraping with a little effort for free.

If you are interested in the full article it is here, if not, let´s go straight into it.

---------------------------------------------------------------------------------------------------

To scrape Google search results we will not need:

• web scraper software;
• proxies;
• programming experience.

To get it we will only need:

• Google (obviously);
• Two freeware plugins for Google Chrome browser.

This method brings limited results (maximum around 300 URLs per scrape), however, that is more tha enough, in most cases.

Let’s start with the Chrome plugins
Go to Google Chrome extensions repository and download these two awsome plugins:

• Google Infinity;
• Link Grabber;

Then pin them on the top bar so that you can launch them with just one click. They are the two highlighted icons.

Google Infinity allows you to list all search results on one page and the Link Grabber does what it’s name foreshadows – it grabs all the links from a page.

That means that we have a plugin combo capable of listing all URLs on one page and grabbing that URLs at once. Perfect, isn’t it?

Let’s go do some advanced Google search settings
In order to do everything as efficiently as possible, we need to change a few default Google Search settings.

We will change the number of displayed results per page to the allowed maximum, which is 100 items/page.

And I strongly suggest that you also change the preferences and turn off the usage of “private results”.

Why? Google by default shows you personalised results which are biased and subjective.

Google algorhitms present you these results based on your historical activity.

Your search history, social life networks, interactions with your friends and foes and what not, it all modulates your search results and if you want to objectivize your results as much as possible, you should just turn them off.

The search results of the other people will be modulated by their own historical activities, but that is a fact that we just can’t influence, so we will abstract from it.

Scraping the search results as a PRO
Launch Google and search whatever you want (I searched for “google loves me” ).

Scroll down and after 100 results you will experience a fancy thing, second page with other 100 results will be loaded, thanks to our beloved Ginfinity plugin.

Now we will grab the links but before we use the Link Grabber plugin for the first time I suggest that you change the settings/options this way.

These settings will enable us to remove by default all URLs that we are not interested in so that we will not have to filter them out later.

And we are done…

Grab the links and do with them whatever you want.

Stay open-minded, gentlemen. And tuned in too .

 

[nahid133]

Good share

 

[Tom Chase]

Great share!! Thanks

 

[myfault]

How can I scrape the Also Asked questions?

 

[neverlackin360]

can i scrape for emails..?

 

[aspire.samee]

Nice share,
Will try

 

[Gdlobo]

Nice share.. if you wanna know who your competition are doing on their sites

 

[dealmein923]

Thank you for this very useful share.

 

[deedee1whoa]

Wanted somethin' like this, thanks for sharin' or the autocomplete scraper. This will do I guess, thanks!

 

[kawsarbd]

Nice share, It would help me out to scrape my competitors

 

[kaudo]

Good share

Great share!! Thanks

Thanks, guys!

How can I scrape the Also Asked questions?

If you want a simple method you can achieve with chrome browser and xpath, follow this video from a guy "MegaMike". We are not affiliated, so for further questions address him

can i scrape for emails..?

Sure, but you have to write a script that visits thiose pages and searches for email patterns. Or you can pay someone here on BHW to do it for you.

Nice share,
Will try

Nice share.. if you wanna know who your competition are doing on their sites

Thank you for this very useful share.

Wanted somethin' like this, thanks for sharin' or the autocomplete scraper. This will do I guess, thanks!

Nice share, It would help me out to scrape my competitors

Thank you very mucho, ladies and gentlemen.

 

[JayDee1984]

Hi, gentlemen, a little guide here. Not everyone has earned enough yet to buy awesome yet expensive scraper tools, that´s why I would like to show to those who are interested how to do Google search results scraping with a little effort for free.

If you are interested in the full article it is here, if not, let´s go straight into it.

---------------------------------------------------------------------------------------------------

To scrape Google search results we will not need:

• web scraper software;
• proxies;
• programming experience.

To get it we will only need:

• Google (obviously);
• Two freeware plugins for Google Chrome browser.

This method brings limited results (maximum around 300 URLs per scrape), however, that is more tha enough, in most cases.

Let’s start with the Chrome plugins
Go to Google Chrome extensions repository and download these two awsome plugins:

• Google Infinity;
• Link Grabber;

Then pin them on the top bar so that you can launch them with just one click. They are the two highlighted icons.

Google Infinity allows you to list all search results on one page and the Link Grabber does what it’s name foreshadows – it grabs all the links from a page.

That means that we have a plugin combo capable of listing all URLs on one page and grabbing that URLs at once. Perfect, isn’t it?

Let’s go do some advanced Google search settings
In order to do everything as efficiently as possible, we need to change a few default Google Search settings.

We will change the number of displayed results per page to the allowed maximum, which is 100 items/page.

And I strongly suggest that you also change the preferences and turn off the usage of “private results”.

Why? Google by default shows you personalised results which are biased and subjective.

Google algorhitms present you these results based on your historical activity.

Your search history, social life networks, interactions with your friends and foes and what not, it all modulates your search results and if you want to objectivize your results as much as possible, you should just turn them off.

The search results of the other people will be modulated by their own historical activities, but that is a fact that we just can’t influence, so we will abstract from it.

Scraping the search results as a PRO
Launch Google and search whatever you want (I searched for “google loves me” ).

Scroll down and after 100 results you will experience a fancy thing, second page with other 100 results will be loaded, thanks to our beloved Ginfinity plugin.

Now we will grab the links but before we use the Link Grabber plugin for the first time I suggest that you change the settings/options this way.

These settings will enable us to remove by default all URLs that we are not interested in so that we will not have to filter them out later.

And we are done…

Grab the links and do with them whatever you want.

Stay open-minded, gentlemen. And tuned in too .

Another one

 

[HustleTong]

Dope share, bud.
The fact that you don't need proxies is impressive.
These extensions will come handy.

 

[saad01]

Awesome share. Thanks.

 

[neverlackin360]

how can I use this to scrape for emails...?

 

[kaudo]

Another oneView attachment 157596

That´s funny! Thanks!

Dope share, bud.
The fact that you don't need proxies is impressive.
These extensions will come handy.

Thanks a lot, guys!

 

[kelphano]

Nice! Really handy

 

[m4virus]

Hi, gentlemen, a little guide here. Not everyone has earned enough yet to buy awesome yet expensive scraper tools, that´s why I would like to show to those who are interested how to do Google search results scraping with a little effort for free.

If you are interested in the https://www.smartial.net/how-to-web-scrape-google-search-results-without-a-scraper-or-any-other-software-for-free-of-course/ it is here, if not, let´s go straight into it.

---------------------------------------------------------------------------------------------------

To scrape Google search results we will not need:

• web scraper software;
• proxies;
• programming experience.

To get it we will only need:

• Google (obviously);
• Two freeware plugins for Google Chrome browser.

This method brings limited results (maximum around 300 URLs per scrape), however, that is more tha enough, in most cases.

Let’s start with the Chrome plugins
Go to Google Chrome extensions repository and download these two awsome plugins:

• https://chrome.google.com/webstore/detail/ginfinity/dgomfdmdnjbnfhodggijhpbmkgfabcmn;
• https://chrome.google.com/webstore/detail/link-grabber/caodelkhipncidmoebgbbeemedohcdma

Then pin them on the top bar so that you can launch them with just one click. They are the two highlighted icons.

Google Infinity allows you to list all search results on one page and the Link Grabber does what it’s name foreshadows – it grabs all the links from a page.

That means that we have a plugin combo capable of listing all URLs on one page and grabbing that URLs at once. Perfect, isn’t it?

Let’s go do some advanced Google search settings
In order to do everything as efficiently as possible, we need to change a few default Google Search settings.

We will change the number of displayed results per page to the allowed maximum, which is 100 items/page.

And I strongly suggest that you also change the preferences and turn off the usage of “private results”.

Why? Google by default shows you personalised results which are biased and subjective.

Google algorhitms present you these results based on your historical activity.

Your search history, social life networks, interactions with your friends and foes and what not, it all modulates your search results and if you want to objectivize your results as much as possible, you should just turn them off.

The search results of the other people will be modulated by their own historical activities, but that is a fact that we just can’t influence, so we will abstract from it.

Scraping the search results as a PRO
Launch Google and search whatever you want (I searched for “google loves me” ).

Scroll down and after 100 results you will experience a fancy thing, second page with other 100 results will be loaded, thanks to our beloved Ginfinity plugin.

Now we will grab the links but before we use the Link Grabber plugin for the first time I suggest that you change the settings/options this way.

These settings will enable us to remove by default all URLs that we are not interested in so that we will not have to filter them out later.

And we are done…

Grab the links and do with them whatever you want.

Stay open-minded, gentlemen. And tuned in too .

this is what people call it ,free blackhate methods , XD
sometime the solution is just front of us but people look far away

 

[scott2]

Nice sharing. thanks for it.

 

[kaudo]

Awesome share. Thanks.

Cheers, Saad!

how can I use this to scrape for emails...?

You can't, Neverlackin! To scrape emails, you have to visit the urls you scraped with this method and search for email footprints. I have my onw script for this, but you can do it yourself too - it is actually not that complicated.