[METHOD] [Free Links Scraping From Any Website]

[best999]

Hey guys, I've found quite easy and free method to scrape any website for links - and want to share it with you. All you need is Chrome browser and Google Docs.

I'll show the method on YellowPages, but it can be used on any websites, even Google Search Results.

For example, let's say you are providing services for Local Businesses and want to target Seattle Lawyers.

And for your marketing methods you need to create the list of target websites.

You can go for commercial scrapers (ScrapeStorm is my favorite lol) but here I'll show you how to make the list for free.

1. You go and install Chrome extension called Link Klipper.

2. Then you go to yellowpages.com and search for lawyers in Seattle.

3. After search results page is open, you click on Link Klipper extension icon and select "Extract All Links".

4. Text file will be opened in browser, containing all links from yellow pages (in case of Google Search Results - links will be saved as CSV). Select all and copy.

5. Create blank spreadsheet on Google Sheets and paste links there.

6. Click "Data - Split text to columns".

7. Select all columns and click "Data - Create filter".

8. Then click on the filter icon at the top cell of links containing column, select "filter by condition" and use "text does not contain" option. In the text field input "yellowpage". Click OK.

9. Congratulations! You have now list of all needed URLs from first page of YellowPage.com results. Open second page of YP search and repeat from step 3.

Of course, you'll still have some links from YP like local.yp.com or YP twitter link - but you can remove them later.

To scrape 300 links in 3 minutes you first extract all needed links and copy them to Google Sheets, and only then apply splitting and filters from steps 6-8.

Hope this helps!

 

[Social God]

Thanks for your share! Great contribution to the community.

 

[Xaliu]

Wow sounds great, this is helpful I'll try that pretty soon

 

[Digioner]

It works. Appreciate!

 

[Deleted member 752298]

Thanks for the share buddy

 

[seocrab]

Good idea, but it will only automatically scape all the links on any single page. If you want all the links from an entire domain, you'll need a tool like screaming frog, scrapebox or ahrefs.

 

[best999]

Thanks for your share! Great contribution to the community.

Wow sounds great, this is helpful I'll try that pretty soon

It works. Appreciate!

Thanks for the share buddy

Thank you, guys!

Good idea, but it will only automatically scape all the links on any single page. If you want all the links from an entire domain, you'll need a tool like screaming frog, scrapebox or ahrefs.

The idea was to offer fast, dirty and free solution. Of course I agree that on large scale operations you'll need large scale tools, mostly commercial ones

 

[Zargamax]

It can be combined with a macro script to scrape more pages

 

[Badboy Enterprise]

It worked
thanks for share

 

[best999]

It can be combined with a macro script to scrape more pages

Good point! But I wanted to provide method as simple as possible. To use Kantu or AutoIT requires some skills, while "copy-paste and several clicks" method is easy for anyone.

It worked
thanks for share

thank you!

 

[GenesisOne]

Have you done this method with Scrapebox? - not exactly as I guess scrapebox should go page after page on itself.
I am asking as ScrapeStorm is pretty expensive on a monthly basis and Scrapebox in 1 time payment.

 

[DonKing19]

Thanks for the share.. I was looking for this..

 

[DonKing19]

I see it was last updated 2015 and not much reviews.. However great share..

 

[best999]

Have you done this method with Scrapebox? - not exactly as I guess scrapebox should go page after page on itself.
I am asking as ScrapeStorm is pretty expensive on a monthly basis and Scrapebox in 1 time payment.

I like ScrapeStorm because it's very versatile, it even scrapes IG media links from profiles for me. And $20 per month is good price if you can turn it into x5 profit in a week.

The whole point of this thread was to give free scraping method. Of course I agree that commercial scrapers are must-have on big volumes.

 

[best999]

I see it was last updated 2015 and not much reviews.. However great share..

You can use any of Chrome extensions for url/link grabbing, dozens of them are available, actually.

The point is to do it fast and use Google Sheets for cleaning the results - any URL grabber will grab all URLs from page, so you have to either manually pick the ones you need, or use smart filtering trick with Google Sheets

 

[GenesisOne]

I like ScrapeStorm because it's very versatile, it even scrapes IG media links from profiles for me. And $20 per month is good price if you can turn it into x5 profit in a week.

The whole point of this thread was to give free scraping method. Of course I agree that commercial scrapers are must-have on big volumes.

I understand that this method is meant to be free, but ScrapeStorm is $50/month while Scrapebox is $67 one time which is what I was asking.
Nevertheless I'll try ScrapeStorm free version to test it first and see if it's worth the high price.

Thanks

 

[Dingus22]

Would this work on gfycat. I need to scrap all the links to the gifs I have uploaded.