Scraping keywords from 50.000 domains

mrmystic · Sep 18, 2014

Hello. I have a domainlist on 50.000 domains.

I want to find out what category these websites are in, like are they doing sports, computer, webdesign and so on.
Is there a free way i can 'scrape' or find out who uses the keyword or word sport on their website and so?

Like type: Sport, and then it shows me all the domains which contains sports on their website

TrafficWizard · Oct 14, 2014

mrmystic said:
Hello. I have a domainlist on 50.000 domains.

I want to find out what category these websites are in, like are they doing sports, computer, webdesign and so on.
Is there a free way i can 'scrape' or find out who uses the keyword or word sport on their website and so?

Like type: Sport, and then it shows me all the domains which contains sports on their website

I will write a script for you.. !

However I have no effin clue how to get keyword/category idea out of sites.. could I just scrape all meta description ?
<meta name="description" content="Health and Fitness products, health and fitness product reviews" />

This could work or you need something else ? PM

member8200 · Oct 28, 2014

mrmystic said:
Hello. I have a domainlist on 50.000 domains.

I want to find out what category these websites are in, like are they doing sports, computer, webdesign and so on.
Is there a free way i can 'scrape' or find out who uses the keyword or word sport on their website and so?

Like type: Sport, and then it shows me all the domains which contains sports on their website

I think the best option you can do is to hire a programmer to build the script for you, i suggest a php or python programmer.

Scraping keywords from 50.000 domains

mrmystic

Newbie

TrafficWizard

Junior Member

member8200

Regular Member

Main Menu

Marketplace

Making Money

BlackHat World