Categorizing Expired Domains

G

graham25s

Power Member

May 8, 2010

764

190

• Dec 31, 2017

• #1

Hey Guys,

I use my own crawler to find expired domains, the only thing i'm missing is the ability to categorize what niche an expired domain was in, is there an api or a way to get this information at all?

cheers guys

Graham

 

AverageDude

Junior Member

Jul 3, 2011

129

23

• Dec 31, 2017

• #2

If you already wrote your own crawler you could try to expand it using the wayback machine. Just crawl the last entries and try to look for certain keywords. There's most likely a better and easier way but that's what first came to mind.

 

xenoxen

Senior Member

Jul 22, 2009

939

234

• Dec 31, 2017

• #3

Hey mate!

You can also get this data from MajesticSEO API - but you need to pay for it or you can create your own databse where you will categorize and tag websites according to % of words used on page/website.

 

nikita12

Power Member

Nov 15, 2012

662

195

• Dec 31, 2017

• #4

Majestic Topical Categories are what you want. You can subscribe to the Majestic API to get this data for all the domains.

https://blog.majestic.com/development/topicaltrustflow/

 

A

Abstractme

Newbie

Dec 29, 2017

40

6

• Dec 31, 2017

• #5

Hey do you guys know any google search operator to find the expired domains? i am looking for it all over but did not find any.

 

G

graham25s

Power Member

May 8, 2010

764

190

• Dec 31, 2017
• Thread Starter Thread Starter

• #6

Hey Guys, The first thing that came to mind was the majestic api, it seems overly priced for what i need, the archive options is interesting though

cheers guys

 

G

graham25s

Power Member

May 8, 2010

764

190

• Dec 31, 2017
• Thread Starter Thread Starter

• #7

One way is to grab a page:

https://web.archive.org/web/20150306213953/http://www.georgiajuniors.com:80/

Extract the keywords in the <title></title> tags, and put each word and put into an array.

<title>Georgia Juniors Volleyball</title>

The word "volleyball" would denote it a "Sports" category, not the greatest way to do it, but can definately be expanded on

Graham

 

jimbobo2779

Elite Member

Jr. VIP

Sep 17, 2008

6,037

3,973

• Dec 31, 2017

• #8

Domdetailer API shows top 3 topical trust flow and doesn't have monthly subs.

 

G

graham25s

Power Member

May 8, 2010

764

190

• Dec 31, 2017
• Thread Starter Thread Starter

• #9

Hey @jimbobo2779 ah that sounds good! why is there 3 values of categories by majestic do you know? yours is the only api i seee that returns this i will definately signup buddy

regards

Graham

 

jimbobo2779

Elite Member

Jr. VIP

Sep 17, 2008

6,037

3,973

• Dec 31, 2017

• #10

graham25s said:

Hey @jimbobo2779 ah that sounds good! why is there 3 values of categories by majestic do you know? yours is the only api i seee that returns this i will definately signup buddy

regards

Graham

Click to expand...

There is more provided by Majestic ApI but domdetailer currently only returns the top 3. I will be adding more to the api if not the domdetailer software as well.