Expired Domain Crawlers Talk

[Doublet7t]

Expired Domain Crawlers

I have seen some OLD threads on here that are talking about Expired Domain Crawlers, but they were very outdated threads. Does that mean those crawlers are not any good? I am just wanting to see if there is an open source domain crawler out there?

I am looking for the open source option because I would like to see if I can use one for an FB crawling for emails as well. The bigger question becomes are these methods outdated?

Any info I can get from anyone would be helpful.

Also if this thread is not in the correct spot let me know. First time posting my own thread.

 

[krazylearner]

have you checked xenu link sleuth ? it can scrap whole websites for expired links . run on windows machine. its not open source but yes its available for free for commercial and personal use

 

[Doublet7t]

have you checked xenu link sleuth ? it can scrap whole websites for expired links . run on windows machine. its not open source but yes its available for free for commercial and personal use

No I have not check on that first time I have heard of that one. Where can I find this at?

 

[krazylearner]

No I have not check on that first time I have heard of that one. Where can I find this at?

you can search "xenu link sleuth" on google and first result will take you to the download section .

i use it like that

1.crawl any website like abc.com with this tool
2.the tool will give you a report of all broken and unresolved links with status like 200 (SUCCESS) or 404 (NOT FOUND) or other status for unreachable links

the links with status which is not 200 or 404 are normally expired domains but you need to check in domain registrar to make sure domain is available for purchase.
i have used this trick to find several high da expired domains on high authority websites .

This is the only free way i know to find expired domains on any website like forbes.com

The other way is to buy ahref subscription . if you are interested in this way then let me know i will tell you steps to do it

Thanks

 

[JitenderSingh]

is there any offer on purchasing of domain name?