Trim URLs To Root Domain

Huy Phan

Senior Member
Joined
Sep 3, 2012
Messages
1,037
Reaction score
581
hi guys
i coded another simple script but helpful for you here :P

http://ninjaseotools.com/trim-urls-to-root-domain.php

Features:
-Include subdomains
-Ignore URLs starting with an IP
-Keep entries starting with 'domain: ' in the results
-Remove duplicates
-Convert domain names to lowercase
-Sort results (0 to Z) - it will remove all comments
-Add the word 'domain:' before extracted domains
-Generate a list of domains/subdomains as HTTP_REFERER to add to .htaccess file and deny backlinks
 
scraoebox can do it. thanks , will come handy some time.
-=-
 
Cheers for this!

To make this script even better I would recommend the addition of removing .gov .edu and .ac.uk urls, a simple fix that will improve upon the speed making it faster than scrapebox.
 
Back
Top