1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Trim URLs To Root Domain

Discussion in 'Black Hat SEO' started by Huy Phan, Jul 25, 2014.

  1. Huy Phan

    Huy Phan Jr. VIP Jr. VIP

    Joined:
    Sep 3, 2012
    Messages:
    988
    Likes Received:
    569
    Home Page:
    hi guys
    i coded another simple script but helpful for you here :p

    http://ninjaseotools.com/trim-urls-to-root-domain.php

    Features:
    -Include subdomains
    -Ignore URLs starting with an IP
    -Keep entries starting with 'domain: ' in the results
    -Remove duplicates
    -Convert domain names to lowercase
    -Sort results (0 to Z) - it will remove all comments
    -Add the word 'domain:' before extracted domains
    -Generate a list of domains/subdomains as HTTP_REFERER to add to .htaccess file and deny backlinks
     
    • Thanks Thanks x 2
  2. tutughosh

    tutughosh Jr. VIP Jr. VIP

    Joined:
    Sep 28, 2010
    Messages:
    1,576
    Likes Received:
    484
    Occupation:
    Business
    Location:
    Some Where in the Optical
    Home Page:
    This will be a nice for every one... Thanks
     
  3. AsgharSK

    AsgharSK Jr. VIP Jr. VIP

    Joined:
    Jun 10, 2014
    Messages:
    351
    Likes Received:
    21
    Gender:
    Male
    Location:
    Sweden
    Its great Nice sharing mate thanks
     
  4. prab1996

    prab1996 Elite Member

    Joined:
    Jan 8, 2013
    Messages:
    3,494
    Likes Received:
    2,031
    Occupation:
    your gf's <3 ♥♥♥♥
    Location:
    Prab1996.com
    Home Page:
    scraoebox can do it. thanks , will come handy some time.
    -=-
     
  5. Creative9

    Creative9 Junior Member

    Joined:
    May 22, 2014
    Messages:
    136
    Likes Received:
    15
    Thanks, nice tool.
     
  6. pbnseo

    pbnseo Newbie

    Joined:
    Jul 25, 2014
    Messages:
    4
    Likes Received:
    1
    Occupation:
    SEO
    Location:
    UK
    Cheers for this!

    To make this script even better I would recommend the addition of removing .gov .edu and .ac.uk urls, a simple fix that will improve upon the speed making it faster than scrapebox.
     
    • Thanks Thanks x 1
  7. aka sam

    aka sam Jr. VIP Jr. VIP Premium Member

    Joined:
    Sep 15, 2011
    Messages:
    4,111
    Likes Received:
    901
    Gender:
    Male
    Occupation:
    Internet Marketer
    Location:
    Black Hat World
    Home Page:
    +1 for you Mate...