Trim URLs To Root Domain

Discussion in 'Black Hat SEO' started by Huy Phan, Jul 25, 2014.

  1. Huy Phan

    Huy Phan Jr. VIP Jr. VIP

    Joined:
    Sep 3, 2012
    Messages:
    1,030
    Likes Received:
    575
    Home Page:
    hi guys
    i coded another simple script but helpful for you here :p

    http://ninjaseotools.com/trim-urls-to-root-domain.php

    Features:
    -Include subdomains
    -Ignore URLs starting with an IP
    -Keep entries starting with 'domain: ' in the results
    -Remove duplicates
    -Convert domain names to lowercase
    -Sort results (0 to Z) - it will remove all comments
    -Add the word 'domain:' before extracted domains
    -Generate a list of domains/subdomains as HTTP_REFERER to add to .htaccess file and deny backlinks
     
    • Thanks Thanks x 2
  2. tutughosh

    tutughosh Jr. VIP Jr. VIP

    Joined:
    Sep 28, 2010
    Messages:
    1,642
    Likes Received:
    492
    Occupation:
    Business
    Location:
    Some Where in the Optical
    Home Page:
    This will be a nice for every one... Thanks
     
  3. AsgharSK

    AsgharSK BANNED BANNED

    Joined:
    Jun 10, 2014
    Messages:
    416
    Likes Received:
    30
    Gender:
    Male
    Its great Nice sharing mate thanks
     
  4. prab1996

    prab1996 Elite Member

    Joined:
    Jan 8, 2013
    Messages:
    3,493
    Likes Received:
    2,032
    Occupation:
    your gf's <3 ♥♥♥♥
    Location:
    Prab1996.com
    Home Page:
    scraoebox can do it. thanks , will come handy some time.
    -=-
     
  5. Creative9

    Creative9 Junior Member

    Joined:
    May 22, 2014
    Messages:
    138
    Likes Received:
    15
    Thanks, nice tool.
     
  6. pbnseo

    pbnseo Newbie

    Joined:
    Jul 25, 2014
    Messages:
    4
    Likes Received:
    1
    Occupation:
    SEO
    Location:
    UK
    Cheers for this!

    To make this script even better I would recommend the addition of removing .gov .edu and .ac.uk urls, a simple fix that will improve upon the speed making it faster than scrapebox.
     
    • Thanks Thanks x 1
  7. aka sam

    aka sam Jr. VIP Jr. VIP Premium Member

    Joined:
    Sep 15, 2011
    Messages:
    4,405
    Likes Received:
    916
    Gender:
    Male
    Occupation:
    Internet Marketer
    Location:
    Black Hat World
    Home Page:
    +1 for you Mate...