1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

[need help] remove subdomains of url list

Discussion in 'Black Hat SEO Tools' started by kkvsam, Jan 26, 2012.

  1. kkvsam

    kkvsam Senior Member

    Joined:
    Oct 11, 2009
    Messages:
    936
    Likes Received:
    569
    Occupation:
    SYS ADMIN
    Home Page:
    I've scraped huge list of URLs through SB. But there are lots of sub domains like abc.domain.com. I need to remove all sub domains and want to get main domains. Any one know how to do this?
    Code:
    abc.domain.com to domain.com
    Thank you.
     
    Last edited: Jan 26, 2012
  2. Techkat

    Techkat Registered Member

    Joined:
    Aug 14, 2011
    Messages:
    73
    Likes Received:
    65
    You can use Sick Scraper (free tool) for this task:

    Code:
    [B][URL]http://sickmarketing.com/beta/scraper.exe[/URL][/B]
    
     
  3. kkvsam

    kkvsam Senior Member

    Joined:
    Oct 11, 2009
    Messages:
    936
    Likes Received:
    569
    Occupation:
    SYS ADMIN
    Home Page:
    I've sick scraper. Then what?
     
  4. hpv222

    hpv222 Power Member

    Joined:
    Feb 8, 2010
    Messages:
    736
    Likes Received:
    274
    regular expressions should help

    what's easier for me though would be to import the list in access, using the dot (.) as a delimiter - then you will end up with three columns:
    sub domain com
    sub domain1 com

    etc. - just copy the 2nd and the third and you'll end up with

    domain com
    domain1 com

    then just replace the space with dot (.) It takes less than 10 seconds
     
  5. kkvsam

    kkvsam Senior Member

    Joined:
    Oct 11, 2009
    Messages:
    936
    Likes Received:
    569
    Occupation:
    SYS ADMIN
    Home Page:
    but if the site is abc.domain.com.uk, then what? I need to have domain.com.uk for those domains.
     
  6. Techkat

    Techkat Registered Member

    Joined:
    Aug 14, 2011
    Messages:
    73
    Likes Received:
    65
    Then this:

    Sick Scraper -> Import Urls -> Trim to root domain
     
  7. kkvsam

    kkvsam Senior Member

    Joined:
    Oct 11, 2009
    Messages:
    936
    Likes Received:
    569
    Occupation:
    SYS ADMIN
    Home Page:
    it is not removing . Check your self.
     
  8. milans

    milans Regular Member

    Joined:
    Mar 26, 2011
    Messages:
    370
    Likes Received:
    149
  9. kkvsam

    kkvsam Senior Member

    Joined:
    Oct 11, 2009
    Messages:
    936
    Likes Received:
    569
    Occupation:
    SYS ADMIN
    Home Page:
    No. Dude. I can remove dupe with SB. What I need is remove subdomains from the URL list and get the root domain like below.
    Code:
    abc.domain.com  --->  domain.com
    abc.domain.co.uk ---> domain.co.uk
     
  10. Techkat

    Techkat Registered Member

    Joined:
    Aug 14, 2011
    Messages:
    73
    Likes Received:
    65
    You are right.
    It only works for
    domain.com/subdomain
     
  11. spoon22

    spoon22 Regular Member

    Joined:
    May 7, 2011
    Messages:
    321
    Likes Received:
    152
    Lol, he gave you the solution and you don't see it?

    Just copy 2,3,4 and replace space with dot in notepad (STRG+H)