1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Duplicate URL

Discussion in 'BlackHat Lounge' started by ericsson, Sep 26, 2009.

  1. ericsson

    ericsson Elite Member Premium Member

    Joined:
    Apr 25, 2009
    Messages:
    2,642
    Likes Received:
    8,132
    Occupation:
    www
    Location:
    Swe
    Home Page:
    Hi!

    I got a huge list of URLs from an extractor on different pages.

    Is there a tool who can remove duplicated URL i probably have on that saved text file?

    Thanks In Advance

    //Jimmy

    Guess noone knows..

    :(
     
    Last edited: Sep 26, 2009
  2. Jimmy078

    Jimmy078 Registered Member

    Joined:
    Apr 10, 2008
    Messages:
    94
    Likes Received:
    15
    Occupation:
    Bum
    Location:
    USA
  3. s0phia

    s0phia Regular Member

    Joined:
    Nov 11, 2008
    Messages:
    266
    Likes Received:
    280
    in case you are still looking: CSVed, very good tool imho :thumb:
    has a lot of functions, one of them removes duplicates in chosen column(s) and then saves them in a new file.