Duplicate URL

Discussion in 'BlackHat Lounge' started by ericsson, Sep 26, 2009.

  1. Sep 26, 2009
    #1
    ericsson

    ericsson Elite Member Premium Member

    Joined:
    Apr 25, 2009
    Messages:
    2,641
    Likes Received:
    8,138
    Hi!

    I got a huge list of URLs from an extractor on different pages.

    Is there a tool who can remove duplicated URL i probably have on that saved text file?

    Thanks In Advance

    //Jimmy

    Guess noone knows..

    :(
     
    Last edited: Sep 26, 2009
  2. Oct 11, 2009
    #2
    Jimmy078

    Jimmy078 Registered Member

    Joined:
    Apr 10, 2008
    Messages:
    94
    Likes Received:
    15
    Occupation:
    Bum
    Location:
    USA
  3. Oct 11, 2009
    #3
    s0phia

    s0phia Regular Member

    Joined:
    Nov 11, 2008
    Messages:
    266
    Likes Received:
    281
    in case you are still looking: CSVed, very good tool imho :thumb:
    has a lot of functions, one of them removes duplicates in chosen column(s) and then saves them in a new file.