software question

Discussion in 'BlackHat Lounge' started by acrimon, Jul 18, 2008.

  1. acrimon

    acrimon Newbie

    Joined:
    Mar 27, 2008
    Messages:
    41
    Likes Received:
    4
    does anyone know of a program that combines text files and removes duplicates? (duplicate lines)

    I used to have one for email address but it only worked for email address and I want it to work for lines since I'm sorting URLS.

    Even a program that removes duplicate lines would be fine
     
  2. Cleaner007

    Cleaner007 Newbie

    Joined:
    Jul 10, 2008
    Messages:
    1
    Likes Received:
    0
    Concerning duplicates removal i know a very good program called Clone Remover. It searches and http://www.moleskinsoft.com/delete-duplicate-files from pc
     
  3. acrimon

    acrimon Newbie

    Joined:
    Mar 27, 2008
    Messages:
    41
    Likes Received:
    4
    thanks. I saw that program but it deletes files I'm looking for something that removes duplicate lines of text inside the txt file
     
  4. jaeden

    jaeden BANNED BANNED

    Joined:
    Jun 3, 2008
    Messages:
    232
    Likes Received:
    28
    im sure notepad++ can do it. it can do anything and everything. so many built in features and plugins available... and its free.