1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Software Suggestion - Cleaning Data

Discussion in 'BlackHat Lounge' started by Jagged55, Feb 26, 2009.

  1. Jagged55

    Jagged55 Power Member

    Joined:
    Mar 27, 2008
    Messages:
    747
    Likes Received:
    325
    Occupation:
    Internet Marketing
    Location:
    Canada
    Can anyone suggest a good piece(s) of software to help with cleaning up lists? I had a couple pieces that were helpful in the past but I lost them all in a hard drive crash :( I have been getting by with Excel but I need something else. Basically I am looking to do the following:

    1. compare two txt files....dupe data is erased and a single clean list is spit out

    2. search for a specific string and every line that contains it will be deleted from the list (not search and replace)

    3. add a string to various parts of a line: beginning, end after a specific word/string

    Any help is appreciated...thanks!
     
  2. oldenstylehats

    oldenstylehats Elite Member Premium Member

    Joined:
    Apr 10, 2008
    Messages:
    1,893
    Likes Received:
    1,196
    How is the information in the text files structured? CSV, TSV, new lines?
     
  3. Jagged55

    Jagged55 Power Member

    Joined:
    Mar 27, 2008
    Messages:
    747
    Likes Received:
    325
    Occupation:
    Internet Marketing
    Location:
    Canada
    Mainly just normal text files (no formatting). One piece of data per line (keyword, url, email address etc). Very simple stuff. So to make it clear, just pretend it is lists of email addresses....comparing 2 lists for dupes, deleting all emails from the list that have "hotmail" in them. Thanks.
     
  4. sendlerad

    sendlerad Regular Member

    Joined:
    Sep 5, 2007
    Messages:
    307
    Likes Received:
    51
    google for ''listomtor'' does everythink
     
  5. Jagged55

    Jagged55 Power Member

    Joined:
    Mar 27, 2008
    Messages:
    747
    Likes Received:
    325
    Occupation:
    Internet Marketing
    Location:
    Canada
    Thanks but can you check the spelling on that please?
     
  6. redmercury

    redmercury Registered Member

    Joined:
    Oct 22, 2008
    Messages:
    97
    Likes Received:
    6
    I didn't see anything for "listomtor" . Is that right spelling?
     
  7. banannabee

    banannabee Newbie

    Joined:
    Oct 27, 2008
    Messages:
    23
    Likes Received:
    10
    Try "listmotor"
     
  8. sendlerad

    sendlerad Regular Member

    Joined:
    Sep 5, 2007
    Messages:
    307
    Likes Received:
    51
    yes listmotor.biz