1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Script/software that deletes multiple lines in .txt files

Discussion in 'Black Hat SEO Tools' started by raybeam, Feb 23, 2011.

  1. raybeam

    raybeam Newbie

    Joined:
    Jan 12, 2011
    Messages:
    41
    Likes Received:
    2
    The word in the title should be "duplicate", then you might understand me better.
    It's a simple little task, but haven't found any program that does the job..

    What I want is a program that finds multiples and lets me delete them:
    email1
    email2
    email3
    email1
    email2
    email4
    -------------
    In my case above result would be

    email1
    email2
    email3
    email4
     
  2. badpete

    badpete Newbie

    Joined:
    Dec 18, 2009
    Messages:
    13
    Likes Received:
    4
    Import data into excel and remove duplicates then copy and paste back to a .txt
     
  3. RootLocus

    RootLocus Newbie

    Joined:
    Jan 5, 2011
    Messages:
    3
    Likes Received:
    1
    Loop each line of the txt loading them one by one in a List.
    If the entrance is already present in that List, skip the current line.
    Pseudo-code will be.

    List li;
    For Each line in txt
    For Each element in li
    If line == element
    li.add(element);

    Easy ;)
     
  4. chris456

    chris456 Regular Member

    Joined:
    May 17, 2010
    Messages:
    281
    Likes Received:
    567
    TextPipe is best - search for it here , it has 1000 functions ready to use ,
    Extract link or Link Extractor (I don't remember the name) is also removing duplicate lines automaticaly , you can find it here too.
    many other text editors do that too , very simple task for every editor . almost everywhere the function should name : remove duplicate lines
     
  5. raybeam

    raybeam Newbie

    Joined:
    Jan 12, 2011
    Messages:
    41
    Likes Received:
    2
    Thanks for your replies, will start taking a look at textpipe then.
    Love this forum, so much knowledge. :)
     
  6. raybeam

    raybeam Newbie

    Joined:
    Jan 12, 2011
    Messages:
    41
    Likes Received:
    2
    I can recommend using TextPipe Pro if anyone else has the same issue in the future.
     
  7. alaltaierii

    alaltaierii Supreme Member

    Joined:
    Jun 11, 2010
    Messages:
    1,408
    Likes Received:
    349
  8. fatboy

    fatboy Elite Member

    Joined:
    Aug 13, 2008
    Messages:
    1,618
    Likes Received:
    3,227
    Occupation:
    Retired
    Location:
    Old Peoples Home
    If you are using Linux, type something like:

    Code:
    uniq original.list.txt > dedupe.list.txt
    
    That should help you without installing anything else :)
     
  9. corstenroam

    corstenroam Junior Member

    Joined:
    Jun 10, 2010
    Messages:
    106
    Likes Received:
    10
    Occupation:
    CEO of SEO38.com
    Location:
    UKR
    what about textpipe. I have a keygen if u need it