Duplicate remover?

[IGFella]

No idea where to post it so I will post it here.

Is there a tool to remove lines that repeat? Not as in remove duplicates, there are plenty of those around, but if a line appears more than once, remove the original + duplicate?
Can't seem to find any of those. I know it's probably possible to make such tool in 3 seconds but programming is Chinese to me.

 

[mhtro]

Learn Chinese then.
Anyway here you go: https://www.glarysoft.com/duplicate-cleaner/

 

[IGFella]

Learn Chinese then.
Anyway here you go: https://www.glarysoft.com/duplicate-cleaner/

That's a file cleaner soft, I'm talking about text lines

 

[mhtro]

That's a file cleaner soft, I'm talking about text lines

Oh alright my man, I got you:
https://textmechanic.com/text-tools/basic-text-tools/remove-duplicate-lines/

Idk about the originals though

 

[IGFella]

Oh alright my man, I got you:
https://textmechanic.com/text-tools/basic-text-tools/remove-duplicate-lines/

Idk about the originals though

That's not the one again
I need it to remove the duplicate + the original if they repeat. So if "a" repeats >1 time I need it to remove all the a's not just the duplicate ones.

 

[phatzilla]

duplifind

 

[Veil123]

Google...is...your...friend...not!

- http://www.text-utils.com/remove-duplicate-lines

 

[IGFella]

Google...is...your...friend...not!

I tried many different duplicate removers but all of them kept a single record and only removed the duplicates.

http://www.text-utils.com/remove-duplicate-lines

That's the money right there. Thanks a lot!

 

[payal23j]

You can remove it through Excel too. There is an option on menu bar as duplicate remover. It's easy to use.

 

[HoNeYBiRD]

Online tools can be good, but if you have a long ass text, it will break the browser.

Notepad++ and regex is your friend as always: https://stackoverflow.com/questions...s-and-delete-all-in-notepad/35350261#35350261

 

[Zwielicht]

THREAD moved​