Remove duplicate lines from a list
Paste the list into a text file and run sort -u, which sorts it and keeps each line once. To keep the original order, awk "!seen[$0]++" drops repeats without sorting.
How
Sorted, each line once:
sort -u list.txt > clean.txt
Original order, each line once:
awk '!seen[$0]++' list.txt > clean.txt
“Apple” and “apple” count as different lines. Add -f to sort (sort -uf) to treat them as the same.
Or just ask Titan
Remove the duplicate emails from this list and keep the order.Do it with Titan
Titan is an AI that lives on your computer: tell it what you need and it does it while you watch — you press Return, nothing runs by itself. What is Titan?
Titan isn’t on this computer yet. Get Titan, then press the button again — the task will be waiting, typed in.