Find duplicate files

Two files are duplicates when their contents match, whatever they are called. shasum gives every file a fingerprint; sorting the fingerprints puts identical files next to each other, so duplicates fall out in one line.

How

List every file in this folder that is an exact copy of another:

find . -type f -exec shasum {} + | sort | awk '{h=$1; $1=""; if (h==p) print "duplicate:" $0; p=h}'

This only lists them. Look before deleting — a copy in a backup folder may be there on purpose.

Or just ask Titan

Find the duplicate photos in my Pictures folder and show me before deleting anything. Do it with Titan

Titan is an AI that lives on your computer: tell it what you need and it does it while you watch — you press Return, nothing runs by itself. What is Titan?

Titan isn’t on this computer yet. Get Titan, then press the button again — the task will be waiting, typed in.

Related

Find what is taking up disk space Clean up old files in Downloads