Last Updated: April 27, 2019
·
208
· Lars Van Casteren

Find duplicates

Scan a large list of files and match duplicates:

find -not -empty -type f -printf "%s\n" | sort -rn | uniq -d | xargs -I{} -n1 find -type f -size {}c -print0 | xargs -0 md5sum | sort | uniq -w32 --all-repeated=separate