[clue-tech] file deduplication

David L. Anselmi anselmi at anselmi.us
Fri Sep 7 20:08:07 MDT 2007


David L. Willson wrote:
> Is anyone aware of a free (as in software) tool that will crawl a filesystem replacing
> redundant copies of files with hard-links to the first instance of each?

Seems like that shouldn't be more than a few lines of perl.  Well, at 
least less than 10.  Perl can do find, and md5sum, and a hash is an easy 
way to find dupes.

Dave



More information about the clue-tech mailing list