[clue-tech] file deduplication

Angelo Bertolli angelo at freeshell.org
Fri Sep 7 14:47:06 MDT 2007


David L. Willson wrote:
> Is anyone aware of a free (as in software) tool that will crawl a filesystem replacing
> redundant copies of files with hard-links to the first instance of each?
>   

Hmmm, no... but if it helps I can offer a bash script I wrote once which 
hashes all the files under a certain directory and reports duplicates.  
 From running that script I can tell you something to watch out for:  
there's a lot more files containing 0 bytes than you realize ;)  You 
probably don't want to hard link all of those.

Angelo




More information about the clue-tech mailing list