[lug] replacing dupes with links

Mon Mar 12 19:16:19 MDT 2018

yes, i've used fslint, good for finding duplicates spread on multiple drives, but for this case it would require massive user attention.  nearly every file on the relevant partition is duplicated, some more than 10 times, and there are 1000's of "unique" files, a lot of work to tell fslint what to keep and what to link.  looks like freedup or rdfind is probably the answer.  anyone ever use them or know which one will run faster?  this is a relatively wimpy machine.

mad.scientist.at.large (a good madscientist)
--
God bless the rich, the greedy and the corrupt politicians they have put into office.   God bless them for helping me do the right thing by giving the rich my little pile of cash.  After all, the rich know what to do with money.

12. Mar 2018 16:41 by DLWillson at TheGeek.NU:

> `fslint` does exactly that, *and* it will allow you to do all your dupes at once, so if you have many different files all with many dupes, you'll be able to de-dupe them all, instantly. Be careful though, you can also delete them all, instantly. That option was disappointingly attractive to my quickly clicking finger, once.
>
> - > https://www.pixelbeat.org/fslint
> - > https://alternativeto.net/software/fslint
>
> --
> David L. Willson
> Teacher, Engineer, Evangelist
> COA LFCS CCAH RHCE CLP
> Mobile 720-333-LANS(5267)
> http://sofree.us
>
> This is a good time for a r3VOLution.
>
>
>
>>           For organizational purposes i'm trying to deal with a partition that has many copies of each file in various subdirectories.  I'd like a way to replace all but one instance of a given file with a link.  Is there an easy way to do this?  I'm thinking i can use fdupes and some scripting.  Any better ideas or already written shellscripts or programs? 
>>
>>  The partition has several hundred gig of files (several hundered thousand files including dupes) nicely sorted and grouped but consuming excess space.  Run time isn't much of an issue as this machine can run unattended overnight.  I could use fslint with a lot of user involvement but obviously that would be tedious.
>>
>>
>> mad.scientist.at.large (a good madscientist)
>> --
>> God bless the rich, the greedy and the corrupt politicians they have put into office.   God bless them for helping me do the right thing by giving the rich my little pile of cash.  After all, the rich know what to do with money.
>>   
>> _______________________________________________
>> Web Page:  >> http://lug.boulder.co.us
>> Mailing List: >> http://lists.lug.boulder.co.us/mailman/listinfo/lug
>> Join us on IRC: irc.hackingsociety.org port=6667 channel=#hackingsociety
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lug.boulder.co.us/pipermail/lug/attachments/20180313/a884c5e3/attachment.html>