[clue-tech] CLUE Talk Mailing list mbox file too big to rsynch

adam bultman adamb at glaven.org
Sun Feb 1 10:57:55 MST 2009


31MB?  That's not very big.  I routinely rsync files over 20GB, up to
what?  60GB? 

Could you change the format to Maildir, which would make syncing a lot
easier?  If you rsync an mbox, it'll see the file changed, and just copy
the whole thing again, won't it? Maildir makes rsyncing very efficient.

Anyway.... Moving along...



Jed S. Baer wrote:
> Hi Folks.
>
> I've been doing a nightly rsynch of all crucial CLUE data and config
> files. This has worked fine for a backup for a couple years now, but I've
> hit a snag.
>
> The /var/lib/mailman/archives/private/clue-talk/ directory and the
> /var/lib/mailman/archives/private/clue-talk.mbox/clue-talk.mbox file are
> now both too large for rsync.
>
> The CLUE-Talk mbox file is over 31MB. Yes, it really does contain every
> message ever sent to CLUE-Talk.
>
> Haven't tried it yet, but I'm going to guess that rdiff-backup will have
> the same problem, since it relies on librsync. Or maybe not.
>
> Has anyone used rdiff-backup with very large files?
>
> Anyone have any other suggestions?
>
> Anyone with experience using things such as Amanda and/or bacula have any
> advice on how easy/difficult they are to install and run?
>
> The requirement is pretty simple. Nightly backup of the CLUE mailing
> lists, website, and various config files, to a remote machine.
>
> jed
> _______________________________________________
> clue-tech mailing list
> clue-tech at cluedenver.org
> http://www.cluedenver.org/mailman/listinfo/clue-tech
>   



More information about the clue-tech mailing list