Question on work-flow for big binary files

Marcus Lindblom macke at yar.nu
Thu Dec 18 16:31:53 UTC 2008


Andrei Vermel wrote:
>> It boils down to this: is it feasible with a distributed versioning 
>> system of really large files? Perhaps I should run some 
>> tests, but it's 
>> hard to predict performance a few years down the line.
>>
>> Anyone with experience in that field? How much data can one feasibly 
>> work with in a DVCS? Am I trying to use the wrong tool for the job?
>>
> At some point I got a file of about 170Mb checked in, but then it would not
> check out.
> Now we are using an extension 'bigfiles'. See
> http://www.selenic.com/pipermail/mercurial/2008-November/022175.html
> In our experience the current 10Mb warning limit is a safe one, but we are
> thinking about lowering it further down to 2Mb on our site so that the repo
> won't grow too much due to the binaries.

Good to know.

Using this together with a prune-pass on the server repo could be a way 
forward. Still, I'm reluctant to clone a big repo, unless it would fetch 
bigfiles from the master on demand.

Cheers
/Marcus



More information about the Mercurial mailing list