ANN of new versions of Mercurial

Paul Boddie paul.boddie at biotek.uio.no
Tue Jan 8 13:30:02 UTC 2013


On 08/01/13 01:58, Matt Mackall wrote:
> On Mon, 2013-01-07 at 13:05 +0100, Paul Boddie wrote:
>> [*] When asked to give Ubuntu releases a test to see if the bootloader
>> works, to provide an extreme example, I often wonder whether Canonical
>> thinks its demographic is a bunch of tinkerers who don't do anything
>> more than try out the latest release, as opposed to people using the
>> software to do actual work. I also wonder whether they have any testing
>> infrastructure to eliminate basic deployment issues at all. There's only
>> a limited potential in asking people to bear a significant cost
>> (disruption and potential loss of work) in order to save a much lower
>> cost to the project.
> This is an perfect example of my point. Canonical has about 500
> employees, but there are something like 20 million Ubuntu users (most
> paying $0 each). There are many more than 500 models of laptop out there
> so it's obviously an economic impossibility for Canonical to test even a
> tiny fraction of the hardware configurations their users use. So they
> absolutely need people like Tess to help them.

I'm not disputing this. That said, a lot of bugs that can be caught by 
opportunistic testing are generic enough that just running a few test 
machines would pick them up. My bootloader bug anecdote involved a 
pretty normal configuration, and any organisation considering more than 
a couple of use-cases should have been testing for it anyway. (I have my 
own suspicions about what kind of narrow audience Ubuntu is targeting 
these days, but that's a different story.)

> Let's imagine a scenario where .1% of machines are incompatible with a
> new bootloader. If they have 1000 Tesses, they might catch it before
> release. 2000 Tesses and they're much more likely. But Earl is pretty
> much irrelevant. If 20 million Norms randomly upgrade once every two
> years, 100k Norms are going to randomly pick release day to upgrade.
> Without Tess, we'll have 100 Norms with machines that won't boot. If
> we've got 100k Earls updating too, now we've got 200 broken machines on
> day one. Not an improvement.

I think I got Norm and Earl somewhat mixed up, but I also think there's 
a continuum involved. Some forms of Earl want the latest release but 
hold back until it is "done" because they are not merely playing around. 
To persuade these forms of Earl to use release candidates is a hard 
sell, even though any investment on Earl's part does provide him with 
some benefit, potentially huge if there's something that will break his 
working environment.

> This is basically the story of Mercurial, but scaled up by a few orders
> of magnitude.

Well, I wish you the very best in getting Earl to make time for trying 
out the release candidates. Since I'm more in the Norm category myself 
with regard to Mercurial (but not with regard to everything), mostly at 
the more conservative end of that part of the continuum, I won't try and 
change anyone's mind about this, but I do wonder whether the tactics are 
the best ones to encourage earlier testing.

Paul



More information about the Mercurial mailing list