[Nix-dev] Re: How do parallel builds scale?

[Ludovic Courtès]

Hi Marc,

Marc Weber <marco-oweber at gmx.de> writes:

> More interesting: Have you also numbers about whether some of those
> builds failed due to -jX ?

Sort of.  If you look at the plots at
<http://hubble.gforge.inria.fr/parallel-builds.html>, you’ll see that
the total number of packages in the ‘-j32’ curve is slightly lower than
that of ‘-j2’.  It’s less than 10% off the top of my head, but I haven’t
looked in detail.

> I've had another idea in mind: Building up a database listing the
> resources a build takes (both IO and CPU). Then it would be possible to
> calculate an estimated wait time for rebuilds - or maybe it would be
> possible to optimize the order of builds or such.

That’s the idea: <http://hubble.gforge.inria.fr/hubble.html#sec-2_4>.
:-)

Thanks,
Ludo’.