Thread (7 messages) 7 messages, 4 authors, 2016-09-02

Re: [PATCH] doc-rst:sphinx-extensions: add metadata parallel-safe

From: Markus Heiser <hidden>
Date: 2016-09-01 16:38:50

Am 01.09.2016 um 18:22 schrieb Markus Heiser [off-list ref]:
Am 01.09.2016 um 16:29 schrieb Jani Nikula [off-list ref]:
quoted
On Thu, 01 Sep 2016, Jonathan Corbet [off-list ref] wrote:
quoted
On Wed, 24 Aug 2016 15:35:24 +0200
Markus Heiser [off-list ref] wrote:
quoted
With metadata "parallel_read_safe = True" a extension is marked as
save for "parallel reading of source". This is needed if you want
build in parallel with N processes. E.g.:

make SPHINXOPTS=-j4 htmldocs
A definite improvement; applied to the docs tree, thanks.
The Sphinx docs say -jN "should be considered experimental" [1]. Any
idea *how* experimental that is, really? Could we add some -j by
default?
My experience is, that parallel build is only strong on "reading
input" and weak on "writing output". I can't see any rich performance
increase on more than -j2 ... 

Mauro posted [2] his experience with -j8 compared to serial. He
also compares -j8 to -j16:
quoted
PS: on my server with 16 dual-thread Xeon CPU, the gain with a
bigger value for -j was not impressive. Got about the same time as
with -j8 or -j32 there.
I guess he will get nearly the same results with -j2 ;)

If we want to add a -j default, I suggest -j2. 

[2] https://www.mail-archive.com/linux-doc%40vger.kernel.org/msg05552.html

-- Markus --
Sorry, forget to mentioning, that there has been some improvements
to parallel build in Sphinx 1.3 compared to 1.2. But in 1.3.2 they
have also fixed a bug which lets parallel builds hang :-o

https://github.com/sphinx-doc/sphinx/blob/master/CHANGES#L665

This in mind and if we really support down to sphinx 1.2 ... we
should not use any -j default.

IMHO we should get rid of this sphinx 1.2. downward compatibility,
it makes so may problems (e.g. see [3]) ... but we have discussed
this already and I don't want to restart this thread ;-) 

[3] https://www.mail-archive.com/linux-doc%40vger.kernel.org/msg05695.html

-- Markus --


quoted
BR,
Jani.


[1] http://www.sphinx-doc.org/en/stable/invocation.html#invocation-of-sphinx-build

-- 
Jani Nikula, Intel Open Source Technology Center
--
To unsubscribe from this list: send the line "unsubscribe linux-doc" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
  
Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help