Thread (24 messages) 24 messages, 8 authors, 2002-12-28

Re: shared pagetable benchmarking

From: Andrew Morton <hidden>
Date: 2002-12-28 02:34:02

"Martin J. Bligh" wrote:
quoted
I don't consider it important enough to qualify unless there are some real
loads where it really matters. I can well imagine that such loads exist
(where low-memory usage by page tables is a real problem), but I'd like to
have that confirmed as a bug-report and that the sharing really does fix
it.
We had over 10Gb of PTEs running Oracle Apps (on 2.4 without RMAP) -
RMAP would add another 5Gb or so to that (2Gb shared memory segment
across many processes). But you can stick PTEs in highmem, whereas
it's not easy to do that with pte_chains ... sticking 5Gb of overhead
into ZONE_NORMAL is tricky ;-) The really nice thing about shared
pagetables as a solution is that it's totally transparent, and requires
no app modifications. Obviously degrading fork for small tasks is
unacceptable, but Dave seems to have fixed that issue now.
To what extent is that a "real" workload?

What other applications are affected, and to what extent?

Why are hugepages not a sufficient solution?

Is this problem sufficiently common to warrant the inclusion of
pagetable sharing in the main kernel, as opposed to a specialised
Oracle/DB2 derivative?
I think the long-term fix for the rmap performance hit is object-based
RMAP (doing the reverse mappings shared on a per-area basis) which we've
talked about, but not for 2.6 ... it may not turn out to be that hard
though ... K42 did it before.
I think we can do a few things still in the 2.6 context.  The fact that
my "apply seventy patches with patch-scripts" test takes 350,000 pagefaults
in 13 seconds makes one go "hmm".
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/
Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help