Thread (183 messages) 183 messages, 41 authors, 2007-08-06

Re: RFT: updatedb "morning after" problem [was: Re: -mm merge plans for 2.6.23]

From: Andrew Morton <akpm@linux-foundation.org>
Date: 2007-07-26 10:38:53
Also in: lkml

On Thu, 26 Jul 2007 12:27:30 +0200 Ingo Molnar [off-list ref] wrote:
* Andrew Morton [off-list ref] wrote:
quoted
quoted
quoted
quoted
( we _do_ want to baloon the dentry cache otherwise - for things like 
  "find" - having a fast VFS is important. But known-use-once things 
  like the daily updatedb job can clearly be annotated properly. )
Mutter.  /proc/sys/vm/vfs_cache_pressure has been there for what, 
three years?  Are any distros raising it during the updatedb run yet?
but ... that's system-wide, and the 'dont baloon the dcache' is only a 
property of updatedb.
Sure, but it's practical, isn't it?  Who runs (and cares about) 
vfs-intensive workloads during their wee-small-hours updatedb run?
there's another side-effect: it likely results in the zapping of 
thousands of dentries that were cached nicely before. So we might 
exchange 'all my apps are swapped out' experience with 'all file access 
is slow'. The latter is _probably_ still an improvement over the 
balooning, but i'm not sure.
Yup.  Nobody has begun to think about preserving dcache/icache across load
shifts yet, afaik.  Hard.
What we _really_ want is an updatedb that 
does not disturb the dcache.
Well.  Hopefully this time next year you can prep a 16MB container and toss
your updatedb inside that.  Maybe set its peak disk bandwidth utilisation
too.  However that won't work ;) because I don't think anyone is looking
at containerisation of vfs cache memory yet.  Perhaps full-on openvz has it,
dunno.

But updatedb is a special case, because it is so vfs-intensive.  For lots
of other workloads (those which use heaps of pagecache), resource
management via containerisation will work nicely.

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help