Thread (18 messages) flat view 18 messages, 11 authors, 2016-06-15

Re: inotify daemon speedup for git [POC/HACK]

From: Enrico Weigelt <hidden>
Date: 2016-06-15 22:49:18

* Jakub Narebski [off-list ref] wrote:
I guess that modern filesystems solve the problem of very many files
in a single directory somehow (hash tables?).  Perhaps the index file
could borrow some such mechanism as an extension.

Index for index?
hmm, if an index gets too large, it could be split into several
ones by an pathname prefix (but not necessarily one per directory)
so when having the subdirs "a", "b", "c", we'll three separate 
index files and a master index telling:

    a/	index.001
    b/	index.002
    c/	index.003

or even:

    a/		index.001
    b/		index.002
    b/foo	index.004
    c/		index.005

this would just add one indirection in the index-lookup by
comparing the key w/ index indice's prefix.


cu
-- 
----------------------------------------------------------------------
 Enrico Weigelt, metux IT service -- http://www.metux.de/

 phone:  +49 36207 519931  email: weigelt@metux.de
 mobile: +49 151 27565287  icq:   210169427         skype: nekrad666
----------------------------------------------------------------------
 Embedded-Linux / Portierung / Opensource-QM / Verteilte Systeme
----------------------------------------------------------------------
Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help