Thread (57 messages) 57 messages, 11 authors, 2012-03-18

Re: getdents - ext4 vs btrfs performance

From: Jacek Luczak <hidden>
Date: 2012-03-15 10:42:24
Also in: linux-ext4, linux-fsdevel, lkml

2012/3/11 Ted Ts'o [off-list ref]:
Well, my goal in proposing this optimization is that helps for the
"medium size" directories in the cold cache case. =A0The ext4 user wh=
o
first kicked off this thread was using his file system for an SVN
server, as I recall. =A0I could easily believe that he has thousands =
of
files; maybe even tens of thousands of files in a directory. =A0But t=
hat
probably still fits in 256k, or at best 512k worth of directory block=
s.
That was not a SVN server. It was a build host having checkouts of SVN
projects.

The many files/dirs case is common for VCS and the SVN is not the only
that would be affected here. AFAIR git.kernel.org was also suffering
from the getdents(). Same applies to commercial products that are
heavily stuffed with many files/dirs, e.g. ClearCase or Synergy. In
the second one case we are running on XFS for a longer while and I
must say that this was a huge improvement mostly on backup times
(where a dump of Informix and the whole filesystem is ordinary
compressed in tarball).

A medium size you are referring would most probably fit into 256k and
this could be enough for 90% of cases. Large production system running
on ext4 need backups thus those would benefit the most here.

-Jacek
--
To unsubscribe from this list: send the line "unsubscribe linux-ext4" i=
n
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help