Re: kernel.org mirroring (Re: [GIT PULL] MMC update)

Linus Torvalds wrote:

On Thu, 7 Dec 2006, H. Peter Anvin wrote:

quoted

That all being said, the lack of intrinsic caching in gitweb continues to be a
major problem for us.  Under high load, it makes all the problems worse.

I really don't see what gitweb could do that would be somehow better than 
apache doing the caching in front of it.. Is there some apache reason why 
that isn't sufficient (ie limitations on its cache size or timeouts?)

What it could do better is it could prevent multiple identical queries 
from being launched in parallel.  That's the real problem we see; under 
high load, Apache times out so the git query never gets into the cache; 
but in the meantime, the common queries might easily have been launched 
20 times in parallel.  Unfortunately, the most common queries are also 
extremely expensive.