Re: kernel.org mirroring (Re: [GIT PULL] MMC update)

Olivier Galibert wrote:

On Thu, Dec 07, 2006 at 11:57:34AM -0800, H. Peter Anvin wrote:

quoted

Olivier Galibert wrote:

quoted

On Thu, Dec 07, 2006 at 11:16:58AM -0800, H. Peter Anvin wrote:

quoted

Unfortunately, the most common queries are also extremely expensive.

Do you have a top-ten of queries ?  That would be the ones to optimize
for.

The front page, summary page of each project, and the RSS feed for each 
project.

Hmmm, maybe you could have the summaries and rss feed generated on
push, which could also generate elementary files with lines of the
front page.  That would make these top offenders static page serving.

The "extremely aggresive caching solution" could be as follows: cache
everything, invalidate (remove) on push caches of variable variety related
to push (list of projects and OPML on any push; summary page and every
page without h=<hash> or hb=<hash>;f=<filename> for a given project).

The most important problem is that kernel.org uses old gitweb, the last
version before incorporating gitweb into git (and also reducing
significantly the time needed for summary, heads and tags pages).
-- 
Jakub Narebski
Warsaw, Poland
ShadeHawk on #git