Thread (4 messages) flat view 4 messages, 3 authors, 2016-06-15

Re: [RFC] Dynamic window size on repack?

From: Linus Torvalds <torvalds@linux-foundation.org>
Date: 2016-06-15 22:43:20


On Sun, 8 Jul 2007, Brian Downing wrote:
I think what I'd like is an extra option to repack to limit window
memory usage.  This would dynamically scale the window size down if it
can't fit within the limit, then scale it back up once you're off of the
nasty file.  This would let me repack my repository with --window=100
and have it actually finish someday on the machines I have access to.
The big file may not be as efficiently packed as possible, but I can
live with that.

My question is, is this sane?  Does the repack algorithm depend on having
a fixed window size to work?  I'd rather not look into implementing this
if it's silly on the face of it.
It doesn't sound silly, and it should even be fairly easy. The window code 
is all in builtin-pack-objects.c (find_deltas()) and while it's currently 
coded for a constant-sized window, it shouldn't be too hard to free more 
old entries if you allocate one big one to make sure that the "array" 
thing doesn't grow to contain too much data.

In other words, just look at how the variables "struct unpacked *array" 
(the whole window array) and the "struct unpacked *n" (the "next entry" in 
the array using a simple circular queue using "idx") are accessed.

		Linus
Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help