Re: Multi-threaded 'git clone'

On Mon, 16 Feb 2015, Jeff King wrote:

On Mon, Feb 16, 2015 at 05:31:13AM -0800, David Lang wrote:

quoted

I think it's an interesting question to look at, but before you start
looking at changing the architecture of the current code, I would suggest
doing a bit more analisys of the problem to see if the bottleneck is really
where you think it is.

First measure, then optimize :-)

Yes, very much so. Fortunately some people have already done some of
this work. :)

nice summary

Then the server streams the data to the client. It might do some light
work transforming the data as it comes off the disk, but most of it is
just blitted straight from disk, and the network is the bottleneck.

Depending on how close to full the WAN link is, it may be possible to improve 
this with multiple connections (again, referencing bbcp), but there's also the 
question of if it's worth trying to use the entire WAN for a single user. The 
vast majority of the time the server is doing more than one thing and would 
rather let any individual user wait a bit and service the other users.

David Lang