"Shawn O. Pearce" [off-list ref] wrote:
Linus Torvalds [off-list ref] wrote:
quoted
Junio - I suspect "pack-check.c" really shouldn't try to do it as one
single humungous "SHA1_Update()" call. It showed one bug on PPC, I
wouldn't be surprised if it's implicated now on some other architecture.
It used to do it as one big SHA1_Update() call...
quoted
Shawn - does the pack-file-windowing thing already change that? I'm too
lazy to check..
But with the mmap window thing in `next` it does it in window
units only. Which the user could configure to be huge, or could
configure to be sane. The default when using mmap() is 32 MiB;
1 MiB when using pread() and git_mmap().
I should also point out that my git-fastimport hack that we used
on the huge Mozilla import may be helpful here. Its _very_ fast
as it goes right to a pack file, but there's no SVN frontend for
it at this time.
--
Shawn.