Thread (10 messages) 10 messages, 3 authors, 2023-08-01

Re: What is the status of GSoC 2022 work on making Git use roaring bitmaps?

From: Han-Wen Nienhuys <hidden>
Date: 2023-07-31 17:46:38

On Sat, Mar 25, 2023 at 6:40 PM Jakub Narębski [off-list ref] wrote:
quoted
quoted
quoted
Abhradeep promised[1] that he'd include some performance work in his
next version of that series. I think the main things we'd be interested
in are:

  - Does using Roaring provide a file-size advantage over
    EWAH-compressed bitmaps?
I modified JGit to write Roaring bitmaps instead of EWAH bitmaps. The
resulting difference in file sizes are small, and actually favor EWAH:

$ ls -l {ewah-repos,roaring-repos}/*.git/objects/pack/*.bitmap
-r--r----- 1 hanwen primarygroup 26257386 Jul 31 15:04
ewah-repos/android-pfb.git/objects/pack/pack-b14c35ec7fc3bb20884abe51a81c832be5983fdc.bitmap
-r--r----- 1 hanwen primarygroup 27621579 Jul 31 15:20
roaring-repos/android-pfb.git/objects/pack/pack-b14c35ec7fc3bb20884abe51a81c832be5983fdc.bitmap

-r--r----- 1 hanwen primarygroup  1037356 Jul 31 14:46
ewah-repos/gerrit.git/objects/pack/pack-fe46c7f96a2910f5775a2ff3bef7e4fa0e779f91.bitmap
-r--r----- 1 hanwen primarygroup  1242608 Jul 31 14:45
roaring-repos/gerrit.git/objects/pack/pack-fe46c7f96a2910f5775a2ff3bef7e4fa0e779f91.bitmap

-- 
Han-Wen Nienhuys - Google Munich
I work 80%. Don't expect answers from me on Fridays.
--
Google Germany GmbH, Erika-Mann-Strasse 33, 80636 Munich
Registergericht und -nummer: Hamburg, HRB 86891
Sitz der Gesellschaft: Hamburg
Geschäftsführer: Paul Manicle, Liana Sebastian
Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help