Thread (23 messages) flat view 23 messages, 7 authors, 2016-06-15

Re: large files and low memory

From: Enrico Weigelt <hidden>
Date: 2016-06-15 22:49:42

* Shawn Pearce [off-list ref] wrote:
The mmap() isn't the problem.  Its the allocation of a buffer that is
larger than the file in order to hold the result of deflating the file
before it gets written to disk.  
When the file is bigger than physical memory, the kernel has to
page in parts of the file as well as swap in and out parts of
that allocated buffer to hold the deflated file.
What are the access pattern of these memory areas ?
Perhaps madvise() could help ?


cu
-- 
----------------------------------------------------------------------
 Enrico Weigelt, metux IT service -- http://www.metux.de/

 phone:  +49 36207 519931  email: weigelt@metux.de
 mobile: +49 151 27565287  icq:   210169427         skype: nekrad666
----------------------------------------------------------------------
 Embedded-Linux / Portierung / Opensource-QM / Verteilte Systeme
----------------------------------------------------------------------
Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help