Thread (18 messages) 18 messages, 7 authors, 2025-01-29

Re: Direct I/O performance problems with 1GB pages

From: Jens Axboe <axboe@kernel.dk>
Date: 2025-01-27 18:54:12
Also in: linux-mm

On 1/27/25 11:21 AM, Andres Freund wrote:
quoted
That's precisely what io-uring fixed buffers do :)
I looked at using them at some point - unfortunately it seems that there is
just {READ,WRITE}_FIXED not {READV,WRITEV}_FIXED. It's *exceedingly* common
for us to do reads/writes where source/target buffers aren't wholly
contiguous. Thus - unless I am misunderstanding something, entirely plausible
- using fixed buffers would unfortunately increase the number of IOs
noticeably.

Should have sent an email about that...

I guess we could add some heuristic to use _FIXED if it doesn't require
splitting an IO into too many sub-ios. But that seems pretty gnarly.
Adding Pavel, he's been working on support registered buffers with
readv/writev.
I dimly recall that I also ran into some around using fixed buffers as a
non-root user. It might just be the accounting of registered buffers as
mlocked memory and the difficulty of configuring that across
distributions. But I unfortunately don't remember any details anymore.
Should just be accounting.

-- 
Jens Axboe
Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help