Thread (14 messages) 14 messages, 3 authors, 2020-12-16

Re: hybrid polling on an nvme doesn't seem to work with iodepth > 1 on 5.10.0-rc5

From: Andres Freund <hidden>
Date: 2020-12-11 08:02:05

Hi,

On 2020-12-11 01:44:38 +0000, Pavel Begunkov wrote:
In general the current hybrid polling doesn't work well with high QD,
that's because statistics it based on are not very resilient to all sorts
of problems. And it might be a problem I described long ago

https://www.spinics.net/lists/linux-block/msg61479.html
https://lkml.org/lkml/2019/4/30/120
Interesting.

Are you interested in it just out of curiosity, or you have a good
use case? Modern SSDs are so fast that even with QD1 the sleep overhead
on sleeping getting considerable, all the more so for higher QD.
It's a bit more than just idle curiosity, but not a strong need (yet). I
was experimenting with using it for postgres WAL writes. The CPU cost of
"classic" polling is high enough to make it not super attractive in a
lot of cases.  Often enough the QD is just 1 for data integrity writes
on fast drives, but there's also cases (bulk load particularly, or high
concurrency OLTP) where having multiple IOs in flight is important.

Because if there is no one who really cares, then instead of adding
elaborated correction schemes, I'd rather put max(time, 10ms) and
that's it.
I wonder if it's doable to just switch from hybrid polling to classic
polling if there's more than one request in flight?

Greetings,

Andres Freund
Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help