Re: [bug report] NVMe/IB: reset_controller need more than 1min
From: Yi Zhang <hidden>
Date: 2021-05-22 04:28:34
Also in:
linux-nvme
On Sat, May 22, 2021 at 2:00 AM Sagi Grimberg [off-list ref] wrote:
quoted
Hi I found this issue on 5.13-rc2 with NVMe/IB environment, could anyone help check it? Thanks. $ time echo 1 >/sys/block/nvme0n1/device/reset_controller real 0m10.678s user 0m0.000s sys 0m0.000s $ time echo 1 >/sys/block/nvme0n1/device/reset_controller real 1m11.530s user 0m0.000s sys 0m0.000s target: $ dmesg | grep nvme [ 276.891454] nvmet: creating controller 1 for subsystem testnqn for NQN nqn.2014-08.org.nvmexpress:uuid:4c4c4544-0056-4c10-8058-b7c04f383432. [ 287.374412] nvmet: ctrl 1 keep-alive timer (5 seconds) expired! [ 287.399317] nvmet: ctrl 1 fatal error occurred! [ 348.412672] nvmet: creating controller 1 for subsystem testnqn for NQN nqn.2014-08.org.nvmexpress:uuid:4c4c4544-0056-4c10-8058-b7c04f383432. client: $ dmesg | grep nvme [ 281.704475] nvme nvme0: creating 40 I/O queues. [ 285.557759] nvme nvme0: mapped 40/0/0 default/read/poll queues. [ 353.187809] nvme nvme0: I/O 8 QID 0 timeout [ 353.193100] nvme nvme0: Property Set error: 881, offset 0x14 [ 353.226082] nvme nvme0: creating 40 I/O queues. [ 357.088266] nvme nvme0: mapped 40/0/0 default/read/poll queues.It appears that there is an admin timeout that is either triggered by the reset or unrelated. Can you run nvme reset /dev/nvme0 instead so we can see the "resetting controller" print?
Yes, here is the log: ------------------------0 + nvme reset /dev/nvme0 real 0m10.737s user 0m0.004s sys 0m0.004s ------------------------1 + nvme reset /dev/nvme0 real 1m11.335s user 0m0.002s sys 0m0.005s target: [ 934.306016] nvmet: creating controller 1 for subsystem testnqn for NQN nqn.2014-08.org.nvmexpress:uuid:4c4c4544-0056-4c10-8058-b7c04f383432. [ 944.875021] nvmet: ctrl 1 keep-alive timer (5 seconds) expired! [ 944.900051] nvmet: ctrl 1 fatal error occurred! [ 1005.628340] nvmet: creating controller 1 for subsystem testnqn for NQN nqn.2014-08.org.nvmexpress:uuid:4c4c4544-0056-4c10-8058-b7c04f383432. client: [ 857.264029] nvme nvme0: resetting controller [ 864.115369] nvme nvme0: creating 40 I/O queues. [ 867.996746] nvme nvme0: mapped 40/0/0 default/read/poll queues. [ 868.001673] nvme nvme0: resetting controller [ 935.396789] nvme nvme0: I/O 9 QID 0 timeout [ 935.402036] nvme nvme0: Property Set error: 881, offset 0x14 [ 935.438080] nvme nvme0: creating 40 I/O queues. [ 939.332125] nvme nvme0: mapped 40/0/0 default/read/poll queues. -- Best Regards, Yi Zhang