linux-kernel - Re: [bug report] nvme: fio workload hangs on 16m random read

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [day] [month] [year] [list]

Message-ID: <87r0395ldk.fsf@kernel.org>
Date: Fri, 07 Mar 2025 08:51:35 +0100
From: Andreas Hindborg <a.hindborg@...nel.org>
To: "Keith Busch" <kbusch@...nel.org>
Cc: "Jens Axboe" <axboe@...nel.dk>,  "Christoph Hellwig" <hch@....de>,
  "Sagi Grimberg" <sagi@...mberg.me>,  <linux-nvme@...ts.infradead.org>,
  <linux-kernel@...r.kernel.org>
Subject: Re: [bug report] nvme: fio workload hangs on 16m random read

"Keith Busch" <kbusch@...nel.org> writes:

> On Thu, Mar 06, 2025 at 09:46:37PM +0100, Andreas Hindborg wrote:
>> Hi All,
>>
>> My CI system has found an issue for the following fio workload:
>>
>> root@...ian:~# insmod /mnt/v6.14-rc5-build/drivers/nvme/host/nvme-core.ko
>> root@...ian:~# insmod /mnt/v6.14-rc5-build/drivers/nvme/host/nvme.ko poll_queues=1
>>
>> "fio" "--group_reporting" "--name=default" "--filename=/dev/nvme0n1"
>> "--readwrite=randread" "--blocksize=16777216" "--direct=1" "--numjobs=1"
>> "--ioengine=io_uring" "--iodepth=1" "--hipri=1" "--time_based=1"
>> "--runtime=3000"
>>
>> fio will hang, some times immediately, some times after a few minutes.
>>
>> I observed this on v6.14-rc1 and v6.14-rc5. It is not present in v6.13.
>>
>> Can any of you reproduce this? I was able to reproduce this on real
>> hardware and in qemu.
>
> Could you try adding this patch to your kernel?
>
> https://lore.kernel.org/io-uring/92b0a330-4782-45e9-8de7-3b90a94208c2@kernel.dk/

Thanks Keith, at first glance that seems to solve the issue. Will
restart my CI with this applied.


Best regards,
Andreas Hindborg