linux-kernel - Re: [PATCH 6.10 00/25] 6.10.6-rc3 review

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-ID: <ZsRmmQOLiZ1KtQ1T@duo.ucw.cz>
Date: Tue, 20 Aug 2024 11:49:13 +0200
From: Pavel Machek <pavel@...x.de>
To: Florian Bezdeka <florian.bezdeka@...mens.com>
Cc: Chris Paterson <Chris.Paterson2@...esas.com>,
	Pavel Machek <pavel@...x.de>,
	Greg Kroah-Hartman <gregkh@...uxfoundation.org>,
	"stable@...r.kernel.org" <stable@...r.kernel.org>,
	"patches@...ts.linux.dev" <patches@...ts.linux.dev>,
	"linux-kernel@...r.kernel.org" <linux-kernel@...r.kernel.org>,
	"torvalds@...ux-foundation.org" <torvalds@...ux-foundation.org>,
	"akpm@...ux-foundation.org" <akpm@...ux-foundation.org>,
	"linux@...ck-us.net" <linux@...ck-us.net>,
	"shuah@...nel.org" <shuah@...nel.org>,
	"patches@...nelci.org" <patches@...nelci.org>,
	"lkft-triage@...ts.linaro.org" <lkft-triage@...ts.linaro.org>,
	"jonathanh@...dia.com" <jonathanh@...dia.com>,
	"f.fainelli@...il.com" <f.fainelli@...il.com>,
	"sudipm.mukherjee@...il.com" <sudipm.mukherjee@...il.com>,
	"srw@...dewatkins.net" <srw@...dewatkins.net>,
	"rwarsow@....de" <rwarsow@....de>,
	"conor@...nel.org" <conor@...nel.org>,
	"allen.lkml@...il.com" <allen.lkml@...il.com>,
	"broonie@...nel.org" <broonie@...nel.org>,
	Quirin Gylstorff <quirin.gylstorff@...mens.com>
Subject: Re: [PATCH 6.10 00/25] 6.10.6-rc3 review

Hi!

> > So we could blame it on the qemu-cip-siemens-muc machine, however, it was quite happily booting 6.10.6-rc1 a few days ago:
> > https://lava.ciplatform.org/scheduler/job/1180857
> > 6.10.6-rc2 was also okay:
> > https://lava.ciplatform.org/scheduler/job/1181017
> 
> As Chris pointed out that this might be related to our qemu instance in
> the CIP lab. We had a look and found the attached kernel splat. This
> seems not a guest but a host problem (which is Debian/6.1 based and not
> 6.10).

Aha, thanks a lot, things make sense now.

> I think you can continue, ignore the test result for this 6.10 release
> for now. 
> 
> We will investigate further. Let's see.
> 
> For completeness the kernel log of the host is attached. LAVA runs into
> a timeout and marks the job as failed.

Thanks for the log. It seems something is seriously wrong with the
machine, likely deadlock in ext4 or storage subsystems. If there are
any suspect messages before this one, they may be useful.

Best regards,
								Pavel

> [1639290.742208] INFO: task lava-run [job: :70173 blocked for more than 120 seconds.
> [1639290.742223]       Not tainted 6.1.0-22-amd64 #1 Debian 6.1.94-1
> [1639290.742231] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
> [1639290.742241] task:lava-run [job:  state:D stack:0     pid:70173 ppid:2131   flags:0x00000002
> [1639290.742244] Call Trace:
> [1639290.742245]  <TASK>
> [1639290.742247]  __schedule+0x34d/0x9e0
> [1639290.742253]  schedule+0x5a/0xd0
> [1639290.742255]  wb_wait_for_completion+0x82/0xb0
> [1639290.742258]  ? cpuusage_read+0x10/0x10
> [1639290.742261]  __writeback_inodes_sb_nr+0xa0/0xd0
> [1639290.742263]  try_to_writeback_inodes_sb+0x55/0x70
> [1639290.742266]  ext4_nonda_switch+0x80/0x90 [ext4]
> [1639290.742289]  ext4_da_write_begin+0x61/0x2c0 [ext4]
> [1639290.742306]  ? __file_remove_privs+0xbb/0x150
> [1639290.742309]  generic_perform_write+0xcd/0x210
> [1639290.742313]  ext4_buffered_write_iter+0x84/0x140 [ext4]
> [1639290.742328]  vfs_write+0x232/0x3e0
> [1639290.742332]  ksys_write+0x6b/0xf0
> [1639290.742334]  do_syscall_64+0x55/0xb0
> [1639290.742337]  ? ksys_read+0x6b/0xf0
> [1639290.742339]  ? exit_to_user_mode_prepare+0x44/0x1f0
> [1639290.742342]  ? syscall_exit_to_user_mode+0x1e/0x40
> [1639290.742344]  ? do_syscall_64+0x61/0xb0
> [1639290.742345]  ? syscall_exit_to_user_mode+0x1e/0x40
> [1639290.742347]  ? do_syscall_64+0x61/0xb0
> [1639290.742349]  ? do_syscall_64+0x61/0xb0
> [1639290.742350]  ? __do_sys_newfstatat+0x4e/0x80
> [1639290.742353]  ? exit_to_user_mode_prepare+0x44/0x1f0
> [1639290.742355]  ? syscall_exit_to_user_mode+0x1e/0x40
> [1639290.742357]  ? do_syscall_64+0x61/0xb0
> [1639290.742358]  ? syscall_exit_to_user_mode+0x1e/0x40
> [1639290.742360]  ? do_syscall_64+0x61/0xb0
> [1639290.742362]  ? syscall_exit_to_user_mode+0x1e/0x40
> [1639290.742363]  ? do_syscall_64+0x61/0xb0
> [1639290.742365]  ? do_syscall_64+0x61/0xb0
> [1639290.742366]  ? do_syscall_64+0x61/0xb0
> [1639290.742367]  ? do_syscall_64+0x61/0xb0
> [1639290.742369]  entry_SYSCALL_64_after_hwframe+0x6e/0xd8
> [1639290.742371] RIP: 0033:0x7fc69729e240
> [1639290.742373] RSP: 002b:00007ffcfc6840e8 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
> [1639290.742375] RAX: ffffffffffffffda RBX: 0000000000a860f8 RCX: 00007fc69729e240
> [1639290.742376] RDX: 0000000000004000 RSI: 00000000019198d0 RDI: 000000000000000d
> [1639290.742378] RBP: 0000000000004000 R08: 0000000000000000 R09: 0000000000000000
> [1639290.742378] R10: 0000000000000003 R11: 0000000000000202 R12: 00007fc6971a4fc0
> [1639290.742380] R13: 000000000000000d R14: 0000000000a440e0 R15: 0000000000000000
> [1639290.742382]  </TASK>
> [1639411.519101] INFO: task lava-run [job: :70173 blocked for more than 241 seconds.
> [1639411.519115]       Not tainted 6.1.0-22-amd64 #1 Debian 6.1.94-1


-- 
DENX Software Engineering GmbH,        Managing Director: Erika Unter
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany

Download attachment "signature.asc" of type "application/pgp-signature" (196 bytes)