| lists.openwall.net | lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC | |
|
Open Source and information security mailing list archives
| ||
|
Date: Tue, 12 Nov 2019 17:03:57 +0800
From: kernel test robot <rong.a.chen@...el.com>
To: Frederic Weisbecker <frederic@...nel.org>
Cc: Ingo Molnar <mingo@...nel.org>,
Linus Torvalds <torvalds@...ux-foundation.org>,
"Paul E . McKenney" <paulmck@...ux.vnet.ibm.com>,
Peter Zijlstra <peterz@...radead.org>,
Thomas Gleixner <tglx@...utronix.de>,
LKML <linux-kernel@...r.kernel.org>,
Stephen Rothwell <sfr@...b.auug.org.au>, lkp@...ts.01.org
Subject: [irq_work] feb4a51323: BUG:soft_lockup-CPU##stuck_for#s
FYI, we noticed the following commit (built with gcc-7):
commit: feb4a51323babe13315c3b783ea7f1cf25368918 ("irq_work: Slightly simplify IRQ_WORK_PENDING clearing")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
in testcase: blktests
with following parameters:
disk: 1SSD
test: block-group1
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+------------------------------------------------+------------+------------+
| | 25269871db | feb4a51323 |
+------------------------------------------------+------------+------------+
| boot_successes | 5 | 0 |
| boot_failures | 0 | 10 |
| BUG:soft_lockup-CPU##stuck_for#s | 0 | 10 |
| RIP:irq_work_sync | 0 | 10 |
| Kernel_panic-not_syncing:softlockup:hung_tasks | 0 | 10 |
+------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen@...el.com>
[ 81.049506] watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [blktrace:4948]
[ 81.055602] Modules linked in: scsi_debug loop intel_rapl_msr intel_rapl_common sr_mod cdrom crct10dif_pclmul crc32_pclmul bochs_drm crc32c_intel sd_mod sg ghash_clmulni_intel drm_vram_helper ata_generic pata_acpi ttm ppdev drm_kms_helper snd_pcm syscopyarea sysfillrect snd_timer aesni_intel snd sysimgblt fb_sys_fops ata_piix crypto_simd drm cryptd glue_helper libata soundcore pcspkr joydev serio_raw virtio_scsi i2c_piix4 parport_pc floppy parport ip_tables [last unloaded: scsi_debug]
[ 81.071683] CPU: 0 PID: 4948 Comm: blktrace Not tainted 5.4.0-rc7-00003-gfeb4a51323bab #1
[ 81.075435] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 81.079031] RIP: 0010:irq_work_sync+0x4/0x10
[ 81.081575] Code: 84 00 00 00 00 00 48 8b bf a0 00 00 00 48 85 ff 74 10 48 81 ef 90 00 00 00 74 05 e9 56 dc ff ff f3 c3 0f 0b c3 90 eb 02 f3 90 <8b> 07 a8 02 75 f8 f3 c3 0f 1f 40 00 8b 17 89 d1 89 d0 83 c9 03 f0
[ 81.090460] RSP: 0018:ffffafd88094bd70 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[ 81.093896] RAX: 0000000000000002 RBX: ffff9aee7cd56e40 RCX: 0000000000000000
[ 81.097074] RDX: 000034e9800087b8 RSI: 0000000000000000 RDI: ffff9aee7cd56e88
[ 81.100158] RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000fffc3f60
[ 81.103453] R10: ffff9aee7fdaf980 R11: 0000000000000001 R12: ffffffffadc41660
[ 81.106738] R13: ffff9aee8026f7b8 R14: 00005568f8dd6830 R15: 0000000000000000
[ 81.109879] FS: 00007f57890f4740(0000) GS:ffff9aeeffc00000(0000) knlGS:0000000000000000
[ 81.113298] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 81.116240] CR2: 00007f5789280870 CR3: 00000001bffb8000 CR4: 00000000000406f0
[ 81.119436] Call Trace:
[ 81.121438] relay_close_buf+0x19/0x50
[ 81.123746] relay_close+0x64/0x100
[ 81.126071] blk_trace_free+0x1f/0x50
[ 81.128291] __blk_trace_remove+0x1e/0x30
[ 81.130554] blk_trace_ioctl+0x11b/0x140
[ 81.132826] blkdev_ioctl+0x6c1/0xa40
[ 81.135013] block_ioctl+0x39/0x40
[ 81.137145] do_vfs_ioctl+0xa5/0x700
[ 81.139243] ksys_ioctl+0x70/0x80
[ 81.141209] __x64_sys_ioctl+0x16/0x20
[ 81.143334] do_syscall_64+0x5b/0x1d0
[ 81.145431] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 81.147830] RIP: 0033:0x7f57891e7427
[ 81.149844] Code: 00 00 90 48 8b 05 69 aa 0c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 39 aa 0c 00 f7 d8 64 89 01 48
[ 81.156755] RSP: 002b:00007ffd49de8cc8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[ 81.159794] RAX: ffffffffffffffda RBX: 0000000000000004 RCX: 00007f57891e7427
[ 81.162756] RDX: 00005568f8dd6830 RSI: 0000000000001276 RDI: 0000000000000004
[ 81.165780] RBP: 00005568f8dd6830 R08: 000000000000002f R09: 00005568faab87b0
[ 81.168987] R10: 0000000000000001 R11: 0000000000000246 R12: 00005568faab8570
[ 81.172007] R13: 00005568f8dd6830 R14: 00005568f8dd6830 R15: 00007ffd49de8d50
[ 81.174999] Kernel panic - not syncing: softlockup: hung tasks
[ 81.177815] CPU: 0 PID: 4948 Comm: blktrace Tainted: G L 5.4.0-rc7-00003-gfeb4a51323bab #1
[ 81.181669] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 81.185180] Call Trace:
[ 81.187071] <IRQ>
[ 81.188876] dump_stack+0x66/0x8b
[ 81.191015] panic+0x105/0x2e2
[ 81.193079] watchdog_timer_fn+0x256/0x260
[ 81.195313] ? softlockup_fn+0x40/0x40
[ 81.197418] __hrtimer_run_queues+0x108/0x2b0
[ 81.199640] hrtimer_interrupt+0xe5/0x240
[ 81.201779] smp_apic_timer_interrupt+0x6a/0x140
[ 81.204018] apic_timer_interrupt+0xf/0x20
[ 81.206246] </IRQ>
[ 81.207787] RIP: 0010:irq_work_sync+0x4/0x10
[ 81.209809] Code: 84 00 00 00 00 00 48 8b bf a0 00 00 00 48 85 ff 74 10 48 81 ef 90 00 00 00 74 05 e9 56 dc ff ff f3 c3 0f 0b c3 90 eb 02 f3 90 <8b> 07 a8 02 75 f8 f3 c3 0f 1f 40 00 8b 17 89 d1 89 d0 83 c9 03 f0
[ 81.216585] RSP: 0018:ffffafd88094bd70 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[ 81.219531] RAX: 0000000000000002 RBX: ffff9aee7cd56e40 RCX: 0000000000000000
[ 81.222359] RDX: 000034e9800087b8 RSI: 0000000000000000 RDI: ffff9aee7cd56e88
[ 81.225171] RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000fffc3f60
[ 81.227837] R10: ffff9aee7fdaf980 R11: 0000000000000001 R12: ffffffffadc41660
[ 81.230106] R13: ffff9aee8026f7b8 R14: 00005568f8dd6830 R15: 0000000000000000
[ 81.231908] relay_close_buf+0x19/0x50
[ 81.233302] relay_close+0x64/0x100
[ 81.234709] blk_trace_free+0x1f/0x50
[ 81.236105] __blk_trace_remove+0x1e/0x30
[ 81.237432] blk_trace_ioctl+0x11b/0x140
[ 81.238688] blkdev_ioctl+0x6c1/0xa40
[ 81.240107] block_ioctl+0x39/0x40
[ 81.241932] do_vfs_ioctl+0xa5/0x700
[ 81.243320] ksys_ioctl+0x70/0x80
[ 81.244613] __x64_sys_ioctl+0x16/0x20
[ 81.246059] do_syscall_64+0x5b/0x1d0
[ 81.247359] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 81.249101] RIP: 0033:0x7f57891e7427
[ 81.250605] Code: 00 00 90 48 8b 05 69 aa 0c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 39 aa 0c 00 f7 d8 64 89 01 48
[ 81.256795] RSP: 002b:00007ffd49de8cc8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[ 81.259422] RAX: ffffffffffffffda RBX: 0000000000000004 RCX: 00007f57891e7427
[ 81.261754] RDX: 00005568f8dd6830 RSI: 0000000000001276 RDI: 0000000000000004
[ 81.264415] RBP: 00005568f8dd6830 R08: 000000000000002f R09: 00005568faab87b0
[ 81.266333] R10: 0000000000000001 R11: 0000000000000246 R12: 00005568faab8570
[ 81.268787] R13: 00005568f8dd6830 R14: 00005568f8dd6830 R15: 00007ffd49de8d50
[ 81.271996] Kernel Offset: 0x2b400000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
Elapsed time: 120
To reproduce:
# build kernel
cd linux
cp config-5.4.0-rc7-00003-gfeb4a51323bab .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Rong Chen
View attachment "config-5.4.0-rc7-00003-gfeb4a51323bab" of type "text/plain" (200562 bytes)
View attachment "job-script" of type "text/plain" (5180 bytes)
Download attachment "dmesg.xz" of type "application/x-xz" (48048 bytes)
Powered by blists - more mailing lists