lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Message-ID: <20170407070606.zn4hxadsv7rm6goj@wfg-t540p.sh.intel.com>
Date:   Fri, 7 Apr 2017 15:06:06 +0800
From:   Fengguang Wu <fengguang.wu@...el.com>
To:     LKML <linux-kernel@...r.kernel.org>
Cc:     LKP <lkp@...org>
Subject: [rbtree_test_init] ca92e6c7e6 [   87.454390] NMI watchdog: BUG: soft
 lockup - CPU#0 stuck for 22s! [swapper:1]

Greetings,

FYI, here is a soft-lockup bug in linux-next that cannot be bisected
due to noises.

[   39.808930] xz_dec_test: Create a device node with 'mknod xz_dec_test c 249 0' and write .xz files to it.
[   39.823932] glob: 64 self-tests passed, 0 failed
[   39.826494] rbtree testing
[   59.360186]  -> 571619 cycles
[   61.437068] augmented rbtree testing
[   87.454390] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [swapper:1]
[   87.463514] CPU: 0 PID: 1 Comm: swapper Not tainted 4.10.0-rc4-00095-gca92e6c #1
[   87.466569] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.9.3-20161025_171302-gandalf 04/01/2014
[   87.472161] task: ffff880018540000 task.stack: ffff880018548000
[   87.474709] RIP: 0010:__asan_loadN+0x0/0x20
[   87.476420] RSP: 0000:ffff88001854fd78 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff10
[   87.479538] RAX: fffffbfff5e6ca3d RBX: 0000000000000000 RCX: ffffffffab585fd2
[   87.482608] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffffaf365198
[   87.485552] RBP: ffff88001854fdc0 R08: fffffbfff5e6ca3d R09: fffffbfff5e6ca3c
[   87.488431] R10: ffffffffaf3651e7 R11: fffffbfff5e6ca3d R12: 0000000000000003
[   87.493010] R13: ffffffffb20a4448 R14: ffffffffb20a4478 R15: ffffffffb20a4568
[   87.495917] FS:  0000000000000000(0000) GS:ffffffffae2c0000(0000) knlGS:0000000000000000
[   87.499113] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   87.501423] CR2: 0000000000000000 CR3: 000000000c620000 CR4: 00000000000006f0
[   87.504274] Call Trace:
[   87.505393]  ? erase_augmented+0xf9/0x33b
[   87.507463]  rbtree_test_init+0x187/0x220
[   87.509042]  ? irq_poll_setup+0x4d/0x4d
[   87.510528]  do_one_initcall+0x15a/0x321
[   87.512070]  ? start_kernel+0x718/0x718
[   87.513550]  ? parse_args+0x5b8/0x7e0
[   87.515134]  ? do_early_param+0x114/0x114
[   87.516946]  kernel_init_freeable+0x2ce/0x3d8
[   87.518688]  ? rest_init+0xd0/0xd0
[   87.520100]  kernel_init+0xc/0x200
[   87.521416]  ? rest_init+0xd0/0xd0
[   87.522742]  ret_from_fork+0x31/0x40
[   87.524131] Code: c6 48 c1 ee 03 0f b6 14 16 84 d2 74 df 83 e0 07 38 c2 7f d8 ba 01 00 00 00 be 10 00 00 00 e8 48 02 00 00 5d c3 66 0f 1f 44 00 00 <55> 31 d2 48 89 e5 48 8b 4d 08 e8 61 ed ff ff 5d c3 0f 1f 44 00 
[   87.532512] Kernel panic - not syncing: softlockup: hung tasks
[   87.534863] CPU: 0 PID: 1 Comm: swapper Tainted: G             L  4.10.0-rc4-00095-gca92e6c #1
[   87.538173] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.9.3-20161025_171302-gandalf 04/01/2014
[   87.542228] Call Trace:
[   87.543234]  <IRQ>
[   87.544107]  dump_stack+0x19/0x2a
[   87.545434]  panic+0x1c9/0x415
[   87.546616]  ? percpu_up_read_preempt_enable+0x9b/0x9b
[   87.549079]  ? ftrace_likely_update+0x62/0x80
[   87.550973]  ? watchdog_timer_fn+0x35e/0x390
[   87.552575]  watchdog_timer_fn+0x390/0x390
[   87.554217]  ? watchdog_park_threads+0x50/0x50
[   87.555924]  __hrtimer_run_queues+0x383/0x670
[   87.558025]  ? hrtimer_fixup_activate+0x30/0x30
[   87.559745]  hrtimer_interrupt+0xda/0x2e0
[   87.561374]  ? hrtimer_fixup_init+0x30/0x30
[   87.562961]  local_apic_timer_interrupt+0x4d/0x70
[   87.564761]  smp_apic_timer_interrupt+0x4b/0x60
[   87.566516]  apic_timer_interrupt+0x91/0xa0
[   87.568164] RIP: 0010:__asan_loadN+0x0/0x20
[   87.572423] RSP: 0000:ffff88001854fd78 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff10
[   87.575701] RAX: fffffbfff5e6ca3d RBX: 0000000000000000 RCX: ffffffffab585fd2
[   87.578359] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffffaf365198
[   87.581055] RBP: ffff88001854fdc0 R08: fffffbfff5e6ca3d R09: fffffbfff5e6ca3c
[   87.583941] R10: ffffffffaf3651e7 R11: fffffbfff5e6ca3d R12: 0000000000000003
[   87.586824] R13: ffffffffb20a4448 R14: ffffffffb20a4478 R15: ffffffffb20a4568
[   87.589688]  </IRQ>
[   87.590612]  ? erase_augmented+0x5d/0x33b
[   87.593547]  ? erase_augmented+0xf9/0x33b
[   87.595647]  rbtree_test_init+0x187/0x220
[   87.597345]  ? irq_poll_setup+0x4d/0x4d
[   87.598936]  do_one_initcall+0x15a/0x321
[   87.600523]  ? start_kernel+0x718/0x718
[   87.602110]  ? parse_args+0x5b8/0x7e0
[   87.603599]  ? do_early_param+0x114/0x114
[   87.605190]  kernel_init_freeable+0x2ce/0x3d8
[   87.606919]  ? rest_init+0xd0/0xd0
[   87.608233]  kernel_init+0xc/0x200
[   87.609616]  ? rest_init+0xd0/0xd0
[   87.611082]  ret_from_fork+0x31/0x40
[   87.612677] Kernel Offset: 0x29e00000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)


0b75f821ec  Merge branch 'timers-urgent-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
4205e4786d  cpu/hotplug: Provide dynamic range for prepare stage
ca92e6c7e6  Merge branch 'smp-urgent-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
269c930e66  Merge tag 'xfs-4.11-fixes-3' of git://git.kernel.org/pub/scm/fs/xfs/xfs-linux
d203084e69  Add linux-next specific files for 20170406
+--------------------------------------------------------------------------------------------------------+------------+------------+------------+------------+---------------+
|                                                                                                        | 0b75f821ec | 4205e4786d | ca92e6c7e6 | 269c930e66 | next-20170406 |
+--------------------------------------------------------------------------------------------------------+------------+------------+------------+------------+---------------+
| boot_successes                                                                                         | 0          | 0          | 176        | 26         | 11            |
| boot_failures                                                                                          | 700        | 700        | 3          | 14         | 4             |
| BUG:kernel_reboot-without-warning_in_early-boot_stage,last_printk:Probing_EDD(edd=off_to_disable)...ok | 688        | 700        |            |            |               |
| BUG:kernel_hang_in_early-boot_stage,last_printk:Probing_EDD(edd=off_to_disable)...ok                   | 12         |            |            |            |               |
| BUG:soft_lockup-CPU##stuck_for#s                                                                       | 0          | 0          | 3          | 14         | 4             |
| Kernel_panic-not_syncing:softlockup:hung_tasks                                                         | 0          | 0          | 3          | 14         | 4             |
+--------------------------------------------------------------------------------------------------------+------------+------------+------------+------------+---------------+

                                                           # HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD
git bisect start v4.10 v4.9 --
git bisect good 9e3596b0c6539e28546ff7c72a06576627068353  # 02:55  G     30     0    0   0  kbuild: initramfs cleanup, set target from Kconfig
git bisect  bad 3aebae061cea6f6627ab882a73de7b0b21af3127  # 03:39  B      4     2    0   1  Merge tag 'vfio-v4.10-rc6' of git://github.com/awilliam/linux-vfio
git bisect good c92816275674c1491ce228ee49aa030a5fa1be04  # 04:09  G     32     0   32  32  Merge tag 'char-misc-4.10-rc4' of git://git.kernel.org/pub/scm/linux/kernel/git/gregkh/char-misc
git bisect  bad e3737b9145636e884d7185176cbe76a3f2c645e2  # 04:23  B      0     1   11   0  Merge branch 'for-linus' of git://git.kernel.dk/linux-block
git bisect  bad fa19a769f82fb9a5ca000b83cacd13fcaeda51ac  # 04:47  B     29     1    0   0  Merge branch 'fixes' of git://git.armlinux.org.uk/~rmk/linux-arm
git bisect good 203f80f1c4187b2d5b3a282586fa6cc6d9503d4b  # 05:14  G    174     0  174 174  Merge branch 'stable/for-linus-4.10' of git://git.kernel.org/pub/scm/linux/kernel/git/konrad/swiotlb
git bisect good 9da96f99f15169b8bf77a1f27ed6d926f82ea59f  # 05:33  G    178     0  178 178  Merge branch 'perf-urgent-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect good 0b75f821ec8be459dd4dec77be39595d989d77ac  # 05:58  G    178     0  178 178  Merge branch 'timers-urgent-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect  bad ca92e6c7e6329029d7188487a5c32e86ef471977  # 06:18  B      6     2    0   0  Merge branch 'smp-urgent-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect good 4205e4786d0b9fc3b4fec7b1910cf645a0468307  # 07:10  G    172     0  172 172  cpu/hotplug: Provide dynamic range for prepare stage
# first bad commit: [ca92e6c7e6329029d7188487a5c32e86ef471977] Merge branch 'smp-urgent-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect good 0b75f821ec8be459dd4dec77be39595d989d77ac  # 07:51  G    519     0  519 699  Merge branch 'timers-urgent-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect good 4205e4786d0b9fc3b4fec7b1910cf645a0468307  # 08:10  G    510     0  510 690  cpu/hotplug: Provide dynamic range for prepare stage
# extra tests with CONFIG_DEBUG_INFO_REDUCED
git bisect  bad ca92e6c7e6329029d7188487a5c32e86ef471977  # 08:27  B      0     4   14   0  Merge branch 'smp-urgent-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
# extra tests on HEAD of linux-devel/devel-spot-201704051704
git bisect  bad 15522f7f5af9cd4d431425bee50b782a5f1dbb0f  # 08:27  B      9     4    0   0  0day head guard for 'devel-spot-201704051704'
# extra tests on tree/branch linus/master
git bisect  bad 269c930e6698e6afa6d4606bfd241f4497597e79  # 09:06  B      4     1    0   0  Merge tag 'xfs-4.11-fixes-3' of git://git.kernel.org/pub/scm/fs/xfs/xfs-linux
# extra tests on tree/branch linux-next/master
git bisect  bad d203084e692ac2f656cf8c50449f8f90ca7875de  # 09:51  B      6     1    3   4  Add linux-next specific files for 20170406

---
0-DAY kernel test infrastructure                Open Source Technology Center
https://lists.01.org/pipermail/lkp                          Intel Corporation

Download attachment "dmesg-quantal-intel12-28:20170407061728:x86_64-randconfig-r0-04062323:4.10.0-rc4-00095-gca92e6c:1.gz" of type "application/gzip" (11428 bytes)

View attachment "reproduce-quantal-intel12-28:20170407061728:x86_64-randconfig-r0-04062323:4.10.0-rc4-00095-gca92e6c:1" of type "text/plain" (888 bytes)

View attachment "config-4.10.0-rc4-00095-gca92e6c" of type "text/plain" (104000 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ