lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Date:   Tue, 7 Nov 2017 17:27:16 +0800
From:   Fengguang Wu <fengguang.wu@...el.com>
To:     netdev@...r.kernel.org
Cc:     Thomas Graf <tgraf@...g.ch>,
        Herbert Xu <herbert@...dor.apana.org.au>,
        Linus Torvalds <torvalds@...ux-foundation.org>,
        "David S. Miller" <davem@...emloft.net>,
        Florian Westphal <fw@...len.de>, linux-kernel@...r.kernel.org
Subject: [rht_deferred_worker] watchdog: BUG: soft lockup - CPU#0 stuck for
 23s! [kworker/0:1:15]

Hello,

FYI this happens in v4.14-rc8 -- it's not necessarily a new bug.

[  485.097496] rcu-torture: Reader Pipe:  2 0 0 0 0 0 0 0 0 0 0
[  485.317082] rcu-torture: Reader Batch:  0 2 0 0 0 0 0 0 0 0 0
[  485.809530] rcu-torture: Free-Block Circulation:  0 0 0 0 0 0 0 0 0 0 0
[  486.097071] ??? Writer stall state RTWS_STUTTER(8) g0 c0 f0x0 ->state 0x1 cpu 0
[  523.211468] hrtimer: interrupt took 7942680 ns
[  551.200303] watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [kworker/0:1:15]
[  551.200319] irq event stamp: 3267541
[  551.200319] hardirqs last  enabled at (3267539): [<ffffffff810f7b6b>] __local_bh_enable_ip+0x14e/0x15c
[  551.200319] hardirqs last disabled at (3267541): [<ffffffff81df0ecb>] apic_timer_interrupt+0xab/0xc0
[  551.200319] softirqs last  enabled at (3267538): [<ffffffff81586448>] rht_deferred_worker+0xb5a/0xd40
[  551.200319] softirqs last disabled at (3267540): [<ffffffff81585f45>] rht_deferred_worker+0x657/0xd40
[  551.200319] CPU: 0 PID: 15 Comm: kworker/0:1 Not tainted 4.14.0-rc8 #22
[  551.200319] Workqueue: events rht_deferred_worker
[  551.200319] task: ffff8800186023c0 task.stack: ffff880018608000
[  551.200319] RIP: 0010:arch_local_irq_restore+0x6/0xd
[  551.200319] RSP: 0000:ffff88001860fc80 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff10
[  551.200319] RAX: 1ffff100030c0500 RBX: ffff8800186023c0 RCX: ffffffff8116353d
[  551.200319] RDX: ffff880018602a20 RSI: 0000000000000007 RDI: 0000000000000246
[  551.200319] RBP: ffff88001860fc80 R08: dffffc0000000000 R09: fffffbfff0674c41
[  551.200319] R10: 0000000000000000 R11: ffffffff833a620f R12: ffff880018602a24
[  551.200319] R13: 0000000000000246 R14: ffffffff84413180 R15: 00000000ffffffff
[  551.200319] FS:  0000000000000000(0000) GS:ffffffff8284e000(0000) knlGS:0000000000000000
[  551.200319] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  551.200319] CR2: 0000000000000000 CR3: 0000000002820001 CR4: 00000000000206b0
[  551.200319] Call Trace:
[  551.200319]  lock_is_held_type+0x83/0x94
[  551.200319]  lockdep_rht_mutex_is_held+0x31/0x36
[  551.200319]  rht_deferred_worker+0x708/0xd40
[  551.200319]  process_one_work+0x68d/0xb7d
[  551.200319]  ? pwq_dec_nr_in_flight+0x24d/0x24d
[  551.200319]  ? ftrace_likely_update+0x249/0x26b
[  551.200319]  worker_thread+0x5ba/0x724
[  551.200319]  kthread+0x228/0x238
[  551.200319]  ? process_scheduled_works+0x43/0x43
[  551.200319]  ? __list_del_entry+0x77/0x77
[  551.200319]  ret_from_fork+0x2a/0x40
[  551.200319] Code: 49 8d 7d 60 e8 dd f4 1c 00 49 c7 45 60 00 00 00 00 5b 41 5c 41 5d 5d c3 55 48 89 e5 9c 58 66 66 90 66 90 5d c3 55 48 89 e5 57 9d <66> 66 90 66 90 5d c3 55 48 89 e5 e8 dd ff ff ff 48 89 c2 fa 66 
[  551.200319] Kernel panic - not syncing: softlockup: hung tasks
[  551.200319] CPU: 0 PID: 15 Comm: kworker/0:1 Tainted: G             L  4.14.0-rc8 #22
[  551.200319] Workqueue: events rht_deferred_worker
[  551.200319] Call Trace:
[  551.200319]  <IRQ>
[  551.200319]  show_stack+0x6d/0x70
[  551.200319]  dump_stack+0x19/0x1b
[  551.200319]  panic+0x1cc/0x434
[  551.200319]  ? __warn+0x1a6/0x1a6
[  551.200319]  ? set_fs+0x1e/0x2e
[  551.200319]  ? watchdog_timer_fn+0x34b/0x389
[  551.200319]  watchdog_timer_fn+0x369/0x389
[  551.200319]  __hrtimer_run_queues+0x469/0x808
[  551.200319]  ? watchdog+0x1e/0x1e
[  551.200319]  ? retrigger_next_event+0x6f/0x6f
[  551.200319]  ? ktime_get_update_offsets_now+0x180/0x19a
[  551.200319]  hrtimer_interrupt+0xab/0x278
[  551.200319]  ? hrtimer_cancel+0x51/0x51
[  551.200319]  smp_apic_timer_interrupt+0x26d/0x466
[  551.200319]  apic_timer_interrupt+0xb0/0xc0
[  551.200319]  </IRQ>
[  551.200319] RIP: 0010:arch_local_irq_restore+0x6/0xd
[  551.200319] RSP: 0000:ffff88001860fc80 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff10
[  551.200319] RAX: 1ffff100030c0500 RBX: ffff8800186023c0 RCX: ffffffff8116353d
[  551.200319] RDX: ffff880018602a20 RSI: 0000000000000007 RDI: 0000000000000246
[  551.200319] RBP: ffff88001860fc80 R08: dffffc0000000000 R09: fffffbfff0674c41
[  551.200319] R10: 0000000000000000 R11: ffffffff833a620f R12: ffff880018602a24
[  551.200319] R13: 0000000000000246 R14: ffffffff84413180 R15: 00000000ffffffff
[  551.200319]  ? lock_is_held_type+0x71/0x94
[  551.200319]  lock_is_held_type+0x83/0x94
[  551.200319]  lockdep_rht_mutex_is_held+0x31/0x36
[  551.200319]  rht_deferred_worker+0x708/0xd40
[  551.200319]  process_one_work+0x68d/0xb7d
[  551.200319]  ? pwq_dec_nr_in_flight+0x24d/0x24d
[  551.200319]  ? ftrace_likely_update+0x249/0x26b
[  551.200319]  worker_thread+0x5ba/0x724
[  551.200319]  kthread+0x228/0x238
[  551.200319]  ? process_scheduled_works+0x43/0x43
[  551.200319]  ? __list_del_entry+0x77/0x77
[  551.200319]  ret_from_fork+0x2a/0x40
[  551.200319] Kernel Offset: disabled

Attached the full dmesg and kconfig.

Thanks,
Fengguang

View attachment "dmesg-vm-lkp-wsx03-quantal-x86_64-22:20171106145455:x86_64-randconfig-ws0-11061402:4.14.0-rc8:22" of type "text/plain" (41002 bytes)

View attachment ".config" of type "text/plain" (89391 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ