[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Message-ID: <20171107092716.qlesgurhi27nlx3v@wfg-t540p.sh.intel.com>
Date: Tue, 7 Nov 2017 17:27:16 +0800
From: Fengguang Wu <fengguang.wu@...el.com>
To: netdev@...r.kernel.org
Cc: Thomas Graf <tgraf@...g.ch>,
Herbert Xu <herbert@...dor.apana.org.au>,
Linus Torvalds <torvalds@...ux-foundation.org>,
"David S. Miller" <davem@...emloft.net>,
Florian Westphal <fw@...len.de>, linux-kernel@...r.kernel.org
Subject: [rht_deferred_worker] watchdog: BUG: soft lockup - CPU#0 stuck for
23s! [kworker/0:1:15]
Hello,
FYI this happens in v4.14-rc8 -- it's not necessarily a new bug.
[ 485.097496] rcu-torture: Reader Pipe: 2 0 0 0 0 0 0 0 0 0 0
[ 485.317082] rcu-torture: Reader Batch: 0 2 0 0 0 0 0 0 0 0 0
[ 485.809530] rcu-torture: Free-Block Circulation: 0 0 0 0 0 0 0 0 0 0 0
[ 486.097071] ??? Writer stall state RTWS_STUTTER(8) g0 c0 f0x0 ->state 0x1 cpu 0
[ 523.211468] hrtimer: interrupt took 7942680 ns
[ 551.200303] watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [kworker/0:1:15]
[ 551.200319] irq event stamp: 3267541
[ 551.200319] hardirqs last enabled at (3267539): [<ffffffff810f7b6b>] __local_bh_enable_ip+0x14e/0x15c
[ 551.200319] hardirqs last disabled at (3267541): [<ffffffff81df0ecb>] apic_timer_interrupt+0xab/0xc0
[ 551.200319] softirqs last enabled at (3267538): [<ffffffff81586448>] rht_deferred_worker+0xb5a/0xd40
[ 551.200319] softirqs last disabled at (3267540): [<ffffffff81585f45>] rht_deferred_worker+0x657/0xd40
[ 551.200319] CPU: 0 PID: 15 Comm: kworker/0:1 Not tainted 4.14.0-rc8 #22
[ 551.200319] Workqueue: events rht_deferred_worker
[ 551.200319] task: ffff8800186023c0 task.stack: ffff880018608000
[ 551.200319] RIP: 0010:arch_local_irq_restore+0x6/0xd
[ 551.200319] RSP: 0000:ffff88001860fc80 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff10
[ 551.200319] RAX: 1ffff100030c0500 RBX: ffff8800186023c0 RCX: ffffffff8116353d
[ 551.200319] RDX: ffff880018602a20 RSI: 0000000000000007 RDI: 0000000000000246
[ 551.200319] RBP: ffff88001860fc80 R08: dffffc0000000000 R09: fffffbfff0674c41
[ 551.200319] R10: 0000000000000000 R11: ffffffff833a620f R12: ffff880018602a24
[ 551.200319] R13: 0000000000000246 R14: ffffffff84413180 R15: 00000000ffffffff
[ 551.200319] FS: 0000000000000000(0000) GS:ffffffff8284e000(0000) knlGS:0000000000000000
[ 551.200319] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 551.200319] CR2: 0000000000000000 CR3: 0000000002820001 CR4: 00000000000206b0
[ 551.200319] Call Trace:
[ 551.200319] lock_is_held_type+0x83/0x94
[ 551.200319] lockdep_rht_mutex_is_held+0x31/0x36
[ 551.200319] rht_deferred_worker+0x708/0xd40
[ 551.200319] process_one_work+0x68d/0xb7d
[ 551.200319] ? pwq_dec_nr_in_flight+0x24d/0x24d
[ 551.200319] ? ftrace_likely_update+0x249/0x26b
[ 551.200319] worker_thread+0x5ba/0x724
[ 551.200319] kthread+0x228/0x238
[ 551.200319] ? process_scheduled_works+0x43/0x43
[ 551.200319] ? __list_del_entry+0x77/0x77
[ 551.200319] ret_from_fork+0x2a/0x40
[ 551.200319] Code: 49 8d 7d 60 e8 dd f4 1c 00 49 c7 45 60 00 00 00 00 5b 41 5c 41 5d 5d c3 55 48 89 e5 9c 58 66 66 90 66 90 5d c3 55 48 89 e5 57 9d <66> 66 90 66 90 5d c3 55 48 89 e5 e8 dd ff ff ff 48 89 c2 fa 66
[ 551.200319] Kernel panic - not syncing: softlockup: hung tasks
[ 551.200319] CPU: 0 PID: 15 Comm: kworker/0:1 Tainted: G L 4.14.0-rc8 #22
[ 551.200319] Workqueue: events rht_deferred_worker
[ 551.200319] Call Trace:
[ 551.200319] <IRQ>
[ 551.200319] show_stack+0x6d/0x70
[ 551.200319] dump_stack+0x19/0x1b
[ 551.200319] panic+0x1cc/0x434
[ 551.200319] ? __warn+0x1a6/0x1a6
[ 551.200319] ? set_fs+0x1e/0x2e
[ 551.200319] ? watchdog_timer_fn+0x34b/0x389
[ 551.200319] watchdog_timer_fn+0x369/0x389
[ 551.200319] __hrtimer_run_queues+0x469/0x808
[ 551.200319] ? watchdog+0x1e/0x1e
[ 551.200319] ? retrigger_next_event+0x6f/0x6f
[ 551.200319] ? ktime_get_update_offsets_now+0x180/0x19a
[ 551.200319] hrtimer_interrupt+0xab/0x278
[ 551.200319] ? hrtimer_cancel+0x51/0x51
[ 551.200319] smp_apic_timer_interrupt+0x26d/0x466
[ 551.200319] apic_timer_interrupt+0xb0/0xc0
[ 551.200319] </IRQ>
[ 551.200319] RIP: 0010:arch_local_irq_restore+0x6/0xd
[ 551.200319] RSP: 0000:ffff88001860fc80 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff10
[ 551.200319] RAX: 1ffff100030c0500 RBX: ffff8800186023c0 RCX: ffffffff8116353d
[ 551.200319] RDX: ffff880018602a20 RSI: 0000000000000007 RDI: 0000000000000246
[ 551.200319] RBP: ffff88001860fc80 R08: dffffc0000000000 R09: fffffbfff0674c41
[ 551.200319] R10: 0000000000000000 R11: ffffffff833a620f R12: ffff880018602a24
[ 551.200319] R13: 0000000000000246 R14: ffffffff84413180 R15: 00000000ffffffff
[ 551.200319] ? lock_is_held_type+0x71/0x94
[ 551.200319] lock_is_held_type+0x83/0x94
[ 551.200319] lockdep_rht_mutex_is_held+0x31/0x36
[ 551.200319] rht_deferred_worker+0x708/0xd40
[ 551.200319] process_one_work+0x68d/0xb7d
[ 551.200319] ? pwq_dec_nr_in_flight+0x24d/0x24d
[ 551.200319] ? ftrace_likely_update+0x249/0x26b
[ 551.200319] worker_thread+0x5ba/0x724
[ 551.200319] kthread+0x228/0x238
[ 551.200319] ? process_scheduled_works+0x43/0x43
[ 551.200319] ? __list_del_entry+0x77/0x77
[ 551.200319] ret_from_fork+0x2a/0x40
[ 551.200319] Kernel Offset: disabled
Attached the full dmesg and kconfig.
Thanks,
Fengguang
View attachment "dmesg-vm-lkp-wsx03-quantal-x86_64-22:20171106145455:x86_64-randconfig-ws0-11061402:4.14.0-rc8:22" of type "text/plain" (41002 bytes)
View attachment ".config" of type "text/plain" (89391 bytes)
Powered by blists - more mailing lists