Message-ID: <20140307012847.GA8427@localhost>
Date:	Fri, 7 Mar 2014 09:28:47 +0800
From:	Fengguang Wu <fengguang.wu@...el.com>
To:	"Paul E. McKenney" <paulmck@...ux.vnet.ibm.com>
Cc:	linux-kernel@...r.kernel.org
Subject: [torture] BUG: soft lockup - CPU#0 stuck for 22s!
 [lock_torture_wr:26]

Greetings,

I got the below dmesg and the first bad commit is

git://git.kernel.org/pub/scm/linux/kernel/git/paulmck/linux-rcu.git rcu/dev
commit 1f9c26968e1a501f3a839603c9633f21abca65b3
Author:     Paul E. McKenney <paulmck@...ux.vnet.ibm.com>
AuthorDate: Tue Mar 4 11:03:21 2014 -0800
Commit:     Paul E. McKenney <paulmck@...ux.vnet.ibm.com>
CommitDate: Wed Mar 5 07:49:28 2014 -0800

    torture: Increase stutter-end intensity
    
+------------------------------------------------+----+
|                                                |    |
+------------------------------------------------+----+
| boot_successes                                 | 0  |
| boot_failures                                  | 19 |
| BUG:soft_lockup-CPU_stuck_for_s                | 19 |
| EIP_is_at_stutter_wait                         | 19 |
| Kernel_panic-not_syncing:softlockup:hung_tasks | 19 |
| backtrace:lock_torture_writer                  | 19 |
+------------------------------------------------+----+

[   19.853890] CE: hpet increased min_delta_ns to 16875 nsec
[   19.853890] CE: hpet increased min_delta_ns to 25312 nsec
[   19.853890] hrtimer: interrupt took 3315122 ns
[   88.019164] BUG: soft lockup - CPU#0 stuck for 22s! [lock_torture_wr:26]
[   88.019164] Modules linked in:
[   88.019164] CPU: 0 PID: 26 Comm: lock_torture_wr Not tainted 3.14.0-rc5-03857-gaafcfca #2
[   88.019164] task: 8dfd8000 ti: 8dc02000 task.ti: 88a26000
[   88.019164] EIP: 0060:[<8109afde>] EFLAGS: 00000202 CPU: 0
[   88.019164] EIP is at stutter_wait+0x1d/0x5a
[   88.019164] EAX: 00000002 EBX: 815a9cf2 ECX: 00000000 EDX: 00000000
[   88.019164] ESI: 8b0e5438 EDI: 00000000 EBP: 88a27efc ESP: 88a27ef8
[   88.019164]  DS: 007b ES: 007b FS: 0000 GS: 00e0 SS: 0068
[   88.019164] CR0: 8005003b CR2: 00000000 CR3: 0186f000 CR4: 000006f0
[   88.019164] Stack:
[   88.019164]  8b96f300 88a27f20 81060f8e 815a9a86 815abef3 815a9a65 00000000 8b96f330
[   88.019164]  8b0e5438 81060e9e 88a27fac 8104c0f8 00000000 0000000c 8b0e5438 00000000
[   88.019164]  00000001 dead4ead ffffffff ffffffff 8187c858 00000000 00000000 815a6175
[   88.019164] Call Trace:
[   88.019164]  [<81060f8e>] lock_torture_writer+0xf0/0x13c
[   88.019164]  [<81060e9e>] ? torture_lock_busted_write_unlock+0x5/0x5
[   88.019164]  [<8104c0f8>] kthread+0xb7/0xbc
[   88.019164]  [<813f10bb>] ret_from_kernel_thread+0x1b/0x30
[   88.019164]  [<8104c041>] ? kthread_stop+0xaa/0xaa
[   88.019164] Code: 00 a1 3c c7 79 81 48 74 de 5b 58 5b 5d c3 55 89 e5 53 89 c3 eb 36 83 3d 0c c6 cd 81 00 74 17 a1 0c c6 cd 81 83 f8 01 75 02 eb 15 <a1> 0c c6 cd 81 85 c0 74 11 eb f5 b8 e8 03 00 00 e8 74 e8 f9 ff

git bisect start aafcfca36a7a26409af2ec2265927ed8ad6eb4b2 0414855fdc4a40da05221fc6062cccbc0c30f169 --
git bisect good bda89c7567044071e93d8b1c4c2f6e383c0fd249  # 16:21     20+      0  Merge 'drm/drm-next' into devel-hourly-2014030612
git bisect good 8eb78a8e0bca474d486a0505a1d38488119e8602  # 16:29     20+      0  Merge 'ath6kl/ath-next-test' into devel-hourly-2014030612
git bisect  bad e4729df86820a7132e41d401525acf24e4a25040  # 16:39      0-     13  Merge 'tip/x86/reboot' into devel-hourly-2014030612
git bisect good 07c4534e0d92e9600243ec4f9e27bd337c0617ff  # 16:52     20+      0  Merge 'ipsec-next/vti6' into devel-hourly-2014030612
git bisect  bad ace3f54462b01d674389eb0627c933cb6230a57b  # 17:11      0-      5  Merge 'rcu/rcu/dev' into devel-hourly-2014030612
git bisect good c236e3c6e2862c7d2d5f2f26eaa5ff86b896d1a0  # 17:26     20+      0  Merge 'tip/x86/efi' into devel-hourly-2014030612
git bisect good b46f358ae5e3558a9072f0354128d5749a584d01  # 17:36     20+      0  rcutorture: Place kvm-test-1-run.sh output into res directory
git bisect good f5604f67fe8cbd6f2088b20b9463f721aa613d4b  # 17:44     20+      0  Merge branch 'torture.2014.02.23a' into HEAD
git bisect good dd35b81c341c685bafd15bc9a6bfa79584e07b07  # 17:51     20+      0  torture: Rename RCU_BUILDONLY to TORTURE_BUILDONLY
git bisect good 8864f0996e8b7f07a536aa07553c4461cd5f4211  # 18:12     20+      0  torture: Make "--dryrun script" output self-sufficient
git bisect good b2d777a6d9d64929b9701f1905fdeda8fc3cb16d  # 18:34     20+      0  rcutorture: Print negatives for SRCU counter wraparound
git bisect good 4c79d7d89902a2e9c96b3db5115af52b3cf94da9  # 18:41     20+      0  torture: Report diagnostics from qemu
git bisect  bad 1f9c26968e1a501f3a839603c9633f21abca65b3  # 18:43      0-      9  torture: Increase stutter-end intensity
# first bad commit: [1f9c26968e1a501f3a839603c9633f21abca65b3] torture: Increase stutter-end intensity
git bisect good 4c79d7d89902a2e9c96b3db5115af52b3cf94da9  # 20:25     60+      0  torture: Report diagnostics from qemu
git bisect  bad aafcfca36a7a26409af2ec2265927ed8ad6eb4b2  # 20:26      0-     19  0day head guard for 'devel-hourly-2014030612'
git bisect good 7cd8d1c19dd10cb6861bbf7111ba86ef7d262788  # 23:19     60+      0  Revert "torture: Increase stutter-end intensity"
git bisect good c3bebc71c4bcdafa24b506adf0c1de3c1f77e2e0  # 23:26     60+      0  Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net
git bisect good 0ffb2fe7b9c30082876fa3a17da018bf0632cf03  # 02:08     60+      0  Add linux-next specific files for 20140306

Thanks,
Fengguang

View attachment "dmesg-quantal-lkp-nex05-61:20140306141300:i386-randconfig-ba1-03061322::" of type "text/plain" (27280 bytes)

Download attachment "i386-randconfig-ba1-03061322-aafcfca36a7a26409af2ec2265927ed8ad6eb4b2-lock_torture_writer+-x-79189.log" of type "application/octet-stream" (29256 bytes)

View attachment "config-3.14.0-rc5-03857-gaafcfca" of type "text/plain" (65681 bytes)

_______________________________________________
LKP mailing list
LKP@...ux.intel.com

Powered by blists - more mailing lists