[<prev] [next>] [day] [month] [year] [list]
Message-ID: <20160804084612.GF19697@yexl-desktop>
Date: Thu, 4 Aug 2016 16:46:12 +0800
From: kernel test robot <xiaolong.ye@...el.com>
To: Stanislav Kinsburskiy <skinsbursky@...tuozzo.com>
Cc: 0day robot <fengguang.wu@...el.com>,
LKML <linux-kernel@...r.kernel.org>, lkp@...org
Subject: [lkp] [sunrpc] f0ca0aacfe: INFO: rcu_sched detected stalls on
CPUs/tasks:
FYI, we noticed the following commit:
https://github.com/0day-ci/linux Stanislav-Kinsburskiy/sunrpc-do-not-allow-process-to-freeze-within-RPC-state-machine/20160804-022409
commit f0ca0aacfed0309a5dd97db7025493e5130c737b ("sunrpc: do not allow process to freeze within RPC state machine")
in testcase: boot
on test machine: 1 threads qemu-system-x86_64 -enable-kvm -cpu Nehalem with 1G memory
caused below changes:
+----------------------------------------------+------------+------------+
| | 49d0325625 | f0ca0aacfe |
+----------------------------------------------+------------+------------+
| boot_successes | 8 | 3 |
| boot_failures | 0 | 5 |
| INFO:rcu_sched_detected_stalls_on_CPUs/tasks | 0 | 5 |
| backtrace:nfs_create_rpc_client | 0 | 5 |
| backtrace:nfs4_init_client | 0 | 5 |
| backtrace:SyS_mount | 0 | 5 |
| backtrace:schedule_timeout | 0 | 5 |
| BUG:kernel_test_hang | 0 | 2 |
+----------------------------------------------+------------+------------+
[ 42.571280] RESULT_ROOT=/result/boot/1/vm-intel12-1G/debian-x86_64-2015-02-07.cgz/x86_64-nfsroot/gcc-6/f0ca0aacfed0309a5dd97db7025493e5130c737b/0
[ 42.583680] job=/lkp/scheduled/vm-intel12-1G-5/boot-1-debian-x86_64-2015-02-07.cgz-f0ca0aacfed0309a5dd97db7025493e5130c737b-20160804-92468-116cpop-0.yaml
[ 126.337569] hrtimer: interrupt took 7542325 ns
[ 147.622459] INFO: rcu_sched detected stalls on CPUs/tasks:
[ 147.627372] All QSes seen, last rcu_sched kthread activity 105002 (4294813785-4294708783), jiffies_till_next_fqs=3, root ->qsmask 0x0
[ 147.629773] mount.nfs D ffff8800389d75b0 12416 3591 3576 0x00000008
[ 147.631504] 0000000000000000 ffff880038803e10 ffffffff810cda19 ffffffff8246eec0
[ 147.633513] ffff8800389d82c0 ffffffff8246f2c0 ffff880038803e78 ffffffff81113f6b
[ 147.635483] 0000000000000000 0000000000000002 000000000000001c ffff88003c4a5340
[ 147.637466] Call Trace:
[ 147.638070] <IRQ> [<ffffffff810cda19>] sched_show_task+0x1d6/0x1e1
[ 147.639542] [<ffffffff81113f6b>] rcu_check_callbacks+0x63a/0x924
[ 147.641499] [<ffffffff8111963a>] update_process_times+0x2f/0x54
[ 147.643456] [<ffffffff81129105>] tick_sched_handle+0x33/0x3f
[ 147.645470] [<ffffffff8112914e>] tick_sched_timer+0x3d/0x65
[ 147.647340] [<ffffffff8111a81f>] __hrtimer_run_queues+0x2ff/0x585
[ 147.649345] [<ffffffff81129111>] ? tick_sched_handle+0x3f/0x3f
[ 147.651379] [<ffffffff8111ac4e>] hrtimer_interrupt+0xac/0x1a3
[ 147.653333] [<ffffffff8107f933>] local_apic_timer_interrupt+0x4b/0x4e
[ 147.655400] [<ffffffff81cce31e>] smp_apic_timer_interrupt+0x3d/0x4d
[ 147.658256] [<ffffffff81ccc7dc>] apic_timer_interrupt+0x8c/0xa0
[ 147.660186] <EOI> [<ffffffff810e0576>] ? prepare_to_wait+0x22/0x7d
[ 147.662300] [<ffffffff81ccb362>] ? _raw_spin_unlock_irqrestore+0x4d/0x5e
[ 147.664432] [<ffffffff810e05c7>] prepare_to_wait+0x73/0x7d
[ 147.666303] [<ffffffff81c95be8>] ? trace_event_raw_event_svc_deferred_event+0xaf/0xaf
[ 147.669300] [<ffffffff81cc6f31>] __wait_on_bit+0x32/0x7e
[ 147.671138] [<ffffffff81cc70ec>] out_of_line_wait_on_bit+0x72/0x7d
[ 147.673129] [<ffffffff81c95be8>] ? trace_event_raw_event_svc_deferred_event+0xaf/0xaf
[ 147.676114] [<ffffffff810e0a76>] ? autoremove_wake_function+0x3a/0x3a
[ 147.678208] [<ffffffff81c8c0d2>] ? call_bind_status+0x23f/0x23f
[ 147.680011] [<ffffffff81c96bd4>] __rpc_execute+0x203/0x4e7
[ 147.681738] [<ffffffff810e0a37>] ? wake_up_bit+0x25/0x2a
[ 147.683551] [<ffffffff81c971d1>] rpc_execute+0x162/0x1ca
[ 147.685366] [<ffffffff81c8c670>] rpc_run_task+0x121/0x12d
[ 147.687207] [<ffffffff81c8c6df>] rpc_call_sync+0x63/0x95
[ 147.689034] [<ffffffff81c8c758>] rpc_ping+0x47/0x5d
[ 147.690756] [<ffffffff81c8c83d>] rpc_create_xprt+0xcf/0x149
[ 147.692659] [<ffffffff81c8ca07>] rpc_create+0x150/0x159
[ 147.694479] [<ffffffff810ea716>] ? mark_held_locks+0x5e/0x74
[ 147.696365] [<ffffffff811e7325>] ? __slab_alloc+0x6e/0x84
[ 147.698200] [<ffffffff812efa12>] nfs_create_rpc_client+0xc3/0xe3
[ 147.700173] [<ffffffff81328deb>] nfs4_init_client+0x70/0x19f
[ 147.702057] [<ffffffff8108bceb>] ? kvm_clock_read+0x25/0x2e
[ 147.703939] [<ffffffff8108bd08>] ? kvm_sched_clock_read+0x9/0x12
[ 147.705936] [<ffffffff8106ab15>] ? sched_clock+0x9/0xd
[ 147.707734] [<ffffffff810d0e17>] ? sched_clock_cpu+0x15/0xae
[ 147.709639] [<ffffffff812f1486>] ? nfs_get_client+0x456/0x488
[ 147.711551] [<ffffffff812f14a3>] nfs_get_client+0x473/0x488
[ 147.713412] [<ffffffff81328824>] nfs4_set_client+0x78/0x91
[ 147.715252] [<ffffffff813295e8>] nfs4_create_server+0xc8/0x22c
[ 147.717159] [<ffffffff813229c6>] nfs4_remote_mount+0x2f/0x55
[ 147.719055] [<ffffffff811f8d6c>] mount_fs+0x14/0x8d
[ 147.720843] [<ffffffff81213b18>] vfs_kern_mount+0x6b/0x133
[ 147.722677] [<ffffffff81322937>] nfs_do_root_mount+0x8f/0xab
[ 147.724541] [<ffffffff81322b8c>] nfs4_try_mount+0x37/0x4e
[ 147.726375] [<ffffffff812febff>] nfs_fs_mount+0x746/0x777
[ 147.728214] [<ffffffff812fc31d>] ? nfs_get_option_ul+0x46/0x46
[ 147.731175] [<ffffffff812fbf08>] ? nfs_auth_info_match+0x2a/0x2a
[ 147.733128] [<ffffffff811f8d6c>] mount_fs+0x14/0x8d
[ 147.734900] [<ffffffff81213a21>] ? alloc_vfsmnt+0x18e/0x21a
[ 147.736764] [<ffffffff811f8d6c>] ? mount_fs+0x14/0x8d
[ 147.738533] [<ffffffff81213b18>] vfs_kern_mount+0x6b/0x133
[ 147.740386] [<ffffffff81216d1f>] do_mount+0xa4d/0xb53
[ 147.742149] [<ffffffff8121624b>] ? copy_mount_options+0xba/0x124
[ 147.744077] [<ffffffff81217050>] SyS_mount+0x77/0x9f
[ 147.745823] [<ffffffff81ccbb7c>] entry_SYSCALL_64_fastpath+0x1f/0xbd
FYI, raw QEMU command line is:
qemu-system-x86_64 -enable-kvm -cpu Nehalem -kernel /pkg/linux/x86_64-nfsroot/gcc-6/f0ca0aacfed0309a5dd97db7025493e5130c737b/vmlinuz-4.7.0-rc5-00036-gf0ca0aa -append 'ip=::::vm-intel12-1G-5::dhcp root=/dev/ram0 user=lkp job=/lkp/scheduled/vm-intel12-1G-5/boot-1-debian-x86_64-2015-02-07.cgz-f0ca0aacfed0309a5dd97db7025493e5130c737b-20160804-92468-116cpop-0.yaml ARCH=x86_64 kconfig=x86_64-nfsroot branch=linux-devel/devel-catchup-201608040229 commit=f0ca0aacfed0309a5dd97db7025493e5130c737b BOOT_IMAGE=/pkg/linux/x86_64-nfsroot/gcc-6/f0ca0aacfed0309a5dd97db7025493e5130c737b/vmlinuz-4.7.0-rc5-00036-gf0ca0aa max_uptime=600 RESULT_ROOT=/result/boot/1/vm-intel12-1G/debian-x86_64-2015-02-07.cgz/x86_64-nfsroot/gcc-6/f0ca0aacfed0309a5dd97db7025493e5130c737b/0 LKP_SERVER=inn debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0 systemd.log_level=err ignore_loglevel earlyprintk=ttyS0,115200 console=ttyS0,115200 console=tty0 vga=normal rw' -initrd /fs/KVM/initrd-vm-intel12-1G-5 -m 1024 -smp 1 -device e1000,netdev=net0 -netdev user,id=net0,hostfwd=tcp::23304-:22 -boot order=nc -no-reboot -watchdog i6300esb -watchdog-action debug -rtc base=localtime -drive file=/fs/KVM/disk0-vm-intel12-1G-5,media=disk,if=virtio -drive file=/fs/KVM/disk1-vm-intel12-1G-5,media=disk,if=virtio -drive file=/fs/KVM/disk2-vm-intel12-1G-5,media=disk,if=virtio -drive file=/fs/KVM/disk3-vm-intel12-1G-5,media=disk,if=virtio -drive file=/fs/KVM/disk4-vm-intel12-1G-5,media=disk,if=virtio -drive file=/fs/KVM/disk5-vm-intel12-1G-5,media=disk,if=virtio -pidfile /dev/shm/kboot/pid-vm-intel12-1G-5 -serial file:/dev/shm/kboot/serial-vm-intel12-1G-5 -daemonize -display none -monitor null
Thanks,
Xiaolong
View attachment "config-4.7.0-rc5-00036-gf0ca0aa" of type "text/plain" (111221 bytes)
Download attachment "dmesg.xz" of type "application/octet-stream" (18168 bytes)
Powered by blists - more mailing lists