lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Date:	Thu, 4 Aug 2016 16:46:12 +0800
From:	kernel test robot <xiaolong.ye@...el.com>
To:	Stanislav Kinsburskiy <skinsbursky@...tuozzo.com>
Cc:	0day robot <fengguang.wu@...el.com>,
	LKML <linux-kernel@...r.kernel.org>, lkp@...org
Subject: [lkp] [sunrpc]  f0ca0aacfe: INFO: rcu_sched detected stalls on
 CPUs/tasks:


FYI, we noticed the following commit:

https://github.com/0day-ci/linux Stanislav-Kinsburskiy/sunrpc-do-not-allow-process-to-freeze-within-RPC-state-machine/20160804-022409
commit f0ca0aacfed0309a5dd97db7025493e5130c737b ("sunrpc: do not allow process to freeze within RPC state machine")

in testcase: boot

on test machine: 1 threads qemu-system-x86_64 -enable-kvm -cpu Nehalem with 1G memory

caused below changes:


+----------------------------------------------+------------+------------+
|                                              | 49d0325625 | f0ca0aacfe |
+----------------------------------------------+------------+------------+
| boot_successes                               | 8          | 3          |
| boot_failures                                | 0          | 5          |
| INFO:rcu_sched_detected_stalls_on_CPUs/tasks | 0          | 5          |
| backtrace:nfs_create_rpc_client              | 0          | 5          |
| backtrace:nfs4_init_client                   | 0          | 5          |
| backtrace:SyS_mount                          | 0          | 5          |
| backtrace:schedule_timeout                   | 0          | 5          |
| BUG:kernel_test_hang                         | 0          | 2          |
+----------------------------------------------+------------+------------+



[   42.571280] RESULT_ROOT=/result/boot/1/vm-intel12-1G/debian-x86_64-2015-02-07.cgz/x86_64-nfsroot/gcc-6/f0ca0aacfed0309a5dd97db7025493e5130c737b/0
[   42.583680] job=/lkp/scheduled/vm-intel12-1G-5/boot-1-debian-x86_64-2015-02-07.cgz-f0ca0aacfed0309a5dd97db7025493e5130c737b-20160804-92468-116cpop-0.yaml
[  126.337569] hrtimer: interrupt took 7542325 ns
[  147.622459] INFO: rcu_sched detected stalls on CPUs/tasks:
[  147.627372] All QSes seen, last rcu_sched kthread activity 105002 (4294813785-4294708783), jiffies_till_next_fqs=3, root ->qsmask 0x0
[  147.629773] mount.nfs       D ffff8800389d75b0 12416  3591   3576 0x00000008
[  147.631504]  0000000000000000 ffff880038803e10 ffffffff810cda19 ffffffff8246eec0
[  147.633513]  ffff8800389d82c0 ffffffff8246f2c0 ffff880038803e78 ffffffff81113f6b
[  147.635483]  0000000000000000 0000000000000002 000000000000001c ffff88003c4a5340
[  147.637466] Call Trace:
[  147.638070]  <IRQ>  [<ffffffff810cda19>] sched_show_task+0x1d6/0x1e1
[  147.639542]  [<ffffffff81113f6b>] rcu_check_callbacks+0x63a/0x924
[  147.641499]  [<ffffffff8111963a>] update_process_times+0x2f/0x54
[  147.643456]  [<ffffffff81129105>] tick_sched_handle+0x33/0x3f
[  147.645470]  [<ffffffff8112914e>] tick_sched_timer+0x3d/0x65
[  147.647340]  [<ffffffff8111a81f>] __hrtimer_run_queues+0x2ff/0x585
[  147.649345]  [<ffffffff81129111>] ? tick_sched_handle+0x3f/0x3f
[  147.651379]  [<ffffffff8111ac4e>] hrtimer_interrupt+0xac/0x1a3
[  147.653333]  [<ffffffff8107f933>] local_apic_timer_interrupt+0x4b/0x4e
[  147.655400]  [<ffffffff81cce31e>] smp_apic_timer_interrupt+0x3d/0x4d
[  147.658256]  [<ffffffff81ccc7dc>] apic_timer_interrupt+0x8c/0xa0
[  147.660186]  <EOI>  [<ffffffff810e0576>] ? prepare_to_wait+0x22/0x7d
[  147.662300]  [<ffffffff81ccb362>] ? _raw_spin_unlock_irqrestore+0x4d/0x5e
[  147.664432]  [<ffffffff810e05c7>] prepare_to_wait+0x73/0x7d
[  147.666303]  [<ffffffff81c95be8>] ? trace_event_raw_event_svc_deferred_event+0xaf/0xaf
[  147.669300]  [<ffffffff81cc6f31>] __wait_on_bit+0x32/0x7e
[  147.671138]  [<ffffffff81cc70ec>] out_of_line_wait_on_bit+0x72/0x7d
[  147.673129]  [<ffffffff81c95be8>] ? trace_event_raw_event_svc_deferred_event+0xaf/0xaf
[  147.676114]  [<ffffffff810e0a76>] ? autoremove_wake_function+0x3a/0x3a
[  147.678208]  [<ffffffff81c8c0d2>] ? call_bind_status+0x23f/0x23f
[  147.680011]  [<ffffffff81c96bd4>] __rpc_execute+0x203/0x4e7
[  147.681738]  [<ffffffff810e0a37>] ? wake_up_bit+0x25/0x2a
[  147.683551]  [<ffffffff81c971d1>] rpc_execute+0x162/0x1ca
[  147.685366]  [<ffffffff81c8c670>] rpc_run_task+0x121/0x12d
[  147.687207]  [<ffffffff81c8c6df>] rpc_call_sync+0x63/0x95
[  147.689034]  [<ffffffff81c8c758>] rpc_ping+0x47/0x5d
[  147.690756]  [<ffffffff81c8c83d>] rpc_create_xprt+0xcf/0x149
[  147.692659]  [<ffffffff81c8ca07>] rpc_create+0x150/0x159
[  147.694479]  [<ffffffff810ea716>] ? mark_held_locks+0x5e/0x74
[  147.696365]  [<ffffffff811e7325>] ? __slab_alloc+0x6e/0x84
[  147.698200]  [<ffffffff812efa12>] nfs_create_rpc_client+0xc3/0xe3
[  147.700173]  [<ffffffff81328deb>] nfs4_init_client+0x70/0x19f
[  147.702057]  [<ffffffff8108bceb>] ? kvm_clock_read+0x25/0x2e
[  147.703939]  [<ffffffff8108bd08>] ? kvm_sched_clock_read+0x9/0x12
[  147.705936]  [<ffffffff8106ab15>] ? sched_clock+0x9/0xd
[  147.707734]  [<ffffffff810d0e17>] ? sched_clock_cpu+0x15/0xae
[  147.709639]  [<ffffffff812f1486>] ? nfs_get_client+0x456/0x488
[  147.711551]  [<ffffffff812f14a3>] nfs_get_client+0x473/0x488
[  147.713412]  [<ffffffff81328824>] nfs4_set_client+0x78/0x91
[  147.715252]  [<ffffffff813295e8>] nfs4_create_server+0xc8/0x22c
[  147.717159]  [<ffffffff813229c6>] nfs4_remote_mount+0x2f/0x55
[  147.719055]  [<ffffffff811f8d6c>] mount_fs+0x14/0x8d
[  147.720843]  [<ffffffff81213b18>] vfs_kern_mount+0x6b/0x133
[  147.722677]  [<ffffffff81322937>] nfs_do_root_mount+0x8f/0xab
[  147.724541]  [<ffffffff81322b8c>] nfs4_try_mount+0x37/0x4e
[  147.726375]  [<ffffffff812febff>] nfs_fs_mount+0x746/0x777
[  147.728214]  [<ffffffff812fc31d>] ? nfs_get_option_ul+0x46/0x46
[  147.731175]  [<ffffffff812fbf08>] ? nfs_auth_info_match+0x2a/0x2a
[  147.733128]  [<ffffffff811f8d6c>] mount_fs+0x14/0x8d
[  147.734900]  [<ffffffff81213a21>] ? alloc_vfsmnt+0x18e/0x21a
[  147.736764]  [<ffffffff811f8d6c>] ? mount_fs+0x14/0x8d
[  147.738533]  [<ffffffff81213b18>] vfs_kern_mount+0x6b/0x133
[  147.740386]  [<ffffffff81216d1f>] do_mount+0xa4d/0xb53
[  147.742149]  [<ffffffff8121624b>] ? copy_mount_options+0xba/0x124
[  147.744077]  [<ffffffff81217050>] SyS_mount+0x77/0x9f
[  147.745823]  [<ffffffff81ccbb7c>] entry_SYSCALL_64_fastpath+0x1f/0xbd


FYI, raw QEMU command line is:

	qemu-system-x86_64 -enable-kvm -cpu Nehalem -kernel /pkg/linux/x86_64-nfsroot/gcc-6/f0ca0aacfed0309a5dd97db7025493e5130c737b/vmlinuz-4.7.0-rc5-00036-gf0ca0aa -append 'ip=::::vm-intel12-1G-5::dhcp root=/dev/ram0 user=lkp job=/lkp/scheduled/vm-intel12-1G-5/boot-1-debian-x86_64-2015-02-07.cgz-f0ca0aacfed0309a5dd97db7025493e5130c737b-20160804-92468-116cpop-0.yaml ARCH=x86_64 kconfig=x86_64-nfsroot branch=linux-devel/devel-catchup-201608040229 commit=f0ca0aacfed0309a5dd97db7025493e5130c737b BOOT_IMAGE=/pkg/linux/x86_64-nfsroot/gcc-6/f0ca0aacfed0309a5dd97db7025493e5130c737b/vmlinuz-4.7.0-rc5-00036-gf0ca0aa max_uptime=600 RESULT_ROOT=/result/boot/1/vm-intel12-1G/debian-x86_64-2015-02-07.cgz/x86_64-nfsroot/gcc-6/f0ca0aacfed0309a5dd97db7025493e5130c737b/0 LKP_SERVER=inn debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0 systemd.log_level=err ignore_loglevel earlyprintk=ttyS0,115200 console=ttyS0,115200 console=tty0 vga=normal rw'  -initrd /fs/KVM/initrd-vm-intel12-1G-5 -m 1024 -smp 1 -device e1000,netdev=net0 -netdev user,id=net0,hostfwd=tcp::23304-:22 -boot order=nc -no-reboot -watchdog i6300esb -watchdog-action debug -rtc base=localtime -drive file=/fs/KVM/disk0-vm-intel12-1G-5,media=disk,if=virtio -drive file=/fs/KVM/disk1-vm-intel12-1G-5,media=disk,if=virtio -drive file=/fs/KVM/disk2-vm-intel12-1G-5,media=disk,if=virtio -drive file=/fs/KVM/disk3-vm-intel12-1G-5,media=disk,if=virtio -drive file=/fs/KVM/disk4-vm-intel12-1G-5,media=disk,if=virtio -drive file=/fs/KVM/disk5-vm-intel12-1G-5,media=disk,if=virtio -pidfile /dev/shm/kboot/pid-vm-intel12-1G-5 -serial file:/dev/shm/kboot/serial-vm-intel12-1G-5 -daemonize -display none -monitor null 





Thanks,
Xiaolong

View attachment "config-4.7.0-rc5-00036-gf0ca0aa" of type "text/plain" (111221 bytes)

Download attachment "dmesg.xz" of type "application/octet-stream" (18168 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ