lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Message-ID: <20210122081311.GA12834@xsang-OptiPlex-9020>
Date:   Fri, 22 Jan 2021 16:13:11 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     John Ogness <john.ogness@...utronix.de>
Cc:     Petr Mladek <pmladek@...e.com>,
        Sergey Senozhatsky <sergey.senozhatsky@...il.com>,
        LKML <linux-kernel@...r.kernel.org>, lkp@...ts.01.org,
        lkp@...el.com, zhengjun.xing@...ux.intel.com
Subject: [printk]  b031a684bf: INFO:rcu_tasks_detected_stalls_on_tasks


Greeting,

FYI, we noticed the following commit (built with gcc-9):

commit: b031a684bfd01d633c79d281bd0cf11c2f834ada ("printk: remove logbuf_lock writer-protection of ringbuffer")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master


in testcase: rcutorture
version: 
with following parameters:

	runtime: 300s
	test: cpuhotplug
	torture_type: tasks

test-description: rcutorture is rcutorture kernel module load/unload test.
test-url: https://www.kernel.org/doc/Documentation/RCU/torture.txt


on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G

caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):


+------------------------------------------------+------------+------------+
|                                                | 6b916706f8 | b031a684bf |
+------------------------------------------------+------------+------------+
| boot_successes                                 | 66         | 18         |
| boot_failures                                  | 2          | 26         |
| INFO:rcu_sched_detected_stalls_on_CPUs/tasks   | 1          |            |
| RIP:enqueue_hrtimer                            | 1          |            |
| RIP:__memset                                   | 1          |            |
| RIP:clear_page_rep                             | 2          | 2          |
| BUG:kernel_hang_in_boot_stage                  | 2          |            |
| INFO:rcu_sched_self-detected_stall_on_CPU      | 1          | 4          |
| INFO:rcu_tasks_detected_stalls_on_tasks        | 0          | 22         |
| RIP:kernel_init_free_pages                     | 0          | 1          |
| IP-Config:Auto-configuration_of_network_failed | 0          | 3          |
| RIP:zone_page_state                            | 0          | 1          |
+------------------------------------------------+------------+------------+


If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang@...el.com>


[  952.147986] INFO: rcu_tasks detected stalls on tasks:
[  952.149313] 000000008d44d6d1: .. nvcsw: 0/0 holdout: 1 idle_cpu: -1/1
[  952.150866] task:dmesg           state:R  running task     stack:    0 pid: 1771 ppid:   573 flags:0x20020000
[  952.153385] Call Trace:
[  952.154090] __schedule (kbuild/src/consumer/kernel/sched/core.c:3779 kbuild/src/consumer/kernel/sched/core.c:4528) 
[  952.154990] ? firmware_map_remove (kbuild/src/consumer/kernel/sched/core.c:4411) 
[  952.156159] ? ksys_read (kbuild/src/consumer/fs/read_write.c:637) 
[  952.157063] schedule (kbuild/src/consumer/include/linux/thread_info.h:84 (discriminator 1) kbuild/src/consumer/include/linux/sched.h:1897 (discriminator 1) kbuild/src/consumer/kernel/sched/core.c:4608 (discriminator 1)) 
[  952.157895] exit_to_user_mode_prepare (kbuild/src/consumer/kernel/entry/common.c:160 kbuild/src/consumer/kernel/entry/common.c:191) 
[  952.158984] syscall_exit_to_user_mode (kbuild/src/consumer/arch/x86/include/asm/jump_label.h:41 kbuild/src/consumer/arch/x86/include/asm/nospec-branch.h:288 kbuild/src/consumer/arch/x86/include/asm/entry-common.h:80 kbuild/src/consumer/kernel/entry/common.c:133 kbuild/src/consumer/kernel/entry/common.c:268) 
[  952.160252] entry_INT80_compat (kbuild/src/consumer/arch/x86/entry/entry_64_compat.S:412) 
[  952.161424] RIP: 0023:0xf7eeca02
[  952.162254] RSP: 002b:00000000fff98e04 EFLAGS: 00000246 ORIG_RAX: 0000000000000003
[  952.164203] RAX: ffffffffffffffe0 RBX: 0000000000000004 RCX: 0000000056573234
[  952.165898] RDX: 0000000000001fff RSI: 00000000000001e0 RDI: 0000000056573234
[  952.167484] RBP: 00000000ffffffff R08: 0000000000000000 R09: 0000000000000000
[  952.169182] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
[  952.170897] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
[  952.189825] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.191987]
[  352.522192] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.192011]
[  952.222122] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.224619]
[  352.539354]
[   98.566609] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.224648]
[  952.264449]
[  352.555366] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.264484]
[  952.267017] 00000000974cbae1: .. nvcsw: 2/2 holdout: 1 idle_cpu: -1/1
[  952.268469] task:sed             state:R  running task     stack:    0 pid:  424 ppid:   396 flags:0x20020000
[  952.270501] Call Trace:
[  952.270986] __schedule (kbuild/src/consumer/kernel/sched/core.c:3779 kbuild/src/consumer/kernel/sched/core.c:4528) 
[  952.271861] ? firmware_map_remove (kbuild/src/consumer/kernel/sched/core.c:4411) 
[  952.272870] ? ksys_write (kbuild/src/consumer/fs/read_write.c:661) 
[  952.273709] schedule (kbuild/src/consumer/include/linux/thread_info.h:84 (discriminator 1) kbuild/src/consumer/include/linux/sched.h:1897 (discriminator 1) kbuild/src/consumer/kernel/sched/core.c:4608 (discriminator 1)) 
[  952.274495] exit_to_user_mode_prepare (kbuild/src/consumer/kernel/entry/common.c:160 kbuild/src/consumer/kernel/entry/common.c:191) 
[  952.275516] syscall_exit_to_user_mode (kbuild/src/consumer/arch/x86/include/asm/jump_label.h:41 kbuild/src/consumer/arch/x86/include/asm/nospec-branch.h:288 kbuild/src/consumer/arch/x86/include/asm/entry-common.h:80 kbuild/src/consumer/kernel/entry/common.c:133 kbuild/src/consumer/kernel/entry/common.c:268) 
[  952.276650] entry_INT80_compat (kbuild/src/consumer/arch/x86/entry/entry_64_compat.S:412) 
[  952.277673] RIP: 0023:0xf7f93a02
[  952.278497] RSP: 002b:00000000ff8db2f4 EFLAGS: 00000246 ORIG_RAX: 0000000000000004
[  952.280235] RAX: 0000000000000001 RBX: 0000000000000001 RCX: 000000005666f220
[  952.281813] RDX: 0000000000000001 RSI: 00000000f7f59d60 RDI: 0000000000000001
[  952.283347] RBP: 000000005666f220 R08: 0000000000000000 R09: 0000000000000000
[  952.284919] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
[  952.286507] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
[  952.294673] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.328047] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.336658]
[  352.572231]
[   98.585525] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.336693]
[  952.359450]
[  352.594642] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.359483]
[  952.377678] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.409955] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.412504]
[  352.610470]
[   98.605699] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.412531]
[  952.444293]
[  352.625170] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.444328]
[  952.453669] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.480340]
[  352.638172]
[   98.622917] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.480372]
[  952.521255] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.532279]
[  352.668363] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.532313]
[  952.546877] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.589718]
[  352.679476]
[   98.638686] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.589794]
[  952.604011] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.622613]
[  352.694706] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.622648]
[  952.631723] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.662230]
[  352.706582]
[   98.654747] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.662270]
[  952.692429] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.700017]
[  352.738289] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.700056]
[  952.732376] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.762275] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.764584]
[  352.740552]
[   98.670545] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.764616]
[  952.809608] tasks-torture:torture_onoff task: online 0 failed: errno -5
[  952.811420]
[  352.764442]


To reproduce:

        # build kernel
	cd linux
	cp config-5.10.0-rc5-gb031a684bfd0 .config
	make HOSTCC=gcc-9 CC=gcc-9 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email



Thanks,
Oliver Sang


View attachment "config-5.10.0-rc5-gb031a684bfd0" of type "text/plain" (120657 bytes)

View attachment "job-script" of type "text/plain" (4359 bytes)

Download attachment "dmesg.xz" of type "application/x-xz" (393380 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ