linux-kernel - [linus:master] [selftests/memory] 13023c33c9: kernel-selftests.memory-hotplug.mem-on-off-test.sh.fail

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [day] [month] [year] [list]

Message-ID: <202211011541.83a6cd27-yujie.liu@intel.com>
Date:   Tue, 1 Nov 2022 15:58:52 +0800
From:   kernel test robot <yujie.liu@...el.com>
To:     Zhao Gongyi <zhaogongyi@...wei.com>
CC:     <oe-lkp@...ts.linux.dev>, <lkp@...el.com>,
        Shuah Khan <skhan@...uxfoundation.org>,
        David Hildenbrand <david@...hat.com>,
        <linux-kernel@...r.kernel.org>, <linux-mm@...ck.org>
Subject: [linus:master] [selftests/memory] 13023c33c9:
 kernel-selftests.memory-hotplug.mem-on-off-test.sh.fail

Hi Gongyi,

We noticed that below commit may change the exit status of
memory-hotplug selftest, please check if the test result is expected.

We got same test log before this commit but with a good exit, though
there were also some "Invalid argument" and "unexpected success" log.
Please help give some guidance if there are any problems in our test
flow. Thanks.


Greeting,

FYI, we noticed kernel-selftests.memory-hotplug.mem-on-off-test.sh.fail due to commit (built with gcc-11):

commit: 13023c33c962730a38d6b43995910c8805637a9a ("selftests/memory-hotplug: Add checking after online or offline")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master

in testcase: kernel-selftests
version: kernel-selftests-x86_64-9313ba54-1_20221017
with following parameters:

	group: memory-hotplug

test-description: The kernel contains a set of "self tests" under the tools/testing/selftests/ directory. These are intended to be small unit tests to exercise individual code paths in the kernel.
test-url: https://www.kernel.org/doc/Documentation/kselftest.txt


on test machine: 8 threads Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz (Skylake) with 28G memory

caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):


2022-10-28 01:04:44 make quicktest=1 run_tests -C memory-hotplug
make: Entering directory '/usr/src/perf_selftests-x86_64-rhel-8.3-kselftests-13023c33c962730a38d6b43995910c8805637a9a/tools/testing/selftests/memory-hotplug'
TAP version 13
1..1
# selftests: memory-hotplug: mem-on-off-test.sh
# Test scope: 2% hotplug memory
# 	 online all hot-pluggable memory in offline state:
# 		 SKIPPED - no hot-pluggable memory in offline state
# 	 offline 2% hot-pluggable memory in online state
# 	 trying to offline 5 out of 224 memory block(s):
# online->offline memory0
# ./mem-on-off-test.sh: line 78: echo: write error: Invalid argument
# offline_memory_expect_success 0: unexpected fail
# online->offline memory1
# online->offline memory10
# online->offline memory100
# online->offline memory101
# online->offline memory102
# 	 online all hot-pluggable memory in offline state:
# offline->online memory1
# offline->online memory10
# offline->online memory100
# offline->online memory101
# offline->online memory102
# 	 Test with memory notifier error injection
# ./mem-on-off-test.sh: line 267: echo: write error: Invalid argument
# online_memory_expect_fail 142: unexpected success
# online_memory_expect_fail 190: unexpected success
# ./mem-on-off-test.sh: line 287: echo: write error: Invalid argument
# offline_memory_expect_fail 107: unexpected success
# offline_memory_expect_fail 119: unexpected success
# offline_memory_expect_fail 120: unexpected success
# offline_memory_expect_fail 137: unexpected success
# offline_memory_expect_fail 14: unexpected success
# offline_memory_expect_fail 150: unexpected success
# offline_memory_expect_fail 184: unexpected success
# offline_memory_expect_fail 188: unexpected success
# offline_memory_expect_fail 189: unexpected success
# offline_memory_expect_fail 94: unexpected success
# offline_memory_expect_fail 96: unexpected success
not ok 1 selftests: memory-hotplug: mem-on-off-test.sh # exit=1
make: Leaving directory '/usr/src/perf_selftests-x86_64-rhel-8.3-kselftests-13023c33c962730a38d6b43995910c8805637a9a/tools/testing/selftests/memory-hotplug'


If you fix the issue, kindly add following tag
| Reported-by: kernel test robot <yujie.liu@...el.com>
| Link: https://lore.kernel.org/oe-lkp/202211011541.83a6cd27-yujie.liu@intel.com


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        sudo bin/lkp install job.yaml           # job file is attached in this email
        bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
        sudo bin/lkp run generated-yaml-file

        # if come across any failure that blocks the test,
        # please remove ~/.lkp and /lkp dir to run from a clean state.


-- 
0-DAY CI Kernel Test Service
https://01.org/lkp

View attachment "config-6.0.0-rc1-00015-g13023c33c962" of type "text/plain" (168219 bytes)

View attachment "job-script" of type "text/plain" (6590 bytes)

Download attachment "dmesg.xz" of type "application/x-xz" (29624 bytes)

View attachment "kernel-selftests" of type "text/plain" (2895 bytes)

View attachment "job.yaml" of type "text/plain" (5531 bytes)

View attachment "reproduce" of type "text/plain" (258 bytes)