linux-kernel - [x86, sched] 2a0abc5969: phoronix-test-suite.stress-ng.SystemVMessagePassing.bogo_ops

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Message-ID: <20201116070733.GA22371@xsang-OptiPlex-9020>
Date:   Mon, 16 Nov 2020 15:07:33 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Giovanni Gherdovich <ggherdovich@...e.cz>
Cc:     Ingo Molnar <mingo@...nel.org>,
        Peter Zijlstra <peterz@...radead.org>,
        "Rafael J. Wysocki" <rafael.j.wysocki@...el.com>,
        LKML <linux-kernel@...r.kernel.org>, lkp@...ts.01.org,
        lkp@...el.com, ying.huang@...el.com, feng.tang@...el.com,
        zhengjun.xing@...el.com, guobing.chen@...el.com,
        ming.a.chen@...el.com, frank.du@...el.com, Shuhua.Fan@...el.com,
        wangyang.guo@...el.com, Wenhuan.Huang@...el.com,
        jessica.ji@...el.com, shan.kang@...el.com, guangli.li@...el.com,
        tiejun.li@...el.com, yu.ma@...el.com, dapeng1.mi@...el.com,
        jiebin.sun@...el.com, gengxin.xie@...el.com, fan.zhao@...el.com,
        aubrey.li@...ux.intel.com, yu.c.chen@...el.com
Subject: [x86, sched]  2a0abc5969:
 phoronix-test-suite.stress-ng.SystemVMessagePassing.bogo_ops_s -14.1%
 regression


Greeting,

FYI, we noticed a -14.1% regression of phoronix-test-suite.stress-ng.SystemVMessagePassing.bogo_ops_s due to commit:


commit: 2a0abc59699896f03bf6f16efb8a3a490511216f ("x86, sched: Add support for frequency invariance on SKYLAKE_X")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master


in testcase: phoronix-test-suite
on test machine: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory
with following parameters:

	test: stress-ng-1.2.2
	option_a: System V Message Passing
	cpufreq_governor: performance
	ucode: 0x5002f01

test-description: The Phoronix Test Suite is the most comprehensive testing and benchmarking platform available that provides an extensible framework for which new tests can be easily added.
test-url: http://www.phoronix-test-suite.com/



If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang@...el.com>


Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml

=========================================================================================
compiler/cpufreq_governor/kconfig/option_a/rootfs/tbox_group/test/testcase/ucode:
  gcc-9/performance/x86_64-rhel-8.3/System V Message Passing/debian-x86_64-phoronix/lkp-csl-2sp8/stress-ng-1.2.2/phoronix-test-suite/0x5002f01

commit: 
  1567c3e346 ("x86, sched: Add support for frequency invariance")
  2a0abc5969 ("x86, sched: Add support for frequency invariance on SKYLAKE_X")

1567c3e3467cddeb 2a0abc59699896f03bf6f16efb8 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
   6736877 ±  2%     -14.1%    5784719        phoronix-test-suite.stress-ng.SystemVMessagePassing.bogo_ops_s
 2.509e+08 ± 82%     -73.9%   65398195 ±  4%  phoronix-test-suite.time.involuntary_context_switches
    222.84 ± 78%     -52.7%     105.51 ±  2%  phoronix-test-suite.time.user_time
 2.576e+08 ± 82%     -73.3%   68843409 ±  4%  phoronix-test-suite.time.voluntary_context_switches


                                                                                
            phoronix-test-suite.stress-ng.SystemVMessagePassing.bogo_ops_s      
                                                                                
  7.2e+06 +-----------------------------------------------------------------+   
    7e+06 |-+          +        .+.+                                        |   
          |  +        : +    .+.    :                  .+    +              |   
  6.8e+06 |.. +       :  +..+       :                +. :    :              |   
  6.6e+06 |-+  +..   :               :     +.. .+.. +    :  :               |   
          |       +.+                :   ..   +    +     :  :               |   
  6.4e+06 |-+                         +.+                :  :               |   
  6.2e+06 |-+                                            : :                |   
    6e+06 |-+  O    O                                     ::                |   
          |  O    O              O O                    O :       O         |   
  5.8e+06 |-+          O O  O O                    O O    +  O O    O  O O  |   
  5.6e+06 |-+                         O O  O  O                             |   
          |                                                                 |   
  5.4e+06 |-+                                   O                           |   
  5.2e+06 +-----------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Oliver Sang


View attachment "config-5.5.0-rc3-00068-g2a0abc59699896" of type "text/plain" (154382 bytes)

View attachment "job-script" of type "text/plain" (7423 bytes)

View attachment "job.yaml" of type "text/plain" (5002 bytes)

View attachment "reproduce" of type "text/plain" (301 bytes)