lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Date:   Sun, 5 Sep 2021 21:59:33 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Andrew Morton <akpm@...ux-foundation.org>
Cc:     0day robot <lkp@...el.com>, "Huang, Ying" <ying.huang@...el.com>,
        Yang Shi <shy828301@...il.com>, Zi Yan <ziy@...dia.com>,
        Michal Hocko <mhocko@...e.com>, Wei Xu <weixugc@...gle.com>,
        Oscar Salvador <osalvador@...e.de>,
        David Rientjes <rientjes@...gle.com>,
        Dan Williams <dan.j.williams@...el.com>,
        David Hildenbrand <david@...hat.com>,
        Greg Thelen <gthelen@...gle.com>,
        Keith Busch <kbusch@...nel.org>,
        Yang Shi <yang.shi@...ux.alibaba.com>,
        Andrew Morton <akpm@...ux-foundation.org>,
        LKML <linux-kernel@...r.kernel.org>, lkp@...ts.01.org,
        feng.tang@...el.com, zhengjun.xing@...ux.intel.com,
        dave.hansen@...ux.intel.com, linux-mm@...ck.org,
        mm-commits@...r.kernel.org, torvalds@...ux-foundation.org
Subject: [mm/migrate]  9eeb73028c:  stress-ng.memhotplug.ops_per_sec -53.8%
 regression



Greeting,

FYI, we noticed a -53.8% regression of stress-ng.memhotplug.ops_per_sec due to commit:


commit: 9eeb73028cfb54eb06efe87c50cc014d3f1ff43e ("[patch 174/212] mm/migrate: update node demotion order on hotplug events")
url: https://github.com/0day-ci/linux/commits/Andrew-Morton/ia64-fix-typo-in-a-comment/20210903-065028


in testcase: stress-ng
on test machine: 96 threads 2 sockets Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory
with following parameters:

	nr_threads: 10%
	disk: 1HDD
	testtime: 60s
	fs: ext4
	class: os
	test: memhotplug
	cpufreq_governor: performance
	ucode: 0x5003006




If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang@...el.com>


Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install                job.yaml  # job file is attached in this email
        bin/lkp split-job --compatible job.yaml  # generate the yaml file for lkp run
        bin/lkp run                    generated-yaml-file

=========================================================================================
class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode:
  os/gcc-9/performance/1HDD/ext4/x86_64-rhel-8.3/10%/debian-10.4-x86_64-20200603.cgz/lkp-csl-2sp5/memhotplug/stress-ng/60s/0x5003006

commit: 
  603f5ce25c ("mm/numa: automatically generate node migration order")
  9eeb73028c ("mm/migrate: update node demotion order on hotplug events")

603f5ce25c452baf 9eeb73028cfb54eb06efe87c50c 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
      2638           -53.7%       1221        stress-ng.memhotplug.ops
     43.89           -53.8%      20.28        stress-ng.memhotplug.ops_per_sec
     40637 ±  2%     -61.5%      15654 ±  4%  stress-ng.time.involuntary_context_switches
     91.17           -50.6%      45.00        stress-ng.time.percent_of_cpu_this_job_got
     57.11           -50.3%      28.40        stress-ng.time.system_time
   1075917           -36.4%     684753        cpuidle..usage
      0.92            -0.5        0.43 ±  2%  mpstat.cpu.all.sys%
      7183 ±  3%     +17.9%       8467 ±  8%  numa-vmstat.node1.nr_kernel_stack
     13042 ± 10%     -34.2%       8577 ± 11%  softirqs.CPU0.SCHED
     17047            +5.8%      18036        proc-vmstat.nr_kernel_stack
 1.218e+09 ±  2%     -54.3%  5.564e+08 ±  3%  proc-vmstat.pgfree
    766.67 ±  5%     +12.2%     860.50 ±  3%  slabinfo.kmalloc-cg-32.active_objs
      7462 ±  7%     +13.3%       8458 ±  4%  slabinfo.kmalloc-cg-8.active_objs
     25595 ±  2%     -40.0%      15361        vmstat.system.cs
      7186           -22.4%       5577        vmstat.system.in
      1422 ±  8%     -34.0%     939.50 ± 43%  numa-meminfo.node0.Active(anon)
      7183 ±  3%     +17.9%       8467 ±  8%  numa-meminfo.node1.KernelStack
    835236 ± 12%     +23.0%    1027326 ± 11%  numa-meminfo.node1.MemUsed
     41.67           -48.8%      21.33 ±  3%  turbostat.Avg_MHz
      1.42 ±  2%      -0.6        0.83 ±  2%  turbostat.Busy%
      2937           -12.3%       2574        turbostat.Bzy_MHz
     51129 ± 15%     -34.7%      33365 ± 10%  turbostat.C1
      0.10 ±  4%      -0.0        0.07 ± 14%  turbostat.C1%
    161038           -53.8%      74435        turbostat.C1E
      0.82            -0.4        0.39        turbostat.C1E%
    837765           -33.9%     553856        turbostat.C6
     15.14           -28.8%      10.78 ±  3%  turbostat.CPU%c1
    455267 ±  2%     -23.9%     346620 ±  2%  turbostat.IRQ
    112.21            -7.7%     103.57        turbostat.PkgWatt
     84.04            -4.3%      80.40        turbostat.RAMWatt
     33885 ±  6%     -24.2%      25673        interrupts.CAL:Function_call_interrupts
      6313 ±  8%     -75.6%       1541 ± 19%  interrupts.CPU0.CAL:Function_call_interrupts
     30982 ± 16%     -55.4%      13832 ±  5%  interrupts.CPU0.LOC:Local_timer_interrupts
    270.83 ± 18%     -79.5%      55.50 ± 21%  interrupts.CPU0.RES:Rescheduling_interrupts
      2401 ± 25%     -76.3%     568.50 ± 21%  interrupts.CPU1.CAL:Function_call_interrupts
     21139 ± 23%     -56.0%       9299 ± 27%  interrupts.CPU1.LOC:Local_timer_interrupts
    108.33 ± 18%     -81.1%      20.50 ± 38%  interrupts.CPU1.RES:Rescheduling_interrupts
    863.50 ± 24%     -59.7%     348.17 ± 34%  interrupts.CPU2.CAL:Function_call_interrupts
     98.00 ± 35%     -70.9%      28.50 ± 86%  interrupts.CPU2.RES:Rescheduling_interrupts
      1504 ± 29%    +168.4%       4037 ± 50%  interrupts.CPU22.LOC:Local_timer_interrupts
     12932 ± 21%     -69.8%       3904 ± 41%  interrupts.CPU5.LOC:Local_timer_interrupts
     77.17 ± 65%     -85.1%      11.50 ± 49%  interrupts.CPU5.RES:Rescheduling_interrupts
      6555 ± 33%     -45.9%       3549 ± 58%  interrupts.CPU54.LOC:Local_timer_interrupts
     87.33 ± 31%     -74.6%      22.17 ± 60%  interrupts.CPU58.RES:Rescheduling_interrupts
     76.17 ± 24%     -80.7%      14.67 ± 39%  interrupts.CPU59.RES:Rescheduling_interrupts
     76.17 ± 24%     -72.4%      21.00 ± 62%  interrupts.CPU63.RES:Rescheduling_interrupts
      6038 ± 34%     -67.1%       1984 ± 40%  interrupts.CPU66.LOC:Local_timer_interrupts
      7942 ± 37%     -55.8%       3513 ± 70%  interrupts.CPU7.LOC:Local_timer_interrupts
    428264           -22.2%     333008        interrupts.LOC:Local_timer_interrupts
      3123 ±  8%     -53.8%       1444 ± 10%  interrupts.RES:Rescheduling_interrupts


                                                                                
                             stress-ng.memhotplug.ops                           
                                                                                
  3000 +--------------------------------------------------------------------+   
       |            .+                   .+   +.       +.                   |   
  2500 |.++.++.++.++  +.++.++.++.++.++.++  +.+  ++.++.+  ++.+               |   
       |                                                                    |   
       |                                                                    |   
  2000 |-+                                                                  |   
       |                                                                    |   
  1500 |-+                                                                  |   
       | OO OO OO OO O  OO OO OO OO OO OO OO  O OO OO  O OO O   O  O OO OO O|   
  1000 |-+            O                                      O O  O         |   
       |                                                                    |   
       |                                                                    |   
   500 |-+                                                                  |   
       |                                     O        O                     |   
     0 +--------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                        stress-ng.memhotplug.ops_per_sec                        
                                                                                
  50 +----------------------------------------------------------------------+   
  45 |-+          .+                    .+   +.       +.                    |   
     |.++.++.++.++  +.+.++.++.++.++.++.+  +.+  ++.++.+  ++.+                |   
  40 |-+                                                                    |   
  35 |-+                                                                    |   
     |                                                                      |   
  30 |-+                                                                    |   
  25 |-+                                                                    |   
  20 |-OO OO OO OO O  O OO OO OO OO OO O OO  O OO OO  O O  O    O  OO OO OO |   
     |              O                                    O   OO  O          |   
  15 |-+                                                                    |   
  10 |-+                                                                    |   
     |                                                                      |   
   5 |-+                                    O        O                      |   
   0 +----------------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


---
0DAY/LKP+ Test Infrastructure                   Open Source Technology Center
https://lists.01.org/hyperkitty/list/lkp@lists.01.org       Intel Corporation

Thanks,
Oliver Sang


View attachment "config-5.14.0-00174-g9eeb73028cfb" of type "text/plain" (175541 bytes)

View attachment "job-script" of type "text/plain" (8277 bytes)

View attachment "job.yaml" of type "text/plain" (5578 bytes)

View attachment "reproduce" of type "text/plain" (538 bytes)

Powered by blists - more mailing lists