lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Message-ID: <20201030053427.GU31092@shao2-debian>
Date:   Fri, 30 Oct 2020 13:34:28 +0800
From:   kernel test robot <rong.a.chen@...el.com>
To:     Johan Hovold <johan@...nel.org>
Cc:     Greg Kroah-Hartman <gregkh@...uxfoundation.org>,
        Andy Shevchenko <andriy.shevchenko@...ux.intel.com>,
        LKML <linux-kernel@...r.kernel.org>, lkp@...ts.01.org,
        lkp@...el.com, ying.huang@...el.com, feng.tang@...el.com,
        zhengjun.xing@...el.com
Subject: [serial] e0830dbf71: will-it-scale.per_process_ops 23.8% improvement

Greeting,

FYI, we noticed a 23.8% improvement of will-it-scale.per_process_ops due to commit:


commit: e0830dbf71f191851ed3772d2760f007b7c5bc3a ("serial: core: fix console port-lock regression")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master


in testcase: will-it-scale
on test machine: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
with following parameters:

	nr_task: 50%
	mode: process
	test: context_switch1
	cpufreq_governor: performance
	ucode: 0x5002f01

test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale





Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml

=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
  gcc-9/performance/x86_64-rhel-8.3/process/50%/debian-10.4-x86_64-20200603.cgz/lkp-csl-2ap3/context_switch1/will-it-scale/0x5002f01

commit: 
  fe88c64892 ("serial: core: fix port-lock initialisation")
  e0830dbf71 ("serial: core: fix console port-lock regression")

fe88c6489264eaea e0830dbf71f191851ed3772d276 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
    302270 ±  4%     +23.8%     374255 ±  2%  will-it-scale.per_process_ops
    313807           +25.7%     394431        will-it-scale.per_process_ops.virtual.max
  29018011 ±  4%     +23.8%   35928582 ±  2%  will-it-scale.workload
      1.32 ±  5%      +0.2        1.56 ±  5%  mpstat.cpu.all.irq%
      0.20            +0.0        0.23 ±  3%  mpstat.cpu.all.soft%
     38.16 ±  6%      +9.1       47.24 ±  2%  mpstat.cpu.all.sys%
  45948546 ±  4%     +23.5%   56754694 ±  2%  sched_debug.cpu.nr_switches.avg
  48138737 ±  3%     +22.0%   58735441 ±  2%  sched_debug.cpu.nr_switches.max
  40369386 ±  5%     +26.7%   51165357 ±  4%  sched_debug.cpu.nr_switches.min
     38.88 ±  6%     +24.1%      48.25 ±  2%  vmstat.cpu.sy
  57317067 ±  4%     +23.8%   70958764 ±  2%  vmstat.system.cs
   2215932 ±  5%     +36.8%    3031251 ±  6%  vmstat.system.in
  36471086 ± 22%     +86.6%   68048511 ± 25%  cpuidle.C1.time
  21713122 ± 21%     +68.0%   36483148 ± 24%  cpuidle.C1.usage
  4.39e+09 ±  6%     +20.5%  5.292e+09        cpuidle.POLL.time
 5.263e+09 ±  3%     +33.8%   7.04e+09 ±  4%  cpuidle.POLL.usage
 5.708e+10 ±  4%     +23.5%  7.049e+10 ±  2%  perf-stat.i.branch-instructions
 7.714e+08 ±  4%     +23.4%  9.518e+08 ±  2%  perf-stat.i.branch-misses
  57837468 ±  4%     +23.8%   71621468 ±  2%  perf-stat.i.context-switches
      2.14 ±  4%     -20.8%       1.70 ±  2%  perf-stat.i.cpi
 5.864e+11            -2.0%  5.749e+11        perf-stat.i.cpu-cycles
      0.01 ± 64%      -0.0        0.00 ±  3%  perf-stat.i.dTLB-load-miss-rate%
 8.057e+10 ±  4%     +23.7%  9.968e+10 ±  2%  perf-stat.i.dTLB-loads
 5.033e+10 ±  3%     +23.8%  6.232e+10 ±  2%  perf-stat.i.dTLB-stores
 4.574e+08 ±  3%     +21.6%  5.559e+08 ±  2%  perf-stat.i.iTLB-load-misses
    788081 ± 15%     +71.0%    1347960 ± 20%  perf-stat.i.iTLB-loads
 2.751e+11 ±  4%     +23.5%  3.399e+11 ±  2%  perf-stat.i.instructions
    602.89            +1.8%     613.55        perf-stat.i.instructions-per-iTLB-miss
      0.47 ±  4%     +25.9%       0.59 ±  2%  perf-stat.i.ipc
      3.05            -2.0%       2.99        perf-stat.i.metric.GHz
    982.17 ±  4%     +23.6%       1213 ±  2%  perf-stat.i.metric.M/sec
      2.13 ±  4%     -20.7%       1.69 ±  2%  perf-stat.overall.cpi
      0.01 ± 66%      -0.0        0.00 ±  2%  perf-stat.overall.dTLB-load-miss-rate%
    601.30            +1.7%     611.24        perf-stat.overall.instructions-per-iTLB-miss
      0.47 ±  4%     +26.0%       0.59 ±  2%  perf-stat.overall.ipc
 5.692e+10 ±  4%     +23.5%  7.029e+10 ±  2%  perf-stat.ps.branch-instructions
 7.694e+08 ±  4%     +23.4%  9.492e+08 ±  2%  perf-stat.ps.branch-misses
  57671220 ±  4%     +23.8%   71414958 ±  2%  perf-stat.ps.context-switches
 5.844e+11            -2.0%  5.729e+11        perf-stat.ps.cpu-cycles
 8.034e+10 ±  4%     +23.7%  9.939e+10 ±  2%  perf-stat.ps.dTLB-loads
 5.018e+10 ±  4%     +23.8%  6.213e+10 ±  2%  perf-stat.ps.dTLB-stores
 4.561e+08 ±  3%     +21.5%  5.543e+08 ±  2%  perf-stat.ps.iTLB-load-misses
    800352 ± 15%     +69.3%    1355071 ± 20%  perf-stat.ps.iTLB-loads
 2.743e+11 ±  4%     +23.5%  3.389e+11 ±  2%  perf-stat.ps.instructions
 8.314e+13 ±  4%     +23.5%  1.026e+14 ±  2%  perf-stat.total.instructions
   2198522 ±  3%     +32.0%    2901372 ±  5%  interrupts.CPU0.RES:Rescheduling_interrupts
   2195256 ±  3%     +30.5%    2865118 ±  4%  interrupts.CPU10.RES:Rescheduling_interrupts
   2198643 ±  4%     +32.2%    2906370 ±  4%  interrupts.CPU100.RES:Rescheduling_interrupts
   2215356 ±  3%     +34.3%    2974326 ±  6%  interrupts.CPU101.RES:Rescheduling_interrupts
   2182466 ±  4%     +31.8%    2877469 ±  5%  interrupts.CPU102.RES:Rescheduling_interrupts
   2190208 ±  4%     +31.7%    2884117 ±  7%  interrupts.CPU103.RES:Rescheduling_interrupts
   2185579 ±  4%     +32.3%    2890745 ±  3%  interrupts.CPU104.RES:Rescheduling_interrupts
   2201723 ±  4%     +31.9%    2904434 ±  4%  interrupts.CPU105.RES:Rescheduling_interrupts
   2201401 ±  4%     +31.0%    2884856 ±  5%  interrupts.CPU106.RES:Rescheduling_interrupts
   2214655 ±  4%     +33.7%    2961112 ±  5%  interrupts.CPU107.RES:Rescheduling_interrupts
   2230687 ±  4%     +28.4%    2863088 ±  6%  interrupts.CPU108.RES:Rescheduling_interrupts
   2190814 ±  2%     +32.3%    2899319 ±  4%  interrupts.CPU109.RES:Rescheduling_interrupts
   2228886 ±  3%     +28.3%    2859158 ±  7%  interrupts.CPU11.RES:Rescheduling_interrupts
   2188177 ±  3%     +34.3%    2939319 ±  4%  interrupts.CPU110.RES:Rescheduling_interrupts
   2200805 ±  4%     +31.5%    2894093 ±  4%  interrupts.CPU111.RES:Rescheduling_interrupts
   2192163 ±  2%     +32.1%    2894955 ±  5%  interrupts.CPU112.RES:Rescheduling_interrupts
   2221375 ±  3%     +29.6%    2879656 ±  5%  interrupts.CPU113.RES:Rescheduling_interrupts
   2228963 ±  5%     +31.6%    2932823 ±  6%  interrupts.CPU114.RES:Rescheduling_interrupts
   2217933 ±  4%     +32.5%    2937856 ±  4%  interrupts.CPU115.RES:Rescheduling_interrupts
   2200438 ±  3%     +33.7%    2942832 ±  4%  interrupts.CPU116.RES:Rescheduling_interrupts
   2186316 ±  2%     +33.9%    2928298 ±  4%  interrupts.CPU117.RES:Rescheduling_interrupts
   2211671 ±  2%     +30.0%    2876162 ±  5%  interrupts.CPU118.RES:Rescheduling_interrupts
   2207921 ±  3%     +30.6%    2883169 ±  6%  interrupts.CPU119.RES:Rescheduling_interrupts
   2210669 ±  4%     +32.3%    2925220 ±  6%  interrupts.CPU12.RES:Rescheduling_interrupts
   2200923 ±  4%     +31.3%    2889401 ±  4%  interrupts.CPU120.RES:Rescheduling_interrupts
   2167181 ±  5%     +33.8%    2899439 ±  5%  interrupts.CPU121.RES:Rescheduling_interrupts
   2180684 ±  3%     +36.2%    2969677 ±  6%  interrupts.CPU122.RES:Rescheduling_interrupts
   2180753 ±  3%     +28.9%    2810166 ±  6%  interrupts.CPU123.RES:Rescheduling_interrupts
   2154340 ±  3%     +34.0%    2886221 ±  4%  interrupts.CPU124.RES:Rescheduling_interrupts
   2163312 ±  3%     +32.7%    2871196 ±  6%  interrupts.CPU125.RES:Rescheduling_interrupts
   2170310 ±  6%     +30.9%    2839991 ±  5%  interrupts.CPU126.RES:Rescheduling_interrupts
   2163274 ±  5%     +36.4%    2950254 ±  6%  interrupts.CPU127.RES:Rescheduling_interrupts
   2179517 ±  3%     +32.6%    2889863 ±  4%  interrupts.CPU128.RES:Rescheduling_interrupts
   2165045 ±  4%     +33.2%    2884132 ±  5%  interrupts.CPU129.RES:Rescheduling_interrupts
   2190398 ±  5%     +34.1%    2938057 ±  4%  interrupts.CPU13.RES:Rescheduling_interrupts
   2191694 ±  4%     +32.0%    2893584 ±  4%  interrupts.CPU130.RES:Rescheduling_interrupts
   2147982 ±  3%     +31.7%    2828061 ±  5%  interrupts.CPU131.RES:Rescheduling_interrupts
   2149791 ±  3%     +38.0%    2965873 ±  6%  interrupts.CPU132.RES:Rescheduling_interrupts
   2167449 ±  4%     +31.9%    2858809 ±  2%  interrupts.CPU133.RES:Rescheduling_interrupts
   2151181 ±  4%     +33.4%    2869567 ±  6%  interrupts.CPU134.RES:Rescheduling_interrupts
   2123346 ±  3%     +31.6%    2793270 ±  4%  interrupts.CPU135.RES:Rescheduling_interrupts
   2127802 ±  4%     +34.1%    2853636 ±  4%  interrupts.CPU136.RES:Rescheduling_interrupts
   2124202 ±  4%     +32.2%    2808240 ±  6%  interrupts.CPU137.RES:Rescheduling_interrupts
   2120044 ±  4%     +35.8%    2878016 ±  7%  interrupts.CPU138.RES:Rescheduling_interrupts
   2138063 ±  4%     +31.6%    2813112 ±  7%  interrupts.CPU139.RES:Rescheduling_interrupts
   2212347 ±  5%     +32.5%    2931273 ±  4%  interrupts.CPU14.RES:Rescheduling_interrupts
   2158701 ±  4%     +31.2%    2831558 ±  5%  interrupts.CPU140.RES:Rescheduling_interrupts
   2139579 ±  3%     +30.3%    2787463 ±  4%  interrupts.CPU141.RES:Rescheduling_interrupts
   2117365 ±  3%     +31.0%    2773321 ±  8%  interrupts.CPU142.RES:Rescheduling_interrupts
   2146417 ±  4%     +30.3%    2796157 ±  6%  interrupts.CPU143.RES:Rescheduling_interrupts
   2168328 ±  8%     +32.9%    2882787 ±  7%  interrupts.CPU144.RES:Rescheduling_interrupts
   2196791 ±  2%     +32.5%    2911424 ±  6%  interrupts.CPU145.RES:Rescheduling_interrupts
   2163972 ±  5%     +35.9%    2940949 ±  5%  interrupts.CPU146.RES:Rescheduling_interrupts
   2201185 ±  8%     +30.7%    2876430 ±  7%  interrupts.CPU147.RES:Rescheduling_interrupts
   2200116 ±  5%     +33.0%    2926511 ±  5%  interrupts.CPU148.RES:Rescheduling_interrupts
   2207795 ±  6%     +33.3%    2943606 ± 10%  interrupts.CPU149.RES:Rescheduling_interrupts
   2213503 ±  3%     +30.8%    2896217 ±  4%  interrupts.CPU15.RES:Rescheduling_interrupts
   2203364 ±  7%     +30.1%    2867121 ±  6%  interrupts.CPU150.RES:Rescheduling_interrupts
   2240917 ±  5%     +31.4%    2944120 ±  5%  interrupts.CPU152.RES:Rescheduling_interrupts
   2184706 ±  5%     +31.7%    2877061 ±  7%  interrupts.CPU153.RES:Rescheduling_interrupts
   2203209 ±  5%     +32.3%    2914035 ±  5%  interrupts.CPU154.RES:Rescheduling_interrupts
   2202566 ±  5%     +32.3%    2913030 ±  8%  interrupts.CPU155.RES:Rescheduling_interrupts
   2182854 ±  4%     +32.6%    2893593 ±  5%  interrupts.CPU156.RES:Rescheduling_interrupts
   2189095 ±  4%     +33.9%    2931058 ±  8%  interrupts.CPU157.RES:Rescheduling_interrupts
   2182662 ±  5%     +33.0%    2902087 ±  5%  interrupts.CPU158.RES:Rescheduling_interrupts
   2142136 ±  4%     +31.1%    2809378 ±  8%  interrupts.CPU159.RES:Rescheduling_interrupts
   2246972 ±  7%     +30.9%    2940456 ±  6%  interrupts.CPU16.RES:Rescheduling_interrupts
   2196100 ±  8%     +28.3%    2816774 ±  8%  interrupts.CPU160.RES:Rescheduling_interrupts
   2172698 ±  6%     +30.8%    2841918 ±  6%  interrupts.CPU161.RES:Rescheduling_interrupts
   2128359 ±  4%     +31.3%    2794406 ±  9%  interrupts.CPU162.RES:Rescheduling_interrupts
   2139611 ±  4%     +33.1%    2847711 ±  6%  interrupts.CPU163.RES:Rescheduling_interrupts
   2177887 ±  7%     +33.7%    2911189 ±  7%  interrupts.CPU164.RES:Rescheduling_interrupts
   2156967 ±  3%     +29.6%    2795797 ±  5%  interrupts.CPU165.RES:Rescheduling_interrupts
   2172466 ±  5%     +29.9%    2822553 ±  7%  interrupts.CPU167.RES:Rescheduling_interrupts
   1967158 ±  7%     +37.4%    2701912 ±  7%  interrupts.CPU168.RES:Rescheduling_interrupts
   1935338 ±  5%     +41.7%    2741991 ±  8%  interrupts.CPU169.RES:Rescheduling_interrupts
   2244397 ±  4%     +30.8%    2936039 ±  5%  interrupts.CPU17.RES:Rescheduling_interrupts
   1940265 ±  4%     +43.2%    2778900 ±  6%  interrupts.CPU170.RES:Rescheduling_interrupts
   1948953 ±  6%     +40.8%    2745083 ±  8%  interrupts.CPU171.RES:Rescheduling_interrupts
   1956592 ±  6%     +42.8%    2794674 ±  7%  interrupts.CPU172.RES:Rescheduling_interrupts
   1976727 ±  8%     +37.2%    2711639 ±  6%  interrupts.CPU173.RES:Rescheduling_interrupts
   1963791 ±  5%     +35.1%    2653817 ±  9%  interrupts.CPU174.RES:Rescheduling_interrupts
   1939722 ±  4%     +41.3%    2741613 ±  6%  interrupts.CPU175.RES:Rescheduling_interrupts
   1995450 ±  8%     +37.3%    2738881 ±  6%  interrupts.CPU176.RES:Rescheduling_interrupts
   1926891 ±  5%     +41.1%    2718954 ±  3%  interrupts.CPU177.RES:Rescheduling_interrupts
   1954553 ±  5%     +40.4%    2744394 ±  4%  interrupts.CPU178.RES:Rescheduling_interrupts
   1949929 ±  6%     +39.0%    2710352 ±  5%  interrupts.CPU179.RES:Rescheduling_interrupts
   2239021 ±  6%     +31.3%    2939328 ±  4%  interrupts.CPU18.RES:Rescheduling_interrupts
   1962923 ±  7%     +36.9%    2688175 ±  7%  interrupts.CPU180.RES:Rescheduling_interrupts
   1960194 ±  4%     +38.2%    2708394 ±  7%  interrupts.CPU181.RES:Rescheduling_interrupts
   1954540 ±  5%     +38.2%    2702000 ±  6%  interrupts.CPU182.RES:Rescheduling_interrupts
   1938825 ±  4%     +37.8%    2671858 ±  6%  interrupts.CPU183.RES:Rescheduling_interrupts
   1946469 ±  4%     +33.3%    2595431 ±  7%  interrupts.CPU184.RES:Rescheduling_interrupts
   1926013 ±  7%     +34.5%    2591343 ±  5%  interrupts.CPU185.RES:Rescheduling_interrupts
   1934138 ±  5%     +36.8%    2646397 ±  6%  interrupts.CPU186.RES:Rescheduling_interrupts
   1923542 ±  5%     +35.5%    2606825 ±  7%  interrupts.CPU187.RES:Rescheduling_interrupts
   1926300 ±  5%     +38.6%    2670661 ±  5%  interrupts.CPU188.RES:Rescheduling_interrupts
   1914506 ±  4%     +38.0%    2641383 ±  7%  interrupts.CPU189.RES:Rescheduling_interrupts
   2211190 ±  4%     +31.1%    2897971 ±  6%  interrupts.CPU19.RES:Rescheduling_interrupts
   1946312 ±  6%     +34.8%    2623589 ±  7%  interrupts.CPU190.RES:Rescheduling_interrupts
   1853431 ±  4%     +36.5%    2530456 ±  6%  interrupts.CPU191.RES:Rescheduling_interrupts
   2233495 ±  8%     +30.4%    2911910 ±  5%  interrupts.CPU2.RES:Rescheduling_interrupts
   2218910 ±  3%     +33.1%    2952959 ±  6%  interrupts.CPU20.RES:Rescheduling_interrupts
   2289401 ±  6%     +29.6%    2968178 ±  5%  interrupts.CPU21.RES:Rescheduling_interrupts
   2218997 ±  3%     +31.5%    2917923 ±  3%  interrupts.CPU22.RES:Rescheduling_interrupts
   2215270 ±  5%     +30.1%    2881419 ±  4%  interrupts.CPU23.RES:Rescheduling_interrupts
   2185403 ±  7%     +30.0%    2840158 ±  5%  interrupts.CPU24.RES:Rescheduling_interrupts
   2155134 ±  6%     +34.1%    2891004 ±  6%  interrupts.CPU25.RES:Rescheduling_interrupts
   2203532 ±  3%     +29.9%    2863210 ±  5%  interrupts.CPU27.RES:Rescheduling_interrupts
   2205201 ±  6%     +30.5%    2878555 ±  3%  interrupts.CPU28.RES:Rescheduling_interrupts
   2201469 ±  6%     +29.5%    2850836 ±  5%  interrupts.CPU29.RES:Rescheduling_interrupts
   2206564 ±  3%     +30.6%    2882729 ±  4%  interrupts.CPU3.RES:Rescheduling_interrupts
   2166283 ±  4%     +31.7%    2853641 ±  8%  interrupts.CPU30.RES:Rescheduling_interrupts
   2169139 ±  5%     +32.5%    2874571 ±  5%  interrupts.CPU31.RES:Rescheduling_interrupts
   2211416 ±  5%     +31.2%    2900763 ±  4%  interrupts.CPU32.RES:Rescheduling_interrupts
   2203611 ±  9%     +31.2%    2891078 ±  7%  interrupts.CPU33.RES:Rescheduling_interrupts
   2203057 ±  4%     +30.3%    2870604 ±  6%  interrupts.CPU34.RES:Rescheduling_interrupts
   2197175 ±  8%     +32.0%    2899435 ±  5%  interrupts.CPU35.RES:Rescheduling_interrupts
   2213145 ±  8%     +30.6%    2889879 ±  5%  interrupts.CPU36.RES:Rescheduling_interrupts
   2191882 ±  5%     +32.5%    2904940 ±  4%  interrupts.CPU37.RES:Rescheduling_interrupts
   2179585 ±  5%     +32.0%    2877269 ±  6%  interrupts.CPU38.RES:Rescheduling_interrupts
   2188653 ±  5%     +33.0%    2910302 ±  7%  interrupts.CPU39.RES:Rescheduling_interrupts
   2169514 ±  4%     +32.4%    2873431 ±  6%  interrupts.CPU40.RES:Rescheduling_interrupts
   2182725 ±  3%     +30.1%    2840208 ±  4%  interrupts.CPU41.RES:Rescheduling_interrupts
   2191870 ±  5%     +29.7%    2842584 ±  3%  interrupts.CPU43.RES:Rescheduling_interrupts
   2219148 ±  5%     +29.3%    2868451 ±  6%  interrupts.CPU44.RES:Rescheduling_interrupts
   2192996 ±  6%     +32.1%    2897693 ±  6%  interrupts.CPU45.RES:Rescheduling_interrupts
   2199248 ±  5%     +32.2%    2907814 ±  6%  interrupts.CPU46.RES:Rescheduling_interrupts
   2157553 ±  6%     +33.5%    2879560 ±  6%  interrupts.CPU47.RES:Rescheduling_interrupts
   2158996 ±  4%     +30.1%    2809269 ±  6%  interrupts.CPU48.RES:Rescheduling_interrupts
   2148396 ±  5%     +31.4%    2822208 ±  6%  interrupts.CPU49.RES:Rescheduling_interrupts
   2221532 ±  3%     +31.8%    2928672 ±  3%  interrupts.CPU5.RES:Rescheduling_interrupts
   2140869 ±  5%     +32.9%    2844448 ±  6%  interrupts.CPU50.RES:Rescheduling_interrupts
   2138557 ±  4%     +27.1%    2717724 ±  5%  interrupts.CPU51.RES:Rescheduling_interrupts
   2174982 ±  4%     +27.9%    2780727 ±  5%  interrupts.CPU52.RES:Rescheduling_interrupts
   2160626 ±  5%     +28.1%    2767937 ±  7%  interrupts.CPU54.RES:Rescheduling_interrupts
   2123391 ±  5%     +30.7%    2776236 ±  5%  interrupts.CPU55.RES:Rescheduling_interrupts
   2184843 ±  4%     +30.6%    2853955 ±  6%  interrupts.CPU56.RES:Rescheduling_interrupts
   2199542 ±  6%     +29.7%    2853122 ±  7%  interrupts.CPU57.RES:Rescheduling_interrupts
   2179916 ±  5%     +32.2%    2880995 ±  6%  interrupts.CPU58.RES:Rescheduling_interrupts
   2162370 ±  5%     +31.5%    2843745 ±  7%  interrupts.CPU59.RES:Rescheduling_interrupts
   2200889 ±  3%     +32.4%    2913441 ±  5%  interrupts.CPU6.RES:Rescheduling_interrupts
   2179531 ±  4%     +32.5%    2887357 ±  6%  interrupts.CPU60.RES:Rescheduling_interrupts
   2193266 ±  4%     +29.7%    2844497 ±  6%  interrupts.CPU61.RES:Rescheduling_interrupts
   2160548 ±  5%     +37.0%    2960266 ±  6%  interrupts.CPU62.RES:Rescheduling_interrupts
   2180155 ±  4%     +30.0%    2834276 ± 10%  interrupts.CPU64.RES:Rescheduling_interrupts
   2153999 ±  5%     +33.5%    2876008 ±  8%  interrupts.CPU65.RES:Rescheduling_interrupts
   2179283 ±  3%     +30.5%    2844260 ±  7%  interrupts.CPU67.RES:Rescheduling_interrupts
   2163221 ±  5%     +30.7%    2828373 ±  7%  interrupts.CPU68.RES:Rescheduling_interrupts
   2174917 ±  5%     +33.4%    2901097 ±  6%  interrupts.CPU69.RES:Rescheduling_interrupts
   2201074 ±  3%     +29.2%    2842705 ±  7%  interrupts.CPU7.RES:Rescheduling_interrupts
   2211418 ±  5%     +31.2%    2900354 ±  6%  interrupts.CPU71.RES:Rescheduling_interrupts
   1889043 ±  4%     +40.8%    2660535 ±  6%  interrupts.CPU72.RES:Rescheduling_interrupts
   1896457 ±  4%     +39.5%    2645097 ±  7%  interrupts.CPU73.RES:Rescheduling_interrupts
   1928255 ±  3%     +38.2%    2664871 ±  6%  interrupts.CPU74.RES:Rescheduling_interrupts
   1918874 ±  3%     +39.6%    2679067 ±  6%  interrupts.CPU75.RES:Rescheduling_interrupts
   1913327 ±  5%     +41.7%    2710553 ±  5%  interrupts.CPU76.RES:Rescheduling_interrupts
   1931383 ±  5%     +36.4%    2634813 ±  5%  interrupts.CPU77.RES:Rescheduling_interrupts
   1960809 ±  4%     +34.9%    2645806 ±  6%  interrupts.CPU78.RES:Rescheduling_interrupts
   1929607 ±  5%     +38.6%    2675276 ±  5%  interrupts.CPU79.RES:Rescheduling_interrupts
   2224742 ±  4%     +32.3%    2943696 ±  5%  interrupts.CPU8.RES:Rescheduling_interrupts
   1960053 ±  3%     +43.5%    2812849 ±  6%  interrupts.CPU80.RES:Rescheduling_interrupts
   1941141 ±  5%     +41.3%    2742584 ±  5%  interrupts.CPU81.RES:Rescheduling_interrupts
   1968566 ±  4%     +39.9%    2754615 ±  5%  interrupts.CPU82.RES:Rescheduling_interrupts
   1939121 ±  6%     +39.5%    2704432 ±  7%  interrupts.CPU83.RES:Rescheduling_interrupts
   1937371 ±  4%     +37.0%    2653678 ±  7%  interrupts.CPU84.RES:Rescheduling_interrupts
   1940737 ±  3%     +40.9%    2734305 ±  7%  interrupts.CPU85.RES:Rescheduling_interrupts
   1947378 ±  3%     +41.0%    2746497 ±  6%  interrupts.CPU86.RES:Rescheduling_interrupts
   1985791 ±  8%     +37.1%    2721692 ±  6%  interrupts.CPU87.RES:Rescheduling_interrupts
   1980911 ±  4%     +37.5%    2724561 ±  8%  interrupts.CPU88.RES:Rescheduling_interrupts
   1933675 ±  5%     +37.9%    2666050 ±  7%  interrupts.CPU89.RES:Rescheduling_interrupts
   2203840 ±  3%     +29.7%    2858469 ±  6%  interrupts.CPU9.RES:Rescheduling_interrupts
   1961077 ±  4%     +39.8%    2741747 ±  7%  interrupts.CPU90.RES:Rescheduling_interrupts
   1970070 ±  6%     +36.6%    2690985 ±  9%  interrupts.CPU91.RES:Rescheduling_interrupts
   1952310 ±  5%     +38.7%    2707833 ±  7%  interrupts.CPU92.RES:Rescheduling_interrupts
   1961378 ±  6%     +40.3%    2752086 ±  8%  interrupts.CPU93.RES:Rescheduling_interrupts
   1825332 ± 45%    +110.5%    3842087 ± 40%  interrupts.CPU94.CAL:Function_call_interrupts
   1971260 ±  6%     +35.2%    2665751 ±  8%  interrupts.CPU94.RES:Rescheduling_interrupts
   1911557 ±  5%     +36.5%    2609902 ±  7%  interrupts.CPU95.RES:Rescheduling_interrupts
   2250709 ±  7%     +31.7%    2964207 ±  4%  interrupts.CPU96.RES:Rescheduling_interrupts
   2200169 ±  2%     +31.2%    2887221 ±  6%  interrupts.CPU97.RES:Rescheduling_interrupts
   2223298 ±  3%     +34.7%    2994301 ±  5%  interrupts.CPU98.RES:Rescheduling_interrupts
   2251560 ±  8%     +27.8%    2877529 ±  4%  interrupts.CPU99.RES:Rescheduling_interrupts
 4.083e+08 ±  3%     +33.1%  5.436e+08 ±  3%  interrupts.RES:Rescheduling_interrupts
     21.96 ±  8%      -9.4       12.53 ±  7%  perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
      0.52 ± 26%      +0.1        0.62 ±  2%  perf-profile.calltrace.cycles-pp.ttwu_do_wakeup.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
      0.45 ± 37%      +0.1        0.56        perf-profile.calltrace.cycles-pp.hrtimer_get_next_event.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select
      0.54 ± 26%      +0.1        0.66 ±  2%  perf-profile.calltrace.cycles-pp.__calc_delta.update_curr.dequeue_entity.dequeue_task_fair.__sched_text_start
      0.85 ±  2%      +0.1        0.98 ±  2%  perf-profile.calltrace.cycles-pp.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle
      0.71 ±  7%      +0.1        0.84 ±  5%  perf-profile.calltrace.cycles-pp.hrtimer_next_event_without.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
      0.69 ±  5%      +0.1        0.84 ±  2%  perf-profile.calltrace.cycles-pp.mutex_lock.pipe_read.new_sync_read.vfs_read.ksys_read
      0.56 ± 25%      +0.2        0.71 ±  2%  perf-profile.calltrace.cycles-pp.touch_atime.pipe_read.new_sync_read.vfs_read.ksys_read
      0.86 ±  3%      +0.2        1.01        perf-profile.calltrace.cycles-pp.__switch_to_asm.read
      1.27 ±  7%      +0.2        1.43 ±  2%  perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
      1.10 ±  6%      +0.2        1.27        perf-profile.calltrace.cycles-pp.copy_page_from_iter.pipe_write.new_sync_write.vfs_write.ksys_write
      0.50 ± 25%      +0.2        0.67        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64.write
      0.54 ± 25%      +0.2        0.72        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64.read
      1.14 ±  6%      +0.2        1.33        perf-profile.calltrace.cycles-pp.update_load_avg.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up
      0.87 ±  4%      +0.2        1.10        perf-profile.calltrace.cycles-pp.__switch_to_asm
      0.91 ±  3%      +0.3        1.21 ±  2%  perf-profile.calltrace.cycles-pp.copy_page_to_iter.pipe_read.new_sync_read.vfs_read.ksys_read
      1.04 ±  7%      +0.3        1.38 ±  6%  perf-profile.calltrace.cycles-pp.update_load_avg.set_next_entity.pick_next_task_fair.__sched_text_start.schedule_idle
      0.29 ± 88%      +0.3        0.63 ±  2%  perf-profile.calltrace.cycles-pp.pick_next_entity.pick_next_task_fair.__sched_text_start.schedule_idle.do_idle
      1.44 ±  4%      +0.4        1.85        perf-profile.calltrace.cycles-pp.prepare_to_wait_event.pipe_read.new_sync_read.vfs_read.ksys_read
      0.16 ±148%      +0.4        0.59 ±  6%  perf-profile.calltrace.cycles-pp.update_cfs_group.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up
      0.93 ±  6%      +0.4        1.38 ±  5%  perf-profile.calltrace.cycles-pp.timekeeping_max_deferment.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle
      3.65 ±  7%      +0.5        4.16        perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function
      0.03 ±387%      +0.5        0.57 ±  2%  perf-profile.calltrace.cycles-pp.update_rq_clock.__sched_text_start.schedule.pipe_read.new_sync_read
      0.03 ±387%      +0.5        0.58 ±  4%  perf-profile.calltrace.cycles-pp.__update_load_avg_cfs_rq.update_load_avg.dequeue_entity.dequeue_task_fair.__sched_text_start
      0.00            +0.6        0.55        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.pipe_read.new_sync_read.vfs_read
      0.00            +0.6        0.55 ±  2%  perf-profile.calltrace.cycles-pp._raw_spin_unlock_irqrestore.prepare_to_wait_event.pipe_read.new_sync_read.vfs_read
      1.98 ±  6%      +0.6        2.54 ±  4%  perf-profile.calltrace.cycles-pp.set_next_entity.pick_next_task_fair.__sched_text_start.schedule_idle.do_idle
      0.00            +0.6        0.57 ±  4%  perf-profile.calltrace.cycles-pp.update_cfs_group.dequeue_entity.dequeue_task_fair.__sched_text_start.schedule
      4.36 ±  7%      +0.6        4.94        perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common
      0.00            +0.6        0.60 ±  2%  perf-profile.calltrace.cycles-pp.finish_task_switch.__sched_text_start.schedule.pipe_read.new_sync_read
      4.48 ±  7%      +0.6        5.09        perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
      2.23 ±  2%      +0.6        2.87 ±  3%  perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
      3.15 ±  2%      +0.8        3.99 ±  2%  perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
      3.17 ±  4%      +0.9        4.03 ±  2%  perf-profile.calltrace.cycles-pp.pick_next_task_fair.__sched_text_start.schedule_idle.do_idle.cpu_startup_entry
      5.01 ±  8%      +1.0        6.03 ±  6%  perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__sched_text_start.schedule.pipe_read
      8.05 ±  7%      +1.0        9.09        perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write
      8.55 ±  7%      +1.1        9.67        perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write
      8.35 ±  7%      +1.1        9.47        perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write
      2.68 ±  4%      +1.1        3.81 ±  6%  perf-profile.calltrace.cycles-pp.ktime_get.tick_nohz_idle_exit.do_idle.cpu_startup_entry.start_secondary
      2.40 ±  8%      +1.1        3.54 ±  5%  perf-profile.calltrace.cycles-pp.ktime_get.tick_nohz_idle_enter.do_idle.cpu_startup_entry.start_secondary
      5.68 ±  8%      +1.2        6.85 ±  6%  perf-profile.calltrace.cycles-pp.dequeue_task_fair.__sched_text_start.schedule.pipe_read.new_sync_read
      9.17 ±  7%      +1.2       10.39        perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write.ksys_write
      3.15 ±  3%      +1.3        4.40 ±  3%  perf-profile.calltrace.cycles-pp.tick_nohz_idle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
     11.93 ±  7%      +1.4       13.32 ±  2%  perf-profile.calltrace.cycles-pp.schedule.pipe_read.new_sync_read.vfs_read.ksys_read
      0.00            +1.4        1.41 ±  6%  perf-profile.calltrace.cycles-pp.asm_sysvec_reschedule_ipi.tick_nohz_idle_exit.do_idle.cpu_startup_entry.start_secondary
      7.12 ±  8%      +1.5        8.59 ±  2%  perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
     11.35 ±  7%      +1.5       12.83 ±  3%  perf-profile.calltrace.cycles-pp.__sched_text_start.schedule.pipe_read.new_sync_read.vfs_read
      6.58 ±  3%      +1.5        8.07 ±  3%  perf-profile.calltrace.cycles-pp.__sched_text_start.schedule_idle.do_idle.cpu_startup_entry.start_secondary
      6.89 ±  2%      +1.6        8.50 ±  2%  perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
     12.14 ±  6%      +1.7       13.86        perf-profile.calltrace.cycles-pp.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64
     12.55 ±  6%      +1.8       14.30        perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     14.42 ±  7%      +1.8       16.23        perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     15.00 ±  7%      +1.9       16.86        perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     15.28 ±  7%      +1.9       17.19        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     17.86 ±  6%      +2.8       20.69        perf-profile.calltrace.cycles-pp.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64
     18.54 ±  6%      +3.0       21.52        perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
     23.27            +3.1       26.32        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read
     20.77 ±  6%      +3.2       23.97        perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
     21.47 ±  7%      +3.3       24.73        perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
     22.09 ±  7%      +3.3       25.38        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
     27.31            +3.7       31.03        perf-profile.calltrace.cycles-pp.read
     22.10 ±  8%      -9.5       12.64 ±  6%  perf-profile.children.cycles-pp.menu_select
      0.19 ±  4%      -0.0        0.15 ±  3%  perf-profile.children.cycles-pp.rcu_needs_cpu
      0.05 ±  8%      +0.0        0.07 ±  7%  perf-profile.children.cycles-pp.perf_exclude_event
      0.12 ±  8%      +0.0        0.14 ±  4%  perf-profile.children.cycles-pp.iov_iter_init
      0.18 ±  6%      +0.0        0.20 ±  3%  perf-profile.children.cycles-pp.__list_del_entry_valid
      0.14 ±  7%      +0.0        0.16 ±  6%  perf-profile.children.cycles-pp.timestamp_truncate
      0.08 ±  7%      +0.0        0.10 ±  5%  perf-profile.children.cycles-pp.can_stop_idle_tick
      0.09 ±  7%      +0.0        0.11 ±  4%  perf-profile.children.cycles-pp.rcu_dynticks_eqs_exit
      0.23 ±  8%      +0.0        0.26 ±  3%  perf-profile.children.cycles-pp.resched_curr
      0.15 ±  6%      +0.0        0.17 ±  4%  perf-profile.children.cycles-pp.cpus_share_cache
      0.09 ±  5%      +0.0        0.12 ±  5%  perf-profile.children.cycles-pp.rcu_dynticks_eqs_enter
      0.11 ±  6%      +0.0        0.14        perf-profile.children.cycles-pp.__list_add_valid
      0.15 ±  7%      +0.0        0.18 ±  5%  perf-profile.children.cycles-pp.place_entity
      0.13 ±  7%      +0.0        0.17 ±  3%  perf-profile.children.cycles-pp.rcu_all_qs
      0.13 ± 12%      +0.0        0.16 ±  7%  perf-profile.children.cycles-pp.perf_swevent_event
      0.26 ±  7%      +0.0        0.30 ±  2%  perf-profile.children.cycles-pp.syscall_enter_from_user_mode
      0.07 ±  5%      +0.0        0.11 ±  4%  perf-profile.children.cycles-pp.__x64_sys_write
      0.10 ±  8%      +0.0        0.14 ± 12%  perf-profile.children.cycles-pp.__sb_start_write
      0.38 ±  3%      +0.0        0.42 ±  2%  perf-profile.children.cycles-pp.__rdgsbase_inactive
      0.16 ±  6%      +0.0        0.20 ±  4%  perf-profile.children.cycles-pp.available_idle_cpu
      0.43 ±  6%      +0.0        0.47 ±  2%  perf-profile.children.cycles-pp.file_update_time
      0.17 ±  4%      +0.0        0.22 ±  2%  perf-profile.children.cycles-pp.apparmor_file_permission
      0.21 ±  4%      +0.0        0.25 ±  3%  perf-profile.children.cycles-pp.clear_buddies
      0.20 ±  4%      +0.0        0.24 ±  3%  perf-profile.children.cycles-pp.put_prev_task_idle
      0.46 ±  6%      +0.0        0.51 ±  3%  perf-profile.children.cycles-pp.current_time
      0.52 ±  2%      +0.0        0.57        perf-profile.children.cycles-pp.hrtimer_get_next_event
      0.02 ±113%      +0.1        0.07 ±  5%  perf-profile.children.cycles-pp.sched_idle_set_state
      0.44 ±  6%      +0.1        0.50 ±  4%  perf-profile.children.cycles-pp.hrtimer_interrupt
      0.24 ±  5%      +0.1        0.29 ±  2%  perf-profile.children.cycles-pp.switch_fpu_return
      0.45 ±  5%      +0.1        0.51 ±  4%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      0.19 ±  6%      +0.1        0.25 ±  3%  perf-profile.children.cycles-pp.rcu_eqs_exit
      0.22 ±  6%      +0.1        0.28 ±  3%  perf-profile.children.cycles-pp.anon_pipe_buf_release
      0.46 ±  8%      +0.1        0.53        perf-profile.children.cycles-pp.copyin
      0.28 ±  5%      +0.1        0.35 ±  2%  perf-profile.children.cycles-pp.finish_wait
      0.29 ±  4%      +0.1        0.35 ±  3%  perf-profile.children.cycles-pp.rb_erase
      0.32 ±  8%      +0.1        0.39 ±  6%  perf-profile.children.cycles-pp.account_entity_enqueue
      0.26 ±  6%      +0.1        0.33 ±  2%  perf-profile.children.cycles-pp._cond_resched
      0.57 ±  8%      +0.1        0.64 ±  2%  perf-profile.children.cycles-pp.__fget_light
      0.00            +0.1        0.07 ±  8%  perf-profile.children.cycles-pp.cpu_latency_qos_limit
      0.68 ±  8%      +0.1        0.76 ±  2%  perf-profile.children.cycles-pp.__fdget_pos
      0.97 ±  8%      +0.1        1.05 ±  2%  perf-profile.children.cycles-pp.common_file_perm
      0.33 ±  5%      +0.1        0.41 ±  2%  perf-profile.children.cycles-pp.switch_mm_irqs_off
      0.43 ±  6%      +0.1        0.51 ±  4%  perf-profile.children.cycles-pp.atime_needs_update
      0.46 ±  5%      +0.1        0.54 ±  2%  perf-profile.children.cycles-pp.check_preempt_curr
      0.34 ±  3%      +0.1        0.42 ±  2%  perf-profile.children.cycles-pp.__might_fault
      0.35 ±  4%      +0.1        0.43 ±  2%  perf-profile.children.cycles-pp._raw_spin_lock_irq
      0.56 ±  6%      +0.1        0.64 ±  2%  perf-profile.children.cycles-pp.ttwu_do_wakeup
      0.05 ± 26%      +0.1        0.15 ±  4%  perf-profile.children.cycles-pp.irq_work_needs_cpu
      0.03 ± 77%      +0.1        0.12 ±  3%  perf-profile.children.cycles-pp.default_wake_function
      0.57 ±  6%      +0.1        0.67 ±  2%  perf-profile.children.cycles-pp.__calc_delta
      0.42 ±  5%      +0.1        0.52 ±  2%  perf-profile.children.cycles-pp.copy_user_generic_unrolled
      0.35 ±  5%      +0.1        0.46 ±  3%  perf-profile.children.cycles-pp.rcu_idle_exit
      0.39 ±  4%      +0.1        0.50 ±  2%  perf-profile.children.cycles-pp.copyout
      0.81 ±  7%      +0.1        0.92 ±  3%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
      0.43 ±  4%      +0.1        0.54        perf-profile.children.cycles-pp.mutex_unlock
      0.44 ±  4%      +0.1        0.57 ±  2%  perf-profile.children.cycles-pp.__might_sleep
      0.54 ±  5%      +0.1        0.67 ±  2%  perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      0.59 ±  5%      +0.1        0.71 ±  2%  perf-profile.children.cycles-pp.touch_atime
      0.87 ±  2%      +0.1        1.00 ±  2%  perf-profile.children.cycles-pp.get_next_timer_interrupt
      0.22 ± 13%      +0.1        0.36 ± 18%  perf-profile.children.cycles-pp.native_irq_return_iret
      0.73 ±  7%      +0.1        0.87 ±  5%  perf-profile.children.cycles-pp.hrtimer_next_event_without
      2.32 ±  2%      +0.1        2.47 ±  2%  perf-profile.children.cycles-pp.__switch_to
      0.55 ±  3%      +0.1        0.70 ±  2%  perf-profile.children.cycles-pp.pick_next_entity
      0.97 ±  6%      +0.2        1.13        perf-profile.children.cycles-pp.update_rq_clock
      0.67 ±  6%      +0.2        0.82 ±  4%  perf-profile.children.cycles-pp.reweight_entity
      0.37 ±  5%      +0.2        0.53 ±  2%  perf-profile.children.cycles-pp.cpuidle_governor_latency_req
      1.27 ±  7%      +0.2        1.44 ±  2%  perf-profile.children.cycles-pp.select_task_rq_fair
      1.13 ±  5%      +0.2        1.31        perf-profile.children.cycles-pp.copy_page_from_iter
      0.75 ±  2%      +0.2        0.94 ±  2%  perf-profile.children.cycles-pp._raw_spin_lock
      0.76 ±  4%      +0.2        0.96 ±  2%  perf-profile.children.cycles-pp.___might_sleep
      0.79 ±  4%      +0.2        0.99 ±  4%  perf-profile.children.cycles-pp.fsnotify
      0.93 ±  4%      +0.2        1.17 ±  2%  perf-profile.children.cycles-pp.syscall_return_via_sysret
      1.08 ±  5%      +0.2        1.33        perf-profile.children.cycles-pp.mutex_lock
      1.11 ±  5%      +0.2        1.36 ±  2%  perf-profile.children.cycles-pp.__update_load_avg_se
      0.96 ±  7%      +0.3        1.22 ±  6%  perf-profile.children.cycles-pp.update_cfs_group
      1.05 ±  5%      +0.3        1.32 ±  3%  perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
      1.11 ±  4%      +0.3        1.40        perf-profile.children.cycles-pp.entry_SYSCALL_64
      1.15 ±  3%      +0.3        1.44        perf-profile.children.cycles-pp.native_sched_clock
      0.93 ±  3%      +0.3        1.24 ±  2%  perf-profile.children.cycles-pp.copy_page_to_iter
      1.19 ±  3%      +0.3        1.50        perf-profile.children.cycles-pp.sched_clock
      1.93 ±  2%      +0.3        2.25        perf-profile.children.cycles-pp.__switch_to_asm
      1.39 ±  4%      +0.3        1.72 ±  2%  perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
      1.37 ±  3%      +0.3        1.70        perf-profile.children.cycles-pp.sched_clock_cpu
      1.44 ±  3%      +0.4        1.81        perf-profile.children.cycles-pp._raw_spin_lock_irqsave
      1.49 ±  4%      +0.4        1.92        perf-profile.children.cycles-pp.prepare_to_wait_event
      1.12 ±  8%      +0.4        1.56 ±  8%  perf-profile.children.cycles-pp.finish_task_switch
      0.94 ±  6%      +0.4        1.39 ±  5%  perf-profile.children.cycles-pp.timekeeping_max_deferment
      0.93 ±  7%      +0.5        1.39 ±  5%  perf-profile.children.cycles-pp.asm_sysvec_reschedule_ipi
      2.09 ±  5%      +0.6        2.67 ±  3%  perf-profile.children.cycles-pp.set_next_entity
      3.87 ±  8%      +0.6        4.50 ±  3%  perf-profile.children.cycles-pp.enqueue_entity
      2.27 ±  2%      +0.7        2.92 ±  3%  perf-profile.children.cycles-pp.tick_nohz_next_event
      4.49 ±  8%      +0.7        5.17 ±  3%  perf-profile.children.cycles-pp.enqueue_task_fair
      4.60 ±  7%      +0.7        5.32 ±  3%  perf-profile.children.cycles-pp.ttwu_do_activate
      3.18 ±  2%      +0.8        4.03 ±  2%  perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
      3.96 ±  5%      +0.9        4.83 ±  2%  perf-profile.children.cycles-pp.pick_next_task_fair
      3.77 ±  7%      +1.0        4.79 ±  6%  perf-profile.children.cycles-pp.update_load_avg
      5.09 ±  8%      +1.0        6.13 ±  6%  perf-profile.children.cycles-pp.dequeue_entity
      8.08 ±  7%      +1.1        9.13        perf-profile.children.cycles-pp.try_to_wake_up
      8.56 ±  7%      +1.1        9.67        perf-profile.children.cycles-pp.__wake_up_common
      8.36 ±  7%      +1.1        9.49        perf-profile.children.cycles-pp.autoremove_wake_function
      5.69 ±  7%      +1.2        6.86 ±  6%  perf-profile.children.cycles-pp.dequeue_task_fair
      9.18 ±  7%      +1.2       10.40        perf-profile.children.cycles-pp.__wake_up_common_lock
      3.26 ±  2%      +1.4        4.64 ±  3%  perf-profile.children.cycles-pp.tick_nohz_idle_enter
     11.95 ±  7%      +1.4       13.34 ±  2%  perf-profile.children.cycles-pp.schedule
      7.38 ±  8%      +1.4        8.81 ±  3%  perf-profile.children.cycles-pp.poll_idle
      6.95 ±  2%      +1.6        8.58 ±  2%  perf-profile.children.cycles-pp.schedule_idle
     12.18 ±  6%      +1.7       13.90        perf-profile.children.cycles-pp.pipe_write
     12.60 ±  6%      +1.8       14.35        perf-profile.children.cycles-pp.new_sync_write
     14.46 ±  7%      +1.8       16.27        perf-profile.children.cycles-pp.vfs_write
     15.02 ±  7%      +1.9       16.88        perf-profile.children.cycles-pp.ksys_write
      5.55 ±  5%      +2.2        7.74 ±  5%  perf-profile.children.cycles-pp.ktime_get
     17.95 ±  6%      +2.9       20.81        perf-profile.children.cycles-pp.pipe_read
     18.55 ±  6%      +3.0       21.54        perf-profile.children.cycles-pp.new_sync_read
     18.30 ±  5%      +3.0       21.30 ±  2%  perf-profile.children.cycles-pp.__sched_text_start
     20.80 ±  6%      +3.2       24.02        perf-profile.children.cycles-pp.vfs_read
     21.50 ±  7%      +3.3       24.77        perf-profile.children.cycles-pp.ksys_read
     27.57            +3.8       31.35        perf-profile.children.cycles-pp.read
     37.39 ±  7%      +5.2       42.60        perf-profile.children.cycles-pp.do_syscall_64
     18.40 ± 11%     -10.6        7.85 ± 11%  perf-profile.self.cycles-pp.menu_select
      4.48 ± 14%      -2.5        1.93 ± 11%  perf-profile.self.cycles-pp.cpuidle_enter_state
      0.18 ±  5%      -0.0        0.14 ±  5%  perf-profile.self.cycles-pp.rcu_needs_cpu
      0.07 ±  6%      +0.0        0.09 ±  2%  perf-profile.self.cycles-pp.sched_clock
      0.17 ±  6%      +0.0        0.19 ±  3%  perf-profile.self.cycles-pp.__list_del_entry_valid
      0.09 ±  5%      +0.0        0.11 ±  5%  perf-profile.self.cycles-pp.iov_iter_init
      0.11 ±  4%      +0.0        0.13 ±  4%  perf-profile.self.cycles-pp.tick_nohz_get_sleep_length
      0.12 ±  7%      +0.0        0.14 ±  6%  perf-profile.self.cycles-pp.current_time
      0.06 ±  8%      +0.0        0.08 ±  3%  perf-profile.self.cycles-pp.copyout
      0.13 ±  5%      +0.0        0.15 ±  6%  perf-profile.self.cycles-pp.timestamp_truncate
      0.10 ±  5%      +0.0        0.12 ±  2%  perf-profile.self.cycles-pp.__list_add_valid
      0.07 ±  6%      +0.0        0.10 ±  4%  perf-profile.self.cycles-pp.can_stop_idle_tick
      0.12 ±  7%      +0.0        0.14 ±  5%  perf-profile.self.cycles-pp.cpus_share_cache
      0.10 ±  7%      +0.0        0.12 ±  3%  perf-profile.self.cycles-pp.rcu_all_qs
      0.06 ± 13%      +0.0        0.09 ± 12%  perf-profile.self.cycles-pp.pm_qos_read_value
      0.06            +0.0        0.09 ±  7%  perf-profile.self.cycles-pp.flush_smp_call_function_from_idle
      0.09 ±  3%      +0.0        0.12 ±  4%  perf-profile.self.cycles-pp.__might_fault
      0.08 ±  7%      +0.0        0.11 ±  3%  perf-profile.self.cycles-pp.rcu_dynticks_eqs_exit
      0.10 ±  6%      +0.0        0.12 ±  4%  perf-profile.self.cycles-pp.rcu_eqs_exit
      0.10 ±  5%      +0.0        0.13 ±  4%  perf-profile.self.cycles-pp.ttwu_do_activate
      0.23 ±  3%      +0.0        0.26 ±  2%  perf-profile.self.cycles-pp.tick_nohz_next_event
      0.30 ±  8%      +0.0        0.33 ±  2%  perf-profile.self.cycles-pp.do_syscall_64
      0.09 ±  4%      +0.0        0.12 ±  5%  perf-profile.self.cycles-pp.rcu_dynticks_eqs_enter
      0.16 ±  9%      +0.0        0.19 ±  3%  perf-profile.self.cycles-pp.rb_insert_color
      0.16 ±  2%      +0.0        0.20 ±  3%  perf-profile.self.cycles-pp.clear_buddies
      0.18 ±  3%      +0.0        0.22 ±  3%  perf-profile.self.cycles-pp.cpu_startup_entry
      0.16 ±  4%      +0.0        0.20 ±  2%  perf-profile.self.cycles-pp.cpuidle_governor_latency_req
      0.25 ±  7%      +0.0        0.28 ±  2%  perf-profile.self.cycles-pp.syscall_enter_from_user_mode
      0.06 ±  8%      +0.0        0.10 ±  2%  perf-profile.self.cycles-pp.__x64_sys_write
      0.16 ±  3%      +0.0        0.20 ±  3%  perf-profile.self.cycles-pp.put_prev_task_idle
      0.10 ±  8%      +0.0        0.14 ± 12%  perf-profile.self.cycles-pp.__sb_start_write
      0.11 ±  6%      +0.0        0.15 ±  3%  perf-profile.self.cycles-pp._cond_resched
      0.14 ±  5%      +0.0        0.18 ±  3%  perf-profile.self.cycles-pp.touch_atime
      0.15 ±  6%      +0.0        0.19 ±  5%  perf-profile.self.cycles-pp.available_idle_cpu
      0.16 ±  4%      +0.0        0.20 ±  2%  perf-profile.self.cycles-pp.apparmor_file_permission
      0.13            +0.0        0.17 ±  3%  perf-profile.self.cycles-pp.get_next_timer_interrupt
      0.17 ±  4%      +0.0        0.21 ±  2%  perf-profile.self.cycles-pp.check_preempt_curr
      0.15 ±  3%      +0.0        0.20 ±  3%  perf-profile.self.cycles-pp.put_prev_task_fair
      0.39 ±  8%      +0.0        0.44 ±  2%  perf-profile.self.cycles-pp.ksys_read
      0.21 ±  5%      +0.0        0.25        perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      0.16 ±  4%      +0.0        0.21 ±  2%  perf-profile.self.cycles-pp.rcu_idle_exit
      0.00            +0.1        0.05 ±  4%  perf-profile.self.cycles-pp.perf_exclude_event
      0.40 ±  6%      +0.1        0.46        perf-profile.self.cycles-pp.update_rq_clock
      0.22 ±  5%      +0.1        0.28 ±  2%  perf-profile.self.cycles-pp.switch_fpu_return
      0.21 ±  4%      +0.1        0.26 ±  7%  perf-profile.self.cycles-pp.__hrtimer_next_event_base
      0.21 ±  6%      +0.1        0.27 ±  3%  perf-profile.self.cycles-pp.anon_pipe_buf_release
      0.30 ±  8%      +0.1        0.36 ±  6%  perf-profile.self.cycles-pp.account_entity_enqueue
      0.27 ±  5%      +0.1        0.33 ±  3%  perf-profile.self.cycles-pp.rb_erase
      0.00 ±387%      +0.1        0.07 ±  9%  perf-profile.self.cycles-pp.sched_idle_set_state
      0.55 ±  8%      +0.1        0.61 ±  2%  perf-profile.self.cycles-pp.__fget_light
      0.00            +0.1        0.06 ±  7%  perf-profile.self.cycles-pp.cpu_latency_qos_limit
      0.30 ±  5%      +0.1        0.36 ±  2%  perf-profile.self.cycles-pp.exit_to_user_mode_prepare
      0.23 ±  4%      +0.1        0.29 ±  3%  perf-profile.self.cycles-pp.copy_page_to_iter
      0.37 ±  5%      +0.1        0.44 ±  2%  perf-profile.self.cycles-pp.write
      0.32 ±  2%      +0.1        0.39 ±  2%  perf-profile.self.cycles-pp.__rdgsbase_inactive
      0.31 ±  4%      +0.1        0.38 ±  2%  perf-profile.self.cycles-pp.dequeue_entity
      0.35 ±  5%      +0.1        0.42 ±  2%  perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.32 ±  5%      +0.1        0.40 ±  2%  perf-profile.self.cycles-pp.switch_mm_irqs_off
      0.79 ±  9%      +0.1        0.87 ±  3%  perf-profile.self.cycles-pp.common_file_perm
      0.31 ±  4%      +0.1        0.39 ±  2%  perf-profile.self.cycles-pp.read
      0.33 ±  4%      +0.1        0.42 ±  2%  perf-profile.self.cycles-pp._raw_spin_lock_irq
      0.49 ±  5%      +0.1        0.57        perf-profile.self.cycles-pp.pipe_write
      0.56 ±  6%      +0.1        0.66 ±  2%  perf-profile.self.cycles-pp.__calc_delta
      0.04 ± 48%      +0.1        0.14 ±  4%  perf-profile.self.cycles-pp.irq_work_needs_cpu
      0.40 ±  5%      +0.1        0.49 ±  2%  perf-profile.self.cycles-pp.copy_user_generic_unrolled
      0.42 ±  4%      +0.1        0.52        perf-profile.self.cycles-pp.mutex_unlock
      0.49 ±  5%      +0.1        0.60 ±  2%  perf-profile.self.cycles-pp.mutex_lock
      0.54 ±  3%      +0.1        0.65        perf-profile.self.cycles-pp.pick_next_task_fair
      0.39 ±  4%      +0.1        0.50 ±  2%  perf-profile.self.cycles-pp.__might_sleep
      0.38 ±  5%      +0.1        0.49 ±  3%  perf-profile.self.cycles-pp.pick_next_entity
      0.53 ±  6%      +0.1        0.64 ±  8%  perf-profile.self.cycles-pp.dequeue_task_fair
      0.54 ±  5%      +0.1        0.66        perf-profile.self.cycles-pp.new_sync_read
      0.74 ±  7%      +0.1        0.86 ±  2%  perf-profile.self.cycles-pp.enqueue_entity
      0.00            +0.1        0.12 ±  3%  perf-profile.self.cycles-pp.default_wake_function
      0.68 ±  8%      +0.1        0.80        perf-profile.self.cycles-pp.vfs_read
      2.22 ±  2%      +0.1        2.36 ±  2%  perf-profile.self.cycles-pp.__switch_to
      0.68 ±  5%      +0.1        0.81 ±  3%  perf-profile.self.cycles-pp.select_task_rq_fair
      0.22 ± 13%      +0.1        0.35 ± 18%  perf-profile.self.cycles-pp.native_irq_return_iret
      0.60 ±  4%      +0.2        0.75        perf-profile.self.cycles-pp.entry_SYSCALL_64
      0.66 ±  6%      +0.2        0.82 ±  4%  perf-profile.self.cycles-pp.reweight_entity
      0.59 ±  5%      +0.2        0.75 ±  2%  perf-profile.self.cycles-pp.set_next_entity
      0.61 ±  4%      +0.2        0.78        perf-profile.self.cycles-pp.prepare_to_wait_event
      0.89 ±  6%      +0.2        1.07        perf-profile.self.cycles-pp.pipe_read
      0.73 ±  2%      +0.2        0.91 ±  2%  perf-profile.self.cycles-pp._raw_spin_lock
      0.75 ±  4%      +0.2        0.94 ±  4%  perf-profile.self.cycles-pp.fsnotify
      0.74 ±  4%      +0.2        0.94 ±  2%  perf-profile.self.cycles-pp.___might_sleep
      2.67 ±  3%      +0.2        2.88        perf-profile.self.cycles-pp.__sched_text_start
      1.06 ±  5%      +0.2        1.29 ±  2%  perf-profile.self.cycles-pp.__update_load_avg_se
      0.92 ±  4%      +0.2        1.16 ±  2%  perf-profile.self.cycles-pp.syscall_return_via_sysret
      0.98 ±  6%      +0.3        1.23 ±  4%  perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
      0.79 ±  6%      +0.3        1.04 ±  3%  perf-profile.self.cycles-pp.finish_task_switch
      0.94 ±  7%      +0.3        1.19 ±  6%  perf-profile.self.cycles-pp.update_cfs_group
      1.10 ±  3%      +0.3        1.39        perf-profile.self.cycles-pp.native_sched_clock
      1.27 ±  3%      +0.3        1.56        perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
      1.39 ±  3%      +0.4        1.75        perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      1.78 ±  2%      +0.4        2.18        perf-profile.self.cycles-pp.__switch_to_asm
      0.94 ±  6%      +0.4        1.38 ±  5%  perf-profile.self.cycles-pp.timekeeping_max_deferment
      6.89 ±  8%      +1.3        8.21 ±  2%  perf-profile.self.cycles-pp.poll_idle
      4.77 ±  4%      +2.1        6.91 ±  6%  perf-profile.self.cycles-pp.ktime_get





Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Rong Chen


View attachment "config-5.9.0-rc3-00002-ge0830dbf71f191" of type "text/plain" (170215 bytes)

View attachment "job-script" of type "text/plain" (7665 bytes)

View attachment "job.yaml" of type "text/plain" (5025 bytes)

View attachment "reproduce" of type "text/plain" (347 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ