lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Date:   Thu, 20 Jan 2022 10:54:27 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Vincent Donnefort <vincent.donnefort@....com>
Cc:     Peter Zijlstra <peterz@...radead.org>,
        Vincent Guittot <vincent.guittot@...aro.org>,
        Valentin Schneider <valentin.schneider@....com>,
        LKML <linux-kernel@...r.kernel.org>, lkp@...ts.01.org,
        lkp@...el.com, ying.huang@...el.com, feng.tang@...el.com,
        zhengjun.xing@...ux.intel.com, fengwei.yin@...el.com,
        aubrey.li@...ux.intel.com, yu.c.chen@...el.com
Subject: [sched/fair]  8b4e74ccb5:  stress-ng.sem.ops_per_sec 12.0%
 improvement



Greeting,

FYI, we noticed a 12.0% improvement of stress-ng.sem.ops_per_sec due to commit:


commit: 8b4e74ccb582797f6f0b0a50372ebd9fd2372a27 ("sched/fair: Fix detection of per-CPU kthreads waking a task")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master

in testcase: stress-ng
on test machine: 96 threads 2 sockets Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 512G memory
with following parameters:

	nr_threads: 100%
	testtime: 60s
	sc_pid_max: 4194304
	class: scheduler
	test: sem
	cpufreq_governor: performance
	ucode: 0x5003102






Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        sudo bin/lkp install job.yaml           # job file is attached in this email
        bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
        sudo bin/lkp run generated-yaml-file

        # if come across any failure that blocks the test,
        # please remove ~/.lkp and /lkp dir to run from a clean state.

=========================================================================================
class/compiler/cpufreq_governor/kconfig/nr_threads/rootfs/sc_pid_max/tbox_group/test/testcase/testtime/ucode:
  scheduler/gcc-9/performance/x86_64-rhel-8.3/100%/debian-10.4-x86_64-20200603.cgz/4194304/lkp-csl-2sp7/sem/stress-ng/60s/0x5003102

commit: 
  8c92606ab8 ("sched/cpuacct: Make user/system times in cpuacct.stat more precise")
  8b4e74ccb5 ("sched/fair: Fix detection of per-CPU kthreads waking a task")

8c92606ab81086db 8b4e74ccb582797f6f0b0a50372 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
 4.467e+08           +12.0%  5.003e+08 ±  2%  stress-ng.sem.ops
   7445762           +12.0%    8337795 ±  2%  stress-ng.sem.ops_per_sec
  44238040 ±  3%     -41.7%   25806960 ±  6%  stress-ng.time.involuntary_context_switches
     19795           +14.1%      22585 ±  2%  stress-ng.time.minor_page_faults
      1114           +61.3%       1798 ±  4%  stress-ng.time.percent_of_cpu_this_job_got
    514.41 ±  2%     +43.5%     738.12 ±  3%  stress-ng.time.system_time
    177.69 ±  2%    +112.8%     378.12 ± 17%  stress-ng.time.user_time
 2.234e+08           +11.9%    2.5e+08 ±  2%  stress-ng.time.voluntary_context_switches
 1.344e+08           +64.3%  2.209e+08 ±  3%  cpuidle..usage
      6.74 ±  4%      +7.4       14.13 ±  8%  mpstat.cpu.all.irq%
      0.11 ±  6%      -0.0        0.10 ±  4%  mpstat.cpu.all.soft%
     23961 ±  6%     +14.9%      27543 ±  7%  meminfo.Active
     21572 ±  7%     +17.5%      25338 ±  7%  meminfo.Active(anon)
     34792 ±  4%     +13.6%      39509 ±  4%  meminfo.Shmem
     21170 ±  7%     +13.8%      24094 ±  8%  numa-meminfo.node1.Active
     20286 ±  8%     +17.4%      23826 ±  8%  numa-meminfo.node1.Active(anon)
     25568 ± 19%     +33.0%      34003 ± 12%  numa-meminfo.node1.Shmem
      5074 ±  8%     +16.7%       5924 ±  7%  numa-vmstat.node1.nr_active_anon
      6395 ± 19%     +32.7%       8489 ± 12%  numa-vmstat.node1.nr_shmem
      5074 ±  8%     +16.7%       5924 ±  7%  numa-vmstat.node1.nr_zone_active_anon
     18.14 ± 12%     +63.3%      29.62 ± 13%  vmstat.procs.r
   5829450 ±  3%     +22.4%    7135732 ±  4%  vmstat.system.cs
   1569944 ±  2%      -7.9%    1446325 ±  3%  vmstat.system.in
    856.00 ±  2%     +14.8%     982.38 ±  6%  turbostat.Avg_MHz
     30.83 ±  2%      +4.5       35.35 ±  6%  turbostat.Busy%
  54314337 ±  2%    +258.7%  1.948e+08 ±  3%  turbostat.C1
     20.89 ±  3%     +37.2       58.10 ±  4%  turbostat.C1%
  78271316           -73.8%   20522940 ±  6%  turbostat.C1E
     51.84 ±  3%     -33.5       18.33 ± 20%  turbostat.C1E%
    151.14            -3.0%     146.68        turbostat.RAMWatt
      5378 ±  8%     +17.8%       6335 ±  7%  proc-vmstat.nr_active_anon
     10448            +2.5%      10708        proc-vmstat.nr_mapped
      8686 ±  5%     +13.8%       9883 ±  4%  proc-vmstat.nr_shmem
      5378 ±  8%     +17.8%       6335 ±  7%  proc-vmstat.nr_zone_active_anon
      5980 ±  2%     +42.9%       8548 ±  6%  proc-vmstat.numa_hint_faults
      4552 ±  2%     +45.7%       6633 ±  7%  proc-vmstat.numa_hint_faults_local
    242021 ±  2%     +55.3%     375758 ±  8%  proc-vmstat.numa_pte_updates
     11361 ±  4%     +33.2%      15138 ±  4%  proc-vmstat.pgactivate
     15.52 ±  2%     +27.3%      19.76 ±  5%  perf-stat.i.MPKI
 8.682e+09 ±  3%      -8.4%  7.954e+09 ±  4%  perf-stat.i.branch-instructions
      2.00 ±  2%      -0.3        1.69 ±  3%  perf-stat.i.branch-miss-rate%
 1.742e+08 ±  2%     -23.7%  1.329e+08 ±  5%  perf-stat.i.branch-misses
      9.01 ± 13%      -6.3        2.75 ± 16%  perf-stat.i.cache-miss-rate%
  63223447 ± 16%     -73.9%   16490736 ± 30%  perf-stat.i.cache-misses
   6124406 ±  3%     +22.8%    7522839 ±  4%  perf-stat.i.context-switches
      1.95 ±  3%     +33.1%       2.59 ±  5%  perf-stat.i.cpi
 8.583e+10           +18.4%  1.016e+11 ±  6%  perf-stat.i.cpu-cycles
    777439 ±  3%    +212.1%    2426371 ±  4%  perf-stat.i.cpu-migrations
      1661 ±  9%    +290.2%       6484 ± 18%  perf-stat.i.cycles-between-cache-misses
      0.03 ± 18%      +0.1        0.08 ± 19%  perf-stat.i.dTLB-load-miss-rate%
   4643099 ±  6%    +122.7%   10338382 ± 17%  perf-stat.i.dTLB-load-misses
 1.401e+10 ±  2%     -18.1%  1.148e+10 ±  4%  perf-stat.i.dTLB-loads
      0.01 ± 10%      +0.0        0.03 ±  7%  perf-stat.i.dTLB-store-miss-rate%
   1004339 ±  3%    +127.6%    2285509 ±  6%  perf-stat.i.dTLB-store-misses
 7.573e+09 ±  3%      -7.5%  7.004e+09 ±  4%  perf-stat.i.dTLB-stores
  47522496 ±  3%     +22.5%   58208580 ±  5%  perf-stat.i.iTLB-load-misses
  80073958 ±  3%     +15.4%   92424903 ±  4%  perf-stat.i.iTLB-loads
 4.505e+10 ±  3%     -13.0%  3.918e+10 ±  4%  perf-stat.i.instructions
      1114 ±  7%     -21.0%     879.54 ±  6%  perf-stat.i.instructions-per-iTLB-miss
      0.52 ±  2%     -24.3%       0.40 ±  4%  perf-stat.i.ipc
      0.89           +18.4%       1.06 ±  6%  perf-stat.i.metric.GHz
      1442 ±  5%     -81.2%     270.89 ±  7%  perf-stat.i.metric.K/sec
    322.94 ±  2%     -11.8%     284.86 ±  4%  perf-stat.i.metric.M/sec
  37742898 ± 17%     -82.3%    6663637 ± 16%  perf-stat.i.node-load-misses
   1795169 ± 28%     -81.5%     332344 ± 41%  perf-stat.i.node-loads
   9826294 ± 16%     -54.8%    4439792 ± 13%  perf-stat.i.node-store-misses
     16.34 ±  3%     +28.2%      20.94 ±  2%  perf-stat.overall.MPKI
      2.01 ±  2%      -0.3        1.67        perf-stat.overall.branch-miss-rate%
      8.61 ± 17%      -6.6        1.99 ± 24%  perf-stat.overall.cache-miss-rate%
      1.91 ±  2%     +36.2%       2.60 ±  5%  perf-stat.overall.cpi
      1396 ± 17%    +365.9%       6504 ± 18%  perf-stat.overall.cycles-between-cache-misses
      0.03 ±  7%      +0.1        0.09 ± 18%  perf-stat.overall.dTLB-load-miss-rate%
      0.01 ±  4%      +0.0        0.03 ±  6%  perf-stat.overall.dTLB-store-miss-rate%
     37.24            +1.4       38.64        perf-stat.overall.iTLB-load-miss-rate%
    948.40           -29.0%     673.67 ±  3%  perf-stat.overall.instructions-per-iTLB-miss
      0.52 ±  2%     -26.4%       0.39 ±  5%  perf-stat.overall.ipc
 8.551e+09 ±  3%      -8.4%  7.834e+09 ±  4%  perf-stat.ps.branch-instructions
 1.716e+08 ±  2%     -23.7%   1.31e+08 ±  5%  perf-stat.ps.branch-misses
  62268255 ± 16%     -73.9%   16242861 ± 30%  perf-stat.ps.cache-misses
   6031679 ±  3%     +22.9%    7410005 ±  4%  perf-stat.ps.context-switches
 8.453e+10           +18.4%  1.001e+11 ±  6%  perf-stat.ps.cpu-cycles
    765671 ±  3%    +212.1%    2389979 ±  4%  perf-stat.ps.cpu-migrations
   4572862 ±  6%    +122.7%   10182919 ± 17%  perf-stat.ps.dTLB-load-misses
  1.38e+10 ±  2%     -18.1%  1.131e+10 ±  4%  perf-stat.ps.dTLB-loads
    989144 ±  3%    +127.6%    2251210 ±  6%  perf-stat.ps.dTLB-store-misses
 7.459e+09 ±  3%      -7.5%  6.899e+09 ±  4%  perf-stat.ps.dTLB-stores
  46803103 ±  3%     +22.5%   57335214 ±  5%  perf-stat.ps.iTLB-load-misses
  78861849 ±  3%     +15.4%   91038604 ±  4%  perf-stat.ps.iTLB-loads
 4.437e+10 ±  3%     -13.0%  3.859e+10 ±  4%  perf-stat.ps.instructions
  37172598 ± 17%     -82.3%    6563822 ± 16%  perf-stat.ps.node-load-misses
   1768067 ± 28%     -81.5%     327355 ± 41%  perf-stat.ps.node-loads
   9677815 ± 16%     -54.8%    4373330 ± 13%  perf-stat.ps.node-store-misses
 2.969e+12           -12.6%  2.596e+12 ±  2%  perf-stat.total.instructions
     21644 ±  7%     -24.9%      16265 ±  5%  softirqs.CPU0.SCHED
     18130 ±  5%     -31.1%      12498 ±  5%  softirqs.CPU1.SCHED
     16233 ± 14%     -32.3%      10986 ±  5%  softirqs.CPU10.SCHED
     16783 ±  6%     -33.3%      11197 ±  6%  softirqs.CPU11.SCHED
     17251 ±  7%     -34.8%      11249 ±  7%  softirqs.CPU12.SCHED
     17471 ±  8%     -35.1%      11336 ±  6%  softirqs.CPU13.SCHED
     16679 ±  5%     -33.1%      11152 ±  5%  softirqs.CPU14.SCHED
     16761 ±  6%     -35.4%      10824 ±  5%  softirqs.CPU15.SCHED
     17013 ±  7%     -34.3%      11183 ±  6%  softirqs.CPU16.SCHED
     16918 ±  9%     -33.5%      11253 ±  7%  softirqs.CPU17.SCHED
     16822 ±  9%     -33.8%      11140 ±  5%  softirqs.CPU18.SCHED
     16936 ±  4%     -35.0%      11016 ±  4%  softirqs.CPU19.SCHED
     17552 ±  7%     -33.6%      11659 ±  5%  softirqs.CPU2.SCHED
     16941 ±  6%     -34.3%      11138 ±  5%  softirqs.CPU20.SCHED
     16867 ±  5%     -34.7%      11007 ±  6%  softirqs.CPU21.SCHED
     16719 ±  6%     -34.6%      10928 ±  5%  softirqs.CPU22.SCHED
     16841 ±  6%     -33.4%      11213 ±  2%  softirqs.CPU23.SCHED
     16985 ±  4%     -35.5%      10959 ±  5%  softirqs.CPU24.SCHED
     16663 ±  6%     -36.0%      10657 ±  5%  softirqs.CPU25.SCHED
     16596 ±  5%     -35.1%      10772 ±  5%  softirqs.CPU26.SCHED
     16552 ±  5%     -35.2%      10721 ±  5%  softirqs.CPU27.SCHED
     16422 ±  3%     -34.5%      10754 ±  7%  softirqs.CPU28.SCHED
     16722 ±  5%     -33.5%      11124 ±  7%  softirqs.CPU29.SCHED
     17412 ±  7%     -33.6%      11565 ±  4%  softirqs.CPU3.SCHED
     16516 ±  3%     -35.9%      10582 ±  5%  softirqs.CPU30.SCHED
     16570 ±  5%     -36.3%      10548 ±  5%  softirqs.CPU31.SCHED
     16596 ±  4%     -35.6%      10696 ±  5%  softirqs.CPU32.SCHED
     16922 ±  6%     -36.6%      10731 ±  3%  softirqs.CPU33.SCHED
     16821 ±  4%     -36.8%      10638 ±  6%  softirqs.CPU34.SCHED
     16569 ±  4%     -34.1%      10914 ±  6%  softirqs.CPU35.SCHED
     16457 ±  4%     -34.8%      10735 ±  6%  softirqs.CPU36.SCHED
     16429 ±  5%     -34.5%      10754 ±  9%  softirqs.CPU37.SCHED
     16584 ±  5%     -34.6%      10851 ±  5%  softirqs.CPU38.SCHED
     16548 ±  5%     -35.2%      10731 ±  6%  softirqs.CPU39.SCHED
     17058 ±  7%     -34.9%      11110 ±  3%  softirqs.CPU4.SCHED
     16577 ±  4%     -34.0%      10940 ±  6%  softirqs.CPU40.SCHED
     16629 ±  4%     -34.6%      10880 ±  6%  softirqs.CPU41.SCHED
     16515 ±  4%     -35.7%      10626 ±  8%  softirqs.CPU42.SCHED
     16464 ±  5%     -35.1%      10691 ±  6%  softirqs.CPU43.SCHED
     16571 ±  5%     -35.4%      10711 ±  5%  softirqs.CPU44.SCHED
     17292 ±  5%     -37.6%      10796 ±  4%  softirqs.CPU45.SCHED
     16664 ±  5%     -35.4%      10759 ±  5%  softirqs.CPU46.SCHED
     16522 ±  5%     -34.4%      10836 ±  4%  softirqs.CPU47.SCHED
     16448 ±  6%     -35.5%      10616 ±  3%  softirqs.CPU48.SCHED
     16346 ±  7%     -36.4%      10394 ±  4%  softirqs.CPU49.SCHED
     16985 ±  5%     -35.3%      10989 ±  5%  softirqs.CPU5.SCHED
     16987 ±  5%     -35.5%      10956 ±  7%  softirqs.CPU50.SCHED
     16814 ±  6%     -35.0%      10934 ±  4%  softirqs.CPU51.SCHED
     17242 ±  9%     -35.7%      11094 ±  8%  softirqs.CPU52.SCHED
     17045 ±  7%     -35.5%      11001 ±  7%  softirqs.CPU53.SCHED
     16772 ±  5%     -34.8%      10941 ±  5%  softirqs.CPU54.SCHED
     16750 ±  5%     -34.9%      10900 ±  3%  softirqs.CPU55.SCHED
     16707 ±  6%     -32.9%      11213 ±  7%  softirqs.CPU56.SCHED
     16896 ±  6%     -34.5%      11067 ±  3%  softirqs.CPU57.SCHED
     16776 ±  5%     -31.8%      11443 ±  9%  softirqs.CPU58.SCHED
     16629 ±  7%     -32.8%      11180 ±  4%  softirqs.CPU59.SCHED
     17009 ±  7%     -33.5%      11314 ±  7%  softirqs.CPU6.SCHED
     17329 ±  6%     -36.6%      10989 ±  5%  softirqs.CPU60.SCHED
     16812 ±  9%     -33.4%      11190 ±  5%  softirqs.CPU61.SCHED
     16819 ±  6%     -34.1%      11091 ±  4%  softirqs.CPU62.SCHED
     17183 ± 10%     -34.1%      11332 ±  4%  softirqs.CPU63.SCHED
     16738 ±  7%     -32.3%      11338 ±  6%  softirqs.CPU64.SCHED
     16944 ±  7%     -34.6%      11076 ±  6%  softirqs.CPU65.SCHED
     16760 ±  7%     -33.1%      11216 ±  6%  softirqs.CPU66.SCHED
     16922 ±  7%     -36.2%      10797 ±  6%  softirqs.CPU67.SCHED
     16820 ±  6%     -33.9%      11113 ±  3%  softirqs.CPU68.SCHED
     16979 ±  7%     -33.3%      11320 ± 10%  softirqs.CPU69.SCHED
     17352 ± 11%     -37.4%      10865 ±  5%  softirqs.CPU7.SCHED
     17142 ±  6%     -32.3%      11611 ±  6%  softirqs.CPU70.SCHED
     17104 ±  8%     -35.0%      11112 ±  3%  softirqs.CPU71.SCHED
     16454 ±  6%     -35.2%      10667 ±  5%  softirqs.CPU73.SCHED
     16722 ±  5%     -33.4%      11140 ±  8%  softirqs.CPU74.SCHED
     16625 ±  5%     -36.8%      10510 ±  5%  softirqs.CPU75.SCHED
     16673 ±  4%     -35.2%      10803 ±  4%  softirqs.CPU76.SCHED
     16979 ±  8%     -36.2%      10841 ±  5%  softirqs.CPU77.SCHED
     16656 ±  4%     -35.9%      10685 ±  6%  softirqs.CPU78.SCHED
     16334 ±  5%     -35.2%      10579 ±  5%  softirqs.CPU79.SCHED
     16846 ±  6%     -32.4%      11380 ± 14%  softirqs.CPU8.SCHED
     16553 ±  5%     -34.2%      10886 ±  4%  softirqs.CPU80.SCHED
     16619 ±  4%     -34.5%      10885 ±  7%  softirqs.CPU81.SCHED
     16319 ±  5%     -33.8%      10811 ±  6%  softirqs.CPU82.SCHED
     16729 ±  3%     -34.6%      10939 ±  4%  softirqs.CPU83.SCHED
     16582 ±  5%     -35.4%      10708 ±  4%  softirqs.CPU84.SCHED
     16404 ±  6%     -34.6%      10729 ±  5%  softirqs.CPU85.SCHED
     16723 ±  4%     -35.4%      10804 ±  5%  softirqs.CPU86.SCHED
     16754 ±  6%     -35.9%      10732 ±  3%  softirqs.CPU87.SCHED
     16596 ±  3%     -33.1%      11104 ±  8%  softirqs.CPU88.SCHED
     16847 ±  4%     -35.2%      10918 ±  6%  softirqs.CPU89.SCHED
     17517 ±  7%     -38.3%      10800 ±  5%  softirqs.CPU9.SCHED
     16389 ±  4%     -35.9%      10502 ±  5%  softirqs.CPU90.SCHED
     16495 ±  5%     -34.7%      10772 ±  3%  softirqs.CPU91.SCHED
     16486 ±  5%     -35.2%      10689 ±  4%  softirqs.CPU92.SCHED
     16718 ±  5%     -35.6%      10769 ±  4%  softirqs.CPU93.SCHED
     16798 ±  6%     -36.4%      10677 ±  6%  softirqs.CPU94.SCHED
     16290 ±  6%     -33.9%      10763 ±  6%  softirqs.CPU95.SCHED
   1615774 ±  5%     -34.6%    1057271 ±  4%  softirqs.SCHED
     18.03 ±  8%     -17.3        0.70 ± 19%  perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.do_nanosleep.hrtimer_nanosleep
     17.66 ±  8%     -17.2        0.45 ± 61%  perf-profile.calltrace.cycles-pp.newidle_balance.pick_next_task_fair.__schedule.schedule.do_nanosleep
     30.78 ±  4%     -16.7       14.11        perf-profile.calltrace.cycles-pp.__x64_sys_nanosleep.do_syscall_64.entry_SYSCALL_64_after_hwframe.__nanosleep
     27.75 ±  5%     -16.6       11.11        perf-profile.calltrace.cycles-pp.schedule.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
     27.63 ±  5%     -16.6       11.03        perf-profile.calltrace.cycles-pp.__schedule.schedule.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep
     29.85 ±  4%     -16.6       13.28        perf-profile.calltrace.cycles-pp.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64.entry_SYSCALL_64_after_hwframe
     30.21 ±  4%     -16.6       13.64        perf-profile.calltrace.cycles-pp.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64.entry_SYSCALL_64_after_hwframe.__nanosleep
     32.01 ±  4%     -16.0       16.04 ±  3%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__nanosleep
     33.80 ±  3%     -16.0       17.83 ±  3%  perf-profile.calltrace.cycles-pp.__nanosleep
     31.75 ±  4%     -15.9       15.81 ±  3%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__nanosleep
     15.86 ±  9%     -15.8        0.07 ±264%  perf-profile.calltrace.cycles-pp.load_balance.newidle_balance.pick_next_task_fair.__schedule.schedule
     11.07 ±  9%     -11.1        0.00        perf-profile.calltrace.cycles-pp.find_busiest_group.load_balance.newidle_balance.pick_next_task_fair.__schedule
     10.84 ±  9%     -10.8        0.00        perf-profile.calltrace.cycles-pp.update_sd_lb_stats.find_busiest_group.load_balance.newidle_balance.pick_next_task_fair
      5.55 ±  7%      -5.4        0.15 ±173%  perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      3.42            -1.0        2.43        perf-profile.calltrace.cycles-pp.__x64_sys_sched_yield.do_syscall_64.entry_SYSCALL_64_after_hwframe.__sched_yield
      2.36 ±  2%      -0.4        1.97        perf-profile.calltrace.cycles-pp.schedule.__x64_sys_sched_yield.do_syscall_64.entry_SYSCALL_64_after_hwframe.__sched_yield
      2.30 ±  2%      -0.4        1.93        perf-profile.calltrace.cycles-pp.__schedule.schedule.__x64_sys_sched_yield.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.02 ±  5%      -0.2        0.82 ±  7%  perf-profile.calltrace.cycles-pp.sem_getvalue@@GLIBC_2.2.5
      1.45 ±  3%      -0.2        1.26 ±  3%  perf-profile.calltrace.cycles-pp.hrtimer_start_range_ns.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
      0.96 ±  4%      -0.1        0.84 ±  2%  perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.__x64_sys_sched_yield.do_syscall_64
      0.85 ±  5%      -0.1        0.74 ±  5%  perf-profile.calltrace.cycles-pp.semaphore_posix_thrash
      1.13 ±  5%      +0.3        1.39 ±  3%  perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      0.91 ±  5%      +0.3        1.19 ±  5%  perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__schedule.schedule_idle.do_idle.cpu_startup_entry
      0.64 ±  3%      +0.3        0.92 ±  2%  perf-profile.calltrace.cycles-pp.update_load_avg.dequeue_entity.dequeue_task_fair.__schedule.schedule
      1.06 ±  4%      +0.4        1.43        perf-profile.calltrace.cycles-pp.finish_task_switch.__schedule.schedule.do_nanosleep.hrtimer_nanosleep
      0.15 ±158%      +0.5        0.63 ±  2%  perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
      0.75 ±  4%      +0.5        1.27 ±  3%  perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__nanosleep
      0.72 ±  4%      +0.5        1.24 ±  3%  perf-profile.calltrace.cycles-pp.switch_fpu_return.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.34 ± 87%      +0.5        0.88 ±  6%  perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.finish_task_switch.__schedule.schedule_idle
      0.38 ± 63%      +0.5        0.93 ±  3%  perf-profile.calltrace.cycles-pp.restore_fpregs_from_fpstate.switch_fpu_return.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
      0.35 ± 87%      +0.5        0.90 ±  6%  perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.finish_task_switch.__schedule.schedule_idle.do_idle
      0.39 ± 87%      +0.6        0.95 ±  6%  perf-profile.calltrace.cycles-pp.finish_task_switch.__schedule.schedule_idle.do_idle.cpu_startup_entry
      0.00            +0.6        0.62 ±  5%  perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.finish_task_switch.__schedule.schedule
      0.00            +0.6        0.64 ±  5%  perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.finish_task_switch.__schedule.schedule.do_nanosleep
      0.00            +0.7        0.74 ±  4%  perf-profile.calltrace.cycles-pp.__switch_to_asm
      0.83 ±  4%      +0.7        1.58 ± 39%  perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__nanosleep
      0.00            +0.9        0.85 ±  8%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__schedule.schedule_idle.do_idle
      0.00            +0.9        0.91 ±  3%  perf-profile.calltrace.cycles-pp.select_idle_sibling.select_task_rq_fair.try_to_wake_up.hrtimer_wakeup.__hrtimer_run_queues
      0.15 ±158%      +0.9        1.08 ±  3%  perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.hrtimer_wakeup.__hrtimer_run_queues.hrtimer_interrupt
      0.00            +1.0        1.02 ±  7%  perf-profile.calltrace.cycles-pp._raw_spin_lock.__schedule.schedule_idle.do_idle.cpu_startup_entry
      0.24 ±115%      +1.2        1.48 ±  6%  perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.finish_task_switch
      0.24 ±115%      +1.2        1.49 ±  5%  perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.finish_task_switch.__schedule
      0.00            +1.3        1.31 ±  2%  perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.poll_idle
      0.00            +1.3        1.32 ±  2%  perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.poll_idle.cpuidle_enter_state
      5.26 ±  2%      +1.3        6.58 ±  3%  perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.do_nanosleep.hrtimer_nanosleep
      0.00            +1.3        1.35 ±  2%  perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.poll_idle.cpuidle_enter_state.cpuidle_enter
      0.00            +1.4        1.38 ±  2%  perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.poll_idle.cpuidle_enter_state.cpuidle_enter.do_idle
      0.00            +1.4        1.44 ±  7%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.try_to_wake_up.hrtimer_wakeup.__hrtimer_run_queues
      0.00            +1.5        1.50 ±  2%  perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      0.07 ±244%      +1.6        1.68 ±  6%  perf-profile.calltrace.cycles-pp._raw_spin_lock.try_to_wake_up.hrtimer_wakeup.__hrtimer_run_queues.hrtimer_interrupt
      0.80 ±  4%      +1.7        2.47 ±  2%  perf-profile.calltrace.cycles-pp.update_load_avg.set_next_entity.pick_next_task_fair.__schedule.schedule_idle
      1.19 ±  6%      +1.7        2.90 ±  5%  perf-profile.calltrace.cycles-pp.update_cfs_group.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up
      1.07 ±  3%      +2.0        3.07        perf-profile.calltrace.cycles-pp.set_next_entity.pick_next_task_fair.__schedule.schedule_idle.do_idle
      1.73 ±  7%      +2.0        3.77 ±  6%  perf-profile.calltrace.cycles-pp.update_cfs_group.dequeue_entity.dequeue_task_fair.__schedule.schedule
      1.26 ±  3%      +2.1        3.37        perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule_idle.do_idle.cpu_startup_entry
      0.67 ±  2%      +2.2        2.90 ±  3%  perf-profile.calltrace.cycles-pp.update_load_avg.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up
      3.53 ±  3%      +2.3        5.84 ±  3%  perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.do_nanosleep
      0.00            +2.4        2.37 ±  7%  perf-profile.calltrace.cycles-pp.set_task_cpu.try_to_wake_up.hrtimer_wakeup.__hrtimer_run_queues.hrtimer_interrupt
      4.87 ±  2%      +3.5        8.36 ±  3%  perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.hrtimer_wakeup.__hrtimer_run_queues.hrtimer_interrupt
      4.82 ±  2%      +3.5        8.32 ±  3%  perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.hrtimer_wakeup.__hrtimer_run_queues
      3.29 ±  2%      +3.9        7.22 ±  2%  perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.hrtimer_wakeup
      4.36 ±  3%      +4.0        8.35        perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
      4.43 ±  4%      +4.0        8.42        perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      9.17 ±  3%      +8.4       17.56 ±  2%  perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      8.37 ±  3%      +8.6       16.93 ±  3%  perf-profile.calltrace.cycles-pp.hrtimer_wakeup.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
      8.30 ±  3%      +8.6       16.87 ±  3%  perf-profile.calltrace.cycles-pp.try_to_wake_up.hrtimer_wakeup.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
     34.81 ±  2%      +9.5       44.26        perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      5.24           +10.2       15.42 ±  2%  perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.intel_idle
      5.28           +10.2       15.48 ±  2%  perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.intel_idle.cpuidle_enter_state
      5.63           +10.3       15.95 ±  2%  perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.intel_idle.cpuidle_enter_state.cpuidle_enter
     49.71           +11.7       61.43        perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     49.29           +12.1       61.38        perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
     56.41           +16.5       72.91        perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     56.45           +16.5       72.96        perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     56.46           +16.5       72.99        perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     57.04           +16.6       73.67        perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
     21.90 ±  2%     +23.6       45.54        perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle
     17.67 ±  8%     -17.1        0.55 ± 24%  perf-profile.children.cycles-pp.newidle_balance
     30.12 ±  5%     -17.0       13.09        perf-profile.children.cycles-pp.schedule
     35.92 ±  3%     -16.9       19.05 ±  6%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     35.57 ±  3%     -16.8       18.76 ±  6%  perf-profile.children.cycles-pp.do_syscall_64
     30.79 ±  4%     -16.7       14.12        perf-profile.children.cycles-pp.__x64_sys_nanosleep
     29.87 ±  4%     -16.6       13.29        perf-profile.children.cycles-pp.do_nanosleep
     30.22 ±  4%     -16.6       13.64        perf-profile.children.cycles-pp.hrtimer_nanosleep
     33.93 ±  3%     -16.0       17.95 ±  3%  perf-profile.children.cycles-pp.__nanosleep
     15.94 ±  9%     -15.5        0.42 ± 26%  perf-profile.children.cycles-pp.load_balance
     20.33 ±  7%     -15.3        4.99 ±  2%  perf-profile.children.cycles-pp.pick_next_task_fair
     34.42 ±  4%     -13.0       21.45        perf-profile.children.cycles-pp.__schedule
     11.12 ±  9%     -10.9        0.27 ± 31%  perf-profile.children.cycles-pp.find_busiest_group
     10.93 ±  9%     -10.7        0.26 ± 30%  perf-profile.children.cycles-pp.update_sd_lb_stats
      2.33 ± 17%      -2.3        0.06 ±  9%  perf-profile.children.cycles-pp.raw_spin_rq_lock_nested
      1.54 ± 12%      -1.5        0.05 ± 40%  perf-profile.children.cycles-pp.idle_cpu
      5.40 ±  8%      -1.2        4.21 ±  5%  perf-profile.children.cycles-pp._raw_spin_lock
      3.42            -1.0        2.43        perf-profile.children.cycles-pp.__x64_sys_sched_yield
      1.09 ±  8%      -1.0        0.13 ± 11%  perf-profile.children.cycles-pp.update_blocked_averages
      0.81 ±  8%      -0.7        0.11 ±  6%  perf-profile.children.cycles-pp._find_next_bit
      1.00 ±  3%      -0.6        0.41 ±  3%  perf-profile.children.cycles-pp.do_sched_yield
      0.92 ±  4%      -0.4        0.50 ±  3%  perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
      1.03 ±  5%      -0.3        0.72 ±  3%  perf-profile.children.cycles-pp.clockevents_program_event
      1.72 ±  5%      -0.3        1.46 ±  4%  perf-profile.children.cycles-pp.switch_mm_irqs_off
      0.90 ±  3%      -0.2        0.66 ±  4%  perf-profile.children.cycles-pp.sched_clock_cpu
      0.33 ±  4%      -0.2        0.11 ±  8%  perf-profile.children.cycles-pp.yield_task_fair
      0.75 ±  4%      -0.2        0.54 ±  3%  perf-profile.children.cycles-pp.lapic_next_deadline
      1.31 ±  2%      -0.2        1.10 ±  4%  perf-profile.children.cycles-pp.update_rq_clock
      1.02 ±  4%      -0.2        0.82 ±  7%  perf-profile.children.cycles-pp.sem_getvalue@@GLIBC_2.2.5
      1.46 ±  3%      -0.2        1.27 ±  3%  perf-profile.children.cycles-pp.hrtimer_start_range_ns
      0.78 ±  3%      -0.2        0.58 ±  4%  perf-profile.children.cycles-pp.native_sched_clock
      0.48 ±  4%      -0.2        0.30 ±  3%  perf-profile.children.cycles-pp.reweight_entity
      0.65 ±  6%      -0.1        0.52 ±  4%  perf-profile.children.cycles-pp.ktime_get
      0.27 ±  4%      -0.1        0.14 ±  6%  perf-profile.children.cycles-pp.irq_enter_rcu
      0.42 ±  4%      -0.1        0.29 ±  2%  perf-profile.children.cycles-pp.migrate_task_rq_fair
      0.23 ±  7%      -0.1        0.11 ±  6%  perf-profile.children.cycles-pp.place_entity
      0.92 ±  4%      -0.1        0.80 ±  4%  perf-profile.children.cycles-pp.semaphore_posix_thrash
      0.38 ±  6%      -0.1        0.27 ±  5%  perf-profile.children.cycles-pp.irq_exit_rcu
      0.23 ±  4%      -0.1        0.12 ±  6%  perf-profile.children.cycles-pp.tick_irq_enter
      0.59 ±  3%      -0.1        0.49 ±  4%  perf-profile.children.cycles-pp.__update_load_avg_se
      0.37 ±  3%      -0.1        0.28 ±  3%  perf-profile.children.cycles-pp.native_irq_return_iret
      0.18 ±  3%      -0.1        0.10 ±  7%  perf-profile.children.cycles-pp.update_irq_load_avg
      0.81 ±  5%      -0.1        0.72 ±  4%  perf-profile.children.cycles-pp.load_new_mm_cr3
      0.42 ±  5%      -0.1        0.35 ±  4%  perf-profile.children.cycles-pp.read_tsc
      0.37 ±  5%      -0.1        0.30 ±  4%  perf-profile.children.cycles-pp.save_fpregs_to_fpstate
      0.34 ±  4%      -0.1        0.27 ±  4%  perf-profile.children.cycles-pp.pick_next_entity
      0.21 ±  9%      -0.1        0.15 ±  5%  perf-profile.children.cycles-pp.__softirqentry_text_start
      0.19 ±  4%      -0.1        0.13 ±  4%  perf-profile.children.cycles-pp.put_prev_entity
      0.25 ±  2%      -0.1        0.20 ±  4%  perf-profile.children.cycles-pp.tick_sched_timer
      0.11 ±  3%      -0.1        0.06 ±  9%  perf-profile.children.cycles-pp.rebalance_domains
      0.19 ±  2%      -0.1        0.14 ±  2%  perf-profile.children.cycles-pp.irqtime_account_irq
      0.10 ±  6%      -0.1        0.04 ± 38%  perf-profile.children.cycles-pp.clear_buddies
      0.48 ±  3%      -0.1        0.43 ±  4%  perf-profile.children.cycles-pp.sem_post@@GLIBC_2.2.5
      0.23 ±  3%      -0.1        0.18 ±  6%  perf-profile.children.cycles-pp.tick_sched_handle
      0.41 ±  6%      -0.0        0.36 ±  2%  perf-profile.children.cycles-pp.syscall_return_via_sysret
      0.23 ±  4%      -0.0        0.18 ±  6%  perf-profile.children.cycles-pp.update_process_times
      0.26 ±  7%      -0.0        0.22 ±  4%  perf-profile.children.cycles-pp.__calc_delta
      0.09 ± 11%      -0.0        0.04 ± 37%  perf-profile.children.cycles-pp.__list_add_valid
      0.40 ±  5%      -0.0        0.35 ±  3%  perf-profile.children.cycles-pp.get_timespec64
      0.09 ± 17%      -0.0        0.05 ± 38%  perf-profile.children.cycles-pp.perf_trace_buf_alloc
      0.13 ±  4%      -0.0        0.09        perf-profile.children.cycles-pp.scheduler_tick
      0.34 ±  5%      -0.0        0.30 ±  3%  perf-profile.children.cycles-pp._copy_from_user
      0.07 ± 10%      -0.0        0.04 ± 57%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode_prepare
      0.15 ±  5%      -0.0        0.12 ±  4%  perf-profile.children.cycles-pp.__might_fault
      0.15 ±  6%      -0.0        0.13 ±  6%  perf-profile.children.cycles-pp.rb_erase
      0.09 ±  7%      -0.0        0.07 ±  6%  perf-profile.children.cycles-pp.ktime_get_update_offsets_now
      0.11 ±  4%      -0.0        0.08 ± 10%  perf-profile.children.cycles-pp.__list_del_entry_valid
      0.13 ±  7%      -0.0        0.10 ±  7%  perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime
      0.10 ±  5%      -0.0        0.08 ±  5%  perf-profile.children.cycles-pp.__enqueue_entity
      0.08            -0.0        0.06 ±  6%  perf-profile.children.cycles-pp.hrtimer_update_next_event
      0.09 ±  5%      -0.0        0.07 ±  5%  perf-profile.children.cycles-pp.perf_trace_buf_update
      0.07 ±  6%      +0.0        0.08 ±  5%  perf-profile.children.cycles-pp.irqentry_exit
      0.08 ±  6%      +0.0        0.09 ±  5%  perf-profile.children.cycles-pp.put_prev_task_fair
      0.06 ±  7%      +0.0        0.08 ±  5%  perf-profile.children.cycles-pp.hrtimer_reprogram
      0.09 ±  5%      +0.0        0.11 ±  8%  perf-profile.children.cycles-pp.syscall_enter_from_user_mode
      0.09 ±  5%      +0.0        0.12 ±  7%  perf-profile.children.cycles-pp.rcu_eqs_exit
      0.12 ±  8%      +0.0        0.15 ±  3%  perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
      0.09 ±  3%      +0.0        0.12 ±  5%  perf-profile.children.cycles-pp.hrtimer_get_next_event
      0.12 ±  7%      +0.0        0.15 ±  6%  perf-profile.children.cycles-pp.hrtimer_next_event_without
      0.07 ±  6%      +0.0        0.11 ±  4%  perf-profile.children.cycles-pp.call_cpuidle
      0.01 ±158%      +0.0        0.06 ±  7%  perf-profile.children.cycles-pp.switch_ldt
      0.28 ±  6%      +0.0        0.33 ±  4%  perf-profile.children.cycles-pp.enqueue_hrtimer
      0.25 ±  5%      +0.0        0.30 ±  4%  perf-profile.children.cycles-pp.timerqueue_add
      0.14 ±  5%      +0.0        0.19 ±  5%  perf-profile.children.cycles-pp.rcu_idle_exit
      0.11 ±  4%      +0.1        0.17 ±  5%  perf-profile.children.cycles-pp.rcu_dynticks_inc
      0.16 ±  6%      +0.1        0.22 ±  2%  perf-profile.children.cycles-pp.tick_nohz_idle_enter
      0.00            +0.1        0.05 ±  9%  perf-profile.children.cycles-pp.rcu_needs_cpu
      0.19 ±  6%      +0.1        0.25 ±  3%  perf-profile.children.cycles-pp.get_next_timer_interrupt
      0.00            +0.1        0.06 ±  5%  perf-profile.children.cycles-pp.irq_work_needs_cpu
      0.00            +0.1        0.06 ± 10%  perf-profile.children.cycles-pp.menu_reflect
      0.01 ±244%      +0.1        0.08 ±  7%  perf-profile.children.cycles-pp.cpumask_next
      0.08 ±  5%      +0.1        0.19 ±  3%  perf-profile.children.cycles-pp.remove_entity_load_avg
      0.13            +0.1        0.24 ±  5%  perf-profile.children.cycles-pp.update_ts_time_stats
      0.32 ±  5%      +0.1        0.44 ±  2%  perf-profile.children.cycles-pp.tick_nohz_next_event
      0.06 ±  7%      +0.1        0.17 ±  4%  perf-profile.children.cycles-pp.attach_entity_load_avg
      0.12 ±  2%      +0.1        0.24 ±  4%  perf-profile.children.cycles-pp.nr_iowait_cpu
      0.08 ± 12%      +0.1        0.22 ±  5%  perf-profile.children.cycles-pp.cpus_share_cache
      0.31 ±  6%      +0.1        0.44 ±  8%  perf-profile.children.cycles-pp.shim_nanosleep_uint64
      0.29 ±  4%      +0.2        0.44 ±  3%  perf-profile.children.cycles-pp.check_preempt_curr
      0.39 ±  6%      +0.2        0.55 ±  3%  perf-profile.children.cycles-pp.available_idle_cpu
      0.48 ±  6%      +0.2        0.64 ±  2%  perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
      0.17 ±  5%      +0.2        0.35 ±  3%  perf-profile.children.cycles-pp.resched_curr
      0.28 ±  5%      +0.2        0.47 ±  3%  perf-profile.children.cycles-pp.ttwu_do_wakeup
      0.13 ±  6%      +0.2        0.36 ±  3%  perf-profile.children.cycles-pp.tick_nohz_idle_exit
      0.13 ±  3%      +0.2        0.37 ±  4%  perf-profile.children.cycles-pp.hrtimer_active
      0.14 ±  5%      +0.2        0.38 ±  3%  perf-profile.children.cycles-pp.hrtimer_try_to_cancel
      1.14 ±  5%      +0.3        1.41 ±  3%  perf-profile.children.cycles-pp.menu_select
      0.93 ±  4%      +0.3        1.21 ±  3%  perf-profile.children.cycles-pp.__switch_to_asm
      0.63 ±  3%      +0.3        0.92 ±  4%  perf-profile.children.cycles-pp._raw_spin_lock_irqsave
      0.39 ±  9%      +0.3        0.72 ±  5%  perf-profile.children.cycles-pp.select_idle_cpu
      0.83 ±  4%      +0.3        1.17 ±  3%  perf-profile.children.cycles-pp.__switch_to
      0.59 ±  4%      +0.4        0.96 ±  3%  perf-profile.children.cycles-pp.restore_fpregs_from_fpstate
      1.01 ±  7%      +0.4        1.43 ±  2%  perf-profile.children.cycles-pp.select_task_rq_fair
      0.90 ±  3%      +0.4        1.35 ±  3%  perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      0.83 ±  4%      +0.5        1.28 ±  3%  perf-profile.children.cycles-pp.switch_fpu_return
      0.75 ±  8%      +0.5        1.22 ±  2%  perf-profile.children.cycles-pp.select_idle_sibling
      1.75 ± 10%      +0.8        2.53 ±  2%  perf-profile.children.cycles-pp.finish_task_switch
      5.74 ±  2%      +0.9        6.62 ±  3%  perf-profile.children.cycles-pp.dequeue_task_fair
      1.02 ±  4%      +0.9        1.91 ± 64%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      0.36 ± 16%      +1.2        1.55 ±  2%  perf-profile.children.cycles-pp.poll_idle
      1.33 ±  3%      +1.9        3.21        perf-profile.children.cycles-pp.set_next_entity
      1.09 ±  6%      +2.1        3.20 ±  7%  perf-profile.children.cycles-pp.set_task_cpu
      3.73 ±  2%      +2.2        5.88 ±  3%  perf-profile.children.cycles-pp.dequeue_entity
      5.35 ±  7%      +3.2        8.57 ±  6%  perf-profile.children.cycles-pp.update_cfs_group
      3.93 ±  2%      +3.7        7.61 ±  2%  perf-profile.children.cycles-pp.update_load_avg
      6.11 ±  2%      +3.8        9.90 ±  3%  perf-profile.children.cycles-pp.enqueue_task_fair
      4.48 ±  4%      +4.0        8.50        perf-profile.children.cycles-pp.schedule_idle
      4.41 ±  3%      +4.3        8.69 ±  3%  perf-profile.children.cycles-pp.enqueue_entity
      5.56 ±  2%      +4.3        9.90 ±  3%  perf-profile.children.cycles-pp.ttwu_do_activate
     12.47            +8.2       20.66 ±  2%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
     11.62            +8.5       20.08 ±  2%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
     11.52            +8.5       20.01 ±  2%  perf-profile.children.cycles-pp.hrtimer_interrupt
     10.54            +8.7       19.28 ±  3%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      9.76            +8.8       18.58 ±  3%  perf-profile.children.cycles-pp.hrtimer_wakeup
      9.70            +8.8       18.54 ±  3%  perf-profile.children.cycles-pp.try_to_wake_up
     50.22           +11.8       62.01        perf-profile.children.cycles-pp.cpuidle_enter
     50.19           +11.8       61.99        perf-profile.children.cycles-pp.cpuidle_enter_state
     21.23           +14.6       35.80        perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
     43.34 ±  2%     +15.9       59.29        perf-profile.children.cycles-pp.intel_idle
     56.46           +16.5       72.99        perf-profile.children.cycles-pp.start_secondary
     57.01           +16.6       73.63        perf-profile.children.cycles-pp.do_idle
     57.04           +16.6       73.67        perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     57.04           +16.6       73.67        perf-profile.children.cycles-pp.cpu_startup_entry
      8.53 ±  9%      -8.3        0.20 ± 31%  perf-profile.self.cycles-pp.update_sd_lb_stats
      1.51 ± 12%      -1.5        0.05 ± 40%  perf-profile.self.cycles-pp.idle_cpu
      2.05 ±  4%      -0.6        1.40        perf-profile.self.cycles-pp._raw_spin_lock
      0.74 ±  8%      -0.6        0.10 ±  9%  perf-profile.self.cycles-pp._find_next_bit
      0.63 ±  5%      -0.4        0.18 ±  6%  perf-profile.self.cycles-pp.cpuidle_enter_state
      0.46 ± 21%      -0.4        0.04 ± 81%  perf-profile.self.cycles-pp.update_blocked_averages
      0.84 ±  4%      -0.4        0.48 ±  2%  perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
      0.38 ± 11%      -0.3        0.11 ±  5%  perf-profile.self.cycles-pp.newidle_balance
      0.41 ± 10%      -0.2        0.19 ±  4%  perf-profile.self.cycles-pp.dequeue_task_fair
      0.88 ±  5%      -0.2        0.66 ±  7%  perf-profile.self.cycles-pp.sem_getvalue@@GLIBC_2.2.5
      0.75 ±  4%      -0.2        0.54 ±  3%  perf-profile.self.cycles-pp.lapic_next_deadline
      0.75 ±  3%      -0.2        0.56 ±  3%  perf-profile.self.cycles-pp.native_sched_clock
      0.90 ±  5%      -0.2        0.73 ±  4%  perf-profile.self.cycles-pp.switch_mm_irqs_off
      0.86 ±  5%      -0.1        0.71 ±  5%  perf-profile.self.cycles-pp.semaphore_posix_thrash
      0.58 ±  9%      -0.1        0.44 ±  3%  perf-profile.self.cycles-pp.enqueue_task_fair
      0.41 ±  3%      -0.1        0.27 ±  3%  perf-profile.self.cycles-pp.reweight_entity
      0.58 ±  2%      -0.1        0.48 ±  4%  perf-profile.self.cycles-pp.__update_load_avg_se
      0.37 ±  2%      -0.1        0.28 ±  3%  perf-profile.self.cycles-pp.native_irq_return_iret
      0.18 ±  4%      -0.1        0.09 ±  4%  perf-profile.self.cycles-pp.update_irq_load_avg
      0.81 ±  5%      -0.1        0.72 ±  4%  perf-profile.self.cycles-pp.load_new_mm_cr3
      0.42 ±  4%      -0.1        0.34 ±  5%  perf-profile.self.cycles-pp.read_tsc
      0.37 ±  4%      -0.1        0.30 ±  4%  perf-profile.self.cycles-pp.save_fpregs_to_fpstate
      0.16 ±  7%      -0.1        0.09 ±  6%  perf-profile.self.cycles-pp.place_entity
      0.27 ± 10%      -0.1        0.20 ±  5%  perf-profile.self.cycles-pp.ktime_get
      0.44 ±  4%      -0.1        0.37 ±  4%  perf-profile.self.cycles-pp.sem_post@@GLIBC_2.2.5
      0.18 ±  6%      -0.1        0.12 ±  4%  perf-profile.self.cycles-pp.__x64_sys_nanosleep
      0.08 ± 10%      -0.1        0.02 ±100%  perf-profile.self.cycles-pp.__list_add_valid
      0.56 ±  3%      -0.1        0.50 ±  4%  perf-profile.self.cycles-pp.enqueue_entity
      0.35 ±  5%      -0.1        0.30 ±  5%  perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.40 ±  6%      -0.1        0.35 ±  3%  perf-profile.self.cycles-pp.syscall_return_via_sysret
      0.13 ±  7%      -0.1        0.08 ±  8%  perf-profile.self.cycles-pp.schedule
      0.30 ±  4%      -0.0        0.25 ±  4%  perf-profile.self.cycles-pp.pick_next_entity
      0.11 ±  4%      -0.0        0.06 ± 10%  perf-profile.self.cycles-pp.sched_clock_cpu
      0.11 ± 18%      -0.0        0.06 ± 10%  perf-profile.self.cycles-pp.hrtimer_interrupt
      0.31 ±  4%      -0.0        0.27 ±  4%  perf-profile.self.cycles-pp.pick_next_task_fair
      0.26 ±  8%      -0.0        0.21 ±  3%  perf-profile.self.cycles-pp.__calc_delta
      0.25 ±  4%      -0.0        0.21 ±  5%  perf-profile.self.cycles-pp.select_task_rq_fair
      0.19 ±  6%      -0.0        0.16 ±  4%  perf-profile.self.cycles-pp.__sched_yield
      0.07 ±  4%      -0.0        0.04 ± 57%  perf-profile.self.cycles-pp.irqtime_account_irq
      0.12 ±  7%      -0.0        0.10 ±  7%  perf-profile.self.cycles-pp.perf_trace_sched_stat_runtime
      0.09 ±  7%      -0.0        0.07 ±  7%  perf-profile.self.cycles-pp.__enqueue_entity
      0.07 ±  7%      -0.0        0.04 ± 37%  perf-profile.self.cycles-pp.clockevents_program_event
      0.10 ±  4%      -0.0        0.08 ±  8%  perf-profile.self.cycles-pp.__list_del_entry_valid
      0.06 ±  5%      -0.0        0.04 ± 37%  perf-profile.self.cycles-pp.get_timespec64
      0.09 ±  8%      -0.0        0.07 ±  5%  perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
      0.08 ±  6%      -0.0        0.06 ±  7%  perf-profile.self.cycles-pp.put_prev_entity
      0.06 ±  7%      +0.0        0.08 ±  7%  perf-profile.self.cycles-pp.hrtimer_reprogram
      0.09 ± 12%      +0.0        0.12 ±  5%  perf-profile.self.cycles-pp.select_idle_sibling
      0.07 ±  8%      +0.0        0.10 ±  4%  perf-profile.self.cycles-pp.call_cpuidle
      0.17 ±  4%      +0.0        0.21 ±  4%  perf-profile.self.cycles-pp.timerqueue_add
      0.01 ±158%      +0.0        0.06 ±  9%  perf-profile.self.cycles-pp.switch_ldt
      0.11 ±  6%      +0.1        0.16 ±  6%  perf-profile.self.cycles-pp.rcu_dynticks_inc
      0.00            +0.1        0.05        perf-profile.self.cycles-pp.tick_nohz_idle_exit
      0.01 ±244%      +0.1        0.06 ±  7%  perf-profile.self.cycles-pp.rcu_idle_exit
      0.00            +0.1        0.05 ±  9%  perf-profile.self.cycles-pp.irq_work_needs_cpu
      0.11 ±  8%      +0.1        0.17 ±  6%  perf-profile.self.cycles-pp.select_idle_cpu
      0.00            +0.1        0.08 ±  9%  perf-profile.self.cycles-pp.migrate_task_rq_fair
      0.22 ±  5%      +0.1        0.32 ±  4%  perf-profile.self.cycles-pp.switch_fpu_return
      0.06 ± 16%      +0.1        0.16 ±  5%  perf-profile.self.cycles-pp.poll_idle
      0.49 ±  5%      +0.1        0.59 ±  5%  perf-profile.self.cycles-pp.menu_select
      0.29 ±  5%      +0.1        0.41 ±  8%  perf-profile.self.cycles-pp.shim_nanosleep_uint64
      0.06 ±  7%      +0.1        0.17 ±  3%  perf-profile.self.cycles-pp.attach_entity_load_avg
      0.12 ±  4%      +0.1        0.24 ±  6%  perf-profile.self.cycles-pp.nr_iowait_cpu
      0.08 ± 13%      +0.1        0.22 ±  5%  perf-profile.self.cycles-pp.cpus_share_cache
      0.41 ±  5%      +0.1        0.55 ±  4%  perf-profile.self.cycles-pp.do_idle
      0.39 ±  7%      +0.2        0.55 ±  2%  perf-profile.self.cycles-pp.available_idle_cpu
      0.16 ±  5%      +0.2        0.34 ±  3%  perf-profile.self.cycles-pp.resched_curr
      0.12 ±  5%      +0.2        0.33 ±  4%  perf-profile.self.cycles-pp.hrtimer_active
      0.25 ±  6%      +0.3        0.52 ±  4%  perf-profile.self.cycles-pp.set_next_entity
      0.93 ±  4%      +0.3        1.20 ±  3%  perf-profile.self.cycles-pp.__switch_to_asm
      0.62 ±  3%      +0.3        0.91 ±  4%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.81 ±  4%      +0.3        1.16 ±  3%  perf-profile.self.cycles-pp.__switch_to
      0.59 ±  4%      +0.4        0.96 ±  3%  perf-profile.self.cycles-pp.restore_fpregs_from_fpstate
      0.66 ±  7%      +2.2        2.88 ±  8%  perf-profile.self.cycles-pp.set_task_cpu
      5.34 ±  7%      +3.2        8.56 ±  6%  perf-profile.self.cycles-pp.update_cfs_group
      2.42 ±  3%      +3.6        5.99 ±  3%  perf-profile.self.cycles-pp.update_load_avg
     37.45 ±  2%      +5.4       42.82 ±  2%  perf-profile.self.cycles-pp.intel_idle




Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


---
0DAY/LKP+ Test Infrastructure                   Open Source Technology Center
https://lists.01.org/hyperkitty/list/lkp@lists.01.org       Intel Corporation

Thanks,
Oliver Sang


View attachment "config-5.16.0-rc1-00009-g8b4e74ccb582" of type "text/plain" (173314 bytes)

View attachment "job-script" of type "text/plain" (8265 bytes)

View attachment "job.yaml" of type "text/plain" (5590 bytes)

View attachment "reproduce" of type "text/plain" (380 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ