lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Date:   Thu, 21 Oct 2021 22:21:41 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Dave Hansen <dave.hansen@...ux.intel.com>
Cc:     Linus Torvalds <torvalds@...ux-foundation.org>,
        kernel test robot <oliver.sang@...el.com>,
        David Hildenbrand <david@...hat.com>,
        "Huang, Ying" <ying.huang@...el.com>,
        Michal Hocko <mhocko@...e.com>, Wei Xu <weixugc@...gle.com>,
        Oscar Salvador <osalvador@...e.de>,
        David Rientjes <rientjes@...gle.com>,
        Dan Williams <dan.j.williams@...el.com>,
        Greg Thelen <gthelen@...gle.com>,
        Yang Shi <yang.shi@...ux.alibaba.com>,
        Andrew Morton <akpm@...ux-foundation.org>,
        LKML <linux-kernel@...r.kernel.org>, lkp@...ts.01.org,
        lkp@...el.com, feng.tang@...el.com, zhengjun.xing@...ux.intel.com
Subject: [mm/migrate]  295be91f7e:  stress-ng.memhotplug.ops_per_sec 151.7%
 improvement



Greeting,

FYI, we noticed a 151.7% improvement of stress-ng.memhotplug.ops_per_sec due to commit:


commit: 295be91f7ef0027fca2f2e4788e99731aa931834 ("mm/migrate: optimize hotplug-time demotion order updates")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master


in testcase: stress-ng
on test machine: 96 threads 2 sockets Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory
with following parameters:

	nr_threads: 10%
	disk: 1HDD
	testtime: 60s
	fs: ext4
	class: os
	test: memhotplug
	cpufreq_governor: performance
	ucode: 0x5003006






Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        sudo bin/lkp install job.yaml           # job file is attached in this email
        bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
        sudo bin/lkp run generated-yaml-file

        # if come across any failure that blocks the test,
        # please remove ~/.lkp and /lkp dir to run from a clean state.

=========================================================================================
class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode:
  os/gcc-9/performance/1HDD/ext4/x86_64-rhel-8.3/10%/debian-10.4-x86_64-20200603.cgz/lkp-csl-2sp5/memhotplug/stress-ng/60s/0x5003006

commit: 
  cb185d5f1e ("userfaultfd: fix a race between writeprotect and exit_mmap()")
  295be91f7e ("mm/migrate: optimize hotplug-time demotion order updates")

cb185d5f1ebf900f 295be91f7ef0027fca2f2e4788e 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
      1041 ±  9%    +151.1%       2614        stress-ng.memhotplug.ops
     17.28 ±  9%    +151.7%      43.50        stress-ng.memhotplug.ops_per_sec
     15735 ± 10%    +148.8%      39147 ±  3%  stress-ng.time.involuntary_context_switches
     38.25 ±  8%    +143.1%      93.00        stress-ng.time.percent_of_cpu_this_job_got
     24.04 ±  8%    +141.6%      58.06        stress-ng.time.system_time
      3335 ±  3%     +13.7%       3791 ±  2%  meminfo.Active(anon)
    545.38 ±  4%     -20.9%     431.44 ±  4%  slabinfo.seq_file.num_objs
     13401 ±  5%     +88.0%      25188        vmstat.system.cs
      0.11 ± 18%      -0.0        0.09 ± 20%  mpstat.cpu.all.soft%
      0.39 ±  8%      +0.5        0.92 ±  2%  mpstat.cpu.all.sys%
      0.03 ±  5%      +0.0        0.04 ±  7%  mpstat.cpu.all.usr%
     51.62 ± 15%     +34.9%      69.67 ± 10%  turbostat.Avg_MHz
      1424 ±  3%     +30.1%       1853 ±  7%  turbostat.Bzy_MHz
    121.84           +10.1%     134.18        turbostat.PkgWatt
     82.89            +4.4%      86.55        turbostat.RAMWatt
    833.25 ±  3%     +13.7%     947.56 ±  2%  proc-vmstat.nr_active_anon
      5807            +2.1%       5927        proc-vmstat.nr_shmem
    833.25 ±  3%     +13.7%     947.56 ±  2%  proc-vmstat.nr_zone_active_anon
      2621 ±  6%     +19.9%       3142 ±  4%  proc-vmstat.pgactivate
 4.772e+08 ±  9%    +150.0%  1.193e+09        proc-vmstat.pgfree
     53561 ±  2%     +19.3%      63913 ±  4%  interrupts.CAL:Function_call_interrupts
    516.12 ±  6%     +24.4%     642.22 ± 14%  interrupts.CPU15.CAL:Function_call_interrupts
    545.12 ±  6%     +61.5%     880.33 ± 34%  interrupts.CPU24.CAL:Function_call_interrupts
    522.88 ±  2%     +23.5%     646.00 ± 11%  interrupts.CPU26.CAL:Function_call_interrupts
    516.25 ±  2%     +21.6%     628.00 ± 12%  interrupts.CPU27.CAL:Function_call_interrupts
    519.38 ±  3%     +21.1%     629.00 ± 10%  interrupts.CPU30.CAL:Function_call_interrupts
    519.75 ±  5%     +38.6%     720.56 ± 33%  interrupts.CPU31.CAL:Function_call_interrupts
    518.12 ±  2%     +30.4%     675.67 ± 17%  interrupts.CPU36.CAL:Function_call_interrupts
    521.00 ±  5%     +15.3%     600.89 ±  8%  interrupts.CPU39.CAL:Function_call_interrupts
    504.50 ±  6%     +23.6%     623.33 ±  9%  interrupts.CPU41.CAL:Function_call_interrupts
    512.62 ±  2%     +23.3%     632.11 ±  9%  interrupts.CPU42.CAL:Function_call_interrupts
    527.88 ±  6%     +38.0%     728.22 ± 21%  interrupts.CPU43.CAL:Function_call_interrupts
    504.00 ±  6%     +57.5%     793.89 ± 29%  interrupts.CPU46.CAL:Function_call_interrupts
    549.25 ±  3%     +34.9%     740.67 ± 13%  interrupts.CPU47.CAL:Function_call_interrupts
    511.62           +81.7%     929.78 ± 53%  interrupts.CPU73.CAL:Function_call_interrupts
    511.38 ±  2%     +79.9%     920.00 ± 47%  interrupts.CPU74.CAL:Function_call_interrupts
    522.00 ±  6%     +41.3%     737.78 ± 27%  interrupts.CPU75.CAL:Function_call_interrupts
    506.50           +74.5%     883.78 ± 53%  interrupts.CPU76.CAL:Function_call_interrupts
    519.75 ±  4%     +28.8%     669.67 ± 17%  interrupts.CPU78.CAL:Function_call_interrupts
    506.88           +23.7%     626.78 ± 15%  interrupts.CPU79.CAL:Function_call_interrupts
    515.00 ±  2%     +35.1%     695.67 ± 23%  interrupts.CPU83.CAL:Function_call_interrupts
    511.38 ±  2%     +28.0%     654.56 ± 20%  interrupts.CPU84.CAL:Function_call_interrupts
    519.88 ±  6%     +23.3%     641.00 ± 10%  interrupts.CPU86.CAL:Function_call_interrupts
    503.12 ± 12%     +23.6%     621.78 ± 11%  interrupts.CPU87.CAL:Function_call_interrupts
    547.00 ±  7%     +20.6%     659.67 ± 13%  interrupts.CPU89.CAL:Function_call_interrupts
    527.62 ±  3%     +71.1%     902.89 ± 57%  interrupts.CPU93.CAL:Function_call_interrupts
    534.00 ±  5%     +51.9%     810.89 ± 46%  interrupts.CPU94.CAL:Function_call_interrupts
    542.75 ±  6%     +31.4%     713.11 ± 17%  interrupts.CPU95.CAL:Function_call_interrupts
     12945 ± 20%     +61.4%      20889 ±  9%  interrupts.NMI:Non-maskable_interrupts
     12945 ± 20%     +61.4%      20889 ±  9%  interrupts.PMI:Performance_monitoring_interrupts
      2706 ± 25%     +88.6%       5103 ± 18%  interrupts.RES:Rescheduling_interrupts
 5.285e+08 ±  5%     +95.8%  1.035e+09        perf-stat.i.branch-instructions
      1.42 ± 54%      -0.7        0.77 ± 53%  perf-stat.i.branch-miss-rate%
  25137162 ± 10%    +145.6%   61727243        perf-stat.i.cache-misses
  61633730 ± 39%     +79.9%  1.109e+08 ± 17%  perf-stat.i.cache-references
     13469 ±  6%     +90.8%      25693        perf-stat.i.context-switches
      1.83 ± 13%     -25.1%       1.37 ± 11%  perf-stat.i.cpi
 4.261e+09 ± 18%     +41.2%  6.015e+09 ± 11%  perf-stat.i.cpu-cycles
    226.29 ±  5%     -30.6%     157.02 ±  6%  perf-stat.i.cycles-between-cache-misses
 5.312e+08 ±  4%     +79.0%  9.506e+08        perf-stat.i.dTLB-loads
      0.03 ± 88%      -0.0        0.02 ± 92%  perf-stat.i.dTLB-store-miss-rate%
 2.809e+08 ±  4%     +79.9%  5.053e+08        perf-stat.i.dTLB-stores
    759120 ±  4%     +14.9%     872108 ±  4%  perf-stat.i.iTLB-load-misses
 2.358e+09 ±  5%     +90.4%  4.491e+09        perf-stat.i.instructions
      3121 ±  9%     +66.1%       5185 ±  4%  perf-stat.i.instructions-per-iTLB-miss
      0.57 ± 13%     +33.3%       0.76 ± 10%  perf-stat.i.ipc
      0.04 ± 18%     +41.1%       0.06 ± 11%  perf-stat.i.metric.GHz
    727.45 ± 34%     -42.7%     416.57 ± 39%  perf-stat.i.metric.K/sec
     13.97 ±  5%     +92.5%      26.89        perf-stat.i.metric.M/sec
   3267111 ±  8%    +136.2%    7716991 ±  9%  perf-stat.i.node-load-misses
   1735357 ±  9%    +164.4%    4587669 ± 13%  perf-stat.i.node-loads
   1533195 ±  8%    +151.2%    3851398 ±  4%  perf-stat.i.node-store-misses
   1079117 ± 13%    +163.6%    2844637 ±  4%  perf-stat.i.node-stores
      1.43 ± 51%      -0.7        0.73 ± 52%  perf-stat.overall.branch-miss-rate%
      1.79 ± 13%     -25.3%       1.34 ± 11%  perf-stat.overall.cpi
    168.16 ±  8%     -42.1%      97.35 ± 10%  perf-stat.overall.cycles-between-cache-misses
      0.03 ± 86%      -0.0        0.02 ± 92%  perf-stat.overall.dTLB-store-miss-rate%
      3118 ±  9%     +65.4%       5159 ±  4%  perf-stat.overall.instructions-per-iTLB-miss
      0.57 ± 13%     +33.2%       0.76 ± 10%  perf-stat.overall.ipc
 5.201e+08 ±  5%     +95.8%  1.019e+09        perf-stat.ps.branch-instructions
  24739396 ± 10%    +145.6%   60759231        perf-stat.ps.cache-misses
  60650396 ± 39%     +79.9%  1.091e+08 ± 17%  perf-stat.ps.cache-references
     13256 ±  6%     +90.8%      25287        perf-stat.ps.context-switches
 4.193e+09 ± 18%     +41.2%  5.919e+09 ± 11%  perf-stat.ps.cpu-cycles
 5.227e+08 ±  4%     +79.0%  9.354e+08        perf-stat.ps.dTLB-loads
 2.764e+08 ±  4%     +79.9%  4.972e+08        perf-stat.ps.dTLB-stores
    746985 ±  4%     +14.9%     858111 ±  4%  perf-stat.ps.iTLB-load-misses
 2.321e+09 ±  5%     +90.4%  4.419e+09        perf-stat.ps.instructions
   3215383 ±  8%    +136.2%    7596029 ±  9%  perf-stat.ps.node-load-misses
   1707815 ±  9%    +164.4%    4515471 ± 13%  perf-stat.ps.node-loads
   1508884 ±  8%    +151.3%    3791226 ±  4%  perf-stat.ps.node-store-misses
   1062105 ± 13%    +163.6%    2800159 ±  4%  perf-stat.ps.node-stores
 1.471e+11 ±  5%     +90.6%  2.804e+11        perf-stat.total.instructions
     14263 ± 14%     -20.6%      11330 ± 10%  softirqs.CPU0.RCU
     12166 ± 20%     -25.4%       9078 ± 12%  softirqs.CPU11.RCU
     12640 ± 20%     -26.7%       9265 ± 15%  softirqs.CPU12.RCU
     13113 ± 13%     -27.1%       9555 ± 13%  softirqs.CPU13.RCU
     12127 ± 15%     -27.3%       8812 ± 10%  softirqs.CPU15.RCU
     10763 ± 13%     -32.5%       7267 ± 11%  softirqs.CPU16.RCU
     11134 ± 10%     -28.5%       7965 ± 15%  softirqs.CPU17.RCU
     11124 ± 14%     -27.0%       8118 ± 14%  softirqs.CPU19.RCU
     13344 ± 11%     -27.8%       9632 ± 12%  softirqs.CPU2.RCU
     12754 ± 24%     -37.1%       8019 ± 14%  softirqs.CPU20.RCU
     10766 ±  5%     -30.3%       7507 ± 10%  softirqs.CPU21.RCU
     10945 ±  6%     -29.2%       7754 ± 12%  softirqs.CPU23.RCU
      9036 ±  5%     -20.3%       7205 ±  7%  softirqs.CPU25.RCU
      9612 ±  9%     -19.0%       7788 ± 17%  softirqs.CPU29.RCU
     13411 ± 18%     -31.9%       9138 ± 15%  softirqs.CPU3.RCU
      9549 ±  9%     -17.0%       7927 ±  9%  softirqs.CPU30.RCU
      9210 ±  5%     -20.6%       7311 ± 11%  softirqs.CPU31.RCU
     10952 ±  9%     -16.1%       9186 ± 10%  softirqs.CPU33.RCU
     10191 ±  5%     -13.3%       8837 ±  7%  softirqs.CPU36.RCU
     10633 ±  7%     -16.5%       8876 ±  9%  softirqs.CPU39.RCU
     13116 ± 23%     -26.4%       9649 ±  9%  softirqs.CPU4.RCU
     11247 ± 11%     -17.5%       9278 ±  9%  softirqs.CPU47.RCU
     12587 ± 16%     -32.4%       8505 ± 12%  softirqs.CPU48.RCU
     14346 ± 18%     -32.5%       9684 ± 18%  softirqs.CPU5.RCU
     12580 ± 18%     -29.4%       8876 ± 10%  softirqs.CPU51.RCU
     13283 ± 26%     -30.5%       9232 ± 15%  softirqs.CPU53.RCU
     12647 ± 15%     -27.5%       9166 ± 14%  softirqs.CPU54.RCU
     12486 ± 16%     -32.6%       8416 ±  7%  softirqs.CPU55.RCU
     12832 ± 17%     -26.0%       9492 ± 17%  softirqs.CPU59.RCU
     12929 ± 16%     -24.5%       9755 ± 18%  softirqs.CPU6.RCU
     13390 ± 17%     -29.0%       9507 ± 18%  softirqs.CPU60.RCU
     11309 ± 13%     -31.3%       7763 ± 13%  softirqs.CPU64.RCU
     11550 ± 11%     -31.3%       7933 ± 13%  softirqs.CPU65.RCU
     11513 ±  9%     -32.3%       7799 ± 16%  softirqs.CPU66.RCU
     11594 ± 10%     -33.8%       7677 ± 13%  softirqs.CPU67.RCU
     11797 ±  9%     -36.4%       7499 ± 11%  softirqs.CPU68.RCU
     11649 ± 16%     -35.7%       7488 ± 12%  softirqs.CPU69.RCU
     11282 ± 10%     -28.5%       8065 ± 13%  softirqs.CPU70.RCU
     11054 ± 10%     -28.2%       7931 ± 13%  softirqs.CPU71.RCU
      9519 ±  6%     -19.2%       7692 ±  7%  softirqs.CPU72.RCU
      9875 ±  9%     -15.9%       8308 ±  8%  softirqs.CPU76.RCU
      9288 ±  7%     -19.2%       7504 ±  8%  softirqs.CPU79.RCU
     10119 ±  4%      -9.0%       9205 ±  6%  softirqs.CPU84.RCU
     12494 ± 19%     -28.5%       8934 ± 12%  softirqs.CPU9.RCU
   1087941 ± 10%     -20.9%     860053 ±  5%  softirqs.RCU
     74.19 ±  4%     -14.1       60.13 ±  2%  perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
     73.22 ±  4%     -13.9       59.31 ±  2%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     73.22 ±  4%     -13.9       59.31 ±  2%  perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     73.15 ±  4%     -13.9       59.27 ±  2%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     66.07 ±  3%     -11.8       54.27 ±  3%  perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     64.96 ±  3%     -11.3       53.66 ±  3%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
     22.84 ± 15%      -9.4       13.42 ±  9%  perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
     18.47 ± 15%      -7.6       10.84 ± 10%  perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
     12.28 ± 19%      -5.1        7.16 ± 11%  perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
     12.02 ± 20%      -5.0        7.02 ± 11%  perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      6.62 ±  7%      -2.7        3.96 ± 16%  perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      4.24 ± 11%      -1.7        2.55 ± 15%  perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
      5.16 ± 14%      -1.6        3.57 ± 17%  perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      3.84 ± 10%      -1.5        2.30 ± 16%  perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
      3.57 ± 13%      -1.4        2.18 ± 14%  perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
      3.47 ±  9%      -1.4        2.09 ± 12%  perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      2.91 ± 10%      -1.2        1.74 ± 12%  perf-profile.calltrace.cycles-pp.__softirqentry_text_start.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      1.06 ± 22%      -0.7        0.38 ± 90%  perf-profile.calltrace.cycles-pp.tick_irq_enter.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      1.10 ± 21%      -0.6        0.46 ± 72%  perf-profile.calltrace.cycles-pp.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      1.82 ± 12%      -0.6        1.20 ± 17%  perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
      1.30 ± 10%      -0.5        0.75 ±  9%  perf-profile.calltrace.cycles-pp.rebalance_domains.__softirqentry_text_start.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      1.16 ± 23%      -0.5        0.67 ± 16%  perf-profile.calltrace.cycles-pp.lapic_next_deadline.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
      1.10 ±  7%      -0.5        0.64 ±  6%  perf-profile.calltrace.cycles-pp.perf_mux_hrtimer_handler.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
      0.70 ± 16%      +0.4        1.08 ±  7%  perf-profile.calltrace.cycles-pp.flush_all_cpus_locked.slab_memory_callback.blocking_notifier_call_chain.offline_pages.memory_subsys_offline
      0.78 ± 16%      +0.5        1.25 ± 11%  perf-profile.calltrace.cycles-pp.update_sd_lb_stats.find_busiest_group.load_balance.newidle_balance.pick_next_task_fair
      0.78 ± 15%      +0.5        1.27 ± 11%  perf-profile.calltrace.cycles-pp.find_busiest_group.load_balance.newidle_balance.pick_next_task_fair.__schedule
      0.84 ± 14%      +0.5        1.36 ±  9%  perf-profile.calltrace.cycles-pp.load_balance.newidle_balance.pick_next_task_fair.__schedule.schedule
      0.92 ± 14%      +0.6        1.47 ±  8%  perf-profile.calltrace.cycles-pp.newidle_balance.pick_next_task_fair.__schedule.schedule.worker_thread
      0.92 ± 14%      +0.6        1.47 ±  8%  perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.worker_thread.kthread
      1.01 ± 18%      +0.6        1.56 ±  8%  perf-profile.calltrace.cycles-pp.slab_memory_callback.blocking_notifier_call_chain.offline_pages.memory_subsys_offline.device_offline
      1.01 ± 19%      +0.6        1.57 ±  8%  perf-profile.calltrace.cycles-pp.blocking_notifier_call_chain.offline_pages.memory_subsys_offline.device_offline.state_store
      1.07 ± 18%      +0.6        1.64 ± 14%  perf-profile.calltrace.cycles-pp.__pageblock_pfn_to_page.set_zone_contiguous.online_pages.memory_subsys_online.device_online
      1.11 ± 16%      +0.6        1.70 ± 14%  perf-profile.calltrace.cycles-pp.set_zone_contiguous.online_pages.memory_subsys_online.device_online.state_store
      1.03 ± 14%      +0.6        1.63 ±  8%  perf-profile.calltrace.cycles-pp.__schedule.schedule.worker_thread.kthread.ret_from_fork
      1.04 ± 14%      +0.6        1.65 ±  8%  perf-profile.calltrace.cycles-pp.schedule.worker_thread.kthread.ret_from_fork
      1.01 ± 18%      +0.6        1.65 ±  4%  perf-profile.calltrace.cycles-pp.__free_pages_ok.generic_online_page.online_pages.memory_subsys_online.device_online
      1.46 ± 12%      +0.7        2.12 ±  7%  perf-profile.calltrace.cycles-pp.ret_from_fork
      1.46 ± 12%      +0.7        2.12 ±  7%  perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
      1.33 ± 12%      +0.7        1.99 ±  8%  perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
      0.68 ± 67%      +0.7        1.40 ± 16%  perf-profile.calltrace.cycles-pp._printk.__dump_page.cold.dump_page.start_isolate_page_range.offline_pages
      0.68 ± 67%      +0.7        1.40 ± 16%  perf-profile.calltrace.cycles-pp.vprintk_emit._printk.__dump_page.cold.dump_page.start_isolate_page_range
      0.68 ± 67%      +0.7        1.40 ± 16%  perf-profile.calltrace.cycles-pp.console_unlock.vprintk_emit._printk.__dump_page.cold.dump_page
      0.68 ± 66%      +0.7        1.40 ± 16%  perf-profile.calltrace.cycles-pp.serial8250_console_write.console_unlock.vprintk_emit._printk.__dump_page.cold
      1.15 ± 16%      +0.8        2.00 ±  8%  perf-profile.calltrace.cycles-pp.move_freepages_block.unset_migratetype_isolate.undo_isolate_page_range.online_pages.memory_subsys_online
      1.25 ± 20%      +0.9        2.12 ±  8%  perf-profile.calltrace.cycles-pp.undo_isolate_page_range.online_pages.memory_subsys_online.device_online.state_store
      1.20 ± 16%      +0.9        2.09 ±  8%  perf-profile.calltrace.cycles-pp.unset_migratetype_isolate.undo_isolate_page_range.online_pages.memory_subsys_online.device_online
      1.76 ± 11%      +1.0        2.78 ±  5%  perf-profile.calltrace.cycles-pp.has_unmovable_pages.start_isolate_page_range.offline_pages.memory_subsys_offline.device_offline
      2.11 ± 32%      +1.5        3.57 ± 14%  perf-profile.calltrace.cycles-pp.__dump_page.cold.dump_page.start_isolate_page_range.offline_pages.memory_subsys_offline
      2.64 ± 15%      +1.5        4.14 ±  3%  perf-profile.calltrace.cycles-pp.__free_pages_core.generic_online_page.online_pages.memory_subsys_online.device_online
      3.02 ± 15%      +1.7        4.72 ±  7%  perf-profile.calltrace.cycles-pp.__init_single_page.memmap_init_range.move_pfn_range_to_zone.online_pages.memory_subsys_online
      3.05 ± 20%      +2.1        5.10 ± 10%  perf-profile.calltrace.cycles-pp.dump_page.start_isolate_page_range.offline_pages.memory_subsys_offline.device_offline
      3.66 ± 15%      +2.2        5.81 ±  3%  perf-profile.calltrace.cycles-pp.generic_online_page.online_pages.memory_subsys_online.device_online.state_store
      3.08 ± 18%      +2.3        5.38 ± 13%  perf-profile.calltrace.cycles-pp.wait_for_xmitr.serial8250_console_putchar.uart_console_write.serial8250_console_write.console_unlock
      2.05 ± 27%      +2.3        4.35 ± 16%  perf-profile.calltrace.cycles-pp.io_serial_in.wait_for_xmitr.serial8250_console_putchar.uart_console_write.serial8250_console_write
      3.09 ± 18%      +2.3        5.39 ± 13%  perf-profile.calltrace.cycles-pp.serial8250_console_putchar.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit
      4.11 ± 16%      +2.4        6.49 ±  6%  perf-profile.calltrace.cycles-pp.memmap_init_range.move_pfn_range_to_zone.online_pages.memory_subsys_online.device_online
      3.21 ± 18%      +2.4        5.62 ± 10%  perf-profile.calltrace.cycles-pp.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit._printk
      4.25 ± 16%      +2.5        6.77 ±  6%  perf-profile.calltrace.cycles-pp.move_pfn_range_to_zone.online_pages.memory_subsys_online.device_online.state_store
      5.62 ± 15%      +3.7        9.36 ±  7%  perf-profile.calltrace.cycles-pp.start_isolate_page_range.offline_pages.memory_subsys_offline.device_offline.state_store
     10.38 ± 15%      +6.2       16.55 ±  4%  perf-profile.calltrace.cycles-pp.online_pages.memory_subsys_online.device_online.state_store.kernfs_fop_write_iter
     10.38 ± 15%      +6.2       16.56 ±  4%  perf-profile.calltrace.cycles-pp.memory_subsys_online.device_online.state_store.kernfs_fop_write_iter.new_sync_write
     10.39 ± 15%      +6.2       16.56 ±  4%  perf-profile.calltrace.cycles-pp.device_online.state_store.kernfs_fop_write_iter.new_sync_write.vfs_write
     11.90 ± 13%      +7.6       19.49 ±  4%  perf-profile.calltrace.cycles-pp.offline_pages.memory_subsys_offline.device_offline.state_store.kernfs_fop_write_iter
     12.06 ± 13%      +7.7       19.75 ±  4%  perf-profile.calltrace.cycles-pp.memory_subsys_offline.device_offline.state_store.kernfs_fop_write_iter.new_sync_write
     12.07 ± 13%      +7.7       19.77 ±  4%  perf-profile.calltrace.cycles-pp.device_offline.state_store.kernfs_fop_write_iter.new_sync_write.vfs_write
     22.76 ± 13%     +13.8       36.58 ±  4%  perf-profile.calltrace.cycles-pp.write
     22.73 ± 13%     +13.8       36.56 ±  4%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
     22.73 ± 13%     +13.8       36.56 ±  4%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     22.71 ± 13%     +13.8       36.55 ±  4%  perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     22.70 ± 13%     +13.8       36.54 ±  4%  perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     22.69 ± 13%     +13.9       36.54 ±  4%  perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     22.64 ± 13%     +13.9       36.50 ±  4%  perf-profile.calltrace.cycles-pp.kernfs_fop_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
     22.61 ± 13%     +13.9       36.48 ±  4%  perf-profile.calltrace.cycles-pp.state_store.kernfs_fop_write_iter.new_sync_write.vfs_write.ksys_write
     74.19 ±  4%     -14.1       60.13 ±  2%  perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     74.19 ±  4%     -14.1       60.13 ±  2%  perf-profile.children.cycles-pp.cpu_startup_entry
     74.19 ±  4%     -14.1       60.13 ±  2%  perf-profile.children.cycles-pp.do_idle
     73.22 ±  4%     -13.9       59.31 ±  2%  perf-profile.children.cycles-pp.start_secondary
     66.98 ±  3%     -11.9       55.03 ±  3%  perf-profile.children.cycles-pp.cpuidle_enter
     66.92 ±  3%     -11.9       54.99 ±  3%  perf-profile.children.cycles-pp.cpuidle_enter_state
     21.26 ± 15%      -8.6       12.68 ±  9%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
     18.83 ± 15%      -7.6       11.22 ± 10%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
     12.51 ± 19%      -5.1        7.43 ± 11%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
     12.26 ± 20%      -5.0        7.29 ± 11%  perf-profile.children.cycles-pp.hrtimer_interrupt
      6.78 ±  7%      -2.6        4.17 ± 16%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      4.34 ± 10%      -1.6        2.70 ± 16%  perf-profile.children.cycles-pp.tick_sched_timer
      5.23 ± 14%      -1.6        3.64 ± 17%  perf-profile.children.cycles-pp.menu_select
      3.92 ±  9%      -1.5        2.44 ± 17%  perf-profile.children.cycles-pp.tick_sched_handle
      3.57 ±  9%      -1.4        2.18 ± 13%  perf-profile.children.cycles-pp.irq_exit_rcu
      3.66 ± 12%      -1.3        2.34 ± 15%  perf-profile.children.cycles-pp.update_process_times
      2.98 ±  9%      -1.2        1.80 ± 12%  perf-profile.children.cycles-pp.__softirqentry_text_start
      1.88 ± 11%      -0.6        1.30 ± 18%  perf-profile.children.cycles-pp.scheduler_tick
      1.32 ± 10%      -0.6        0.77 ±  8%  perf-profile.children.cycles-pp.rebalance_domains
      1.11 ± 21%      -0.5        0.60 ± 28%  perf-profile.children.cycles-pp.irq_enter_rcu
      1.08 ± 22%      -0.5        0.57 ± 30%  perf-profile.children.cycles-pp.tick_irq_enter
      1.21 ± 23%      -0.5        0.71 ± 16%  perf-profile.children.cycles-pp.lapic_next_deadline
      1.13 ±  7%      -0.5        0.67 ±  7%  perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
      1.12 ± 21%      -0.4        0.68 ± 11%  perf-profile.children.cycles-pp.sched_clock_cpu
      0.98 ± 22%      -0.4        0.58 ± 10%  perf-profile.children.cycles-pp.native_sched_clock
      0.86 ± 14%      -0.4        0.47 ± 13%  perf-profile.children.cycles-pp.irqtime_account_irq
      0.79 ± 38%      -0.4        0.40 ± 32%  perf-profile.children.cycles-pp.ktime_get_update_offsets_now
      1.07 ± 25%      -0.4        0.68 ± 16%  perf-profile.children.cycles-pp.native_irq_return_iret
      0.94 ± 20%      -0.4        0.57 ± 39%  perf-profile.children.cycles-pp.irq_work_run_list
      0.91 ± 20%      -0.4        0.54 ± 40%  perf-profile.children.cycles-pp.asm_sysvec_irq_work
      0.91 ± 20%      -0.4        0.54 ± 40%  perf-profile.children.cycles-pp.sysvec_irq_work
      0.91 ± 20%      -0.4        0.54 ± 40%  perf-profile.children.cycles-pp.__sysvec_irq_work
      0.91 ± 20%      -0.4        0.54 ± 40%  perf-profile.children.cycles-pp.irq_work_run
      0.91 ± 20%      -0.4        0.55 ± 40%  perf-profile.children.cycles-pp.irq_work_single
      0.73 ± 14%      -0.3        0.41 ± 12%  perf-profile.children.cycles-pp.rcu_sched_clock_irq
      0.79 ± 17%      -0.3        0.51 ± 17%  perf-profile.children.cycles-pp.read_tsc
      0.58 ± 21%      -0.2        0.33 ± 13%  perf-profile.children.cycles-pp.run_rebalance_domains
      0.54 ± 16%      -0.2        0.30 ± 23%  perf-profile.children.cycles-pp.hrtimer_update_next_event
      0.50 ± 26%      -0.2        0.27 ± 18%  perf-profile.children.cycles-pp.rcu_idle_exit
      0.60 ± 17%      -0.2        0.37 ± 12%  perf-profile.children.cycles-pp.update_blocked_averages
      0.61 ± 11%      -0.2        0.39 ± 26%  perf-profile.children.cycles-pp.update_rq_clock
      0.43 ± 22%      -0.2        0.22 ± 14%  perf-profile.children.cycles-pp._raw_spin_trylock
      0.46 ± 24%      -0.2        0.27 ± 36%  perf-profile.children.cycles-pp.__remove_hrtimer
      0.41 ± 16%      -0.2        0.24 ± 18%  perf-profile.children.cycles-pp.__intel_pmu_enable_all
      0.49 ± 20%      -0.2        0.33 ± 17%  perf-profile.children.cycles-pp.get_next_timer_interrupt
      0.52 ± 11%      -0.2        0.36 ± 20%  perf-profile.children.cycles-pp.rcu_core
      0.34 ± 36%      -0.2        0.19 ± 51%  perf-profile.children.cycles-pp.enqueue_hrtimer
      0.30 ± 11%      -0.2        0.15 ± 30%  perf-profile.children.cycles-pp.note_gp_changes
      0.37 ± 16%      -0.2        0.22 ± 29%  perf-profile.children.cycles-pp.update_irq_load_avg
      0.35 ± 24%      -0.2        0.20 ± 18%  perf-profile.children.cycles-pp.rcu_eqs_exit
      0.31 ± 40%      -0.1        0.16 ± 54%  perf-profile.children.cycles-pp.timerqueue_add
      0.42 ± 12%      -0.1        0.28 ± 12%  perf-profile.children.cycles-pp.arch_scale_freq_tick
      0.28 ±  8%      -0.1        0.15 ± 16%  perf-profile.children.cycles-pp.__hrtimer_get_next_event
      0.36 ± 24%      -0.1        0.23 ± 34%  perf-profile.children.cycles-pp.timerqueue_del
      0.23 ± 15%      -0.1        0.12 ± 18%  perf-profile.children.cycles-pp.error_entry
      0.25 ± 25%      -0.1        0.15 ± 27%  perf-profile.children.cycles-pp.rcu_dynticks_inc
      0.20 ± 10%      -0.1        0.10 ± 32%  perf-profile.children.cycles-pp.execve
      0.20 ± 10%      -0.1        0.11 ± 32%  perf-profile.children.cycles-pp.__x64_sys_execve
      0.20 ± 10%      -0.1        0.11 ± 32%  perf-profile.children.cycles-pp.do_execveat_common
      0.22 ± 19%      -0.1        0.12 ± 21%  perf-profile.children.cycles-pp.call_cpuidle
      0.63 ±  8%      -0.1        0.54 ±  8%  perf-profile.children.cycles-pp._raw_spin_lock
      0.17 ± 14%      -0.1        0.08 ± 25%  perf-profile.children.cycles-pp.bprm_execve
      0.18 ± 36%      -0.1        0.09 ± 59%  perf-profile.children.cycles-pp.nr_iowait_cpu
      0.17 ± 33%      -0.1        0.09 ± 27%  perf-profile.children.cycles-pp.__handle_mm_fault
      0.18 ± 30%      -0.1        0.10 ± 28%  perf-profile.children.cycles-pp.handle_mm_fault
      0.15 ± 18%      -0.1        0.07 ± 20%  perf-profile.children.cycles-pp.menu_reflect
      0.14 ± 23%      -0.1        0.07 ± 42%  perf-profile.children.cycles-pp.exec_binprm
      0.14 ± 20%      -0.1        0.07 ± 42%  perf-profile.children.cycles-pp.load_elf_binary
      0.11 ± 26%      -0.1        0.04 ± 92%  perf-profile.children.cycles-pp.get_cpu_device
      0.21 ± 22%      -0.1        0.14 ± 21%  perf-profile.children.cycles-pp.ksys_read
      0.12 ± 21%      -0.1        0.06 ± 41%  perf-profile.children.cycles-pp.mmput
      0.12 ± 23%      -0.1        0.06 ± 41%  perf-profile.children.cycles-pp.exit_mmap
      0.20 ± 24%      -0.1        0.14 ± 23%  perf-profile.children.cycles-pp.vfs_read
      0.13 ± 23%      -0.1        0.07 ± 47%  perf-profile.children.cycles-pp.tick_check_broadcast_expired
      0.14 ± 30%      -0.0        0.09 ± 20%  perf-profile.children.cycles-pp.tick_nohz_tick_stopped
      0.07 ± 24%      +0.0        0.12 ± 16%  perf-profile.children.cycles-pp.setup_per_zone_wmarks
      0.05 ± 42%      +0.1        0.10 ± 18%  perf-profile.children.cycles-pp.zone_pcp_update
      0.07 ± 19%      +0.1        0.12 ± 11%  perf-profile.children.cycles-pp.__zone_set_pageset_high_and_batch
      0.02 ±129%      +0.1        0.09 ± 19%  perf-profile.children.cycles-pp.ttwu_queue_wakelist
      0.10 ± 29%      +0.1        0.18 ± 20%  perf-profile.children.cycles-pp.pfn_to_online_page
      0.14 ± 21%      +0.1        0.23 ± 17%  perf-profile.children.cycles-pp.cpumask_next
      0.17 ± 26%      +0.1        0.27 ±  8%  perf-profile.children.cycles-pp.init_per_zone_wmark_min
      0.28 ± 12%      +0.1        0.41 ± 12%  perf-profile.children.cycles-pp.try_to_wake_up
      0.18 ± 25%      +0.2        0.41 ± 12%  perf-profile.children.cycles-pp.__queue_work
      0.20 ± 22%      +0.2        0.44 ± 11%  perf-profile.children.cycles-pp.queue_work_on
      0.71 ± 17%      +0.4        1.09 ±  7%  perf-profile.children.cycles-pp.flush_all_cpus_locked
      0.68 ± 18%      +0.4        1.10 ±  4%  perf-profile.children.cycles-pp.PageHuge
      1.03 ± 19%      +0.5        1.57 ±  8%  perf-profile.children.cycles-pp.blocking_notifier_call_chain
      1.01 ± 18%      +0.6        1.56 ±  8%  perf-profile.children.cycles-pp.slab_memory_callback
      1.10 ± 13%      +0.6        1.69 ±  8%  perf-profile.children.cycles-pp.newidle_balance
      1.14 ± 13%      +0.6        1.75 ±  8%  perf-profile.children.cycles-pp.pick_next_task_fair
      1.32 ± 13%      +0.6        1.94 ±  8%  perf-profile.children.cycles-pp.schedule
      1.01 ± 18%      +0.6        1.65 ±  4%  perf-profile.children.cycles-pp.__free_pages_ok
      1.46 ± 12%      +0.7        2.12 ±  7%  perf-profile.children.cycles-pp.kthread
      1.47 ± 12%      +0.7        2.13 ±  7%  perf-profile.children.cycles-pp.ret_from_fork
      1.33 ± 12%      +0.7        1.99 ±  8%  perf-profile.children.cycles-pp.worker_thread
      1.48 ± 13%      +0.7        2.16 ±  8%  perf-profile.children.cycles-pp.__schedule
      1.26 ± 20%      +0.9        2.12 ±  8%  perf-profile.children.cycles-pp.undo_isolate_page_range
      1.22 ± 16%      +0.9        2.11 ±  8%  perf-profile.children.cycles-pp.unset_migratetype_isolate
      1.48 ± 13%      +1.0        2.48 ±  7%  perf-profile.children.cycles-pp.move_freepages_block
      1.79 ± 11%      +1.0        2.84 ±  5%  perf-profile.children.cycles-pp.has_unmovable_pages
      2.09 ± 18%      +1.1        3.22 ± 14%  perf-profile.children.cycles-pp.__pageblock_pfn_to_page
      2.20 ± 17%      +1.2        3.39 ± 14%  perf-profile.children.cycles-pp.set_zone_contiguous
      2.11 ± 32%      +1.5        3.57 ± 14%  perf-profile.children.cycles-pp.__dump_page.cold
      2.64 ± 15%      +1.5        4.15 ±  3%  perf-profile.children.cycles-pp.__free_pages_core
      3.08 ± 15%      +1.8        4.83 ±  7%  perf-profile.children.cycles-pp.__init_single_page
      3.06 ± 10%      +1.9        4.92 ± 12%  perf-profile.children.cycles-pp.io_serial_in
      3.93 ± 13%      +2.0        5.95 ±  8%  perf-profile.children.cycles-pp.serial8250_console_putchar
      3.05 ± 20%      +2.1        5.10 ± 10%  perf-profile.children.cycles-pp.dump_page
      4.09 ± 14%      +2.1        6.16 ±  8%  perf-profile.children.cycles-pp.uart_console_write
      4.06 ± 13%      +2.1        6.15 ±  9%  perf-profile.children.cycles-pp.wait_for_xmitr
      4.23 ± 13%      +2.1        6.37 ±  8%  perf-profile.children.cycles-pp.serial8250_console_write
      4.25 ± 14%      +2.1        6.40 ±  8%  perf-profile.children.cycles-pp.console_unlock
      3.66 ± 15%      +2.2        5.81 ±  3%  perf-profile.children.cycles-pp.generic_online_page
      4.28 ± 14%      +2.2        6.44 ±  8%  perf-profile.children.cycles-pp._printk
      4.28 ± 14%      +2.2        6.44 ±  8%  perf-profile.children.cycles-pp.vprintk_emit
      4.25 ± 16%      +2.5        6.77 ±  6%  perf-profile.children.cycles-pp.move_pfn_range_to_zone
      4.25 ± 16%      +2.5        6.77 ±  6%  perf-profile.children.cycles-pp.memmap_init_range
      5.63 ± 15%      +3.7        9.36 ±  7%  perf-profile.children.cycles-pp.start_isolate_page_range
     10.38 ± 15%      +6.2       16.55 ±  4%  perf-profile.children.cycles-pp.online_pages
     10.38 ± 15%      +6.2       16.56 ±  4%  perf-profile.children.cycles-pp.memory_subsys_online
     10.39 ± 15%      +6.2       16.56 ±  4%  perf-profile.children.cycles-pp.device_online
     12.06 ± 13%      +7.7       19.75 ±  4%  perf-profile.children.cycles-pp.memory_subsys_offline
     12.06 ± 13%      +7.7       19.75 ±  4%  perf-profile.children.cycles-pp.offline_pages
     12.07 ± 13%      +7.7       19.77 ±  4%  perf-profile.children.cycles-pp.device_offline
     23.78 ± 13%     +13.5       37.32 ±  4%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     23.78 ± 13%     +13.5       37.32 ±  4%  perf-profile.children.cycles-pp.do_syscall_64
     22.76 ± 13%     +13.8       36.58 ±  4%  perf-profile.children.cycles-pp.write
     22.72 ± 13%     +13.8       36.55 ±  4%  perf-profile.children.cycles-pp.ksys_write
     22.71 ± 13%     +13.8       36.55 ±  4%  perf-profile.children.cycles-pp.vfs_write
     22.69 ± 13%     +13.8       36.54 ±  4%  perf-profile.children.cycles-pp.new_sync_write
     22.64 ± 13%     +13.9       36.50 ±  4%  perf-profile.children.cycles-pp.kernfs_fop_write_iter
     22.61 ± 13%     +13.9       36.48 ±  4%  perf-profile.children.cycles-pp.state_store
      3.04 ± 12%      -1.2        1.82 ±  9%  perf-profile.self.cycles-pp.cpuidle_enter_state
      1.21 ± 23%      -0.5        0.71 ± 16%  perf-profile.self.cycles-pp.lapic_next_deadline
      0.96 ± 22%      -0.4        0.55 ± 11%  perf-profile.self.cycles-pp.native_sched_clock
      1.07 ± 25%      -0.4        0.68 ± 15%  perf-profile.self.cycles-pp.native_irq_return_iret
      0.64 ± 48%      -0.3        0.31 ± 39%  perf-profile.self.cycles-pp.ktime_get_update_offsets_now
      0.63 ± 17%      -0.3        0.35 ± 10%  perf-profile.self.cycles-pp.rcu_sched_clock_irq
      0.76 ± 17%      -0.3        0.50 ± 15%  perf-profile.self.cycles-pp.read_tsc
      0.43 ± 22%      -0.2        0.21 ± 15%  perf-profile.self.cycles-pp._raw_spin_trylock
      0.53 ±  9%      -0.2        0.33 ± 16%  perf-profile.self.cycles-pp.do_idle
      0.41 ± 16%      -0.2        0.24 ± 18%  perf-profile.self.cycles-pp.__intel_pmu_enable_all
      0.36 ± 16%      -0.2        0.20 ± 14%  perf-profile.self.cycles-pp.irqtime_account_irq
      0.37 ± 16%      -0.2        0.22 ± 29%  perf-profile.self.cycles-pp.update_irq_load_avg
      0.42 ± 12%      -0.1        0.28 ± 12%  perf-profile.self.cycles-pp.arch_scale_freq_tick
      0.34 ± 10%      -0.1        0.21 ± 15%  perf-profile.self.cycles-pp.hrtimer_interrupt
      0.25 ± 14%      -0.1        0.15 ± 15%  perf-profile.self.cycles-pp.asm_sysvec_apic_timer_interrupt
      0.25 ± 25%      -0.1        0.15 ± 27%  perf-profile.self.cycles-pp.rcu_dynticks_inc
      0.20 ± 18%      -0.1        0.10 ± 22%  perf-profile.self.cycles-pp.error_entry
      0.20 ± 27%      -0.1        0.11 ± 21%  perf-profile.self.cycles-pp.perf_mux_hrtimer_handler
      0.21 ± 19%      -0.1        0.11 ± 20%  perf-profile.self.cycles-pp.call_cpuidle
      0.18 ±  9%      -0.1        0.10 ± 17%  perf-profile.self.cycles-pp.__hrtimer_get_next_event
      0.14 ± 28%      -0.1        0.07 ± 45%  perf-profile.self.cycles-pp.note_gp_changes
      0.11 ± 26%      -0.1        0.04 ± 93%  perf-profile.self.cycles-pp.get_cpu_device
      0.11 ± 30%      -0.1        0.04 ± 93%  perf-profile.self.cycles-pp.__remove_hrtimer
      0.19 ± 10%      -0.1        0.13 ± 24%  perf-profile.self.cycles-pp.load_balance
      0.17 ± 26%      -0.1        0.11 ± 23%  perf-profile.self.cycles-pp.__softirqentry_text_start
      0.12 ± 23%      -0.1        0.06 ± 48%  perf-profile.self.cycles-pp.tick_check_broadcast_expired
      0.14 ± 21%      -0.1        0.09 ± 25%  perf-profile.self.cycles-pp.timerqueue_del
      0.09 ± 21%      -0.1        0.04 ± 73%  perf-profile.self.cycles-pp.tick_sched_timer
      0.12 ± 19%      -0.0        0.07 ± 24%  perf-profile.self.cycles-pp.rcu_idle_exit
      0.11 ±  7%      -0.0        0.06 ± 41%  perf-profile.self.cycles-pp.clockevents_program_event
      0.11 ± 30%      -0.0        0.06 ± 40%  perf-profile.self.cycles-pp.tick_nohz_tick_stopped
      0.06 ± 43%      +0.1        0.11 ± 11%  perf-profile.self.cycles-pp.__zone_set_pageset_high_and_batch
      0.10 ± 33%      +0.1        0.16 ± 20%  perf-profile.self.cycles-pp.pfn_to_online_page
      0.12 ± 35%      +0.1        0.20 ± 17%  perf-profile.self.cycles-pp.__kmem_cache_do_shrink
      0.50 ± 22%      +0.3        0.76 ±  9%  perf-profile.self.cycles-pp.flush_all_cpus_locked
      0.46 ± 18%      +0.3        0.79 ±  6%  perf-profile.self.cycles-pp.PageHuge
      0.99 ± 18%      +0.6        1.59 ±  4%  perf-profile.self.cycles-pp.__free_pages_ok
      1.20 ± 18%      +0.9        2.05 ±  8%  perf-profile.self.cycles-pp.memmap_init_range
      1.63 ± 11%      +0.9        2.57 ±  5%  perf-profile.self.cycles-pp.has_unmovable_pages
      1.42 ± 12%      +1.0        2.39 ±  8%  perf-profile.self.cycles-pp.move_freepages_block
      1.98 ± 19%      +1.0        3.03 ± 14%  perf-profile.self.cycles-pp.__pageblock_pfn_to_page
      2.62 ± 15%      +1.5        4.08 ±  3%  perf-profile.self.cycles-pp.__free_pages_core
      2.74 ± 12%      +1.7        4.47 ±  6%  perf-profile.self.cycles-pp.__init_single_page
      3.06 ± 10%      +1.9        4.92 ± 12%  perf-profile.self.cycles-pp.io_serial_in
      3.59 ± 14%      +2.3        5.86 ±  5%  perf-profile.self.cycles-pp.offline_pages


                                                                                
                     stress-ng.time.involuntary_context_switches                
                                                                                
  45000 +-------------------------------------------------------------------+   
        |            O                                                      |   
  40000 |-+O O  O O     O O                                                 |   
  35000 |-+                                                                 |   
        |                                                                   |   
  30000 |-+                                                                 |   
  25000 |-+                                                                 |   
        |                                                                   |   
  20000 |-+                                                                 |   
  15000 |.. .+..+.     .+.+..+..+.+..+.  .+    +..+.+..  .+.+..       .+.+..|   
        |  +      +..+.                +.  :   :       +.      +..+.+.      |   
  10000 |-+                                 : :                             |   
   5000 |-+                                 : :                             |   
        |                                    +                              |   
      0 +-------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                             stress-ng.memhotplug.ops                           
                                                                                
  3000 +--------------------------------------------------------------------+   
       |                                                                    |   
  2500 |-+O O  O  O O  O  O                                                 |   
       |                                                                    |   
       |                                                                    |   
  2000 |-+                                                                  |   
       |                                                                    |   
  1500 |-+                                                                  |   
       |                                                                    |   
  1000 |.. .+..+..    .+.. .+..+..+.+..  .+    +.+..    .+..+..+.     .+.+..|   
       |  +       +.+.    +            +. :   :     +..+         +..+.      |   
       |                                   :  :                             |   
   500 |-+                                 : :                              |   
       |                                    ::                              |   
     0 +--------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                        stress-ng.memhotplug.ops_per_sec                        
                                                                                
  45 +----------------------------------------------------------------------+   
     |    O        O                                                        |   
  40 |-+                                                                    |   
  35 |-+                                                                    |   
     |                                                                      |   
  30 |-+                                                                    |   
  25 |-+                                                                    |   
     |                                                                      |   
  20 |..                     .+.                           .+.        .+.+..|   
  15 |-++.+..+..+..+.+..+..+.   +..+..+..+    +..+.+..+..+.   +..+..+.      |   
     |                                   :   :                              |   
  10 |-+                                  :  :                              |   
   5 |-+                                  : :                               |   
     |                                     ::                               |   
   0 +----------------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


---
0DAY/LKP+ Test Infrastructure                   Open Source Technology Center
https://lists.01.org/hyperkitty/list/lkp@lists.01.org       Intel Corporation

Thanks,
Oliver Sang


View attachment "config-5.15.0-rc6-00003-g295be91f7ef0" of type "text/plain" (176696 bytes)

View attachment "job-script" of type "text/plain" (8299 bytes)

View attachment "job.yaml" of type "text/plain" (5627 bytes)

View attachment "reproduce" of type "text/plain" (538 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ