lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Message-ID: <20190520063534.GB19312@shao2-debian>
Date:   Mon, 20 May 2019 14:35:34 +0800
From:   kernel test robot <rong.a.chen@...el.com>
To:     Johannes Weiner <hannes@...xchg.org>
Cc:     Linus Torvalds <torvalds@...ux-foundation.org>,
        Shakeel Butt <shakeelb@...gle.com>,
        Roman Gushchin <guro@...com>, Michal Hocko <mhocko@...nel.org>,
        Andrew Morton <akpm@...ux-foundation.org>,
        LKML <linux-kernel@...r.kernel.org>, lkp@...org
Subject: [mm]  42a3003535:  will-it-scale.per_process_ops -25.9% regression

Greeting,

FYI, we noticed a -25.9% regression of will-it-scale.per_process_ops due to commit:


commit: 42a300353577ccc17ecc627b8570a89fa1678bec ("mm: memcontrol: fix recursive statistics correctness & scalabilty")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master

in testcase: will-it-scale
on test machine: 192 threads Skylake-SP with 256G memory
with following parameters:

	nr_task: 100%
	mode: process
	test: page_fault3
	cpufreq_governor: performance

test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale



Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml

=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase:
  gcc-7/performance/x86_64-rhel-7.6/process/100%/debian-x86_64-2018-04-03.cgz/lkp-skl-4sp1/page_fault3/will-it-scale

commit: 
  db9adbcbe7 ("mm: memcontrol: move stat/event counting functions out-of-line")
  42a3003535 ("mm: memcontrol: fix recursive statistics correctness & scalabilty")

db9adbcbe740e098 42a300353577ccc17ecc627b857 
---------------- --------------------------- 
       fail:runs  %reproduction    fail:runs
           |             |             |    
         44:4         -283%          33:4     perf-profile.calltrace.cycles-pp.error_entry.testcase
         23:4         -151%          17:4     perf-profile.calltrace.cycles-pp.sync_regs.error_entry.testcase
         46:4         -294%          34:4     perf-profile.children.cycles-pp.error_entry
          0:4           -2%           0:4     perf-profile.children.cycles-pp.error_exit
         21:4         -138%          16:4     perf-profile.self.cycles-pp.error_entry
          0:4           -2%           0:4     perf-profile.self.cycles-pp.error_exit
         %stddev     %change         %stddev
             \          |                \  
    457395           -25.9%     339092        will-it-scale.per_process_ops
  87819982           -25.9%   65105780        will-it-scale.workload
     14796 ± 54%     +95.8%      28964 ± 24%  numa-meminfo.node1.Inactive(anon)
     38.02            +6.1%      40.35 ±  5%  boot-time.boot
      7275            +4.7%       7618 ±  5%  boot-time.idle
     58843 ± 96%     -93.8%       3646 ± 12%  cpuidle.C1.usage
    735515 ± 55%     -77.2%     167576 ±  4%  cpuidle.C6.usage
    269480 ± 10%     +15.7%     311822 ±  3%  sched_debug.cfs_rq:/.min_vruntime.stddev
    268385 ± 10%     +15.7%     310417 ±  2%  sched_debug.cfs_rq:/.spread0.stddev
     79.00            +3.2%      81.50        vmstat.cpu.sy
     17.75 ±  2%      -8.5%      16.25 ±  2%  vmstat.cpu.us
      7938            -2.5%       7741        vmstat.system.cs
    462347            -4.4%     441932        vmstat.system.in
  60227822           -22.5%   46651173        proc-vmstat.numa_hit
  60082905           -22.6%   46506548        proc-vmstat.numa_local
  60343904           -22.5%   46759361        proc-vmstat.pgalloc_normal
 2.646e+10           -25.9%  1.962e+10        proc-vmstat.pgfault
  60301946           -22.5%   46714581        proc-vmstat.pgfree
     57689 ± 99%     -96.0%       2309 ± 15%  turbostat.C1
    692737 ± 61%     -83.4%     114720 ± 10%  turbostat.C6
      0.30 ± 67%     -68.1%       0.10 ± 22%  turbostat.Pkg%pc2
    524.21            -6.8%     488.32        turbostat.PkgWatt
    122.63            -7.6%     113.33        turbostat.RAMWatt
  15022686           -18.4%   12260958 ±  2%  numa-numastat.node0.local_node
  15051138           -18.4%   12280459 ±  2%  numa-numastat.node0.numa_hit
  14900790           -24.7%   11213127        numa-numastat.node1.local_node
  14941317           -24.7%   11258221        numa-numastat.node1.numa_hit
  14987489 ±  2%     -24.5%   11320760 ±  2%  numa-numastat.node2.local_node
  15022530 ±  2%     -24.3%   11368910 ±  2%  numa-numastat.node2.numa_hit
  15145257           -22.8%   11685459        numa-numastat.node3.local_node
  15186130           -22.8%   11717320        numa-numastat.node3.numa_hit
      1.04           +11.4%       1.16        irq_exception_noise.__do_page_fault.60th
      1.07           +22.5%       1.32        irq_exception_noise.__do_page_fault.70th
      1.11           +40.9%       1.57        irq_exception_noise.__do_page_fault.80th
      1.19           +65.2%       1.96        irq_exception_noise.__do_page_fault.90th
      1.29           +93.5%       2.50 ±  2%  irq_exception_noise.__do_page_fault.95th
      1.64          +202.5%       4.96 ±  4%  irq_exception_noise.__do_page_fault.99th
      1.07           +28.0%       1.37        irq_exception_noise.__do_page_fault.avg
    214103           +28.0%     274033        irq_exception_noise.__do_page_fault.sum
    372.75 ±  3%     +17.8%     439.25 ±  2%  irq_exception_noise.softirq_nr
    188.50 ± 11%     +26.7%     238.75 ± 10%  irq_exception_noise.softirq_time
   8826971 ±  3%     -15.6%    7452852 ±  3%  numa-vmstat.node0.numa_hit
   8798559 ±  3%     -15.5%    7433083 ±  4%  numa-vmstat.node0.numa_local
      3634 ± 55%    +100.6%       7291 ± 24%  numa-vmstat.node1.nr_inactive_anon
      3638 ± 55%    +100.4%       7291 ± 24%  numa-vmstat.node1.nr_zone_inactive_anon
   8654591           -21.8%    6764571        numa-vmstat.node1.numa_hit
   8529741           -22.2%    6635474        numa-vmstat.node1.numa_local
   8789111 ±  2%     -22.2%    6838852 ±  3%  numa-vmstat.node2.numa_hit
   8669691 ±  3%     -22.6%    6706417 ±  3%  numa-vmstat.node2.numa_local
   8870528 ±  2%     -21.2%    6989990        numa-vmstat.node3.numa_hit
   8745356 ±  2%     -21.4%    6873917        numa-vmstat.node3.numa_local
   5.1e+10           -25.3%  3.807e+10        perf-stat.i.branch-instructions
 4.024e+08           -24.3%  3.046e+08        perf-stat.i.branch-misses
     70.00            -8.4       61.59        perf-stat.i.cache-miss-rate%
 2.932e+08            -6.7%  2.737e+08        perf-stat.i.cache-misses
 4.174e+08            +6.3%  4.439e+08        perf-stat.i.cache-references
      7791            -3.4%       7529        perf-stat.i.context-switches
      1.69 ±  2%     +32.2%       2.23        perf-stat.i.cpi
      1435            +6.9%       1534        perf-stat.i.cycles-between-cache-misses
 7.381e+10           -25.2%  5.518e+10        perf-stat.i.dTLB-loads
 1.447e+09           -26.0%  1.072e+09        perf-stat.i.dTLB-store-misses
 4.045e+10           -25.1%  3.031e+10        perf-stat.i.dTLB-stores
     68.74           -27.5       41.27        perf-stat.i.iTLB-load-miss-rate%
 1.882e+08           -24.9%  1.413e+08        perf-stat.i.iTLB-load-misses
  94586813 ±  5%    +147.3%  2.339e+08        perf-stat.i.iTLB-loads
 2.512e+11           -25.2%  1.879e+11        perf-stat.i.instructions
      0.60           -25.5%       0.45        perf-stat.i.ipc
  87236715           -25.5%   64948201        perf-stat.i.minor-faults
      1.27 ± 34%      +3.5        4.75 ±  5%  perf-stat.i.node-load-miss-rate%
    371727 ±  8%    +291.3%    1454574 ±  2%  perf-stat.i.node-load-misses
  40821938           -27.1%   29771040        perf-stat.i.node-loads
      7.55 ±  5%      +8.2       15.80        perf-stat.i.node-store-miss-rate%
   6885297           +79.9%   12389289        perf-stat.i.node-store-misses
  89036136           -25.5%   66289356        perf-stat.i.node-stores
  87237611           -25.5%   64948420        perf-stat.i.page-faults
      1.66           +42.2%       2.36        perf-stat.overall.MPKI
      0.79            +0.0        0.80        perf-stat.overall.branch-miss-rate%
     70.23            -8.6       61.65        perf-stat.overall.cache-miss-rate%
      1.65           +34.8%       2.22        perf-stat.overall.cpi
      1414            +8.0%       1527        perf-stat.overall.cycles-between-cache-misses
      0.01 ± 13%      +0.0        0.01 ± 16%  perf-stat.overall.dTLB-load-miss-rate%
      3.45            -0.0        3.41        perf-stat.overall.dTLB-store-miss-rate%
     66.57 ±  2%     -28.9       37.66        perf-stat.overall.iTLB-load-miss-rate%
      0.61           -25.8%       0.45        perf-stat.overall.ipc
      0.90 ±  9%      +3.8        4.66 ±  2%  perf-stat.overall.node-load-miss-rate%
      7.18            +8.6       15.75        perf-stat.overall.node-store-miss-rate%
 5.079e+10           -25.3%  3.793e+10        perf-stat.ps.branch-instructions
 4.011e+08           -24.3%  3.037e+08        perf-stat.ps.branch-misses
  2.92e+08            -6.6%  2.726e+08        perf-stat.ps.cache-misses
 4.158e+08            +6.4%  4.423e+08        perf-stat.ps.cache-references
      7755            -3.2%       7509        perf-stat.ps.context-switches
 7.351e+10           -25.2%  5.498e+10        perf-stat.ps.dTLB-loads
 1.441e+09           -25.9%  1.068e+09        perf-stat.ps.dTLB-store-misses
 4.028e+10           -25.0%   3.02e+10        perf-stat.ps.dTLB-stores
 1.874e+08           -24.9%  1.407e+08        perf-stat.ps.iTLB-load-misses
  94208530 ±  5%    +147.3%   2.33e+08        perf-stat.ps.iTLB-loads
 2.502e+11           -25.2%  1.872e+11        perf-stat.ps.instructions
  86898473           -25.5%   64708711        perf-stat.ps.minor-faults
    371049 ±  8%    +290.7%    1449665 ±  2%  perf-stat.ps.node-load-misses
  40664993           -27.1%   29662127        perf-stat.ps.node-loads
   6859094           +80.0%   12344092        perf-stat.ps.node-store-misses
  88694004           -25.5%   66047901        perf-stat.ps.node-stores
  86899384           -25.5%   64708780        perf-stat.ps.page-faults
 7.618e+13           -25.5%  5.673e+13        perf-stat.total.instructions
     13965 ±  7%     -12.3%      12250 ±  3%  softirqs.CPU104.RCU
     13818 ±  6%     -11.9%      12167 ±  4%  softirqs.CPU105.RCU
     13944 ±  6%     -12.3%      12231 ±  4%  softirqs.CPU106.RCU
     13932 ±  8%     -12.2%      12237 ±  4%  softirqs.CPU107.RCU
     13838 ±  6%     -10.9%      12330 ±  4%  softirqs.CPU109.RCU
     13524 ±  6%     -10.0%      12174 ±  4%  softirqs.CPU111.RCU
     15248 ± 10%     -14.3%      13068 ±  8%  softirqs.CPU112.RCU
     14832 ±  7%     -13.7%      12799 ±  4%  softirqs.CPU113.RCU
     14741 ±  8%     -11.0%      13117 ±  6%  softirqs.CPU114.RCU
     14729 ±  8%     -14.3%      12616 ±  3%  softirqs.CPU115.RCU
     15234 ±  6%     -16.8%      12676 ±  5%  softirqs.CPU116.RCU
     14968 ±  7%     -15.4%      12656 ±  5%  softirqs.CPU117.RCU
     15220 ±  8%     -17.8%      12515 ±  4%  softirqs.CPU118.RCU
     15680 ±  7%     -13.5%      13559 ±  4%  softirqs.CPU120.RCU
     14621 ±  8%     -12.3%      12821 ±  4%  softirqs.CPU123.RCU
     16075 ± 11%     -19.2%      12983 ±  4%  softirqs.CPU13.RCU
     13799 ± 10%     -14.3%      11823 ±  3%  softirqs.CPU133.RCU
     13752 ±  9%     -15.2%      11659 ±  5%  softirqs.CPU134.RCU
     13855 ±  9%     -14.0%      11915 ±  4%  softirqs.CPU138.RCU
     13601 ±  9%     -15.5%      11499 ±  4%  softirqs.CPU142.RCU
     13840 ± 11%     -19.4%      11154 ± 14%  softirqs.CPU145.RCU
     13154 ±  7%     -12.5%      11505 ±  3%  softirqs.CPU147.RCU
     13396 ±  7%     -13.2%      11622 ±  3%  softirqs.CPU148.RCU
     13392 ±  7%     -13.4%      11595 ±  4%  softirqs.CPU150.RCU
     13335 ±  6%     -13.0%      11607 ±  4%  softirqs.CPU151.RCU
     13446 ±  6%     -18.1%      11013 ± 13%  softirqs.CPU152.RCU
     13447 ±  6%     -16.9%      11179 ±  3%  softirqs.CPU153.RCU
     13557 ±  9%     -14.3%      11617 ±  3%  softirqs.CPU154.RCU
     13282 ±  8%     -13.1%      11547 ±  3%  softirqs.CPU155.RCU
     13098 ±  8%     -12.2%      11502 ±  3%  softirqs.CPU158.RCU
     13096 ±  8%     -12.0%      11528 ±  3%  softirqs.CPU159.RCU
     14572 ±  9%     -13.0%      12683 ±  5%  softirqs.CPU160.RCU
     14327 ±  5%     -12.7%      12510 ±  5%  softirqs.CPU161.RCU
     14348 ±  6%     -11.1%      12751 ±  4%  softirqs.CPU162.RCU
     14213 ±  6%     -10.7%      12692 ±  4%  softirqs.CPU163.RCU
     14249 ±  6%     -12.1%      12524 ±  5%  softirqs.CPU164.RCU
     14234 ±  6%     -12.0%      12523 ±  6%  softirqs.CPU165.RCU
     14315 ±  5%     -12.2%      12561 ±  5%  softirqs.CPU166.RCU
     13999 ±  6%     -10.2%      12574 ±  5%  softirqs.CPU167.RCU
     15604 ±  6%     -12.7%      13627 ±  3%  softirqs.CPU17.RCU
     15087 ± 10%     -15.8%      12706 ±  4%  softirqs.CPU174.RCU
     13327 ±  8%     -11.6%      11776 ±  7%  softirqs.CPU185.RCU
     13851 ±  9%     -19.4%      11162 ±  4%  softirqs.CPU187.RCU
     15629 ±  6%     -12.4%      13685 ±  4%  softirqs.CPU20.RCU
     15723 ±  6%     -11.9%      13857 ±  6%  softirqs.CPU21.RCU
     16114 ±  7%     -17.6%      13275 ±  3%  softirqs.CPU22.RCU
     15767 ±  6%     -17.7%      12972 ±  8%  softirqs.CPU23.RCU
     16746 ±  8%     -13.9%      14417 ±  3%  softirqs.CPU24.RCU
     14317 ±  5%     -11.5%      12667 ±  3%  softirqs.CPU3.RCU
     14121 ±  9%     -12.9%      12299 ±  4%  softirqs.CPU32.RCU
     14184 ±  8%     -13.7%      12242 ±  4%  softirqs.CPU38.RCU
     14239 ±  9%     -13.0%      12394 ±  4%  softirqs.CPU40.RCU
     15062 ±  8%     -17.0%      12497 ±  4%  softirqs.CPU41.RCU
     14218 ±  8%     -13.5%      12299 ±  4%  softirqs.CPU42.RCU
     14305 ±  8%     -11.8%      12623        softirqs.CPU45.RCU
     14295 ±  8%     -15.5%      12080 ±  8%  softirqs.CPU46.RCU
     14199 ±  9%     -12.7%      12397 ±  4%  softirqs.CPU47.RCU
     16386 ± 20%     -21.3%      12892 ±  2%  softirqs.CPU5.RCU
     14976 ±  5%     -13.0%      13026 ±  5%  softirqs.CPU65.RCU
     14809 ±  5%     -12.6%      12942 ±  4%  softirqs.CPU66.RCU
     15051 ±  5%     -14.5%      12865 ±  4%  softirqs.CPU68.RCU
     15246 ±  4%     -15.4%      12900 ±  3%  softirqs.CPU69.RCU
     14766 ±  5%     -14.6%      12617 ±  7%  softirqs.CPU70.RCU
     14623 ±  6%     -11.4%      12949 ±  5%  softirqs.CPU71.RCU
     15793 ± 11%     -17.6%      13009 ±  3%  softirqs.CPU8.RCU
     13773 ±  7%     -12.6%      12032 ±  4%  softirqs.CPU82.RCU
     14870 ±  6%     -13.3%      12894 ±  3%  softirqs.CPU9.RCU
     14727 ± 10%     -17.6%      12135 ±  4%  softirqs.CPU91.RCU
     14321 ±  5%     -14.0%      12313 ±  5%  softirqs.CPU92.RCU
     81.90            -4.5       77.37        perf-profile.calltrace.cycles-pp.page_fault.testcase
      9.87            -1.1        8.80        perf-profile.calltrace.cycles-pp.__do_fault.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault
      9.50            -1.0        8.52        perf-profile.calltrace.cycles-pp.shmem_fault.__do_fault.__handle_mm_fault.handle_mm_fault.__do_page_fault
      8.17            -0.7        7.49        perf-profile.calltrace.cycles-pp.shmem_getpage_gfp.shmem_fault.__do_fault.__handle_mm_fault.handle_mm_fault
      5.31            -0.6        4.68        perf-profile.calltrace.cycles-pp.find_get_entry.find_lock_entry.shmem_getpage_gfp.shmem_fault.__do_fault
      7.06            -0.6        6.45        perf-profile.calltrace.cycles-pp.swapgs_restore_regs_and_return_to_usermode.testcase
      2.44            -0.6        1.83        perf-profile.calltrace.cycles-pp.xas_load.find_get_entry.find_lock_entry.shmem_getpage_gfp.shmem_fault
      2.60            -0.5        2.10        perf-profile.calltrace.cycles-pp.fault_dirty_shared_page.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault
      1.82            -0.5        1.34        perf-profile.calltrace.cycles-pp.__do_page_fault.return_to_handler.testcase
      1.82            -0.5        1.34        perf-profile.calltrace.cycles-pp.ftrace_graph_caller.__do_page_fault.return_to_handler.testcase
      1.82            -0.5        1.34        perf-profile.calltrace.cycles-pp.return_to_handler.testcase
      1.81            -0.5        1.33        perf-profile.calltrace.cycles-pp.prepare_ftrace_return.ftrace_graph_caller.__do_page_fault.return_to_handler.testcase
      1.75            -0.5        1.28        perf-profile.calltrace.cycles-pp.function_graph_enter.prepare_ftrace_return.ftrace_graph_caller.__do_page_fault.return_to_handler
      1.76            -0.4        1.35        perf-profile.calltrace.cycles-pp.__perf_sw_event.__do_page_fault.do_page_fault.page_fault.testcase
      7.17            -0.4        6.75        perf-profile.calltrace.cycles-pp.find_lock_entry.shmem_getpage_gfp.shmem_fault.__do_fault.__handle_mm_fault
      5.85            -0.4        5.43        perf-profile.calltrace.cycles-pp.ftrace_graph_caller.__do_page_fault.do_page_fault.page_fault.testcase
      1.36            -0.3        1.04        perf-profile.calltrace.cycles-pp.___perf_sw_event.__perf_sw_event.__do_page_fault.do_page_fault.page_fault
      0.84            -0.3        0.53        perf-profile.calltrace.cycles-pp.set_page_dirty.fault_dirty_shared_page.__handle_mm_fault.handle_mm_fault.__do_page_fault
      1.22            -0.3        0.92        perf-profile.calltrace.cycles-pp.prepare_exit_to_usermode.swapgs_restore_regs_and_return_to_usermode.testcase
      1.11            -0.3        0.81        perf-profile.calltrace.cycles-pp.trace_clock_local.function_graph_enter.prepare_ftrace_return.ftrace_graph_caller.__do_page_fault
      5.35            -0.3        5.07        perf-profile.calltrace.cycles-pp.prepare_ftrace_return.ftrace_graph_caller.__do_page_fault.do_page_fault.page_fault
      0.98            -0.3        0.71        perf-profile.calltrace.cycles-pp.sched_clock.trace_clock_local.function_graph_enter.prepare_ftrace_return.ftrace_graph_caller
      0.99            -0.3        0.73        perf-profile.calltrace.cycles-pp.native_sched_clock.sched_clock.trace_clock_local.function_graph_enter.prepare_ftrace_return
      1.23 ±  2%      -0.2        0.98 ±  2%  perf-profile.calltrace.cycles-pp.___perf_sw_event.__perf_sw_event.do_page_fault.page_fault.testcase
      1.02            -0.2        0.81        perf-profile.calltrace.cycles-pp.vmacache_find.find_vma.__do_page_fault.do_page_fault.page_fault
      5.03            -0.2        4.83        perf-profile.calltrace.cycles-pp.function_graph_enter.prepare_ftrace_return.ftrace_graph_caller.__do_page_fault.do_page_fault
      1.12            -0.2        0.94        perf-profile.calltrace.cycles-pp.find_vma.__do_page_fault.do_page_fault.page_fault.testcase
      1.20            -0.2        1.01        perf-profile.calltrace.cycles-pp.file_update_time.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault
      0.85            -0.2        0.67        perf-profile.calltrace.cycles-pp.__set_page_dirty_no_writeback.fault_dirty_shared_page.__handle_mm_fault.handle_mm_fault.__do_page_fault
      0.71            -0.2        0.54        perf-profile.calltrace.cycles-pp.__set_page_dirty_no_writeback.unmap_page_range.unmap_vmas.unmap_region.__do_munmap
      1.73            -0.1        1.58        perf-profile.calltrace.cycles-pp.__perf_sw_event.do_page_fault.page_fault.testcase
      0.76            -0.1        0.64 ±  2%  perf-profile.calltrace.cycles-pp.tlb_flush_mmu.unmap_page_range.unmap_vmas.unmap_region.__do_munmap
      4.64            -0.1        4.55        perf-profile.calltrace.cycles-pp.trace_graph_entry.function_graph_enter.prepare_ftrace_return.ftrace_graph_caller.__do_page_fault
      0.68 ±  3%      -0.1        0.61        perf-profile.calltrace.cycles-pp.current_time.file_update_time.__handle_mm_fault.handle_mm_fault.__do_page_fault
      0.55            +0.1        0.64        perf-profile.calltrace.cycles-pp.unlock_page.fault_dirty_shared_page.__handle_mm_fault.handle_mm_fault.__do_page_fault
      0.70            +0.3        0.97        perf-profile.calltrace.cycles-pp._raw_spin_lock.alloc_set_pte.finish_fault.__handle_mm_fault.handle_mm_fault
      0.61            +0.4        1.03        perf-profile.calltrace.cycles-pp.up_read.__do_page_fault.do_page_fault.page_fault.testcase
      0.00            +0.8        0.82        perf-profile.calltrace.cycles-pp.lock_page_memcg.page_remove_rmap.unmap_page_range.unmap_vmas.unmap_region
      0.59            +1.2        1.75        perf-profile.calltrace.cycles-pp.down_read_trylock.__do_page_fault.do_page_fault.page_fault.testcase
     79.30            +1.2       80.50        perf-profile.calltrace.cycles-pp.testcase
      0.00            +2.7        2.67        perf-profile.calltrace.cycles-pp.lock_page_memcg.page_add_file_rmap.alloc_set_pte.finish_fault.__handle_mm_fault
     22.92            +3.4       26.37        perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
      0.54            +3.7        4.26        perf-profile.calltrace.cycles-pp.__count_memcg_events.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
      1.30            +3.9        5.17        perf-profile.calltrace.cycles-pp.__mod_lruvec_state.page_add_file_rmap.alloc_set_pte.finish_fault.__handle_mm_fault
      7.93            +4.0       11.88        perf-profile.calltrace.cycles-pp.munmap
      7.88            +4.0       11.84        perf-profile.calltrace.cycles-pp.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe.munmap
      7.88            +4.0       11.84        perf-profile.calltrace.cycles-pp.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe.munmap
      7.89            +4.0       11.85        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.munmap
      7.89            +4.0       11.85        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.munmap
      7.88            +4.0       11.84        perf-profile.calltrace.cycles-pp.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe
      7.88            +4.0       11.84        perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64
      7.86            +4.0       11.82        perf-profile.calltrace.cycles-pp.unmap_vmas.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap
      7.78            +4.0       11.77        perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.unmap_region.__do_munmap.__vm_munmap
      1.22            +4.0        5.26        perf-profile.calltrace.cycles-pp.__mod_lruvec_state.page_remove_rmap.unmap_page_range.unmap_vmas.unmap_region
      0.53            +4.1        4.58 ±  2%  perf-profile.calltrace.cycles-pp.__mod_memcg_state.__mod_lruvec_state.page_remove_rmap.unmap_page_range.unmap_vmas
      0.00            +4.4        4.44 ±  2%  perf-profile.calltrace.cycles-pp.__mod_memcg_state.__mod_lruvec_state.page_add_file_rmap.alloc_set_pte.finish_fault
      2.47            +4.8        7.29        perf-profile.calltrace.cycles-pp.page_remove_rmap.unmap_page_range.unmap_vmas.unmap_region.__do_munmap
      5.32            +6.1       11.46        perf-profile.calltrace.cycles-pp.finish_fault.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault
      5.01            +6.2       11.24        perf-profile.calltrace.cycles-pp.alloc_set_pte.finish_fault.__handle_mm_fault.handle_mm_fault.__do_page_fault
     40.44            +6.3       46.71        perf-profile.calltrace.cycles-pp.do_page_fault.page_fault.testcase
      2.52            +6.3        8.84        perf-profile.calltrace.cycles-pp.page_add_file_rmap.alloc_set_pte.finish_fault.__handle_mm_fault.handle_mm_fault
     38.29            +6.5       44.81        perf-profile.calltrace.cycles-pp.__do_page_fault.do_page_fault.page_fault.testcase
     25.85            +6.6       32.41        perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.do_page_fault.page_fault.testcase
     92.00            -4.0       88.05        perf-profile.children.cycles-pp.testcase
      6.03            -1.6        4.48        perf-profile.children.cycles-pp.sync_regs
      9.89            -1.1        8.81        perf-profile.children.cycles-pp.__do_fault
      9.53            -1.0        8.54        perf-profile.children.cycles-pp.shmem_fault
      7.71            -0.9        6.80        perf-profile.children.cycles-pp.ftrace_graph_caller
      7.21            -0.8        6.43        perf-profile.children.cycles-pp.prepare_ftrace_return
      8.18            -0.7        7.50        perf-profile.children.cycles-pp.shmem_getpage_gfp
      6.81            -0.7        6.13        perf-profile.children.cycles-pp.function_graph_enter
      5.36            -0.6        4.72        perf-profile.children.cycles-pp.find_get_entry
      2.53            -0.6        1.91        perf-profile.children.cycles-pp.xas_load
      7.07            -0.6        6.45        perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode
      2.65            -0.6        2.08        perf-profile.children.cycles-pp.___perf_sw_event
      3.51            -0.6        2.94        perf-profile.children.cycles-pp.__perf_sw_event
      2.69            -0.5        2.16        perf-profile.children.cycles-pp.fault_dirty_shared_page
      1.48            -0.5        0.97        perf-profile.children.cycles-pp.set_page_dirty
      1.82            -0.5        1.34        perf-profile.children.cycles-pp.return_to_handler
      7.24            -0.4        6.82        perf-profile.children.cycles-pp.find_lock_entry
      1.46            -0.4        1.08        perf-profile.children.cycles-pp.page_mapping
      1.60            -0.4        1.24        perf-profile.children.cycles-pp.__set_page_dirty_no_writeback
      1.25            -0.3        0.94        perf-profile.children.cycles-pp.prepare_exit_to_usermode
      1.13            -0.3        0.83        perf-profile.children.cycles-pp.trace_clock_local
      1.03            -0.3        0.75        perf-profile.children.cycles-pp.sched_clock
      1.00            -0.3        0.73        perf-profile.children.cycles-pp.native_sched_clock
      1.01            -0.2        0.76 ±  2%  perf-profile.children.cycles-pp.__mod_node_page_state
      1.05            -0.2        0.82        perf-profile.children.cycles-pp.vmacache_find
      1.23            -0.2        1.04        perf-profile.children.cycles-pp.file_update_time
      1.15            -0.2        0.97        perf-profile.children.cycles-pp.find_vma
      7.79            -0.2        7.61        perf-profile.children.cycles-pp.native_irq_return_iret
      0.65            -0.1        0.50        perf-profile.children.cycles-pp.pmd_devmap_trans_unstable
      4.79            -0.1        4.66        perf-profile.children.cycles-pp.trace_graph_entry
      0.54 ±  2%      -0.1        0.41 ±  3%  perf-profile.children.cycles-pp.xas_start
      0.47            -0.1        0.35        perf-profile.children.cycles-pp.__trace_graph_entry
      0.77            -0.1        0.65 ±  2%  perf-profile.children.cycles-pp.tlb_flush_mmu
      0.23 ±  9%      -0.1        0.12 ±  5%  perf-profile.children.cycles-pp.retint_user
      0.45            -0.1        0.34        perf-profile.children.cycles-pp.__x86_indirect_thunk_rax
      0.35            -0.1        0.25        perf-profile.children.cycles-pp.trace_buffer_lock_reserve
      0.70            -0.1        0.60        perf-profile.children.cycles-pp.___might_sleep
      0.37            -0.1        0.28        perf-profile.children.cycles-pp.mark_page_accessed
      0.27 ± 18%      -0.1        0.17 ±  2%  perf-profile.children.cycles-pp.mem_cgroup_from_task
      0.39 ±  2%      -0.1        0.30        perf-profile.children.cycles-pp._cond_resched
      0.35 ±  2%      -0.1        0.27        perf-profile.children.cycles-pp.ftrace_lookup_ip
      0.23 ±  3%      -0.1        0.15 ±  4%  perf-profile.children.cycles-pp.__tlb_remove_page_size
      0.72 ±  3%      -0.1        0.65        perf-profile.children.cycles-pp.current_time
      0.28            -0.1        0.20 ±  2%  perf-profile.children.cycles-pp.__might_sleep
      0.20            -0.1        0.14 ±  3%  perf-profile.children.cycles-pp._vm_normal_page
      0.56            -0.1        0.50 ±  2%  perf-profile.children.cycles-pp.release_pages
      0.22            -0.1        0.16 ±  4%  perf-profile.children.cycles-pp.ring_buffer_lock_reserve
      0.23            -0.1        0.18 ±  2%  perf-profile.children.cycles-pp.fpregs_assert_state_consistent
      0.18 ±  2%      -0.1        0.12 ±  4%  perf-profile.children.cycles-pp.pmd_pfn
      0.22 ±  3%      -0.0        0.17 ±  4%  perf-profile.children.cycles-pp.perf_exclude_event
      0.21 ±  2%      -0.0        0.17 ±  3%  perf-profile.children.cycles-pp.pmd_page_vaddr
      0.20 ±  2%      -0.0        0.15 ±  3%  perf-profile.children.cycles-pp.page_rmapping
      0.20            -0.0        0.15 ±  2%  perf-profile.children.cycles-pp.free_pages_and_swap_cache
      0.15 ±  2%      -0.0        0.11 ±  4%  perf-profile.children.cycles-pp.PageHuge
      0.13 ±  3%      -0.0        0.09 ±  4%  perf-profile.children.cycles-pp.native_iret
      0.17            -0.0        0.14        perf-profile.children.cycles-pp.rcu_all_qs
      0.10 ±  4%      -0.0        0.08 ±  5%  perf-profile.children.cycles-pp.perf_swevent_event
      0.09 ±  5%      -0.0        0.07 ±  7%  perf-profile.children.cycles-pp.pte_alloc_one
      0.07 ±  5%      -0.0        0.05 ±  9%  perf-profile.children.cycles-pp.get_page_from_freelist
      0.08 ±  5%      -0.0        0.06        perf-profile.children.cycles-pp.__alloc_pages_nodemask
      0.56            +0.1        0.64        perf-profile.children.cycles-pp.unlock_page
      0.12 ±  4%      +0.1        0.27        perf-profile.children.cycles-pp.__unlock_page_memcg
      0.74            +0.3        1.01        perf-profile.children.cycles-pp._raw_spin_lock
      0.61            +0.4        1.03        perf-profile.children.cycles-pp.up_read
     61.67            +0.7       62.41        perf-profile.children.cycles-pp.page_fault
      0.61            +1.2        1.77        perf-profile.children.cycles-pp.down_read_trylock
      0.35            +3.2        3.51        perf-profile.children.cycles-pp.lock_page_memcg
     23.05            +3.4       26.47        perf-profile.children.cycles-pp.__handle_mm_fault
      0.54            +3.7        4.26        perf-profile.children.cycles-pp.__count_memcg_events
      7.93            +4.0       11.88        perf-profile.children.cycles-pp.munmap
      7.93            +4.0       11.89        perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
      7.93            +4.0       11.89        perf-profile.children.cycles-pp.do_syscall_64
      7.88            +4.0       11.84        perf-profile.children.cycles-pp.__x64_sys_munmap
      7.88            +4.0       11.84        perf-profile.children.cycles-pp.__vm_munmap
      7.88            +4.0       11.84        perf-profile.children.cycles-pp.__do_munmap
      7.88            +4.0       11.84        perf-profile.children.cycles-pp.unmap_region
      7.86            +4.0       11.82        perf-profile.children.cycles-pp.unmap_vmas
      7.86            +4.0       11.82        perf-profile.children.cycles-pp.unmap_page_range
      2.50            +4.8        7.33        perf-profile.children.cycles-pp.page_remove_rmap
     40.28            +6.0       46.28        perf-profile.children.cycles-pp.__do_page_fault
      5.36            +6.1       11.49        perf-profile.children.cycles-pp.finish_fault
      5.13            +6.2       11.32        perf-profile.children.cycles-pp.alloc_set_pte
     40.60            +6.2       46.82        perf-profile.children.cycles-pp.do_page_fault
      2.55            +6.3        8.87        perf-profile.children.cycles-pp.page_add_file_rmap
     26.02            +6.5       32.55        perf-profile.children.cycles-pp.handle_mm_fault
      2.61            +7.8       10.45        perf-profile.children.cycles-pp.__mod_lruvec_state
      1.01            +8.0        9.03 ±  2%  perf-profile.children.cycles-pp.__mod_memcg_state
     22.09            -5.7       16.41        perf-profile.self.cycles-pp.testcase
      5.95            -1.5        4.42        perf-profile.self.cycles-pp.sync_regs
      3.44            -0.8        2.62        perf-profile.self.cycles-pp.__handle_mm_fault
      2.15            -0.6        1.59        perf-profile.self.cycles-pp.handle_mm_fault
      2.35            -0.5        1.85        perf-profile.self.cycles-pp.___perf_sw_event
      2.03            -0.5        1.53        perf-profile.self.cycles-pp.xas_load
      1.58            -0.4        1.15        perf-profile.self.cycles-pp.__do_page_fault
      1.40            -0.4        1.04        perf-profile.self.cycles-pp.page_mapping
      1.45            -0.3        1.13        perf-profile.self.cycles-pp.__set_page_dirty_no_writeback
      1.16            -0.3        0.84        perf-profile.self.cycles-pp.alloc_set_pte
      1.30            -0.3        0.99        perf-profile.self.cycles-pp.shmem_fault
      5.81            -0.3        5.51        perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode
      0.99            -0.3        0.72        perf-profile.self.cycles-pp.function_graph_enter
      0.97            -0.3        0.71        perf-profile.self.cycles-pp.native_sched_clock
      0.90            -0.2        0.67 ±  6%  perf-profile.self.cycles-pp.shmem_getpage_gfp
      1.01            -0.2        0.79        perf-profile.self.cycles-pp.vmacache_find
      2.39            -0.2        2.17        perf-profile.self.cycles-pp.unmap_page_range
      0.92            -0.2        0.70        perf-profile.self.cycles-pp.prepare_exit_to_usermode
      0.53            -0.2        0.31        perf-profile.self.cycles-pp.set_page_dirty
      0.96            -0.2        0.75 ±  2%  perf-profile.self.cycles-pp.__mod_node_page_state
      7.76            -0.2        7.60        perf-profile.self.cycles-pp.native_irq_return_iret
      0.59            -0.1        0.45        perf-profile.self.cycles-pp.page_fault
      0.60            -0.1        0.47        perf-profile.self.cycles-pp.pmd_devmap_trans_unstable
      0.49            -0.1        0.36 ±  3%  perf-profile.self.cycles-pp.ftrace_graph_caller
      0.52 ±  2%      -0.1        0.40        perf-profile.self.cycles-pp.file_update_time
      0.47 ±  2%      -0.1        0.35 ±  4%  perf-profile.self.cycles-pp.xas_start
      0.23 ± 10%      -0.1        0.12 ±  5%  perf-profile.self.cycles-pp.retint_user
      0.42            -0.1        0.32        perf-profile.self.cycles-pp.__x86_indirect_thunk_rax
      0.69            -0.1        0.59        perf-profile.self.cycles-pp.___might_sleep
      0.35            -0.1        0.26        perf-profile.self.cycles-pp.prepare_ftrace_return
      0.32            -0.1        0.23        perf-profile.self.cycles-pp.do_page_fault
      0.26 ± 19%      -0.1        0.17 ±  2%  perf-profile.self.cycles-pp.mem_cgroup_from_task
      0.34 ±  2%      -0.1        0.25        perf-profile.self.cycles-pp.ftrace_lookup_ip
      0.34            -0.1        0.26        perf-profile.self.cycles-pp.mark_page_accessed
      0.27            -0.1        0.20 ±  2%  perf-profile.self.cycles-pp.fault_dirty_shared_page
      0.21 ±  3%      -0.1        0.14 ±  3%  perf-profile.self.cycles-pp.__tlb_remove_page_size
      0.55            -0.1        0.48 ±  2%  perf-profile.self.cycles-pp.release_pages
      0.25 ±  2%      -0.1        0.18 ±  2%  perf-profile.self.cycles-pp.__might_sleep
      0.32 ±  2%      -0.1        0.26 ±  4%  perf-profile.self.cycles-pp.current_time
      0.21 ±  2%      -0.1        0.15 ±  2%  perf-profile.self.cycles-pp._cond_resched
      0.26            -0.1        0.20 ±  3%  perf-profile.self.cycles-pp.__do_fault
      0.24 ±  4%      -0.1        0.18 ±  2%  perf-profile.self.cycles-pp.finish_fault
      0.22            -0.1        0.16 ±  4%  perf-profile.self.cycles-pp.ring_buffer_lock_reserve
      0.18            -0.1        0.12 ±  4%  perf-profile.self.cycles-pp._vm_normal_page
      0.22            -0.0        0.17 ±  2%  perf-profile.self.cycles-pp.fpregs_assert_state_consistent
      0.16 ±  2%      -0.0        0.11 ±  4%  perf-profile.self.cycles-pp.pmd_pfn
      0.20 ±  2%      -0.0        0.15        perf-profile.self.cycles-pp.free_pages_and_swap_cache
      0.20 ±  2%      -0.0        0.15 ±  4%  perf-profile.self.cycles-pp.pmd_page_vaddr
      0.18 ±  2%      -0.0        0.14 ±  3%  perf-profile.self.cycles-pp.perf_exclude_event
      0.16 ±  2%      -0.0        0.12 ±  5%  perf-profile.self.cycles-pp.page_rmapping
      0.13 ±  3%      -0.0        0.09        perf-profile.self.cycles-pp.native_iret
      0.15 ±  2%      -0.0        0.11        perf-profile.self.cycles-pp.__trace_graph_entry
      0.12 ±  3%      -0.0        0.09 ±  4%  perf-profile.self.cycles-pp.PageHuge
      0.11 ±  4%      -0.0        0.08        perf-profile.self.cycles-pp.trace_buffer_lock_reserve
      0.10            -0.0        0.08 ±  5%  perf-profile.self.cycles-pp.trace_clock_local
      0.10            -0.0        0.08 ±  5%  perf-profile.self.cycles-pp.perf_swevent_event
      0.13 ±  3%      -0.0        0.11        perf-profile.self.cycles-pp.rcu_all_qs
      0.12 ±  3%      +0.0        0.17        perf-profile.self.cycles-pp.find_vma
      3.94            +0.1        4.03        perf-profile.self.cycles-pp.trace_graph_entry
      0.53            +0.1        0.62        perf-profile.self.cycles-pp.unlock_page
      0.11 ±  4%      +0.1        0.25 ±  3%  perf-profile.self.cycles-pp.__unlock_page_memcg
      1.05            +0.1        1.19 ±  2%  perf-profile.self.cycles-pp.page_remove_rmap
      0.71            +0.3        0.99        perf-profile.self.cycles-pp._raw_spin_lock
      0.88 ±  2%      +0.4        1.28        perf-profile.self.cycles-pp.find_lock_entry
      0.59            +0.4        1.01 ±  2%  perf-profile.self.cycles-pp.up_read
      0.59            +1.1        1.74        perf-profile.self.cycles-pp.down_read_trylock
      0.31            +3.2        3.46        perf-profile.self.cycles-pp.lock_page_memcg
      0.52            +3.7        4.25        perf-profile.self.cycles-pp.__count_memcg_events
      0.97            +8.0        8.96 ±  2%  perf-profile.self.cycles-pp.__mod_memcg_state
    871.50 ± 42%     -49.3%     441.75 ± 48%  interrupts.32:PCI-MSI.26738689-edge.eth0-TxRx-0
   1306534 ±  7%     -11.5%    1156735        interrupts.CAL:Function_call_interrupts
     21692 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU0.TRM:Thermal_event_interrupts
      6825 ±  7%     -12.1%       5997        interrupts.CPU1.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU1.TRM:Thermal_event_interrupts
      6794 ±  7%     -11.0%       6047        interrupts.CPU10.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU10.TRM:Thermal_event_interrupts
      6847 ±  7%     -12.1%       6017        interrupts.CPU100.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU100.TRM:Thermal_event_interrupts
      6736 ±  8%     -10.7%       6018        interrupts.CPU101.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU101.TRM:Thermal_event_interrupts
      6871 ±  7%     -11.8%       6059        interrupts.CPU102.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU102.TRM:Thermal_event_interrupts
      6849 ±  7%     -11.7%       6047        interrupts.CPU103.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU103.TRM:Thermal_event_interrupts
      6847 ±  7%     -11.5%       6060        interrupts.CPU104.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU104.TRM:Thermal_event_interrupts
      6869 ±  7%     -11.8%       6058        interrupts.CPU105.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU105.TRM:Thermal_event_interrupts
      6820 ±  7%     -11.0%       6071        interrupts.CPU106.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU106.TRM:Thermal_event_interrupts
      6868 ±  7%     -11.6%       6074        interrupts.CPU107.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      14.25 ±108%  interrupts.CPU107.TRM:Thermal_event_interrupts
      6787 ±  7%     -10.6%       6070        interrupts.CPU108.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU108.TRM:Thermal_event_interrupts
      6830 ±  7%     -11.2%       6065        interrupts.CPU109.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU109.TRM:Thermal_event_interrupts
      6836 ±  8%     -11.4%       6055        interrupts.CPU11.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU11.TRM:Thermal_event_interrupts
      6809 ±  7%     -11.1%       6054        interrupts.CPU110.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU110.TRM:Thermal_event_interrupts
      6808 ±  7%     -11.1%       6054        interrupts.CPU111.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU111.TRM:Thermal_event_interrupts
      6819 ±  7%     -11.2%       6054        interrupts.CPU112.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU112.TRM:Thermal_event_interrupts
      6806 ±  7%     -11.0%       6055        interrupts.CPU113.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU113.TRM:Thermal_event_interrupts
      6793 ±  7%     -17.1%       5631 ± 13%  interrupts.CPU114.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU114.TRM:Thermal_event_interrupts
      6802 ±  7%     -11.6%       6014        interrupts.CPU115.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU115.TRM:Thermal_event_interrupts
      6791 ±  7%     -10.8%       6060        interrupts.CPU116.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU116.TRM:Thermal_event_interrupts
      6801 ±  7%     -11.0%       6054        interrupts.CPU117.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU117.TRM:Thermal_event_interrupts
      6842 ±  7%     -11.5%       6057        interrupts.CPU118.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU118.TRM:Thermal_event_interrupts
      6813 ±  7%     -10.9%       6067        interrupts.CPU119.CAL:Function_call_interrupts
     12.50 ± 66%   +1090.0%     148.75 ± 74%  interrupts.CPU119.RES:Rescheduling_interrupts
     21692 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU119.TRM:Thermal_event_interrupts
      6823 ±  8%     -11.4%       6048        interrupts.CPU12.CAL:Function_call_interrupts
    533.00 ± 77%    +171.0%       1444 ± 36%  interrupts.CPU12.RES:Rescheduling_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU12.TRM:Thermal_event_interrupts
      6733 ±  7%     -10.1%       6055        interrupts.CPU120.CAL:Function_call_interrupts
      6815 ±  7%     -11.1%       6061        interrupts.CPU121.CAL:Function_call_interrupts
      6817 ±  7%     -10.9%       6072        interrupts.CPU122.CAL:Function_call_interrupts
      6806 ±  7%     -10.8%       6070        interrupts.CPU123.CAL:Function_call_interrupts
      6829 ±  7%     -11.0%       6075        interrupts.CPU124.CAL:Function_call_interrupts
      6842 ±  6%     -11.3%       6070        interrupts.CPU125.CAL:Function_call_interrupts
      6847 ±  7%     -11.5%       6059        interrupts.CPU126.CAL:Function_call_interrupts
      6844 ±  7%     -11.4%       6065        interrupts.CPU127.CAL:Function_call_interrupts
      6839 ±  7%     -11.4%       6056        interrupts.CPU128.CAL:Function_call_interrupts
      6820 ±  6%     -11.2%       6054        interrupts.CPU129.CAL:Function_call_interrupts
      3852 ± 34%     +61.3%       6214        interrupts.CPU129.NMI:Non-maskable_interrupts
      3852 ± 34%     +61.3%       6214        interrupts.CPU129.PMI:Performance_monitoring_interrupts
    122.75 ±121%     -97.6%       3.00 ± 23%  interrupts.CPU129.RES:Rescheduling_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU13.TRM:Thermal_event_interrupts
      6845 ±  7%     -11.5%       6058        interrupts.CPU130.CAL:Function_call_interrupts
      6835 ±  7%     -11.5%       6046        interrupts.CPU131.CAL:Function_call_interrupts
      6826 ±  7%     -11.4%       6047        interrupts.CPU132.CAL:Function_call_interrupts
      6839 ±  7%     -11.5%       6050        interrupts.CPU133.CAL:Function_call_interrupts
      6832 ±  7%     -11.3%       6057        interrupts.CPU134.CAL:Function_call_interrupts
      6835 ±  7%     -11.5%       6051        interrupts.CPU135.CAL:Function_call_interrupts
      6813 ±  7%     -11.4%       6037        interrupts.CPU137.CAL:Function_call_interrupts
      6846 ±  7%     -11.8%       6035        interrupts.CPU138.CAL:Function_call_interrupts
      6823 ±  7%     -11.4%       6048        interrupts.CPU139.CAL:Function_call_interrupts
      6852 ±  8%     -11.7%       6050        interrupts.CPU14.CAL:Function_call_interrupts
    245.50 ± 74%    +162.5%     644.50 ± 65%  interrupts.CPU14.RES:Rescheduling_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU14.TRM:Thermal_event_interrupts
      6787 ±  7%     -10.9%       6044        interrupts.CPU140.CAL:Function_call_interrupts
      6802 ±  7%     -11.2%       6042        interrupts.CPU141.CAL:Function_call_interrupts
      6839 ±  7%     -11.6%       6046        interrupts.CPU142.CAL:Function_call_interrupts
      6823 ±  7%     -11.3%       6051        interrupts.CPU143.CAL:Function_call_interrupts
      6693 ±  8%     -11.1%       5954 ±  2%  interrupts.CPU144.CAL:Function_call_interrupts
      6807 ±  7%     -11.5%       6025        interrupts.CPU145.CAL:Function_call_interrupts
      6825 ±  7%     -11.4%       6045        interrupts.CPU147.CAL:Function_call_interrupts
      6861 ±  7%     -11.9%       6042        interrupts.CPU148.CAL:Function_call_interrupts
      6855 ±  7%     -11.8%       6050        interrupts.CPU149.CAL:Function_call_interrupts
      6846 ±  8%     -11.8%       6037        interrupts.CPU15.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU15.TRM:Thermal_event_interrupts
      6832 ±  7%     -11.5%       6046        interrupts.CPU150.CAL:Function_call_interrupts
      6651 ±  6%      -9.3%       6034        interrupts.CPU151.CAL:Function_call_interrupts
      6860 ±  7%     -12.0%       6034        interrupts.CPU153.CAL:Function_call_interrupts
      6843 ±  7%     -11.8%       6034        interrupts.CPU154.CAL:Function_call_interrupts
      6865 ±  7%     -11.9%       6050        interrupts.CPU155.CAL:Function_call_interrupts
      6862 ±  7%     -12.2%       6026        interrupts.CPU156.CAL:Function_call_interrupts
      6882 ±  8%     -12.3%       6035        interrupts.CPU157.CAL:Function_call_interrupts
      6854 ±  7%     -12.1%       6022        interrupts.CPU158.CAL:Function_call_interrupts
      6856 ±  7%     -11.8%       6046        interrupts.CPU159.CAL:Function_call_interrupts
      6838 ±  8%     -11.8%       6033        interrupts.CPU16.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU16.TRM:Thermal_event_interrupts
      6860 ±  7%     -11.9%       6044        interrupts.CPU160.CAL:Function_call_interrupts
      6849 ±  7%     -11.8%       6042        interrupts.CPU161.CAL:Function_call_interrupts
      6836 ±  7%     -11.4%       6054        interrupts.CPU162.CAL:Function_call_interrupts
      6850 ±  7%     -13.6%       5917 ±  3%  interrupts.CPU163.CAL:Function_call_interrupts
      6840 ±  7%     -11.5%       6056        interrupts.CPU164.CAL:Function_call_interrupts
      6843 ±  7%     -11.7%       6043        interrupts.CPU165.CAL:Function_call_interrupts
      6858 ±  7%     -11.7%       6053        interrupts.CPU166.CAL:Function_call_interrupts
      6855 ±  7%     -11.8%       6043        interrupts.CPU167.CAL:Function_call_interrupts
      6855 ±  7%     -11.1%       6095        interrupts.CPU169.CAL:Function_call_interrupts
      6826 ±  8%     -11.3%       6056        interrupts.CPU17.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU17.TRM:Thermal_event_interrupts
      6866 ±  7%     -15.8%       5782 ±  8%  interrupts.CPU170.CAL:Function_call_interrupts
      6867 ±  7%     -11.9%       6049        interrupts.CPU171.CAL:Function_call_interrupts
      6866 ±  7%     -11.9%       6052        interrupts.CPU172.CAL:Function_call_interrupts
      6869 ±  7%     -11.9%       6053        interrupts.CPU173.CAL:Function_call_interrupts
      6884 ±  7%     -12.1%       6051        interrupts.CPU174.CAL:Function_call_interrupts
      6858 ±  7%     -13.0%       5963 ±  3%  interrupts.CPU175.CAL:Function_call_interrupts
      6818 ±  7%     -11.2%       6056        interrupts.CPU176.CAL:Function_call_interrupts
      6887 ±  7%     -12.2%       6049        interrupts.CPU177.CAL:Function_call_interrupts
      6849 ±  7%     -11.7%       6047        interrupts.CPU179.CAL:Function_call_interrupts
      6855 ±  7%     -14.3%       5877 ±  4%  interrupts.CPU18.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU18.TRM:Thermal_event_interrupts
      6879 ±  8%     -12.1%       6044        interrupts.CPU181.CAL:Function_call_interrupts
      6879 ±  8%     -12.0%       6054        interrupts.CPU182.CAL:Function_call_interrupts
      6915 ±  7%     -12.6%       6046        interrupts.CPU183.CAL:Function_call_interrupts
      6892 ±  8%     -12.4%       6039        interrupts.CPU184.CAL:Function_call_interrupts
      6877 ±  7%     -12.1%       6042        interrupts.CPU185.CAL:Function_call_interrupts
      6887 ±  8%     -12.5%       6024        interrupts.CPU186.CAL:Function_call_interrupts
      6851 ±  8%     -11.9%       6038        interrupts.CPU187.CAL:Function_call_interrupts
      6855 ±  7%     -11.7%       6053        interrupts.CPU188.CAL:Function_call_interrupts
      6882 ±  7%     -14.5%       5887 ±  5%  interrupts.CPU189.CAL:Function_call_interrupts
      6843 ±  8%     -19.3%       5520 ± 16%  interrupts.CPU19.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU19.TRM:Thermal_event_interrupts
      6852 ±  7%     -11.6%       6060        interrupts.CPU190.CAL:Function_call_interrupts
      6876 ±  7%     -11.9%       6056        interrupts.CPU191.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU2.TRM:Thermal_event_interrupts
      6848 ±  8%     -12.0%       6030        interrupts.CPU20.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU20.TRM:Thermal_event_interrupts
      6820 ±  8%     -11.3%       6046        interrupts.CPU21.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU21.TRM:Thermal_event_interrupts
      6824 ±  8%     -11.3%       6050        interrupts.CPU22.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU22.TRM:Thermal_event_interrupts
      6828 ±  8%     -11.4%       6047        interrupts.CPU23.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU23.TRM:Thermal_event_interrupts
      6856 ±  7%     -13.2%       5951 ±  2%  interrupts.CPU24.CAL:Function_call_interrupts
      6817 ±  7%     -11.3%       6046        interrupts.CPU25.CAL:Function_call_interrupts
      6840 ±  7%     -11.7%       6039        interrupts.CPU26.CAL:Function_call_interrupts
      6824 ±  7%     -12.9%       5946 ±  2%  interrupts.CPU27.CAL:Function_call_interrupts
    137.00 ± 74%     -71.7%      38.75 ±150%  interrupts.CPU27.RES:Rescheduling_interrupts
      6851 ±  7%     -12.2%       6018        interrupts.CPU28.CAL:Function_call_interrupts
      6833 ±  7%     -11.3%       6062        interrupts.CPU29.CAL:Function_call_interrupts
     97.50 ± 92%     -92.1%       7.75 ± 69%  interrupts.CPU29.RES:Rescheduling_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU3.TRM:Thermal_event_interrupts
      6814 ±  8%     -11.2%       6052        interrupts.CPU30.CAL:Function_call_interrupts
    234.00 ±103%     -82.2%      41.75 ±120%  interrupts.CPU30.RES:Rescheduling_interrupts
      6811 ±  8%     -11.1%       6052        interrupts.CPU31.CAL:Function_call_interrupts
      6813 ±  8%     -11.1%       6059        interrupts.CPU32.CAL:Function_call_interrupts
      6808 ±  8%     -11.0%       6059        interrupts.CPU33.CAL:Function_call_interrupts
      6842 ±  8%     -11.4%       6062        interrupts.CPU34.CAL:Function_call_interrupts
      6823 ±  8%     -11.3%       6049        interrupts.CPU35.CAL:Function_call_interrupts
      6838 ±  8%     -10.9%       6092        interrupts.CPU36.CAL:Function_call_interrupts
    194.50 ± 41%     -80.3%      38.25 ± 93%  interrupts.CPU36.RES:Rescheduling_interrupts
      6835 ±  8%     -11.4%       6057        interrupts.CPU37.CAL:Function_call_interrupts
      6802 ±  7%     -11.0%       6052        interrupts.CPU38.CAL:Function_call_interrupts
    211.25 ± 74%     -89.7%      21.75 ± 82%  interrupts.CPU38.RES:Rescheduling_interrupts
      6812 ±  7%     -11.1%       6055        interrupts.CPU39.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU4.TRM:Thermal_event_interrupts
      6791 ±  7%     -10.8%       6057        interrupts.CPU40.CAL:Function_call_interrupts
    112.25 ± 21%     -75.1%      28.00 ± 82%  interrupts.CPU40.RES:Rescheduling_interrupts
      6798 ±  7%     -11.0%       6048        interrupts.CPU42.CAL:Function_call_interrupts
      6829 ±  7%     -11.3%       6057        interrupts.CPU44.CAL:Function_call_interrupts
    586.50 ±141%     -93.6%      37.50 ± 71%  interrupts.CPU45.RES:Rescheduling_interrupts
      6816 ±  7%     -11.2%       6051        interrupts.CPU46.CAL:Function_call_interrupts
      6833 ±  7%     -11.4%       6055        interrupts.CPU47.CAL:Function_call_interrupts
    493.00 ± 87%     -92.8%      35.50 ± 92%  interrupts.CPU48.RES:Rescheduling_interrupts
      6800 ±  7%     -23.1%       5230 ± 23%  interrupts.CPU49.CAL:Function_call_interrupts
      6712 ±  8%      -9.8%       6057        interrupts.CPU5.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU5.TRM:Thermal_event_interrupts
      6858 ±  8%     -11.6%       6066        interrupts.CPU53.CAL:Function_call_interrupts
      6839 ±  8%     -11.4%       6060        interrupts.CPU54.CAL:Function_call_interrupts
      6838 ±  8%     -11.3%       6063        interrupts.CPU55.CAL:Function_call_interrupts
      6825 ±  7%     -11.2%       6060        interrupts.CPU56.CAL:Function_call_interrupts
      6866 ±  7%     -11.7%       6061        interrupts.CPU58.CAL:Function_call_interrupts
      6846 ±  8%     -11.5%       6062        interrupts.CPU59.CAL:Function_call_interrupts
      6852 ±  7%     -12.3%       6007        interrupts.CPU6.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU6.TRM:Thermal_event_interrupts
      6847 ±  8%     -11.5%       6062        interrupts.CPU60.CAL:Function_call_interrupts
      6842 ±  7%     -11.4%       6061        interrupts.CPU63.CAL:Function_call_interrupts
      6870 ±  7%     -11.8%       6058        interrupts.CPU64.CAL:Function_call_interrupts
      6819 ±  7%     -18.7%       5542 ± 16%  interrupts.CPU67.CAL:Function_call_interrupts
      6819 ±  7%     -11.2%       6054        interrupts.CPU68.CAL:Function_call_interrupts
      6862 ±  6%     -11.7%       6062        interrupts.CPU69.CAL:Function_call_interrupts
      6812 ±  7%     -19.8%       5466 ± 18%  interrupts.CPU7.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU7.TRM:Thermal_event_interrupts
      6836 ±  7%     -11.3%       6064        interrupts.CPU70.CAL:Function_call_interrupts
      6814 ±  7%     -11.1%       6060        interrupts.CPU71.CAL:Function_call_interrupts
      6816 ±  8%     -11.1%       6061        interrupts.CPU72.CAL:Function_call_interrupts
      6843 ±  8%     -11.4%       6062        interrupts.CPU73.CAL:Function_call_interrupts
      6826 ±  8%     -14.7%       5820 ±  7%  interrupts.CPU74.CAL:Function_call_interrupts
      6820 ±  8%     -11.2%       6054        interrupts.CPU75.CAL:Function_call_interrupts
    164.50 ± 34%    +261.2%     594.25 ± 35%  interrupts.CPU75.RES:Rescheduling_interrupts
      6812 ±  8%     -11.1%       6053        interrupts.CPU76.CAL:Function_call_interrupts
      6814 ±  8%     -11.3%       6045        interrupts.CPU77.CAL:Function_call_interrupts
      6818 ±  8%     -11.2%       6058        interrupts.CPU78.CAL:Function_call_interrupts
      6791 ±  8%     -10.8%       6057        interrupts.CPU79.CAL:Function_call_interrupts
    871.50 ± 42%     -49.3%     441.75 ± 48%  interrupts.CPU8.32:PCI-MSI.26738689-edge.eth0-TxRx-0
      6729 ±  8%     -10.1%       6050        interrupts.CPU8.CAL:Function_call_interrupts
    316.50 ± 89%    +444.2%       1722 ± 67%  interrupts.CPU8.RES:Rescheduling_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU8.TRM:Thermal_event_interrupts
      6814 ±  8%     -11.1%       6058        interrupts.CPU80.CAL:Function_call_interrupts
      6826 ±  7%     -11.1%       6069        interrupts.CPU81.CAL:Function_call_interrupts
      6832 ±  7%     -11.3%       6062        interrupts.CPU88.CAL:Function_call_interrupts
      6860 ±  7%     -11.8%       6050        interrupts.CPU89.CAL:Function_call_interrupts
      6820 ±  7%     -10.6%       6097        interrupts.CPU9.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU9.TRM:Thermal_event_interrupts
      6843 ±  7%     -11.4%       6062        interrupts.CPU90.CAL:Function_call_interrupts
      6803 ±  7%     -10.8%       6066        interrupts.CPU91.CAL:Function_call_interrupts
      6877 ±  8%     -11.8%       6066        interrupts.CPU92.CAL:Function_call_interrupts
      6880 ±  7%     -17.8%       5658 ± 12%  interrupts.CPU93.CAL:Function_call_interrupts
      6858 ±  7%     -11.7%       6058        interrupts.CPU94.CAL:Function_call_interrupts
    367.50 ± 77%     -58.2%     153.50 ±119%  interrupts.CPU94.RES:Rescheduling_interrupts
      6813 ±  7%     -11.7%       6018        interrupts.CPU95.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU96.TRM:Thermal_event_interrupts
      6855 ±  7%     -12.2%       6017        interrupts.CPU97.CAL:Function_call_interrupts
    113.25 ±105%     -86.5%      15.25 ± 57%  interrupts.CPU97.RES:Rescheduling_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU97.TRM:Thermal_event_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU98.TRM:Thermal_event_interrupts
      6845 ±  7%     -11.6%       6049        interrupts.CPU99.CAL:Function_call_interrupts
     21693 ±  5%     -99.9%      24.75 ± 78%  interrupts.CPU99.TRM:Thermal_event_interrupts
     52257 ±  4%     +12.0%      58541 ±  6%  interrupts.RES:Rescheduling_interrupts
   1041285 ±  5%     -99.9%       1177 ± 77%  interrupts.TRM:Thermal_event_interrupts


                                                                                
                     irq_exception_noise.__do_page_fault.70th                   
                                                                                
   1.5 +-+------------------------------------------------------------------+   
       |   O                     O O                                        |   
  1.45 +-+     O    OO  O O                                                 |   
   1.4 OO+O OO  O  O  O  O    OO  O    O  O                                 |   
       |         O         O O      O O    O                                |   
  1.35 +-+                              O   OO OO                           |   
   1.3 +-+                                       OO OO                      |   
       |                                                                    |   
  1.25 +-+                                                                  |   
   1.2 +-+                                                                  |   
       |                                                                    |   
  1.15 +-+                  .++                                      .+     |   
   1.1 +-+++++.++ .++++. +++   +.++++.+++.+ ++.++ +.+++.++++.+++.++++  +    |   
       |+        +      +                  +     +                      ++. |   
  1.05 +-+------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                     irq_exception_noise.__do_page_fault.80th                   
                                                                                
  1.8 +-+-------------------------------------------------------------------+   
      |                                                                     |   
  1.7 +-+ O                     O  O                                        |   
      OO O  O O    OO OOOO   O O O    O  O                                  |   
  1.6 +-+  O   OO O        OO       OO  O O OOOO  O  O                      |   
      |                                          O O                        |   
  1.5 +-+                                                                   |   
      |                                                                     |   
  1.4 +-+                                                                   |   
      |                                                                     |   
  1.3 +-+                                                                   |   
      |                                                                     |   
  1.2 +-+                   ++.                                             |   
      |+.++++.+++.+++.++++.+   +++.++++.+++.++++.+++.+++.++++.+++.+++.++    |   
  1.1 +-+-------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                     irq_exception_noise.__do_page_fault.90th                   
                                                                                
  2.2 +-+-O-----------------------------------------------------------------+   
  2.1 +-+                       O  O                                        |   
      OO O  O O    OO OOOO   O O O    O  O                                  |   
    2 +-+  O   OO O        OO       OO  O O OOOO OOO O                      |   
  1.9 +-+                                                                   |   
  1.8 +-+                                                                   |   
  1.7 +-+                                                                   |   
      |                                                                     |   
  1.6 +-+                                                                   |   
  1.5 +-+                                                                   |   
  1.4 +-+                                                                   |   
  1.3 +-+                                                                   |   
      |+.++++.+++.+++.++++.+++.+++.++++.+++.++++.+++.+++.++++.+++.+++.++    |   
  1.2 +-+                                                               ++.+|   
  1.1 +-+-------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                     irq_exception_noise.__do_page_fault.95th                   
                                                                                
    3 +-+-------------------------------------------------------------------+   
      |   O                                                                 |   
  2.8 +-+                       O  O                                        |   
  2.6 O-+O    O    O                  O  O   O O     O                      |   
      |O   OO  O    O OOOO   O O O   O  O O O O   OO                        |   
  2.4 +-+       O O        OO       O            O                          |   
  2.2 +-+                                                                   |   
      |                                                                     |   
    2 +-+                                                                   |   
  1.8 +-+                                                                   |   
      |                                                                     |   
  1.6 +-+                                                                   |   
  1.4 +-+                   +                                               |   
      |+.++++.+++.+++.++++.+ +.+++.++++.+++.++++.+++.+++.++++.+++.+++.++++.+|   
  1.2 +-+-------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                     irq_exception_noise.__do_page_fault.99th                   
                                                                                
    6 +-+-------------------------------------------------------------------+   
      |   O                                                                 |   
  5.5 +-+                             O                                     |   
    5 +-+                       O  O     O        OO O                      |   
      O  O    OO   O  O OO   O            O  O O O                          |   
  4.5 +-+  O        O  O       O O  O   O   O O                             |   
    4 +O+   O   O           O        O                                      |   
      |           O        O                                                |   
  3.5 +-+                                                                   |   
    3 +-+                                                                   |   
      |                                                                     |   
  2.5 +-+                                                                   |   
    2 +-+                                                                   |   
      |                     ++.+ +. ++                ++. +++.+++.+++.++    |   
  1.5 +-+-------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                      irq_exception_noise.__do_page_fault.avg                   
                                                                                
   1.5 +-+-O---------------------O-O----------------------------------------+   
       |O           O    OO            O                                    |   
  1.45 O-+     OO    OO O     OO  O       O                                 |   
   1.4 +-+O OO   O O       O O      O O    O                                |   
       |                                O   OO OOOO OO                      |   
  1.35 +-+                                                                  |   
   1.3 +-+                                                                  |   
       |                                                                    |   
  1.25 +-+                                                                  |   
   1.2 +-+                                                                  |   
       |                     +                                              |   
  1.15 +-+                  + +                           + .+ +.++++.++    |   
   1.1 +-+ +++.++   +++.  ++   +.++++.+++.+  +.++  .+++.++ +  +         :   |   
       |+.+      +.+    ++                 ++    ++                     ++. |   
  1.05 +-+------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                       irq_exception_noise.__do_page_fault.sum                  
                                                                                
  300000 +-+----------------------O-O---------------------------------------+   
         |O  O       O    O O                                               |   
  290000 O-+    O O    OOO     O O O    O  O                                |   
  280000 +-O  OO   OO        OO       OO    O                               |   
         |                               O   OOO OOOO O                     |   
  270000 +-+                                                                |   
  260000 +-+                                                                |   
         |                                                                  |   
  250000 +-+                                                                |   
  240000 +-+                                                                |   
         |                    +                                             |   
  230000 +-+                  :+.                            + .+ ++.+++    |   
  220000 +-+.++++.+  +.++  .++   ++++.++++.+  ++.+  +.++++.++ +  +      :   |   
         |++       ++    ++                 ++    ++                    +.+ |   
  210000 +-+----------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                            will-it-scale.per_process_ops                       
                                                                                
  460000 +-+----------------------------------------------------------------+   
         |++.++++.++++.++++.++++.++++.++++.+++++.++++.+  +.++++.++++.+++    |   
  440000 +-+                                                                |   
         |                                                                  |   
  420000 +-+                                                                |   
         |                                                                  |   
  400000 +-+                                                                |   
         |                                                                  |   
  380000 +-+                                                                |   
         |                                                                  |   
  360000 +-+                                                                |   
         |     OO O O                 OO                                    |   
  340000 OOO OO    O O OOOO OOOO OOOO   OO O OOO OOOO O                     |   
         |                                  O                               |   
  320000 +-+----------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                will-it-scale.workload                          
                                                                                
    9e+07 +-+---------------------------------------------------------------+   
          |++.++++.+++++.++++.+  ++.++++.+++++.++++.+++++.+             +.++|   
  8.5e+07 +-+                  ++                          +++.+++++.+++    |   
          |                                                                 |   
          |                                                                 |   
    8e+07 +-+                                                               |   
          |                                                                 |   
  7.5e+07 +-+                                                               |   
          |                                                                 |   
    7e+07 +-+                                                               |   
          |                                                                 |   
          |O    OO OOOO  OOOO OOO O  OOO       O O  O                       |   
  6.5e+07 O-O OO       O         O  O    OOOOO  O O  OO                     |   
          |                                                                 |   
    6e+07 +-+---------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Rong Chen


View attachment "config-5.1.0-10831-g42a3003" of type "text/plain" (190101 bytes)

View attachment "job-script" of type "text/plain" (7655 bytes)

View attachment "job.yaml" of type "text/plain" (5352 bytes)

View attachment "reproduce" of type "text/plain" (316 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ