lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Message-ID: <20200308141029.GR5972@shao2-debian>
Date:   Sun, 8 Mar 2020 22:10:29 +0800
From:   kernel test robot <rong.a.chen@...el.com>
To:     Peter Zijlstra <peterz@...radead.org>
Cc:     LKML <linux-kernel@...r.kernel.org>, x86-ml <x86@...nel.org>,
        Ingo Molnar <mingo@...nel.org>,
        Thomas Gleixner <tglx@...utronix.de>,
        Borislav Petkov <bp@...e.de>, lkp@...ts.01.org
Subject: [futex] 222993395e: will-it-scale.per_thread_ops 1507.5% improvement

Greeting,

FYI, we noticed a 1507.5% improvement of will-it-scale.per_thread_ops due to commit:


commit: 222993395ed38f3751287f4bd82ef46b3eb3a66d ("futex: Remove pointless mmgrap() + mmdrop()")
https://git.kernel.org/cgit/linux/kernel/git/tip/tip.git locking/core

in testcase: will-it-scale
on test machine: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
with following parameters:

	nr_task: 16
	mode: thread
	test: futex1
	cpufreq_governor: performance
	ucode: 0x500002c

test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale





Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml

=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
  gcc-7/performance/x86_64-rhel-7.6/thread/16/debian-x86_64-20191114.cgz/lkp-csl-2ap2/futex1/will-it-scale/0x500002c

commit: 
  3867913c45 ("Merge branch 'locking/urgent'")
  222993395e ("futex: Remove pointless mmgrap() + mmdrop()")

3867913c45b478de 222993395ed38f3751287f4bd82 
---------------- --------------------------- 
       fail:runs  %reproduction    fail:runs
           |             |             |    
           :4           25%           1:4     dmesg.WARNING:stack_recursion
         %stddev     %change         %stddev
             \          |                \  
    384044 ±  2%   +1507.5%    6173590        will-it-scale.per_thread_ops
      4761           -17.4%       3931        will-it-scale.time.system_time
     55.12 ±  2%   +1505.9%     885.16        will-it-scale.time.user_time
   6144711 ±  2%   +1507.5%   98777444        will-it-scale.workload
      2279            -5.6%       2150        vmstat.system.cs
      8.36            -1.4        6.93        mpstat.cpu.all.sys%
      0.12 ±  2%      +1.5        1.57        mpstat.cpu.all.usr%
    337640 ±  4%      -9.4%     305889        meminfo.Active
    335564 ±  4%      -9.5%     303813        meminfo.Active(anon)
    314355 ±  4%      -8.8%     286711        meminfo.AnonPages
     45657 ±  4%      -8.6%      41717        meminfo.Shmem
     43983 ± 35%     -70.9%      12801 ± 55%  numa-vmstat.node3.nr_active_anon
      1948 ± 33%     -30.4%       1357 ±  2%  numa-vmstat.node3.nr_mapped
    363.75 ± 39%     -65.6%     125.00 ± 29%  numa-vmstat.node3.nr_page_table_pages
     43983 ± 35%     -70.9%      12801 ± 55%  numa-vmstat.node3.nr_zone_active_anon
    111212 ± 11%     +39.7%     155400 ± 31%  sched_debug.cpu.avg_idle.stddev
      1854           -12.5%       1623 ±  8%  sched_debug.cpu.sched_count.avg
    813.58           -11.5%     719.92 ±  7%  sched_debug.cpu.sched_goidle.avg
    810.18           -11.7%     715.62 ±  7%  sched_debug.cpu.ttwu_count.avg
    416.54           -14.9%     354.33 ± 10%  sched_debug.cpu.ttwu_local.avg
    175940 ± 35%     -70.9%      51235 ± 55%  numa-meminfo.node3.Active
    175940 ± 35%     -70.9%      51227 ± 55%  numa-meminfo.node3.Active(anon)
    103872 ± 47%     -84.2%      16435 ±104%  numa-meminfo.node3.AnonHugePages
      7510 ± 31%     -27.8%       5424 ±  2%  numa-meminfo.node3.Mapped
    766420 ±  6%     -21.5%     601491 ±  5%  numa-meminfo.node3.MemUsed
      1462 ± 39%     -65.8%     500.00 ± 29%  numa-meminfo.node3.PageTables
     83897 ±  4%      -9.5%      75959        proc-vmstat.nr_active_anon
     78588 ±  4%      -8.8%      71687        proc-vmstat.nr_anon_pages
     11413 ±  4%      -8.6%      10426        proc-vmstat.nr_shmem
     83897 ±  4%      -9.5%      75959        proc-vmstat.nr_zone_active_anon
    896720            -0.8%     889286        proc-vmstat.numa_local
   1083518            -2.0%    1062385        proc-vmstat.pgalloc_normal
   1197815            -1.9%    1174840        proc-vmstat.pgfree
      9.02           -91.1%       0.80 ± 69%  perf-stat.i.MPKI
 1.196e+09 ±  2%    +991.3%  1.305e+10        perf-stat.i.branch-instructions
      0.79 ±  3%      -0.3        0.48 ± 14%  perf-stat.i.branch-miss-rate%
  10113023 ±  4%    +517.5%   62450138 ± 14%  perf-stat.i.branch-misses
      2229            -5.7%       2101        perf-stat.i.context-switches
      7.51 ±  2%     -91.7%       0.62        perf-stat.i.cpi
 1.738e+09 ±  2%   +1095.1%  2.077e+10        perf-stat.i.dTLB-loads
 1.045e+09         +1131.1%  1.286e+10        perf-stat.i.dTLB-stores
     62.09           +33.6       95.73 ±  2%  perf-stat.i.iTLB-load-miss-rate%
   5992520          +722.7%   49302917 ±  3%  perf-stat.i.iTLB-load-misses
 7.435e+09 ±  2%   +1113.9%  9.025e+10        perf-stat.i.instructions
      1241           +47.8%       1834 ±  2%  perf-stat.i.instructions-per-iTLB-miss
      0.13 ±  2%   +1093.9%       1.61        perf-stat.i.ipc
      8.97           -91.2%       0.79 ± 70%  perf-stat.overall.MPKI
      0.85 ±  3%      -0.4        0.48 ± 14%  perf-stat.overall.branch-miss-rate%
      7.47 ±  2%     -91.7%       0.62        perf-stat.overall.cpi
     62.10           +33.7       95.78 ±  2%  perf-stat.overall.iTLB-load-miss-rate%
      1240           +47.7%       1832 ±  2%  perf-stat.overall.instructions-per-iTLB-miss
      0.13 ±  2%   +1099.8%       1.61        perf-stat.overall.ipc
    364237           -24.5%     275093        perf-stat.overall.path-length
 1.192e+09 ±  2%    +991.3%  1.301e+10        perf-stat.ps.branch-instructions
  10083689 ±  4%    +517.2%   62241108 ± 14%  perf-stat.ps.branch-misses
      2221            -5.7%       2094        perf-stat.ps.context-switches
 1.732e+09 ±  2%   +1095.0%   2.07e+10        perf-stat.ps.dTLB-loads
 1.041e+09         +1131.1%  1.282e+10        perf-stat.ps.dTLB-stores
   5972341          +722.7%   49136644 ±  3%  perf-stat.ps.iTLB-load-misses
  7.41e+09 ±  2%   +1113.8%  8.995e+10        perf-stat.ps.instructions
 2.238e+12 ±  2%   +1114.2%  2.717e+13        perf-stat.total.instructions
     61.32 ±  7%     -24.0       37.30 ±  2%  perf-profile.calltrace.cycles-pp.futex_wake.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
     61.46 ±  7%     -21.6       39.89 ±  2%  perf-profile.calltrace.cycles-pp.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe.syscall
     61.63 ±  7%     -18.7       42.95 ±  2%  perf-profile.calltrace.cycles-pp.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe.syscall
     61.79 ±  7%     -16.0       45.78 ±  2%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.syscall
     15.59 ±  8%     -15.6        0.00        perf-profile.calltrace.cycles-pp.drop_futex_key_refs.futex_wake.do_futex.__x64_sys_futex.do_syscall_64
     61.95 ±  7%     -13.5       48.43 ±  2%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.syscall
     45.44 ±  7%     -13.1       32.36 ±  2%  perf-profile.calltrace.cycles-pp.get_futex_key.futex_wake.do_futex.__x64_sys_futex.do_syscall_64
     30.74 ±  8%     -11.0       19.72 ±  2%  perf-profile.calltrace.cycles-pp.gup_pgd_range.get_user_pages_fast.get_futex_key.futex_wake.do_futex
     14.02 ±  6%     -10.9        3.16 ±  3%  perf-profile.calltrace.cycles-pp.get_futex_key_refs.get_futex_key.futex_wake.do_futex.__x64_sys_futex
     31.03 ±  8%      -7.9       23.13 ±  2%  perf-profile.calltrace.cycles-pp.get_user_pages_fast.get_futex_key.futex_wake.do_futex.__x64_sys_futex
      0.00            +1.5        1.50 ±  3%  perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.syscall
      0.00            +2.8        2.76 ±  3%  perf-profile.calltrace.cycles-pp.hash_futex.futex_wake.do_futex.__x64_sys_futex.do_syscall_64
      0.61 ±  9%     +16.6       17.20 ±  2%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64.syscall
     61.34 ±  7%     -23.7       37.59 ±  2%  perf-profile.children.cycles-pp.futex_wake
     61.47 ±  7%     -21.4       40.05 ±  2%  perf-profile.children.cycles-pp.do_futex
     61.64 ±  7%     -18.4       43.21 ±  2%  perf-profile.children.cycles-pp.__x64_sys_futex
     61.87 ±  7%     -15.7       46.12 ±  2%  perf-profile.children.cycles-pp.do_syscall_64
     15.60 ±  8%     -15.6        0.00        perf-profile.children.cycles-pp.drop_futex_key_refs
     62.01 ±  7%     -13.5       48.49 ±  2%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     45.45 ±  7%     -12.8       32.64 ±  2%  perf-profile.children.cycles-pp.get_futex_key
     30.75 ±  8%     -10.9       19.87 ±  2%  perf-profile.children.cycles-pp.gup_pgd_range
     14.03 ±  6%     -10.9        3.17 ±  3%  perf-profile.children.cycles-pp.get_futex_key_refs
     31.05 ±  8%      -7.9       23.14 ±  2%  perf-profile.children.cycles-pp.get_user_pages_fast
      0.00            +0.2        0.15 ±  4%  perf-profile.children.cycles-pp.syscall@plt
      0.00            +0.3        0.29 ±  3%  perf-profile.children.cycles-pp.pud_huge
      0.00            +0.3        0.30 ±  5%  perf-profile.children.cycles-pp.__indirect_thunk_start
      0.00            +0.4        0.37 ±  5%  perf-profile.children.cycles-pp.pmd_huge
      0.00            +0.5        0.46 ±  5%  perf-profile.children.cycles-pp.fpregs_assert_state_consistent
      0.16 ± 13%      +2.7        2.91 ±  3%  perf-profile.children.cycles-pp.hash_futex
     63.12 ±  7%      +6.5       69.63 ±  2%  perf-profile.children.cycles-pp.syscall
      0.40 ±  8%      +6.8        7.20 ±  2%  perf-profile.children.cycles-pp.syscall_return_via_sysret
      0.62 ±  9%     +10.9       11.52 ±  2%  perf-profile.children.cycles-pp.entry_SYSCALL_64
     15.56 ±  8%     -15.6        0.00        perf-profile.self.cycles-pp.drop_futex_key_refs
     30.72 ±  8%     -11.4       19.37 ±  2%  perf-profile.self.cycles-pp.gup_pgd_range
     13.99 ±  6%     -11.0        3.01 ±  3%  perf-profile.self.cycles-pp.get_futex_key_refs
      0.00            +0.1        0.15 ±  3%  perf-profile.self.cycles-pp.pud_huge
      0.00            +0.2        0.15 ±  4%  perf-profile.self.cycles-pp.syscall@plt
      0.00            +0.2        0.15 ±  7%  perf-profile.self.cycles-pp.__indirect_thunk_start
      0.00            +0.4        0.36 ±  5%  perf-profile.self.cycles-pp.pmd_huge
      0.00            +0.5        0.46 ±  5%  perf-profile.self.cycles-pp.fpregs_assert_state_consistent
      0.13 ± 14%      +2.0        2.16 ±  3%  perf-profile.self.cycles-pp.futex_wake
      0.13 ± 22%      +2.2        2.31 ±  3%  perf-profile.self.cycles-pp.do_syscall_64
      0.14 ± 11%      +2.2        2.33        perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.14 ± 15%      +2.4        2.50 ±  3%  perf-profile.self.cycles-pp.do_futex
      0.15 ± 11%      +2.6        2.75 ±  3%  perf-profile.self.cycles-pp.hash_futex
      0.19 ±  8%      +2.8        3.03 ±  2%  perf-profile.self.cycles-pp.get_user_pages_fast
      0.17 ±  4%      +2.9        3.12 ±  2%  perf-profile.self.cycles-pp.__x64_sys_futex
      0.29 ±  8%      +5.5        5.81 ±  2%  perf-profile.self.cycles-pp.entry_SYSCALL_64
      0.37 ± 10%      +6.1        6.45        perf-profile.self.cycles-pp.get_futex_key
      0.40 ±  8%      +6.8        7.20 ±  2%  perf-profile.self.cycles-pp.syscall_return_via_sysret
      0.45 ± 12%      +7.6        8.03 ±  3%  perf-profile.self.cycles-pp.syscall
      5745 ± 36%     -56.5%       2501 ± 24%  interrupts.CPU10.NMI:Non-maskable_interrupts
      5745 ± 36%     -56.5%       2501 ± 24%  interrupts.CPU10.PMI:Performance_monitoring_interrupts
      4274 ± 33%     -33.1%       2857        interrupts.CPU11.NMI:Non-maskable_interrupts
      4274 ± 33%     -33.1%       2857        interrupts.CPU11.PMI:Performance_monitoring_interrupts
      1471 ±168%     -99.9%       1.00 ±122%  interrupts.CPU13.RES:Rescheduling_interrupts
    174.00 ±169%     -99.4%       1.00 ± 70%  interrupts.CPU13.TLB:TLB_shootdowns
     97.50 ±  5%     +24.4%     121.25 ±  8%  interrupts.CPU132.NMI:Non-maskable_interrupts
     97.50 ±  5%     +24.4%     121.25 ±  8%  interrupts.CPU132.PMI:Performance_monitoring_interrupts
     98.00 ±  6%     +53.1%     150.00 ± 10%  interrupts.CPU138.NMI:Non-maskable_interrupts
     98.00 ±  6%     +53.1%     150.00 ± 10%  interrupts.CPU138.PMI:Performance_monitoring_interrupts
    101.00 ± 10%     +25.0%     126.25 ±  5%  interrupts.CPU139.NMI:Non-maskable_interrupts
    101.00 ± 10%     +25.0%     126.25 ±  5%  interrupts.CPU139.PMI:Performance_monitoring_interrupts
     85.00 ± 24%     +51.5%     128.75 ± 11%  interrupts.CPU147.NMI:Non-maskable_interrupts
     85.00 ± 24%     +51.5%     128.75 ± 11%  interrupts.CPU147.PMI:Performance_monitoring_interrupts
     97.75 ±  4%     +25.8%     123.00 ± 10%  interrupts.CPU148.NMI:Non-maskable_interrupts
     97.75 ±  4%     +25.8%     123.00 ± 10%  interrupts.CPU148.PMI:Performance_monitoring_interrupts
    100.25           +22.9%     123.25 ±  9%  interrupts.CPU149.NMI:Non-maskable_interrupts
    100.25           +22.9%     123.25 ±  9%  interrupts.CPU149.PMI:Performance_monitoring_interrupts
     86.25 ± 28%     +44.6%     124.75 ±  9%  interrupts.CPU150.NMI:Non-maskable_interrupts
     86.25 ± 28%     +44.6%     124.75 ±  9%  interrupts.CPU150.PMI:Performance_monitoring_interrupts
     85.25 ± 27%     +42.2%     121.25 ±  9%  interrupts.CPU151.NMI:Non-maskable_interrupts
     85.25 ± 27%     +42.2%     121.25 ±  9%  interrupts.CPU151.PMI:Performance_monitoring_interrupts
     73.75 ± 35%     +73.2%     127.75 ± 13%  interrupts.CPU152.NMI:Non-maskable_interrupts
     73.75 ± 35%     +73.2%     127.75 ± 13%  interrupts.CPU152.PMI:Performance_monitoring_interrupts
     73.75 ± 37%     +67.1%     123.25 ± 11%  interrupts.CPU153.NMI:Non-maskable_interrupts
     73.75 ± 37%     +67.1%     123.25 ± 11%  interrupts.CPU153.PMI:Performance_monitoring_interrupts
     76.50 ± 40%     +92.8%     147.50 ±  8%  interrupts.CPU155.NMI:Non-maskable_interrupts
     76.50 ± 40%     +92.8%     147.50 ±  8%  interrupts.CPU155.PMI:Performance_monitoring_interrupts
      5.50 ± 94%   +1763.6%     102.50 ±124%  interrupts.CPU155.RES:Rescheduling_interrupts
     83.25 ± 25%     +47.4%     122.75 ±  7%  interrupts.CPU156.NMI:Non-maskable_interrupts
     83.25 ± 25%     +47.4%     122.75 ±  7%  interrupts.CPU156.PMI:Performance_monitoring_interrupts
      1.75 ± 47%   +5414.3%      96.50 ±150%  interrupts.CPU156.RES:Rescheduling_interrupts
     97.00 ±  6%     +37.6%     133.50 ± 15%  interrupts.CPU157.NMI:Non-maskable_interrupts
     97.00 ±  6%     +37.6%     133.50 ± 15%  interrupts.CPU157.PMI:Performance_monitoring_interrupts
     98.25 ±  6%     +43.3%     140.75 ± 24%  interrupts.CPU158.NMI:Non-maskable_interrupts
     98.25 ±  6%     +43.3%     140.75 ± 24%  interrupts.CPU158.PMI:Performance_monitoring_interrupts
     97.75 ±  5%     +24.0%     121.25 ±  9%  interrupts.CPU159.NMI:Non-maskable_interrupts
     97.75 ±  5%     +24.0%     121.25 ±  9%  interrupts.CPU159.PMI:Performance_monitoring_interrupts
    100.25 ±  2%     +23.7%     124.00 ± 10%  interrupts.CPU161.NMI:Non-maskable_interrupts
    100.25 ±  2%     +23.7%     124.00 ± 10%  interrupts.CPU161.PMI:Performance_monitoring_interrupts
     98.50 ±  5%     +21.6%     119.75 ± 10%  interrupts.CPU163.NMI:Non-maskable_interrupts
     98.50 ±  5%     +21.6%     119.75 ± 10%  interrupts.CPU163.PMI:Performance_monitoring_interrupts
      5.00 ±127%   +2450.0%     127.50 ±140%  interrupts.CPU163.RES:Rescheduling_interrupts
     99.75 ±  5%     +22.6%     122.25 ±  9%  interrupts.CPU165.NMI:Non-maskable_interrupts
     99.75 ±  5%     +22.6%     122.25 ±  9%  interrupts.CPU165.PMI:Performance_monitoring_interrupts
     86.00 ± 24%     +43.9%     123.75 ±  9%  interrupts.CPU166.NMI:Non-maskable_interrupts
     86.00 ± 24%     +43.9%     123.75 ±  9%  interrupts.CPU166.PMI:Performance_monitoring_interrupts
     89.75 ± 27%     +39.0%     124.75 ±  9%  interrupts.CPU167.NMI:Non-maskable_interrupts
     89.75 ± 27%     +39.0%     124.75 ±  9%  interrupts.CPU167.PMI:Performance_monitoring_interrupts
     89.00 ± 24%     +60.7%     143.00 ± 17%  interrupts.CPU168.NMI:Non-maskable_interrupts
     89.00 ± 24%     +60.7%     143.00 ± 17%  interrupts.CPU168.PMI:Performance_monitoring_interrupts
     76.25 ± 37%     +60.7%     122.50 ±  8%  interrupts.CPU169.NMI:Non-maskable_interrupts
     76.25 ± 37%     +60.7%     122.50 ±  8%  interrupts.CPU169.PMI:Performance_monitoring_interrupts
     61.75 ± 36%    +102.4%     125.00 ±  7%  interrupts.CPU170.NMI:Non-maskable_interrupts
     61.75 ± 36%    +102.4%     125.00 ±  7%  interrupts.CPU170.PMI:Performance_monitoring_interrupts
     61.75 ± 36%    +103.6%     125.75 ±  9%  interrupts.CPU171.NMI:Non-maskable_interrupts
     61.75 ± 36%    +103.6%     125.75 ±  9%  interrupts.CPU171.PMI:Performance_monitoring_interrupts
     62.00 ± 36%    +103.6%     126.25 ±  9%  interrupts.CPU172.NMI:Non-maskable_interrupts
     62.00 ± 36%    +103.6%     126.25 ±  9%  interrupts.CPU172.PMI:Performance_monitoring_interrupts
     63.00 ± 36%     +99.2%     125.50 ± 10%  interrupts.CPU173.NMI:Non-maskable_interrupts
     63.00 ± 36%     +99.2%     125.50 ± 10%  interrupts.CPU173.PMI:Performance_monitoring_interrupts
     49.25 ±  5%    +176.6%     136.25 ± 15%  interrupts.CPU174.NMI:Non-maskable_interrupts
     49.25 ±  5%    +176.6%     136.25 ± 15%  interrupts.CPU174.PMI:Performance_monitoring_interrupts
     62.00 ± 37%    +100.0%     124.00 ±  7%  interrupts.CPU175.NMI:Non-maskable_interrupts
     62.00 ± 37%    +100.0%     124.00 ±  7%  interrupts.CPU175.PMI:Performance_monitoring_interrupts
     61.00 ± 38%    +101.2%     122.75 ±  8%  interrupts.CPU176.NMI:Non-maskable_interrupts
     61.00 ± 38%    +101.2%     122.75 ±  8%  interrupts.CPU176.PMI:Performance_monitoring_interrupts
     62.00 ± 39%     +98.4%     123.00 ±  7%  interrupts.CPU177.NMI:Non-maskable_interrupts
     62.00 ± 39%     +98.4%     123.00 ±  7%  interrupts.CPU177.PMI:Performance_monitoring_interrupts
     61.25 ± 37%    +127.3%     139.25 ± 19%  interrupts.CPU178.NMI:Non-maskable_interrupts
     61.25 ± 37%    +127.3%     139.25 ± 19%  interrupts.CPU178.PMI:Performance_monitoring_interrupts
     80.25 ± 42%     +56.1%     125.25 ±  8%  interrupts.CPU179.NMI:Non-maskable_interrupts
     80.25 ± 42%     +56.1%     125.25 ±  8%  interrupts.CPU179.PMI:Performance_monitoring_interrupts
     74.00 ± 36%     +81.8%     134.50 ± 16%  interrupts.CPU180.NMI:Non-maskable_interrupts
     74.00 ± 36%     +81.8%     134.50 ± 16%  interrupts.CPU180.PMI:Performance_monitoring_interrupts
     73.25 ± 36%     +74.1%     127.50 ±  9%  interrupts.CPU181.NMI:Non-maskable_interrupts
     73.25 ± 36%     +74.1%     127.50 ±  9%  interrupts.CPU181.PMI:Performance_monitoring_interrupts
     73.50 ± 36%     +70.1%     125.00 ±  8%  interrupts.CPU182.NMI:Non-maskable_interrupts
     73.50 ± 36%     +70.1%     125.00 ±  8%  interrupts.CPU182.PMI:Performance_monitoring_interrupts
     73.50 ± 36%     +68.7%     124.00 ±  7%  interrupts.CPU183.NMI:Non-maskable_interrupts
     73.50 ± 36%     +68.7%     124.00 ±  7%  interrupts.CPU183.PMI:Performance_monitoring_interrupts
     73.25 ± 36%     +67.6%     122.75 ±  8%  interrupts.CPU184.NMI:Non-maskable_interrupts
     73.25 ± 36%     +67.6%     122.75 ±  8%  interrupts.CPU184.PMI:Performance_monitoring_interrupts
     87.75 ± 28%     +41.9%     124.50 ±  7%  interrupts.CPU185.NMI:Non-maskable_interrupts
     87.75 ± 28%     +41.9%     124.50 ±  7%  interrupts.CPU185.PMI:Performance_monitoring_interrupts
     99.00 ±  4%     +26.3%     125.00 ±  7%  interrupts.CPU186.NMI:Non-maskable_interrupts
     99.00 ±  4%     +26.3%     125.00 ±  7%  interrupts.CPU186.PMI:Performance_monitoring_interrupts
     98.00 ±  4%     +30.9%     128.25 ±  9%  interrupts.CPU187.NMI:Non-maskable_interrupts
     98.00 ±  4%     +30.9%     128.25 ±  9%  interrupts.CPU187.PMI:Performance_monitoring_interrupts
     85.50 ± 23%     +45.0%     124.00 ±  7%  interrupts.CPU188.NMI:Non-maskable_interrupts
     85.50 ± 23%     +45.0%     124.00 ±  7%  interrupts.CPU188.PMI:Performance_monitoring_interrupts
     73.00 ± 31%     +69.9%     124.00 ±  7%  interrupts.CPU189.NMI:Non-maskable_interrupts
     73.00 ± 31%     +69.9%     124.00 ±  7%  interrupts.CPU189.PMI:Performance_monitoring_interrupts
     73.50 ± 31%     +69.7%     124.75 ±  7%  interrupts.CPU190.NMI:Non-maskable_interrupts
     73.50 ± 31%     +69.7%     124.75 ±  7%  interrupts.CPU190.PMI:Performance_monitoring_interrupts
    576.50 ± 53%     -89.7%      59.50 ± 61%  interrupts.CPU191.TLB:TLB_shootdowns
      7084 ±101%    -100.0%       2.50 ± 60%  interrupts.CPU2.RES:Rescheduling_interrupts
     89.25 ± 26%     +38.9%     124.00 ±  8%  interrupts.CPU24.NMI:Non-maskable_interrupts
     89.25 ± 26%     +38.9%     124.00 ±  8%  interrupts.CPU24.PMI:Performance_monitoring_interrupts
      1834 ±171%    -100.0%       0.75 ±110%  interrupts.CPU24.TLB:TLB_shootdowns
    101.75 ±  9%     +17.7%     119.75 ± 10%  interrupts.CPU33.NMI:Non-maskable_interrupts
    101.75 ±  9%     +17.7%     119.75 ± 10%  interrupts.CPU33.PMI:Performance_monitoring_interrupts
    102.25 ± 10%     +20.5%     123.25 ±  7%  interrupts.CPU35.NMI:Non-maskable_interrupts
    102.25 ± 10%     +20.5%     123.25 ±  7%  interrupts.CPU35.PMI:Performance_monitoring_interrupts
     97.75 ±  5%     +24.0%     121.25 ±  9%  interrupts.CPU36.NMI:Non-maskable_interrupts
     97.75 ±  5%     +24.0%     121.25 ±  9%  interrupts.CPU36.PMI:Performance_monitoring_interrupts
     96.50 ±  4%     +24.4%     120.00 ±  9%  interrupts.CPU37.NMI:Non-maskable_interrupts
     96.50 ±  4%     +24.4%     120.00 ±  9%  interrupts.CPU37.PMI:Performance_monitoring_interrupts
     98.50 ±  6%     +21.6%     119.75 ±  8%  interrupts.CPU38.NMI:Non-maskable_interrupts
     98.50 ±  6%     +21.6%     119.75 ±  8%  interrupts.CPU38.PMI:Performance_monitoring_interrupts
     98.50 ±  6%     +24.9%     123.00 ±  6%  interrupts.CPU39.NMI:Non-maskable_interrupts
     98.50 ±  6%     +24.9%     123.00 ±  6%  interrupts.CPU39.PMI:Performance_monitoring_interrupts
      4282 ± 33%     -41.6%       2501 ± 24%  interrupts.CPU5.NMI:Non-maskable_interrupts
      4282 ± 33%     -41.6%       2501 ± 24%  interrupts.CPU5.PMI:Performance_monitoring_interrupts
     89.25 ± 12%     +38.1%     123.25 ± 11%  interrupts.CPU50.NMI:Non-maskable_interrupts
     89.25 ± 12%     +38.1%     123.25 ± 11%  interrupts.CPU50.PMI:Performance_monitoring_interrupts
     72.00 ± 31%     +71.9%     123.75 ±  9%  interrupts.CPU51.NMI:Non-maskable_interrupts
     72.00 ± 31%     +71.9%     123.75 ±  9%  interrupts.CPU51.PMI:Performance_monitoring_interrupts
      5.25 ± 75%   +2185.7%     120.00 ± 81%  interrupts.CPU58.RES:Rescheduling_interrupts
     85.50 ± 22%     +55.6%     133.00 ± 11%  interrupts.CPU59.NMI:Non-maskable_interrupts
     85.50 ± 22%     +55.6%     133.00 ± 11%  interrupts.CPU59.PMI:Performance_monitoring_interrupts
     83.75 ± 24%     +44.8%     121.25 ±  8%  interrupts.CPU60.NMI:Non-maskable_interrupts
     83.75 ± 24%     +44.8%     121.25 ±  8%  interrupts.CPU60.PMI:Performance_monitoring_interrupts
     84.00 ± 24%     +64.6%     138.25 ± 22%  interrupts.CPU61.NMI:Non-maskable_interrupts
     84.00 ± 24%     +64.6%     138.25 ± 22%  interrupts.CPU61.PMI:Performance_monitoring_interrupts
      2.25 ±123%   +1866.7%      44.25 ±126%  interrupts.CPU61.RES:Rescheduling_interrupts
     60.25 ± 37%    +107.1%     124.75 ± 10%  interrupts.CPU62.NMI:Non-maskable_interrupts
     60.25 ± 37%    +107.1%     124.75 ± 10%  interrupts.CPU62.PMI:Performance_monitoring_interrupts
     60.00 ± 37%    +101.2%     120.75 ±  9%  interrupts.CPU63.NMI:Non-maskable_interrupts
     60.00 ± 37%    +101.2%     120.75 ±  9%  interrupts.CPU63.PMI:Performance_monitoring_interrupts
     63.00 ± 34%     +93.7%     122.00 ±  9%  interrupts.CPU64.NMI:Non-maskable_interrupts
     63.00 ± 34%     +93.7%     122.00 ±  9%  interrupts.CPU64.PMI:Performance_monitoring_interrupts
     61.75 ± 36%    +100.0%     123.50 ±  9%  interrupts.CPU65.NMI:Non-maskable_interrupts
     61.75 ± 36%    +100.0%     123.50 ±  9%  interrupts.CPU65.PMI:Performance_monitoring_interrupts
     61.00 ± 37%     +97.5%     120.50 ±  8%  interrupts.CPU66.NMI:Non-maskable_interrupts
     61.00 ± 37%     +97.5%     120.50 ±  8%  interrupts.CPU66.PMI:Performance_monitoring_interrupts
     99.00 ±  6%     +22.5%     121.25 ±  7%  interrupts.CPU69.NMI:Non-maskable_interrupts
     99.00 ±  6%     +22.5%     121.25 ±  7%  interrupts.CPU69.PMI:Performance_monitoring_interrupts
     98.25 ±  5%     +25.4%     123.25 ±  8%  interrupts.CPU70.NMI:Non-maskable_interrupts
     98.25 ±  5%     +25.4%     123.25 ±  8%  interrupts.CPU70.PMI:Performance_monitoring_interrupts
     99.75 ±  7%     +35.8%     135.50 ± 14%  interrupts.CPU71.NMI:Non-maskable_interrupts
     99.75 ±  7%     +35.8%     135.50 ± 14%  interrupts.CPU71.PMI:Performance_monitoring_interrupts
    102.00 ±  5%     +36.0%     138.75 ± 13%  interrupts.CPU72.NMI:Non-maskable_interrupts
    102.00 ±  5%     +36.0%     138.75 ± 13%  interrupts.CPU72.PMI:Performance_monitoring_interrupts
     88.75 ± 29%     +36.9%     121.50 ±  6%  interrupts.CPU73.NMI:Non-maskable_interrupts
     88.75 ± 29%     +36.9%     121.50 ±  6%  interrupts.CPU73.PMI:Performance_monitoring_interrupts
     88.25 ± 29%     +40.2%     123.75 ±  8%  interrupts.CPU75.NMI:Non-maskable_interrupts
     88.25 ± 29%     +40.2%     123.75 ±  8%  interrupts.CPU75.PMI:Performance_monitoring_interrupts
     88.00 ± 29%     +41.2%     124.25 ±  8%  interrupts.CPU76.NMI:Non-maskable_interrupts
     88.00 ± 29%     +41.2%     124.25 ±  8%  interrupts.CPU76.PMI:Performance_monitoring_interrupts
     89.00 ± 29%     +40.7%     125.25 ±  8%  interrupts.CPU77.NMI:Non-maskable_interrupts
     89.00 ± 29%     +40.7%     125.25 ±  8%  interrupts.CPU77.PMI:Performance_monitoring_interrupts
     87.50 ± 29%     +44.9%     126.75 ±  8%  interrupts.CPU78.NMI:Non-maskable_interrupts
     87.50 ± 29%     +44.9%     126.75 ±  8%  interrupts.CPU78.PMI:Performance_monitoring_interrupts
     87.50 ± 29%     +40.0%     122.50 ±  7%  interrupts.CPU79.NMI:Non-maskable_interrupts
     87.50 ± 29%     +40.0%     122.50 ±  7%  interrupts.CPU79.PMI:Performance_monitoring_interrupts
     97.50 ±  6%     +24.9%     121.75 ±  7%  interrupts.CPU80.NMI:Non-maskable_interrupts
     97.50 ±  6%     +24.9%     121.75 ±  7%  interrupts.CPU80.PMI:Performance_monitoring_interrupts
     97.00 ±  5%     +26.3%     122.50 ±  6%  interrupts.CPU81.NMI:Non-maskable_interrupts
     97.00 ±  5%     +26.3%     122.50 ±  6%  interrupts.CPU81.PMI:Performance_monitoring_interrupts
     97.75 ±  5%     +28.4%     125.50 ±  8%  interrupts.CPU82.NMI:Non-maskable_interrupts
     97.75 ±  5%     +28.4%     125.50 ±  8%  interrupts.CPU82.PMI:Performance_monitoring_interrupts
     89.00 ± 29%     +38.8%     123.50 ±  7%  interrupts.CPU83.NMI:Non-maskable_interrupts
     89.00 ± 29%     +38.8%     123.50 ±  7%  interrupts.CPU83.PMI:Performance_monitoring_interrupts
     98.25 ±  6%     +27.7%     125.50 ±  7%  interrupts.CPU84.NMI:Non-maskable_interrupts
     98.25 ±  6%     +27.7%     125.50 ±  7%  interrupts.CPU84.PMI:Performance_monitoring_interrupts
     84.75 ± 25%     +45.7%     123.50 ± 10%  interrupts.CPU85.NMI:Non-maskable_interrupts
     84.75 ± 25%     +45.7%     123.50 ± 10%  interrupts.CPU85.PMI:Performance_monitoring_interrupts
     97.50 ±  6%     +26.4%     123.25 ±  8%  interrupts.CPU86.NMI:Non-maskable_interrupts
     97.50 ±  6%     +26.4%     123.25 ±  8%  interrupts.CPU86.PMI:Performance_monitoring_interrupts
     97.75 ±  5%     +24.6%     121.75 ±  8%  interrupts.CPU87.NMI:Non-maskable_interrupts
     97.75 ±  5%     +24.6%     121.75 ±  8%  interrupts.CPU87.PMI:Performance_monitoring_interrupts
     97.25 ±  5%     +24.7%     121.25 ±  8%  interrupts.CPU88.NMI:Non-maskable_interrupts
     97.25 ±  5%     +24.7%     121.25 ±  8%  interrupts.CPU88.PMI:Performance_monitoring_interrupts
     98.25 ±  6%     +24.9%     122.75 ±  8%  interrupts.CPU89.NMI:Non-maskable_interrupts
     98.25 ±  6%     +24.9%     122.75 ±  8%  interrupts.CPU89.PMI:Performance_monitoring_interrupts
     99.25 ±  6%     +24.4%     123.50 ±  8%  interrupts.CPU90.NMI:Non-maskable_interrupts
     99.25 ±  6%     +24.4%     123.50 ±  8%  interrupts.CPU90.PMI:Performance_monitoring_interrupts
     97.25 ±  5%     +26.5%     123.00 ±  7%  interrupts.CPU91.NMI:Non-maskable_interrupts
     97.25 ±  5%     +26.5%     123.00 ±  7%  interrupts.CPU91.PMI:Performance_monitoring_interrupts
     97.50 ±  5%     +25.9%     122.75 ±  8%  interrupts.CPU92.NMI:Non-maskable_interrupts
     97.50 ±  5%     +25.9%     122.75 ±  8%  interrupts.CPU92.PMI:Performance_monitoring_interrupts
     98.25 ±  6%     +24.2%     122.00 ±  8%  interrupts.CPU93.NMI:Non-maskable_interrupts
     98.25 ±  6%     +24.2%     122.00 ±  8%  interrupts.CPU93.PMI:Performance_monitoring_interrupts
     98.75 ±  5%     +24.3%     122.75 ±  8%  interrupts.CPU94.NMI:Non-maskable_interrupts
     98.75 ±  5%     +24.3%     122.75 ±  8%  interrupts.CPU94.PMI:Performance_monitoring_interrupts
    114.50 ±  3%     +23.6%     141.50 ±  7%  interrupts.CPU95.NMI:Non-maskable_interrupts
    114.50 ±  3%     +23.6%     141.50 ±  7%  interrupts.CPU95.PMI:Performance_monitoring_interrupts
    114807 ±  7%     -21.9%      89661 ± 11%  softirqs.CPU10.RCU
     67022           +55.1%     103976 ± 12%  softirqs.CPU100.RCU
     68447           +52.6%     104445 ± 13%  softirqs.CPU101.RCU
     67666 ±  2%     +53.1%     103575 ± 12%  softirqs.CPU102.RCU
     67916           +52.5%     103595 ± 12%  softirqs.CPU103.RCU
     67734 ±  3%     +55.3%     105196 ± 12%  softirqs.CPU104.RCU
     67002           +54.4%     103476 ± 12%  softirqs.CPU105.RCU
     72864 ± 15%     +42.2%     103642 ± 12%  softirqs.CPU106.RCU
     67356           +53.6%     103436 ± 13%  softirqs.CPU107.RCU
     67656 ±  2%     +53.2%     103667 ± 12%  softirqs.CPU108.RCU
    115511 ±  4%     -22.4%      89667 ±  8%  softirqs.CPU11.RCU
     68173           +54.0%     104992 ± 13%  softirqs.CPU110.RCU
     73090 ± 14%     +41.4%     103372 ± 12%  softirqs.CPU111.RCU
    141860 ±  2%     -23.3%     108808 ± 12%  softirqs.CPU112.RCU
    140386           -23.7%     107073 ± 12%  softirqs.CPU113.RCU
    138878           -22.4%     107763 ± 12%  softirqs.CPU114.RCU
    141773 ±  2%     -20.2%     113204 ± 11%  softirqs.CPU115.RCU
    141638 ±  2%     -23.3%     108583 ± 11%  softirqs.CPU116.RCU
    143489           -23.1%     110281 ± 13%  softirqs.CPU117.RCU
    143068 ±  2%     -21.7%     111972 ± 11%  softirqs.CPU118.RCU
    139741           -20.8%     110640 ± 11%  softirqs.CPU119.RCU
    116209 ±  2%     -23.8%      88525 ±  9%  softirqs.CPU12.RCU
    142820           -23.6%     109043 ± 13%  softirqs.CPU120.RCU
    145143           -23.1%     111612 ± 11%  softirqs.CPU121.RCU
    146899           -24.3%     111134 ± 11%  softirqs.CPU122.RCU
    146889 ±  2%     -25.6%     109310 ± 12%  softirqs.CPU123.RCU
    144569           -24.7%     108869 ± 12%  softirqs.CPU124.RCU
    144871           -25.0%     108630 ± 12%  softirqs.CPU125.RCU
    145684           -25.2%     109041 ± 12%  softirqs.CPU126.RCU
    145098           -23.8%     110556 ± 11%  softirqs.CPU127.RCU
    111587           -15.2%      94645 ± 12%  softirqs.CPU128.RCU
    111259 ±  2%     -17.6%      91645 ± 11%  softirqs.CPU129.RCU
    111588 ±  3%     -18.8%      90663 ± 10%  softirqs.CPU130.RCU
    108817 ±  3%     -18.2%      89058 ±  7%  softirqs.CPU131.RCU
    117185 ± 11%     -24.0%      89019 ± 10%  softirqs.CPU132.RCU
    111106 ±  3%     -13.9%      95671 ±  7%  softirqs.CPU133.RCU
    115428           -18.7%      93847 ±  8%  softirqs.CPU134.RCU
    112137 ±  3%     -15.2%      95081 ± 10%  softirqs.CPU135.RCU
    111739 ±  2%     -14.5%      95506 ±  7%  softirqs.CPU136.RCU
    109885 ±  2%     -13.1%      95477 ± 11%  softirqs.CPU138.RCU
    107366 ±  4%     -14.6%      91725 ±  9%  softirqs.CPU139.RCU
    118779 ±  4%     -20.4%      94547 ± 13%  softirqs.CPU14.RCU
    113475           -19.9%      90936 ± 11%  softirqs.CPU140.RCU
    113373           -14.4%      97078 ±  9%  softirqs.CPU141.RCU
    107610 ±  4%     -17.3%      88964 ±  7%  softirqs.CPU142.RCU
    113471 ±  3%     -19.1%      91804 ± 11%  softirqs.CPU145.RCU
    113724 ±  4%     -18.1%      93170 ± 10%  softirqs.CPU146.RCU
    107331           -23.3%      82330 ± 12%  softirqs.CPU147.RCU
    105510           -22.0%      82285 ± 10%  softirqs.CPU148.RCU
    104771           -21.0%      82786 ± 12%  softirqs.CPU149.RCU
    113826 ±  4%     -15.7%      95967 ± 10%  softirqs.CPU15.RCU
    103066 ±  2%     -19.7%      82722 ± 10%  softirqs.CPU150.RCU
    111378           -18.8%      90469 ± 11%  softirqs.CPU151.RCU
    107751           -18.2%      88190 ± 10%  softirqs.CPU152.RCU
    109069           -17.7%      89763 ± 10%  softirqs.CPU153.RCU
    110981           -17.1%      92050 ±  8%  softirqs.CPU156.RCU
    109101 ±  4%     -14.5%      93286 ± 11%  softirqs.CPU157.RCU
    105269 ±  2%     +15.5%     121614 ± 11%  softirqs.CPU157.TIMER
    108507 ±  2%     -16.7%      90424 ± 11%  softirqs.CPU158.RCU
    137627 ±  4%     -19.1%     111280 ±  9%  softirqs.CPU16.RCU
    105781 ±  3%     -15.6%      89330 ±  9%  softirqs.CPU164.RCU
    117163 ±  2%     -12.2%     102870 ±  9%  softirqs.CPU169.RCU
    132687 ±  4%     -18.5%     108177 ± 11%  softirqs.CPU17.RCU
    104078 ±  2%     +30.7%     135991 ± 13%  softirqs.CPU170.TIMER
    107966           -14.4%      92379 ±  9%  softirqs.CPU171.RCU
    109509           -16.0%      92014 ±  9%  softirqs.CPU172.RCU
    107260 ±  2%     -13.5%      92781 ±  9%  softirqs.CPU173.RCU
    112039           -16.7%      93369 ±  8%  softirqs.CPU175.RCU
    112843 ±  2%     -19.4%      90950 ± 10%  softirqs.CPU176.RCU
    114882 ±  3%     -19.7%      92252 ± 11%  softirqs.CPU177.RCU
    110061           -18.1%      90141 ± 11%  softirqs.CPU179.RCU
    132493 ±  3%     -18.4%     108091 ± 11%  softirqs.CPU18.RCU
    111417 ±  2%     -12.6%      97411 ± 10%  softirqs.CPU180.RCU
    113860           -16.1%      95476 ± 11%  softirqs.CPU181.RCU
    113908           -19.8%      91307 ± 12%  softirqs.CPU183.RCU
    113295           -23.1%      87179 ± 11%  softirqs.CPU185.RCU
    114953 ±  2%     -19.4%      92616 ± 11%  softirqs.CPU186.RCU
    112802           -21.7%      88275 ± 10%  softirqs.CPU187.RCU
    114273 ±  2%     -21.3%      89969 ± 10%  softirqs.CPU188.RCU
    110963 ±  2%     -18.3%      90684 ±  9%  softirqs.CPU189.RCU
    137474 ±  4%     -17.8%     113059 ±  9%  softirqs.CPU19.RCU
    109395           -18.6%      89020 ± 10%  softirqs.CPU190.RCU
    113241 ±  2%     -15.7%      95438 ± 14%  softirqs.CPU191.RCU
    119653 ±  3%     -19.2%      96668 ±  8%  softirqs.CPU2.RCU
    140328 ±  4%     -22.4%     108851 ± 10%  softirqs.CPU20.RCU
    141178           -22.2%     109790 ± 10%  softirqs.CPU21.RCU
    138902           -19.9%     111234 ± 10%  softirqs.CPU22.RCU
    135335 ±  2%     -18.7%     110042 ± 10%  softirqs.CPU23.RCU
    149310 ±  3%     -24.1%     113340 ± 13%  softirqs.CPU24.RCU
    105377 ±  2%     +17.7%     124078 ±  8%  softirqs.CPU24.TIMER
    146100 ±  2%     -23.1%     112405 ± 10%  softirqs.CPU25.RCU
    102776 ±  2%     +17.6%     120846 ±  7%  softirqs.CPU25.TIMER
    149654 ±  2%     -22.5%     115966 ±  8%  softirqs.CPU26.RCU
     99613 ±  5%     +19.5%     119086 ±  9%  softirqs.CPU26.TIMER
    146520 ±  2%     -24.5%     110584 ±  9%  softirqs.CPU27.RCU
    102741 ±  2%     +21.4%     124766 ±  9%  softirqs.CPU27.TIMER
    144615 ±  2%     -24.3%     109468 ± 10%  softirqs.CPU28.RCU
    101900 ±  2%     +22.8%     125093 ±  8%  softirqs.CPU28.TIMER
    145338 ±  2%     -24.8%     109259 ± 10%  softirqs.CPU29.RCU
    101827 ±  2%     +22.4%     124607 ±  8%  softirqs.CPU29.TIMER
    117300 ±  3%     -22.3%      91131 ± 12%  softirqs.CPU3.RCU
    144680 ±  2%     -23.4%     110767 ± 11%  softirqs.CPU30.RCU
    102055 ±  2%     +20.7%     123214 ±  8%  softirqs.CPU30.TIMER
    145761 ±  2%     -23.5%     111448 ± 10%  softirqs.CPU31.RCU
    102347 ±  2%     +17.1%     119813 ±  8%  softirqs.CPU31.TIMER
    102387 ±  2%     +19.4%     122209 ±  8%  softirqs.CPU32.TIMER
    115843 ±  5%     -19.7%      92972 ±  9%  softirqs.CPU33.RCU
    102055 ±  2%     +20.7%     123158 ±  9%  softirqs.CPU33.TIMER
    116302 ±  5%     -20.7%      92176 ±  9%  softirqs.CPU34.RCU
    101545 ±  2%     +19.4%     121281 ±  9%  softirqs.CPU34.TIMER
    114752 ±  5%     -20.2%      91557 ±  8%  softirqs.CPU35.RCU
    102608           +19.0%     122102 ± 10%  softirqs.CPU35.TIMER
    113642 ±  4%     -20.2%      90661 ±  9%  softirqs.CPU36.RCU
    114695 ±  6%     -16.9%      95364 ±  8%  softirqs.CPU37.RCU
    118080 ±  6%     -21.4%      92840 ± 10%  softirqs.CPU38.RCU
    102010 ±  3%     +16.3%     118655 ±  8%  softirqs.CPU38.TIMER
    114045 ±  6%     -16.7%      95036 ±  8%  softirqs.CPU39.RCU
    102024 ±  2%     +27.6%     130200 ± 16%  softirqs.CPU39.TIMER
    117732 ±  4%     -23.9%      89579 ± 10%  softirqs.CPU4.RCU
    114938 ±  6%     -16.3%      96214 ±  7%  softirqs.CPU40.RCU
    101968 ±  2%     +15.3%     117609 ±  8%  softirqs.CPU40.TIMER
    101673 ±  2%     +27.2%     129330 ± 16%  softirqs.CPU41.TIMER
    114023 ±  6%     -14.4%      97626 ±  9%  softirqs.CPU42.RCU
    112471 ±  6%     -15.9%      94577 ±  8%  softirqs.CPU43.RCU
    115403 ±  8%     -17.4%      95318 ±  9%  softirqs.CPU44.RCU
    114657 ±  5%     -16.9%      95291 ±  9%  softirqs.CPU46.RCU
    115788 ±  6%     -17.7%      95286 ±  7%  softirqs.CPU47.RCU
    102567           +15.2%     118189 ± 10%  softirqs.CPU48.TIMER
    109280 ±  6%     -17.6%      90027 ±  9%  softirqs.CPU49.RCU
    103234 ±  2%     +16.1%     119839 ±  7%  softirqs.CPU49.TIMER
    116511 ±  4%     -25.1%      87222 ± 11%  softirqs.CPU5.RCU
    111236 ±  3%     -16.7%      92679 ±  8%  softirqs.CPU50.RCU
    103307 ±  2%     +15.5%     119288 ±  9%  softirqs.CPU50.TIMER
    108551 ±  3%     -22.9%      83639 ± 11%  softirqs.CPU51.RCU
    103007 ±  2%     +17.7%     121226 ±  8%  softirqs.CPU51.TIMER
    111623 ±  6%     -23.7%      85153 ± 12%  softirqs.CPU52.RCU
    103208 ±  2%     +18.2%     122033 ±  8%  softirqs.CPU52.TIMER
    114852 ±  6%     -25.2%      85873 ± 11%  softirqs.CPU53.RCU
    103008 ±  2%     +18.2%     121744 ±  9%  softirqs.CPU53.TIMER
    106696 ±  5%     -20.0%      85363 ± 10%  softirqs.CPU54.RCU
    102978 ±  2%     +16.9%     120354 ±  8%  softirqs.CPU54.TIMER
    112866 ±  5%     -19.5%      90845 ± 10%  softirqs.CPU55.RCU
    102774 ±  3%     +16.3%     119527 ±  7%  softirqs.CPU55.TIMER
    110412 ±  2%     -22.6%      85468 ±  9%  softirqs.CPU56.RCU
    103683 ±  2%     +16.8%     121089 ±  8%  softirqs.CPU56.TIMER
    110917 ±  3%     -15.9%      93283 ±  9%  softirqs.CPU57.RCU
    103298 ±  2%     +16.3%     120089 ±  8%  softirqs.CPU57.TIMER
    102942 ±  2%     +15.6%     119031 ±  8%  softirqs.CPU58.TIMER
    102947 ±  2%     +16.7%     120113 ±  8%  softirqs.CPU59.TIMER
    117037 ±  2%     -25.1%      87635 ± 12%  softirqs.CPU6.RCU
    111451 ±  3%     -18.3%      91011 ±  6%  softirqs.CPU60.RCU
    103346 ±  3%     +16.3%     120184 ±  7%  softirqs.CPU60.TIMER
    103643 ±  2%     +15.7%     119959 ±  7%  softirqs.CPU61.TIMER
    103169 ±  2%     +17.6%     121359 ±  8%  softirqs.CPU62.TIMER
    103066 ±  2%     +15.3%     118795 ±  8%  softirqs.CPU63.TIMER
    102911 ±  2%     +18.9%     122382 ±  7%  softirqs.CPU64.TIMER
    102990 ±  2%     +20.0%     123589 ±  9%  softirqs.CPU65.TIMER
    103436 ±  2%     +15.7%     119700 ±  7%  softirqs.CPU66.TIMER
    102991 ±  2%     +17.3%     120760 ±  8%  softirqs.CPU67.TIMER
    103922 ±  4%     -11.4%      92125 ±  6%  softirqs.CPU68.RCU
    102601 ±  2%     +23.1%     126293 ±  8%  softirqs.CPU68.TIMER
    103013 ±  2%     +19.2%     122837 ±  7%  softirqs.CPU69.TIMER
    118925 ±  2%     -24.4%      89901 ± 12%  softirqs.CPU7.RCU
    103386           +18.2%     122253 ±  9%  softirqs.CPU70.TIMER
    100972           +18.1%     119264 ± 10%  softirqs.CPU72.TIMER
    102061 ±  3%     +18.4%     120875 ±  7%  softirqs.CPU73.TIMER
    101853 ±  3%     +18.0%     120176 ±  8%  softirqs.CPU74.TIMER
    111439 ±  3%     -16.5%      93104 ±  6%  softirqs.CPU75.RCU
    101697 ±  2%     +19.9%     121975 ±  9%  softirqs.CPU75.TIMER
    110273 ±  2%     -16.0%      92646 ±  6%  softirqs.CPU76.RCU
    101366 ±  2%     +18.7%     120332 ±  9%  softirqs.CPU76.TIMER
    108036 ±  4%     -14.0%      92925 ±  6%  softirqs.CPU77.RCU
    101645           +22.2%     124189 ± 10%  softirqs.CPU77.TIMER
    109104 ±  5%     -12.0%      96050 ±  8%  softirqs.CPU78.RCU
    101351 ±  3%     +21.9%     123584 ±  9%  softirqs.CPU78.TIMER
    112263 ±  2%     -17.1%      93071 ±  6%  softirqs.CPU79.RCU
    101398 ±  3%     +21.4%     123104 ±  8%  softirqs.CPU79.TIMER
    117671 ±  3%     -17.8%      96736 ±  8%  softirqs.CPU8.RCU
    111236 ±  3%     -18.4%      90740 ±  7%  softirqs.CPU80.RCU
    101496 ±  3%     +21.0%     122824 ±  8%  softirqs.CPU80.TIMER
    115502 ±  4%     -21.6%      90595 ± 10%  softirqs.CPU81.RCU
    102292 ±  2%     +19.7%     122489 ±  7%  softirqs.CPU81.TIMER
    101957 ±  3%     +19.1%     121420 ±  8%  softirqs.CPU82.TIMER
    109823 ±  3%     -18.7%      89302 ± 10%  softirqs.CPU83.RCU
    101972           +20.4%     122740 ±  8%  softirqs.CPU83.TIMER
    101726 ±  3%     +18.9%     121002 ±  8%  softirqs.CPU84.TIMER
    111696 ±  2%     -14.4%      95631 ±  9%  softirqs.CPU85.RCU
    101708 ±  3%     +19.7%     121792 ±  8%  softirqs.CPU85.TIMER
    101866 ±  3%     +17.3%     119519 ±  9%  softirqs.CPU86.TIMER
    111966 ±  2%     -20.2%      89370 ±  9%  softirqs.CPU87.RCU
    102672 ±  4%     +20.3%     123522 ±  8%  softirqs.CPU87.TIMER
    101535 ±  3%     +19.6%     121457 ±  8%  softirqs.CPU88.TIMER
    111598 ±  2%     -23.2%      85697 ±  8%  softirqs.CPU89.RCU
    103974 ±  4%     +20.3%     125032 ±  9%  softirqs.CPU89.TIMER
    118390 ±  3%     -23.0%      91130 ± 11%  softirqs.CPU9.RCU
    108965 ±  3%     -19.7%      87481 ±  8%  softirqs.CPU91.RCU
    101923 ±  3%     +22.6%     124920 ±  8%  softirqs.CPU91.TIMER
    109589           -18.3%      89493 ± 11%  softirqs.CPU92.RCU
    101694 ±  3%     +25.6%     127777 ±  6%  softirqs.CPU92.TIMER
    108502 ±  3%     -16.3%      90857 ±  8%  softirqs.CPU93.RCU
    101575 ±  3%     +23.7%     125681 ±  7%  softirqs.CPU93.TIMER
    110076           -19.8%      88245 ±  9%  softirqs.CPU94.RCU
    101754 ±  2%     +23.4%     125553 ±  8%  softirqs.CPU94.TIMER
    101277 ±  2%     +19.9%     121477 ±  8%  softirqs.CPU95.TIMER
     69965 ±  2%     +49.0%     104241 ± 12%  softirqs.CPU97.RCU
     67399           +54.3%     103976 ± 12%  softirqs.CPU98.RCU
     67547 ±  3%     +53.5%     103708 ± 12%  softirqs.CPU99.RCU
  21648900 ±  2%     -14.3%   18549862 ±  9%  softirqs.RCU


                                                                                
                            will-it-scale.per_thread_ops                        
                                                                                
  7e+06 +-------------------------------------------------------------------+   
        |  O  O  O  O  O   O  O  O  O  O  O  O  O  O  O  O   O  O           |   
  6e+06 |-+                                                        O  O  O  |   
        |                                                                   |   
  5e+06 |-+                                                                 |   
        |                                                                   |   
  4e+06 |-+                                                                 |   
        |                                                                   |   
  3e+06 |-+                                                                 |   
        |                                                                   |   
  2e+06 |-+                                                                 |   
        |                                                                   |   
  1e+06 |-+                                                                 |   
        |..+..+..+..+..+...+..+..+..+..+..+..+..+..+..+..+...+..+..+..+     |   
      0 +-------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                will-it-scale.workload                          
                                                                                
  1.1e+08 +-----------------------------------------------------------------+   
    1e+08 |-+O  O  O  O  O  O  O  O  O  O  O  O  O  O  O  O  O  O  O  O  O  |   
          |                                                                 |   
    9e+07 |-+                                                               |   
    8e+07 |-+                                                               |   
    7e+07 |-+                                                               |   
    6e+07 |-+                                                               |   
          |                                                                 |   
    5e+07 |-+                                                               |   
    4e+07 |-+                                                               |   
    3e+07 |-+                                                               |   
    2e+07 |-+                                                               |   
          |                                                                 |   
    1e+07 |..+..+..+..+..+..+..+..+..+..+..+..+..+..+..+..+..+..+..+..+     |   
        0 +-----------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                           will-it-scale.time.user_time                         
                                                                                
  1000 +--------------------------------------------------------------------+   
   900 |-+O  O  O   O  O  O  O  O  O  O   O  O  O  O  O  O  O  O            |   
       |                                                           O  O  O  |   
   800 |-+                                                                  |   
   700 |-+                                                                  |   
       |                                                                    |   
   600 |-+                                                                  |   
   500 |-+                                                                  |   
   400 |-+                                                                  |   
       |                                                                    |   
   300 |-+                                                                  |   
   200 |-+                                                                  |   
       |                                                                    |   
   100 |..+..+..+...+..+..+..+..+..+..+...+..+..+..+..+..+..+..+...+..+     |   
     0 +--------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                          will-it-scale.time.system_time                        
                                                                                
  4800 +--------------------------------------------------------------------+   
  4700 |..+..+..+...+..+..+..+..+..+..+...+..+..+..+..+..+..+..+...+..+     |   
       |                                                                    |   
  4600 |-+                                                                  |   
  4500 |-+                                                                  |   
       |                                                                    |   
  4400 |-+                                                                  |   
  4300 |-+                                                                  |   
  4200 |-+                                                                  |   
       |                                                                    |   
  4100 |-+                                                                  |   
  4000 |-+                                                                  |   
       |  O  O  O         O  O  O                     O  O  O  O   O  O  O  |   
  3900 |-+          O  O           O  O   O  O  O  O                        |   
  3800 +--------------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Rong Chen


View attachment "config-5.6.0-rc4-00017-g222993395ed38" of type "text/plain" (203581 bytes)

View attachment "job-script" of type "text/plain" (7459 bytes)

View attachment "job.yaml" of type "text/plain" (5052 bytes)

View attachment "reproduce" of type "text/plain" (309 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ