lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Message-ID: <1426225098.6711.230.camel@intel.com>
Date:	Fri, 13 Mar 2015 13:38:18 +0800
From:	Huang Ying <ying.huang@...el.com>
To:	Davidlohr Bueso <dave@...olabs.net>
Cc:	LKML <linux-kernel@...r.kernel.org>, LKP ML <lkp@...org>,
	Ingo Molnar <mingo@...nel.org>
Subject: [LKP] [locking/rwsem] b3fd4f03ca0: -11.1% vm-scalability.throughput

Sorry for duplicated email.  Forget to send to the patch author.

FYI, we noticed the below changes on

git://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git master
commit b3fd4f03ca0b9952221f39ae6790e698bf4b39e7 ("locking/rwsem: Avoid deceiving lock spinners")


testbox/testcase/testparams: brickland3/vm-scalability/performance-300s-small-allocs

7a215f89a0335582  b3fd4f03ca0b9952221f39ae67  
----------------  --------------------------  
         %stddev     %change         %stddev
             \          |                \  
      2.38 ± 18%    +247.4%       8.27 ± 16%  vm-scalability.stddev
  24226456 ±  0%     -23.0%   18650874 ±  1%  vm-scalability.time.voluntary_context_switches
      1622 ±  0%     -15.6%       1369 ±  1%  vm-scalability.time.system_time
       765 ±  0%     -13.1%        665 ±  1%  vm-scalability.time.percent_of_cpu_this_job_got
      1036 ±  0%     -11.9%        914 ±  1%  vm-scalability.time.user_time
 7.244e+08 ±  0%     -11.1%  6.439e+08 ±  1%  vm-scalability.time.minor_page_faults
  10841276 ±  0%     -11.1%    9639981 ±  1%  vm-scalability.throughput
   8922883 ±  3%     -70.2%    2658543 ±  4%  cpuidle.C1-IVT-4S.usage
  1.19e+10 ±  2%     -66.2%  4.016e+09 ±  4%  cpuidle.C1-IVT-4S.time
      1.97 ±  4%    +106.7%       4.08 ±  6%  perf-profile.cpu-cycles.intel_idle.cpuidle_enter_state.cpuidle_enter.cpu_startup_entry.start_secondary
     58.29 ±  1%     -50.2%      29.03 ±  2%  turbostat.CPU%c1
     34.84 ±  2%     +86.6%      65.01 ±  1%  turbostat.CPU%c6
    170814 ±  7%     -39.9%     102682 ± 11%  sched_debug.cpu#21.sched_goidle
    367762 ± 11%     -39.9%     220850 ± 10%  sched_debug.cpu#26.sched_count
      5.12 ±  2%     -39.8%       3.08 ±  5%  perf-profile.cpu-cycles.osq_lock.rwsem_down_write_failed.call_rwsem_down_write_failed.vma_link.mmap_region
    342453 ±  7%     -39.9%     205985 ± 11%  sched_debug.cpu#21.nr_switches
      3.14 ±  2%     +68.0%       5.28 ±  5%  perf-profile.cpu-cycles.cpuidle_enter_state.cpuidle_enter.cpu_startup_entry.start_secondary
    170317 ±  6%     -39.9%     102389 ± 11%  sched_debug.cpu#22.sched_goidle
    168710 ±  6%     -38.4%     103876 ± 11%  sched_debug.cpu#23.sched_goidle
    341400 ±  6%     -39.8%     205416 ± 11%  sched_debug.cpu#22.nr_switches
    338590 ±  6%     -38.5%     208381 ± 11%  sched_debug.cpu#23.nr_switches
    165879 ±  4%     -36.6%     105178 ± 10%  sched_debug.cpu#18.sched_goidle
    168958 ±  6%     -39.0%     103043 ± 11%  sched_debug.cpu#20.sched_goidle
    359148 ±  5%     -39.2%     218455 ± 11%  sched_debug.cpu#20.sched_count
    332511 ±  4%     -36.5%     211029 ± 10%  sched_debug.cpu#18.nr_switches
    338875 ±  6%     -39.0%     206782 ± 11%  sched_debug.cpu#20.nr_switches
    359968 ±  6%     -39.4%     218057 ± 12%  sched_debug.cpu#21.sched_count
    166207 ±  4%     -38.5%     102168 ± 11%  sched_debug.cpu#27.sched_goidle
    164881 ±  6%     -37.0%     103846 ± 11%  sched_debug.cpu#25.sched_goidle
    330721 ±  6%     -37.0%     208344 ± 11%  sched_debug.cpu#25.nr_switches
    333161 ±  4%     -38.3%     205591 ± 11%  sched_debug.cpu#27.nr_switches
    362674 ±  7%     -40.1%     217123 ± 10%  sched_debug.cpu#22.sched_count
    350433 ±  7%     -37.3%     219595 ± 13%  sched_debug.cpu#15.nr_switches
    174599 ±  7%     -37.4%     109366 ± 13%  sched_debug.cpu#15.sched_goidle
    174038 ±  9%     -36.8%     109941 ± 12%  sched_debug.cpu#17.sched_goidle
    348896 ±  9%     -36.7%     220793 ± 12%  sched_debug.cpu#17.nr_switches
    327443 ±  6%     -36.8%     207015 ± 11%  sched_debug.cpu#24.nr_switches
    348687 ±  5%     -37.2%     219100 ± 11%  sched_debug.cpu#27.sched_count
    163220 ±  6%     -36.9%     103066 ± 11%  sched_debug.cpu#24.sched_goidle
    167997 ±  5%     -35.7%     108017 ± 11%  sched_debug.cpu#16.sched_goidle
    365757 ± 10%     -38.9%     223561 ± 12%  sched_debug.cpu#28.sched_count
    336756 ±  5%     -35.6%     216751 ± 11%  sched_debug.cpu#16.nr_switches
    174236 ± 12%     -40.6%     103542 ± 10%  sched_debug.cpu#26.sched_goidle
    349494 ± 12%     -40.6%     207718 ± 10%  sched_debug.cpu#26.nr_switches
    175130 ± 10%     -39.7%     105573 ± 13%  sched_debug.cpu#28.sched_goidle
    351090 ± 10%     -39.6%     212090 ± 13%  sched_debug.cpu#28.nr_switches
    350972 ±  5%     -35.2%     227402 ± 10%  sched_debug.cpu#19.sched_count
    343794 ±  5%     -36.2%     219297 ± 10%  sched_debug.cpu#24.sched_count
    347268 ±  5%     -36.3%     221228 ± 10%  sched_debug.cpu#25.sched_count
    352999 ±  5%     -34.1%     232554 ±  9%  sched_debug.cpu#16.sched_count
    354362 ±  7%     -37.0%     223292 ± 10%  sched_debug.cpu#23.sched_count
    166091 ±  7%     -36.6%     105356 ± 14%  sched_debug.cpu#29.sched_goidle
    350840 ±  6%     -35.5%     226331 ± 13%  sched_debug.cpu#29.sched_count
    332928 ±  7%     -36.4%     211785 ± 14%  sched_debug.cpu#29.nr_switches
    369396 ±  7%     -36.4%     234822 ± 13%  sched_debug.cpu#15.sched_count
    364063 ±  9%     -34.6%     238151 ± 11%  sched_debug.cpu#17.sched_count
    349193 ±  4%     -35.2%     226315 ±  9%  sched_debug.cpu#18.sched_count
      3.94 ±  1%     +49.9%       5.90 ±  5%  perf-profile.cpu-cycles.cpuidle_enter.cpu_startup_entry.start_secondary
   5361900 ±  1%     +50.5%    8067121 ±  0%  cpuidle.C6-IVT-4S.usage
    166471 ±  5%     -36.3%     106063 ± 10%  sched_debug.cpu#19.sched_goidle
    334078 ±  5%     -36.3%     212767 ± 10%  sched_debug.cpu#19.nr_switches
    511523 ± 11%     +40.1%     716466 ±  9%  sched_debug.cpu#38.avg_idle
      5141 ± 10%     -21.3%       4046 ± 18%  sched_debug.cfs_rq[16]:/.avg->runnable_avg_sum
    185324 ±  6%     -28.9%     131826 ± 11%  sched_debug.cpu#43.ttwu_count
       111 ± 10%     -21.6%         87 ± 18%  sched_debug.cfs_rq[16]:/.tg_runnable_contrib
    188387 ±  5%     -28.4%     134976 ± 11%  sched_debug.cpu#35.ttwu_count
    182306 ±  7%     -28.0%     131276 ±  9%  sched_debug.cpu#19.ttwu_count
    181618 ±  5%     -28.6%     129685 ± 10%  sched_debug.cpu#18.ttwu_count
    370815 ±  7%     -25.5%     276125 ± 11%  sched_debug.cpu#38.sched_count
    178281 ±  7%     -25.9%     132044 ± 11%  sched_debug.cpu#38.sched_goidle
    181914 ±  5%     -28.0%     130970 ±  8%  sched_debug.cpu#16.ttwu_count
    357347 ±  7%     -25.9%     264826 ± 11%  sched_debug.cpu#38.nr_switches
    546593 ±  7%     +38.6%     757389 ±  4%  sched_debug.cpu#27.avg_idle
    183057 ±  5%     -27.7%     132439 ±  8%  sched_debug.cpu#17.ttwu_count
    174289 ±  8%     -25.5%     129871 ± 13%  sched_debug.cpu#43.sched_goidle
    349323 ±  8%     -25.4%     260438 ± 13%  sched_debug.cpu#43.nr_switches
    187088 ±  5%     -27.4%     135758 ± 10%  sched_debug.cpu#36.ttwu_count
    190589 ±  5%     -29.1%     135135 ± 12%  sched_debug.cpu#33.ttwu_count
    179655 ± 10%     -28.6%     128343 ± 13%  sched_debug.cpu#44.sched_goidle
    367566 ± 11%     -26.0%     271924 ± 14%  sched_debug.cpu#43.sched_count
    360119 ± 10%     -28.5%     257380 ± 13%  sched_debug.cpu#44.nr_switches
    177427 ±  5%     -25.5%     132241 ±  9%  sched_debug.cpu#20.ttwu_count
    187477 ±  6%     -28.9%     133263 ± 11%  sched_debug.cpu#39.ttwu_count
    187313 ±  5%     -28.7%     133487 ± 11%  sched_debug.cpu#41.ttwu_count
    192203 ±  4%     -28.3%     137818 ± 10%  sched_debug.cpu#31.ttwu_count
    183679 ±  5%     -28.1%     132147 ± 10%  sched_debug.cpu#44.ttwu_count
    367665 ±  9%     -24.6%     277237 ± 15%  sched_debug.cpu#42.sched_count
    178211 ±  3%     -26.9%     130348 ±  8%  sched_debug.cpu#23.ttwu_count
    175478 ±  4%     -25.6%     130478 ±  9%  sched_debug.cpu#22.ttwu_count
    186974 ±  6%     -27.6%     135310 ± 10%  sched_debug.cpu#38.ttwu_count
    190431 ±  4%     -28.0%     137033 ± 11%  sched_debug.cpu#32.ttwu_count
    190722 ±  4%     -28.4%     136639 ± 10%  sched_debug.cpu#34.ttwu_count
    175431 ±  8%     -25.3%     131079 ± 12%  sched_debug.cpu#42.sched_goidle
    361690 ±  8%     -24.8%     272015 ± 13%  sched_debug.cpu#39.sched_count
    351619 ±  8%     -25.2%     262838 ± 12%  sched_debug.cpu#42.nr_switches
    175056 ±  6%     -24.8%     131564 ± 12%  sched_debug.cpu#40.sched_goidle
    350873 ±  6%     -24.8%     263820 ± 12%  sched_debug.cpu#40.nr_switches
    173107 ±  6%     -25.3%     129289 ± 13%  sched_debug.cpu#37.sched_goidle
    346966 ±  6%     -25.3%     259257 ± 13%  sched_debug.cpu#37.nr_switches
    171359 ±  7%     -24.8%     128941 ± 11%  sched_debug.cpu#39.sched_goidle
    343474 ±  7%     -24.7%     258590 ± 11%  sched_debug.cpu#39.nr_switches
    375852 ± 12%     -28.4%     269206 ± 15%  sched_debug.cpu#44.sched_count
    180303 ±  8%     -25.0%     135309 ± 10%  sched_debug.cpu#30.sched_goidle
    177803 ±  5%     -25.3%     132893 ±  9%  sched_debug.cpu#21.ttwu_count
    361386 ±  8%     -24.9%     271330 ± 10%  sched_debug.cpu#30.nr_switches
    172414 ±  7%     -24.9%     129400 ± 13%  sched_debug.cpu#41.sched_goidle
    345579 ±  7%     -24.9%     259489 ± 13%  sched_debug.cpu#41.nr_switches
    373591 ±  8%     -25.3%     279094 ± 13%  sched_debug.cpu#31.sched_count
    177533 ±  9%     -26.9%     129812 ± 12%  sched_debug.cpu#36.sched_goidle
    179094 ±  8%     -26.3%     131936 ± 11%  sched_debug.cpu#35.sched_goidle
    376042 ±  8%     -26.7%     275458 ± 12%  sched_debug.cpu#35.sched_count
    355841 ±  9%     -26.8%     260341 ± 12%  sched_debug.cpu#36.nr_switches
    183165 ± 12%     -29.4%     129301 ± 13%  sched_debug.cpu#33.sched_goidle
    371977 ±  9%     -27.3%     270521 ± 13%  sched_debug.cpu#36.sched_count
    184524 ±  5%     -27.3%     134078 ± 10%  sched_debug.cpu#42.ttwu_count
    204591 ±  7%     -22.5%     158606 ± 16%  sched_debug.cfs_rq[33]:/.min_vruntime
    358950 ±  8%     -26.3%     264608 ± 11%  sched_debug.cpu#35.nr_switches
    367143 ± 12%     -29.4%     259297 ± 13%  sched_debug.cpu#33.nr_switches
    184796 ±  5%     -26.7%     135370 ±  8%  sched_debug.cpu#15.ttwu_count
    560186 ±  7%     +36.4%     764034 ±  4%  sched_debug.cpu#15.avg_idle
    192024 ±  5%     -27.6%     138984 ±  9%  sched_debug.cpu#30.ttwu_count
    186661 ±  5%     -27.9%     134534 ± 11%  sched_debug.cpu#40.ttwu_count
    175890 ±  4%     -26.4%     129452 ±  8%  sched_debug.cpu#26.ttwu_count
    366664 ±  8%     -24.7%     276276 ± 14%  sched_debug.cpu#34.sched_count
    186046 ±  5%     -26.7%     136338 ± 10%  sched_debug.cpu#37.ttwu_count
    173138 ±  4%     -26.5%     127219 ±  8%  sched_debug.cpu#28.ttwu_count
    231881 ±  4%     -26.0%     171683 ±  6%  sched_debug.cpu#48.ttwu_count
    229108 ±  4%     -24.5%     173024 ±  5%  sched_debug.cpu#47.ttwu_count
    545213 ±  6%     +30.6%     712076 ±  3%  sched_debug.cpu#39.avg_idle
    175780 ±  8%     -25.0%     131911 ± 12%  sched_debug.cpu#34.sched_goidle
    352325 ±  8%     -24.9%     264519 ± 12%  sched_debug.cpu#34.nr_switches
    368764 ±  7%     -25.9%     273326 ± 13%  sched_debug.cpu#40.sched_count
    178369 ±  7%     -25.3%     133316 ± 12%  sched_debug.cpu#31.sched_goidle
    357523 ±  7%     -25.2%     267329 ± 12%  sched_debug.cpu#31.nr_switches
    445168 ±  6%     -21.5%     349498 ±  7%  sched_debug.cpu#50.sched_count
    178502 ±  3%     -27.0%     130326 ±  8%  sched_debug.cpu#24.ttwu_count
    232438 ±  4%     -25.2%     173912 ±  4%  sched_debug.cpu#45.ttwu_count
    214980 ±  6%     -21.3%     169213 ±  7%  sched_debug.cpu#50.sched_goidle
    430801 ±  6%     -21.3%     339213 ±  7%  sched_debug.cpu#50.nr_switches
    175354 ±  7%     -25.0%     131440 ± 12%  sched_debug.cpu#32.sched_goidle
    351473 ±  7%     -25.0%     263573 ± 12%  sched_debug.cpu#32.nr_switches
    175818 ±  4%     -25.5%     131027 ±  9%  sched_debug.cpu#25.ttwu_count
    562351 ±  4%     +33.0%     747969 ±  7%  sched_debug.cpu#17.avg_idle
    226274 ±  5%     -24.6%     170581 ±  5%  sched_debug.cpu#54.ttwu_count
    566741 ±  5%     +33.2%     754744 ±  4%  sched_debug.cpu#29.avg_idle
    365692 ±  8%     -24.7%     275497 ± 14%  sched_debug.cpu#32.sched_count
    443973 ±  6%     -22.1%     345964 ±  7%  sched_debug.cpu#51.sched_count
    360816 ±  8%     -25.3%     269548 ± 14%  sched_debug.cpu#41.sched_count
    224711 ±  4%     -24.6%     169414 ±  6%  sched_debug.cpu#53.ttwu_count
    380979 ± 13%     -28.9%     270783 ± 14%  sched_debug.cpu#33.sched_count
    174502 ±  4%     -27.0%     127311 ±  8%  sched_debug.cpu#29.ttwu_count
    573889 ±  4%     +32.2%     758635 ±  5%  sched_debug.cpu#24.avg_idle
    523204 ± 10%     +29.1%     675536 ±  9%  sched_debug.cpu#6.avg_idle
    173555 ±  4%     -25.7%     128988 ±  8%  sched_debug.cpu#27.ttwu_count
    228859 ±  4%     -25.2%     171229 ±  6%  sched_debug.cpu#49.ttwu_count
    529356 ±  9%     +32.4%     700872 ±  6%  sched_debug.cpu#33.avg_idle
    565916 ±  5%     +33.4%     755047 ±  7%  sched_debug.cpu#23.avg_idle
    232257 ±  3%     -25.1%     173926 ±  5%  sched_debug.cpu#46.ttwu_count
    227954 ±  4%     -24.3%     172631 ±  5%  sched_debug.cpu#52.ttwu_count
    197241 ±  5%     -23.5%     150963 ±  8%  sched_debug.cpu#4.ttwu_count
    228392 ±  3%     -24.8%     171779 ±  6%  sched_debug.cpu#51.ttwu_count
    542129 ±  5%     +28.0%     693751 ±  6%  sched_debug.cpu#13.avg_idle
    364245 ±  8%     -25.1%     272652 ± 15%  sched_debug.cpu#37.sched_count
    558275 ±  8%     +36.1%     759570 ±  6%  sched_debug.cpu#26.avg_idle
    225027 ±  5%     -24.7%     169427 ±  6%  sched_debug.cpu#57.ttwu_count
     17.06 ±  1%     -23.0%      13.13 ±  3%  perf-profile.cpu-cycles.call_rwsem_down_write_failed.vma_link.mmap_region.do_mmap_pgoff.vm_mmap_pgoff
    197493 ±  5%     -22.8%     152503 ±  8%  sched_debug.cpu#2.ttwu_count
     16.99 ±  1%     -23.2%      13.05 ±  3%  perf-profile.cpu-cycles.rwsem_down_write_failed.call_rwsem_down_write_failed.vma_link.mmap_region.do_mmap_pgoff
    223164 ±  4%     -24.7%     168105 ±  6%  sched_debug.cpu#59.ttwu_count
    223884 ±  4%     -24.6%     168887 ±  4%  sched_debug.cpu#58.ttwu_count
    538073 ±  6%     +27.8%     687436 ±  8%  sched_debug.cpu#43.avg_idle
    445916 ±  7%     -22.4%     345938 ±  6%  sched_debug.cpu#52.sched_count
    214967 ±  6%     -21.9%     167898 ±  6%  sched_debug.cpu#52.sched_goidle
    534156 ±  9%     +25.2%     668876 ±  5%  sched_debug.cpu#11.avg_idle
    430800 ±  6%     -21.9%     336561 ±  6%  sched_debug.cpu#52.nr_switches
       117 ±  8%     -21.7%         91 ±  5%  sched_debug.cfs_rq[36]:/.tg_runnable_contrib
    224801 ±  4%     -24.0%     170764 ±  5%  sched_debug.cpu#55.ttwu_count
    225103 ±  4%     -24.9%     168953 ±  5%  sched_debug.cpu#56.ttwu_count
  24226456 ±  0%     -23.0%   18650874 ±  1%  time.voluntary_context_switches
      5411 ±  8%     -21.3%       4256 ±  4%  sched_debug.cfs_rq[36]:/.avg->runnable_avg_sum
    212964 ±  5%     -21.5%     167092 ±  6%  sched_debug.cpu#51.sched_goidle
    426769 ±  5%     -21.5%     334967 ±  6%  sched_debug.cpu#51.nr_switches
    519159 ±  4%     +27.0%     659572 ±  7%  sched_debug.cpu#52.avg_idle
    193464 ±  4%     -22.1%     150665 ±  7%  sched_debug.cpu#7.ttwu_count
    226747 ±  4%     -24.4%     171347 ±  6%  sched_debug.cpu#50.ttwu_count
    572755 ±  6%     +29.0%     738639 ±  4%  sched_debug.cpu#25.avg_idle
    520910 ±  7%     +35.0%     703382 ±  6%  sched_debug.cpu#32.avg_idle
 2.696e+10 ±  1%     +29.0%  3.478e+10 ±  0%  cpuidle.C6-IVT-4S.time
    530311 ± 12%     +31.1%     695099 ±  5%  sched_debug.cpu#44.avg_idle
    204543 ±  8%     -20.5%     162661 ± 15%  sched_debug.cfs_rq[31]:/.min_vruntime
    484242 ±  9%     +31.7%     637669 ±  8%  sched_debug.cpu#47.avg_idle
      6.85 ±  1%     -22.4%       5.32 ±  3%  perf-profile.cpu-cycles.rwsem_spin_on_owner.rwsem_down_write_failed.call_rwsem_down_write_failed.vma_link.mmap_region
    528770 ±  7%     +31.6%     695818 ±  6%  sched_debug.cpu#40.avg_idle
    223475 ±  4%     -20.9%     176718 ±  6%  sched_debug.cfs_rq[52]:/.min_vruntime
    577331 ±  4%     +29.2%     745806 ±  4%  sched_debug.cpu#16.avg_idle
    192821 ±  4%     -23.4%     147763 ±  8%  sched_debug.cpu#10.ttwu_count
    198393 ±  4%     -23.1%     152635 ±  7%  sched_debug.cpu#1.ttwu_count
    572991 ±  9%     +29.0%     738876 ±  3%  sched_debug.cpu#18.avg_idle
    531346 ±  5%     +26.8%     673808 ±  6%  sched_debug.cpu#35.avg_idle
    531692 ±  8%     +30.0%     691275 ±  7%  sched_debug.cpu#36.avg_idle
    573689 ±  9%     +30.1%     746581 ±  3%  sched_debug.cpu#28.avg_idle
    194767 ±  3%     -22.1%     151736 ±  7%  sched_debug.cpu#6.ttwu_count
    576252 ± 10%     +29.8%     748134 ±  5%  sched_debug.cpu#19.avg_idle
    189779 ±  5%     -22.5%     147019 ±  9%  sched_debug.cpu#13.ttwu_count
    574093 ±  9%     +28.0%     734982 ±  4%  sched_debug.cpu#22.avg_idle
    530896 ±  7%     +25.4%     665864 ±  7%  sched_debug.cpu#9.avg_idle
    222143 ±  5%     -19.0%     179889 ±  9%  sched_debug.cfs_rq[49]:/.min_vruntime
    190106 ±  5%     -22.4%     147518 ±  7%  sched_debug.cpu#14.ttwu_count
    192933 ±  3%     -21.8%     150835 ±  8%  sched_debug.cpu#8.ttwu_count
    193656 ±  4%     -22.7%     149678 ±  8%  sched_debug.cpu#9.ttwu_count
    196739 ±  5%     -22.9%     151747 ±  7%  sched_debug.cpu#3.ttwu_count
    434909 ±  6%     -18.4%     354789 ±  6%  sched_debug.cpu#55.sched_count
    194722 ±  4%     -22.0%     151895 ±  8%  sched_debug.cpu#5.ttwu_count
    439285 ±  7%     -19.7%     352534 ±  6%  sched_debug.cpu#47.sched_count
    585003 ±  7%     +31.4%     768551 ±  5%  sched_debug.cpu#20.avg_idle
    432219 ±  7%     -19.5%     347734 ±  7%  sched_debug.cpu#48.sched_count
    224113 ±  5%     -18.9%     181798 ±  8%  sched_debug.cfs_rq[48]:/.min_vruntime
    534566 ±  7%     +30.3%     696442 ±  6%  sched_debug.cpu#31.avg_idle
    525194 ±  6%     +23.5%     648587 ±  7%  sched_debug.cpu#7.avg_idle
    209128 ±  6%     -19.4%     168562 ±  7%  sched_debug.cpu#48.sched_goidle
    419098 ±  6%     -19.4%     337908 ±  7%  sched_debug.cpu#48.nr_switches
    448417 ±  7%     -19.8%     359813 ±  6%  sched_debug.cpu#46.sched_count
    491962 ±  8%     +26.7%     623449 ±  4%  sched_debug.cpu#48.avg_idle
    212354 ±  6%     -19.7%     170477 ±  5%  sched_debug.cpu#47.sched_goidle
    581409 ±  7%     +23.6%     718790 ±  4%  sched_debug.cpu#37.avg_idle
    194066 ±  6%     -17.8%     159565 ± 11%  sched_debug.cfs_rq[16]:/.min_vruntime
    425571 ±  6%     -19.7%     341752 ±  5%  sched_debug.cpu#47.nr_switches
    215882 ±  7%     -19.5%     173827 ±  5%  sched_debug.cpu#46.sched_goidle
    442267 ±  6%     -21.4%     347467 ±  6%  sched_debug.cpu#59.sched_count
    432617 ±  7%     -19.5%     348457 ±  5%  sched_debug.cpu#46.nr_switches
    569496 ± 11%     +32.0%     751590 ±  5%  sched_debug.cpu#21.avg_idle
    189763 ±  5%     -22.2%     147705 ±  8%  sched_debug.cpu#12.ttwu_count
    223064 ±  4%     -19.3%     179906 ±  5%  sched_debug.cfs_rq[53]:/.min_vruntime
    213869 ±  5%     -21.0%     168888 ±  5%  sched_debug.cpu#59.sched_goidle
    428592 ±  5%     -21.0%     338537 ±  5%  sched_debug.cpu#59.nr_switches
    441291 ±  6%     -19.8%     353975 ±  5%  sched_debug.cpu#45.sched_count
    213493 ±  5%     -19.5%     171778 ±  5%  sched_debug.cpu#45.sched_goidle
    427837 ±  5%     -19.5%     344360 ±  5%  sched_debug.cpu#45.nr_switches
    191795 ±  5%     -22.6%     148369 ±  8%  sched_debug.cpu#11.ttwu_count
    194309 ±  6%     -19.3%     156815 ±  8%  sched_debug.cfs_rq[17]:/.min_vruntime
    221301 ±  5%     -20.9%     175025 ±  7%  sched_debug.cfs_rq[56]:/.min_vruntime
    538571 ±  8%     +24.4%     670227 ±  8%  sched_debug.cpu#3.avg_idle
    223672 ±  5%     -18.9%     181388 ±  7%  sched_debug.cfs_rq[47]:/.min_vruntime
    425387 ±  7%     -18.3%     347554 ±  7%  sched_debug.cpu#54.sched_count
    199287 ±  6%     -21.7%     156117 ± 12%  sched_debug.cfs_rq[15]:/.min_vruntime
      1.00 ±  5%     -15.8%       0.84 ±  6%  perf-profile.cpu-cycles.kmem_cache_alloc_trace.perf_event_mmap.mmap_region.do_mmap_pgoff.vm_mmap_pgoff
    385907 ±  8%     -23.7%     294552 ± 10%  sched_debug.cpu#6.sched_count
    493228 ±  5%     +27.4%     628579 ±  8%  sched_debug.cpu#54.avg_idle
    185090 ±  8%     -23.0%     142559 ± 10%  sched_debug.cpu#6.sched_goidle
    542727 ±  8%     +27.5%     691759 ±  4%  sched_debug.cpu#42.avg_idle
    209830 ±  6%     -18.0%     172096 ±  6%  sched_debug.cpu#55.sched_goidle
    370989 ±  8%     -23.0%     285813 ± 10%  sched_debug.cpu#6.nr_switches
    420473 ±  6%     -18.0%     344973 ±  6%  sched_debug.cpu#55.nr_switches
    201389 ±  4%     -20.7%     159785 ±  7%  sched_debug.cpu#0.ttwu_count
    365245 ±  7%     -20.1%     291843 ±  9%  sched_debug.cpu#5.sched_count
    176316 ±  7%     -19.7%     141647 ±  9%  sched_debug.cpu#5.sched_goidle
    353385 ±  7%     -19.6%     284000 ±  9%  sched_debug.cpu#5.nr_switches
    430699 ±  7%     -20.6%     341980 ±  7%  sched_debug.cpu#53.sched_count
    434688 ±  7%     -17.9%     356994 ±  7%  sched_debug.cpu#58.sched_count
       910 ± 11%     -15.6%        767 ± 12%  sched_debug.cpu#34.ttwu_local
    194153 ±  7%     -16.9%     161410 ±  5%  sched_debug.cfs_rq[19]:/.min_vruntime
    435164 ± 10%     -20.0%     348238 ±  7%  sched_debug.cpu#56.sched_count
     25686 ±  0%     -18.8%      20849 ±  1%  softirqs.HRTIMER
    205841 ±  7%     -18.6%     167608 ±  6%  sched_debug.cpu#54.sched_goidle
    412493 ±  7%     -18.5%     335995 ±  6%  sched_debug.cpu#54.nr_switches
    209629 ±  7%     -17.5%     172950 ±  7%  sched_debug.cpu#58.sched_goidle
    420079 ±  7%     -17.5%     346715 ±  7%  sched_debug.cpu#58.nr_switches
    190909 ±  5%     -19.3%     154071 ±  8%  sched_debug.cfs_rq[26]:/.min_vruntime
    535739 ± 10%     +25.8%     674192 ±  3%  sched_debug.cpu#41.avg_idle
    220505 ±  5%     -17.2%     182496 ± 10%  sched_debug.cfs_rq[57]:/.min_vruntime
    207365 ±  6%     -19.9%     166054 ±  7%  sched_debug.cpu#53.sched_goidle
    415569 ±  6%     -19.9%     332885 ±  7%  sched_debug.cpu#53.nr_switches
    433052 ±  7%     -19.5%     348641 ±  8%  sched_debug.cpu#57.sched_count
    534493 ±  4%     +25.6%     671066 ±  4%  sched_debug.cpu#2.avg_idle
      1.02 ±  2%     -20.2%       0.81 ±  8%  perf-profile.cpu-cycles.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__run_hrtimer
      5217 ± 12%     -17.6%       4297 ±  9%  sched_debug.cfs_rq[26]:/.avg->runnable_avg_sum
    209594 ±  6%     -19.1%     169509 ±  8%  sched_debug.cpu#57.sched_goidle
    420012 ±  6%     -19.1%     339802 ±  8%  sched_debug.cpu#57.nr_switches
    503208 ± 10%     +25.5%     631683 ±  7%  sched_debug.cpu#55.avg_idle
       113 ± 12%     -17.9%         92 ±  9%  sched_debug.cfs_rq[26]:/.tg_runnable_contrib
    549109 ±  5%     +22.6%     673144 ±  6%  sched_debug.cpu#14.avg_idle
    210495 ±  9%     -19.7%     169109 ±  7%  sched_debug.cpu#56.sched_goidle
    421839 ±  9%     -19.6%     338979 ±  7%  sched_debug.cpu#56.nr_switches
    221205 ±  4%     -17.6%     182374 ±  7%  sched_debug.cfs_rq[50]:/.min_vruntime
    502758 ±  6%     +23.1%     618755 ±  7%  sched_debug.cpu#46.avg_idle
    222043 ±  4%     -18.6%     180727 ± 10%  sched_debug.cfs_rq[51]:/.min_vruntime
    221617 ±  4%     -18.3%     181127 ±  8%  sched_debug.cfs_rq[55]:/.min_vruntime
    557533 ± 11%     +22.2%     681218 ±  7%  sched_debug.cpu#12.avg_idle
    187238 ±  6%     -17.7%     154099 ± 10%  sched_debug.cfs_rq[29]:/.min_vruntime
    551333 ± 10%     +22.2%     673592 ±  7%  sched_debug.cpu#34.avg_idle
    224579 ±  4%     -16.6%     187288 ±  9%  sched_debug.cfs_rq[54]:/.min_vruntime
    184873 ±  6%     -15.9%     155439 ±  8%  sched_debug.cfs_rq[28]:/.min_vruntime
    206172 ±  6%     -18.2%     168730 ±  7%  sched_debug.cpu#49.sched_goidle
    413179 ±  6%     -18.1%     338238 ±  7%  sched_debug.cpu#49.nr_switches
    225157 ±  5%     -16.4%     188227 ±  9%  sched_debug.cfs_rq[46]:/.min_vruntime
    175150 ±  5%     -16.9%     145619 ± 11%  sched_debug.cpu#3.sched_goidle
    351054 ±  5%     -16.8%     291944 ± 11%  sched_debug.cpu#3.nr_switches
    564018 ±  3%     +21.0%     682616 ±  6%  sched_debug.cpu#4.avg_idle
      5529 ±  8%     -18.1%       4527 ± 11%  sched_debug.cfs_rq[39]:/.avg->runnable_avg_sum
    600812 ±  5%     -15.3%     508926 ±  9%  numa-vmstat.node2.numa_local
    187471 ±  4%     -18.5%     152874 ± 10%  sched_debug.cfs_rq[22]:/.min_vruntime
     19730 ±  6%     -13.7%      17025 ±  9%  sched_debug.cfs_rq[26]:/.exec_clock
    425149 ±  6%     -18.2%     347836 ±  7%  sched_debug.cpu#49.sched_count
     22908 ±  5%     -12.9%      19945 ±  5%  sched_debug.cfs_rq[58]:/.exec_clock
    191793 ±  4%     -16.6%     160031 ± 10%  sched_debug.cfs_rq[24]:/.min_vruntime
     14.49 ±  0%     +16.4%      16.87 ±  2%  perf-profile.cpu-cycles.start_secondary
    514287 ± 10%     +19.7%     615733 ±  6%  sched_debug.cpu#58.avg_idle
      1622 ±  0%     -15.6%       1369 ±  1%  time.system_time
     14.45 ±  0%     +16.2%      16.80 ±  2%  perf-profile.cpu-cycles.cpu_startup_entry.start_secondary
      1117 ±  6%     -12.1%        982 ±  3%  proc-vmstat.pgmigrate_success
      1117 ±  6%     -12.1%        982 ±  3%  proc-vmstat.numa_pages_migrated
     23520 ±  4%     -14.0%      20233 ±  6%  sched_debug.cfs_rq[48]:/.exec_clock
    372296 ±  1%     -18.0%     305136 ±  9%  sched_debug.cpu#2.sched_count
    218377 ±  6%     -16.5%     182283 ±  6%  sched_debug.cfs_rq[58]:/.min_vruntime
    548860 ±  8%     +25.4%     688468 ±  6%  sched_debug.cpu#8.avg_idle
    224066 ±  5%     -17.7%     184445 ±  8%  sched_debug.cfs_rq[45]:/.min_vruntime
     23172 ±  4%     -12.9%      20184 ±  5%  sched_debug.cfs_rq[52]:/.exec_clock
    947362 ±  3%     -14.4%     810580 ±  7%  numa-numastat.node2.local_node
     22992 ±  5%     -12.9%      20026 ±  7%  sched_debug.cfs_rq[59]:/.exec_clock
     23572 ±  4%     -12.3%      20668 ±  5%  sched_debug.cfs_rq[46]:/.exec_clock
      6293 ±  8%     -16.0%       5288 ±  8%  sched_debug.cfs_rq[47]:/.avg->runnable_avg_sum
     23545 ±  4%     -13.3%      20402 ±  6%  sched_debug.cfs_rq[47]:/.exec_clock
         7 ±  0%     -14.3%          6 ±  0%  vmstat.procs.r
       136 ±  8%     -16.3%        114 ±  8%  sched_debug.cfs_rq[47]:/.tg_runnable_contrib
    952018 ±  3%     -14.1%     817562 ±  7%  numa-numastat.node2.numa_hit
    684874 ±  4%     -13.1%     595283 ±  7%  numa-vmstat.node2.numa_hit
     22864 ±  5%     -12.7%      19967 ±  5%  sched_debug.cfs_rq[57]:/.exec_clock
    190734 ±  5%     -16.3%     159695 ±  8%  sched_debug.cfs_rq[23]:/.min_vruntime
    237300 ±  6%     -14.9%     202014 ±  7%  numa-vmstat.node3.nr_page_table_pages
    949123 ±  6%     -14.9%     808058 ±  7%  numa-meminfo.node3.PageTables
     11.45 ±  4%     +12.2%      12.84 ±  7%  perf-profile.cpu-cycles.task_numa_work.task_work_run.do_notify_resume.retint_signal
    561716 ±  7%     +22.7%     689210 ±  5%  sched_debug.cpu#10.avg_idle
     23421 ±  4%     -12.5%      20484 ±  5%  sched_debug.cfs_rq[45]:/.exec_clock
     23090 ±  4%     -13.4%      19999 ±  6%  sched_debug.cfs_rq[53]:/.exec_clock
   2257945 ±  6%     -14.5%    1929848 ±  7%  numa-meminfo.node3.SUnreclaim
    564591 ±  6%     -14.5%     482457 ±  7%  numa-vmstat.node3.nr_slab_unreclaimable
      7903 ±  0%     -13.6%       6830 ±  1%  sched_debug.cfs_rq[11]:/.tg->runnable_avg
    522411 ±  6%     +15.9%     605704 ±  4%  sched_debug.cpu#59.avg_idle
      7899 ±  0%     -13.6%       6827 ±  1%  sched_debug.cfs_rq[10]:/.tg->runnable_avg
      7884 ±  0%     -13.6%       6811 ±  1%  sched_debug.cfs_rq[2]:/.tg->runnable_avg
      7913 ±  0%     -13.6%       6839 ±  1%  sched_debug.cfs_rq[14]:/.tg->runnable_avg
   2272179 ±  6%     -14.4%    1944358 ±  7%  numa-meminfo.node3.Slab
      7896 ±  0%     -13.6%       6826 ±  1%  sched_debug.cfs_rq[9]:/.tg->runnable_avg
      7894 ±  0%     -13.6%       6822 ±  1%  sched_debug.cfs_rq[8]:/.tg->runnable_avg
      7877 ±  0%     -13.6%       6802 ±  1%  sched_debug.cfs_rq[0]:/.tg->runnable_avg
      7890 ±  0%     -13.6%       6817 ±  1%  sched_debug.cfs_rq[4]:/.tg->runnable_avg
      7891 ±  0%     -13.6%       6816 ±  1%  sched_debug.cfs_rq[5]:/.tg->runnable_avg
      7894 ±  0%     -13.6%       6823 ±  1%  sched_debug.cfs_rq[7]:/.tg->runnable_avg
    512300 ±  6%     +18.2%     605480 ±  9%  sched_debug.cpu#50.avg_idle
      7908 ±  0%     -13.6%       6836 ±  1%  sched_debug.cfs_rq[13]:/.tg->runnable_avg
      7888 ±  0%     -13.6%       6814 ±  1%  sched_debug.cfs_rq[3]:/.tg->runnable_avg
      7916 ±  0%     -13.6%       6843 ±  1%  sched_debug.cfs_rq[15]:/.tg->runnable_avg
      7892 ±  0%     -13.6%       6818 ±  1%  sched_debug.cfs_rq[6]:/.tg->runnable_avg
    178921 ±  1%     -17.9%     146921 ±  9%  sched_debug.cpu#2.sched_goidle
      7918 ±  0%     -13.5%       6848 ±  1%  sched_debug.cfs_rq[16]:/.tg->runnable_avg
      7883 ±  0%     -13.6%       6809 ±  1%  sched_debug.cfs_rq[1]:/.tg->runnable_avg
      7903 ±  0%     -13.5%       6832 ±  1%  sched_debug.cfs_rq[12]:/.tg->runnable_avg
      7930 ±  0%     -13.5%       6861 ±  1%  sched_debug.cfs_rq[20]:/.tg->runnable_avg
      7925 ±  0%     -13.5%       6859 ±  1%  sched_debug.cfs_rq[19]:/.tg->runnable_avg
      7921 ±  0%     -13.5%       6852 ±  1%  sched_debug.cfs_rq[17]:/.tg->runnable_avg
      7932 ±  0%     -13.4%       6866 ±  1%  sched_debug.cfs_rq[21]:/.tg->runnable_avg
    358611 ±  1%     -17.9%     294548 ±  9%  sched_debug.cpu#2.nr_switches
      7922 ±  0%     -13.4%       6857 ±  1%  sched_debug.cfs_rq[18]:/.tg->runnable_avg
      7985 ±  0%     -13.4%       6918 ±  1%  sched_debug.cfs_rq[36]:/.tg->runnable_avg
    555502 ±  4%     +16.3%     646081 ±  5%  sched_debug.cpu#5.avg_idle
      7944 ±  0%     -13.5%       6876 ±  1%  sched_debug.cfs_rq[24]:/.tg->runnable_avg
      7994 ±  0%     -13.4%       6926 ±  1%  sched_debug.cfs_rq[39]:/.tg->runnable_avg
      7959 ±  0%     -13.4%       6892 ±  1%  sched_debug.cfs_rq[28]:/.tg->runnable_avg
      7997 ±  0%     -13.3%       6930 ±  1%  sched_debug.cfs_rq[40]:/.tg->runnable_avg
      7962 ±  0%     -13.4%       6895 ±  1%  sched_debug.cfs_rq[29]:/.tg->runnable_avg
      7935 ±  0%     -13.4%       6869 ±  1%  sched_debug.cfs_rq[22]:/.tg->runnable_avg
      7982 ±  0%     -13.4%       6915 ±  1%  sched_debug.cfs_rq[35]:/.tg->runnable_avg
      8000 ±  0%     -13.3%       6932 ±  1%  sched_debug.cfs_rq[41]:/.tg->runnable_avg
      7951 ±  0%     -13.4%       6884 ±  1%  sched_debug.cfs_rq[26]:/.tg->runnable_avg
      7954 ±  0%     -13.4%       6889 ±  1%  sched_debug.cfs_rq[27]:/.tg->runnable_avg
      7976 ±  0%     -13.4%       6911 ±  1%  sched_debug.cfs_rq[34]:/.tg->runnable_avg
      7937 ±  0%     -13.4%       6872 ±  1%  sched_debug.cfs_rq[23]:/.tg->runnable_avg
      8003 ±  0%     -13.3%       6937 ±  1%  sched_debug.cfs_rq[43]:/.tg->runnable_avg
       765 ±  0%     -13.1%        665 ±  1%  time.percent_of_cpu_this_job_got
      7964 ±  0%     -13.4%       6896 ±  1%  sched_debug.cfs_rq[30]:/.tg->runnable_avg
      7987 ±  0%     -13.4%       6919 ±  1%  sched_debug.cfs_rq[37]:/.tg->runnable_avg
      8027 ±  0%     -13.3%       6961 ±  1%  sched_debug.cfs_rq[50]:/.tg->runnable_avg
      7988 ±  0%     -13.4%       6921 ±  1%  sched_debug.cfs_rq[38]:/.tg->runnable_avg
      7946 ±  0%     -13.4%       6883 ±  1%  sched_debug.cfs_rq[25]:/.tg->runnable_avg
      8025 ±  0%     -13.3%       6955 ±  1%  sched_debug.cfs_rq[48]:/.tg->runnable_avg
      8012 ±  0%     -13.3%       6944 ±  1%  sched_debug.cfs_rq[45]:/.tg->runnable_avg
      7974 ±  0%     -13.3%       6909 ±  1%  sched_debug.cfs_rq[33]:/.tg->runnable_avg
      1.13 ±  1%     -14.8%       0.96 ±  7%  perf-profile.cpu-cycles.update_process_times.tick_sched_handle.tick_sched_timer.__run_hrtimer.hrtimer_interrupt
      8000 ±  0%     -13.3%       6933 ±  1%  sched_debug.cfs_rq[42]:/.tg->runnable_avg
      8035 ±  0%     -13.3%       6969 ±  1%  sched_debug.cfs_rq[51]:/.tg->runnable_avg
      8024 ±  0%     -13.3%       6954 ±  1%  sched_debug.cfs_rq[47]:/.tg->runnable_avg
      8014 ±  0%     -13.3%       6950 ±  1%  sched_debug.cfs_rq[46]:/.tg->runnable_avg
      8026 ±  0%     -13.3%       6959 ±  1%  sched_debug.cfs_rq[49]:/.tg->runnable_avg
      7968 ±  0%     -13.4%       6902 ±  1%  sched_debug.cfs_rq[31]:/.tg->runnable_avg
     37.12 ±  0%     -12.9%      32.34 ±  2%  perf-profile.cpu-cycles.vma_link.mmap_region.do_mmap_pgoff.vm_mmap_pgoff.sys_mmap_pgoff
      8007 ±  0%     -13.4%       6938 ±  1%  sched_debug.cfs_rq[44]:/.tg->runnable_avg
      8037 ±  0%     -13.2%       6973 ±  1%  sched_debug.cfs_rq[52]:/.tg->runnable_avg
      7968 ±  0%     -13.3%       6906 ±  1%  sched_debug.cfs_rq[32]:/.tg->runnable_avg
      1.13 ±  1%     -14.1%       0.97 ±  7%  perf-profile.cpu-cycles.tick_sched_handle.isra.18.tick_sched_timer.__run_hrtimer.hrtimer_interrupt.local_apic_timer_interrupt
      8068 ±  0%     -13.1%       7007 ±  1%  sched_debug.cfs_rq[63]:/.tg->runnable_avg
      8040 ±  0%     -13.2%       6977 ±  1%  sched_debug.cfs_rq[53]:/.tg->runnable_avg
      8053 ±  0%     -13.2%       6990 ±  1%  sched_debug.cfs_rq[57]:/.tg->runnable_avg
      8064 ±  0%     -13.1%       7004 ±  1%  sched_debug.cfs_rq[61]:/.tg->runnable_avg
      8049 ±  0%     -13.2%       6985 ±  1%  sched_debug.cfs_rq[56]:/.tg->runnable_avg
      8070 ±  0%     -13.1%       7009 ±  1%  sched_debug.cfs_rq[64]:/.tg->runnable_avg
   3595633 ±  5%     -12.9%    3133416 ±  6%  numa-meminfo.node3.MemUsed
      8055 ±  0%     -13.2%       6993 ±  1%  sched_debug.cfs_rq[58]:/.tg->runnable_avg
      8071 ±  0%     -13.1%       7014 ±  1%  sched_debug.cfs_rq[65]:/.tg->runnable_avg
      8046 ±  0%     -13.2%       6983 ±  1%  sched_debug.cfs_rq[55]:/.tg->runnable_avg
      8045 ±  0%     -13.3%       6978 ±  1%  sched_debug.cfs_rq[54]:/.tg->runnable_avg
      8086 ±  0%     -13.1%       7027 ±  1%  sched_debug.cfs_rq[71]:/.tg->runnable_avg
      8137 ±  0%     -13.0%       7080 ±  1%  sched_debug.cfs_rq[91]:/.tg->runnable_avg
      8081 ±  0%     -13.1%       7022 ±  1%  sched_debug.cfs_rq[68]:/.tg->runnable_avg
      8076 ±  0%     -13.1%       7017 ±  1%  sched_debug.cfs_rq[66]:/.tg->runnable_avg
      8062 ±  0%     -13.1%       7002 ±  1%  sched_debug.cfs_rq[60]:/.tg->runnable_avg
      8139 ±  0%     -12.9%       7085 ±  1%  sched_debug.cfs_rq[92]:/.tg->runnable_avg
      8088 ±  0%     -13.1%       7031 ±  1%  sched_debug.cfs_rq[72]:/.tg->runnable_avg
      8064 ±  0%     -13.1%       7006 ±  1%  sched_debug.cfs_rq[62]:/.tg->runnable_avg
      8143 ±  0%     -12.9%       7090 ±  1%  sched_debug.cfs_rq[94]:/.tg->runnable_avg
  41932371 ±  0%     -13.0%   36489731 ±  1%  slabinfo.vm_area_struct.active_objs
      8078 ±  0%     -13.1%       7019 ±  1%  sched_debug.cfs_rq[67]:/.tg->runnable_avg
      8083 ±  0%     -13.1%       7025 ±  1%  sched_debug.cfs_rq[69]:/.tg->runnable_avg
      8058 ±  0%     -13.2%       6997 ±  1%  sched_debug.cfs_rq[59]:/.tg->runnable_avg
      8142 ±  0%     -12.9%       7089 ±  1%  sched_debug.cfs_rq[93]:/.tg->runnable_avg
      8084 ±  0%     -13.1%       7028 ±  1%  sched_debug.cfs_rq[70]:/.tg->runnable_avg
      8134 ±  0%     -13.0%       7078 ±  1%  sched_debug.cfs_rq[90]:/.tg->runnable_avg
      8123 ±  0%     -13.1%       7062 ±  1%  sched_debug.cfs_rq[84]:/.tg->runnable_avg
   3274295 ±  0%     -13.0%    2849232 ±  1%  meminfo.PageTables
    818565 ±  0%     -13.0%     712300 ±  1%  proc-vmstat.nr_page_table_pages
      8094 ±  0%     -13.0%       7038 ±  1%  sched_debug.cfs_rq[74]:/.tg->runnable_avg
      8133 ±  0%     -13.0%       7077 ±  1%  sched_debug.cfs_rq[89]:/.tg->runnable_avg
      8103 ±  0%     -13.0%       7046 ±  1%  sched_debug.cfs_rq[77]:/.tg->runnable_avg
      8144 ±  0%     -12.9%       7094 ±  1%  sched_debug.cfs_rq[95]:/.tg->runnable_avg
      8146 ±  0%     -12.9%       7096 ±  1%  sched_debug.cfs_rq[96]:/.tg->runnable_avg
      8128 ±  0%     -13.0%       7070 ±  1%  sched_debug.cfs_rq[86]:/.tg->runnable_avg
      8091 ±  0%     -13.0%       7035 ±  1%  sched_debug.cfs_rq[73]:/.tg->runnable_avg
    536950 ± 10%     +23.4%     662508 ±  6%  sched_debug.cpu#30.avg_idle
      8096 ±  0%     -13.1%       7039 ±  1%  sched_debug.cfs_rq[75]:/.tg->runnable_avg
      8127 ±  0%     -13.0%       7067 ±  1%  sched_debug.cfs_rq[85]:/.tg->runnable_avg
      8149 ±  0%     -12.9%       7097 ±  1%  sched_debug.cfs_rq[97]:/.tg->runnable_avg
      8151 ±  0%     -12.9%       7100 ±  1%  sched_debug.cfs_rq[99]:/.tg->runnable_avg
      8153 ±  0%     -12.9%       7101 ±  1%  sched_debug.cfs_rq[100]:/.tg->runnable_avg
      8129 ±  0%     -13.0%       7074 ±  1%  sched_debug.cfs_rq[87]:/.tg->runnable_avg
      8118 ±  0%     -13.0%       7060 ±  1%  sched_debug.cfs_rq[83]:/.tg->runnable_avg
      8107 ±  0%     -13.1%       7047 ±  1%  sched_debug.cfs_rq[78]:/.tg->runnable_avg
      8111 ±  0%     -13.0%       7054 ±  1%  sched_debug.cfs_rq[80]:/.tg->runnable_avg
      8098 ±  0%     -13.0%       7044 ±  1%  sched_debug.cfs_rq[76]:/.tg->runnable_avg
  42188778 ±  0%     -12.9%   36733179 ±  1%  slabinfo.vm_area_struct.num_objs
    958835 ±  0%     -12.9%     834844 ±  1%  slabinfo.vm_area_struct.num_slabs
    958835 ±  0%     -12.9%     834844 ±  1%  slabinfo.vm_area_struct.active_slabs
      8154 ±  0%     -12.9%       7103 ±  1%  sched_debug.cfs_rq[101]:/.tg->runnable_avg
      8116 ±  0%     -13.0%       7058 ±  1%  sched_debug.cfs_rq[82]:/.tg->runnable_avg
      8130 ±  0%     -12.9%       7077 ±  1%  sched_debug.cfs_rq[88]:/.tg->runnable_avg
      8171 ±  0%     -12.9%       7120 ±  1%  sched_debug.cfs_rq[107]:/.tg->runnable_avg
      8113 ±  0%     -13.0%       7058 ±  1%  sched_debug.cfs_rq[81]:/.tg->runnable_avg
      8109 ±  0%     -13.1%       7051 ±  1%  sched_debug.cfs_rq[79]:/.tg->runnable_avg
      8155 ±  0%     -12.9%       7106 ±  1%  sched_debug.cfs_rq[102]:/.tg->runnable_avg
      8157 ±  0%     -12.8%       7111 ±  1%  sched_debug.cfs_rq[103]:/.tg->runnable_avg
      8165 ±  0%     -12.9%       7115 ±  1%  sched_debug.cfs_rq[105]:/.tg->runnable_avg
      8159 ±  0%     -12.8%       7113 ±  1%  sched_debug.cfs_rq[104]:/.tg->runnable_avg
      8148 ±  0%     -12.9%       7099 ±  1%  sched_debug.cfs_rq[98]:/.tg->runnable_avg
      8169 ±  0%     -12.9%       7118 ±  1%  sched_debug.cfs_rq[106]:/.tg->runnable_avg
      1.78 ±  2%     -11.3%       1.58 ±  4%  perf-profile.cpu-cycles.tick_sched_timer.__run_hrtimer.hrtimer_interrupt.local_apic_timer_interrupt.smp_apic_timer_interrupt
   7802174 ±  0%     -12.8%    6805780 ±  1%  meminfo.SUnreclaim
   1950525 ±  0%     -12.8%    1701410 ±  1%  proc-vmstat.nr_slab_unreclaimable
      8198 ±  0%     -12.7%       7154 ±  1%  sched_debug.cfs_rq[119]:/.tg->runnable_avg
      8175 ±  0%     -12.8%       7125 ±  1%  sched_debug.cfs_rq[109]:/.tg->runnable_avg
      8180 ±  0%     -12.8%       7136 ±  1%  sched_debug.cfs_rq[112]:/.tg->runnable_avg
      8188 ±  0%     -12.8%       7143 ±  1%  sched_debug.cfs_rq[115]:/.tg->runnable_avg
      8194 ±  0%     -12.7%       7151 ±  1%  sched_debug.cfs_rq[117]:/.tg->runnable_avg
      8176 ±  0%     -12.8%       7129 ±  1%  sched_debug.cfs_rq[110]:/.tg->runnable_avg
      8189 ±  0%     -12.8%       7145 ±  1%  sched_debug.cfs_rq[116]:/.tg->runnable_avg
    189413 ±  4%     -13.7%     163494 ±  8%  sched_debug.cfs_rq[25]:/.min_vruntime
      8184 ±  0%     -12.7%       7141 ±  1%  sched_debug.cfs_rq[114]:/.tg->runnable_avg
      8182 ±  0%     -12.8%       7137 ±  1%  sched_debug.cfs_rq[113]:/.tg->runnable_avg
      8172 ±  0%     -12.8%       7122 ±  1%  sched_debug.cfs_rq[108]:/.tg->runnable_avg
      8193 ±  0%     -12.7%       7152 ±  1%  sched_debug.cfs_rq[118]:/.tg->runnable_avg
      8178 ±  0%     -12.8%       7133 ±  1%  sched_debug.cfs_rq[111]:/.tg->runnable_avg
   7859652 ±  0%     -12.7%    6863230 ±  1%  meminfo.Slab
      0.95 ±  6%     +15.6%       1.10 ±  3%  perf-profile.cpu-cycles.__fget.fget.sys_mmap_pgoff.sys_mmap.system_call_fastpath
      1.10 ±  2%     -10.5%       0.98 ±  4%  perf-profile.cpu-cycles.ktime_get.clockevents_program_event.tick_program_event.__hrtimer_start_range_ns.hrtimer_start_range_ns
     23237 ±  4%     -13.3%      20143 ±  6%  sched_debug.cfs_rq[51]:/.exec_clock
      1.82 ±  2%     -11.0%       1.62 ±  4%  perf-profile.cpu-cycles.__run_hrtimer.hrtimer_interrupt.local_apic_timer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
      0.97 ±  7%     +14.0%       1.11 ±  3%  perf-profile.cpu-cycles.fget.sys_mmap_pgoff.sys_mmap.system_call_fastpath
     23242 ±  4%     -12.9%      20253 ±  6%  sched_debug.cfs_rq[49]:/.exec_clock
     22886 ±  5%     -13.7%      19749 ±  5%  sched_debug.cfs_rq[56]:/.exec_clock
      1036 ±  0%     -11.9%        914 ±  1%  time.user_time
   8527124 ±  0%     -11.6%    7534220 ±  1%  vmstat.memory.cache
   1695225 ±  0%     -10.7%    1513459 ±  1%  softirqs.TIMER
     23318 ±  6%     -13.1%      20269 ±  6%  sched_debug.cfs_rq[54]:/.exec_clock
    667649 ±  3%     -10.0%     600607 ±  4%  numa-vmstat.node3.numa_local
 7.244e+08 ±  0%     -11.1%  6.439e+08 ±  1%  time.minor_page_faults
 7.254e+08 ±  0%     -11.1%  6.449e+08 ±  1%  proc-vmstat.pgfault
      1.92 ±  2%     -10.9%       1.71 ±  4%  perf-profile.cpu-cycles.read_hpet.ktime_get.clockevents_program_event.tick_program_event.__hrtimer_start_range_ns
     22971 ±  5%     -12.9%      19998 ±  5%  sched_debug.cfs_rq[55]:/.exec_clock
       131 ± 10%     -11.7%        115 ±  6%  sched_debug.cfs_rq[52]:/.tg_runnable_contrib
     42.89 ±  0%     -10.4%      38.41 ±  2%  perf-profile.cpu-cycles.mmap_region.do_mmap_pgoff.vm_mmap_pgoff.sys_mmap_pgoff.sys_mmap
      6053 ± 10%     -11.6%       5349 ±  6%  sched_debug.cfs_rq[52]:/.avg->runnable_avg_sum
    753344 ±  2%      -9.0%     685539 ±  4%  numa-vmstat.node3.numa_hit
    501098 ±  0%     -11.4%     443942 ±  2%  softirqs.SCHED
      1.19 ±  2%      -9.0%       1.08 ±  3%  perf-profile.cpu-cycles.clockevents_program_event.tick_program_event.__hrtimer_start_range_ns.hrtimer_start_range_ns.tick_nohz_restart
     90940 ±  2%      +9.4%      99459 ±  2%  sched_debug.cpu#54.nr_load_updates
     88590 ±  2%      +9.8%      97229 ±  4%  sched_debug.cpu#2.nr_load_updates
     90669 ±  2%      +9.6%      99355 ±  2%  sched_debug.cpu#56.nr_load_updates
     91272 ±  2%      +9.4%      99833 ±  2%  sched_debug.cpu#49.nr_load_updates
      1.22 ±  1%     +10.5%       1.35 ±  2%  perf-profile.cpu-cycles.schedule.rwsem_down_write_failed.call_rwsem_down_write_failed.vma_link.mmap_region
     89287 ±  3%     +10.3%      98507 ±  4%  sched_debug.cpu#1.nr_load_updates
     45.38 ±  0%      -9.4%      41.10 ±  2%  perf-profile.cpu-cycles.do_mmap_pgoff.vm_mmap_pgoff.sys_mmap_pgoff.sys_mmap.system_call_fastpath
     22980 ±  5%     -12.4%      20128 ±  6%  sched_debug.cfs_rq[50]:/.exec_clock
      1.19 ±  2%      -8.5%       1.09 ±  4%  perf-profile.cpu-cycles.tick_program_event.__hrtimer_start_range_ns.hrtimer_start_range_ns.tick_nohz_restart.tick_nohz_idle_exit
   5570129 ±  0%      -9.4%    5048932 ±  1%  proc-vmstat.pgalloc_normal
   1100174 ±  3%      -6.9%    1024326 ±  3%  numa-numastat.node3.local_node
      2.06 ±  2%      -9.1%       1.87 ±  4%  perf-profile.cpu-cycles.print_context_stack.dump_trace.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity
     46.01 ±  0%      -9.2%      41.78 ±  2%  perf-profile.cpu-cycles.vm_mmap_pgoff.sys_mmap_pgoff.sys_mmap.system_call_fastpath
     91494 ±  2%     +10.3%     100902 ±  2%  sched_debug.cpu#46.nr_load_updates
     20296 ±  3%     -24.7%      15293 ±  3%  vmstat.system.in
    140148 ±  0%     -21.9%     109393 ±  1%  vmstat.system.cs
       191 ±  0%     -19.5%        153 ±  0%  turbostat.CorWatt
       257 ±  0%     -14.7%        219 ±  0%  turbostat.PkgWatt
       218 ±  0%     -13.5%        188 ±  1%  turbostat.Avg_MHz
      6.84 ±  0%     -13.6%       5.91 ±  1%  turbostat.%Busy
       578 ±  0%      -8.5%        529 ±  0%  pmeter.Average_Active_Power
     73.34 ±  0%      -3.0%      71.15 ±  0%  turbostat.RAMWatt

brickland3: Brickland Ivy Bridge-EX
Memory: 512G




                              vm-scalability.stddev

  16 ++---------------------------------------------------------------------+
     |                 O                                                    |
  14 ++                   O O                                               |
  12 ++    O                    O   O    O  O                               |
     | O       OO              O       O                                    |
  10 O+   O         O             O       O              O                  |
     |  O            O  O    O       O         O O   O O    O               |
   8 ++      O    O                                                         |
     |                                       O    O       O                 |
   6 ++                                             O                       |
   4 ++                                                                     |
     |                                .*      .*  *.       .*             *.|
   2 *+**.  .*.*   .*        *.**.   *  + *.**  + : *     *  *.*.  .*.**.*  *
     |    **    *.*  *.**.*.*     *.*    *       *   *.*.*       **         |
   0 ++---------------------------------------------------------------------+


	[*] bisect-good sample
	[O] bisect-bad  sample

To reproduce:

	apt-get install ruby
	git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
	cd lkp-tests
	bin/setup-local job.yaml # the job file attached in this email
	bin/run-local   job.yaml


Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Ying Huang



View attachment "job.yaml" of type "text/plain" (1710 bytes)

View attachment "reproduce" of type "text/plain" (9275 bytes)

_______________________________________________
LKP mailing list
LKP@...ux.intel.com

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ