lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Date:	Sat, 22 Mar 2014 19:56:36 +0800
From:	Fengguang Wu <fengguang.wu@...el.com>
To:	Al Viro <viro@...iv.linux.org.uk>
Cc:	LKML <linux-kernel@...r.kernel.org>, lkp@...org
Subject: [rcuwalk] e2a728c2785: -29.4% aim7.2000.jobs-per-min, +71%
 turbostat.Pkg_W

Hi Al,

We noticed the below changes on

git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs.git untested-mnt_hash
commit e2a728c2785d6aab45d1a6d2c61e986d385c30bf ("rcuwalk: recheck mount_lock after mountpoint crossing attempts")

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    395126 ~ 1%     -34.2%     259849 ~ 2%  grantley/micro/aim7/disk_src
    190311 ~ 1%     -37.9%     118138 ~ 2%  grantley/micro/aim7/shell_rtns_1
    383828 ~ 0%      -2.4%     374511 ~ 0%  grantley/micro/aim7/string_rtns
    157829 ~ 0%     -72.6%      43187 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
   1127096 ~ 1%     -29.4%     795687 ~ 1%  TOTAL aim7.2000.jobs-per-min

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      2980 ~ 0%     -46.7%       1587 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
      2980 ~ 0%     -46.7%       1587 ~ 2%  TOTAL netperf.Throughput_tps

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     12683 ~23%     -87.3%       1614 ~46%  lkp-wsx01/micro/aim7/shell_rtns_1
     12683 ~23%     -87.3%       1614 ~46%  TOTAL numa-vmstat.node3.nr_kernel_stack

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     22502 ~31%     -95.6%        999 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
     22502 ~31%     -95.6%        999 ~ 1%  TOTAL slabinfo.kmalloc-192.num_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      2167 ~22%     -83.1%        365 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
      2167 ~22%     -83.1%        365 ~ 0%  TOTAL slabinfo.signal_cache.active_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     13718 ~27%     -88.2%       1621 ~46%  lkp-wsx01/micro/aim7/shell_rtns_1
     13718 ~27%     -88.2%       1621 ~46%  TOTAL numa-vmstat.node2.nr_kernel_stack

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     14796 ~21%     -90.1%       1464 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
     14796 ~21%     -90.1%       1464 ~ 1%  TOTAL slabinfo.dentry.num_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     14796 ~21%     -90.1%       1464 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
     14796 ~21%     -90.1%       1464 ~ 1%  TOTAL slabinfo.dentry.active_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    621458 ~21%     -90.1%      61513 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
    621458 ~21%     -90.1%      61513 ~ 1%  TOTAL slabinfo.dentry.num_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
 2.641e+08 ~ 4%     -99.0%    2722154 ~26%  grantley/micro/aim7/disk_src
  51149646 ~10%     -94.5%    2826487 ~25%  grantley/micro/aim7/shell_rtns_1
 3.153e+08 ~ 5%     -98.2%    5548642 ~26%  TOTAL cpuidle.C1-HSW.time

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    329548 ~13%     -99.7%       1143 ~13%  grantley/micro/aim7/disk_src
    225362 ~15%     -98.8%       2708 ~33%  grantley/micro/aim7/shell_rtns_1
    554911 ~14%     -99.3%       3851 ~27%  TOTAL cpuidle.C1-HSW.usage

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    105147 ~21%     -87.0%      13701 ~44%  lkp-wsx01/micro/aim7/shell_rtns_1
    105147 ~21%     -87.0%      13701 ~44%  TOTAL numa-meminfo.node0.KernelStack

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    611075 ~21%     -89.9%      61509 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
    611075 ~21%     -89.9%      61509 ~ 1%  TOTAL slabinfo.dentry.active_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
       747 ~ 5%   +1722.9%      13617 ~ 9%  lkp-wsx01/micro/aim7/shell_rtns_1
       747 ~ 5%   +1722.9%      13617 ~ 9%  TOTAL interrupts.IWI

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     78043 ~ 3%     -80.3%      15409 ~ 8%  grantley/micro/aim7/disk_src
    183980 ~16%     -94.3%      10524 ~ 8%  grantley/micro/aim7/shell_rtns_1
    262024 ~12%     -90.1%      25934 ~ 8%  TOTAL cpuidle.C6-HSW.usage

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      2167 ~22%     -83.1%        365 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
      2167 ~22%     -83.1%        365 ~ 0%  TOTAL slabinfo.signal_cache.num_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     60879 ~ 6%     -99.5%        291 ~18%  grantley/micro/aim7/shell_rtns_1
     60879 ~ 6%     -99.5%        291 ~18%  TOTAL interrupts.TLB

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     13175 ~21%     -87.0%       1712 ~44%  lkp-wsx01/micro/aim7/shell_rtns_1
     13175 ~21%     -87.0%       1712 ~44%  TOTAL numa-vmstat.node0.nr_kernel_stack

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
 1.471e+08 ~ 2%     -99.3%    1006392 ~37%  grantley/micro/aim7/shell_rtns_1
 1.471e+08 ~ 2%     -99.3%    1006392 ~37%  TOTAL cpuidle.C1E-HSW.time

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     22502 ~31%     -95.6%        999 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
     22502 ~31%     -95.6%        999 ~ 1%  TOTAL slabinfo.kmalloc-192.active_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      6789 ~ 7%     -89.7%        699 ~27%  lkp-wsx01/micro/aim7/shell_rtns_1
      6789 ~ 7%     -89.7%        699 ~27%  TOTAL cpuidle.C1E-NHM.usage

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     29.35 ~ 2%     -92.4%       2.24 ~13%  grantley/micro/aim7/disk_src
     15.12 ~ 5%     -98.3%       0.26 ~10%  grantley/micro/aim7/shell_rtns_1
      0.50 ~10%     -90.5%       0.05 ~ 8%  lkp-wsx01/micro/aim7/shell_rtns_1
     44.97 ~ 3%     -94.3%       2.55 ~12%  TOTAL turbostat.%c1

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      0.00           +Inf%      11.52 ~ 1%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
      0.00           +Inf%      11.52 ~ 1%  TOTAL perf-profile.cpu-cycles._raw_spin_lock.__d_lookup.lookup_fast.do_last.path_openat

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
         4 ~35%    -100.0%          0 ~ 0%  grantley/micro/aim7/disk_src
        23 ~ 9%    -100.0%          0 ~ 0%  grantley/micro/aim7/shell_rtns_1
        27 ~13%    -100.0%          0 ~ 0%  TOTAL cpuidle.POLL.usage

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    102041 ~23%     -87.3%      12959 ~46%  lkp-wsx01/micro/aim7/shell_rtns_1
    102041 ~23%     -87.3%      12959 ~46%  TOTAL numa-meminfo.node3.KernelStack

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      0.00           +Inf%      11.26 ~ 3%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
      0.00           +Inf%      11.26 ~ 3%  TOTAL perf-profile.cpu-cycles._raw_spin_lock.lockref_put_or_lock.dput.__fput.____fput

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    110293 ~27%     -88.2%      13026 ~46%  lkp-wsx01/micro/aim7/shell_rtns_1
    110293 ~27%     -88.2%      13026 ~46%  TOTAL numa-meminfo.node2.KernelStack

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
        89 ~49%    -100.0%          0 ~ 0%  grantley/micro/aim7/disk_src
       663 ~18%    -100.0%          0 ~ 0%  grantley/micro/aim7/shell_rtns_1
       752 ~22%    -100.0%          0 ~ 0%  TOTAL cpuidle.POLL.time

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      0.00           +Inf%      11.07 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
      0.00           +Inf%      11.07 ~ 2%  TOTAL perf-profile.cpu-cycles._raw_spin_lock.lockref_get.path_get.do_dentry_open.finish_open

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
   1384473 ~29%     -95.3%      65064 ~40%  lkp-wsx01/micro/aim7/shell_rtns_1
   1384473 ~29%     -95.3%      65064 ~40%  TOTAL cpuidle.C1-NHM.time

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      4501 ~20%     -87.2%        576 ~36%  lkp-wsx01/micro/aim7/shell_rtns_1
      4501 ~20%     -87.2%        576 ~36%  TOTAL cpuidle.C1-NHM.usage

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
   2471092 ~11%     -97.5%      62093 ~17%  lkp-wsx01/micro/aim7/shell_rtns_1
   2471092 ~11%     -97.5%      62093 ~17%  TOTAL cpuidle.C1E-NHM.time

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      0.00           +Inf%      11.14 ~ 3%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
      0.00           +Inf%      11.14 ~ 3%  TOTAL perf-profile.cpu-cycles._raw_spin_lock.lockref_put_or_lock.dput.path_put.terminate_walk

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      0.23 ~26%     -73.3%       0.06 ~34%  lkp-wsx01/micro/aim7/shell_rtns_1
      0.23 ~26%     -73.3%       0.06 ~34%  TOTAL turbostat.%c3

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      1363 ~15%     -75.0%        340 ~25%  grantley/micro/aim7/disk_src
    481021 ~ 7%     -99.6%       1963 ~28%  grantley/micro/aim7/shell_rtns_1
    482385 ~ 7%     -99.5%       2304 ~27%  TOTAL cpuidle.C1E-HSW.usage

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      6977 ~11%     -75.9%       1681 ~ 6%  grantley/micro/aim7/disk_src
    592870 ~ 5%     -99.4%       3369 ~ 7%  grantley/micro/aim7/shell_rtns_1
    599848 ~ 5%     -99.2%       5050 ~ 7%  TOTAL cpuidle.C3-HSW.usage

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
        17 ~ 7%    +534.5%        110 ~ 4%  grantley/micro/aim7/disk_src
        44 ~ 2%    +409.5%        225 ~ 4%  grantley/micro/aim7/shell_rtns_1
       209 ~ 4%    +207.4%        642 ~ 7%  lkp-wsx01/micro/aim7/shell_rtns_1
       270 ~ 4%    +261.4%        978 ~ 6%  TOTAL vmstat.procs.r

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
 2.456e+08 ~12%     -97.3%    6594906 ~45%  grantley/micro/aim7/shell_rtns_1
 2.456e+08 ~12%     -97.3%    6594906 ~45%  TOTAL cpuidle.C3-HSW.time

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     49244 ~28%     -72.9%      13365 ~28%  lkp-wsx01/micro/aim7/shell_rtns_1
     49244 ~28%     -72.9%      13365 ~28%  TOTAL numa-vmstat.node2.nr_slab_unreclaimable

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    196740 ~28%     -72.8%      53475 ~28%  lkp-wsx01/micro/aim7/shell_rtns_1
    196740 ~28%     -72.8%      53475 ~28%  TOTAL numa-meminfo.node2.SUnreclaim

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     14776 ~45%     +84.6%      27283 ~26%  grantley/micro/aim7/shell_rtns_1
    108458 ~20%     -85.1%      16153 ~45%  lkp-wsx01/micro/aim7/shell_rtns_1
    123234 ~23%     -64.8%      43437 ~33%  TOTAL numa-meminfo.node1.KernelStack

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      1837 ~44%     +84.7%       3393 ~26%  grantley/micro/aim7/shell_rtns_1
     13576 ~21%     -85.2%       2005 ~45%  lkp-wsx01/micro/aim7/shell_rtns_1
     15413 ~24%     -65.0%       5399 ~33%  TOTAL numa-vmstat.node1.nr_kernel_stack

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    237898 ~26%     -71.8%      66988 ~22%  lkp-wsx01/micro/aim7/shell_rtns_1
    237898 ~26%     -71.8%      66988 ~22%  TOTAL numa-meminfo.node2.Slab

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    187410 ~20%     -71.6%      53204 ~27%  lkp-wsx01/micro/aim7/shell_rtns_1
    187410 ~20%     -71.6%      53204 ~27%  TOTAL numa-meminfo.node0.SUnreclaim

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    182221 ~22%     -73.1%      49066 ~26%  lkp-wsx01/micro/aim7/shell_rtns_1
    182221 ~22%     -73.1%      49066 ~26%  TOTAL numa-meminfo.node3.SUnreclaim

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     47071 ~21%     -71.8%      13297 ~27%  lkp-wsx01/micro/aim7/shell_rtns_1
     47071 ~21%     -71.8%      13297 ~27%  TOTAL numa-vmstat.node0.nr_slab_unreclaimable

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     45606 ~23%     -73.1%      12282 ~26%  lkp-wsx01/micro/aim7/shell_rtns_1
     45606 ~23%     -73.1%      12282 ~26%  TOTAL numa-vmstat.node3.nr_slab_unreclaimable

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     12.07 ~ 0%     -72.4%       3.33 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
     12.07 ~ 0%     -72.4%       3.33 ~ 0%  TOTAL turbostat.%pc3

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    221908 ~21%     -72.2%      61632 ~18%  lkp-wsx01/micro/aim7/shell_rtns_1
    221908 ~21%     -72.2%      61632 ~18%  TOTAL numa-meminfo.node3.Slab

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     48292 ~42%    +146.4%     119010 ~20%  grantley/micro/aim7/shell_rtns_1
     48292 ~42%    +146.4%     119010 ~20%  TOTAL numa-meminfo.node1.PageTables

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     12086 ~43%    +145.2%      29636 ~20%  grantley/micro/aim7/shell_rtns_1
     12086 ~43%    +145.2%      29636 ~20%  TOTAL numa-vmstat.node1.nr_page_table_pages

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     68877 ~ 7%    +326.1%     293515 ~ 2%  grantley/micro/aim7/shell_rtns_1
     55620 ~ 7%    +181.2%     156385 ~ 8%  lkp-wsx01/micro/aim7/shell_rtns_1
    124498 ~ 7%    +261.4%     449901 ~ 4%  TOTAL numa-meminfo.node1.AnonPages

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     17237 ~ 8%    +324.2%      73111 ~ 1%  grantley/micro/aim7/shell_rtns_1
     13979 ~ 6%    +178.0%      38857 ~ 8%  lkp-wsx01/micro/aim7/shell_rtns_1
     31217 ~ 7%    +258.7%     111968 ~ 4%  TOTAL numa-vmstat.node1.nr_anon_pages

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      2113 ~22%     -74.4%        541 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
      2113 ~22%     -74.4%        541 ~ 1%  TOTAL slabinfo.kmalloc-512.active_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      2113 ~22%     -74.4%        541 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
      2113 ~22%     -74.4%        541 ~ 1%  TOTAL slabinfo.kmalloc-512.num_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     67631 ~22%     -74.3%      17348 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
     67631 ~22%     -74.3%      17348 ~ 1%  TOTAL slabinfo.kmalloc-512.num_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
  11810487 ~ 0%     -45.3%    6462482 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
    104283 ~11%   +1972.4%    2161157 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
  11914771 ~ 0%     -27.6%    8623639 ~ 1%  TOTAL softirqs.RCU

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     37047 ~ 2%    +297.1%     147122 ~ 1%  grantley/micro/aim7/shell_rtns_1
     58696 ~ 2%    +168.3%     157481 ~ 3%  lkp-wsx01/micro/aim7/shell_rtns_1
     95744 ~ 2%    +218.1%     304603 ~ 2%  TOTAL proc-vmstat.nr_anon_pages

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    148067 ~ 2%    +296.6%     587309 ~ 1%  grantley/micro/aim7/shell_rtns_1
    235601 ~ 3%    +167.1%     629209 ~ 3%  lkp-wsx01/micro/aim7/shell_rtns_1
    383669 ~ 3%    +217.1%    1216518 ~ 2%  TOTAL meminfo.AnonPages

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     79144 ~ 5%    +271.8%     294233 ~ 2%  grantley/micro/aim7/shell_rtns_1
     53935 ~ 5%    +185.7%     154092 ~ 7%  lkp-wsx01/micro/aim7/shell_rtns_1
    133079 ~ 5%    +236.9%     448326 ~ 4%  TOTAL numa-meminfo.node0.AnonPages

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    226257 ~19%     -70.2%      67410 ~21%  lkp-wsx01/micro/aim7/shell_rtns_1
    226257 ~19%     -70.2%      67410 ~21%  TOTAL numa-meminfo.node0.Slab

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    261563 ~11%     -76.5%      61519 ~ 2%  grantley/micro/aim7/disk_src
    885837 ~ 7%     -64.4%     315615 ~ 1%  grantley/micro/aim7/shell_rtns_1
    820916 ~ 0%     -63.8%     297218 ~ 3%  lkp-wsx01/micro/aim7/shell_rtns_1
   1968316 ~ 5%     -65.7%     674354 ~ 2%  TOTAL interrupts.RES

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     19813 ~ 5%    +269.8%      73278 ~ 2%  grantley/micro/aim7/shell_rtns_1
     13492 ~ 5%    +183.7%      38281 ~ 8%  lkp-wsx01/micro/aim7/shell_rtns_1
     33305 ~ 5%    +235.0%     111559 ~ 4%  TOTAL numa-vmstat.node0.nr_anon_pages

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     59995 ~19%     -71.5%      17106 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
     59995 ~19%     -71.5%      17106 ~ 1%  TOTAL slabinfo.kmalloc-512.active_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      4976 ~ 1%     +31.5%       6543 ~ 1%  grantley/micro/aim7/shell_rtns_1
     54140 ~22%     -86.8%       7124 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
     59117 ~20%     -76.9%      13667 ~ 1%  TOTAL proc-vmstat.nr_kernel_stack

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     39796 ~ 1%     +31.4%      52278 ~ 1%  grantley/micro/aim7/shell_rtns_1
    421773 ~21%     -86.5%      56891 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
    461569 ~19%     -76.3%     109169 ~ 0%  TOTAL meminfo.KernelStack

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      5546 ~ 0%     +27.8%       7087 ~ 1%  grantley/micro/aim7/shell_rtns_1
     56799 ~20%     -86.3%       7771 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
     62346 ~19%     -76.2%      14858 ~ 1%  TOTAL slabinfo.task_struct.active_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
       421 ~ 0%     +28.6%        542 ~ 2%  grantley/micro/aim7/shell_rtns_1
      4445 ~23%     -86.6%        597 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
      4867 ~21%     -76.6%       1140 ~ 1%  TOTAL slabinfo.task_struct.active_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
       421 ~ 0%     +28.6%        542 ~ 2%  grantley/micro/aim7/shell_rtns_1
      4445 ~23%     -86.6%        597 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
      4867 ~21%     -76.6%       1140 ~ 1%  TOTAL slabinfo.task_struct.num_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      5913 ~ 0%     +28.6%       7602 ~ 2%  grantley/micro/aim7/shell_rtns_1
     62245 ~23%     -86.5%       8377 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
     68159 ~21%     -76.6%      15979 ~ 1%  TOTAL slabinfo.task_struct.num_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     39568 ~16%     -69.6%      12020 ~ 8%  lkp-wsx01/micro/aim7/shell_rtns_1
     39568 ~16%     -69.6%      12020 ~ 8%  TOTAL numa-meminfo.node1.SReclaimable

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      8738 ~ 4%     +23.6%      10799 ~ 8%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
     29194 ~ 7%     -93.8%       1816 ~ 9%  lkp-wsx01/micro/aim7/shell_rtns_1
     37932 ~ 6%     -66.7%      12615 ~ 9%  TOTAL cpuidle.C3-NHM.usage

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      9912 ~17%     -69.7%       3006 ~ 8%  lkp-wsx01/micro/aim7/shell_rtns_1
      9912 ~17%     -69.7%       3006 ~ 8%  TOTAL numa-vmstat.node1.nr_slab_reclaimable

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      7566 ~ 0%     +14.9%       8690 ~ 0%  grantley/micro/aim7/shell_rtns_1
     65043 ~22%     -83.1%      10981 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
     72609 ~20%     -72.9%      19671 ~ 0%  TOTAL slabinfo.signal_cache.num_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      7387 ~ 0%     +12.6%       8317 ~ 1%  grantley/micro/aim7/shell_rtns_1
     57956 ~20%     -81.5%      10709 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
     65343 ~18%     -70.9%      19027 ~ 0%  TOTAL slabinfo.signal_cache.active_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     29054 ~ 1%     +12.8%      32759 ~ 1%  grantley/micro/aim7/shell_rtns_1
    945145 ~31%     -95.6%      41976 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
    974200 ~30%     -92.3%      74735 ~ 1%  TOTAL slabinfo.kmalloc-192.num_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     28807 ~ 1%     +12.5%      32395 ~ 1%  grantley/micro/aim7/shell_rtns_1
    767784 ~25%     -94.6%      41733 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
    796591 ~24%     -90.7%      74128 ~ 1%  TOTAL slabinfo.kmalloc-192.active_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     81548 ~ 7%    +262.4%     295506 ~ 2%  grantley/micro/aim7/shell_rtns_1
     62798 ~ 5%    +158.3%     162214 ~ 7%  lkp-wsx01/micro/aim7/shell_rtns_1
    144346 ~ 6%    +217.1%     457721 ~ 4%  TOTAL numa-meminfo.node1.Active(anon)

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    167493 ~ 2%    +197.0%     497489 ~ 3%  grantley/micro/aim7/disk_src
    618837 ~ 0%    +107.6%    1284825 ~ 3%  grantley/micro/aim7/shell_rtns_1
   1315045 ~ 0%    +307.5%    5358867 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
   2101375 ~ 0%    +239.8%    7141181 ~ 1%  TOTAL interrupts.LOC

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     20438 ~ 7%    +260.2%      73615 ~ 2%  grantley/micro/aim7/shell_rtns_1
     15775 ~ 5%    +155.3%      40280 ~ 7%  lkp-wsx01/micro/aim7/shell_rtns_1
     36214 ~ 6%    +214.5%     113896 ~ 3%  TOTAL numa-vmstat.node1.nr_active_anon

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
         6 ~12%     -67.7%          2 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
         6 ~12%     -67.7%          2 ~ 0%  TOTAL vmstat.procs.b

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     39686 ~17%     -68.3%      12565 ~10%  lkp-wsx01/micro/aim7/shell_rtns_1
     39686 ~17%     -68.3%      12565 ~10%  TOTAL numa-meminfo.node3.SReclaimable

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     43467 ~ 2%    +240.7%     148081 ~ 1%  grantley/micro/aim7/shell_rtns_1
     65784 ~ 2%    +149.9%     164370 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
    109251 ~ 2%    +186.0%     312452 ~ 1%  TOTAL proc-vmstat.nr_active_anon

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    173786 ~ 2%    +240.2%     591203 ~ 1%  grantley/micro/aim7/shell_rtns_1
    264074 ~ 3%    +148.6%     656365 ~ 2%  lkp-wsx01/micro/aim7/shell_rtns_1
    437861 ~ 3%    +184.9%    1247568 ~ 1%  TOTAL meminfo.Active(anon)

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      9907 ~17%     -68.3%       3142 ~10%  lkp-wsx01/micro/aim7/shell_rtns_1
      9907 ~17%     -68.3%       3142 ~10%  TOTAL numa-vmstat.node3.nr_slab_reclaimable

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     92198 ~ 5%    +221.2%     296102 ~ 2%  grantley/micro/aim7/shell_rtns_1
     61041 ~ 5%    +162.3%     160107 ~ 6%  lkp-wsx01/micro/aim7/shell_rtns_1
    153239 ~ 5%    +197.7%     456209 ~ 4%  TOTAL numa-meminfo.node0.Active(anon)

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     23075 ~ 4%    +219.5%      73730 ~ 2%  grantley/micro/aim7/shell_rtns_1
     15290 ~ 4%    +160.4%      39823 ~ 7%  lkp-wsx01/micro/aim7/shell_rtns_1
     38366 ~ 4%    +196.0%     113553 ~ 4%  TOTAL numa-vmstat.node0.nr_active_anon

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     16972 ~19%     +46.5%      24858 ~17%  grantley/micro/aim7/shell_rtns_1
     48753 ~22%     -70.2%      14535 ~29%  lkp-wsx01/micro/aim7/shell_rtns_1
     65726 ~21%     -40.1%      39393 ~21%  TOTAL numa-vmstat.node1.nr_slab_unreclaimable

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     67859 ~19%     +46.7%      99577 ~17%  grantley/micro/aim7/shell_rtns_1
    194381 ~20%     -70.1%      58177 ~29%  lkp-wsx01/micro/aim7/shell_rtns_1
    262240 ~20%     -39.8%     157755 ~21%  TOTAL numa-meminfo.node1.SUnreclaim

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     40297 ~16%     -67.5%      13103 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
     40297 ~16%     -67.5%      13103 ~ 0%  TOTAL proc-vmstat.nr_slab_reclaimable

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     41157 ~18%     -67.2%      13512 ~ 3%  lkp-wsx01/micro/aim7/shell_rtns_1
     41157 ~18%     -67.2%      13512 ~ 3%  TOTAL numa-meminfo.node2.SReclaimable

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    158286 ~16%     -66.9%      52413 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
    158286 ~16%     -66.9%      52413 ~ 0%  TOTAL meminfo.SReclaimable

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     10262 ~18%     -67.1%       3379 ~ 3%  lkp-wsx01/micro/aim7/shell_rtns_1
     10262 ~18%     -67.1%       3379 ~ 3%  TOTAL numa-vmstat.node2.nr_slab_reclaimable

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     58257 ~ 9%    +153.6%     147736 ~ 4%  lkp-wsx01/micro/aim7/shell_rtns_1
     58257 ~ 9%    +153.6%     147736 ~ 4%  TOTAL numa-meminfo.node3.AnonPages

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     14539 ~10%    +152.1%      36647 ~ 5%  lkp-wsx01/micro/aim7/shell_rtns_1
     14539 ~10%    +152.1%      36647 ~ 5%  TOTAL numa-vmstat.node3.nr_anon_pages

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
       344 ~ 1%     +51.2%        520 ~ 1%  grantley/micro/aim7/shell_rtns_1
      1694 ~ 0%     -34.2%       1114 ~ 1%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
     25043 ~24%     -96.2%        947 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
     27082 ~23%     -90.5%       2582 ~ 1%  TOTAL slabinfo.kmalloc-256.num_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
       344 ~ 1%     +51.2%        520 ~ 1%  grantley/micro/aim7/shell_rtns_1
      1694 ~ 0%     -34.2%       1114 ~ 1%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
     25043 ~24%     -96.2%        947 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
     27082 ~23%     -90.5%       2582 ~ 1%  TOTAL slabinfo.kmalloc-256.active_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
  25230572 ~13%     -60.3%   10024021 ~28%  lkp-wsx01/micro/aim7/shell_rtns_1
  25230572 ~13%     -60.3%   10024021 ~28%  TOTAL cpuidle.C3-NHM.time

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      1947 ~20%     -65.8%        666 ~ 2%  lkp-wsx01/micro/aim7/shell_rtns_1
      1947 ~20%     -65.8%        666 ~ 2%  TOTAL slabinfo.task_delay_info.num_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      1947 ~20%     -65.8%        666 ~ 2%  lkp-wsx01/micro/aim7/shell_rtns_1
      1947 ~20%     -65.8%        666 ~ 2%  TOTAL slabinfo.task_delay_info.active_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     38847 ~16%     -63.4%      14205 ~11%  lkp-wsx01/micro/aim7/shell_rtns_1
     38847 ~16%     -63.4%      14205 ~11%  TOTAL numa-meminfo.node0.SReclaimable

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     91396 ~14%     +33.6%     122065 ~14%  grantley/micro/aim7/shell_rtns_1
    233950 ~19%     -70.0%      70199 ~23%  lkp-wsx01/micro/aim7/shell_rtns_1
    325346 ~18%     -40.9%     192264 ~17%  TOTAL numa-meminfo.node1.Slab

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      9737 ~16%     -63.5%       3552 ~11%  lkp-wsx01/micro/aim7/shell_rtns_1
      9737 ~16%     -63.5%       3552 ~11%  TOTAL numa-vmstat.node0.nr_slab_reclaimable

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    155695 ~ 7%    +112.3%     330467 ~ 2%  grantley/micro/aim7/disk_src
    376752 ~ 3%     +91.2%     720465 ~ 3%  grantley/micro/aim7/shell_rtns_1
    770510 ~ 0%    +263.9%    2803548 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
   1302957 ~ 2%    +195.8%    3854480 ~ 1%  TOTAL softirqs.TIMER

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      2222 ~20%     -63.8%        803 ~ 2%  lkp-wsx01/micro/aim7/shell_rtns_1
      2222 ~20%     -63.8%        803 ~ 2%  TOTAL slabinfo.kmalloc-128.num_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      2222 ~20%     -63.8%        803 ~ 2%  lkp-wsx01/micro/aim7/shell_rtns_1
      2222 ~20%     -63.8%        803 ~ 2%  TOTAL slabinfo.kmalloc-128.active_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     64952 ~ 8%    +136.5%     153601 ~ 3%  lkp-wsx01/micro/aim7/shell_rtns_1
     64952 ~ 8%    +136.5%     153601 ~ 3%  TOTAL numa-meminfo.node3.Active(anon)

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     16208 ~10%    +135.4%      38150 ~ 4%  lkp-wsx01/micro/aim7/shell_rtns_1
     16208 ~10%    +135.4%      38150 ~ 4%  TOTAL numa-vmstat.node3.nr_active_anon

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     63205 ~ 7%    +159.4%     163952 ~ 7%  lkp-wsx01/micro/aim7/shell_rtns_1
     63205 ~ 7%    +159.4%     163952 ~ 7%  TOTAL numa-meminfo.node2.AnonPages

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     15772 ~ 7%    +158.6%      40789 ~ 7%  lkp-wsx01/micro/aim7/shell_rtns_1
     15772 ~ 7%    +158.6%      40789 ~ 7%  TOTAL numa-vmstat.node2.nr_anon_pages

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     70170 ~ 7%    +142.4%     170060 ~ 6%  lkp-wsx01/micro/aim7/shell_rtns_1
     70170 ~ 7%    +142.4%     170060 ~ 6%  TOTAL numa-meminfo.node2.Active(anon)

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     17497 ~ 7%    +141.5%      42251 ~ 7%  lkp-wsx01/micro/aim7/shell_rtns_1
     17497 ~ 7%    +141.5%      42251 ~ 7%  TOTAL numa-vmstat.node2.nr_active_anon

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
       106 ~ 1%    +132.1%        247 ~ 1%  grantley/micro/aim7/shell_rtns_1
       106 ~ 1%    +132.1%        247 ~ 1%  TOTAL slabinfo.kmalloc-2048.num_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
       106 ~ 1%    +132.1%        247 ~ 1%  grantley/micro/aim7/shell_rtns_1
       106 ~ 1%    +132.1%        247 ~ 1%  TOTAL slabinfo.kmalloc-2048.active_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     22067 ~ 1%     +51.1%      33353 ~ 1%  grantley/micro/aim7/shell_rtns_1
     19012 ~ 3%     +17.8%      22391 ~ 2%  grantley/micro/aim7/string_rtns
     54244 ~ 0%     -34.2%      35682 ~ 1%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
    801391 ~24%     -96.2%      30328 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
    896715 ~22%     -86.4%     121755 ~ 1%  TOTAL slabinfo.kmalloc-256.num_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     21569 ~ 1%     +45.1%      31294 ~ 0%  grantley/micro/aim7/shell_rtns_1
     18498 ~ 4%     +18.6%      21944 ~ 2%  grantley/micro/aim7/string_rtns
     51514 ~ 0%     -33.2%      34432 ~ 1%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
    768564 ~23%     -96.4%      27463 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
    860146 ~21%     -86.6%     115134 ~ 1%  TOTAL slabinfo.kmalloc-256.active_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     37.03 ~ 2%     -39.6%      22.37 ~ 2%  grantley/micro/aim7/disk_src
     16.41 ~ 2%     -32.5%      11.08 ~13%  grantley/micro/aim7/shell_rtns_1
     13.89 ~ 0%     -72.3%       3.84 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
     67.33 ~ 1%     -44.6%      37.28 ~ 5%  TOTAL turbostat.%c6

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    297496 ~ 1%    +140.4%     715256 ~ 1%  grantley/micro/aim7/shell_rtns_1
    387686 ~ 2%    +101.3%     780606 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
    685183 ~ 2%    +118.3%    1495862 ~ 1%  TOTAL meminfo.Active

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     38432 ~ 0%     +25.0%      48053 ~ 1%  grantley/micro/aim7/shell_rtns_1
    192752 ~22%     -71.9%      54240 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
    231185 ~18%     -55.8%     102293 ~ 0%  TOTAL proc-vmstat.nr_slab_unreclaimable

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    153710 ~ 0%     +25.0%     192073 ~ 1%  grantley/micro/aim7/shell_rtns_1
    758954 ~21%     -71.4%     216825 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
    912664 ~17%     -55.2%     408898 ~ 0%  TOTAL meminfo.SUnreclaim

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    156138 ~ 7%    +133.3%     364305 ~ 4%  grantley/micro/aim7/shell_rtns_1
     92594 ~ 7%    +110.9%     195235 ~ 6%  lkp-wsx01/micro/aim7/shell_rtns_1
    248732 ~ 7%    +125.0%     559540 ~ 5%  TOTAL numa-meminfo.node0.Active

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    201870 ~ 0%     +19.1%     240499 ~ 1%  grantley/micro/aim7/shell_rtns_1
    917241 ~20%     -70.6%     269238 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
   1119112 ~16%     -54.5%     509738 ~ 0%  TOTAL meminfo.Slab

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     99503 ~10%    +104.9%     203904 ~ 6%  lkp-wsx01/micro/aim7/shell_rtns_1
     99503 ~10%    +104.9%     203904 ~ 6%  TOTAL numa-meminfo.node2.Active

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      0.98 ~ 2%     -49.2%       0.50 ~ 1%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
      0.98 ~ 2%     -49.2%       0.50 ~ 1%  TOTAL perf-profile.cpu-cycles.__netif_receive_skb_core.__netif_receive_skb.process_backlog.net_rx_action.__do_softirq

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     19601 ~ 8%     -49.0%       9998 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
     19601 ~ 8%     -49.0%       9998 ~ 1%  TOTAL slabinfo.proc_inode_cache.num_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    141315 ~ 8%    +148.6%     351337 ~ 5%  grantley/micro/aim7/shell_rtns_1
     54643 ~ 2%     +15.0%      62849 ~ 9%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
     93629 ~ 6%    +100.9%     188139 ~ 5%  lkp-wsx01/micro/aim7/shell_rtns_1
    289588 ~ 6%    +108.0%     602326 ~ 6%  TOTAL numa-meminfo.node1.Active

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
       383 ~ 8%     -49.0%        195 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
       383 ~ 8%     -49.0%        195 ~ 1%  TOTAL slabinfo.proc_inode_cache.active_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
       383 ~ 8%     -49.0%        195 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
       383 ~ 8%     -49.0%        195 ~ 1%  TOTAL slabinfo.proc_inode_cache.num_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
  23349636 ~ 0%     -46.8%   12414509 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
  23349636 ~ 0%     -46.8%   12414509 ~ 2%  TOTAL numa-numastat.node0.numa_hit

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
  23341368 ~ 0%     -46.8%   12407894 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
  23341368 ~ 0%     -46.8%   12407894 ~ 2%  TOTAL numa-numastat.node0.local_node

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     19297 ~ 7%     -48.3%       9968 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
     19297 ~ 7%     -48.3%       9968 ~ 1%  TOTAL slabinfo.proc_inode_cache.active_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     15533 ~ 2%     +16.3%      18062 ~ 2%  grantley/micro/aim7/shell_rtns_1
     70112 ~20%     -65.7%      24021 ~ 2%  lkp-wsx01/micro/aim7/shell_rtns_1
     85646 ~17%     -50.9%      42084 ~ 2%  TOTAL slabinfo.task_delay_info.num_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
 2.288e+08 ~ 0%     -46.7%  1.219e+08 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
 2.288e+08 ~ 0%     -46.7%  1.219e+08 ~ 2%  TOTAL softirqs.NET_RX

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
  46960527 ~ 0%     -46.7%   25048760 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
  46960527 ~ 0%     -46.7%   25048760 ~ 2%  TOTAL proc-vmstat.numa_local

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
  46972931 ~ 0%     -46.6%   25060337 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
  46972931 ~ 0%     -46.6%   25060337 ~ 2%  TOTAL proc-vmstat.numa_hit

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     18061 ~ 2%     +24.8%      22546 ~ 0%  grantley/micro/aim7/shell_rtns_1
     71113 ~20%     -63.8%      25727 ~ 2%  lkp-wsx01/micro/aim7/shell_rtns_1
     89174 ~16%     -45.9%      48273 ~ 1%  TOTAL slabinfo.kmalloc-128.num_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
  12107352 ~ 0%     -45.9%    6544676 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
  12107352 ~ 0%     -45.9%    6544676 ~ 2%  TOTAL numa-vmstat.node0.numa_local

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
  11933610 ~ 1%     -47.4%    6272905 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
  11933610 ~ 1%     -47.4%    6272905 ~ 2%  TOTAL numa-numastat.node3.local_node

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
  11933610 ~ 1%     -47.4%    6275386 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
  11933610 ~ 1%     -47.4%    6275386 ~ 2%  TOTAL numa-numastat.node3.numa_hit

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
  12186795 ~ 0%     -45.6%    6623695 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
  12186795 ~ 0%     -45.6%    6623695 ~ 2%  TOTAL numa-vmstat.node0.numa_hit

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     96797 ~ 9%     +88.9%     182812 ~ 4%  lkp-wsx01/micro/aim7/shell_rtns_1
     96797 ~ 9%     +88.9%     182812 ~ 4%  TOTAL numa-meminfo.node3.Active

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
       109 ~18%    +101.8%        220 ~ 7%  lkp-wsx01/micro/aim7/shell_rtns_1
       109 ~18%    +101.8%        220 ~ 7%  TOTAL proc-vmstat.nr_written

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
   6193291 ~ 1%     -46.3%    3325216 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
   6193291 ~ 1%     -46.3%    3325216 ~ 2%  TOTAL numa-vmstat.node3.numa_local

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
  11692936 ~ 0%     -45.6%    6363752 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
  11692936 ~ 0%     -45.6%    6363752 ~ 2%  TOTAL numa-numastat.node1.numa_hit

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
  11688802 ~ 0%     -45.6%    6361271 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
  11688802 ~ 0%     -45.6%    6361271 ~ 2%  TOTAL numa-numastat.node1.local_node

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     18059 ~ 2%     +24.8%      22543 ~ 0%  grantley/micro/aim7/shell_rtns_1
     65016 ~17%     -60.6%      25621 ~ 2%  lkp-wsx01/micro/aim7/shell_rtns_1
     83076 ~14%     -42.0%      48164 ~ 1%  TOTAL slabinfo.kmalloc-128.active_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     15521 ~ 2%     +16.3%      18047 ~ 2%  grantley/micro/aim7/shell_rtns_1
     64124 ~17%     -62.6%      23975 ~ 2%  lkp-wsx01/micro/aim7/shell_rtns_1
     79646 ~14%     -47.2%      42023 ~ 2%  TOTAL slabinfo.task_delay_info.active_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      1.48 ~ 1%     +67.1%       2.47 ~ 0%  grantley/micro/aim7/disk_src
      1.26 ~ 0%     +97.9%       2.49 ~ 0%  grantley/micro/aim7/shell_rtns_1
      2.74 ~ 0%     +81.3%       4.96 ~ 0%  TOTAL turbostat.GHz

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
   6305179 ~ 1%     -45.5%    3437625 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
   6305179 ~ 1%     -45.5%    3437625 ~ 2%  TOTAL numa-vmstat.node3.numa_hit

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
   6159931 ~ 0%     -44.2%    3438297 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
   6159931 ~ 0%     -44.2%    3438297 ~ 2%  TOTAL numa-vmstat.node1.numa_local

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     70.05 ~ 2%     +22.7%      85.95 ~ 1%  grantley/micro/aim7/disk_src
    101.86 ~ 2%     +39.8%     142.38 ~ 3%  grantley/micro/aim7/shell_rtns_1
    114.60 ~ 1%    +176.7%     317.06 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
    286.50 ~ 1%     +90.4%     545.39 ~ 1%  TOTAL uptime.boot

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
   6195618 ~ 0%     -43.9%    3473661 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
   6195618 ~ 0%     -43.9%    3473661 ~ 2%  TOTAL numa-vmstat.node1.numa_hit

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      1712 ~ 1%    +131.6%       3965 ~ 1%  grantley/micro/aim7/shell_rtns_1
      3936 ~ 5%     +28.8%       5072 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
      5649 ~ 3%     +60.0%       9038 ~ 0%  TOTAL slabinfo.kmalloc-2048.num_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      1712 ~ 1%    +126.1%       3871 ~ 1%  grantley/micro/aim7/shell_rtns_1
      3863 ~ 4%     +27.6%       4927 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
      5575 ~ 3%     +57.8%       8798 ~ 0%  TOTAL slabinfo.kmalloc-2048.active_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
       141 ~ 2%     +70.4%        241 ~10%  lkp-wsx01/micro/aim7/shell_rtns_1
       141 ~ 2%     +70.4%        241 ~10%  TOTAL proc-vmstat.nr_dirtied

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     39027 ~ 3%     -25.8%      28971 ~ 8%  grantley/micro/aim7/disk_src
    747148 ~ 0%     -49.1%     380461 ~ 3%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
    786176 ~ 0%     -47.9%     409432 ~ 3%  TOTAL proc-vmstat.pgalloc_dma32

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     29324 ~ 7%    +101.1%      58978 ~33%  lkp-wsx01/micro/aim7/shell_rtns_1
     29324 ~ 7%    +101.1%      58978 ~33%  TOTAL numa-meminfo.node3.PageTables

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    128910 ~ 3%     +77.2%     228459 ~ 4%  grantley/micro/aim7/shell_rtns_1
    167288 ~ 3%     +50.7%     252075 ~ 2%  lkp-wsx01/micro/aim7/shell_rtns_1
    296199 ~ 3%     +62.2%     480534 ~ 3%  TOTAL meminfo.PageTables

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     32256 ~ 3%     +77.2%      57162 ~ 4%  grantley/micro/aim7/shell_rtns_1
     41618 ~ 3%     +51.7%      63117 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
     73874 ~ 3%     +62.8%     120279 ~ 3%  TOTAL proc-vmstat.nr_page_table_pages

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    792183 ~ 6%     -25.4%     590643 ~ 3%  grantley/micro/aim7/disk_src
  47655459 ~ 0%     -47.1%   25213633 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
  48447643 ~ 0%     -46.7%   25804277 ~ 2%  TOTAL proc-vmstat.pgfree

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    750656 ~ 6%     -25.6%     558315 ~ 2%  grantley/micro/aim7/disk_src
  46948168 ~ 0%     -47.0%   24871573 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
  47698824 ~ 0%     -46.7%   25429888 ~ 2%  TOTAL proc-vmstat.pgalloc_normal

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      7321 ~ 8%    +100.4%      14674 ~33%  lkp-wsx01/micro/aim7/shell_rtns_1
      7321 ~ 8%    +100.4%      14674 ~33%  TOTAL numa-vmstat.node3.nr_page_table_pages

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    106318 ~ 0%     +61.5%     171693 ~ 1%  grantley/micro/aim7/shell_rtns_1
    121177 ~ 0%     +56.6%     189713 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
    227495 ~ 0%     +58.9%     361407 ~ 1%  TOTAL slabinfo.vm_area_struct.num_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      2415 ~ 0%     +61.5%       3901 ~ 1%  grantley/micro/aim7/shell_rtns_1
      2753 ~ 0%     +56.6%       4311 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
      5169 ~ 0%     +58.9%       8213 ~ 1%  TOTAL slabinfo.vm_area_struct.active_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      2415 ~ 0%     +61.5%       3901 ~ 1%  grantley/micro/aim7/shell_rtns_1
      2753 ~ 0%     +56.6%       4311 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
      5169 ~ 0%     +58.9%       8213 ~ 1%  TOTAL slabinfo.vm_area_struct.num_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    103648 ~ 0%     +57.3%     163005 ~ 1%  grantley/micro/aim7/shell_rtns_1
    116417 ~ 0%     +53.1%     178269 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
    220065 ~ 0%     +55.1%     341274 ~ 1%  TOTAL slabinfo.vm_area_struct.active_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    134901 ~ 9%     -32.7%      90833 ~10%  grantley/micro/aim7/shell_rtns_1
    129125 ~12%     +35.8%     175345 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
    264026 ~10%      +0.8%     266179 ~ 4%  TOTAL softirqs.SCHED

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
   1045365 ~ 3%      +9.8%    1147876 ~ 1%  grantley/micro/aim7/disk_src
  47284865 ~ 0%     -45.1%   25940066 ~ 1%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
  48330231 ~ 0%     -44.0%   27087942 ~ 1%  TOTAL proc-vmstat.pgfault

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      9.72 ~11%     -35.5%       6.27 ~ 6%  grantley/micro/aim7/disk_src
      4.37 ~12%     -32.5%       2.95 ~14%  grantley/micro/aim7/shell_rtns_1
     14.09 ~11%     -34.5%       9.22 ~ 8%  TOTAL turbostat.%pc2

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
 8.932e+08 ~ 3%     -27.8%  6.451e+08 ~ 2%  grantley/micro/aim7/disk_src
 8.932e+08 ~ 3%     -27.8%  6.451e+08 ~ 2%  TOTAL cpuidle.C6-HSW.time

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    967729 ~ 6%     +37.0%    1326099 ~ 5%  grantley/micro/aim7/shell_rtns_1
    961879 ~ 8%     -13.4%     832924 ~ 9%  lkp-wsx01/micro/aim7/shell_rtns_1
   1929609 ~ 7%     +11.9%    2159024 ~ 7%  TOTAL numa-meminfo.node1.MemUsed

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     68903 ~ 0%     +37.7%      94913 ~ 1%  grantley/micro/aim7/shell_rtns_1
     85573 ~ 0%     +24.9%     106849 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
    154477 ~ 0%     +30.6%     201762 ~ 1%  TOTAL slabinfo.anon_vma.num_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      1076 ~ 0%     +37.8%       1482 ~ 1%  grantley/micro/aim7/shell_rtns_1
      1336 ~ 0%     +24.9%       1669 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
      2412 ~ 0%     +30.6%       3151 ~ 1%  TOTAL slabinfo.anon_vma.active_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      1076 ~ 0%     +37.8%       1482 ~ 1%  grantley/micro/aim7/shell_rtns_1
      1336 ~ 0%     +24.9%       1669 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
      2412 ~ 0%     +30.6%       3151 ~ 1%  TOTAL slabinfo.anon_vma.num_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     67802 ~ 0%     +35.4%      91804 ~ 1%  grantley/micro/aim7/shell_rtns_1
     84473 ~ 0%     +24.1%     104836 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
    152275 ~ 0%     +29.1%     196641 ~ 1%  TOTAL slabinfo.anon_vma.active_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
       376 ~ 0%     +27.7%        480 ~ 2%  grantley/micro/aim7/shell_rtns_1
       376 ~ 0%     +27.7%        480 ~ 2%  TOTAL slabinfo.sighand_cache.active_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
       376 ~ 0%     +27.7%        480 ~ 2%  grantley/micro/aim7/shell_rtns_1
       376 ~ 0%     +27.7%        480 ~ 2%  TOTAL slabinfo.sighand_cache.num_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      5645 ~ 0%     +27.7%       7208 ~ 2%  grantley/micro/aim7/shell_rtns_1
      6652 ~ 0%     +22.4%       8144 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
     12298 ~ 0%     +24.8%      15353 ~ 1%  TOTAL slabinfo.sighand_cache.num_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      5467 ~ 0%     +24.0%       6779 ~ 1%  grantley/micro/aim7/shell_rtns_1
      6439 ~ 0%     +22.9%       7916 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
     11906 ~ 0%     +23.4%      14696 ~ 0%  TOTAL slabinfo.sighand_cache.active_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      1268 ~ 0%     +25.8%       1596 ~ 1%  grantley/micro/aim7/shell_rtns_1
      1702 ~ 0%     +19.6%       2036 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
      2971 ~ 0%     +22.2%       3632 ~ 1%  TOTAL slabinfo.kmalloc-4096.num_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    177148 ~ 0%     +24.0%     219595 ~ 1%  grantley/micro/aim7/shell_rtns_1
     91649 ~ 0%     -15.8%      77156 ~ 1%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
    268798 ~ 0%     +10.4%     296751 ~ 1%  TOTAL slabinfo.kmalloc-64.active_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      1234 ~ 0%     +23.0%       1518 ~ 1%  grantley/micro/aim7/shell_rtns_1
      1619 ~ 0%     +20.2%       1945 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
      2853 ~ 0%     +21.4%       3464 ~ 1%  TOTAL slabinfo.kmalloc-4096.active_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     13333 ~ 2%     +12.7%      15030 ~ 3%  grantley/micro/aim7/shell_rtns_1
     16521 ~ 3%     +29.3%      21358 ~ 3%  lkp-wsx01/micro/aim7/shell_rtns_1
     29855 ~ 2%     +21.9%      36388 ~ 3%  TOTAL slabinfo.files_cache.num_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     13225 ~ 2%     +12.9%      14927 ~ 3%  grantley/micro/aim7/shell_rtns_1
     16377 ~ 3%     +28.6%      21062 ~ 3%  lkp-wsx01/micro/aim7/shell_rtns_1
     29602 ~ 3%     +21.6%      35990 ~ 3%  TOTAL slabinfo.files_cache.active_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      3259 ~ 2%     -15.9%       2742 ~ 1%  grantley/micro/aim7/disk_src
      3231 ~ 2%     -14.9%       2750 ~ 4%  grantley/micro/aim7/shell_rtns_1
      6491 ~ 2%     -15.4%       5492 ~ 3%  TOTAL uptime.idle

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      2873 ~ 0%     +26.5%       3635 ~ 1%  grantley/micro/aim7/shell_rtns_1
      1437 ~ 0%     -15.5%       1214 ~ 1%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
      4215 ~ 8%     -13.2%       3658 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
      8526 ~ 4%      -0.2%       8508 ~ 1%  TOTAL slabinfo.kmalloc-64.num_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      2873 ~ 0%     +26.5%       3635 ~ 1%  grantley/micro/aim7/shell_rtns_1
      1437 ~ 0%     -15.5%       1214 ~ 1%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
      4215 ~ 8%     -13.2%       3658 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
      8526 ~ 4%      -0.2%       8508 ~ 1%  TOTAL slabinfo.kmalloc-64.active_slabs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    183945 ~ 0%     +26.5%     232676 ~ 1%  grantley/micro/aim7/shell_rtns_1
     92013 ~ 0%     -15.5%      77762 ~ 1%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
    269789 ~ 8%     -13.2%     234207 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
    545748 ~ 4%      -0.2%     544645 ~ 1%  TOTAL slabinfo.kmalloc-64.num_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
   1018345 ~ 5%     +23.8%    1261207 ~ 5%  grantley/micro/aim7/shell_rtns_1
   1018345 ~ 5%     +23.8%    1261207 ~ 5%  TOTAL numa-meminfo.node0.MemUsed

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
   3220038 ~ 0%     +12.8%    3632740 ~ 1%  grantley/micro/aim7/shell_rtns_1
   3297201 ~ 0%     +19.3%    3932415 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
   6517239 ~ 0%     +16.1%    7565155 ~ 1%  TOTAL meminfo.Committed_AS

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
        48 ~ 1%     +14.6%         55 ~ 1%  grantley/micro/aim7/disk_src
        49 ~ 1%     +18.1%         58 ~ 1%  grantley/micro/aim7/shell_rtns_1
        97 ~ 1%     +16.4%        113 ~ 1%  TOTAL turbostat.CTMP

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
        52 ~ 0%     +14.6%         59 ~ 0%  grantley/micro/aim7/disk_src
        55 ~ 0%     +14.4%         63 ~ 1%  grantley/micro/aim7/shell_rtns_1
       107 ~ 0%     +14.5%        123 ~ 1%  TOTAL turbostat.PTMP

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      2434 ~ 5%     +11.7%       2720 ~ 6%  grantley/micro/aim7/shell_rtns_1
      2434 ~ 5%     +11.7%       2720 ~ 6%  TOTAL slabinfo.shmem_inode_cache.active_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      2434 ~ 5%     +11.7%       2720 ~ 6%  grantley/micro/aim7/shell_rtns_1
      2434 ~ 5%     +11.7%       2720 ~ 6%  TOTAL slabinfo.shmem_inode_cache.num_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      1.77 ~ 4%     -13.7%       1.53 ~ 3%  grantley/micro/aim7/shell_rtns_1
      1.77 ~ 4%     -13.7%       1.53 ~ 3%  TOTAL perf-profile.cpu-cycles.find_busiest_group.load_balance.idle_balance.__schedule.schedule

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     14312 ~ 1%     +14.4%      16371 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
     14312 ~ 1%     +14.4%      16371 ~ 1%  TOTAL slabinfo.mm_struct.active_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     14544 ~ 1%     +14.2%      16612 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
     14544 ~ 1%     +14.2%      16612 ~ 1%  TOTAL slabinfo.mm_struct.num_objs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      3396 ~ 4%     -10.4%       3044 ~ 5%  grantley/micro/aim7/shell_rtns_1
      3396 ~ 4%     -10.4%       3044 ~ 5%  TOTAL proc-vmstat.nr_alloc_batch

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     22328 ~ 4%     -11.1%      19845 ~ 2%  lkp-wsx01/micro/aim7/shell_rtns_1
     22328 ~ 4%     -11.1%      19845 ~ 2%  TOTAL cpuidle.C6-NHM.usage

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    529.92 ~ 4%    +268.2%    1951.04 ~ 3%  grantley/micro/aim7/disk_src
   1003.41 ~ 0%    +279.2%    3805.01 ~ 0%  grantley/micro/aim7/shell_rtns_1
     19.77 ~ 6%    +182.6%      55.87 ~17%  grantley/micro/aim7/string_rtns
   3497.24 ~ 0%    +461.8%   19645.76 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
   5050.34 ~ 0%    +404.1%   25457.68 ~ 1%  TOTAL time.system_time

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     11497 ~11%   +1707.3%     207797 ~ 3%  grantley/micro/aim7/disk_src
    942233 ~ 3%      +4.7%     986308 ~ 0%  grantley/micro/aim7/shell_rtns_1
   1131925 ~ 0%    +270.9%    4197966 ~ 4%  lkp-wsx01/micro/aim7/shell_rtns_1
   2085656 ~ 2%    +158.5%    5392071 ~ 3%  TOTAL time.involuntary_context_switches

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     32036 ~12%     -72.8%       8706 ~ 2%  grantley/micro/aim7/disk_src
     99971 ~ 3%     -70.5%      29537 ~ 3%  grantley/micro/aim7/shell_rtns_1
   1440638 ~ 0%     -46.5%     770986 ~ 2%  lkp-nex05/micro/netperf/120s-200%-TCP_CRR
     47859 ~ 0%     -48.0%      24882 ~ 3%  lkp-wsx01/micro/aim7/shell_rtns_1
   1620504 ~ 0%     -48.5%     834112 ~ 2%  TOTAL vmstat.system.cs

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
    487467 ~12%     -81.6%      89693 ~ 2%  grantley/micro/aim7/disk_src
   2644894 ~ 3%     -41.1%    1558409 ~ 0%  grantley/micro/aim7/shell_rtns_1
   2110723 ~ 0%     -17.9%    1731995 ~ 1%  lkp-wsx01/micro/aim7/shell_rtns_1
   5243086 ~ 3%     -35.5%    3380098 ~ 1%  TOTAL time.voluntary_context_switches

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     30.65 ~ 1%     +51.7%      46.48 ~ 2%  grantley/micro/aim7/disk_src
     63.36 ~ 2%     +62.5%     102.94 ~ 4%  grantley/micro/aim7/shell_rtns_1
     31.54 ~ 0%      +2.5%      32.32 ~ 0%  grantley/micro/aim7/string_rtns
     76.30 ~ 0%    +264.6%     278.15 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
    201.85 ~ 1%    +127.8%     459.89 ~ 1%  TOTAL time.elapsed_time

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      1824 ~ 3%    +132.3%       4239 ~ 0%  grantley/micro/aim7/disk_src
      2423 ~ 1%     +64.9%       3995 ~ 3%  grantley/micro/aim7/shell_rtns_1
      5433 ~ 0%     +34.7%       7318 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
      9681 ~ 1%     +60.6%      15552 ~ 1%  TOTAL time.percent_of_cpu_this_job_got

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     75.03 ~ 0%     +75.4%     131.59 ~ 1%  grantley/micro/aim7/disk_src
     92.96 ~ 0%     +67.5%     155.70 ~ 1%  grantley/micro/aim7/shell_rtns_1
    167.99 ~ 0%     +71.0%     287.29 ~ 1%  TOTAL turbostat.Pkg_W

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     32.68 ~ 3%    +129.8%      75.08 ~ 0%  grantley/micro/aim7/disk_src
     68.19 ~ 0%     +29.8%      88.50 ~ 1%  grantley/micro/aim7/shell_rtns_1
     85.38 ~ 0%     +12.5%      96.05 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
    186.25 ~ 0%     +39.4%     259.63 ~ 0%  TOTAL turbostat.%c0

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     29.50 ~ 0%     -31.5%      20.20 ~ 1%  grantley/micro/aim7/disk_src
    531.64 ~ 0%     -43.2%     302.22 ~ 1%  grantley/micro/aim7/shell_rtns_1
    648.67 ~ 0%      +9.8%     712.26 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
   1209.81 ~ 0%     -14.5%    1034.68 ~ 0%  TOTAL time.user_time

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
     14538 ~ 7%     -15.6%      12271 ~ 0%  grantley/micro/aim7/disk_src
     24511 ~ 5%     -36.3%      15617 ~ 2%  grantley/micro/aim7/shell_rtns_1
     27643 ~ 0%     -26.4%      20346 ~ 0%  lkp-wsx01/micro/aim7/shell_rtns_1
     66693 ~ 4%     -27.7%      48234 ~ 0%  TOTAL vmstat.system.in

887843961c4b468  e2a728c2785d6aab45d1a6d2c  
---------------  -------------------------  
      3.86 ~ 7%     +55.3%       5.99 ~ 3%  grantley/micro/aim7/disk_src
      7.45 ~ 5%     +18.6%       8.83 ~ 4%  grantley/micro/aim7/shell_rtns_1
     11.31 ~ 6%     +31.1%      14.82 ~ 4%  TOTAL turbostat.RAM_W


Legend:
	~XX%    - stddev percent
	[+-]XX% - change percent


                                  time.system_time

   20000 O+----O---O-----O--O--O---O--------O--O--O---O--O--O--O--O---O--O--O
         |  O         O               O  O                                  |
   18000 ++                                                                 |
   16000 ++                                                                 |
         |                                                                  |
   14000 ++                                                                 |
   12000 ++                                                                 |
         |                                                                  |
   10000 ++                                                                 |
    8000 ++                                                                 |
         |                                                                  |
    6000 ++                                                                 |
    4000 ++                                                                 |
         *..*..*...*..*..*..*..*...*..*..*..*..*..*...*..*..*               |
    2000 ++-----------------------------------------------------------------+


                          time.percent_of_cpu_this_job_got

   7500 ++------------------------------------------------------------------+
        O  O  O   O  O  O  O   O  O     O   O  O  O  O   O  O  O  O   O  O  O
        |                            O                                      |
   7000 ++                                                                  |
        |                                                                   |
        |                                                                   |
   6500 ++                                                                  |
        |                                                                   |
   6000 ++                                                                  |
        |                                                                   |
        |                                                                   |
   5500 ++                                    .*..         .*               |
        *..*..*...*..*..   *...*..*..*..*...*.    *..*...*.                 |
        |                ..                                                 |
   5000 ++--------------*---------------------------------------------------+


                                 time.elapsed_time

   300 ++-------------------------------------------------------------------+
       O      O  O  O  O   O  O  O         O  O   O  O  O   O  O  O  O   O  O
       |  O                          O  O                                   |
   250 ++                                                                   |
       |                                                                    |
       |                                                                    |
   200 ++                                                                   |
       |                                                                    |
   150 ++                                                                   |
       |                                                                    |
       |                                                                    |
   100 ++                                                                   |
       | .*...  .*..*..*...     .*...  .*..                                 |
       *.     *.           *..*.     *.    *..*...*..*..*...*               |
    50 ++-------------------------------------------------------------------+


                           time.involuntary_context_switches

     5e+06 ++---------------------------------------------------------------+
           |                                                                |
   4.5e+06 O+                    O  O                    O   O           O  |
     4e+06 ++    O     O  O   O        O  O  O  O  O  O         O  O        O
           |  O     O                                                 O     |
   3.5e+06 ++                                                               |
           |                                                                |
     3e+06 ++                                                               |
           |                                                                |
   2.5e+06 ++                                                               |
     2e+06 ++                                                               |
           |                                                                |
   1.5e+06 ++                                                               |
           |                       .*..  .*..*..                            |
     1e+06 *+-*--*--*--*--*---*--*-----*--------*--*--*--*---*--------------+


                                aim7.2000.jobs-per-min

   160000 *+----*--*------*--*--*-----*------*--*--*--*--*--*---------------+
          |  *.        *.          *.    *.                                 |
   140000 ++                                                                |
          |                                                                 |
          |                                                                 |
   120000 ++                                                                |
          |                                                                 |
   100000 ++                                                                |
          |                                                                 |
    80000 ++                                                                |
          |                                                                 |
          |                                                                 |
    60000 ++                                                                |
          |  O                        O  O                                  |
    40000 O+----O--O---O--O--O--O--O---------O--O--O--O--O--O--O---O--O--O--O


                                   turbostat.%c0

   98 ++--------------------------------------------------------------------+
      |                                                           O      O  |
   96 O+ O   O  O  O   O  O  O   O  O  O   O  O  O   O  O  O   O     O      O
   94 ++                                                                    |
      |                                                                     |
   92 ++                                                                    |
   90 ++                                                                    |
      |                                                                     |
   88 ++                                                                    |
   86 ++                                                                    |
      *..*...*..*..*      *..*...*..*..*...*..*..*...*..*..*                |
   84 ++            +    :                                                  |
   82 ++             +   :                                                  |
      |               + :                                                   |
   80 ++---------------*----------------------------------------------------+


                                  vmstat.system.cs

   55000 ++-----------------------------------------------------------------+
         |                                 .*..                             |
   50000 ++                             .*.                                 |
         *..*..*...*..*..  .*..*...*..*.       *..*...*..*..*               |
   45000 ++              *.                                                 |
         |                                                                  |
   40000 ++                                                                 |
         |                                                                  |
   35000 ++                                                                 |
         |                                                                  |
   30000 ++                                                                 |
         |                     O                                            |
   25000 O+ O  O   O  O  O  O      O  O  O  O  O  O   O  O  O  O  O      O  O
         |                                                            O     |
   20000 ++-----------------------------------------------------------------+


	[*] bisect-good sample
	[O] bisect-bad  sample

Thanks,
Fengguang
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ