| lists.openwall.net | lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC | |
|
Open Source and information security mailing list archives
| ||
|
Message-ID: <20210201031004.GA12524@xsang-OptiPlex-9020>
Date: Mon, 1 Feb 2021 11:10:04 +0800
From: kernel test robot <oliver.sang@...el.com>
To: "Darrick J. Wong" <djwong@...nel.org>
Cc: LKML <linux-kernel@...r.kernel.org>,
"Darrick J. Wong" <darrick.wong@...cle.com>, lkp@...ts.01.org,
lkp@...el.com, ying.huang@...el.com, feng.tang@...el.com,
zhengjun.xing@...el.com
Subject: [xfs] aa0a2ec202: fxmark.hdd_xfs_MWUL_9_directio.works/sec -53.2%
regression
Greeting,
FYI, we noticed a -53.2% regression of fxmark.hdd_xfs_MWUL_9_directio.works/sec due to commit:
commit: aa0a2ec202a8b319516cec852c8c206557749b4c ("xfs: deferred inode inactivation")
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfs-linux.git reserve-rt-metadata-space
in testcase: fxmark
on test machine: 288 threads Intel(R) Xeon Phi(TM) CPU 7295 @ 1.50GHz with 80G memory
with following parameters:
disk: 1HDD
media: hdd
test: MWUL
fstype: xfs
directio: directio
cpufreq_governor: performance
ucode: 0x11
In addition to that, the commit also has significant impact on the following tests:
+------------------+-----------------------------------------------------------------------+
| testcase: change | stress-ng: stress-ng.symlink.ops_per_sec -35.1% regression |
| test machine | 48 threads Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory |
| test parameters | class=filesystem |
| | cpufreq_governor=performance |
| | disk=1HDD |
| | fs=xfs |
| | nr_threads=10% |
| | testtime=30s |
| | ucode=0x42e |
+------------------+-----------------------------------------------------------------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang@...el.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/directio/disk/fstype/kconfig/media/rootfs/tbox_group/test/testcase/ucode:
gcc-9/performance/directio/1HDD/xfs/x86_64-rhel-8.3/hdd/debian-10.4-x86_64-20200603.cgz/lkp-knm01/MWUL/fxmark/0x11
commit:
bd70706acf ("xfs: decide if inode needs inactivation")
aa0a2ec202 ("xfs: deferred inode inactivation")
bd70706acfc93277 aa0a2ec202a8b319516cec852c8
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
0:4 6% 0:4 perf-profile.children.cycles-pp.error_return
1:4 10% 1:4 perf-profile.children.cycles-pp.error_entry
0:4 6% 0:4 perf-profile.self.cycles-pp.error_return
1:4 10% 1:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
116.21 ± 12% +151.0% 291.72 ± 4% fxmark.hdd_xfs_MWUL_18_directio.idle_sec
0.49 ± 10% +134.5% 1.16 ± 14% fxmark.hdd_xfs_MWUL_18_directio.iowait_sec
2.53 ± 9% +91.5% 4.85 ± 3% fxmark.hdd_xfs_MWUL_18_directio.irq_sec
1.89 ± 2% -16.9% 1.57 fxmark.hdd_xfs_MWUL_18_directio.irq_util
7.54 ± 11% +128.4% 17.22 ± 4% fxmark.hdd_xfs_MWUL_18_directio.real_sec
7.22 ± 10% +135.6% 17.02 ± 4% fxmark.hdd_xfs_MWUL_18_directio.secs
0.44 ± 16% +71.2% 0.76 ± 8% fxmark.hdd_xfs_MWUL_18_directio.softirq_sec
0.33 ± 9% -25.3% 0.25 ± 10% fxmark.hdd_xfs_MWUL_18_directio.softirq_util
13.36 ± 3% -35.8% 8.57 ± 3% fxmark.hdd_xfs_MWUL_18_directio.sys_sec
10.05 ± 8% -72.3% 2.78 ± 3% fxmark.hdd_xfs_MWUL_18_directio.sys_util
1.22 ± 4% +31.2% 1.60 fxmark.hdd_xfs_MWUL_18_directio.user_sec
0.92 ± 9% -43.4% 0.52 ± 3% fxmark.hdd_xfs_MWUL_18_directio.user_util
7279 ± 11% -58.0% 3055 ± 4% fxmark.hdd_xfs_MWUL_18_directio.works/sec
0.03 ± 40% +4816.7% 1.48 ± 18% fxmark.hdd_xfs_MWUL_1_directio.idle_sec
0.30 ± 41% +3521.2% 10.96 ± 17% fxmark.hdd_xfs_MWUL_1_directio.idle_util
0.45 ± 4% +36.1% 0.61 ± 5% fxmark.hdd_xfs_MWUL_1_directio.irq_sec
9.97 ± 2% +35.1% 13.46 fxmark.hdd_xfs_MWUL_1_directio.real_sec
9.63 ± 2% +34.5% 12.95 fxmark.hdd_xfs_MWUL_1_directio.secs
8.49 +18.3% 10.04 fxmark.hdd_xfs_MWUL_1_directio.sys_sec
85.19 -12.3% 74.71 fxmark.hdd_xfs_MWUL_1_directio.sys_util
0.78 ± 7% +20.8% 0.94 ± 3% fxmark.hdd_xfs_MWUL_1_directio.user_sec
5317 ± 2% -25.6% 3955 fxmark.hdd_xfs_MWUL_1_directio.works/sec
199.30 ± 11% +174.9% 547.89 ± 7% fxmark.hdd_xfs_MWUL_27_directio.idle_sec
0.56 ± 11% +115.6% 1.21 ± 3% fxmark.hdd_xfs_MWUL_27_directio.iowait_sec
0.26 ± 13% -17.2% 0.21 ± 5% fxmark.hdd_xfs_MWUL_27_directio.iowait_util
3.78 ± 8% +124.1% 8.48 ± 7% fxmark.hdd_xfs_MWUL_27_directio.irq_sec
1.73 -13.8% 1.49 fxmark.hdd_xfs_MWUL_27_directio.irq_util
8.19 ± 10% +158.2% 21.16 ± 7% fxmark.hdd_xfs_MWUL_27_directio.real_sec
8.00 ± 10% +163.8% 21.10 ± 8% fxmark.hdd_xfs_MWUL_27_directio.secs
0.56 ± 8% +106.3% 1.15 ± 14% fxmark.hdd_xfs_MWUL_27_directio.softirq_sec
0.26 ± 12% -21.5% 0.20 ± 9% fxmark.hdd_xfs_MWUL_27_directio.softirq_util
13.76 -35.1% 8.94 ± 2% fxmark.hdd_xfs_MWUL_27_directio.sys_sec
6.33 ± 9% -75.1% 1.58 ± 5% fxmark.hdd_xfs_MWUL_27_directio.sys_util
1.59 +28.4% 2.04 fxmark.hdd_xfs_MWUL_27_directio.user_sec
0.73 ± 9% -50.8% 0.36 ± 6% fxmark.hdd_xfs_MWUL_27_directio.user_util
6603 ± 11% -62.2% 2498 ± 9% fxmark.hdd_xfs_MWUL_27_directio.works/sec
1.25 ± 23% +742.9% 10.56 ± 21% fxmark.hdd_xfs_MWUL_2_directio.idle_sec
10.34 ± 20% +375.6% 49.16 ± 4% fxmark.hdd_xfs_MWUL_2_directio.idle_util
0.54 ± 2% +40.3% 0.76 ± 25% fxmark.hdd_xfs_MWUL_2_directio.irq_sec
4.49 -22.2% 3.49 ± 2% fxmark.hdd_xfs_MWUL_2_directio.irq_util
6.05 ± 3% +81.6% 10.99 ± 25% fxmark.hdd_xfs_MWUL_2_directio.real_sec
5.85 ± 2% +85.6% 10.85 ± 2% fxmark.hdd_xfs_MWUL_2_directio.secs
0.17 ± 16% +65.2% 0.29 ± 29% fxmark.hdd_xfs_MWUL_2_directio.softirq_sec
77.75 ± 2% -47.6% 40.76 ± 5% fxmark.hdd_xfs_MWUL_2_directio.sys_util
0.62 ± 4% +33.7% 0.83 ± 17% fxmark.hdd_xfs_MWUL_2_directio.user_sec
5.18 ± 7% -24.3% 3.92 ± 9% fxmark.hdd_xfs_MWUL_2_directio.user_util
8773 ± 2% -46.1% 4729 ± 2% fxmark.hdd_xfs_MWUL_2_directio.works/sec
370.11 ± 6% +153.4% 938.01 ± 6% fxmark.hdd_xfs_MWUL_36_directio.idle_sec
0.66 ± 11% +106.5% 1.36 ± 13% fxmark.hdd_xfs_MWUL_36_directio.iowait_sec
6.29 ± 6% +126.2% 14.21 ± 4% fxmark.hdd_xfs_MWUL_36_directio.irq_sec
11.01 ± 6% +144.6% 26.94 ± 5% fxmark.hdd_xfs_MWUL_36_directio.real_sec
10.87 ± 5% +146.6% 26.81 ± 5% fxmark.hdd_xfs_MWUL_36_directio.secs
0.85 ± 13% +108.5% 1.77 ± 5% fxmark.hdd_xfs_MWUL_36_directio.softirq_sec
14.78 -33.1% 9.88 ± 2% fxmark.hdd_xfs_MWUL_36_directio.sys_sec
3.76 ± 6% -72.8% 1.02 ± 3% fxmark.hdd_xfs_MWUL_36_directio.sys_util
1.93 ± 2% +29.1% 2.49 ± 3% fxmark.hdd_xfs_MWUL_36_directio.user_sec
0.49 ± 4% -47.4% 0.26 ± 3% fxmark.hdd_xfs_MWUL_36_directio.user_util
4876 ± 6% -59.5% 1974 ± 6% fxmark.hdd_xfs_MWUL_36_directio.works/sec
589.74 ± 7% +122.6% 1312 ± 2% fxmark.hdd_xfs_MWUL_45_directio.idle_sec
0.93 ± 13% +93.3% 1.80 ± 4% fxmark.hdd_xfs_MWUL_45_directio.iowait_sec
9.69 ± 6% +106.1% 19.96 fxmark.hdd_xfs_MWUL_45_directio.irq_sec
13.81 ± 7% +117.4% 30.03 ± 2% fxmark.hdd_xfs_MWUL_45_directio.real_sec
13.66 ± 7% +119.0% 29.92 fxmark.hdd_xfs_MWUL_45_directio.secs
1.23 ± 6% +91.0% 2.35 ± 7% fxmark.hdd_xfs_MWUL_45_directio.softirq_sec
15.52 -38.4% 9.57 ± 9% fxmark.hdd_xfs_MWUL_45_directio.sys_sec
2.52 ± 6% -71.8% 0.71 ± 11% fxmark.hdd_xfs_MWUL_45_directio.sys_util
2.37 ± 2% +21.5% 2.88 fxmark.hdd_xfs_MWUL_45_directio.user_sec
0.38 ± 5% -44.4% 0.21 ± 3% fxmark.hdd_xfs_MWUL_45_directio.user_util
3885 ± 7% -61.3% 1505 ± 19% fxmark.hdd_xfs_MWUL_45_directio.works/sec
9.12 ± 4% +189.4% 26.39 ± 7% fxmark.hdd_xfs_MWUL_4_directio.idle_sec
41.10 ± 2% +79.1% 73.59 fxmark.hdd_xfs_MWUL_4_directio.idle_util
0.18 ± 22% +139.4% 0.43 ± 23% fxmark.hdd_xfs_MWUL_4_directio.iowait_sec
0.75 ± 3% +23.0% 0.92 ± 6% fxmark.hdd_xfs_MWUL_4_directio.irq_sec
3.38 ± 2% -23.9% 2.58 fxmark.hdd_xfs_MWUL_4_directio.irq_util
5.65 ± 2% +60.6% 9.07 ± 7% fxmark.hdd_xfs_MWUL_4_directio.real_sec
5.37 +70.5% 9.15 fxmark.hdd_xfs_MWUL_4_directio.secs
11.22 -37.2% 7.05 ± 7% fxmark.hdd_xfs_MWUL_4_directio.sys_sec
50.63 ± 2% -61.2% 19.67 ± 2% fxmark.hdd_xfs_MWUL_4_directio.sys_util
0.72 ± 4% +17.1% 0.84 ± 6% fxmark.hdd_xfs_MWUL_4_directio.user_sec
3.24 ± 3% -27.5% 2.35 ± 4% fxmark.hdd_xfs_MWUL_4_directio.user_util
9547 -41.2% 5611 fxmark.hdd_xfs_MWUL_4_directio.works/sec
986.54 ± 5% +62.4% 1602 fxmark.hdd_xfs_MWUL_54_directio.idle_sec
1.30 ± 17% +50.1% 1.95 ± 4% fxmark.hdd_xfs_MWUL_54_directio.iowait_sec
15.98 ± 4% +52.4% 24.36 fxmark.hdd_xfs_MWUL_54_directio.irq_sec
19.08 ± 4% +59.8% 30.48 fxmark.hdd_xfs_MWUL_54_directio.real_sec
19.00 ± 4% +59.4% 30.27 fxmark.hdd_xfs_MWUL_54_directio.secs
1.92 ± 6% +39.6% 2.67 ± 6% fxmark.hdd_xfs_MWUL_54_directio.softirq_sec
16.92 ± 2% -47.9% 8.82 ± 5% fxmark.hdd_xfs_MWUL_54_directio.sys_sec
1.65 ± 6% -67.5% 0.54 ± 6% fxmark.hdd_xfs_MWUL_54_directio.sys_util
0.46 ± 58% -58.9% 0.19 ± 3% fxmark.hdd_xfs_MWUL_54_directio.user_util
53161 -31.6% 36377 ± 13% fxmark.hdd_xfs_MWUL_54_directio.works
2803 ± 4% -57.1% 1201 ± 13% fxmark.hdd_xfs_MWUL_54_directio.works/sec
1095 ± 16% +68.9% 1851 fxmark.hdd_xfs_MWUL_63_directio.idle_sec
1.22 ± 18% +73.2% 2.11 ± 5% fxmark.hdd_xfs_MWUL_63_directio.iowait_sec
18.14 ± 17% +66.9% 30.26 fxmark.hdd_xfs_MWUL_63_directio.irq_sec
18.11 ± 16% +67.5% 30.33 fxmark.hdd_xfs_MWUL_63_directio.real_sec
18.35 ± 14% +64.0% 30.10 fxmark.hdd_xfs_MWUL_63_directio.secs
1.97 ± 10% +73.2% 3.41 ± 5% fxmark.hdd_xfs_MWUL_63_directio.softirq_sec
17.52 ± 7% -30.9% 12.11 ± 3% fxmark.hdd_xfs_MWUL_63_directio.sys_sec
1.57 ± 11% -59.6% 0.63 ± 3% fxmark.hdd_xfs_MWUL_63_directio.sys_util
3.12 ± 6% +158.3% 8.05 fxmark.hdd_xfs_MWUL_63_directio.user_sec
0.28 ± 14% +50.5% 0.42 fxmark.hdd_xfs_MWUL_63_directio.user_util
53295 -24.1% 40431 ± 4% fxmark.hdd_xfs_MWUL_63_directio.works
2981 ± 17% -54.9% 1343 ± 4% fxmark.hdd_xfs_MWUL_63_directio.works/sec
1620 ± 4% +32.5% 2147 fxmark.hdd_xfs_MWUL_72_directio.idle_sec
1.65 ± 9% +27.2% 2.10 ± 6% fxmark.hdd_xfs_MWUL_72_directio.iowait_sec
26.52 ± 4% +26.0% 33.41 fxmark.hdd_xfs_MWUL_72_directio.irq_sec
23.30 ± 4% +31.3% 30.60 fxmark.hdd_xfs_MWUL_72_directio.real_sec
23.68 ± 3% +28.3% 30.38 fxmark.hdd_xfs_MWUL_72_directio.secs
2.87 ± 7% +23.7% 3.55 ± 6% fxmark.hdd_xfs_MWUL_72_directio.softirq_sec
18.45 -48.5% 9.49 ± 2% fxmark.hdd_xfs_MWUL_72_directio.sys_sec
1.10 ± 2% -60.9% 0.43 ± 2% fxmark.hdd_xfs_MWUL_72_directio.sys_util
0.22 ± 5% -20.8% 0.17 ± 2% fxmark.hdd_xfs_MWUL_72_directio.user_util
54061 -32.8% 36335 ± 4% fxmark.hdd_xfs_MWUL_72_directio.works
2285 ± 3% -47.7% 1196 ± 5% fxmark.hdd_xfs_MWUL_72_directio.works/sec
41.05 ± 8% +160.5% 106.96 ± 5% fxmark.hdd_xfs_MWUL_9_directio.idle_sec
72.69 ± 2% +23.1% 89.45 fxmark.hdd_xfs_MWUL_9_directio.idle_util
0.40 ± 15% +90.6% 0.76 ± 22% fxmark.hdd_xfs_MWUL_9_directio.iowait_sec
1.37 ± 5% +62.1% 2.22 ± 5% fxmark.hdd_xfs_MWUL_9_directio.irq_sec
2.44 -23.6% 1.86 fxmark.hdd_xfs_MWUL_9_directio.irq_util
6.39 ± 6% +109.3% 13.38 ± 5% fxmark.hdd_xfs_MWUL_9_directio.real_sec
6.15 ± 7% +113.1% 13.11 ± 5% fxmark.hdd_xfs_MWUL_9_directio.secs
0.29 ± 10% +61.7% 0.46 ± 15% fxmark.hdd_xfs_MWUL_9_directio.softirq_sec
0.51 ± 5% -23.8% 0.39 ± 11% fxmark.hdd_xfs_MWUL_9_directio.softirq_util
12.36 -35.6% 7.95 ± 2% fxmark.hdd_xfs_MWUL_9_directio.sys_sec
22.00 ± 6% -69.7% 6.67 ± 5% fxmark.hdd_xfs_MWUL_9_directio.sys_util
0.93 ± 3% +26.3% 1.18 fxmark.hdd_xfs_MWUL_9_directio.user_sec
1.66 ± 7% -40.6% 0.99 ± 3% fxmark.hdd_xfs_MWUL_9_directio.user_util
8441 ± 7% -53.2% 3953 ± 6% fxmark.hdd_xfs_MWUL_9_directio.works/sec
320.17 +60.3% 513.37 fxmark.time.elapsed_time
320.17 +60.3% 513.37 fxmark.time.elapsed_time.max
18.75 ± 2% -44.0% 10.50 ± 4% fxmark.time.percent_of_cpu_this_job_got
51.67 -15.0% 43.92 fxmark.time.system_time
9.92 +29.6% 12.86 ± 12% fxmark.time.user_time
90949 -18.0% 74622 ± 2% fxmark.time.voluntary_context_switches
1800960 +24.1% 2235798 numa-numastat.node0.local_node
1800905 +24.1% 2235754 numa-numastat.node0.numa_hit
403.29 +47.5% 594.80 uptime.boot
40880 ± 2% +13.9% 46559 uptime.idle
1.931e+10 +31.8% 2.545e+10 cpuidle.C1.time
34582175 +34.3% 46448784 cpuidle.C1.usage
10434 ± 2% +99.5% 20820 ± 47% cpuidle.POLL.usage
73.07 +9.9% 80.28 iostat.cpu.idle
16.14 ± 2% -24.5% 12.19 iostat.cpu.system
2.87 ± 3% -20.3% 2.29 ± 8% iostat.cpu.user
0.27 ± 4% +0.1 0.35 ± 3% mpstat.cpu.all.iowait%
2.21 -0.2 1.98 mpstat.cpu.all.irq%
15.33 -4.2 11.09 mpstat.cpu.all.sys%
2.98 ± 2% -0.6 2.35 ± 8% mpstat.cpu.all.usr%
73.75 +9.5% 80.75 vmstat.cpu.id
104.75 ± 3% +730.8% 870.25 vmstat.io.bi
10026 -10.7% 8950 vmstat.io.bo
2.50 ± 20% -60.0% 1.00 vmstat.procs.r
14156 -46.2% 7616 ± 2% vmstat.system.cs
110196 -15.8% 92836 vmstat.system.in
7013 ± 22% -72.1% 1954 ± 2% meminfo.Active
6994 ± 22% -72.3% 1939 ± 2% meminfo.Active(anon)
417797 -10.7% 373172 meminfo.Committed_AS
360001 -10.0% 324157 meminfo.Inactive
330962 -10.5% 296339 meminfo.Inactive(anon)
2896120 -9.9% 2610848 meminfo.Memused
628.00 ±123% +146.9% 1550 ± 35% meminfo.Mlocked
73641 ± 9% -39.2% 44810 ± 3% meminfo.Shmem
14088 -37.6% 8796 meminfo.max_used_kB
6985 ± 20% -71.9% 1963 ± 2% numa-meminfo.node0.Active
6966 ± 20% -72.0% 1948 ± 2% numa-meminfo.node0.Active(anon)
359858 -10.0% 323999 numa-meminfo.node0.Inactive
330991 -10.5% 296278 numa-meminfo.node0.Inactive(anon)
85528 +13.5% 97113 numa-meminfo.node0.KReclaimable
2286876 -12.5% 2001442 numa-meminfo.node0.MemUsed
358.75 ±122% +147.0% 886.00 ± 35% numa-meminfo.node0.Mlocked
85528 +13.5% 97113 numa-meminfo.node0.SReclaimable
73548 ± 9% -39.1% 44798 ± 3% numa-meminfo.node0.Shmem
1777 ± 22% -72.6% 486.50 ± 2% numa-vmstat.node0.nr_active_anon
206547 +40.0% 289132 numa-vmstat.node0.nr_dirtied
114.25 ± 3% -32.6% 77.00 ± 3% numa-vmstat.node0.nr_dirty
82741 -10.5% 74088 numa-vmstat.node0.nr_inactive_anon
89.00 ±124% +148.0% 220.75 ± 35% numa-vmstat.node0.nr_mlock
18389 ± 9% -39.1% 11191 ± 3% numa-vmstat.node0.nr_shmem
21358 +13.7% 24289 numa-vmstat.node0.nr_slab_reclaimable
206423 +40.0% 289069 numa-vmstat.node0.nr_written
1777 ± 22% -72.6% 486.50 ± 2% numa-vmstat.node0.nr_zone_active_anon
82741 -10.5% 74088 numa-vmstat.node0.nr_zone_inactive_anon
133.00 ± 17% -44.4% 74.00 numa-vmstat.node0.nr_zone_write_pending
66.50 ±124% +148.5% 165.25 ± 36% numa-vmstat.node1.nr_mlock
1793 ± 21% -72.8% 488.00 ± 2% proc-vmstat.nr_active_anon
66106 -4.0% 63456 proc-vmstat.nr_anon_pages
372844 +46.1% 544658 proc-vmstat.nr_dirtied
123.75 ± 4% -36.6% 78.50 ± 2% proc-vmstat.nr_dirty
291692 -2.5% 284309 proc-vmstat.nr_file_pages
82727 -10.5% 74074 proc-vmstat.nr_inactive_anon
7077 -3.2% 6849 proc-vmstat.nr_inactive_file
40483 -2.0% 39683 proc-vmstat.nr_kernel_stack
9615 -4.5% 9182 proc-vmstat.nr_mapped
157.50 ±123% +146.8% 388.75 ± 35% proc-vmstat.nr_mlock
1289 -6.1% 1210 proc-vmstat.nr_page_table_pages
18508 ± 9% -39.3% 11227 ± 3% proc-vmstat.nr_shmem
25906 +10.3% 28565 proc-vmstat.nr_slab_reclaimable
50633 -4.6% 48309 proc-vmstat.nr_slab_unreclaimable
372844 +46.1% 544658 proc-vmstat.nr_written
1793 ± 21% -72.8% 488.00 ± 2% proc-vmstat.nr_zone_active_anon
82727 -10.5% 74074 proc-vmstat.nr_zone_inactive_anon
7077 -3.2% 6849 proc-vmstat.nr_zone_inactive_file
149.50 -35.1% 97.00 proc-vmstat.nr_zone_write_pending
1826076 +23.8% 2260899 proc-vmstat.numa_hit
1826074 +23.8% 2260897 proc-vmstat.numa_local
51102 ± 50% +60.6% 82068 ± 21% proc-vmstat.numa_pte_updates
22291 ± 10% -54.4% 10166 ± 5% proc-vmstat.pgactivate
2106909 +23.9% 2610405 proc-vmstat.pgalloc_normal
22910 ± 11% -54.2% 10504 ± 4% proc-vmstat.pgdeactivate
1251675 +41.6% 1772890 proc-vmstat.pgfault
2087918 +24.7% 2603980 proc-vmstat.pgfree
33061 ± 3% +1233.1% 440746 proc-vmstat.pgpgin
3148495 +43.8% 4528933 proc-vmstat.pgpgout
122451 +27.1% 155697 proc-vmstat.pgreuse
31321 +0.8% 31582 proc-vmstat.pgrotated
1488940 +13.0% 1682530 ± 3% proc-vmstat.slabs_scanned
3749376 +37.8% 5168256 proc-vmstat.unevictable_pgs_scanned
26326 ±145% +382.3% 126980 ± 49% sched_debug.cfs_rq:/.load.min
288.16 ± 38% +217.8% 915.64 ± 21% sched_debug.cfs_rq:/.load_avg.avg
39.00 ±129% +1643.2% 679.83 ± 28% sched_debug.cfs_rq:/.load_avg.min
119.17 ± 82% +218.5% 379.58 ± 4% sched_debug.cfs_rq:/.runnable_avg.min
84.17 ± 59% +116.2% 181.94 ± 18% sched_debug.cfs_rq:/.util_avg.min
19.08 ± 64% +461.0% 107.06 ± 34% sched_debug.cfs_rq:/.util_est_enqueued.avg
0.12 ±110% +63100.0% 79.00 ± 23% sched_debug.cfs_rq:/.util_est_enqueued.min
1245397 ± 3% -10.5% 1114348 ± 4% sched_debug.cpu.avg_idle.avg
3045705 ± 9% -16.5% 2544394 ± 14% sched_debug.cpu.avg_idle.max
310637 ± 7% -19.0% 251467 ± 13% sched_debug.cpu.avg_idle.stddev
232743 +38.0% 321220 sched_debug.cpu.clock.avg
232806 +38.0% 321262 sched_debug.cpu.clock.max
232677 +38.0% 321174 sched_debug.cpu.clock.min
36.34 ± 9% -30.7% 25.17 sched_debug.cpu.clock.stddev
229323 +37.4% 315044 sched_debug.cpu.clock_task.avg
230157 +37.1% 315627 sched_debug.cpu.clock_task.max
222335 +39.1% 309293 sched_debug.cpu.clock_task.min
1333 ± 8% -13.7% 1150 sched_debug.cpu.clock_task.stddev
1684 ± 60% +91.0% 3217 ± 14% sched_debug.cpu.curr->pid.avg
8597 ± 6% +25.7% 10802 ± 3% sched_debug.cpu.curr->pid.max
674102 ± 3% -8.5% 616685 ± 2% sched_debug.cpu.max_idle_balance_cost.avg
1757935 ± 9% -23.6% 1343290 ± 8% sched_debug.cpu.max_idle_balance_cost.max
135930 ± 8% -31.5% 93095 ± 18% sched_debug.cpu.max_idle_balance_cost.stddev
0.00 ± 14% -38.1% 0.00 ± 2% sched_debug.cpu.next_balance.stddev
0.27 ± 20% -16.5% 0.23 ± 14% sched_debug.cpu.nr_running.stddev
53415 ± 28% +48.1% 79096 ± 2% sched_debug.cpu.nr_switches.avg
41869 ± 35% +69.6% 70996 ± 2% sched_debug.cpu.nr_switches.min
12912 ± 5% -44.5% 7162 ± 11% sched_debug.cpu.nr_switches.stddev
-0.59 +1633.7% -10.17 sched_debug.cpu.nr_uninterruptible.avg
60.92 ± 7% -32.5% 41.11 ± 13% sched_debug.cpu.nr_uninterruptible.max
232666 +38.0% 321157 sched_debug.cpu_clk
232008 +38.1% 320480 sched_debug.ktime
233058 +38.0% 321580 sched_debug.sched_clk
0.94 ± 8% -42.7% 0.54 ± 5% perf-stat.i.MPKI
24556955 ± 4% -40.4% 14638193 ± 3% perf-stat.i.branch-instructions
0.22 ± 5% -0.1 0.13 ± 5% perf-stat.i.branch-miss-rate%
1840133 ± 5% -39.9% 1106329 ± 4% perf-stat.i.branch-misses
0.43 ± 5% -0.2 0.25 ± 4% perf-stat.i.cache-miss-rate%
531501 ± 6% -42.0% 308063 ± 4% perf-stat.i.cache-misses
3678689 ± 6% -42.1% 2130446 ± 4% perf-stat.i.cache-references
13574 -46.4% 7282 ± 2% perf-stat.i.context-switches
0.35 ± 8% -42.7% 0.20 ± 6% perf-stat.i.cpi
51423 -14.3% 44085 perf-stat.i.cpu-clock
1.365e+09 ± 6% -42.1% 7.896e+08 ± 4% perf-stat.i.cpu-cycles
138.23 -9.4% 125.29 perf-stat.i.cpu-migrations
76.63 ± 5% -41.3% 44.98 ± 5% perf-stat.i.cycles-between-cache-misses
0.04 ± 7% -0.0 0.03 ± 5% perf-stat.i.iTLB-load-miss-rate%
1748496 ± 6% -42.0% 1014233 ± 4% perf-stat.i.iTLB-load-misses
1.175e+08 ± 4% -40.6% 69775785 ± 3% perf-stat.i.iTLB-loads
1.177e+08 ± 4% -40.7% 69825913 ± 3% perf-stat.i.instructions
1.99 ± 4% -39.9% 1.19 ± 4% perf-stat.i.instructions-per-iTLB-miss
0.00 ± 4% -39.7% 0.00 ± 3% perf-stat.i.ipc
3.04 ± 4% -32.7% 2.05 ± 2% perf-stat.i.major-faults
0.00 ± 6% -42.1% 0.00 ± 4% perf-stat.i.metric.GHz
0.43 -5.2% 0.41 perf-stat.i.metric.K/sec
0.51 ± 4% -40.5% 0.30 ± 3% perf-stat.i.metric.M/sec
3573 -9.7% 3227 perf-stat.i.minor-faults
3576 -9.7% 3229 perf-stat.i.page-faults
51423 -14.3% 44085 perf-stat.i.task-clock
25744212 ± 4% -39.8% 15500031 ± 4% perf-stat.ps.branch-instructions
1925452 ± 5% -39.3% 1169553 ± 5% perf-stat.ps.branch-misses
557154 ± 6% -41.5% 325974 ± 5% perf-stat.ps.cache-misses
3858190 ± 6% -41.5% 2255512 ± 4% perf-stat.ps.cache-references
13464 -46.1% 7250 ± 2% perf-stat.ps.context-switches
51872 -14.4% 44389 perf-stat.ps.cpu-clock
1.431e+09 ± 6% -41.6% 8.361e+08 ± 5% perf-stat.ps.cpu-cycles
138.23 -9.3% 125.33 perf-stat.ps.cpu-migrations
1832019 ± 5% -41.4% 1072847 ± 5% perf-stat.ps.iTLB-load-misses
1.232e+08 ± 4% -40.0% 73886028 ± 4% perf-stat.ps.iTLB-loads
1.234e+08 ± 4% -40.1% 73943984 ± 4% perf-stat.ps.instructions
3.04 ± 5% -32.7% 2.04 ± 2% perf-stat.ps.major-faults
3560 -9.6% 3220 perf-stat.ps.minor-faults
3563 -9.6% 3222 perf-stat.ps.page-faults
51872 -14.4% 44389 perf-stat.ps.task-clock
3110 -9.7% 2810 slabinfo.Acpi-Parse.active_objs
3416 -19.2% 2759 slabinfo.Acpi-State.active_objs
3746 -15.0% 3183 slabinfo.Acpi-State.num_objs
925.00 ± 4% -12.4% 810.00 ± 2% slabinfo.PING.active_objs
11210 -10.6% 10018 ± 4% slabinfo.anon_vma.active_objs
12358 -10.8% 11026 ± 3% slabinfo.anon_vma.num_objs
23170 ± 2% -12.0% 20396 ± 4% slabinfo.anon_vma_chain.active_objs
26327 -11.0% 23441 ± 3% slabinfo.anon_vma_chain.num_objs
11953 ± 4% -14.3% 10247 ± 2% slabinfo.ep_head.active_objs
14940 ± 4% -11.1% 13276 ± 3% slabinfo.ep_head.num_objs
13557 -13.1% 11779 slabinfo.filp.active_objs
968.00 -11.9% 852.50 slabinfo.filp.active_slabs
15496 -11.9% 13645 slabinfo.filp.num_objs
968.00 -11.9% 852.50 slabinfo.filp.num_slabs
38642 +27.7% 49345 ± 4% slabinfo.kmalloc-16.active_objs
20449 -24.6% 15415 slabinfo.kmalloc-512.active_objs
2715 -23.7% 2072 slabinfo.kmalloc-512.active_slabs
21722 -23.7% 16583 slabinfo.kmalloc-512.num_objs
2715 -23.7% 2072 slabinfo.kmalloc-512.num_slabs
50680 ± 2% -13.0% 44084 slabinfo.kmalloc-8.active_objs
16931 ± 5% -24.8% 12739 ± 5% slabinfo.kmalloc-96.active_objs
22541 ± 3% -17.4% 18608 slabinfo.kmalloc-96.num_objs
17837 -10.1% 16027 slabinfo.lsm_file_cache.active_objs
1100 -11.8% 971.00 slabinfo.mm_struct.active_objs
1774 ± 2% +10.6% 1961 ± 2% slabinfo.numa_policy.active_objs
1805 ± 2% +10.2% 1990 ± 2% slabinfo.numa_policy.num_objs
4879 ± 2% -12.3% 4278 slabinfo.pde_opener.active_objs
5328 ± 2% -9.9% 4802 slabinfo.pde_opener.num_objs
4362 ± 2% -12.5% 3818 slabinfo.pid.active_objs
2941 ± 5% -26.9% 2151 ± 3% slabinfo.proc_inode_cache.active_objs
2990 ± 4% -26.2% 2205 ± 3% slabinfo.proc_inode_cache.num_objs
2011 -16.8% 1673 slabinfo.seq_file.active_objs
2238 -13.7% 1931 slabinfo.seq_file.num_objs
4692 ± 3% -15.5% 3965 ± 7% slabinfo.skbuff_head_cache.active_objs
5106 ± 4% -12.6% 4461 ± 6% slabinfo.skbuff_head_cache.num_objs
2184 ± 2% -7.9% 2011 slabinfo.sock_inode_cache.active_objs
19406 -18.9% 15740 slabinfo.vm_area_struct.active_objs
981.25 -18.8% 797.00 slabinfo.vm_area_struct.active_slabs
19639 -18.8% 15944 slabinfo.vm_area_struct.num_objs
981.25 -18.8% 797.00 slabinfo.vm_area_struct.num_slabs
2688 ± 3% +22.5% 3293 ± 4% slabinfo.xfs_buf.active_objs
2812 ± 2% +20.6% 3392 ± 4% slabinfo.xfs_buf.num_objs
28507 +35.9% 38734 slabinfo.xfs_ili.active_objs
696.75 +32.9% 925.75 slabinfo.xfs_ili.active_slabs
29282 +32.9% 38901 slabinfo.xfs_ili.num_objs
696.75 +32.9% 925.75 slabinfo.xfs_ili.num_slabs
28127 +35.5% 38119 slabinfo.xfs_inode.active_objs
898.25 +33.4% 1198 slabinfo.xfs_inode.active_slabs
28759 +33.4% 38356 slabinfo.xfs_inode.num_objs
898.25 +33.4% 1198 slabinfo.xfs_inode.num_slabs
57760 ± 2% +70.5% 98499 softirqs.BLOCK
58500 ± 16% +42.2% 83207 ± 20% softirqs.CPU0.RCU
35699 ± 2% +61.0% 57478 ± 6% softirqs.CPU0.SCHED
44274 ± 25% +59.6% 70673 ± 23% softirqs.CPU1.RCU
33946 ± 3% +66.8% 56609 ± 5% softirqs.CPU1.SCHED
31426 ± 20% +73.3% 54474 ± 27% softirqs.CPU10.RCU
28279 ± 4% +52.4% 43095 ± 3% softirqs.CPU10.SCHED
33260 ± 22% +60.5% 53398 ± 25% softirqs.CPU11.RCU
28809 +58.4% 45624 softirqs.CPU11.SCHED
31722 ± 19% +70.2% 53985 ± 28% softirqs.CPU12.RCU
27759 ± 3% +57.1% 43599 ± 3% softirqs.CPU12.SCHED
32702 ± 17% +57.5% 51508 ± 24% softirqs.CPU13.RCU
27984 ± 6% +61.0% 45043 ± 3% softirqs.CPU13.SCHED
33145 ± 26% +66.3% 55125 ± 27% softirqs.CPU14.RCU
28978 ± 3% +56.7% 45417 ± 8% softirqs.CPU14.SCHED
31291 ± 16% +65.1% 51673 ± 25% softirqs.CPU15.RCU
27951 ± 2% +60.3% 44814 ± 3% softirqs.CPU15.SCHED
28386 ± 9% +73.9% 49377 ± 27% softirqs.CPU16.RCU
26701 ± 4% +58.5% 42328 ± 4% softirqs.CPU16.SCHED
29052 ± 11% +72.1% 50007 ± 26% softirqs.CPU17.RCU
26059 ± 3% +67.9% 43753 ± 4% softirqs.CPU17.SCHED
27787 ± 17% +63.1% 45321 ± 25% softirqs.CPU18.RCU
25183 ± 3% +59.2% 40084 softirqs.CPU18.SCHED
27646 ± 19% +65.1% 45633 ± 27% softirqs.CPU19.RCU
25831 ± 2% +52.8% 39471 softirqs.CPU19.SCHED
39148 ± 22% +69.3% 66263 ± 26% softirqs.CPU2.RCU
32676 ± 6% +72.6% 56394 softirqs.CPU2.SCHED
28023 ± 19% +61.9% 45378 ± 25% softirqs.CPU20.RCU
25733 ± 4% +54.8% 39826 ± 3% softirqs.CPU20.SCHED
28035 ± 19% +63.1% 45727 ± 25% softirqs.CPU21.RCU
25614 ± 3% +58.5% 40611 softirqs.CPU21.SCHED
27522 ± 18% +66.3% 45780 ± 24% softirqs.CPU22.RCU
24049 ± 4% +58.5% 38112 ± 4% softirqs.CPU22.SCHED
27996 ± 22% +61.4% 45191 ± 26% softirqs.CPU23.RCU
25179 ± 5% +52.8% 38474 ± 5% softirqs.CPU23.SCHED
27601 ± 18% +64.9% 45512 ± 27% softirqs.CPU24.RCU
24667 ± 6% +61.1% 39750 ± 2% softirqs.CPU24.SCHED
27919 ± 20% +62.1% 45263 ± 26% softirqs.CPU25.RCU
25040 +61.2% 40369 ± 3% softirqs.CPU25.SCHED
27946 ± 19% +60.8% 44937 ± 26% softirqs.CPU26.RCU
23068 ± 5% +57.6% 36345 ± 2% softirqs.CPU26.SCHED
24703 ± 21% +57.2% 38836 ± 25% softirqs.CPU27.RCU
22919 +50.5% 34483 ± 5% softirqs.CPU27.SCHED
24695 ± 20% +58.8% 39218 ± 26% softirqs.CPU28.RCU
22944 ± 3% +47.2% 33781 ± 2% softirqs.CPU28.SCHED
24751 ± 21% +58.3% 39172 ± 26% softirqs.CPU29.RCU
21666 ± 4% +62.2% 35150 ± 2% softirqs.CPU29.SCHED
38389 ± 19% +70.4% 65401 ± 26% softirqs.CPU3.RCU
32635 ± 3% +71.6% 56011 softirqs.CPU3.SCHED
24371 ± 18% +56.5% 38130 ± 25% softirqs.CPU30.RCU
22916 ± 6% +55.0% 35517 ± 2% softirqs.CPU30.SCHED
24331 ± 21% +60.1% 38953 ± 25% softirqs.CPU31.RCU
22808 +48.8% 33946 ± 7% softirqs.CPU31.SCHED
23516 ± 20% +54.3% 36290 ± 24% softirqs.CPU32.RCU
23198 ± 3% +51.3% 35091 softirqs.CPU32.SCHED
22882 ± 23% +60.2% 36650 ± 24% softirqs.CPU33.RCU
22721 ± 3% +56.2% 35484 softirqs.CPU33.SCHED
23690 ± 19% +54.1% 36512 ± 24% softirqs.CPU34.RCU
21475 ± 3% +58.1% 33949 softirqs.CPU34.SCHED
23621 ± 20% +50.6% 35584 ± 23% softirqs.CPU35.RCU
22680 ± 4% +47.3% 33399 ± 2% softirqs.CPU35.SCHED
19209 ± 6% +42.1% 27303 ± 9% softirqs.CPU36.SCHED
20836 ± 16% +52.0% 31676 ± 24% softirqs.CPU37.RCU
19075 ± 9% +49.9% 28599 ± 2% softirqs.CPU37.SCHED
20739 ± 16% +53.5% 31837 ± 24% softirqs.CPU38.RCU
20169 ± 2% +31.7% 26562 ± 11% softirqs.CPU38.SCHED
20598 ± 15% +52.4% 31394 ± 22% softirqs.CPU39.RCU
19729 ± 7% +46.2% 28846 ± 4% softirqs.CPU39.SCHED
34472 ± 17% +73.9% 59952 ± 26% softirqs.CPU4.RCU
30931 ± 3% +61.7% 50001 ± 4% softirqs.CPU4.SCHED
20511 ± 20% +53.8% 31541 ± 24% softirqs.CPU40.RCU
19047 ± 4% +58.1% 30106 softirqs.CPU40.SCHED
20810 ± 19% +55.2% 32307 ± 21% softirqs.CPU41.RCU
19179 ± 2% +48.5% 28474 ± 3% softirqs.CPU41.SCHED
20575 ± 18% +53.4% 31562 ± 24% softirqs.CPU42.RCU
17641 ± 7% +59.8% 28196 ± 7% softirqs.CPU42.SCHED
20716 ± 18% +52.3% 31542 ± 23% softirqs.CPU43.RCU
18565 ± 3% +56.9% 29136 ± 2% softirqs.CPU43.SCHED
20725 ± 18% +53.7% 31844 ± 23% softirqs.CPU44.RCU
15683 ± 6% +29.2% 20263 ± 6% softirqs.CPU44.SCHED
17744 ± 15% +39.4% 24734 ± 24% softirqs.CPU45.RCU
16409 ± 5% +38.3% 22694 softirqs.CPU45.SCHED
16863 ± 17% +44.4% 24348 ± 23% softirqs.CPU46.RCU
16649 ± 6% +31.5% 21894 ± 7% softirqs.CPU46.SCHED
16971 ± 18% +44.2% 24479 ± 23% softirqs.CPU47.RCU
15797 ± 8% +44.8% 22872 ± 2% softirqs.CPU47.SCHED
15535 ± 19% +42.0% 22056 ± 23% softirqs.CPU48.RCU
16167 ± 11% +39.9% 22620 ± 3% softirqs.CPU48.SCHED
15737 ± 18% +42.9% 22481 ± 23% softirqs.CPU49.RCU
16747 ± 3% +37.7% 23056 ± 2% softirqs.CPU49.SCHED
35127 ± 19% +68.7% 59260 ± 25% softirqs.CPU5.RCU
31146 ± 3% +62.0% 50448 ± 3% softirqs.CPU5.SCHED
15574 ± 16% +39.7% 21752 ± 20% softirqs.CPU50.RCU
15909 ± 5% +41.1% 22450 ± 2% softirqs.CPU50.SCHED
15633 ± 17% +41.3% 22084 ± 23% softirqs.CPU51.RCU
16153 ± 2% +40.4% 22674 ± 2% softirqs.CPU51.SCHED
15643 ± 16% +50.0% 23464 ± 23% softirqs.CPU52.RCU
14664 ± 5% +42.8% 20938 ± 6% softirqs.CPU52.SCHED
16338 ± 16% +39.3% 22752 ± 23% softirqs.CPU53.RCU
16607 ± 6% +35.3% 22463 ± 5% softirqs.CPU53.SCHED
11486 ± 19% +43.1% 16437 ± 21% softirqs.CPU55.RCU
11945 ± 8% +31.3% 15687 ± 4% softirqs.CPU55.SCHED
11628 ± 18% +42.2% 16531 ± 22% softirqs.CPU56.RCU
12402 ± 8% +24.7% 15470 ± 8% softirqs.CPU56.SCHED
11683 ± 18% +43.9% 16814 ± 20% softirqs.CPU57.RCU
12627 ± 5% +22.7% 15491 ± 7% softirqs.CPU57.SCHED
11665 ± 20% +47.9% 17251 ± 24% softirqs.CPU58.RCU
11874 ± 5% +31.8% 15646 ± 5% softirqs.CPU58.SCHED
11793 ± 19% +43.6% 16936 ± 21% softirqs.CPU59.RCU
12687 ± 3% +22.2% 15506 ± 6% softirqs.CPU59.SCHED
35383 ± 18% +68.3% 59549 ± 26% softirqs.CPU6.RCU
29867 ± 11% +67.9% 50145 ± 2% softirqs.CPU6.SCHED
11438 ± 19% +47.2% 16833 ± 24% softirqs.CPU60.RCU
12325 ± 5% +25.1% 15416 ± 3% softirqs.CPU60.SCHED
12177 ± 26% +35.4% 16488 ± 22% softirqs.CPU61.RCU
12721 +23.3% 15687 softirqs.CPU61.SCHED
11705 ± 18% +47.9% 17317 ± 17% softirqs.CPU62.RCU
6842 ± 15% +24.8% 8538 ± 16% softirqs.CPU68.RCU
35380 ± 20% +68.3% 59531 ± 27% softirqs.CPU7.RCU
30170 ± 5% +61.6% 48751 ± 4% softirqs.CPU7.SCHED
35353 ± 18% +72.3% 60916 ± 27% softirqs.CPU8.RCU
28662 ± 7% +62.9% 46684 ± 3% softirqs.CPU8.SCHED
31810 ± 20% +68.7% 53657 ± 27% softirqs.CPU9.RCU
27920 ± 3% +56.1% 43588 ± 8% softirqs.CPU9.SCHED
28125 ± 78% +99.8% 56207 ± 34% softirqs.NET_RX
2095626 ± 15% +43.7% 3011041 ± 21% softirqs.RCU
2041634 +36.5% 2787508 softirqs.SCHED
58556 ± 4% +39.0% 81377 ± 10% softirqs.TIMER
0.02 ± 16% -100.0% 0.00 perf-sched.sch_delay.avg.ms.d_alloc_parallel.path_openat.do_filp_open.do_sys_openat2
0.04 ± 11% -20.5% 0.03 ± 7% perf-sched.sch_delay.avg.ms.do_syslog.part.0.kmsg_read.vfs_read
0.03 ± 2% -16.1% 0.02 ± 3% perf-sched.sch_delay.avg.ms.kthread_worker_fn.kthread.ret_from_fork
0.01 ±173% +335.0% 0.02 ± 18% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.__kmalloc.kmem_alloc.xfs_dir_removename
0.44 ± 70% -100.0% 0.00 perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.down_write.xfs_ilock.xfs_create
0.08 ±124% -95.1% 0.00 ±173% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.dput.path_openat.do_filp_open
0.02 ± 40% -77.4% 0.00 ±173% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.security_file_alloc.__alloc_file
0.10 ± 72% -100.0% 0.00 perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.xfs_inobt_init_common.xfs_inobt_init_cursor
0.22 ± 48% -100.0% 0.00 perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.xfs_inode_alloc.xfs_iget
0.01 ± 29% -100.0% 0.00 perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.xfs_trans_alloc.xfs_create
0.12 ± 63% -96.5% 0.00 ±173% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.xfs_trans_alloc.xfs_iomap_write_unwritten
0.13 ±160% -100.0% 0.00 perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.mnt_want_write.path_openat.do_filp_open
0.02 ± 11% -30.8% 0.01 ± 3% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.smpboot_thread_fn.kthread.ret_from_fork
0.01 ± 9% -14.0% 0.01 ± 8% perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.stop_one_cpu.sched_exec.bprm_execve
0.05 ±131% -100.0% 0.00 perf-sched.sch_delay.avg.ms.preempt_schedule_common._cond_resched.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode
0.02 ± 22% -100.0% 0.00 perf-sched.sch_delay.avg.ms.rwsem_down_read_slowpath.xfs_log_commit_cil.__xfs_trans_commit.xfs_create
0.18 ±117% -83.1% 0.03 ± 6% perf-sched.sch_delay.avg.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
0.04 ± 57% -64.8% 0.01 ± 3% perf-sched.sch_delay.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
0.03 ± 29% -36.8% 0.02 ± 6% perf-sched.sch_delay.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
0.03 ± 35% -100.0% 0.00 perf-sched.sch_delay.avg.ms.xfs_log_commit_cil.__xfs_trans_commit.xfs_create.xfs_generic_create
0.02 ± 8% -100.0% 0.00 perf-sched.sch_delay.avg.ms.xfs_log_commit_cil.__xfs_trans_commit.xfs_trans_roll.xfs_dialloc_select_ag
0.05 ± 34% -55.3% 0.02 ± 5% perf-sched.sch_delay.avg.ms.xlog_state_get_iclog_space.xlog_write.xlog_cil_push_work.process_one_work
0.08 ± 51% -100.0% 0.00 perf-sched.sch_delay.max.ms.d_alloc_parallel.path_openat.do_filp_open.do_sys_openat2
0.21 ± 83% -75.1% 0.05 ± 5% perf-sched.sch_delay.max.ms.do_syslog.part.0.kmsg_read.vfs_read
6.37 ±167% -99.1% 0.05 ± 38% perf-sched.sch_delay.max.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
3.20 ± 92% -99.5% 0.01 ± 8% perf-sched.sch_delay.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_call_function_single.[unknown]
0.12 ± 94% -68.3% 0.04 ± 40% perf-sched.sch_delay.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.[unknown]
0.26 ± 93% -86.6% 0.04 ± 22% perf-sched.sch_delay.max.ms.futex_wait_queue_me.futex_wait.do_futex.__x64_sys_futex
0.42 ± 42% -68.3% 0.13 ± 19% perf-sched.sch_delay.max.ms.io_schedule.wait_on_page_bit.wait_on_page_writeback.__filemap_fdatawait_range
0.66 ± 47% -83.0% 0.11 ± 34% perf-sched.sch_delay.max.ms.kthread_worker_fn.kthread.ret_from_fork
0.05 ± 41% -58.2% 0.02 ± 74% perf-sched.sch_delay.max.ms.kthreadd.ret_from_fork
0.01 ±173% +675.0% 0.04 ± 59% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.__kmalloc.kmem_alloc.xfs_dir_removename
3.93 ± 76% -100.0% 0.00 perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.down_write.xfs_ilock.xfs_create
1.37 ±157% -99.7% 0.00 ±173% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.dput.path_openat.do_filp_open
0.02 ± 39% -67.9% 0.01 ±100% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.dput.terminate_walk.path_openat
0.02 ± 23% -84.9% 0.00 ±173% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.__alloc_file.alloc_empty_file
0.02 ± 27% -83.1% 0.00 ±173% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.security_file_alloc.__alloc_file
1.70 ±108% -100.0% 0.00 perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.xfs_inobt_init_common.xfs_inobt_init_cursor
4.29 ± 68% -100.0% 0.00 perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.xfs_inode_alloc.xfs_iget
0.05 ± 84% -100.0% 0.00 perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.xfs_trans_alloc.xfs_create
1.15 ± 68% -99.3% 0.01 ±173% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.xfs_trans_alloc.xfs_iomap_write_unwritten
0.56 ±166% -100.0% 0.00 perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.mnt_want_write.path_openat.do_filp_open
3.85 ± 37% -88.9% 0.43 ± 9% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.smpboot_thread_fn.kthread.ret_from_fork
0.14 ± 16% +392.7% 0.67 ± 55% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.submit_bio_checks.submit_bio_noacct.submit_bio
0.16 ±144% -100.0% 0.00 perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode
0.03 ± 10% -48.1% 0.01 ± 57% perf-sched.sch_delay.max.ms.preempt_schedule_common._cond_resched.wait_for_completion_io.submit_bio_wait.blkdev_issue_flush
0.14 ±131% -100.0% 0.00 perf-sched.sch_delay.max.ms.rwsem_down_read_slowpath.xfs_log_commit_cil.__xfs_trans_commit.xfs_create
0.01 ±100% +498.2% 0.08 ± 34% perf-sched.sch_delay.max.ms.rwsem_down_read_slowpath.xfs_log_commit_cil.__xfs_trans_commit.xfs_remove
25.65 ±154% -99.6% 0.11 ± 50% perf-sched.sch_delay.max.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
1.22 ±127% -97.3% 0.03 ± 12% perf-sched.sch_delay.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
0.19 ± 96% -71.0% 0.06 ± 35% perf-sched.sch_delay.max.ms.schedule_timeout.io_schedule_timeout.wait_for_completion_io.submit_bio_wait
12.70 ± 80% -99.4% 0.08 ± 40% perf-sched.sch_delay.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
0.18 ± 24% +87.9% 0.33 ± 22% perf-sched.sch_delay.max.ms.schedule_timeout.wait_for_completion.__flush_work.xlog_cil_force_lsn
2.34 ±133% -100.0% 0.00 perf-sched.sch_delay.max.ms.xfs_log_commit_cil.__xfs_trans_commit.xfs_create.xfs_generic_create
0.02 ± 5% -100.0% 0.00 perf-sched.sch_delay.max.ms.xfs_log_commit_cil.__xfs_trans_commit.xfs_trans_roll.xfs_dialloc_select_ag
3.92 ± 94% -93.5% 0.26 ± 8% perf-sched.sch_delay.max.ms.xlog_state_get_iclog_space.xlog_write.xlog_cil_push_work.process_one_work
0.27 ± 48% -65.0% 0.09 ± 37% perf-sched.sch_delay.max.ms.xlog_wait_on_iclog.__xfs_log_force_lsn.xfs_log_force_lsn.xfs_file_fsync
0.04 ± 15% +62.4% 0.06 ± 24% perf-sched.sch_delay.max.ms.xlog_wait_on_iclog.xfsaild_push.xfsaild.kthread
29.07 ± 14% +146.2% 71.57 ± 5% perf-sched.total_wait_and_delay.average.ms
76774 ± 13% -58.4% 31919 ± 6% perf-sched.total_wait_and_delay.count.ms
8090 ± 14% +23.3% 9974 perf-sched.total_wait_and_delay.max.ms
29.04 ± 14% +146.3% 71.53 ± 5% perf-sched.total_wait_time.average.ms
8090 ± 14% +23.3% 9974 perf-sched.total_wait_time.max.ms
198.54 ± 23% +35.7% 269.49 ± 3% perf-sched.wait_and_delay.avg.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
12.50 ± 12% +20.7% 15.08 perf-sched.wait_and_delay.avg.ms.kthread_worker_fn.kthread.ret_from_fork
709.11 ±114% -91.9% 57.38 ±173% perf-sched.wait_and_delay.avg.ms.kthreadd.ret_from_fork
2802 ±124% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.preempt_schedule_common._cond_resched.generic_perform_write.__generic_file_write_iter.generic_file_write_iter
13.85 ± 7% +81.4% 25.12 perf-sched.wait_and_delay.avg.ms.preempt_schedule_common._cond_resched.stop_one_cpu.affine_move_task.__set_cpus_allowed_ptr
338.39 ± 36% +61.2% 545.64 perf-sched.wait_and_delay.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
9.45 ± 36% +1401.1% 141.90 ± 4% perf-sched.wait_and_delay.avg.ms.schedule_timeout.__down.down.xfs_buf_lock
151.18 ± 5% +20.3% 181.94 perf-sched.wait_and_delay.avg.ms.worker_thread.kthread.ret_from_fork
8.31 ± 28% +323.2% 35.16 ± 9% perf-sched.wait_and_delay.avg.ms.xlog_grant_head_wait.xlog_grant_head_check.xfs_log_reserve.xfs_trans_reserve
41.75 ± 50% -89.2% 4.50 ± 19% perf-sched.wait_and_delay.count.futex_wait_queue_me.futex_wait.do_futex.__x64_sys_futex
8.50 ± 41% -91.2% 0.75 ±173% perf-sched.wait_and_delay.count.kthreadd.ret_from_fork
8.00 ± 67% -100.0% 0.00 perf-sched.wait_and_delay.count.preempt_schedule_common._cond_resched.generic_perform_write.__generic_file_write_iter.generic_file_write_iter
80.00 ±173% +432.5% 426.00 ± 53% perf-sched.wait_and_delay.count.rcu_gp_kthread.kthread.ret_from_fork
157.75 ± 44% -82.4% 27.75 ± 34% perf-sched.wait_and_delay.count.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
70.25 ± 31% -53.0% 33.00 perf-sched.wait_and_delay.count.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
9376 ± 32% -89.5% 984.50 ± 8% perf-sched.wait_and_delay.count.schedule_timeout.__down.down.xfs_buf_lock
4155 ± 3% -20.5% 3302 ± 2% perf-sched.wait_and_delay.count.worker_thread.kthread.ret_from_fork
5.75 ± 25% -78.3% 1.25 ± 87% perf-sched.wait_and_delay.count.xlog_cil_force_lsn.xfs_log_force.xfsaild_push.xfsaild
46938 ± 13% -71.3% 13491 ± 9% perf-sched.wait_and_delay.count.xlog_grant_head_wait.xlog_grant_head_check.xfs_log_reserve.xfs_trans_reserve
17.75 ± 6% +52.1% 27.00 ± 8% perf-sched.wait_and_delay.count.xlog_wait_on_iclog.xfsaild_push.xfsaild.kthread
2458 ± 59% -66.9% 814.19 ± 77% perf-sched.wait_and_delay.max.ms.futex_wait_queue_me.futex_wait.do_futex.__x64_sys_futex
2761 ± 79% -93.8% 171.23 ±173% perf-sched.wait_and_delay.max.ms.kthreadd.ret_from_fork
6201 ± 48% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.preempt_schedule_common._cond_resched.generic_perform_write.__generic_file_write_iter.generic_file_write_iter
1087 ± 13% +817.6% 9974 perf-sched.wait_and_delay.max.ms.preempt_schedule_common._cond_resched.stop_one_cpu.affine_move_task.__set_cpus_allowed_ptr
417.86 ± 6% +14.5% 478.51 ± 2% perf-sched.wait_and_delay.max.ms.schedule_timeout.__down.down.xfs_buf_lock
217.43 ± 18% -40.3% 129.80 ± 64% perf-sched.wait_and_delay.max.ms.xlog_cil_force_lsn.xfs_log_force.xfsaild_push.xfsaild
417.40 ± 6% +103.9% 850.87 ± 76% perf-sched.wait_and_delay.max.ms.xlog_grant_head_wait.xlog_grant_head_check.xfs_log_reserve.xfs_trans_reserve
198.51 ± 23% +35.8% 269.48 ± 3% perf-sched.wait_time.avg.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
14.75 ±116% -99.6% 0.05 ± 63% perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_call_function_single.[unknown]
17.07 ± 42% -68.8% 5.32 ± 15% perf-sched.wait_time.avg.ms.io_schedule.rq_qos_wait.wbt_wait.__rq_qos_throttle
12.47 ± 12% +20.8% 15.06 perf-sched.wait_time.avg.ms.kthread_worker_fn.kthread.ret_from_fork
709.08 ±114% -91.9% 57.37 ±173% perf-sched.wait_time.avg.ms.kthreadd.ret_from_fork
1.40 ± 92% -100.0% 0.00 perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.__kmalloc.kmem_alloc.xfs_dir_createname
1.16 ±173% +1621.7% 19.90 ± 55% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.__kmalloc.kmem_alloc.xfs_dir_removename
195.02 ±173% -100.0% 0.00 perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
18.12 ±100% -100.0% 0.00 perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.down_write.xfs_ilock.xfs_create
0.30 ± 75% -89.7% 0.03 ±100% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.dput.__fput.task_work_run
10.04 ± 41% -100.0% 0.00 perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.dput.path_openat.do_filp_open
5.12 ±156% -100.0% 0.00 perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.dput.terminate_walk.path_openat
2802 ±124% -100.0% 0.00 perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.generic_perform_write.__generic_file_write_iter.generic_file_write_iter
1.41 ± 77% -100.0% 0.00 perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.__alloc_file.alloc_empty_file
21.64 ±172% -100.0% 0.00 perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.getname_flags.do_sys_openat2
19.45 ± 59% -100.0% 0.00 perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.xfs_inobt_init_common.xfs_inobt_init_cursor
6.87 ± 45% -100.0% 0.00 perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.xfs_inode_alloc.xfs_iget
21.41 ±164% -100.0% 0.00 perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.xfs_inode_item_init.xfs_trans_ijoin
8.42 ± 75% -100.0% 0.00 perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.xfs_trans_alloc.xfs_create
39.19 ± 75% -99.0% 0.40 ±173% perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.xfs_trans_alloc.xfs_iomap_write_unwritten
1.97 ± 43% -100.0% 0.00 perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.mnt_want_write.path_openat.do_filp_open
13.85 ± 7% +81.4% 25.12 perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.stop_one_cpu.affine_move_task.__set_cpus_allowed_ptr
15.84 ±103% -100.0% 0.00 perf-sched.wait_time.avg.ms.preempt_schedule_common._cond_resched.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode
33.91 ± 10% -100.0% 0.00 perf-sched.wait_time.avg.ms.rwsem_down_read_slowpath.xfs_log_commit_cil.__xfs_trans_commit.xfs_create
12.45 ±109% +355.3% 56.70 ± 9% perf-sched.wait_time.avg.ms.rwsem_down_read_slowpath.xfs_log_commit_cil.__xfs_trans_commit.xfs_remove
338.35 ± 36% +61.3% 545.63 perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
9.42 ± 37% +1405.4% 141.85 ± 4% perf-sched.wait_time.avg.ms.schedule_timeout.__down.down.xfs_buf_lock
0.02 ± 69% +104.9% 0.04 ± 45% perf-sched.wait_time.avg.ms.schedule_timeout.khugepaged.kthread.ret_from_fork
9.40 ± 4% -48.7% 4.83 ± 9% perf-sched.wait_time.avg.ms.schedule_timeout.wait_for_completion.__flush_work.xlog_cil_force_lsn
0.02 ± 63% -69.8% 0.00 ± 68% perf-sched.wait_time.avg.ms.wait_for_partner.fifo_open.do_dentry_open.path_openat
151.11 ± 5% +20.4% 181.88 perf-sched.wait_time.avg.ms.worker_thread.kthread.ret_from_fork
4.22 ± 31% -100.0% 0.00 perf-sched.wait_time.avg.ms.xfs_log_commit_cil.__xfs_trans_commit.xfs_create.xfs_generic_create
4.42 ± 40% -100.0% 0.00 perf-sched.wait_time.avg.ms.xfs_log_commit_cil.__xfs_trans_commit.xfs_trans_roll.xfs_dialloc_select_ag
8.28 ± 28% +324.1% 35.13 ± 9% perf-sched.wait_time.avg.ms.xlog_grant_head_wait.xlog_grant_head_check.xfs_log_reserve.xfs_trans_reserve
23.53 ± 3% +17.5% 27.65 ± 2% perf-sched.wait_time.avg.ms.xlog_state_get_iclog_space.xlog_write.xlog_cil_push_work.process_one_work
254.85 ± 60% -50.9% 125.21 perf-sched.wait_time.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
11.03 ±167% -99.2% 0.09 ±119% perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_exc_page_fault.[unknown]
395.08 ± 92% -100.0% 0.20 ± 50% perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_call_function_single.[unknown]
2458 ± 59% -66.9% 814.16 ± 77% perf-sched.wait_time.max.ms.futex_wait_queue_me.futex_wait.do_futex.__x64_sys_futex
2761 ± 79% -93.8% 171.22 ±173% perf-sched.wait_time.max.ms.kthreadd.ret_from_fork
5.93 ±100% -100.0% 0.00 perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.__kmalloc.kmem_alloc.xfs_dir_createname
1.78 ±173% +9342.2% 168.40 ± 90% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.__kmalloc.kmem_alloc.xfs_dir_removename
1948 ±173% -100.0% 0.00 perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
180.08 ± 97% -100.0% 0.00 perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.down_write.xfs_ilock.xfs_create
1.36 ±100% -97.8% 0.03 ±100% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.dput.__fput.task_work_run
134.40 ± 81% -100.0% 0.00 perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.dput.path_openat.do_filp_open
15.21 ±157% -100.0% 0.00 perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.dput.terminate_walk.path_openat
6201 ± 48% -100.0% 0.00 perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.generic_perform_write.__generic_file_write_iter.generic_file_write_iter
5.31 ± 79% -100.0% 0.00 perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.__alloc_file.alloc_empty_file
21.65 ±172% -100.0% 0.00 perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.getname_flags.do_sys_openat2
275.44 ± 57% -100.0% 0.00 perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.xfs_inobt_init_common.xfs_inobt_init_cursor
130.08 ± 80% -100.0% 0.00 perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.xfs_inode_alloc.xfs_iget
43.26 ±160% -100.0% 0.00 perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.xfs_inode_item_init.xfs_trans_ijoin
38.03 ± 87% -100.0% 0.00 perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.xfs_trans_alloc.xfs_create
446.13 ± 59% -99.8% 0.80 ±173% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.kmem_cache_alloc.xfs_trans_alloc.xfs_iomap_write_unwritten
6.15 ± 45% -100.0% 0.00 perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.mnt_want_write.path_openat.do_filp_open
355.42 ± 43% -86.9% 46.56 ± 70% perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.process_one_work.worker_thread.kthread
1087 ± 13% +817.6% 9974 perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.stop_one_cpu.affine_move_task.__set_cpus_allowed_ptr
56.87 ±114% -100.0% 0.00 perf-sched.wait_time.max.ms.preempt_schedule_common._cond_resched.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode
198.79 ± 16% -100.0% 0.00 perf-sched.wait_time.max.ms.rwsem_down_read_slowpath.xfs_log_commit_cil.__xfs_trans_commit.xfs_create
95.71 ±100% +303.1% 385.76 ± 12% perf-sched.wait_time.max.ms.rwsem_down_read_slowpath.xfs_log_commit_cil.__xfs_trans_commit.xfs_remove
414.09 ± 6% +15.5% 478.10 ± 2% perf-sched.wait_time.max.ms.schedule_timeout.__down.down.xfs_buf_lock
468.62 ± 77% -93.8% 29.28 ± 22% perf-sched.wait_time.max.ms.schedule_timeout.io_schedule_timeout.wait_for_completion_io.submit_bio_wait
0.02 ± 69% +104.9% 0.04 ± 45% perf-sched.wait_time.max.ms.schedule_timeout.khugepaged.kthread.ret_from_fork
294.77 ± 3% -60.0% 117.80 ± 36% perf-sched.wait_time.max.ms.schedule_timeout.wait_for_completion.__flush_work.xlog_cil_force_lsn
31.05 ±115% -100.0% 0.00 perf-sched.wait_time.max.ms.xfs_log_commit_cil.__xfs_trans_commit.xfs_create.xfs_generic_create
8.22 ± 49% -100.0% 0.00 perf-sched.wait_time.max.ms.xfs_log_commit_cil.__xfs_trans_commit.xfs_trans_roll.xfs_dialloc_select_ag
217.41 ± 18% -40.3% 129.78 ± 64% perf-sched.wait_time.max.ms.xlog_cil_force_lsn.xfs_log_force.xfsaild_push.xfsaild
415.85 ± 6% +104.4% 849.85 ± 77% perf-sched.wait_time.max.ms.xlog_grant_head_wait.xlog_grant_head_check.xfs_log_reserve.xfs_trans_reserve
0.55 ± 11% -64.3% 0.20 ± 50% perf-sched.wait_time.max.ms.xlog_wait_on_iclog.__xfs_log_force_lsn.xfs_log_force_lsn.xfs_file_fsync
36285 ± 57% +149.6% 90556 interrupts.180:IR-PCI-MSI.512000-edge.ahci[0000:00:1f.2]
2668 ±104% +955.7% 28172 ±102% interrupts.38:IR-PCI-MSI.4194306-edge.eth0-TxRx-1
506550 +6.4% 538938 interrupts.CAL:Function_call_interrupts
1796 ± 57% +93.6% 3477 ± 2% interrupts.CPU0.180:IR-PCI-MSI.512000-edge.ahci[0000:00:1f.2]
9098 ± 9% +22.8% 11168 ± 4% interrupts.CPU0.CAL:Function_call_interrupts
640984 +60.1% 1026465 interrupts.CPU0.LOC:Local_timer_interrupts
600.50 ± 30% -69.9% 180.75 ± 37% interrupts.CPU0.NMI:Non-maskable_interrupts
600.50 ± 30% -69.9% 180.75 ± 37% interrupts.CPU0.PMI:Performance_monitoring_interrupts
3636 ± 29% +152.0% 9165 ± 53% interrupts.CPU0.RES:Rescheduling_interrupts
90.75 ± 24% +122.0% 201.50 ± 23% interrupts.CPU0.TLB:TLB_shootdowns
5890 ± 57% +178.9% 16429 interrupts.CPU1.180:IR-PCI-MSI.512000-edge.ahci[0000:00:1f.2]
8753 ± 10% +34.3% 11760 ± 8% interrupts.CPU1.CAL:Function_call_interrupts
557692 +67.6% 934794 interrupts.CPU1.LOC:Local_timer_interrupts
2559 ± 18% +93.5% 4952 ± 10% interrupts.CPU1.RES:Rescheduling_interrupts
80.50 ± 37% +169.9% 217.25 ± 13% interrupts.CPU1.TLB:TLB_shootdowns
458081 ± 2% +62.4% 743914 interrupts.CPU10.LOC:Local_timer_interrupts
57.75 ± 9% +65.4% 95.50 ± 6% interrupts.CPU10.TLB:TLB_shootdowns
457813 ± 2% +62.6% 744205 interrupts.CPU11.LOC:Local_timer_interrupts
139.00 ± 22% +65.6% 230.25 ± 14% interrupts.CPU11.RES:Rescheduling_interrupts
1830 ± 94% +948.8% 19201 ±108% interrupts.CPU12.38:IR-PCI-MSI.4194306-edge.eth0-TxRx-1
457869 ± 2% +62.6% 744326 interrupts.CPU12.LOC:Local_timer_interrupts
424.50 ± 50% -58.0% 178.25 ± 31% interrupts.CPU12.NMI:Non-maskable_interrupts
424.50 ± 50% -58.0% 178.25 ± 31% interrupts.CPU12.PMI:Performance_monitoring_interrupts
142.25 ± 19% +40.6% 200.00 ± 8% interrupts.CPU12.RES:Rescheduling_interrupts
457704 ± 2% +62.6% 744120 interrupts.CPU13.LOC:Local_timer_interrupts
122.50 ± 16% +140.6% 294.75 ± 56% interrupts.CPU13.RES:Rescheduling_interrupts
458395 ± 2% +62.5% 744793 interrupts.CPU14.LOC:Local_timer_interrupts
499.25 ± 38% -73.1% 134.50 ± 13% interrupts.CPU14.NMI:Non-maskable_interrupts
499.25 ± 38% -73.1% 134.50 ± 13% interrupts.CPU14.PMI:Performance_monitoring_interrupts
101.75 ± 19% +129.7% 233.75 ± 24% interrupts.CPU14.RES:Rescheduling_interrupts
458051 ± 2% +62.5% 744313 interrupts.CPU15.LOC:Local_timer_interrupts
374.25 ± 60% -66.9% 123.75 ± 5% interrupts.CPU15.NMI:Non-maskable_interrupts
374.25 ± 60% -66.9% 123.75 ± 5% interrupts.CPU15.PMI:Performance_monitoring_interrupts
3577 ± 11% +31.5% 4702 ± 5% interrupts.CPU16.CAL:Function_call_interrupts
458299 ± 2% +62.4% 744369 interrupts.CPU16.LOC:Local_timer_interrupts
319.00 ± 25% -53.0% 150.00 ± 8% interrupts.CPU16.NMI:Non-maskable_interrupts
319.00 ± 25% -53.0% 150.00 ± 8% interrupts.CPU16.PMI:Performance_monitoring_interrupts
121.75 ± 22% +94.0% 236.25 ± 25% interrupts.CPU16.RES:Rescheduling_interrupts
9138 ±173% +473.7% 52422 ± 57% interrupts.CPU17.180:IR-PCI-MSI.512000-edge.ahci[0000:00:1f.2]
458322 ± 2% +62.3% 743806 interrupts.CPU17.LOC:Local_timer_interrupts
271.50 ± 29% +81.9% 493.75 ± 48% interrupts.CPU17.NMI:Non-maskable_interrupts
271.50 ± 29% +81.9% 493.75 ± 48% interrupts.CPU17.PMI:Performance_monitoring_interrupts
112.25 ± 25% +98.0% 222.25 ± 16% interrupts.CPU17.RES:Rescheduling_interrupts
419237 ± 2% +58.9% 666177 interrupts.CPU18.LOC:Local_timer_interrupts
102.50 ± 8% +31.5% 134.75 ± 15% interrupts.CPU18.RES:Rescheduling_interrupts
2923 ± 8% +29.2% 3778 ± 15% interrupts.CPU19.CAL:Function_call_interrupts
419863 ± 2% +58.8% 666693 interrupts.CPU19.LOC:Local_timer_interrupts
468.50 ± 42% -71.3% 134.25 ± 13% interrupts.CPU19.NMI:Non-maskable_interrupts
468.50 ± 42% -71.3% 134.25 ± 13% interrupts.CPU19.PMI:Performance_monitoring_interrupts
8781 ± 6% +42.3% 12499 ± 16% interrupts.CPU2.CAL:Function_call_interrupts
527217 +66.0% 875081 interrupts.CPU2.LOC:Local_timer_interrupts
606.50 ± 40% -76.4% 143.25 ± 10% interrupts.CPU2.NMI:Non-maskable_interrupts
606.50 ± 40% -76.4% 143.25 ± 10% interrupts.CPU2.PMI:Performance_monitoring_interrupts
109.00 ± 41% +177.8% 302.75 ± 30% interrupts.CPU2.TLB:TLB_shootdowns
420071 ± 2% +58.5% 665924 interrupts.CPU20.LOC:Local_timer_interrupts
76.00 ± 35% +104.6% 155.50 ± 14% interrupts.CPU20.RES:Rescheduling_interrupts
419827 ± 2% +59.0% 667725 interrupts.CPU21.LOC:Local_timer_interrupts
475.00 ± 41% -71.4% 135.75 ± 9% interrupts.CPU21.NMI:Non-maskable_interrupts
475.00 ± 41% -71.4% 135.75 ± 9% interrupts.CPU21.PMI:Performance_monitoring_interrupts
92.00 ± 33% +66.6% 153.25 ± 25% interrupts.CPU21.RES:Rescheduling_interrupts
3057 ± 7% +54.6% 4727 ± 7% interrupts.CPU22.CAL:Function_call_interrupts
419911 ± 2% +58.6% 666150 interrupts.CPU22.LOC:Local_timer_interrupts
285.25 ± 24% -52.9% 134.25 ± 6% interrupts.CPU22.NMI:Non-maskable_interrupts
285.25 ± 24% -52.9% 134.25 ± 6% interrupts.CPU22.PMI:Performance_monitoring_interrupts
3413 ± 5% +22.0% 4164 ± 6% interrupts.CPU23.CAL:Function_call_interrupts
419713 ± 2% +58.6% 665517 interrupts.CPU23.LOC:Local_timer_interrupts
354.75 ± 29% -56.6% 154.00 ± 37% interrupts.CPU23.NMI:Non-maskable_interrupts
354.75 ± 29% -56.6% 154.00 ± 37% interrupts.CPU23.PMI:Performance_monitoring_interrupts
419900 ± 2% +58.5% 665698 interrupts.CPU24.LOC:Local_timer_interrupts
421914 +57.9% 666018 interrupts.CPU25.LOC:Local_timer_interrupts
407.25 ± 17% -50.2% 202.75 ± 43% interrupts.CPU25.NMI:Non-maskable_interrupts
407.25 ± 17% -50.2% 202.75 ± 43% interrupts.CPU25.PMI:Performance_monitoring_interrupts
32.50 ± 24% +102.3% 65.75 ± 50% interrupts.CPU25.TLB:TLB_shootdowns
420409 ± 2% +58.4% 666105 interrupts.CPU26.LOC:Local_timer_interrupts
381863 +51.9% 580175 interrupts.CPU27.LOC:Local_timer_interrupts
426.50 ± 51% -71.0% 123.75 ± 9% interrupts.CPU27.NMI:Non-maskable_interrupts
426.50 ± 51% -71.0% 123.75 ± 9% interrupts.CPU27.PMI:Performance_monitoring_interrupts
380677 ± 2% +52.4% 580025 interrupts.CPU28.LOC:Local_timer_interrupts
474.25 ± 45% -69.0% 147.00 ± 39% interrupts.CPU28.NMI:Non-maskable_interrupts
474.25 ± 45% -69.0% 147.00 ± 39% interrupts.CPU28.PMI:Performance_monitoring_interrupts
380642 ± 2% +52.5% 580519 interrupts.CPU29.LOC:Local_timer_interrupts
433.75 ± 58% -63.3% 159.25 ± 32% interrupts.CPU29.NMI:Non-maskable_interrupts
433.75 ± 58% -63.3% 159.25 ± 32% interrupts.CPU29.PMI:Performance_monitoring_interrupts
10.75 ± 41% +25930.2% 2798 ±102% interrupts.CPU3.38:IR-PCI-MSI.4194306-edge.eth0-TxRx-1
523996 +66.9% 874356 interrupts.CPU3.LOC:Local_timer_interrupts
377.25 ± 23% -59.0% 154.50 ± 13% interrupts.CPU3.NMI:Non-maskable_interrupts
377.25 ± 23% -59.0% 154.50 ± 13% interrupts.CPU3.PMI:Performance_monitoring_interrupts
943.00 ± 6% +26.1% 1189 ± 16% interrupts.CPU3.RES:Rescheduling_interrupts
97.25 ± 51% +179.4% 271.75 ± 15% interrupts.CPU3.TLB:TLB_shootdowns
380419 ± 2% +52.6% 580547 interrupts.CPU30.LOC:Local_timer_interrupts
60.75 ± 31% +138.7% 145.00 ± 39% interrupts.CPU30.RES:Rescheduling_interrupts
380846 ± 2% +52.3% 580053 interrupts.CPU31.LOC:Local_timer_interrupts
380984 ± 2% +52.4% 580499 interrupts.CPU32.LOC:Local_timer_interrupts
358.00 ± 42% -57.3% 153.00 ± 35% interrupts.CPU32.NMI:Non-maskable_interrupts
358.00 ± 42% -57.3% 153.00 ± 35% interrupts.CPU32.PMI:Performance_monitoring_interrupts
2459 ± 11% +18.6% 2916 ± 7% interrupts.CPU33.CAL:Function_call_interrupts
381196 ± 2% +52.3% 580727 interrupts.CPU33.LOC:Local_timer_interrupts
604.00 ± 72% -75.2% 149.50 ± 37% interrupts.CPU33.NMI:Non-maskable_interrupts
604.00 ± 72% -75.2% 149.50 ± 37% interrupts.CPU33.PMI:Performance_monitoring_interrupts
2451 ± 9% +38.2% 3387 ± 14% interrupts.CPU34.CAL:Function_call_interrupts
380544 ± 2% +52.5% 580350 interrupts.CPU34.LOC:Local_timer_interrupts
353.25 ± 31% -62.8% 131.50 ± 17% interrupts.CPU34.NMI:Non-maskable_interrupts
353.25 ± 31% -62.8% 131.50 ± 17% interrupts.CPU34.PMI:Performance_monitoring_interrupts
54.75 ± 8% +95.0% 106.75 ± 26% interrupts.CPU34.RES:Rescheduling_interrupts
2366 ± 8% +27.0% 3005 ± 17% interrupts.CPU35.CAL:Function_call_interrupts
380754 ± 2% +52.4% 580385 interrupts.CPU35.LOC:Local_timer_interrupts
416.75 ± 50% -64.5% 147.75 ± 31% interrupts.CPU35.NMI:Non-maskable_interrupts
416.75 ± 50% -64.5% 147.75 ± 31% interrupts.CPU35.PMI:Performance_monitoring_interrupts
58.50 ± 31% +91.0% 111.75 ± 11% interrupts.CPU35.RES:Rescheduling_interrupts
333550 ± 2% +44.6% 482213 interrupts.CPU36.LOC:Local_timer_interrupts
333497 ± 2% +44.7% 482650 interrupts.CPU37.LOC:Local_timer_interrupts
333466 ± 2% +44.6% 482105 interrupts.CPU38.LOC:Local_timer_interrupts
398.75 ± 43% -59.4% 162.00 ± 32% interrupts.CPU38.NMI:Non-maskable_interrupts
398.75 ± 43% -59.4% 162.00 ± 32% interrupts.CPU38.PMI:Performance_monitoring_interrupts
333861 ± 2% +44.4% 482098 interrupts.CPU39.LOC:Local_timer_interrupts
494408 ± 2% +64.7% 814507 interrupts.CPU4.LOC:Local_timer_interrupts
429.25 ± 60% -57.0% 184.50 ± 27% interrupts.CPU4.NMI:Non-maskable_interrupts
429.25 ± 60% -57.0% 184.50 ± 27% interrupts.CPU4.PMI:Performance_monitoring_interrupts
333775 ± 2% +44.4% 482085 interrupts.CPU40.LOC:Local_timer_interrupts
333880 ± 2% +44.4% 482073 interrupts.CPU41.LOC:Local_timer_interrupts
316.25 ± 29% -44.8% 174.50 ± 39% interrupts.CPU41.NMI:Non-maskable_interrupts
316.25 ± 29% -44.8% 174.50 ± 39% interrupts.CPU41.PMI:Performance_monitoring_interrupts
333802 ± 2% +44.5% 482331 interrupts.CPU42.LOC:Local_timer_interrupts
334200 ± 2% +44.3% 482415 interrupts.CPU43.LOC:Local_timer_interrupts
313.75 ± 32% -60.2% 124.75 ± 6% interrupts.CPU43.NMI:Non-maskable_interrupts
313.75 ± 32% -60.2% 124.75 ± 6% interrupts.CPU43.PMI:Performance_monitoring_interrupts
36.50 ± 26% +93.2% 70.50 ± 27% interrupts.CPU43.RES:Rescheduling_interrupts
334102 ± 2% +44.4% 482397 interrupts.CPU44.LOC:Local_timer_interrupts
2070 ± 6% +34.1% 2776 ± 24% interrupts.CPU45.CAL:Function_call_interrupts
279054 ± 3% +34.8% 376092 interrupts.CPU45.LOC:Local_timer_interrupts
312.25 ± 30% -61.4% 120.50 ± 4% interrupts.CPU45.NMI:Non-maskable_interrupts
312.25 ± 30% -61.4% 120.50 ± 4% interrupts.CPU45.PMI:Performance_monitoring_interrupts
279009 ± 3% +34.7% 375846 interrupts.CPU46.LOC:Local_timer_interrupts
279126 ± 2% +34.8% 376278 interrupts.CPU47.LOC:Local_timer_interrupts
28.00 ± 59% +153.6% 71.00 ± 59% interrupts.CPU47.RES:Rescheduling_interrupts
279112 ± 2% +34.9% 376619 interrupts.CPU48.LOC:Local_timer_interrupts
258.00 ± 31% -53.7% 119.50 ± 6% interrupts.CPU48.NMI:Non-maskable_interrupts
258.00 ± 31% -53.7% 119.50 ± 6% interrupts.CPU48.PMI:Performance_monitoring_interrupts
279374 ± 2% +34.8% 376480 interrupts.CPU49.LOC:Local_timer_interrupts
11.75 ± 17% +17527.7% 2071 ± 95% interrupts.CPU5.38:IR-PCI-MSI.4194306-edge.eth0-TxRx-1
492980 +65.1% 813694 interrupts.CPU5.LOC:Local_timer_interrupts
2046 ± 9% +27.1% 2601 ± 8% interrupts.CPU50.CAL:Function_call_interrupts
279385 ± 3% +34.7% 376401 interrupts.CPU50.LOC:Local_timer_interrupts
329.00 ± 31% -50.9% 161.50 ± 28% interrupts.CPU50.NMI:Non-maskable_interrupts
329.00 ± 31% -50.9% 161.50 ± 28% interrupts.CPU50.PMI:Performance_monitoring_interrupts
279308 ± 3% +34.8% 376383 interrupts.CPU51.LOC:Local_timer_interrupts
279401 ± 3% +34.8% 376721 interrupts.CPU52.LOC:Local_timer_interrupts
439.50 ± 4% -66.2% 148.75 ± 31% interrupts.CPU52.NMI:Non-maskable_interrupts
439.50 ± 4% -66.2% 148.75 ± 31% interrupts.CPU52.PMI:Performance_monitoring_interrupts
279320 ± 3% +34.9% 376673 interrupts.CPU53.LOC:Local_timer_interrupts
584.25 ± 36% -63.6% 212.50 ± 23% interrupts.CPU53.NMI:Non-maskable_interrupts
584.25 ± 36% -63.6% 212.50 ± 23% interrupts.CPU53.PMI:Performance_monitoring_interrupts
209503 ± 3% +25.7% 263328 interrupts.CPU54.LOC:Local_timer_interrupts
16.00 ±122% +828.1% 148.50 ± 29% interrupts.CPU54.NMI:Non-maskable_interrupts
16.00 ±122% +828.1% 148.50 ± 29% interrupts.CPU54.PMI:Performance_monitoring_interrupts
209692 ± 3% +25.7% 263619 interrupts.CPU55.LOC:Local_timer_interrupts
13.75 ±127% +778.2% 120.75 ± 10% interrupts.CPU55.NMI:Non-maskable_interrupts
13.75 ±127% +778.2% 120.75 ± 10% interrupts.CPU55.PMI:Performance_monitoring_interrupts
209679 ± 3% +26.0% 264210 interrupts.CPU56.LOC:Local_timer_interrupts
16.25 ±115% +1666.2% 287.00 ± 65% interrupts.CPU56.NMI:Non-maskable_interrupts
16.25 ±115% +1666.2% 287.00 ± 65% interrupts.CPU56.PMI:Performance_monitoring_interrupts
210162 ± 3% +25.9% 264671 interrupts.CPU57.LOC:Local_timer_interrupts
16.25 ±120% +1158.5% 204.50 ± 31% interrupts.CPU57.NMI:Non-maskable_interrupts
16.25 ±120% +1158.5% 204.50 ± 31% interrupts.CPU57.PMI:Performance_monitoring_interrupts
210144 ± 3% +25.8% 264429 interrupts.CPU58.LOC:Local_timer_interrupts
25.00 ±107% +608.0% 177.00 ± 32% interrupts.CPU58.NMI:Non-maskable_interrupts
25.00 ±107% +608.0% 177.00 ± 32% interrupts.CPU58.PMI:Performance_monitoring_interrupts
210140 ± 3% +26.0% 264721 interrupts.CPU59.LOC:Local_timer_interrupts
24.25 ±121% +569.1% 162.25 ± 29% interrupts.CPU59.NMI:Non-maskable_interrupts
24.25 ±121% +569.1% 162.25 ± 29% interrupts.CPU59.PMI:Performance_monitoring_interrupts
40.25 ± 98% +8284.5% 3374 ± 98% interrupts.CPU6.39:IR-PCI-MSI.4194307-edge.eth0-TxRx-2
4974 ± 10% +46.2% 7271 ± 13% interrupts.CPU6.CAL:Function_call_interrupts
493028 +64.8% 812425 interrupts.CPU6.LOC:Local_timer_interrupts
330.00 ± 27% -36.1% 210.75 ± 37% interrupts.CPU6.NMI:Non-maskable_interrupts
330.00 ± 27% -36.1% 210.75 ± 37% interrupts.CPU6.PMI:Performance_monitoring_interrupts
210128 ± 3% +25.7% 264225 interrupts.CPU60.LOC:Local_timer_interrupts
210662 ± 3% +25.5% 264417 interrupts.CPU61.LOC:Local_timer_interrupts
45.25 ±149% +286.7% 175.00 ± 29% interrupts.CPU61.NMI:Non-maskable_interrupts
45.25 ±149% +286.7% 175.00 ± 29% interrupts.CPU61.PMI:Performance_monitoring_interrupts
1602 ± 12% +30.9% 2096 ± 15% interrupts.CPU62.CAL:Function_call_interrupts
210530 ± 3% +25.8% 264752 interrupts.CPU62.LOC:Local_timer_interrupts
27.00 ±100% +886.1% 266.25 ± 3% interrupts.CPU62.NMI:Non-maskable_interrupts
27.00 ±100% +886.1% 266.25 ± 3% interrupts.CPU62.PMI:Performance_monitoring_interrupts
141169 +9.1% 153981 interrupts.CPU63.LOC:Local_timer_interrupts
141087 +9.3% 154188 interrupts.CPU64.LOC:Local_timer_interrupts
1676 ± 13% -16.3% 1402 ± 2% interrupts.CPU65.CAL:Function_call_interrupts
140977 +9.6% 154443 interrupts.CPU65.LOC:Local_timer_interrupts
141180 +9.1% 154085 interrupts.CPU66.LOC:Local_timer_interrupts
141292 +9.0% 153947 interrupts.CPU67.LOC:Local_timer_interrupts
141300 +9.7% 154947 interrupts.CPU68.LOC:Local_timer_interrupts
141181 +9.5% 154618 interrupts.CPU69.LOC:Local_timer_interrupts
5135 ± 6% +18.4% 6080 ± 7% interrupts.CPU7.CAL:Function_call_interrupts
493616 +64.6% 812685 interrupts.CPU7.LOC:Local_timer_interrupts
62.50 ± 32% +120.8% 138.00 ± 17% interrupts.CPU7.TLB:TLB_shootdowns
140761 +9.9% 154659 interrupts.CPU70.LOC:Local_timer_interrupts
140489 +10.2% 154865 interrupts.CPU71.LOC:Local_timer_interrupts
495084 ± 2% +64.1% 812250 interrupts.CPU8.LOC:Local_timer_interrupts
377.50 ± 19% -64.1% 135.50 ± 2% interrupts.CPU8.NMI:Non-maskable_interrupts
377.50 ± 19% -64.1% 135.50 ± 2% interrupts.CPU8.PMI:Performance_monitoring_interrupts
60.00 ± 24% +100.4% 120.25 ± 21% interrupts.CPU8.TLB:TLB_shootdowns
458426 ± 2% +62.3% 743856 interrupts.CPU9.LOC:Local_timer_interrupts
34015055 +36.1% 46309125 interrupts.LOC:Local_timer_interrupts
290.00 +11.4% 323.00 interrupts.MCP:Machine_check_polls
21618 ± 24% -43.0% 12313 ± 2% interrupts.NMI:Non-maskable_interrupts
21618 ± 24% -43.0% 12313 ± 2% interrupts.PMI:Performance_monitoring_interrupts
13988 ± 7% +78.0% 24895 ± 21% interrupts.RES:Rescheduling_interrupts
3586 ± 6% +44.0% 5166 ± 4% interrupts.TLB:TLB_shootdowns
32.41 ± 16% -32.4 0.00 perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
32.38 ± 16% -32.4 0.00 perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
28.80 ± 16% -28.8 0.00 perf-profile.calltrace.cycles-pp.xfs_generic_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
28.55 ± 16% -28.5 0.00 perf-profile.calltrace.cycles-pp.xfs_create.xfs_generic_create.path_openat.do_filp_open.do_sys_openat2
18.27 ±101% -18.3 0.00 perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
18.26 ±101% -18.3 0.00 perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
14.79 ±101% -14.8 0.00 perf-profile.calltrace.cycles-pp.open64
14.65 ±101% -14.7 0.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.open64
14.61 ±101% -14.6 0.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.open64
14.60 ±101% -14.6 0.00 perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.open64
14.59 ±101% -14.6 0.00 perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.open64
14.00 ± 22% -14.0 0.00 perf-profile.calltrace.cycles-pp.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat.do_filp_open
11.13 ± 27% -11.1 0.00 perf-profile.calltrace.cycles-pp.xfs_dialloc_ag.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat
10.11 ± 29% -10.1 0.00 perf-profile.calltrace.cycles-pp.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dir_ialloc.xfs_create.xfs_generic_create
6.17 ± 17% -6.2 0.00 perf-profile.calltrace.cycles-pp.xfs_trans_alloc.xfs_create.xfs_generic_create.path_openat.do_filp_open
6.11 ± 17% -6.1 0.00 perf-profile.calltrace.cycles-pp.xfs_trans_reserve.xfs_trans_alloc.xfs_create.xfs_generic_create.path_openat
5.94 ± 31% -5.9 0.00 perf-profile.calltrace.cycles-pp.xfs_inobt_get_rec.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dir_ialloc.xfs_create
5.61 ± 17% -5.6 0.00 perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_create.xfs_generic_create.path_openat.do_filp_open
5.44 ± 18% -5.4 0.00 perf-profile.calltrace.cycles-pp.xfs_log_commit_cil.__xfs_trans_commit.xfs_create.xfs_generic_create.path_openat
3.31 ± 19% -2.8 0.55 ± 72% perf-profile.calltrace.cycles-pp.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow.perf_tp_event
2.88 ± 26% -2.6 0.26 ±100% perf-profile.calltrace.cycles-pp.perf_callchain.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow
2.85 ± 26% -2.6 0.26 ±100% perf-profile.calltrace.cycles-pp.get_perf_callchain.perf_callchain.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow
4.04 ± 13% -2.2 1.83 ± 15% perf-profile.calltrace.cycles-pp.xlog_grant_head_wait.xlog_grant_head_check.xfs_log_reserve.xfs_trans_reserve.xfs_trans_alloc
3.67 ± 12% -2.0 1.68 ± 12% perf-profile.calltrace.cycles-pp.schedule.xlog_grant_head_wait.xlog_grant_head_check.xfs_log_reserve.xfs_trans_reserve
3.66 ± 12% -2.0 1.67 ± 12% perf-profile.calltrace.cycles-pp.__schedule.schedule.xlog_grant_head_wait.xlog_grant_head_check.xfs_log_reserve
3.08 ± 14% -1.4 1.72 ± 10% perf-profile.calltrace.cycles-pp.process_simple.perf_session__process_events.record__finish_output.cmd_record.cmd_sched
1.80 ± 14% -1.3 0.46 ± 57% perf-profile.calltrace.cycles-pp.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_switch.__schedule
1.78 ± 14% -1.3 0.46 ± 57% perf-profile.calltrace.cycles-pp.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_switch
3.27 ± 14% -1.0 2.24 ± 8% perf-profile.calltrace.cycles-pp.record__finish_output.cmd_record.cmd_sched.run_builtin.main
3.97 ± 18% -1.0 2.95 ± 6% perf-profile.calltrace.cycles-pp.cmd_record.cmd_sched.run_builtin.main.__libc_start_main
3.97 ± 18% -1.0 2.95 ± 6% perf-profile.calltrace.cycles-pp.cmd_sched.run_builtin.main.__libc_start_main
3.26 ± 13% -1.0 2.24 ± 8% perf-profile.calltrace.cycles-pp.perf_session__process_events.record__finish_output.cmd_record.cmd_sched.run_builtin
4.36 ± 18% -0.9 3.46 ± 5% perf-profile.calltrace.cycles-pp.__libc_start_main
4.36 ± 17% -0.9 3.46 ± 5% perf-profile.calltrace.cycles-pp.main.__libc_start_main
4.36 ± 17% -0.9 3.46 ± 5% perf-profile.calltrace.cycles-pp.run_builtin.main.__libc_start_main
1.57 ± 21% -0.9 0.69 ± 12% perf-profile.calltrace.cycles-pp.__ordered_events__flush.perf_session__process_user_event.process_simple.perf_session__process_events.record__finish_output
1.57 ± 21% -0.9 0.69 ± 12% perf-profile.calltrace.cycles-pp.perf_session__process_user_event.process_simple.perf_session__process_events.record__finish_output.cmd_record
1.19 ± 19% -0.9 0.31 ±102% perf-profile.calltrace.cycles-pp.perf_trace_sched_wakeup_template.try_to_wake_up.xlog_grant_head_wake.xfs_log_space_wake.xfs_log_ticket_ungrant
1.14 ± 20% -0.8 0.30 ±101% perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_wakeup_template.try_to_wake_up.xlog_grant_head_wake.xfs_log_space_wake
1.50 ± 21% -0.8 0.69 ± 12% perf-profile.calltrace.cycles-pp.perf_session__deliver_event.__ordered_events__flush.perf_session__process_user_event.process_simple.perf_session__process_events
1.88 ± 8% -0.8 1.10 ± 2% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
1.85 ± 8% -0.8 1.08 ± 2% perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
1.47 ± 19% -0.8 0.71 ± 70% perf-profile.calltrace.cycles-pp.try_to_wake_up.xlog_grant_head_wake.xfs_log_space_wake.xfs_log_ticket_ungrant.xfs_log_commit_cil
1.58 ± 25% -0.8 0.83 ± 11% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.xlog_grant_head_wait.xlog_grant_head_check
1.54 ± 26% -0.7 0.81 ± 12% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.xlog_grant_head_wait
1.53 ± 19% -0.7 0.85 ± 41% perf-profile.calltrace.cycles-pp.xlog_grant_head_wake.xfs_log_space_wake.xfs_log_ticket_ungrant.xfs_log_commit_cil.__xfs_trans_commit
1.11 ± 29% -0.7 0.45 ± 57% perf-profile.calltrace.cycles-pp.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_stat_runtime.update_curr
1.11 ± 29% -0.7 0.45 ± 57% perf-profile.calltrace.cycles-pp.perf_swevent_overflow.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.dequeue_entity
1.10 ± 29% -0.7 0.44 ± 57% perf-profile.calltrace.cycles-pp.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_stat_runtime
1.31 ± 28% -0.6 0.71 ± 9% perf-profile.calltrace.cycles-pp.update_curr.dequeue_entity.dequeue_task_fair.__schedule.schedule
1.21 ± 29% -0.6 0.64 ± 9% perf-profile.calltrace.cycles-pp.perf_trace_sched_stat_runtime.update_curr.dequeue_entity.dequeue_task_fair.__schedule
1.15 ± 30% -0.6 0.59 ± 9% perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.dequeue_entity.dequeue_task_fair
1.05 ± 12% -0.6 0.49 ± 57% perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_switch.__schedule.schedule_idle.do_idle
0.99 ± 11% -0.5 0.47 ± 57% perf-profile.calltrace.cycles-pp.perf_swevent_overflow.perf_tp_event.perf_trace_sched_switch.__schedule.schedule_idle
1.14 ± 11% -0.5 0.66 ± 7% perf-profile.calltrace.cycles-pp.perf_trace_sched_switch.__schedule.schedule_idle.do_idle.cpu_startup_entry
1.03 ± 21% -0.3 0.68 ± 12% perf-profile.calltrace.cycles-pp.machines__deliver_event.perf_session__deliver_event.__ordered_events__flush.perf_session__process_user_event.process_simple
0.44 ± 58% +0.2 0.68 ± 12% perf-profile.calltrace.cycles-pp.dso__load.map__load.thread__find_map.build_id__mark_dso_hit.machines__deliver_event
0.43 ± 58% +0.2 0.66 ± 12% perf-profile.calltrace.cycles-pp.__dso__load_kallsyms.dso__load.map__load.thread__find_map.build_id__mark_dso_hit
0.76 ± 3% +0.3 1.08 ± 5% perf-profile.calltrace.cycles-pp.rcu_sched_clock_irq.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
0.66 ± 7% +0.4 1.02 ± 2% perf-profile.calltrace.cycles-pp.update_sd_lb_stats.find_busiest_group.load_balance.rebalance_domains.__softirqentry_text_start
0.93 ± 18% +0.4 1.30 ± 7% perf-profile.calltrace.cycles-pp.read
0.71 ± 9% +0.4 1.09 ± 3% perf-profile.calltrace.cycles-pp.find_busiest_group.load_balance.rebalance_domains.__softirqentry_text_start.asm_call_sysvec_on_stack
0.88 ± 19% +0.4 1.27 ± 8% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read
0.86 ± 19% +0.4 1.25 ± 9% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
0.84 ± 19% +0.4 1.24 ± 9% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
0.86 ± 19% +0.4 1.26 ± 9% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
0.81 ± 8% +0.4 1.23 ± 4% perf-profile.calltrace.cycles-pp.update_rq_clock.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer
0.94 ± 10% +0.4 1.37 ± 11% perf-profile.calltrace.cycles-pp.update_blocked_averages.run_rebalance_domains.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack
0.98 ± 11% +0.5 1.44 ± 10% perf-profile.calltrace.cycles-pp.run_rebalance_domains.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu
1.11 ± 10% +0.5 1.66 ± 5% perf-profile.calltrace.cycles-pp.load_balance.rebalance_domains.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack
0.92 ± 8% +0.6 1.47 ± 8% perf-profile.calltrace.cycles-pp.perf_mux_hrtimer_handler.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack
0.00 +0.6 0.55 ± 10% perf-profile.calltrace.cycles-pp.hrtimer_get_next_event.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select
0.45 ± 59% +0.6 1.00 ± 11% perf-profile.calltrace.cycles-pp.__remove_hrtimer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack
0.00 +0.6 0.59 ± 9% perf-profile.calltrace.cycles-pp.arch_cpu_idle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
0.13 ±173% +0.6 0.73 ± 5% perf-profile.calltrace.cycles-pp.cpuidle_governor_latency_req.menu_select.do_idle.cpu_startup_entry.start_secondary
0.00 +0.6 0.62 ± 6% perf-profile.calltrace.cycles-pp.timerqueue_add.enqueue_hrtimer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
1.33 ± 9% +0.6 1.96 ± 3% perf-profile.calltrace.cycles-pp.rebalance_domains.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu
0.00 +0.7 0.66 ± 9% perf-profile.calltrace.cycles-pp.update_irq_load_avg.update_rq_clock.scheduler_tick.update_process_times.tick_sched_handle
0.13 ±173% +0.7 0.79 ± 12% perf-profile.calltrace.cycles-pp.timerqueue_del.__remove_hrtimer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
0.13 ±173% +0.7 0.79 ± 6% perf-profile.calltrace.cycles-pp.lapic_next_deadline.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack
0.00 +0.7 0.69 ± 21% perf-profile.calltrace.cycles-pp.xlog_cil_insert_items.xfs_log_commit_cil.__xfs_trans_commit.xfs_remove.xfs_vn_unlink
0.00 +0.7 0.71 ± 10% perf-profile.calltrace.cycles-pp.xfs_iunlink.xfs_remove.xfs_vn_unlink.vfs_unlink.do_unlinkat
0.00 +0.7 0.73 ± 5% perf-profile.calltrace.cycles-pp.enqueue_hrtimer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack
1.22 ± 12% +0.8 1.97 ± 13% perf-profile.calltrace.cycles-pp.ktime_get.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack
0.00 +0.8 0.80 ± 11% perf-profile.calltrace.cycles-pp.rcu_idle_exit.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
0.00 +0.8 0.82 ± 11% perf-profile.calltrace.cycles-pp.xfs_dir2_leafn_lookup_for_entry.xfs_da3_node_lookup_int.xfs_dir2_node_removename.xfs_dir_removename.xfs_remove
0.00 +0.8 0.83 ± 12% perf-profile.calltrace.cycles-pp.xfs_dir2_leafn_remove.xfs_dir2_node_removename.xfs_dir_removename.xfs_remove.xfs_vn_unlink
0.74 ± 31% +0.8 1.59 ± 11% perf-profile.calltrace.cycles-pp.ktime_get.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
1.76 ± 7% +0.9 2.65 ± 6% perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
0.00 +0.9 0.95 ± 38% perf-profile.calltrace.cycles-pp.xfs_log_space_wake.xfs_log_ticket_ungrant.xfs_log_commit_cil.__xfs_trans_commit.xfs_remove
0.13 ±173% +1.0 1.09 ± 5% perf-profile.calltrace.cycles-pp.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle
0.00 +1.0 0.99 ± 38% perf-profile.calltrace.cycles-pp.xfs_log_ticket_ungrant.xfs_log_commit_cil.__xfs_trans_commit.xfs_remove.xfs_vn_unlink
1.15 ± 8% +1.0 2.17 ± 6% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
0.12 ±173% +1.0 1.16 ± 4% perf-profile.calltrace.cycles-pp.hrtimer_next_event_without.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
1.36 ± 19% +1.2 2.51 ± 12% perf-profile.calltrace.cycles-pp.ktime_get_update_offsets_now.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt
1.83 ± 8% +1.2 3.07 ± 9% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt
0.00 +1.3 1.26 ± 13% perf-profile.calltrace.cycles-pp.xfs_da3_node_lookup_int.xfs_dir2_node_removename.xfs_dir_removename.xfs_remove.xfs_vn_unlink
3.54 ± 7% +1.3 4.89 ± 8% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt
3.55 ± 7% +1.4 4.92 ± 8% perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
3.60 ± 7% +1.4 4.99 ± 8% perf-profile.calltrace.cycles-pp.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
3.82 ± 13% +1.5 5.29 ± 6% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
4.11 ± 13% +1.6 5.75 ± 5% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
0.22 ±173% +1.7 1.92 ± 14% perf-profile.calltrace.cycles-pp.xlog_grant_head_check.xfs_log_reserve.xfs_trans_reserve.xfs_trans_alloc.xfs_remove
4.21 ± 8% +1.8 6.00 ± 8% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.23 ±173% +1.8 2.05 ± 12% perf-profile.calltrace.cycles-pp.xfs_log_reserve.xfs_trans_reserve.xfs_trans_alloc.xfs_remove.xfs_vn_unlink
1.92 ± 8% +2.0 3.95 ± 3% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
0.00 +2.2 2.22 ± 11% perf-profile.calltrace.cycles-pp.xfs_dir2_node_removename.xfs_dir_removename.xfs_remove.xfs_vn_unlink.vfs_unlink
0.14 ±173% +2.2 2.37 ± 10% perf-profile.calltrace.cycles-pp.xfs_dir_removename.xfs_remove.xfs_vn_unlink.vfs_unlink.do_unlinkat
0.28 ±173% +2.3 2.57 ± 12% perf-profile.calltrace.cycles-pp.xfs_trans_reserve.xfs_trans_alloc.xfs_remove.xfs_vn_unlink.vfs_unlink
0.28 ±173% +2.3 2.62 ± 12% perf-profile.calltrace.cycles-pp.xfs_trans_alloc.xfs_remove.xfs_vn_unlink.vfs_unlink.do_unlinkat
0.64 ± 65% +2.4 3.00 ± 29% perf-profile.calltrace.cycles-pp.ktime_get.tick_irq_enter.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
0.20 ±173% +2.4 2.57 ± 24% perf-profile.calltrace.cycles-pp.xfs_log_commit_cil.__xfs_trans_commit.xfs_remove.xfs_vn_unlink.vfs_unlink
0.21 ±173% +2.5 2.75 ± 24% perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_remove.xfs_vn_unlink.vfs_unlink.do_unlinkat
1.32 ± 18% +2.6 3.88 ± 23% perf-profile.calltrace.cycles-pp.tick_irq_enter.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
1.46 ± 17% +2.7 4.15 ± 21% perf-profile.calltrace.cycles-pp.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
5.00 ± 4% +2.8 7.76 ± 4% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack
4.64 ± 5% +4.3 8.99 ± 4% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
7.55 ± 5% +4.5 12.04 ± 2% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt
3.46 ± 71% +6.6 10.09 ± 12% perf-profile.calltrace.cycles-pp.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
12.01 ± 5% +7.7 19.68 ± 3% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
1.32 ± 78% +7.8 9.12 ± 11% perf-profile.calltrace.cycles-pp.xfs_remove.xfs_vn_unlink.vfs_unlink.do_unlinkat.do_syscall_64
1.32 ± 79% +7.8 9.14 ± 11% perf-profile.calltrace.cycles-pp.xfs_vn_unlink.vfs_unlink.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.35 ± 79% +7.9 9.23 ± 11% perf-profile.calltrace.cycles-pp.vfs_unlink.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
12.59 ± 5% +8.1 20.70 ± 3% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
12.70 ± 5% +8.2 20.87 ± 3% perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
9.16 ± 4% +8.9 18.02 ± 2% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
19.68 ± 5% +13.7 33.36 ± 3% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
21.31 ± 5% +14.9 36.19 ± 3% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
31.81 ± 3% +25.1 56.88 perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
32.62 ± 3% +25.1 57.71 perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
41.86 ± 2% +29.5 71.40 perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
41.93 ± 2% +29.6 71.50 perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
41.93 ± 2% +29.6 71.50 perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
42.58 ± 3% +29.7 72.25 perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
33.46 ± 15% -32.7 0.80 ± 7% perf-profile.children.cycles-pp.do_sys_open
33.43 ± 15% -32.6 0.79 ± 7% perf-profile.children.cycles-pp.do_sys_openat2
32.90 ± 15% -32.2 0.69 ± 3% perf-profile.children.cycles-pp.path_openat
32.93 ± 15% -32.2 0.74 ± 7% perf-profile.children.cycles-pp.do_filp_open
28.84 ± 16% -28.8 0.00 perf-profile.children.cycles-pp.xfs_generic_create
28.58 ± 16% -28.6 0.00 perf-profile.children.cycles-pp.xfs_create
44.72 ± 2% -27.2 17.55 ± 7% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
43.63 ± 3% -26.6 17.02 ± 7% perf-profile.children.cycles-pp.do_syscall_64
14.01 ± 21% -14.0 0.00 perf-profile.children.cycles-pp.xfs_dir_ialloc
11.13 ± 27% -11.1 0.00 perf-profile.children.cycles-pp.xfs_dialloc_ag
11.07 ± 27% -10.9 0.22 ± 33% perf-profile.children.cycles-pp.xfs_check_agi_freecount
6.64 ± 29% -6.5 0.15 ± 22% perf-profile.children.cycles-pp.xfs_inobt_get_rec
7.06 ± 10% -4.4 2.67 ± 12% perf-profile.children.cycles-pp.xfs_trans_alloc
6.97 ± 10% -4.4 2.61 ± 12% perf-profile.children.cycles-pp.xfs_trans_reserve
4.38 ± 27% -4.3 0.08 ± 64% perf-profile.children.cycles-pp.xfs_btree_check_sblock
6.47 ± 8% -3.7 2.82 ± 23% perf-profile.children.cycles-pp.__xfs_trans_commit
6.24 ± 9% -3.6 2.66 ± 24% perf-profile.children.cycles-pp.xfs_log_commit_cil
3.55 ± 31% -3.5 0.04 ±115% perf-profile.children.cycles-pp.xfs_btree_increment
3.50 ± 28% -3.4 0.08 ± 62% perf-profile.children.cycles-pp.xfs_btree_get_rec
7.24 ± 8% -3.4 3.83 ± 11% perf-profile.children.cycles-pp.perf_tp_event
6.95 ± 7% -3.3 3.65 ± 11% perf-profile.children.cycles-pp.perf_swevent_overflow
6.91 ± 7% -3.3 3.63 ± 11% perf-profile.children.cycles-pp.__perf_event_overflow
7.96 ± 8% -3.3 4.69 ± 7% perf-profile.children.cycles-pp.__schedule
6.83 ± 7% -3.2 3.60 ± 11% perf-profile.children.cycles-pp.perf_event_output_forward
2.90 ± 27% -2.8 0.06 ± 58% perf-profile.children.cycles-pp.__xfs_btree_check_sblock
4.92 ± 11% -2.8 2.09 ± 12% perf-profile.children.cycles-pp.xfs_log_reserve
5.83 ± 7% -2.7 3.10 ± 12% perf-profile.children.cycles-pp.perf_prepare_sample
4.61 ± 11% -2.7 1.95 ± 14% perf-profile.children.cycles-pp.xlog_grant_head_check
5.32 ± 7% -2.6 2.76 ± 11% perf-profile.children.cycles-pp.perf_callchain
5.26 ± 7% -2.5 2.74 ± 11% perf-profile.children.cycles-pp.get_perf_callchain
5.99 ± 9% -2.5 3.50 ± 8% perf-profile.children.cycles-pp.schedule
4.28 ± 10% -2.4 1.86 ± 15% perf-profile.children.cycles-pp.xlog_grant_head_wait
4.87 ± 8% -2.4 2.50 ± 12% perf-profile.children.cycles-pp.perf_callchain_kernel
2.59 ± 16% -2.1 0.47 ± 33% perf-profile.children.cycles-pp.__percpu_counter_compare
2.57 ± 16% -2.1 0.46 ± 32% perf-profile.children.cycles-pp.__percpu_counter_sum
3.53 ± 9% -1.7 1.85 ± 13% perf-profile.children.cycles-pp.unwind_next_frame
2.04 ± 15% -1.5 0.50 ± 28% perf-profile.children.cycles-pp.xfs_mod_fdblocks
2.33 ± 12% -1.4 0.89 ± 4% perf-profile.children.cycles-pp.xfs_trans_read_buf_map
3.11 ± 10% -1.4 1.70 ± 8% perf-profile.children.cycles-pp.update_curr
3.09 ± 14% -1.4 1.72 ± 10% perf-profile.children.cycles-pp.process_simple
2.82 ± 11% -1.3 1.50 ± 8% perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime
2.71 ± 7% -1.3 1.44 ± 12% perf-profile.children.cycles-pp.perf_trace_sched_switch
1.58 ± 18% -1.2 0.37 ± 52% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
2.65 ± 11% -1.2 1.48 ± 7% perf-profile.children.cycles-pp.dequeue_task_fair
2.58 ± 11% -1.1 1.45 ± 7% perf-profile.children.cycles-pp.dequeue_entity
2.12 ± 8% -1.1 1.00 ± 37% perf-profile.children.cycles-pp.xfs_log_ticket_ungrant
1.75 ± 16% -1.1 0.64 ± 5% perf-profile.children.cycles-pp.xfs_buf_read_map
1.65 ± 16% -1.1 0.57 ± 6% perf-profile.children.cycles-pp.xfs_buf_get_map
2.03 ± 8% -1.1 0.96 ± 38% perf-profile.children.cycles-pp.xfs_log_space_wake
3.27 ± 14% -1.0 2.24 ± 8% perf-profile.children.cycles-pp.record__finish_output
3.97 ± 18% -1.0 2.95 ± 6% perf-profile.children.cycles-pp.cmd_sched
3.26 ± 13% -1.0 2.24 ± 8% perf-profile.children.cycles-pp.perf_session__process_events
3.98 ± 18% -1.0 2.96 ± 6% perf-profile.children.cycles-pp.cmd_record
2.73 ± 5% -1.0 1.74 ± 24% perf-profile.children.cycles-pp.try_to_wake_up
1.88 ± 6% -1.0 0.89 ± 40% perf-profile.children.cycles-pp.xlog_grant_head_wake
2.03 ± 7% -1.0 1.05 ± 17% perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
1.47 ± 18% -1.0 0.51 ± 6% perf-profile.children.cycles-pp.xfs_buf_find
4.36 ± 18% -0.9 3.46 ± 5% perf-profile.children.cycles-pp.__libc_start_main
4.36 ± 17% -0.9 3.46 ± 5% perf-profile.children.cycles-pp.main
4.36 ± 17% -0.9 3.46 ± 5% perf-profile.children.cycles-pp.run_builtin
1.57 ± 21% -0.9 0.69 ± 12% perf-profile.children.cycles-pp.perf_session__process_user_event
1.58 ± 9% -0.9 0.71 ± 22% perf-profile.children.cycles-pp.xlog_cil_insert_items
1.15 ± 32% -0.9 0.30 ± 13% perf-profile.children.cycles-pp.xfs_read_agi
0.96 ± 18% -0.8 0.14 ± 23% perf-profile.children.cycles-pp.xfs_errortag_test
1.33 ± 8% -0.8 0.52 ± 20% perf-profile.children.cycles-pp.kmem_cache_alloc
1.92 ± 8% -0.8 1.11 ± 3% perf-profile.children.cycles-pp.schedule_idle
0.93 ± 22% -0.8 0.15 ± 15% perf-profile.children.cycles-pp.xfs_next_bit
1.46 ± 5% -0.8 0.70 ± 10% perf-profile.children.cycles-pp.__orc_find
1.34 ± 41% -0.7 0.68 ± 20% perf-profile.children.cycles-pp.ksys_write
1.18 ± 9% -0.7 0.53 ± 8% perf-profile.children.cycles-pp.orc_find
1.32 ± 42% -0.7 0.67 ± 20% perf-profile.children.cycles-pp.vfs_write
1.60 ± 7% -0.6 0.99 ± 11% perf-profile.children.cycles-pp.__unwind_start
0.77 ± 40% -0.6 0.17 ± 16% perf-profile.children.cycles-pp.xfs_buf_lock
0.76 ± 40% -0.6 0.17 ± 16% perf-profile.children.cycles-pp.down
0.75 ± 41% -0.6 0.17 ± 16% perf-profile.children.cycles-pp.__down
0.83 ± 24% -0.6 0.24 ± 10% perf-profile.children.cycles-pp.xfs_agino_range
0.92 ± 31% -0.6 0.35 ± 29% perf-profile.children.cycles-pp.schedule_timeout
1.08 ± 14% -0.6 0.53 ± 6% perf-profile.children.cycles-pp.xfs_da_read_buf
1.03 ± 15% -0.5 0.50 ± 11% perf-profile.children.cycles-pp.syscall_exit_to_user_mode
1.15 ± 35% -0.5 0.64 ± 18% perf-profile.children.cycles-pp.new_sync_write
0.98 ± 16% -0.5 0.48 ± 8% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
0.91 ± 13% -0.5 0.43 ± 18% perf-profile.children.cycles-pp.task_tick_fair
0.83 ± 7% -0.5 0.35 ± 12% perf-profile.children.cycles-pp.unwind_get_return_address
1.63 ± 21% -0.5 1.15 ± 7% perf-profile.children.cycles-pp.__ordered_events__flush
0.77 ± 33% -0.5 0.30 ± 2% perf-profile.children.cycles-pp.queue_event
1.61 ± 14% -0.5 1.15 ± 11% perf-profile.children.cycles-pp._raw_spin_lock
0.83 ± 33% -0.5 0.37 ± 8% perf-profile.children.cycles-pp.ordered_events__queue
0.82 ± 15% -0.5 0.36 ± 9% perf-profile.children.cycles-pp.task_work_run
0.75 ± 5% -0.5 0.30 ± 11% perf-profile.children.cycles-pp.__kernel_text_address
1.62 ± 9% -0.4 1.18 ± 8% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.67 ± 5% -0.4 0.25 ± 17% perf-profile.children.cycles-pp.kernel_text_address
0.70 ± 14% -0.4 0.31 ± 11% perf-profile.children.cycles-pp.sched_ttwu_pending
1.38 ± 8% -0.4 1.00 ± 2% perf-profile.children.cycles-pp.pick_next_task_fair
0.70 ± 15% -0.4 0.33 ± 23% perf-profile.children.cycles-pp.xfs_buf_item_format
0.61 ± 15% -0.4 0.26 ± 5% perf-profile.children.cycles-pp.__libc_write
0.67 ± 13% -0.4 0.31 ± 14% perf-profile.children.cycles-pp.__fput
0.74 ± 10% -0.3 0.39 ± 14% perf-profile.children.cycles-pp.perf_output_sample
0.79 ± 13% -0.3 0.45 ± 8% perf-profile.children.cycles-pp.flush_smp_call_function_from_idle
0.49 ± 9% -0.3 0.18 ± 23% perf-profile.children.cycles-pp.xfs_buf_item_release
0.56 ± 9% -0.3 0.26 ± 5% perf-profile.children.cycles-pp.generic_file_write_iter
0.56 ± 9% -0.3 0.26 ± 5% perf-profile.children.cycles-pp.__generic_file_write_iter
0.55 ± 7% -0.3 0.24 ± 6% perf-profile.children.cycles-pp.generic_perform_write
0.74 ± 24% -0.3 0.45 ± 20% perf-profile.children.cycles-pp.memcpy_erms
0.39 ± 20% -0.3 0.10 ± 46% perf-profile.children.cycles-pp.xfs_buf_unlock
1.21 ± 14% -0.3 0.92 ± 3% perf-profile.children.cycles-pp.newidle_balance
0.39 ± 11% -0.3 0.11 ± 28% perf-profile.children.cycles-pp.alloc_empty_file
0.56 ± 25% -0.3 0.28 ± 19% perf-profile.children.cycles-pp.kmem_cache_free
0.36 ± 10% -0.3 0.10 ± 33% perf-profile.children.cycles-pp.__alloc_file
0.45 ± 13% -0.3 0.19 ± 18% perf-profile.children.cycles-pp.xfs_inode_item_format
0.34 ± 22% -0.3 0.08 ± 37% perf-profile.children.cycles-pp.do_dentry_open
0.44 ± 9% -0.3 0.18 ± 30% perf-profile.children.cycles-pp.dput
0.32 ± 18% -0.3 0.06 ± 71% perf-profile.children.cycles-pp.up
0.35 ± 19% -0.3 0.10 ± 23% perf-profile.children.cycles-pp.xfs_ag_block_count
0.53 ± 12% -0.2 0.29 ± 3% perf-profile.children.cycles-pp.xfs_dir3_leaf_check_int
0.46 ± 37% -0.2 0.23 ± 15% perf-profile.children.cycles-pp.finish_task_switch
0.64 ± 11% -0.2 0.41 ± 24% perf-profile.children.cycles-pp.ttwu_do_activate
0.62 ± 11% -0.2 0.39 ± 22% perf-profile.children.cycles-pp.enqueue_task_fair
0.33 ± 10% -0.2 0.11 ± 57% perf-profile.children.cycles-pp.d_alloc_parallel
0.34 ± 16% -0.2 0.13 ± 18% perf-profile.children.cycles-pp.shmem_getpage_gfp
0.37 ± 17% -0.2 0.16 ± 13% perf-profile.children.cycles-pp._xfs_trans_bjoin
0.27 ± 11% -0.2 0.07 ±104% perf-profile.children.cycles-pp.d_alloc
0.37 ± 15% -0.2 0.18 ± 10% perf-profile.children.cycles-pp.xfs_dabuf_map
0.30 ± 10% -0.2 0.11 ± 31% perf-profile.children.cycles-pp.is_module_text_address
0.76 ± 12% -0.2 0.57 ± 23% perf-profile.children.cycles-pp.update_load_avg
0.29 ± 7% -0.2 0.11 ± 13% perf-profile.children.cycles-pp.shmem_write_begin
0.29 ± 17% -0.2 0.11 ± 30% perf-profile.children.cycles-pp.xfs_inode_item_format_data_fork
0.32 ± 17% -0.2 0.14 ± 41% perf-profile.children.cycles-pp.__module_address
0.27 ± 13% -0.2 0.09 ± 79% perf-profile.children.cycles-pp.__d_alloc
0.53 ± 9% -0.2 0.36 ± 26% perf-profile.children.cycles-pp.enqueue_entity
0.32 ± 15% -0.2 0.15 ± 29% perf-profile.children.cycles-pp.xfs_buf_item_size
0.29 ± 14% -0.2 0.13 ± 34% perf-profile.children.cycles-pp.xfs_buf_item_size_segment
0.29 ± 16% -0.2 0.12 ± 23% perf-profile.children.cycles-pp.cpumask_next
0.21 ± 10% -0.2 0.05 ±100% perf-profile.children.cycles-pp.xfs_perag_get
0.26 ± 7% -0.2 0.10 ± 36% perf-profile.children.cycles-pp.___slab_alloc
0.24 ± 29% -0.2 0.09 ± 21% perf-profile.children.cycles-pp.evsel__parse_sample
0.37 ± 14% -0.2 0.21 ± 10% perf-profile.children.cycles-pp.getname_flags
0.38 ± 14% -0.2 0.22 ± 19% perf-profile.children.cycles-pp.perf_output_copy
0.27 ± 6% -0.2 0.11 ± 35% perf-profile.children.cycles-pp.__slab_alloc
0.22 ± 16% -0.2 0.07 ± 71% perf-profile.children.cycles-pp.evlist__parse_sample
0.33 ± 11% -0.1 0.18 ± 23% perf-profile.children.cycles-pp.___might_sleep
0.39 ± 12% -0.1 0.24 ± 22% perf-profile.children.cycles-pp.__alloc_pages_nodemask
0.23 ± 19% -0.1 0.09 ± 38% perf-profile.children.cycles-pp.xfs_iextents_copy
0.25 ± 13% -0.1 0.11 ± 30% perf-profile.children.cycles-pp.__module_text_address
0.27 ± 16% -0.1 0.13 ± 14% perf-profile.children.cycles-pp.strncpy_from_user
0.91 ± 11% -0.1 0.78 ± 10% perf-profile.children.cycles-pp.link_path_walk
0.27 ± 22% -0.1 0.14 ± 16% perf-profile.children.cycles-pp.xfs_bmapi_read
0.30 ± 13% -0.1 0.17 ± 34% perf-profile.children.cycles-pp.stack_access_ok
0.15 ± 18% -0.1 0.03 ±100% perf-profile.children.cycles-pp.__x64_sys_close
0.15 ± 30% -0.1 0.04 ±107% perf-profile.children.cycles-pp.get_obj_cgroup_from_current
0.14 ± 19% -0.1 0.03 ±100% perf-profile.children.cycles-pp.xfs_trans_ijoin
0.30 ± 16% -0.1 0.19 ± 24% perf-profile.children.cycles-pp.__update_load_avg_se
0.14 ± 9% -0.1 0.03 ±102% perf-profile.children.cycles-pp.xfs_trans_log_buf
0.15 ± 7% -0.1 0.04 ±102% perf-profile.children.cycles-pp.__radix_tree_lookup
0.14 ± 23% -0.1 0.03 ±100% perf-profile.children.cycles-pp.shmem_alloc_and_acct_page
0.33 ± 3% -0.1 0.22 ± 28% perf-profile.children.cycles-pp.kmem_alloc
0.48 ± 9% -0.1 0.38 ± 12% perf-profile.children.cycles-pp.xfs_trans_log_inode
0.19 ± 5% -0.1 0.08 ± 15% perf-profile.children.cycles-pp.xfs_bmap_last_offset
0.23 ± 14% -0.1 0.12 ± 4% perf-profile.children.cycles-pp.perf_callchain_user
0.20 ± 15% -0.1 0.10 ± 34% perf-profile.children.cycles-pp.xfs_buf_rele
0.17 ± 16% -0.1 0.06 ± 59% perf-profile.children.cycles-pp.__list_add_valid
0.13 ± 17% -0.1 0.03 ±100% perf-profile.children.cycles-pp.memset_erms
0.17 ± 12% -0.1 0.07 ± 20% perf-profile.children.cycles-pp.xfs_dir2_isblock
0.27 ± 16% -0.1 0.18 ± 32% perf-profile.children.cycles-pp.__perf_event_header__init_id
0.13 ± 19% -0.1 0.04 ± 58% perf-profile.children.cycles-pp.perf_output_begin_forward
0.11 ± 13% -0.1 0.03 ±100% perf-profile.children.cycles-pp.pagecache_get_page
0.27 ± 21% -0.1 0.18 ± 8% perf-profile.children.cycles-pp.__list_del_entry_valid
0.15 ± 22% -0.1 0.06 ± 67% perf-profile.children.cycles-pp.perf_event_pid_type
0.14 ± 12% -0.1 0.05 ±103% perf-profile.children.cycles-pp.xfs_buf_ioend
0.17 ± 17% -0.1 0.09 ± 58% perf-profile.children.cycles-pp.xfs_iflush_cluster
0.14 ± 35% -0.1 0.05 ± 63% perf-profile.children.cycles-pp.machine__findnew_thread
0.12 ± 25% -0.1 0.04 ±107% perf-profile.children.cycles-pp.perf_trace_buf_alloc
0.14 ± 5% -0.1 0.06 ± 13% perf-profile.children.cycles-pp.xfs_bmap_last_extent
0.18 ± 18% -0.1 0.10 ± 22% perf-profile.children.cycles-pp.obj_cgroup_charge
0.11 ± 17% -0.1 0.03 ±105% perf-profile.children.cycles-pp.xfs_buf_inode_iodone
0.18 ± 31% -0.1 0.11 ± 43% perf-profile.children.cycles-pp.__check_object_size
0.11 ± 8% -0.1 0.03 ±100% perf-profile.children.cycles-pp.update_cfs_group
0.20 ± 9% -0.1 0.13 ± 21% perf-profile.children.cycles-pp.__might_sleep
0.11 ± 17% -0.1 0.04 ±102% perf-profile.children.cycles-pp.down_trylock
0.10 ± 32% -0.1 0.03 ±100% perf-profile.children.cycles-pp.evlist__parse_sample_timestamp
0.16 ± 9% -0.1 0.09 ± 17% perf-profile.children.cycles-pp.__get_user_nocheck_1
0.12 ± 29% -0.1 0.06 ± 59% perf-profile.children.cycles-pp.__x64_sys_poll
0.12 ± 29% -0.1 0.06 ± 59% perf-profile.children.cycles-pp.do_sys_poll
0.11 ± 22% -0.1 0.04 ±100% perf-profile.children.cycles-pp.xfs_ilock
0.12 ± 19% -0.1 0.05 ± 63% perf-profile.children.cycles-pp.xfs_buf_trylock
0.16 ± 9% -0.1 0.09 ± 14% perf-profile.children.cycles-pp.iov_iter_fault_in_readable
0.13 ± 24% -0.1 0.07 ± 21% perf-profile.children.cycles-pp.xfs_trans_add_item
0.18 ± 20% -0.1 0.11 ± 20% perf-profile.children.cycles-pp.__d_lookup_rcu
0.15 ± 16% -0.1 0.09 ± 21% perf-profile.children.cycles-pp.xfs_buf_item_init
0.13 ± 25% -0.1 0.07 ± 12% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.14 ± 8% -0.1 0.07 ± 65% perf-profile.children.cycles-pp.rmqueue
0.11 ± 18% -0.1 0.05 ± 58% perf-profile.children.cycles-pp.get_stack_info
0.11 ± 20% -0.1 0.05 ± 60% perf-profile.children.cycles-pp.unlazy_walk
0.11 ± 15% -0.1 0.05 ± 59% perf-profile.children.cycles-pp.xfs_buf_item_log
0.13 ± 29% -0.1 0.07 ± 20% perf-profile.children.cycles-pp.__poll
0.14 ± 8% -0.1 0.08 ± 15% perf-profile.children.cycles-pp.path_init
0.11 ± 28% -0.1 0.06 ± 60% perf-profile.children.cycles-pp.call_rcu
0.16 ± 11% -0.1 0.11 ± 7% perf-profile.children.cycles-pp.xfs_dir3_data_read
0.15 ± 7% -0.1 0.10 ± 30% perf-profile.children.cycles-pp.ttwu_queue_wakelist
0.26 ± 4% -0.0 0.21 ± 12% perf-profile.children.cycles-pp._cond_resched
0.11 ± 11% -0.0 0.08 ± 16% perf-profile.children.cycles-pp.tlb_finish_mmu
0.06 ± 28% +0.0 0.08 ± 21% perf-profile.children.cycles-pp.machine__exit
0.06 ± 28% +0.0 0.08 ± 21% perf-profile.children.cycles-pp.dso__delete
0.08 ± 10% +0.0 0.11 ± 17% perf-profile.children.cycles-pp.arch_scale_freq_tick
0.06 ± 11% +0.0 0.09 ± 20% perf-profile.children.cycles-pp.rcu_needs_cpu
0.10 ± 14% +0.0 0.13 ± 14% perf-profile.children.cycles-pp.local_touch_nmi
0.09 ± 16% +0.0 0.13 ± 12% perf-profile.children.cycles-pp.cpuidle_get_cpu_driver
0.03 ±100% +0.0 0.07 ± 12% perf-profile.children.cycles-pp.symbols__delete
0.13 ± 17% +0.0 0.17 ± 11% perf-profile.children.cycles-pp.__open64
0.07 ± 17% +0.0 0.11 ± 20% perf-profile.children.cycles-pp.update_group_capacity
0.07 ± 26% +0.0 0.12 ± 22% perf-profile.children.cycles-pp.flush_end_io
0.01 ±173% +0.0 0.06 ± 7% perf-profile.children.cycles-pp.rcu_dynticks_task_enter
0.12 ± 26% +0.0 0.17 ± 6% perf-profile.children.cycles-pp.profile_tick
0.13 ± 22% +0.0 0.18 ± 16% perf-profile.children.cycles-pp.write_cache
0.11 ± 14% +0.0 0.15 ± 10% perf-profile.children.cycles-pp.cpu_cache_level__read
0.07 ± 61% +0.0 0.12 ± 11% perf-profile.children.cycles-pp.cpuidle_not_available
0.06 ± 20% +0.1 0.11 ± 17% perf-profile.children.cycles-pp.rcu_irq_exit
0.03 ±102% +0.1 0.09 ± 24% perf-profile.children.cycles-pp.evsel__read_counter
0.07 ± 62% +0.1 0.13 ± 12% perf-profile.children.cycles-pp.balance_fair
0.07 ± 62% +0.1 0.12 ± 23% perf-profile.children.cycles-pp.rcu_idle_enter
0.08 ± 10% +0.1 0.14 ± 30% perf-profile.children.cycles-pp.select_task_rq_fair
0.12 ± 26% +0.1 0.19 ± 11% perf-profile.children.cycles-pp.tick_nohz_tick_stopped
0.06 ± 63% +0.1 0.12 ± 22% perf-profile.children.cycles-pp.blk_mq_trigger_softirq
0.10 ± 4% +0.1 0.16 ± 13% perf-profile.children.cycles-pp.raise_softirq
0.06 ± 17% +0.1 0.12 ± 22% perf-profile.children.cycles-pp.iomap_finish_ioend
0.03 ±102% +0.1 0.09 ± 26% perf-profile.children.cycles-pp.slab_show
0.10 ± 30% +0.1 0.16 ± 20% perf-profile.children.cycles-pp.tick_program_event
0.07 ± 21% +0.1 0.13 ± 28% perf-profile.children.cycles-pp.rcu_is_cpu_rrupt_from_idle
0.04 ± 58% +0.1 0.11 ± 24% perf-profile.children.cycles-pp.end_page_writeback
0.06 ± 59% +0.1 0.12 ± 25% perf-profile.children.cycles-pp.rcu_segcblist_ready_cbs
0.00 +0.1 0.07 ± 16% perf-profile.children.cycles-pp.xfs_iunlink_update_dinode
0.05 ± 67% +0.1 0.13 ± 19% perf-profile.children.cycles-pp.sched_idle_set_state
0.24 ± 14% +0.1 0.32 ± 13% perf-profile.children.cycles-pp.rb_insert_color
0.12 ± 28% +0.1 0.20 ± 19% perf-profile.children.cycles-pp.blk_update_request
0.21 ± 20% +0.1 0.28 ± 13% perf-profile.children.cycles-pp.trigger_load_balance
0.11 ± 16% +0.1 0.19 ± 16% perf-profile.children.cycles-pp.call_cpuidle
0.02 ±173% +0.1 0.10 ± 10% perf-profile.children.cycles-pp.evict
0.01 ±173% +0.1 0.09 ± 20% perf-profile.children.cycles-pp.__x86_retpoline_rbx
0.11 ± 7% +0.1 0.20 ± 19% perf-profile.children.cycles-pp.sched_clock_idle_wakeup_event
0.03 ±102% +0.1 0.11 ± 11% perf-profile.children.cycles-pp.iomap_submit_ioend
0.00 +0.1 0.08 ± 24% perf-profile.children.cycles-pp.cpuidle_select
0.13 ± 15% +0.1 0.21 ± 11% perf-profile.children.cycles-pp.cpu_latency_qos_limit
0.00 +0.1 0.09 ± 44% perf-profile.children.cycles-pp.xfs_inode_set_inactive_tag
0.00 +0.1 0.09 ± 24% perf-profile.children.cycles-pp.find_idlest_group
0.07 ± 26% +0.1 0.16 ± 17% perf-profile.children.cycles-pp.irq_work_tick
0.11 ± 17% +0.1 0.20 ± 20% perf-profile.children.cycles-pp.rcu_nmi_exit
0.13 ± 17% +0.1 0.22 ± 16% perf-profile.children.cycles-pp.update_rt_rq_load_avg
0.09 ± 17% +0.1 0.18 ± 14% perf-profile.children.cycles-pp.tick_check_broadcast_expired
0.00 +0.1 0.10 ± 41% perf-profile.children.cycles-pp.xfs_lock_two_inodes
0.09 ± 19% +0.1 0.19 ± 14% perf-profile.children.cycles-pp.rcu_dynticks_eqs_enter
0.14 ± 25% +0.1 0.24 ± 22% perf-profile.children.cycles-pp.timekeeping_max_deferment
0.10 ± 25% +0.1 0.20 ± 11% perf-profile.children.cycles-pp.tick_nohz_idle_got_tick
0.07 ± 11% +0.1 0.17 ± 23% perf-profile.children.cycles-pp.restore_regs_and_return_to_kernel
0.23 ± 22% +0.1 0.33 ± 21% perf-profile.children.cycles-pp.update_ts_time_stats
0.22 ± 14% +0.1 0.32 ± 2% perf-profile.children.cycles-pp.run_posix_cpu_timers
0.17 ± 21% +0.1 0.28 ± 13% perf-profile.children.cycles-pp.can_stop_idle_tick
0.11 ± 22% +0.1 0.22 ± 11% perf-profile.children.cycles-pp.__intel_pmu_enable_all
0.26 ± 13% +0.1 0.37 ± 5% perf-profile.children.cycles-pp.cpumask_next_and
0.10 ± 18% +0.1 0.21 ± 25% perf-profile.children.cycles-pp.__xfs_buf_submit
0.09 ± 18% +0.1 0.20 ± 11% perf-profile.children.cycles-pp.irq_work_needs_cpu
0.39 ± 8% +0.1 0.50 ± 4% perf-profile.children.cycles-pp.cmd_stat
0.39 ± 8% +0.1 0.50 ± 4% perf-profile.children.cycles-pp.__run_perf_stat
0.39 ± 8% +0.1 0.50 ± 4% perf-profile.children.cycles-pp.dispatch_events
0.38 ± 7% +0.1 0.50 ± 4% perf-profile.children.cycles-pp.process_interval
0.10 ± 25% +0.1 0.22 ± 8% perf-profile.children.cycles-pp.x86_pmu_disable
0.38 ± 7% +0.1 0.50 ± 4% perf-profile.children.cycles-pp.read_counters
0.15 ± 20% +0.1 0.28 ± 21% perf-profile.children.cycles-pp.scsi_io_completion
0.08 ± 10% +0.1 0.21 ± 26% perf-profile.children.cycles-pp._xfs_buf_ioapply
0.03 ±100% +0.1 0.15 ± 48% perf-profile.children.cycles-pp.handle_edge_irq
0.00 +0.1 0.12 ± 17% perf-profile.children.cycles-pp.__x64_sys_unlink
0.15 ± 21% +0.1 0.28 ± 21% perf-profile.children.cycles-pp.scsi_end_request
0.38 ± 10% +0.1 0.51 ± 17% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.10 ± 19% +0.1 0.23 ± 22% perf-profile.children.cycles-pp.xfs_buf_delwri_submit_buffers
0.29 ± 26% +0.1 0.43 ± 9% perf-profile.children.cycles-pp.blk_done_softirq
0.54 ± 17% +0.1 0.68 ± 12% perf-profile.children.cycles-pp.dso__load
0.46 ± 4% +0.1 0.59 ± 10% perf-profile.children.cycles-pp.idle_cpu
0.18 ± 9% +0.1 0.31 ± 18% perf-profile.children.cycles-pp.nr_iowait_cpu
0.53 ± 16% +0.1 0.67 ± 13% perf-profile.children.cycles-pp.__dso__load_kallsyms
0.16 ± 17% +0.1 0.30 ± 11% perf-profile.children.cycles-pp.rcu_nmi_enter
0.17 ± 13% +0.1 0.32 ± 9% perf-profile.children.cycles-pp.irqentry_exit
0.22 ± 33% +0.1 0.36 ± 18% perf-profile.children.cycles-pp.xfs_verify_ino
0.47 ± 2% +0.2 0.64 ± 11% perf-profile.children.cycles-pp.native_irq_return_iret
0.32 ± 17% +0.2 0.49 ± 8% perf-profile.children.cycles-pp.__hrtimer_get_next_event
0.03 ±173% +0.2 0.22 ± 8% perf-profile.children.cycles-pp.xfs_iunlink_update_inode
0.32 ± 9% +0.2 0.52 ± 8% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
0.36 ± 17% +0.2 0.56 ± 14% perf-profile.children.cycles-pp.tick_nohz_irq_exit
0.27 ± 9% +0.2 0.48 ± 11% perf-profile.children.cycles-pp.menu_reflect
0.55 ± 14% +0.2 0.76 ± 9% perf-profile.children.cycles-pp.update_irq_load_avg
1.61 ± 9% +0.2 1.82 perf-profile.children.cycles-pp.update_sd_lb_stats
1.68 ± 7% +0.2 1.89 perf-profile.children.cycles-pp.find_busiest_group
0.38 ± 5% +0.2 0.61 ± 8% perf-profile.children.cycles-pp.arch_cpu_idle_enter
0.29 ± 10% +0.2 0.52 ± 14% perf-profile.children.cycles-pp.rb_erase
0.34 ± 41% +0.2 0.57 ± 15% perf-profile.children.cycles-pp.xfs_dir_ino_validate
0.12 ± 71% +0.2 0.36 ± 22% perf-profile.children.cycles-pp.asm_common_interrupt
0.12 ± 71% +0.2 0.36 ± 22% perf-profile.children.cycles-pp.common_interrupt
0.28 ± 3% +0.2 0.52 ± 8% perf-profile.children.cycles-pp.rcu_eqs_enter
0.23 +0.2 0.48 ± 16% perf-profile.children.cycles-pp.rcu_eqs_exit
0.51 +0.3 0.77 ± 5% perf-profile.children.cycles-pp.cpuidle_governor_latency_req
0.06 ±100% +0.3 0.32 ± 20% perf-profile.children.cycles-pp.path_parentat
0.40 ± 11% +0.3 0.66 ± 9% perf-profile.children.cycles-pp.timerqueue_add
0.29 ± 11% +0.3 0.57 ± 4% perf-profile.children.cycles-pp.irqentry_enter
0.30 ± 7% +0.3 0.59 ± 7% perf-profile.children.cycles-pp.native_apic_msr_eoi_write
0.06 ±100% +0.3 0.34 ± 22% perf-profile.children.cycles-pp.filename_parentat
0.47 ± 7% +0.3 0.76 ± 7% perf-profile.children.cycles-pp.enqueue_hrtimer
0.85 ± 3% +0.3 1.15 ± 5% perf-profile.children.cycles-pp.rcu_sched_clock_irq
0.13 ± 28% +0.3 0.44 ± 55% perf-profile.children.cycles-pp.blk_mq_submit_bio
2.19 ± 4% +0.3 2.51 ± 2% perf-profile.children.cycles-pp.load_balance
0.00 +0.3 0.32 ± 39% perf-profile.children.cycles-pp.xfs_inactive_inode
0.00 +0.3 0.33 ± 39% perf-profile.children.cycles-pp.xfs_inactive_worker
0.00 +0.3 0.33 ± 39% perf-profile.children.cycles-pp.xfs_inode_walk
0.00 +0.3 0.33 ± 39% perf-profile.children.cycles-pp.xfs_inode_walk_ag
0.49 ± 13% +0.3 0.82 ± 5% perf-profile.children.cycles-pp.lapic_next_deadline
0.15 ± 32% +0.3 0.48 ± 52% perf-profile.children.cycles-pp.submit_bio_noacct
0.15 ± 30% +0.3 0.49 ± 52% perf-profile.children.cycles-pp.submit_bio
0.94 ± 22% +0.3 1.28 ± 10% perf-profile.children.cycles-pp.seq_read
0.03 ±173% +0.3 0.37 ± 14% perf-profile.children.cycles-pp.xfs_droplink
0.68 ± 15% +0.4 1.04 ± 12% perf-profile.children.cycles-pp.irqtime_account_irq
0.20 ± 19% +0.4 0.57 ± 11% perf-profile.children.cycles-pp.hrtimer_get_next_event
0.93 ± 19% +0.4 1.30 ± 7% perf-profile.children.cycles-pp.read
0.77 ± 15% +0.4 1.14 ± 12% perf-profile.children.cycles-pp.asm_sysvec_irq_work
0.77 ± 15% +0.4 1.14 ± 12% perf-profile.children.cycles-pp.sysvec_irq_work
0.77 ± 15% +0.4 1.14 ± 12% perf-profile.children.cycles-pp.__sysvec_irq_work
0.77 ± 15% +0.4 1.14 ± 12% perf-profile.children.cycles-pp.irq_work_run
0.77 ± 15% +0.4 1.14 ± 12% perf-profile.children.cycles-pp.irq_work_single
0.50 ± 17% +0.4 0.88 ± 9% perf-profile.children.cycles-pp.timerqueue_del
1.11 ± 10% +0.4 1.49 ± 3% perf-profile.children.cycles-pp.update_rq_clock
0.43 ± 7% +0.4 0.82 ± 11% perf-profile.children.cycles-pp.rcu_idle_exit
1.01 ± 22% +0.4 1.41 ± 6% perf-profile.children.cycles-pp.seq_read_iter
1.04 ± 10% +0.4 1.44 ± 9% perf-profile.children.cycles-pp.update_blocked_averages
0.94 ± 13% +0.4 1.34 ± 4% perf-profile.children.cycles-pp.native_sched_clock
0.97 ± 13% +0.4 1.38 ± 3% perf-profile.children.cycles-pp.sched_clock
0.59 ± 9% +0.4 1.00 ± 14% perf-profile.children.cycles-pp.read_tsc
0.62 ± 16% +0.4 1.04 ± 10% perf-profile.children.cycles-pp.__remove_hrtimer
0.79 ± 10% +0.4 1.22 ± 18% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.85 ± 15% +0.4 1.27 ± 8% perf-profile.children.cycles-pp.irq_work_run_list
1.04 ± 11% +0.4 1.48 ± 10% perf-profile.children.cycles-pp.run_rebalance_domains
1.19 ± 11% +0.5 1.70 ± 5% perf-profile.children.cycles-pp.sched_clock_cpu
1.66 ± 16% +0.5 2.18 ± 5% perf-profile.children.cycles-pp.ksys_read
1.62 ± 16% +0.5 2.15 ± 5% perf-profile.children.cycles-pp.vfs_read
1.00 ± 11% +0.5 1.55 ± 8% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
0.21 ± 65% +0.6 0.82 ± 11% perf-profile.children.cycles-pp.xfs_dir2_leafn_lookup_for_entry
1.41 ± 10% +0.6 2.02 ± 3% perf-profile.children.cycles-pp.rebalance_domains
0.09 ± 78% +0.6 0.72 ± 10% perf-profile.children.cycles-pp.xfs_iunlink
0.61 ± 26% +0.6 1.25 ± 7% perf-profile.children.cycles-pp.__hrtimer_next_event_base
0.42 ± 19% +0.7 1.12 ± 5% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.42 ± 15% +0.8 1.20 ± 5% perf-profile.children.cycles-pp.hrtimer_next_event_without
0.04 ±173% +0.8 0.83 ± 12% perf-profile.children.cycles-pp.xfs_dir2_leafn_remove
4.97 ± 9% +1.1 6.02 ± 6% perf-profile.children.cycles-pp.update_process_times
1.20 ± 8% +1.1 2.27 ± 5% perf-profile.children.cycles-pp.tick_nohz_next_event
1.45 ± 15% +1.1 2.55 ± 12% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
5.26 ± 10% +1.2 6.44 ± 5% perf-profile.children.cycles-pp.tick_sched_handle
1.96 ± 9% +1.2 3.14 ± 9% perf-profile.children.cycles-pp.clockevents_program_event
4.18 ± 8% +1.3 5.47 ± 8% perf-profile.children.cycles-pp.do_softirq_own_stack
4.62 ± 5% +1.3 5.96 ± 7% perf-profile.children.cycles-pp.__softirqentry_text_start
4.88 ± 8% +1.7 6.56 ± 7% perf-profile.children.cycles-pp.irq_exit_rcu
1.96 ± 8% +2.0 3.99 ± 4% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.30 ± 73% +2.1 2.38 ± 10% perf-profile.children.cycles-pp.xfs_dir_removename
0.10 ±173% +2.1 2.22 ± 11% perf-profile.children.cycles-pp.xfs_dir2_node_removename
6.44 ± 6% +2.1 8.58 ± 4% perf-profile.children.cycles-pp.tick_sched_timer
1.36 ± 17% +2.6 3.96 ± 23% perf-profile.children.cycles-pp.tick_irq_enter
1.53 ± 16% +2.7 4.26 ± 21% perf-profile.children.cycles-pp.irq_enter_rcu
9.28 ± 7% +3.8 13.08 ± 2% perf-profile.children.cycles-pp.__hrtimer_run_queues
3.32 ± 9% +4.0 7.34 ± 14% perf-profile.children.cycles-pp.ktime_get
4.75 ± 5% +4.4 9.13 ± 4% perf-profile.children.cycles-pp.menu_select
3.46 ± 71% +6.6 10.09 ± 12% perf-profile.children.cycles-pp.do_unlinkat
14.06 ± 7% +6.8 20.90 ± 2% perf-profile.children.cycles-pp.hrtimer_interrupt
14.67 ± 6% +7.2 21.90 ± 2% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
1.32 ± 78% +7.8 9.12 ± 11% perf-profile.children.cycles-pp.xfs_remove
1.32 ± 79% +7.8 9.14 ± 11% perf-profile.children.cycles-pp.xfs_vn_unlink
1.35 ± 78% +7.9 9.23 ± 11% perf-profile.children.cycles-pp.vfs_unlink
9.22 ± 4% +8.9 18.09 ± 3% perf-profile.children.cycles-pp.intel_idle
19.09 ± 6% +9.2 28.32 perf-profile.children.cycles-pp.asm_call_sysvec_on_stack
22.23 ± 6% +12.4 34.64 ± 2% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
23.96 ± 5% +12.9 36.82 ± 2% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
33.00 ± 3% +25.2 58.22 perf-profile.children.cycles-pp.cpuidle_enter_state
33.11 ± 3% +25.2 58.35 perf-profile.children.cycles-pp.cpuidle_enter
41.93 ± 2% +29.6 71.50 perf-profile.children.cycles-pp.start_secondary
42.58 ± 3% +29.7 72.25 perf-profile.children.cycles-pp.secondary_startup_64_no_verify
42.58 ± 3% +29.7 72.25 perf-profile.children.cycles-pp.cpu_startup_entry
42.57 ± 3% +29.7 72.25 perf-profile.children.cycles-pp.do_idle
1.78 ± 26% -1.7 0.04 ± 58% perf-profile.self.cycles-pp.__xfs_btree_check_sblock
1.58 ± 15% -1.3 0.24 ± 20% perf-profile.self.cycles-pp.__percpu_counter_sum
1.55 ± 18% -1.2 0.36 ± 51% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
0.92 ± 18% -0.8 0.12 ± 22% perf-profile.self.cycles-pp.xfs_errortag_test
1.46 ± 5% -0.8 0.70 ± 10% perf-profile.self.cycles-pp.__orc_find
0.87 ± 21% -0.7 0.14 ± 13% perf-profile.self.cycles-pp.xfs_next_bit
1.17 ± 9% -0.5 0.65 ± 26% perf-profile.self.cycles-pp.unwind_next_frame
0.74 ± 34% -0.5 0.26 ± 15% perf-profile.self.cycles-pp.queue_event
0.49 ± 19% -0.3 0.15 ± 23% perf-profile.self.cycles-pp.xfs_agino_range
0.47 ± 11% -0.2 0.23 ± 16% perf-profile.self.cycles-pp.kmem_cache_alloc
0.51 ± 11% -0.2 0.28 ± 6% perf-profile.self.cycles-pp.xfs_dir3_leaf_check_int
0.65 ± 16% -0.2 0.42 ± 17% perf-profile.self.cycles-pp.memcpy_erms
0.30 ± 21% -0.2 0.09 ± 24% perf-profile.self.cycles-pp.xfs_ag_block_count
0.29 ± 13% -0.2 0.09 ± 27% perf-profile.self.cycles-pp.xfs_buf_item_format
0.32 ± 17% -0.2 0.14 ± 41% perf-profile.self.cycles-pp.__module_address
0.36 ± 10% -0.2 0.19 ± 31% perf-profile.self.cycles-pp.kmem_cache_free
0.23 ± 11% -0.2 0.07 ± 69% perf-profile.self.cycles-pp.xlog_cil_insert_items
0.18 ± 10% -0.1 0.03 ±102% perf-profile.self.cycles-pp.kernel_text_address
0.23 ± 28% -0.1 0.09 ± 17% perf-profile.self.cycles-pp.evsel__parse_sample
0.32 ± 12% -0.1 0.17 ± 24% perf-profile.self.cycles-pp.___might_sleep
0.21 ± 19% -0.1 0.07 ± 72% perf-profile.self.cycles-pp.evlist__parse_sample
0.30 ± 6% -0.1 0.16 ± 7% perf-profile.self.cycles-pp.perf_output_sample
0.36 ± 9% -0.1 0.22 ± 6% perf-profile.self.cycles-pp.orc_find
0.30 ± 16% -0.1 0.17 ± 20% perf-profile.self.cycles-pp.xfs_buf_find
0.20 ± 13% -0.1 0.08 ± 58% perf-profile.self.cycles-pp.xfs_log_commit_cil
0.28 ± 14% -0.1 0.17 ± 35% perf-profile.self.cycles-pp.stack_access_ok
0.26 ± 10% -0.1 0.14 ± 13% perf-profile.self.cycles-pp.perf_callchain_kernel
0.16 ± 18% -0.1 0.05 ± 58% perf-profile.self.cycles-pp.__list_add_valid
0.29 ± 17% -0.1 0.19 ± 25% perf-profile.self.cycles-pp.__update_load_avg_se
0.14 ± 10% -0.1 0.04 ±102% perf-profile.self.cycles-pp.__radix_tree_lookup
0.13 ± 26% -0.1 0.03 ±100% perf-profile.self.cycles-pp.xfs_buf_item_size_segment
0.12 ± 15% -0.1 0.03 ±100% perf-profile.self.cycles-pp.memset_erms
0.13 ± 19% -0.1 0.04 ± 58% perf-profile.self.cycles-pp.perf_output_begin_forward
0.12 ± 13% -0.1 0.04 ±102% perf-profile.self.cycles-pp.link_path_walk
0.12 ± 13% -0.1 0.03 ±100% perf-profile.self.cycles-pp.xfs_buf_get_map
0.15 ± 17% -0.1 0.07 ± 64% perf-profile.self.cycles-pp.perf_output_copy
0.24 ± 24% -0.1 0.16 ± 9% perf-profile.self.cycles-pp.__list_del_entry_valid
0.13 ± 14% -0.1 0.06 ± 60% perf-profile.self.cycles-pp.xfs_inode_item_format
0.16 ± 13% -0.1 0.09 ± 32% perf-profile.self.cycles-pp.perf_prepare_sample
0.10 ± 17% -0.1 0.03 ±102% perf-profile.self.cycles-pp.finish_task_switch
0.10 ± 4% -0.1 0.03 ±100% perf-profile.self.cycles-pp.update_cfs_group
0.11 ± 17% -0.1 0.04 ±100% perf-profile.self.cycles-pp.xfs_buf_item_init
0.10 ± 15% -0.1 0.03 ±100% perf-profile.self.cycles-pp.perf_trace_sched_switch
0.13 ± 25% -0.1 0.07 ± 12% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.18 ± 8% -0.1 0.12 ± 32% perf-profile.self.cycles-pp.__unwind_start
0.17 ± 19% -0.1 0.11 ± 17% perf-profile.self.cycles-pp.__d_lookup_rcu
0.10 ± 11% -0.1 0.04 ±103% perf-profile.self.cycles-pp.enqueue_entity
0.26 ± 9% -0.1 0.20 ± 22% perf-profile.self.cycles-pp.__schedule
0.11 ± 15% -0.1 0.05 ± 59% perf-profile.self.cycles-pp.xfs_buf_item_log
0.12 ± 27% -0.1 0.07 ± 59% perf-profile.self.cycles-pp.___perf_sw_event
0.17 ± 8% -0.1 0.11 ± 24% perf-profile.self.cycles-pp.__might_sleep
0.10 ± 29% -0.0 0.05 ± 61% perf-profile.self.cycles-pp.__task_pid_nr_ns
0.10 ± 25% -0.0 0.06 ± 11% perf-profile.self.cycles-pp.xfs_trans_add_item
0.08 ± 10% +0.0 0.11 ± 13% perf-profile.self.cycles-pp.arch_scale_freq_tick
0.09 ± 16% +0.0 0.12 ± 12% perf-profile.self.cycles-pp.cpuidle_get_cpu_driver
0.06 ± 15% +0.0 0.10 ± 28% perf-profile.self.cycles-pp.rcu_is_cpu_rrupt_from_idle
0.07 ± 17% +0.0 0.11 ± 11% perf-profile.self.cycles-pp.map__process_kallsym_symbol
0.07 ± 17% +0.0 0.11 ± 17% perf-profile.self.cycles-pp.update_group_capacity
0.01 ±173% +0.0 0.06 ± 7% perf-profile.self.cycles-pp.rcu_dynticks_task_enter
0.10 ± 25% +0.0 0.14 ± 15% perf-profile.self.cycles-pp.tick_sched_timer
0.09 ± 30% +0.0 0.13 ± 11% perf-profile.self.cycles-pp.vsnprintf
0.12 ± 26% +0.0 0.17 ± 6% perf-profile.self.cycles-pp.profile_tick
0.05 ± 67% +0.1 0.10 ± 19% perf-profile.self.cycles-pp.rcu_idle_enter
0.06 ± 20% +0.1 0.11 ± 15% perf-profile.self.cycles-pp.irqentry_exit
0.15 ± 25% +0.1 0.21 ± 13% perf-profile.self.cycles-pp.trigger_load_balance
0.07 ± 24% +0.1 0.13 ± 31% perf-profile.self.cycles-pp.irq_work_run_list
0.10 ± 4% +0.1 0.16 ± 11% perf-profile.self.cycles-pp.raise_softirq
0.05 ± 62% +0.1 0.11 ± 20% perf-profile.self.cycles-pp.rcu_segcblist_ready_cbs
0.07 ± 25% +0.1 0.13 ± 9% perf-profile.self.cycles-pp.irq_work_tick
0.10 ± 33% +0.1 0.16 ± 19% perf-profile.self.cycles-pp.tick_program_event
0.05 ± 62% +0.1 0.12 ± 29% perf-profile.self.cycles-pp.sched_idle_set_state
0.16 ± 20% +0.1 0.23 ± 19% perf-profile.self.cycles-pp._raw_spin_lock_irq
0.24 ± 14% +0.1 0.31 ± 8% perf-profile.self.cycles-pp.rebalance_domains
0.00 +0.1 0.07 ± 17% perf-profile.self.cycles-pp.cpuidle_select
0.28 ± 14% +0.1 0.35 ± 5% perf-profile.self.cycles-pp.perf_mux_hrtimer_handler
0.01 ±173% +0.1 0.09 ± 19% perf-profile.self.cycles-pp.__x86_retpoline_rbx
0.00 +0.1 0.07 ± 24% perf-profile.self.cycles-pp.find_idlest_group
0.10 ± 18% +0.1 0.17 ± 15% perf-profile.self.cycles-pp.call_cpuidle
0.08 +0.1 0.15 ± 17% perf-profile.self.cycles-pp.sched_clock_idle_wakeup_event
0.07 ± 7% +0.1 0.14 ± 23% perf-profile.self.cycles-pp.tick_nohz_irq_exit
0.06 ± 58% +0.1 0.13 ± 14% perf-profile.self.cycles-pp.rcu_nmi_exit
0.09 ± 21% +0.1 0.17 ± 16% perf-profile.self.cycles-pp.tick_check_broadcast_expired
0.10 ± 27% +0.1 0.18 ± 8% perf-profile.self.cycles-pp.tick_nohz_idle_got_tick
0.09 ± 17% +0.1 0.17 ± 9% perf-profile.self.cycles-pp.rcu_dynticks_eqs_enter
0.11 ± 23% +0.1 0.20 ± 11% perf-profile.self.cycles-pp.cpu_latency_qos_limit
0.13 ± 19% +0.1 0.22 ± 16% perf-profile.self.cycles-pp.update_rt_rq_load_avg
0.12 ± 22% +0.1 0.22 ± 14% perf-profile.self.cycles-pp.cpuidle_governor_latency_req
0.07 ± 17% +0.1 0.17 ± 24% perf-profile.self.cycles-pp.restore_regs_and_return_to_kernel
0.08 ± 17% +0.1 0.18 ± 13% perf-profile.self.cycles-pp.hrtimer_next_event_without
0.06 ± 58% +0.1 0.16 ± 13% perf-profile.self.cycles-pp.irq_work_needs_cpu
0.24 ± 10% +0.1 0.34 ± 8% perf-profile.self.cycles-pp.scheduler_tick
0.22 ± 6% +0.1 0.32 ± 10% perf-profile.self.cycles-pp.sched_clock_cpu
0.21 ± 13% +0.1 0.32 ± 3% perf-profile.self.cycles-pp.run_posix_cpu_timers
0.17 ± 21% +0.1 0.28 ± 13% perf-profile.self.cycles-pp.can_stop_idle_tick
0.28 ± 16% +0.1 0.38 ± 10% perf-profile.self.cycles-pp.__sysvec_apic_timer_interrupt
0.11 ± 22% +0.1 0.22 ± 11% perf-profile.self.cycles-pp.__intel_pmu_enable_all
0.10 ± 28% +0.1 0.21 ± 6% perf-profile.self.cycles-pp.x86_pmu_disable
0.24 ± 21% +0.1 0.36 ± 9% perf-profile.self.cycles-pp.irq_exit_rcu
0.19 ± 4% +0.1 0.32 ± 2% perf-profile.self.cycles-pp.irq_enter_rcu
0.03 ±105% +0.1 0.15 ± 9% perf-profile.self.cycles-pp.hrtimer_get_next_event
0.18 ± 8% +0.1 0.30 ± 15% perf-profile.self.cycles-pp.clockevents_program_event
0.17 ± 10% +0.1 0.30 ± 19% perf-profile.self.cycles-pp.nr_iowait_cpu
0.17 ± 7% +0.1 0.29 ± 14% perf-profile.self.cycles-pp.menu_reflect
0.37 ± 10% +0.1 0.50 ± 17% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.20 ± 17% +0.1 0.33 ± 20% perf-profile.self.cycles-pp.rcu_idle_exit
0.12 ± 25% +0.1 0.26 ± 8% perf-profile.self.cycles-pp.irqentry_enter
0.13 ± 23% +0.1 0.26 ± 17% perf-profile.self.cycles-pp.rcu_nmi_enter
0.14 ± 26% +0.1 0.28 ± 20% perf-profile.self.cycles-pp.asm_sysvec_apic_timer_interrupt
0.45 ± 2% +0.1 0.59 ± 9% perf-profile.self.cycles-pp.idle_cpu
0.42 ± 6% +0.1 0.56 ± 4% perf-profile.self.cycles-pp.update_rq_clock
0.19 ± 11% +0.2 0.34 ± 11% perf-profile.self.cycles-pp.rcu_eqs_enter
0.47 ± 2% +0.2 0.63 ± 11% perf-profile.self.cycles-pp.native_irq_return_iret
0.20 ± 19% +0.2 0.36 ± 7% perf-profile.self.cycles-pp.timerqueue_del
0.67 ± 5% +0.2 0.83 perf-profile.self.cycles-pp.rcu_sched_clock_irq
0.49 ± 21% +0.2 0.67 ± 16% perf-profile.self.cycles-pp.update_process_times
0.19 ± 19% +0.2 0.37 ± 16% perf-profile.self.cycles-pp.tick_irq_enter
0.24 ± 12% +0.2 0.43 ± 6% perf-profile.self.cycles-pp.tsc_verify_tsc_adjust
0.20 ± 12% +0.2 0.39 ± 14% perf-profile.self.cycles-pp.sysvec_apic_timer_interrupt
0.55 ± 14% +0.2 0.74 ± 9% perf-profile.self.cycles-pp.update_irq_load_avg
0.44 ± 16% +0.2 0.64 ± 6% perf-profile.self.cycles-pp.__hrtimer_run_queues
0.21 ± 18% +0.2 0.41 ± 4% perf-profile.self.cycles-pp.timerqueue_add
0.28 ± 11% +0.2 0.48 ± 12% perf-profile.self.cycles-pp.rb_erase
0.11 ± 20% +0.2 0.32 ± 28% perf-profile.self.cycles-pp.rcu_eqs_exit
0.41 ± 13% +0.2 0.63 ± 11% perf-profile.self.cycles-pp.hrtimer_interrupt
0.47 ± 9% +0.2 0.70 ± 8% perf-profile.self.cycles-pp.tick_nohz_next_event
0.17 ± 16% +0.2 0.40 ± 4% perf-profile.self.cycles-pp.get_next_timer_interrupt
0.73 ± 14% +0.3 0.99 ± 8% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.30 ± 7% +0.3 0.58 ± 7% perf-profile.self.cycles-pp.native_apic_msr_eoi_write
0.49 ± 13% +0.3 0.82 ± 5% perf-profile.self.cycles-pp.lapic_next_deadline
0.57 ± 8% +0.4 0.94 ± 2% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.88 ± 14% +0.4 1.26 ± 3% perf-profile.self.cycles-pp.native_sched_clock
0.53 ± 13% +0.4 0.93 ± 10% perf-profile.self.cycles-pp.do_idle
0.56 ± 8% +0.4 0.96 ± 12% perf-profile.self.cycles-pp.read_tsc
0.56 ± 23% +0.6 1.16 ± 5% perf-profile.self.cycles-pp.__hrtimer_next_event_base
1.23 ± 12% +0.7 1.92 perf-profile.self.cycles-pp.cpuidle_enter_state
1.29 ± 18% +1.0 2.30 ± 12% perf-profile.self.cycles-pp.ktime_get_update_offsets_now
2.11 ± 11% +2.0 4.07 ± 10% perf-profile.self.cycles-pp.menu_select
2.82 ± 9% +3.6 6.44 ± 16% perf-profile.self.cycles-pp.ktime_get
9.22 ± 4% +8.9 18.09 ± 3% perf-profile.self.cycles-pp.intel_idle
fxmark.hdd_xfs_MWUL_72_directio.sys_sec
25 +----------------------------------------------------------------------+
| |
| |
20 |-+ +..+.+.. .+..+..+.+..+.+.. .+.. .|
|..+ : +.+..+.+..+ + +.+..+.+..+.+..+.+. |
| : : |
15 |-+: : |
| : : |
10 |-+ : : O O O O O |
| O:O O:O O O O O O O O O O O O O O O |
| : : |
5 |-+ : : |
| : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_72_directio.sys_util
1.2 +---------------------------------------------------------------------+
| .+.+..+. .+. .+. .+. +.. .+..+.+..+.+..+.|
1 |.. +..+.+. +. +. +. +.. + +.+..+ |
| : + |
| + : |
0.8 |-+: : |
| : : |
0.6 |-+ : : |
| : : O O |
0.4 |-+O:O O:O O O O O O O O O O O O O O O O O O |
| : : |
| : : |
0.2 |-+ : : |
| : : |
0 +---------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_63_directio.secs
35 +----------------------------------------------------------------------+
| |
30 |-+O O O O O O O O O O O O O O O O O O O O O O O |
| |
25 |-+ |
| .+.. +.. .+.. |
20 |..+ .+. .+.+..+. .+.+..+..+.+..+. .+ + + + +. .|
| : +. +. +. +. + + .. +. |
15 |-+ : : + |
| : : |
10 |-+ : : |
| : : |
5 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_63_directio.works
60000 +-------------------------------------------------------------------+
| .+.. .+. .+.. .+. .+.. |
50000 |.+ +.+..+.+ +.+..+.+. + +.+. +..+.+.+..+ +.+..+.|
| : : |
| : : O O O O O O |
40000 |-O: O O :O O O O O O O O O O O O |
| : : O O |
30000 |-+: : |
| : : |
20000 |-+ : : |
| : : |
| : : |
10000 |-+ : : |
| : : |
0 +-------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_63_directio.works_sec
4000 +--------------------------------------------------------------------+
| + |
3500 |-+ + : |
3000 |-+ + .+ +.. + : |
|.+ :+ .+. .+. + .+..+.+.+..+. + + : .+.|
2500 |-: : +. +..+ +..+ +..+ +.+.. + +. |
| : : + |
2000 |-+: : |
| : : |
1500 |-+ :O : O O O O O O O O O |
1000 |-O : O: O O O O O O O O O O O |
| : : |
500 |-+ : : |
| : : |
0 +--------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_63_directio.real_sec
35 +----------------------------------------------------------------------+
| |
30 |-+O O O O O O O O O O O O O O O O O O O O O O O |
| |
25 |-+ +.. |
| .+ +.. + |
20 |..+ +. .+.+.. .+.+..+..+.+..+. .+ + : + + +. .|
| : .. +. +.+. +. + : : + +. |
15 |-+ : + + : + |
| : : + |
10 |-+ : : |
| : : |
5 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_63_directio.user_sec
12 +----------------------------------------------------------------------+
| |
10 |-+ O |
| |
| O O O O O O O O |
8 |-+O O O O O O O O O O O O O O |
| |
6 |-+ |
| |
4 |-+ |
|..+ +..+. .+.+..+.+..+.+..+..+.+..+.+..+.+.. .+..+.+..+. .+.+..|
| : : +. + +. |
2 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_63_directio.idle_sec
2000 +--------------------------------------------------------------------+
1800 |-O O O O O O O O O O O O O O O O O O O O O O O |
| |
1600 |-+ |
1400 |-+ .+ |
|. +.. +.. +.. .+..+ +.+. + +.. .|
1200 |-+ + + +.+.. + +.+..+.+.+..+ + .. + : + |
1000 |-: + + + + + : |
800 |-+: : + : |
| : : + |
600 |-+ : : |
400 |-+ : : |
| : : |
200 |-+ : : |
0 +--------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_63_directio.sys_util
2 +---------------------------------------------------------------------+
1.8 |-+ + |
| + + + : |
1.6 |..: +.. + + +.. .+.. .+. .+.. + : |
1.4 |-+: : + + + + +.+..+.+..+.+. +..+ +.+.. .+ +..+.|
| : : + + |
1.2 |-+ : : |
1 |-+ : : |
0.8 |-+ : : |
| : : O O O O |
0.6 |-+O:O O:O O O O O O O O O O O O O O O O |
0.4 |-+ : : |
| : : |
0.2 |-+ : : |
0 +---------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_54_directio.secs
35 +----------------------------------------------------------------------+
| |
30 |-+O O O O O O O O O O O O O O O O O O O O O O O |
| |
25 |-+ |
| +.. |
20 |..+ +.. .+..+.+.. + .+.. .+. .+..+. .+.+..|
| : : + + + +..+.+..+.+. +..+ +..+.+. |
15 |-+ : : |
| : : |
10 |-+ : : |
| : : |
5 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_54_directio.works_sec
3500 +--------------------------------------------------------------------+
| +.. +.. +. |
3000 |-+ + .+ : .+..+.+.+..+. .. +.. .+.+..+. |
| + +. .+ + : + + +.+. +..+.|
2500 |.+ : +. + : |
| : : + |
2000 |-+: : |
| : : |
1500 |-+: : O O O O O O O O O |
| O :O : O O O O O O O O O |
1000 |-+ : O: O O |
| : : |
500 |-+ : : |
| : : |
0 +--------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_54_directio.real_sec
35 +----------------------------------------------------------------------+
| |
30 |-+O O O O O O O O O O O O O O O O O O O O O O O |
| |
25 |-+ |
| .+. +.. |
20 |..+ +.. .+. +.. + .+.. .+. .+..+. .+.+..|
| : : + + + +..+.+..+.+. +..+ +..+.+. |
15 |-+ : : |
| : : |
10 |-+ : : |
| : : |
5 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_54_directio.sys_sec
18 +----------------------------------------------------------------------+
|..+ +..+.+..+.+..+.+..+.+..+..+.+..+. .. +..+.+..+.+..+ +.+..|
16 |-+: : + |
14 |-+: : |
| : : |
12 |-+ : : |
10 |-+ : : O O O O O O O O O |
| O:O :O O O O O O O O O O |
8 |-+ : O: O |
6 |-+ : : |
| : : |
4 |-+ : : |
2 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_54_directio.idle_sec
1800 +--------------------------------------------------------------------+
| O O |
1600 |-O O O O O O O O O O O O O O O O O O O O O |
1400 |-+ |
| |
1200 |-+ .+.. + |
1000 |.+ +. .+ +. .. + .+. .+.. .+.+.. .+..+.|
| : : +. + +. +..+.+.+..+ +.+. +.+..+ |
800 |-+: : |
600 |-+: : |
| : : |
400 |-+ : : |
200 |-+ : : |
| : : |
0 +--------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_54_directio.sys_util
2 +---------------------------------------------------------------------+
1.8 |-+ + + .+.. .+.. .+. .+ |
| .. + .+ : + .+ + +.+. +.. .+..+.+. + |
1.6 |..+ + +.. .+. : : +. + +..+.|
1.4 |-+: : + : : |
| : : + |
1.2 |-+ : : |
1 |-+ : : |
0.8 |-+ : : |
| : : |
0.6 |-+O:O :O O O O O O O O O O O O O O O O O O O |
0.4 |-+ : O: O |
| : : |
0.2 |-+ : : |
0 +---------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_45_directio.secs
35 +----------------------------------------------------------------------+
| |
30 |-+O O O O O O O O O O O O O O O O O O O O O O |
| |
25 |-+ O |
| |
20 |-+ |
| +.. |
15 |-.+ : +. .+.+..+.+..+.+..+..+.+..+.+..+.+..+.+..+.+..+. .+. .|
|. : : +. +. +. |
10 |-+ : : |
| : : |
5 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_45_directio.works_sec
4500 +--------------------------------------------------------------------+
| + + + + |
4000 |.+ + +..+. +.. .+.. .+..+. .. + .. +|
3500 |-+ .+ +.. + +.+.. .+. .+ + +..+.+ + |
| : + + + +. |
3000 |-+: : |
2500 |-+: : |
| : : |
2000 |-+: : O O O O O |
1500 |-O :O O :O O O O O O O O O O O O O O |
| : : |
1000 |-+ : : O |
500 |-+ : : |
| : : |
0 +--------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_45_directio.real_sec
35 +----------------------------------------------------------------------+
| |
30 |-+O O O O O O O O O O O O O O O O O O O O O O |
| |
25 |-+ O |
| |
20 |-+ |
| +.. |
15 |-.+ : +. .+.+..+.+..+.+..+..+.+..+.+..+.+..+.+..+.+..+. .+. .|
|. : : +. +. +. |
10 |-+ : : |
| : : |
5 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_45_directio.sys_sec
16 +----------------------------------------------------------------------+
|. : : + + +..+.+..+. +. +..+.+. +. +. |
14 |-+: : |
12 |-+: : |
| : : |
10 |-+ : :O O O O O O O O O O O O O O O O O O |
| O:O O: O |
8 |-+ : : O |
| : : |
6 |-+ : : |
4 |-+ : : |
| : : |
2 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_45_directio.idle_sec
1400 +--------------------------------------------------------------------+
| O O O O O O O O O O O O O O O O O O O O O O |
1200 |-+ |
| O |
1000 |-+ |
| |
800 |-+ |
|.+ +. .+..+. .+. .+.. .+..+. |
600 |-: : +.. .+..+ +..+.+. + +.+..+.+..+ +..+.+.. .|
| : : + + |
400 |-+: : |
| : : |
200 |-+ : : |
| : : |
0 +--------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_45_directio.irq_sec
25 +----------------------------------------------------------------------+
| |
| O O O O |
20 |-+O O O O O O O O O O O O O O O O O |
| O |
| O |
15 |-+ |
| |
10 |-.+ +..+. .+.+..+.+.. .+..+..+.+..+.+..+.+..+. .+.+..+. .+. .|
|. : : +. + +. +. +. |
| : : |
5 |-+ : : |
| : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_45_directio.user_util
0.45 +--------------------------------------------------------------------+
| +. .+ + |
0.4 |.+ .. +. : .+.. .+.. .+. +..+. .. +|
0.35 |-+ .+ : .+ +.+.. .+. .+ +.+. +.. + + |
| : + +. + +. + |
0.3 |-+: : |
0.25 |-+: : |
| O: O O :O O O O O O O O O O O O O O |
0.2 |-+: : O O O O O O |
0.15 |-+ : : |
| : : |
0.1 |-+ : : |
0.05 |-+ : : |
| : : |
0 +--------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_45_directio.sys_util
3 +---------------------------------------------------------------------+
| : + + |
2.5 |.. : + .+.. .+.. .+. .. +|
| + .+ + .+.+..+. .+. .+ .+..+.+..+.+. + |
| : +. +.+. +. +. + |
2 |-+: : |
| : : |
1.5 |-+ : : |
| : : |
1 |-+ : : |
| : : O O O O O O O O O |
| O:O O:O O O O O O O O O O O |
0.5 |-+ : : |
| : : |
0 +---------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_36_directio.secs
35 +----------------------------------------------------------------------+
| |
30 |-+ O O O O O O O |
| O O O O O O O |
25 |-+ O O O O O O |
| O O O |
20 |-+ |
| |
15 |-+ |
| .+. .+.+.. .+..+. + +. .+. .+. .+.+.. .+.. .+..|
10 |..+ +. +. + +.. .. + .. +. +. +. + + |
| : : + + |
5 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_36_directio.works_sec
7000 +--------------------------------------------------------------------+
| |
6000 |-+ + + |
|+ + + : :: + |
5000 |-+ .. + .+.. .+ : : : + + .+ +. .+.. .+.. +|
| : +.+ +..+ +.+. : : :+ +. + .. +..+ + + |
4000 |-+: : + + + |
| : : |
3000 |-+: : |
| : O : O |
2000 |-O :O : O O O O O O O O O O O O O O O O |
| : : O O O |
1000 |-+ : : |
| : : |
0 +--------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_36_directio.real_sec
35 +----------------------------------------------------------------------+
| |
30 |-+ O O O O O O O O |
| O O O O O O |
25 |-+ O O O O O O O |
| O O |
20 |-+ |
| |
15 |-+ + + |
| .+ +..+. .+.+.. .+..+. + : + + .+. .+.+..+.+.. .+.. .+..|
10 |.+: : +. + +.. + : + +. +. + + |
| : : + + |
5 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_36_directio.sys_sec
16 +----------------------------------------------------------------------+
| .+ +..+.+..+.+..+.+..+.+.. .+. .+. .+.+..+.+..+.+..+.+..+.+..|
14 |.+: : +. +. +. |
12 |-+: : |
| : : |
10 |-+O: : O O O O O O O O O O O O O O O O |
| :O O:O O O O |
8 |-+ : : |
| : : |
6 |-+ : : |
4 |-+ : : |
| : : |
2 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_36_directio.idle_sec
1200 +--------------------------------------------------------------------+
| |
1000 |-+ O O O O O O O O |
| O O O O O O O O |
| O O O O O |
800 |-+ O O |
| |
600 |-+ |
| |
400 |-+ .+.. .+..+. .+.+.. + +.. .+.. .+.. .+..+. .+. .+.|
|.+ + + +. +. .. + + + + + +. +. |
| : : + + |
200 |-+ : : |
| : : |
0 +--------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_36_directio.irq_sec
18 +----------------------------------------------------------------------+
| O O O |
16 |-+ O O O O O O |
14 |-+O O O O O O O O O O |
| O O O O |
12 |-+ |
10 |-+ |
| |
8 |-+ + +. .+. |
6 |-.+ +..+.+..+.+..+.+..+.+.. .. + .. +..+.+. +..+.+..+.+..+.+..|
|. : : + + |
4 |-+ : : |
2 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_36_directio.user_util
0.6 +---------------------------------------------------------------------+
|.. + : : : |
0.5 |-+ .+.. .+. .+. + : : : +. .+ .+.. .+.. .|
| + +..+ .+. +. + :: :.. +. + .+. .+ + + |
| : : + + + +. +. |
0.4 |-+: : |
| : : |
0.3 |-+ : O: O O |
| O:O :O O O O O O O O O O O O O O O O O |
0.2 |-+ : : O |
| : : |
| : : |
0.1 |-+ : : |
| : : |
0 +---------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_36_directio.sys_util
5 +---------------------------------------------------------------------+
4.5 |-+ + + |
|.. ..: :: |
4 |-+ .+.. .+. .+ : : : +. .+ .+.. .+.. +|
3.5 |-++ +..+ .+. +..+ : : : + +. + .+. .+ + + |
| : : + :: :+ +. +. |
3 |-+: : + + |
2.5 |-+ : : |
2 |-+ : : |
| : : |
1.5 |-+ : : |
1 |-+O:O O:O O O O O O O O O O O O O O O O O O O O |
| : : |
0.5 |-+ : : |
0 +---------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_27_directio.secs
25 +----------------------------------------------------------------------+
| O |
| O O O O O O |
20 |-+ O O O O O O |
| O O O O O O O O O |
| O |
15 |-+ |
| |
10 |-+ |
|.. +..+. .+. .+..+.+.. .+. .+. .+. .+. .+. .|
| + : +. +..+ +. +. +. +..+.+..+.+. +. +. |
5 |-+ : : |
| : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_27_directio.works_sec
8000 +--------------------------------------------------------------------+
| : : +.+.. +.. + +. + : |
7000 |.+ : : .. + + + .+. .. +..+.+..+. + : + |
6000 |-: +. : + +.+..+ + +. + + :.. +|
| : : + + |
5000 |-+: : |
| : : |
4000 |-+: : |
| :O : |
3000 |-+ : O: O O O O O O O O O O O O O O |
2000 |-O : : O O O O O O |
| : : |
1000 |-+ : : |
| : : |
0 +--------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_27_directio.real_sec
25 +----------------------------------------------------------------------+
| O O |
| O O O O O O |
20 |-+ O O O O O |
| O O O O O O O O O |
| O |
15 |-+ |
| |
10 |-+ |
|.. +..+. .+. .+..+.+.. .+. .+. .+. .+..+. .+. .|
| + : +. +..+ +. +. +. +..+.+..+ +. +. |
5 |-+ : : |
| : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_27_directio.sys_sec
16 +----------------------------------------------------------------------+
| |
14 |..+ +..+.+..+.+..+.+..+.+..+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..|
12 |-+: : |
| : : |
10 |-+ : : |
| O:O : O O O O O O O O O O O O O O O O O O |
8 |-+ : O:O O |
| : : |
6 |-+ : : |
4 |-+ : : |
| : : |
2 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_27_directio.idle_sec
600 +---------------------------------------------------------------------+
| O O O O O |
500 |-+ O O O O O O |
| O O O O O O O |
| O O O |
400 |-+ |
| |
300 |-+ |
| |
200 |.. +..+. .+. .+..+.+.. .+.. .+.. .+.. .+.+.. .+.. .|
| + : +. +..+ + + + +.+..+.+. + + |
| : : |
100 |-+ : : |
| : : |
0 +---------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_27_directio.irq_sec
10 +----------------------------------------------------------------------+
9 |-+ O O O |
| O O O O O O |
8 |-+ O O O O |
7 |-+ O O O O O O O O O |
| O |
6 |-+ |
5 |-+ |
4 |.. +..+. .+.. .+. .+. .+. .+. .|
| + : +..+.+..+.+..+ +. +. +. +..+.+..+.+..+.+. +. |
3 |-+: : |
2 |-+ : : |
| : : |
1 |-+ : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_27_directio.user_util
0.9 +---------------------------------------------------------------------+
| +.. + |
0.8 |-+ : +.+..+. +. .+. .+. .+.+.. .. : + |
0.7 |..+ +.. : +..+. .. +. +..+.+. +. +.+ : .. +|
| : : + + + |
0.6 |-+: : |
0.5 |-+ : : |
| :O : |
0.4 |-+O: O:O O O O O O O O O O O O O O O |
0.3 |-+ : : O O O O O |
| : : |
0.2 |-+ : : |
0.1 |-+ : : |
| : : |
0 +---------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_27_directio.sys_util
8 +-----------------------------------------------------------------------+
| +. + |
7 |-+ +.. + +.. +.. + +. .+..+. : + |
6 |-.+ +.. + + +.+.. + .. + .+. .. +. +.. : + .+..|
|. : : + + + + +. + + + |
5 |-+: : |
| : : |
4 |-+ : : |
| : : |
3 |-+ : : |
2 |-+ :O : |
| O: O:O O O O O O O O O O O O O O O O O O O O |
1 |-+ : : |
| : : |
0 +-----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_27_directio.irq_util
2 +---------------------------------------------------------------------+
1.8 |-.+ .+.. |
|. : +..+.+..+ +.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.|
1.6 |-+: O O : O O O O O O O O O O O |
1.4 |-+: : O O O O O O O O |
| : : |
1.2 |-+ : : |
1 |-+ : : |
0.8 |-+ : : |
| : : |
0.6 |-+ : : |
0.4 |-+ : : |
| : : |
0.2 |-+ : : |
0 +---------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_18_directio.secs
25 +----------------------------------------------------------------------+
| O |
| |
20 |-+ |
| O O O O O O O O O O |
| O O O O O O O O |
15 |-+ O O O O |
| |
10 |-+ |
| .+.. |
| .+ +.. .+..+.+..+.+..+. .+..+.+..+.+..+.+..+.+..+.+..+ +.+..|
5 |.+ : : + +. |
| : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_18_directio.works_sec
9000 +--------------------------------------------------------------------+
|.+ + +. .. + .+ + |
8000 |-: : +..+. .+ +..+.+.+. : +.+.. + + +.. +|
7000 |-: : +..+ : .. +. .+ + + + |
| : : + +. + |
6000 |-+: : |
5000 |-+: : |
| : : |
4000 |-+ : : O O |
3000 |-O :O O: O O O O O O O O O O O O O |
| : : O O O O |
2000 |-+ : : O |
1000 |-+ : : |
| : : |
0 +--------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_18_directio.real_sec
25 +----------------------------------------------------------------------+
| O |
| |
20 |-+ O O |
| O O O O O O O O |
| O O O O O O O O O |
15 |-+ O O O |
| |
10 |-+ |
| .+. .+.. .+..|
|..+ +.. .+..+.+..+.+..+. .+..+.+..+.+..+.+..+.+. +..+ + |
5 |-+ : : + +. |
| : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_18_directio.sys_sec
14 +----------------------------------------------------------------------+
|..+ +..+.+..+.+..+.+..+. .+..+.+..+.+..+.+..+.+. +..+ + |
12 |-+: : +. |
| : : |
10 |-+: : |
| : : O O O O O O O O |
8 |-+O:O O:O O O O O O O O O O O O |
| : : |
6 |-+ : : |
| : : |
4 |-+ : : |
| : : |
2 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_18_directio.idle_sec
450 +---------------------------------------------------------------------+
| O |
400 |-+ |
350 |-+ |
| O O O O |
300 |-+O O O O O O O O O O |
250 |-+ O O O O O O O O |
| |
200 |-+ |
150 |-+ |
| .+.+.. .+.. .+.+..+. .+. .+.|
100 |..+ +..+.+..+.+. +.+..+.+..+.+..+ +.+. +. +. |
50 |-+ : : |
| : : |
0 +---------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_18_directio.irq_sec
7 +-----------------------------------------------------------------------+
| O |
6 |-+ |
| O O |
5 |-+O O O O O O O O O |
| O O O O O O O O O |
4 |-+ O O |
| |
3 |-+ .+.. |
|..+ +.. .+..+..+.+..+.+.. .+..+..+.+..+.+..+.+..+..+.+..+ +.+..|
2 |-+: : + + |
| : : |
1 |-+ : : |
| : : |
0 +-----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_18_directio.user_util
1.2 +---------------------------------------------------------------------+
| .+.. |
1 |..+ +..+.+.. .+ .+ .|
| : : +.+..+.+. +.+..+.+. + .+.+.. .+.+.. +..+ |
| : : +. +.+. + |
0.8 |-+ : : + |
| : : |
0.6 |-+ : O: O O O |
| O:O :O O O O O O O O O O O O O O O |
0.4 |-+ : : O O |
| : : |
| : : |
0.2 |-+ : : |
| : : |
0 +---------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_18_directio.sys_util
12 +----------------------------------------------------------------------+
|..+ +..+.+.. + .+.. .+ |
10 |-+: : +.+.. .+ +..+.+..+ .+..+. .+. + .+. ..|
| : : +.+. + +..+ +. + |
| : : |
8 |-+ : : |
| : : |
6 |-+ : : |
| : : |
4 |-+ : : |
| : : O O O |
| O : : O O O O O O O O O O O O O O O O O |
2 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_18_directio.idle_util
100 +---------------------------------------------------------------------+
90 |-+O O O O O O O O O O O O O O O O O O O O O O O |
|..+ +..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.|
80 |-+: : |
70 |-+: : |
| : : |
60 |-+ : : |
50 |-+ : : |
40 |-+ : : |
| : : |
30 |-+ : : |
20 |-+ : : |
| : : |
10 |-+ : : |
0 +---------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_18_directio.irq_util
2.5 +---------------------------------------------------------------------+
| |
| |
2 |..+ +..+.+..+.+..+.+..+.+.. .+.. .+..+. .+. .+.+.. .+.. .|
| : : + + +. +..+.+. + + |
| : O O : O O O O O O O O O O O O O O O O O O |
1.5 |-+ : : O |
| : : |
1 |-+ : : |
| : : |
| : : |
0.5 |-+ : : |
| : : |
| : : |
0 +---------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_9_directio.real_sec
18 +----------------------------------------------------------------------+
| O O |
16 |-+ O O O |
14 |-+O O O O O O O |
| O O O O O O O |
12 |-+ O O O O |
10 |-+ |
| |
8 |-+ .+.. .+.. .+. |
6 |..+ +..+.+..+.+..+.+..+.+. + +.+.. .+. +..+.+..+.+..+.+..|
| : : + |
4 |-+ : : |
2 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_9_directio.sys_sec
14 +----------------------------------------------------------------------+
| .+. |
12 |..+ +..+.+..+.+..+.+..+.+..+..+.+..+.+..+.+. +..+.+..+.+..+.+..|
| : : |
10 |-+: : |
| :O : O |
8 |-+O: O:O O O O O O O O O O O O O O O O O O O |
| : : |
6 |-+ : : |
| : : |
4 |-+ : : |
| : : |
2 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_9_directio.idle_sec
140 +---------------------------------------------------------------------+
| O O O |
120 |-+O O O O |
| O O O O O O O |
100 |-+ O O O O O O O |
| O O |
80 |-+ |
| |
60 |-+ |
| .+. .+. .+.. .+. |
40 |..+ +..+.+..+.+..+.+..+.+. +. +..+. .+ +.+..+.+. +..+.|
| : : +. |
20 |-+ : : |
| : : |
0 +---------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_9_directio.sys_util
25 +----------------------------------------------------------------------+
| .+ .+. .+ .+. +.. +..+. +. |
|. : +..+.+. +..+.+..+ + + + + +..+. .. +..|
20 |-+: : + .. + .. + + |
| : : + + |
| : : |
15 |-+ : : |
| : : |
10 |-+ : : |
| : : |
| O: : O O O O O O O O O O O O O O O O |
5 |-+ : O:O O O O |
| : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_9_directio.idle_util
100 +---------------------------------------------------------------------+
90 |-+O O O O O O O O O O O O O O O O |
| O O O O O O O |
80 |-+ .+. .+. |
70 |..+ +..+.+..+.+..+.+..+.+. +. +..+.+..+.+..+.+..+.+..+.+..+.|
| : : |
60 |-+: : |
50 |-+ : : |
40 |-+ : : |
| : : |
30 |-+ : : |
20 |-+ : : |
| : : |
10 |-+ : : |
0 +---------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_9_directio.irq_util
3 +---------------------------------------------------------------------+
| |
2.5 |-.+ .+.+.. .+.. .+..+. .+.. |
|. : +..+.+. +.+..+ +.+..+.+..+ +..+.+..+.+..+ +.|
| : : |
2 |-+O:O : O O O O O O O O O O O O O O O O O |
| : O:O O O |
1.5 |-+ : : |
| : : |
1 |-+ : : |
| : : |
| : : |
0.5 |-+ : : |
| : : |
0 +---------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_4_directio.secs
12 +----------------------------------------------------------------------+
| |
10 |-+ O |
| O O O O O O O O O O O O O O O O |
| O O O O O O |
8 |-+ |
| |
6 |-+ .+.. .+. |
|..+ +..+.+..+.+..+ +.+..+..+.+..+.+..+.+..+.+..+.+. +..+.+..|
4 |-+: : |
| : : |
| : : |
2 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_4_directio.works_sec
12000 +-------------------------------------------------------------------+
| .+.. |
10000 |-+ +.+.. .+..+. .+. .+. .+. .+.+ |
|.+ : +.+ +. +..+ +. +..+.+. +.+..+.+..+.|
| : : |
8000 |-+: : |
| : : |
6000 |-+: : O O O O O O O O O O |
| O: O O :O O O O O O O O O O |
4000 |-+ : : |
| : : |
| : : |
2000 |-+ : : |
| : : |
0 +-------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_4_directio.real_sec
12 +----------------------------------------------------------------------+
| |
10 |-+O O O O O O |
| O O O O O O O O |
| O O O O O O O O O |
8 |-+ |
| |
6 |.. .+..+. .+.. .+..+.. .+.. .+.+.. .+..+.+..+. .|
| + +..+ +..+ + + +.+. +.+..+ +. |
4 |-+: : |
| : : |
| : : |
2 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_4_directio.sys_sec
12 +----------------------------------------------------------------------+
|..+ +..+.+..+.+..+.+..+.+..+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..|
10 |-+: : |
| : : |
| : : |
8 |-+O:O : O O O O O O O O |
| : O:O O O O O O O O O O O O |
6 |-+ : : |
| : : |
4 |-+ : : |
| : : |
| : : |
2 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_4_directio.idle_sec
35 +----------------------------------------------------------------------+
| O |
30 |-+O O O O |
| O O O O O O O O O |
25 |-+ O O O O O O O O O |
| |
20 |-+ |
| |
15 |-+ |
| |
10 |.. .+..+. .+.. .+..+.. .+.. .+.+.. .+..+.+..+. .|
| + +..+ +..+ + + +.+. +.+..+ +. |
5 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_4_directio.user_util
4 +---------------------------------------------------------------------+
| +.. + |
3.5 |-.+ .+ : .+.. .+.. .+.. .+..+. .+. .. + .+..+.|
3 |.+: +. + : + + + + +. + +..+.+..+ |
| : : +..+ |
2.5 |-+ : : O O O O O |
| O:O O:O O O O O O O O O O O O O O |
2 |-+ : : O |
| : : |
1.5 |-+ : : |
1 |-+ : : |
| : : |
0.5 |-+ : : |
| : : |
0 +---------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_4_directio.sys_util
60 +----------------------------------------------------------------------+
| .+.. + +. .+. |
50 |..+ +..+.+..+ +. .+.+.. .. + .. +..+.+..+.+. +.. .+.. .+..|
| : : +. + + + + |
| : : |
40 |-+ : : |
| : : |
30 |-+ : : |
| : : |
20 |-+ : : O O O O O O O O O O O O O O O |
| O:O O:O O O O O |
| : : |
10 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_4_directio.idle_util
80 +----------------------------------------------------------------------+
| O O O O O O O O O O O O O O O O O O O O O O O |
70 |-+ |
60 |-+ |
| |
50 |-+ |
| .+.. .+.. .+.. |
40 |..+ +..+.+..+. .+ +.+. + +.+..+.+..+.+.. .+..+.+..+.+..|
| : : +. + |
30 |-+ : : |
20 |-+ : : |
| : : |
10 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_4_directio.irq_util
4 +---------------------------------------------------------------------+
| +.. |
3.5 |..+ : +.+..+.+..+.+..+.+.. .+.. .+..+.+..+.+..+.+..+.+..+.+..+.|
3 |-+: : + + |
| : : |
2.5 |-+O:O O:O O O O O O O O O O O O O O O O O O O |
| : : O |
2 |-+ : : |
| : : |
1.5 |-+ : : |
1 |-+ : : |
| : : |
0.5 |-+ : : |
| : : |
0 +---------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_2_directio.secs
12 +----------------------------------------------------------------------+
| O O O O O O |
10 |-+ O O O O O O O |
| O O O O O O O |
| O O |
8 |-+ |
| |
6 |-.+ +..+.+..+.+..+.+..+.+..+..+.+..+.+..+.+.. .+..+.+..+.+..+.+..|
|. : : + |
4 |-+ : : |
| : : |
| : : |
2 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_2_directio.works_sec
10000 +-------------------------------------------------------------------+
9000 |.+ .+.+.+.. .+.. .+..+.+.+..+.+.. .+. .+.|
| : +.+. + + +.+. +.+..+.+..+.+. |
8000 |-: : |
7000 |-+: : |
| : : |
6000 |-+: O : O O O O |
5000 |-+: O :O O O O O O O O O O O O |
4000 |-O : : O O O O |
| : : |
3000 |-+ : : |
2000 |-+ : : |
| : : |
1000 |-+ : : |
0 +-------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_2_directio.idle_sec
14 +----------------------------------------------------------------------+
| O O |
12 |-+O O |
| O O O O O |
10 |-+ O O O O |
| O O O O O O O |
8 |-+ O O O |
| |
6 |-+ |
| |
4 |-+ |
| |
2 |-+ .+. .+. .+. .+.. .+.. |
|..+. .+. +..+.+. +..+.+..+..+.+..+.+. +..+ +.+..+ +.+..|
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_2_directio.sys_util
90 +----------------------------------------------------------------------+
|.. .+.. .+ .+..|
80 |-++ +..+ +.+..+.+..+.+..+..+.+..+.+..+.+. + .+.+..+.+..+ |
70 |-+: : +. |
| : : |
60 |-+ : : |
50 |-+ : : |
| : O: O O O O O O O O |
40 |-+O:O :O O O O O O O O O O O O |
30 |-+ : : |
| : : |
20 |-+ : : |
10 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_2_directio.idle_util
60 +----------------------------------------------------------------------+
| |
50 |-+O O O O O O O O O O O |
| O O O O O O O O O O O O |
| |
40 |-+ |
| |
30 |-+ |
| |
20 |-+ |
| +.. |
| +..+. .+.+..+. .+.+.. .+. .+.+..+.+.. : +.+.. .+.. .|
10 |..+ : +. +. +. +. : + +.+. |
| + : + |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_2_directio.irq_util
5 +---------------------------------------------------------------------+
4.5 |..+ +.. .+..+.+.. .+.. .+. .+. .+.+.. .+.. .+.+.. .+..+.|
| : : + + +.+. +. +. + +.+. + |
4 |-+: : |
3.5 |-+: O O : O O O O O O O O O O O O O O |
| : :O O O O O O |
3 |-+ : : |
2.5 |-+ : : |
2 |-+ : : |
| : : |
1.5 |-+ : : |
1 |-+ : : |
| : : |
0.5 |-+ : : |
0 +---------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_1_directio.secs
14 +----------------------------------------------------------------------+
| O O O O O O O O O O O O O O O O O O O O O O O |
12 |-+ |
| |
10 |..+ +..+.+..+.+.. .+. .+.+..+.+..+.+..+.+..|
| : : +.+. +..+..+.+..+.+..+.+. |
8 |-+: : |
| : : |
6 |-+ : : |
| : : |
4 |-+ : : |
| : : |
2 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_1_directio.works_sec
6000 +--------------------------------------------------------------------+
| .+..+. .+..+.+..+.+..+.+.+..+.+..+. .|
5000 |.+ + +..+ +..+.+..+.+..+.+..+ |
| : : |
| : O : |
4000 |-O: O :O O O O O O O O O O O O O O O O O O O O |
| : : |
3000 |-+: : |
| : : |
2000 |-+ : : |
| : : |
| : : |
1000 |-+ : : |
| : : |
0 +--------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_1_directio.real_sec
14 +----------------------------------------------------------------------+
| O O O O O O O O O O O O O O O O O |
12 |-+ |
| |
10 |..+ +..+.+..+.+..+.+..+.+..+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..|
| : : |
8 |-+: : |
| : : |
6 |-+ : : |
| : : |
4 |-+ : : |
| : : |
2 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_1_directio.sys_sec
12 +----------------------------------------------------------------------+
| |
10 |-+O O O O O O O O O O O O O O O O O O |
| O O O O O |
|..+ +..+.+..+.+..+.+..+.+..+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..|
8 |-+: : |
| : : |
6 |-+ : : |
| : : |
4 |-+ : : |
| : : |
| : : |
2 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_1_directio.idle_sec
2 +---------------------------------------------------------------------+
1.8 |-+ O |
| O |
1.6 |-+ O O O O O O O O |
1.4 |-+ O O O O O |
| O O O O |
1.2 |-+ O |
1 |-+O O |
0.8 |-+ O |
| |
0.6 |-+ |
0.4 |-+ |
| |
0.2 |-+ .+.. |
0 +---------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_1_directio.sys_util
90 +----------------------------------------------------------------------+
|..+ +..+.+..+.+..+.+..+.+..+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..|
80 |-+: O O : O O O O O O O O O O O O O O O O O |
70 |-+: : O O |
| : : |
60 |-+ : : |
50 |-+ : : |
| : : |
40 |-+ : : |
30 |-+ : : |
| : : |
20 |-+ : : |
10 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.hdd_xfs_MWUL_1_directio.idle_util
14 +----------------------------------------------------------------------+
| O |
12 |-+ O O O O O O O |
| O O O O O |
10 |-+ O O O O O |
| O |
8 |-+O O O |
| |
6 |-+ O |
| |
4 |-+ |
| |
2 |-+ |
|.. .+..+. |
0 +----------------------------------------------------------------------+
perf-sched.total_wait_time.average.ms
80 +----------------------------------------------------------------------+
| O O O O O O O O O O O |
70 |-+ O O O O O O O O O |
60 |-+ O |
| |
50 |-+ |
| |
40 |-+ |
| .+.. .+.. .+.. |
30 |..+.+ +..+. .+.+..+.+..+. .+..+.+..+.+..+ +.+..+ + .+..|
20 |-+ : : +. +. + |
| : : |
10 |-+ : : |
| :: |
0 +----------------------------------------------------------------------+
perf-sched.total_wait_and_delay.count.ms
100000 +------------------------------------------------------------------+
90000 |-+ + |
| +.+.. .. + .+. .+.. +.. .|
80000 |.+.. + +.+.. .+.+ +. + +.+ .+.. + : + |
70000 |-+ + + + + .+ +. + + : |
| : : +. + + : |
60000 |-+ : : + |
50000 |-+ : : |
40000 |-+ : : |
| : : O O O O O O O O O |
30000 |-O O:O: O O O O O O O O O O O |
20000 |-+ : : |
| :: |
10000 |-+ : |
0 +------------------------------------------------------------------+
perf-sched.total_wait_and_delay.average.ms
80 +----------------------------------------------------------------------+
| O O O O O O O O O O O |
70 |-+ O O O O O O O O O |
60 |-+ O |
| |
50 |-+ |
| |
40 |-+ |
| .+.. .+.. .+.. |
30 |..+.+ +..+. .+.+..+.+..+. .+..+.+..+.+..+ +.+..+ + .+..|
20 |-+ : : +. +. + |
| : : |
10 |-+ : : |
| :: |
0 +----------------------------------------------------------------------+
50 +----------------------------------------------------------------------+
45 |-+ O O |
| |
40 |-+ O O O |
35 |-+O O O O O O O O |
| O O O O O O |
30 |-+ O O O |
25 |-+ O |
20 |-+ |
| |
15 |-+ |
10 |-+ .+ .+.. .+.. |
|..+ + +..+.+..+.+..+.+..+.+..+..+.+..+.+..+ +.+..+.+..+ +.+..|
5 |-+ + + |
0 +----------------------------------------------------------------------+
60000 +-------------------------------------------------------------------+
| +..+ .+.. |
50000 |.+.. : + .+ .+. .+.+.. +.. .|
| : +.+..+.+. + +. +. .+.+.. +.. : + |
| + + +..+ + : |
40000 |-+ : : + + |
| : : |
30000 |-+ : : |
| : : |
20000 |-+ : : |
| O:O: O O O O |
| O : : O O O O O O O O O O O O O O O |
10000 |-+ :: O |
| : |
0 +-------------------------------------------------------------------+
50 +----------------------------------------------------------------------+
45 |-+ O O |
| |
40 |-+ O O O |
35 |-+O O O O O O O O |
| O O O O O O |
30 |-+ O O O |
25 |-+ O |
20 |-+ |
| |
15 |-+ |
10 |-+ .+ .+.. .+.. |
|..+ + +..+.+..+.+..+.+..+.+..+..+.+..+.+..+ +.+..+.+..+ +.+..|
5 |-+ + + |
0 +----------------------------------------------------------------------+
fxmark.time.system_time
60 +----------------------------------------------------------------------+
| |
50 |..+ +..+.+..+.+..+.+..+.+..+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..|
| : : O |
| : O O : O O O O O O O O O O O O O O O O O O |
40 |-+ : : |
| : : |
30 |-+ : : |
| : : |
20 |-+ : : |
| : : |
| : : |
10 |-+ : : |
| : : |
0 +----------------------------------------------------------------------+
fxmark.time.percent_of_cpu_this_job_got
20 +----------------------------------------------------------------------+
18 |..+ +..+.+..+.+..+.+..+.+..+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..|
| : : |
16 |-+: : |
14 |-+: : |
| : : |
12 |-+ : : O O O O |
10 |-+O:O O:O O O O O O O O O O O O O O O O |
8 |-+ : : |
| : : |
6 |-+ : : |
4 |-+ : : |
| : : |
2 |-+ : : |
0 +----------------------------------------------------------------------+
fxmark.time.elapsed_time
600 +---------------------------------------------------------------------+
| O O |
500 |-+O O O O O O O O O O O O O O O O O O O O O |
| |
| |
400 |-+ |
|..+ +..+. .+.+.. .+.. .+.. .+.. .+..+.+..+.+..+.+..+. .+.. .|
300 |-+: : +. + + + + +..+ + |
| : : |
200 |-+ : : |
| : : |
| : : |
100 |-+ : : |
| : : |
0 +---------------------------------------------------------------------+
fxmark.time.elapsed_time.max
600 +---------------------------------------------------------------------+
| O O |
500 |-+O O O O O O O O O O O O O O O O O O O O O |
| |
| |
400 |-+ |
|..+ +..+. .+.+.. .+.. .+.. .+.. .+..+.+..+.+..+.+..+. .+.. .|
300 |-+: : +. + + + + +..+ + |
| : : |
200 |-+ : : |
| : : |
| : : |
100 |-+ : : |
| : : |
0 +---------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-ivb-2ep1: 48 threads Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory
=========================================================================================
class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_group/testcase/testtime/ucode:
filesystem/gcc-9/performance/1HDD/xfs/x86_64-rhel-8.3/10%/debian-10.4-x86_64-20200603.cgz/lkp-ivb-2ep1/stress-ng/30s/0x42e
commit:
bd70706acf ("xfs: decide if inode needs inactivation")
aa0a2ec202 ("xfs: deferred inode inactivation")
bd70706acfc93277 aa0a2ec202a8b319516cec852c8
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 75% 3:4 kmsg.XFS(sda1):xlog_verify_grant_tail:space>BBTOB(tail_blocks)
:4 25% 1:4 kmsg.XFS(sdc1):xlog_verify_grant_tail:space>BBTOB(tail_blocks)
0:4 2% 0:4 perf-profile.children.cycles-pp.error_entry
0:4 3% 0:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
762397 -34.0% 503332 ± 4% stress-ng.dentry.ops
25117 -34.3% 16507 ± 3% stress-ng.dentry.ops_per_sec
614345 ± 2% -54.7% 278560 ± 10% stress-ng.dir.ops
20186 ± 2% -55.2% 9044 ± 10% stress-ng.dir.ops_per_sec
345342 ± 4% -68.5% 108645 ± 11% stress-ng.dnotify.ops
11511 ± 4% -69.1% 3560 ± 10% stress-ng.dnotify.ops_per_sec
61369 ± 2% -16.0% 51536 ± 4% stress-ng.dup.ops
2045 ± 2% -16.0% 1717 ± 4% stress-ng.dup.ops_per_sec
10174292 ± 3% -30.5% 7071785 ± 3% stress-ng.fanotify.ops
339083 ± 3% -31.4% 232584 ± 2% stress-ng.fanotify.ops_per_sec
22806 ± 10% +183.1% 64575 ± 13% stress-ng.file-ioctl.ops
760.07 ± 10% +183.1% 2151 ± 13% stress-ng.file-ioctl.ops_per_sec
443564 ± 4% -82.8% 76291 ± 6% stress-ng.filename.ops
14335 ± 4% -82.8% 2461 ± 9% stress-ng.filename.ops_per_sec
2097131 +26.2% 2647620 stress-ng.open.ops
57775 ± 7% +51.2% 87339 stress-ng.open.ops_per_sec
74.50 ± 2% -32.6% 50.25 ± 3% stress-ng.symlink.ops
2.44 ± 2% -35.1% 1.58 ± 2% stress-ng.symlink.ops_per_sec
24521968 ± 2% -48.0% 12747982 ± 3% stress-ng.time.file_system_outputs
519151 -9.1% 471755 ± 2% stress-ng.time.involuntary_context_switches
6814722 -9.6% 6160333 ± 5% stress-ng.time.minor_page_faults
430.00 -5.9% 404.75 stress-ng.time.percent_of_cpu_this_job_got
4313 -6.7% 4026 stress-ng.time.system_time
923.92 -2.8% 897.91 ± 2% stress-ng.time.user_time
21538659 ± 3% -5.5% 20348776 stress-ng.time.voluntary_context_switches
9.95 -2.9% 9.66 iostat.cpu.system
0.33 ± 3% +0.0 0.35 ± 4% mpstat.cpu.all.iowait%
2746 +86.8% 5130 ± 3% vmstat.io.bo
146449 ± 2% +31.2% 192179 meminfo.SUnreclaim
342090 ± 2% +15.3% 394548 meminfo.Slab
60316 ± 37% +72.5% 104035 ± 26% numa-meminfo.node1.SUnreclaim
125496 ± 60% +75.4% 220167 ± 31% numa-meminfo.node1.Slab
16716070 ± 24% -35.2% 10838307 ± 26% numa-numastat.node0.local_node
16743470 ± 24% -35.1% 10866340 ± 26% numa-numastat.node0.numa_hit
1548486 ± 39% -69.9% 466159 ± 46% numa-vmstat.node0.nr_dirtied
15076 ± 37% +72.7% 26030 ± 26% numa-vmstat.node1.nr_slab_unreclaimable
121455 ± 16% +43.7% 174520 ± 30% sched_debug.cpu.nr_switches.min
0.07 ± 7% +16.3% 0.09 sched_debug.cpu.nr_uninterruptible.avg
0.01 ± 62% +220.0% 0.02 ± 49% perf-sched.sch_delay.avg.ms.rcu_gp_kthread.kthread.ret_from_fork
0.70 ±132% -93.4% 0.05 ±122% perf-sched.sch_delay.max.ms.rwsem_down_write_slowpath.chmod_common.do_fchmodat.__x64_sys_fchmodat
0.02 ± 68% +91.9% 0.03 ± 42% perf-sched.sch_delay.max.ms.schedule_timeout.wait_for_completion.__flush_work.lru_add_drain_all
3.71 ± 13% +15.4% 4.28 ± 18% perf-sched.total_sch_delay.max.ms
7236 ± 14% -30.9% 4998 ± 15% perf-sched.wait_and_delay.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
151.53 ± 65% +93.7% 293.50 ± 11% perf-sched.wait_and_delay.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
0.00 ± 13% +46.2% 0.00 ± 17% perf-sched.wait_time.avg.ms.rwsem_down_write_slowpath.chmod_common.__x64_sys_fchmod.do_syscall_64
0.08 ±102% +3.1e+05% 250.22 ±172% perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.[unknown]
7236 ± 14% -30.9% 4998 ± 15% perf-sched.wait_time.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
151.51 ± 65% +93.7% 293.48 ± 11% perf-sched.wait_time.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
1307 -6.4% 1223 ± 6% proc-vmstat.nr_active_file
3065246 ± 2% -48.0% 1593497 ± 3% proc-vmstat.nr_dirtied
67017 -1.3% 66137 proc-vmstat.nr_inactive_anon
11490 +1.4% 11654 proc-vmstat.nr_kernel_stack
36609 ± 2% +31.3% 48067 proc-vmstat.nr_slab_unreclaimable
1307 -6.4% 1223 ± 6% proc-vmstat.nr_zone_active_file
67017 -1.3% 66137 proc-vmstat.nr_zone_inactive_anon
27229902 -8.0% 25055284 proc-vmstat.numa_hit
27185796 -8.0% 25011208 proc-vmstat.numa_local
251478 -2.0% 246429 proc-vmstat.pgactivate
31503578 -5.2% 29875694 proc-vmstat.pgalloc_normal
10270259 -6.6% 9593490 ± 3% proc-vmstat.pgfault
31446645 -5.1% 29833764 proc-vmstat.pgfree
3352880 +86.3% 6245878 ± 3% proc-vmstat.pgpgout
417588 -8.9% 380376 ± 2% proc-vmstat.pgreuse
3.80 +0.2 4.04 perf-stat.i.branch-miss-rate%
27214428 -3.6% 26234148 ± 2% perf-stat.i.branch-misses
3.10 +4.3% 3.24 perf-stat.i.cpi
1.781e+10 -2.8% 1.731e+10 ± 2% perf-stat.i.cpu-cycles
2.278e+09 -5.8% 2.145e+09 perf-stat.i.dTLB-loads
1.443e+09 -5.6% 1.362e+09 perf-stat.i.dTLB-stores
74.42 +2.6 76.99 perf-stat.i.iTLB-load-miss-rate%
4074352 -6.7% 3801097 ± 2% perf-stat.i.iTLB-load-misses
1385167 ± 6% -24.2% 1049686 ± 7% perf-stat.i.iTLB-loads
0.51 -3.8% 0.49 perf-stat.i.ipc
0.37 -2.8% 0.36 ± 2% perf-stat.i.metric.GHz
121.14 -5.1% 114.97 perf-stat.i.metric.M/sec
8241 -6.5% 7702 ± 3% perf-stat.i.minor-faults
8241 -6.5% 7703 ± 3% perf-stat.i.page-faults
74.63 +3.8 78.39 perf-stat.overall.iTLB-load-miss-rate%
46.13 -0.8 45.31 perf-stat.overall.node-load-miss-rate%
27193617 -3.6% 26217941 ± 2% perf-stat.ps.branch-misses
1.783e+10 -2.8% 1.734e+10 ± 2% perf-stat.ps.cpu-cycles
2.279e+09 -5.8% 2.147e+09 perf-stat.ps.dTLB-loads
1.442e+09 -5.6% 1.362e+09 perf-stat.ps.dTLB-stores
4070600 -6.7% 3799155 ± 2% perf-stat.ps.iTLB-load-misses
1384203 ± 6% -24.2% 1048928 ± 7% perf-stat.ps.iTLB-loads
0.68 +7.8% 0.74 ± 7% perf-stat.ps.major-faults
8242 -6.5% 7703 ± 3% perf-stat.ps.minor-faults
8243 -6.5% 7704 ± 3% perf-stat.ps.page-faults
1.178e+13 ± 2% -4.3% 1.127e+13 ± 3% perf-stat.total.instructions
96391 +34.8% 129901 ± 2% softirqs.BLOCK
148604 ± 3% -10.7% 132694 ± 2% softirqs.CPU0.SCHED
148732 ± 6% -20.3% 118548 ± 12% softirqs.CPU13.SCHED
229059 ± 25% -53.7% 106151 ± 15% softirqs.CPU2.RCU
191392 ± 23% -43.1% 108976 ± 34% softirqs.CPU24.RCU
186326 ± 22% -29.9% 130523 ± 26% softirqs.CPU25.RCU
210905 ± 34% -52.9% 99410 ± 12% softirqs.CPU26.RCU
6202 ± 60% -60.4% 2457 ± 49% softirqs.CPU27.TIMER
360.25 ± 5% +707.0% 2907 ±146% softirqs.CPU29.NET_RX
159637 ± 26% -34.4% 104653 ± 20% softirqs.CPU29.RCU
222899 ± 24% -53.9% 102799 ± 28% softirqs.CPU30.RCU
250400 ± 31% -62.8% 93049 ± 24% softirqs.CPU31.RCU
140102 ± 36% -38.6% 86012 ± 14% softirqs.CPU32.RCU
182901 ± 26% -48.3% 94561 ± 22% softirqs.CPU35.RCU
166453 ± 22% -25.6% 123825 ± 23% softirqs.CPU36.RCU
164252 ± 13% -37.1% 103303 ± 22% softirqs.CPU40.RCU
135252 ± 10% +15.7% 156436 ± 3% softirqs.CPU45.SCHED
9848 ± 60% -72.5% 2708 ± 46% softirqs.CPU5.TIMER
7088 ± 30% -57.8% 2990 ± 20% softirqs.CPU6.TIMER
203903 ± 28% -50.8% 100257 ± 17% softirqs.CPU7.RCU
173360 ± 19% -40.5% 103154 ± 24% softirqs.CPU8.RCU
123880 +30.9% 162160 ± 2% softirqs.CPU8.TASKLET
225545 ± 32% -51.0% 110580 ± 35% softirqs.CPU9.RCU
8763854 ± 13% -30.4% 6099526 ± 11% softirqs.RCU
124127 +30.8% 162412 ± 2% softirqs.TASKLET
177777 ± 4% -9.8% 160339 softirqs.TIMER
0.63 ± 16% +0.2 0.85 ± 9% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
1.03 ± 19% +0.3 1.28 ± 15% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack
0.27 ±100% +0.4 0.64 ± 11% perf-profile.calltrace.cycles-pp.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
0.15 ±173% +0.5 0.63 ± 11% perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
0.14 ±173% +0.5 0.63 ± 11% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt
4.05 ± 18% +1.0 5.04 ± 11% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
0.55 ± 30% -0.2 0.30 ± 32% perf-profile.children.cycles-pp.xlog_grant_push_ail
0.53 ± 31% -0.2 0.29 ± 34% perf-profile.children.cycles-pp.xlog_grant_push_threshold
0.04 ± 58% +0.0 0.07 ± 17% perf-profile.children.cycles-pp.run_posix_cpu_timers
0.14 ± 17% +0.0 0.19 ± 9% perf-profile.children.cycles-pp.update_blocked_averages
0.12 ± 6% +0.1 0.18 ± 14% perf-profile.children.cycles-pp.__hrtimer_next_event_base
0.15 ± 18% +0.1 0.20 ± 7% perf-profile.children.cycles-pp.run_rebalance_domains
0.01 ±173% +0.1 0.07 ± 17% perf-profile.children.cycles-pp.native_apic_mem_write
0.00 +0.1 0.06 ± 6% perf-profile.children.cycles-pp.can_stop_idle_tick
0.28 ± 15% +0.1 0.35 ± 16% perf-profile.children.cycles-pp.tick_nohz_next_event
0.25 ± 17% +0.1 0.32 ± 15% perf-profile.children.cycles-pp.io_serial_in
0.44 ± 14% +0.1 0.56 ± 16% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.50 ± 15% +0.2 0.68 ± 9% perf-profile.children.cycles-pp.do_softirq_own_stack
0.49 ± 15% +0.2 0.67 ± 9% perf-profile.children.cycles-pp.__softirqentry_text_start
0.67 ± 14% +0.2 0.90 ± 8% perf-profile.children.cycles-pp.irq_exit_rcu
0.07 ± 12% +0.0 0.10 ± 15% perf-profile.self.cycles-pp.irq_exit_rcu
0.04 ± 58% +0.0 0.07 ± 17% perf-profile.self.cycles-pp.run_posix_cpu_timers
0.03 ±100% +0.0 0.07 ± 7% perf-profile.self.cycles-pp.get_next_timer_interrupt
0.03 ±100% +0.0 0.07 ± 12% perf-profile.self.cycles-pp.__sysvec_apic_timer_interrupt
0.11 ± 7% +0.0 0.15 ± 17% perf-profile.self.cycles-pp.__hrtimer_next_event_base
0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.can_stop_idle_tick
0.01 ±173% +0.1 0.07 ± 22% perf-profile.self.cycles-pp.native_apic_mem_write
0.25 ± 17% +0.1 0.32 ± 15% perf-profile.self.cycles-pp.io_serial_in
1414 ± 60% +285.3% 5450 ± 53% interrupts.36:PCI-MSI.2621442-edge.eth0-TxRx-1
699.25 ± 5% +727.1% 5783 ±147% interrupts.38:PCI-MSI.2621444-edge.eth0-TxRx-3
245008 +31.2% 321564 ± 2% interrupts.73:PCI-MSI.2097152-edge.isci-msix
4059 ± 35% +13879.8% 567546 ±133% interrupts.CPU1.RES:Rescheduling_interrupts
17484 ± 22% +363.4% 81025 ± 27% interrupts.CPU12.CAL:Function_call_interrupts
11267 ± 31% +64.1% 18493 ± 26% interrupts.CPU12.TLB:TLB_shootdowns
15771 ± 41% +315.1% 65472 ± 55% interrupts.CPU15.CAL:Function_call_interrupts
22895 ± 21% +105.8% 47130 ± 27% interrupts.CPU16.CAL:Function_call_interrupts
13855 ± 18% +219.9% 44330 ± 17% interrupts.CPU17.CAL:Function_call_interrupts
1991 ± 45% +781.9% 17560 ±142% interrupts.CPU17.RES:Rescheduling_interrupts
14126 ± 30% +94.1% 27414 ± 36% interrupts.CPU19.CAL:Function_call_interrupts
12856 ± 37% +312.0% 52972 ± 39% interrupts.CPU20.CAL:Function_call_interrupts
2135 ± 27% +5630.6% 122347 ±166% interrupts.CPU20.RES:Rescheduling_interrupts
11053 ± 56% +215.3% 34852 ± 28% interrupts.CPU20.TLB:TLB_shootdowns
52976 ± 55% -70.2% 15791 ± 25% interrupts.CPU26.CAL:Function_call_interrupts
1414 ± 60% +285.3% 5450 ± 53% interrupts.CPU27.36:PCI-MSI.2621442-edge.eth0-TxRx-1
699.25 ± 5% +727.1% 5783 ±147% interrupts.CPU29.38:PCI-MSI.2621444-edge.eth0-TxRx-3
155.50 ± 24% +777.7% 1364 ±147% interrupts.CPU3.NMI:Non-maskable_interrupts
155.50 ± 24% +777.7% 1364 ±147% interrupts.CPU3.PMI:Performance_monitoring_interrupts
13711 ± 27% +89.6% 25998 ± 26% interrupts.CPU30.TLB:TLB_shootdowns
133.75 ± 13% +312.5% 551.75 ± 92% interrupts.CPU34.NMI:Non-maskable_interrupts
133.75 ± 13% +312.5% 551.75 ± 92% interrupts.CPU34.PMI:Performance_monitoring_interrupts
178.25 ± 29% +52.2% 271.25 ± 8% interrupts.CPU35.NMI:Non-maskable_interrupts
178.25 ± 29% +52.2% 271.25 ± 8% interrupts.CPU35.PMI:Performance_monitoring_interrupts
19344 ± 53% +190.0% 56103 ± 23% interrupts.CPU37.CAL:Function_call_interrupts
11575 ± 33% +198.7% 34576 ± 61% interrupts.CPU38.TLB:TLB_shootdowns
10009 ± 25% +112.9% 21306 ± 16% interrupts.CPU40.TLB:TLB_shootdowns
19680 ± 28% +233.2% 65572 ± 31% interrupts.CPU41.CAL:Function_call_interrupts
2000 ± 28% +149.1% 4983 ± 49% interrupts.CPU41.RES:Rescheduling_interrupts
20595 ± 51% +140.9% 49613 ± 51% interrupts.CPU42.CAL:Function_call_interrupts
1996 ± 31% +94.9% 3890 ± 22% interrupts.CPU42.RES:Rescheduling_interrupts
2420 ± 48% +22009.8% 535222 ±162% interrupts.CPU43.RES:Rescheduling_interrupts
2536 ± 27% +78.3% 4522 ± 16% interrupts.CPU44.RES:Rescheduling_interrupts
15485 ± 28% +158.7% 40058 ± 57% interrupts.CPU46.CAL:Function_call_interrupts
2308 ± 23% +6628.5% 155311 ±168% interrupts.CPU46.RES:Rescheduling_interrupts
13813 ± 32% +276.8% 52045 ± 39% interrupts.CPU47.CAL:Function_call_interrupts
2184 ± 35% +104.7% 4471 ± 17% interrupts.CPU47.RES:Rescheduling_interrupts
245008 +31.2% 321564 ± 2% interrupts.CPU8.73:PCI-MSI.2097152-edge.isci-msix
415032 ±153% -98.2% 7495 ±123% interrupts.CPU8.RES:Rescheduling_interrupts
57924 ± 40% -69.6% 17593 ± 33% interrupts.CPU9.CAL:Function_call_interrupts
19168 -20.6% 15216 ± 13% slabinfo.Acpi-Parse.active_objs
19420 -21.6% 15216 ± 13% slabinfo.Acpi-Parse.num_objs
289.50 ± 22% +58.0% 457.50 ± 11% slabinfo.biovec-128.active_objs
289.50 ± 22% +58.0% 457.50 ± 11% slabinfo.biovec-128.num_objs
622.50 ± 20% +59.0% 989.50 ± 8% slabinfo.biovec-64.active_objs
622.50 ± 20% +59.0% 989.50 ± 8% slabinfo.biovec-64.num_objs
322.25 ± 14% +43.7% 463.00 ± 6% slabinfo.biovec-max.active_objs
324.50 ± 14% +51.3% 491.00 ± 5% slabinfo.biovec-max.num_objs
176664 ± 3% -23.0% 136056 slabinfo.dentry.active_objs
8900 ± 4% -22.0% 6941 slabinfo.dentry.active_slabs
186915 ± 4% -22.0% 145772 slabinfo.dentry.num_objs
8900 ± 4% -22.0% 6941 slabinfo.dentry.num_slabs
2820 ± 4% +235.5% 9463 ± 29% slabinfo.dmaengine-unmap-16.active_objs
67.00 ± 5% +238.4% 226.75 ± 28% slabinfo.dmaengine-unmap-16.active_slabs
2839 ± 5% +236.4% 9549 ± 28% slabinfo.dmaengine-unmap-16.num_objs
67.00 ± 5% +238.4% 226.75 ± 28% slabinfo.dmaengine-unmap-16.num_slabs
1597 ± 44% +130.4% 3679 ± 2% slabinfo.dnotify_struct.active_objs
1597 ± 44% +130.4% 3679 ± 2% slabinfo.dnotify_struct.num_objs
42701 ± 5% -24.4% 32288 slabinfo.filp.active_objs
2731 ± 5% -24.0% 2075 slabinfo.filp.active_slabs
43714 ± 5% -24.0% 33218 slabinfo.filp.num_objs
2731 ± 5% -24.0% 2075 slabinfo.filp.num_slabs
67887 ± 11% +25.0% 84872 slabinfo.kmalloc-16.active_objs
69225 ± 10% +29.2% 89464 slabinfo.kmalloc-16.num_objs
16838 ± 4% -12.5% 14737 slabinfo.kmalloc-192.active_objs
20086 ± 4% -9.7% 18131 ± 2% slabinfo.kmalloc-192.num_objs
6339 ± 2% +22.1% 7741 ± 3% slabinfo.kmalloc-256.active_objs
411.00 ± 2% +27.6% 524.25 ± 2% slabinfo.kmalloc-256.active_slabs
6584 ± 2% +27.5% 8395 ± 2% slabinfo.kmalloc-256.num_objs
411.00 ± 2% +27.6% 524.25 ± 2% slabinfo.kmalloc-256.num_slabs
26190 ± 2% +186.6% 75070 ± 3% slabinfo.kmalloc-512.active_objs
4235 ± 3% +165.5% 11243 ± 3% slabinfo.kmalloc-512.active_slabs
33883 ± 3% +165.5% 89948 ± 3% slabinfo.kmalloc-512.num_objs
4235 ± 3% +165.5% 11243 ± 3% slabinfo.kmalloc-512.num_slabs
40900 ± 7% +16.8% 47790 ± 6% slabinfo.kmalloc-64.active_objs
648.25 ± 7% +16.6% 755.75 ± 6% slabinfo.kmalloc-64.active_slabs
41529 ± 7% +16.5% 48398 ± 6% slabinfo.kmalloc-64.num_objs
648.25 ± 7% +16.6% 755.75 ± 6% slabinfo.kmalloc-64.num_slabs
141552 ± 10% -59.6% 57244 ± 12% slabinfo.kmalloc-8.active_objs
276.00 ± 10% -56.1% 121.25 ± 12% slabinfo.kmalloc-8.active_slabs
141556 ± 10% -55.9% 62376 ± 11% slabinfo.kmalloc-8.num_objs
276.00 ± 10% -56.1% 121.25 ± 12% slabinfo.kmalloc-8.num_slabs
799.50 ± 2% +153.4% 2026 ± 2% slabinfo.kmalloc-8k.active_objs
217.75 ± 2% +160.8% 568.00 slabinfo.kmalloc-8k.active_slabs
872.50 ± 2% +160.6% 2273 slabinfo.kmalloc-8k.num_objs
217.75 ± 2% +160.8% 568.00 slabinfo.kmalloc-8k.num_slabs
15268 ± 3% -13.4% 13219 slabinfo.kmalloc-96.active_objs
16467 ± 3% -11.7% 14534 slabinfo.kmalloc-96.num_objs
9876 ± 11% -60.8% 3871 ± 14% slabinfo.kmalloc-rcl-128.active_objs
810.50 -68.5% 255.50 ± 5% slabinfo.kmalloc-rcl-128.active_slabs
25952 -68.4% 8193 ± 5% slabinfo.kmalloc-rcl-128.num_objs
810.50 -68.5% 255.50 ± 5% slabinfo.kmalloc-rcl-128.num_slabs
16724 ± 4% -70.3% 4964 ± 4% slabinfo.kmalloc-rcl-192.active_objs
8146 ± 3% -75.9% 1963 ± 6% slabinfo.kmalloc-rcl-192.active_slabs
171083 ± 3% -75.9% 41242 ± 6% slabinfo.kmalloc-rcl-192.num_objs
8146 ± 3% -75.9% 1963 ± 6% slabinfo.kmalloc-rcl-192.num_slabs
6677 ± 3% -69.3% 2052 ± 6% slabinfo.kmalloc-rcl-256.active_objs
1048 ± 2% -70.0% 314.75 ± 3% slabinfo.kmalloc-rcl-256.active_slabs
16779 ± 2% -69.9% 5048 ± 3% slabinfo.kmalloc-rcl-256.num_objs
1048 ± 2% -70.0% 314.75 ± 3% slabinfo.kmalloc-rcl-256.num_slabs
15097 ± 3% -71.5% 4308 slabinfo.kmalloc-rcl-512.active_objs
2847 ± 5% -73.7% 749.25 ± 3% slabinfo.kmalloc-rcl-512.active_slabs
22782 ± 5% -73.7% 5995 ± 3% slabinfo.kmalloc-rcl-512.num_objs
2847 ± 5% -73.7% 749.25 ± 3% slabinfo.kmalloc-rcl-512.num_slabs
19138 ± 14% -48.5% 9855 ± 6% slabinfo.kmalloc-rcl-64.active_objs
1074 ± 7% -71.5% 306.25 ± 4% slabinfo.kmalloc-rcl-64.active_slabs
68822 ± 7% -71.5% 19630 ± 4% slabinfo.kmalloc-rcl-64.num_objs
1074 ± 7% -71.5% 306.25 ± 4% slabinfo.kmalloc-rcl-64.num_slabs
12739 ± 6% -35.4% 8226 ± 13% slabinfo.kmalloc-rcl-96.active_objs
12993 ± 6% -34.7% 8487 ± 12% slabinfo.kmalloc-rcl-96.num_objs
64154 ± 6% -14.1% 55123 ± 5% slabinfo.lsm_file_cache.active_objs
1816 ± 22% +68.3% 3056 ± 9% slabinfo.numa_policy.active_objs
123.75 ± 22% +72.1% 213.00 ± 8% slabinfo.numa_policy.active_slabs
1864 ± 22% +71.7% 3202 ± 8% slabinfo.numa_policy.num_objs
123.75 ± 22% +72.1% 213.00 ± 8% slabinfo.numa_policy.num_slabs
911.50 ± 4% +12.4% 1024 slabinfo.pool_workqueue.num_objs
54939 ± 9% -20.9% 43483 slabinfo.proc_inode_cache.active_objs
4587 ± 9% -20.8% 3633 slabinfo.proc_inode_cache.active_slabs
55058 ± 9% -20.8% 43599 slabinfo.proc_inode_cache.num_objs
4587 ± 9% -20.8% 3633 slabinfo.proc_inode_cache.num_slabs
8917 ± 4% -21.7% 6982 ± 2% slabinfo.shmem_inode_cache.active_objs
816.50 ± 5% -21.7% 639.00 ± 2% slabinfo.shmem_inode_cache.active_slabs
8984 ± 5% -21.7% 7033 ± 2% slabinfo.shmem_inode_cache.num_objs
816.50 ± 5% -21.7% 639.00 ± 2% slabinfo.shmem_inode_cache.num_slabs
637.00 ± 18% +59.3% 1014 ± 9% slabinfo.skbuff_fclone_cache.active_objs
637.00 ± 18% +59.3% 1014 ± 9% slabinfo.skbuff_fclone_cache.num_objs
1856 ± 4% +18.5% 2200 ± 7% slabinfo.skbuff_head_cache.num_objs
3052 ± 28% +101.0% 6134 ± 13% slabinfo.xfs_buf.active_objs
76.00 ± 27% +107.2% 157.50 ± 11% slabinfo.xfs_buf.active_slabs
3205 ± 27% +106.9% 6634 ± 11% slabinfo.xfs_buf.num_objs
76.00 ± 27% +107.2% 157.50 ± 11% slabinfo.xfs_buf.num_slabs
2670 ± 33% +88.4% 5029 ± 24% slabinfo.xfs_efd_item.active_objs
2776 ± 32% +88.3% 5229 ± 24% slabinfo.xfs_efd_item.num_objs
2763 ± 33% +84.9% 5110 ± 23% slabinfo.xfs_efi_item.active_objs
2873 ± 32% +85.0% 5316 ± 23% slabinfo.xfs_efi_item.num_objs
4069 ± 52% +111.7% 8615 ± 21% slabinfo.xfs_icr.active_objs
88.25 ± 52% +115.6% 190.25 ± 21% slabinfo.xfs_icr.active_slabs
4085 ± 52% +115.2% 8789 ± 21% slabinfo.xfs_icr.num_objs
88.25 ± 52% +115.6% 190.25 ± 21% slabinfo.xfs_icr.num_slabs
18407 ± 4% +259.7% 66215 ± 2% slabinfo.xfs_ili.active_objs
451.50 ± 3% +277.2% 1703 ± 2% slabinfo.xfs_ili.active_slabs
18980 ± 3% +277.0% 71552 ± 2% slabinfo.xfs_ili.num_objs
451.50 ± 3% +277.2% 1703 ± 2% slabinfo.xfs_ili.num_slabs
16851 ± 4% +282.4% 64436 ± 2% slabinfo.xfs_inode.active_objs
541.75 ± 2% +298.7% 2160 slabinfo.xfs_inode.active_slabs
17359 ± 2% +298.3% 69141 slabinfo.xfs_inode.num_objs
541.75 ± 2% +298.7% 2160 slabinfo.xfs_inode.num_slabs
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Oliver Sang
View attachment "config-5.11.0-rc4-00084-gaa0a2ec202a8" of type "text/plain" (172414 bytes)
View attachment "job-script" of type "text/plain" (8148 bytes)
View attachment "job.yaml" of type "text/plain" (5657 bytes)
View attachment "reproduce" of type "text/plain" (254 bytes)
Powered by blists - more mailing lists