| lists.openwall.net | lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC | |
|
Open Source and information security mailing list archives
| ||
|
Date: Sat, 24 Oct 2020 20:08:29 +0800
From: kernel test robot <rong.a.chen@...el.com>
To: Theodore Ts'o <tytso@....edu>
Cc: LKML <linux-kernel@...r.kernel.org>, lkp@...ts.01.org,
lkp@...el.com, ying.huang@...el.com, feng.tang@...el.com,
zhengjun.xing@...el.com, guobing.chen@...el.com,
ming.a.chen@...el.com, frank.du@...el.com, Shuhua.Fan@...el.com,
wangyang.guo@...el.com, Wenhuan.Huang@...el.com,
jessica.ji@...el.com, shan.kang@...el.com, guangli.li@...el.com,
tiejun.li@...el.com, yu.ma@...el.com, dapeng1.mi@...el.com,
jiebin.sun@...el.com, gengxin.xie@...el.com, fan.zhao@...el.com
Subject: [ext4] 244adf6426:
phoronix-test-suite.fio.SequentialWrite.Sync.Yes.No.4KB.DefaultTestDirectory.mb_s
-36.1% regression
Greeting,
FYI, we noticed a -36.1% regression of phoronix-test-suite.fio.SequentialWrite.Sync.Yes.No.4KB.DefaultTestDirectory.mb_s due to commit:
commit: 244adf6426ee31a83f397b700d964cff12a247d3 ("ext4: make dioread_nolock the default")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: phoronix-test-suite
on test machine: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory
with following parameters:
test: fio-1.11.5
option_a: Sequential Write
option_b: Sync
option_c: Yes
option_d: No
option_e: 4KB
option_f: Default Test Directory
cpufreq_governor: performance
ucode: 0x5002f01
test-description: The Phoronix Test Suite is the most comprehensive testing and benchmarking platform available that provides an extensible framework for which new tests can be easily added.
test-url: http://www.phoronix-test-suite.com/
In addition to that, the commit also has significant impact on the following tests:
+------------------+-----------------------------------------------------------------------+
| testcase: change | fio-basic: fio.write_iops -58.8% regression |
| test machine | 72 threads Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz with 128G memory |
| test parameters | bs=4k |
| | cpufreq_governor=performance |
| | disk=2pmem |
| | fs=ext4 |
| | ioengine=sync |
| | nr_task=50% |
| | runtime=200s |
| | rw=randwrite |
| | test_size=200G |
| | time_based=tb |
| | ucode=0x43 |
+------------------+-----------------------------------------------------------------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen@...el.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/option_a/option_b/option_c/option_d/option_e/option_f/rootfs/tbox_group/test/testcase/ucode:
gcc-9/performance/x86_64-rhel-8.3/Sequential Write/Sync/Yes/No/4KB/Default Test Directory/debian-x86_64-phoronix/lkp-csl-2sp8/fio-1.11.5/phoronix-test-suite/0x5002f01
commit:
4068664e3c ("ext4: fix extent_status fragmentation for plain files")
244adf6426 ("ext4: make dioread_nolock the default")
4068664e3cd23126 244adf6426ee31a83f397b700d9
---------------- ---------------------------
%stddev %change %stddev
\ | \
235329 -36.2% 150250 phoronix-test-suite.fio.SequentialWrite.Sync.Yes.No.4KB.DefaultTestDirectory.iops
919.25 -36.1% 587.25 phoronix-test-suite.fio.SequentialWrite.Sync.Yes.No.4KB.DefaultTestDirectory.mb_s
phoronix-test-suite.fio.SequentialWrite.Sync.Yes.No.4KB.DefaultTestDirectory.mb_
950 +---------------------------------------------------------------------+
|.. .+.+..+ +.. .+..+.+..+.+..+.+..+ +.+..+.+. + .+.+..+.|
900 |-++.+. + +. |
850 |-+ |
| |
800 |-+ |
| |
750 |-+ |
| |
700 |-+ |
650 |-+ |
| |
600 |-+ O O O O O O O O O |
| O O O O O O O O O O O O O |
550 +---------------------------------------------------------------------+
phoronix-test-suite.fio.SequentialWrite.Sync.Yes.No.4KB.DefaultTestDirectory.iop
250000 +------------------------------------------------------------------+
240000 |-+ .+..+. .+. .+. .+. .+.. |
|. .+.+..+.+ +..+.+.+. +..+.+.+..+ +..+.+..+ +..+ +.|
230000 |-+. |
220000 |-+ |
210000 |-+ |
200000 |-+ |
| |
190000 |-+ |
180000 |-+ |
170000 |-+ |
160000 |-+ |
| O O O O O O O O |
150000 |-O O O O O O O O O O O O O O |
140000 +------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-hsw-ep4: 72 threads Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz with 128G memory
=========================================================================================
bs/compiler/cpufreq_governor/disk/fs/ioengine/kconfig/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/time_based/ucode:
4k/gcc-9/performance/2pmem/ext4/sync/x86_64-rhel-7.6/50%/debian-x86_64-20191114.cgz/200s/randwrite/lkp-hsw-ep4/200G/fio-basic/tb/0x43
commit:
4068664e3c ("ext4: fix extent_status fragmentation for plain files")
244adf6426 ("ext4: make dioread_nolock the default")
4068664e3cd23126 244adf6426ee31a83f397b700d9
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
1:4 -25% :4 dmesg.WARNING:at#for_ip_interrupt_entry/0x
%stddev %change %stddev
\ | \
0.04 ± 14% -0.0 0.01 ± 27% fio.latency_100us%
2.69 ± 15% +1.4 4.14 ± 25% fio.latency_4us%
0.13 +0.2 0.35 ± 17% fio.latency_50ms%
0.97 ± 10% +0.5 1.44 ± 16% fio.latency_50us%
1.205e+09 -58.8% 4.967e+08 ± 10% fio.time.file_system_outputs
19468 ± 28% -87.0% 2523 ± 35% fio.time.involuntary_context_switches
115842 -1.9% 113673 fio.time.minor_page_faults
746.75 ± 3% -60.6% 294.00 ± 12% fio.time.percent_of_cpu_this_job_got
1281 ± 3% -61.0% 500.17 ± 13% fio.time.system_time
218.06 ± 3% -58.5% 90.56 ± 11% fio.time.user_time
317685 ± 4% -17.5% 261941 ± 3% fio.time.voluntary_context_switches
1.506e+08 -58.8% 62083647 ± 10% fio.workload
2940 -58.8% 1212 ± 10% fio.write_bw_MBps
13024 +6.9% 13920 fio.write_clat_95%_us
20736 ± 2% +20.1% 24896 ± 5% fio.write_clat_99%_us
46251 +150.3% 115787 ± 11% fio.write_clat_mean_us
1027511 +77.2% 1821210 ± 3% fio.write_clat_stddev
752793 -58.8% 310367 ± 10% fio.write_iops
6165539 ± 58% -66.5% 2067351 ± 85% cpuidle.C1E.usage
528517 +60.1% 846095 meminfo.Active
223502 +151.9% 562933 meminfo.Active(file)
209593 +162.1% 549446 meminfo.Buffers
37.32 +5.0 42.32 ± 2% mpstat.cpu.all.iowait%
12.03 -6.0 6.06 ± 8% mpstat.cpu.all.sys%
1.47 ± 2% -0.9 0.58 ± 14% mpstat.cpu.all.usr%
49.64 +3.5% 51.38 iostat.cpu.idle
36.95 +13.5% 41.96 ± 2% iostat.cpu.iowait
11.95 -49.1% 6.08 ± 8% iostat.cpu.system
1.46 ± 2% -60.3% 0.58 ± 14% iostat.cpu.user
48.75 +4.1% 50.75 vmstat.cpu.id
36.50 +13.7% 41.50 ± 2% vmstat.cpu.wa
3576950 -64.2% 1281274 ± 10% vmstat.io.bo
209727 +162.2% 549884 vmstat.memory.buff
27.50 +15.5% 31.75 ± 2% vmstat.procs.b
9.50 ± 5% -50.0% 4.75 ± 9% vmstat.procs.r
5870 ± 5% -21.3% 4618 ± 3% vmstat.system.cs
145897 -10.9% 129945 ± 19% vmstat.system.in
62626351 ± 7% -57.9% 26383573 ± 9% numa-numastat.node0.local_node
14010771 ± 33% -65.2% 4882491 ± 19% numa-numastat.node0.numa_foreign
62634553 ± 7% -57.9% 26397605 ± 9% numa-numastat.node0.numa_hit
11906400 ± 26% -62.4% 4479564 ± 27% numa-numastat.node0.numa_miss
11914608 ± 26% -62.3% 4493601 ± 27% numa-numastat.node0.other_node
64372103 ± 7% -56.0% 28345038 ± 12% numa-numastat.node1.local_node
11906400 ± 26% -62.4% 4479564 ± 27% numa-numastat.node1.numa_foreign
64387420 ± 7% -56.0% 28354510 ± 12% numa-numastat.node1.numa_hit
14010771 ± 33% -65.2% 4882491 ± 19% numa-numastat.node1.numa_miss
14026091 ± 33% -65.1% 4891963 ± 19% numa-numastat.node1.other_node
9757 ± 17% -43.4% 5519 ± 18% sched_debug.cfs_rq:/.exec_clock.avg
1747 ± 30% -82.7% 302.81 ± 55% sched_debug.cfs_rq:/.exec_clock.min
174.64 ± 5% -48.1% 90.60 ± 6% sched_debug.cfs_rq:/.load_avg.avg
28268 ± 10% -19.3% 22819 ± 17% sched_debug.cfs_rq:/.min_vruntime.avg
68.07 ± 32% -40.8% 40.28 ± 14% sched_debug.cfs_rq:/.runnable_load_avg.avg
248.98 ± 2% -29.2% 176.25 ± 9% sched_debug.cfs_rq:/.util_avg.avg
69.69 ± 29% -37.9% 43.28 ± 13% sched_debug.cfs_rq:/.util_est_enqueued.avg
502292 +18.5% 595427 ± 7% sched_debug.cpu.max_idle_balance_cost.max
268.33 ±173% +4062.8% 11170 ± 46% sched_debug.cpu.max_idle_balance_cost.stddev
40.23 ± 4% -15.8% 33.88 ± 16% sched_debug.cpu.nr_uninterruptible.max
10.41 ± 7% -15.1% 8.83 ± 7% sched_debug.cpu.nr_uninterruptible.stddev
998.12 ± 4% +43.8% 1434 ± 20% sched_debug.cpu.ttwu_local.stddev
31126962 ± 2% -55.5% 13857067 ± 5% numa-vmstat.node0.nr_dirtied
30262548 ± 2% -57.1% 12975737 ± 6% numa-vmstat.node0.nr_written
7172620 ± 16% -63.9% 2585751 ± 36% numa-vmstat.node0.numa_foreign
27887317 ± 4% -56.2% 12216788 ± 9% numa-vmstat.node0.numa_hit
27877920 ± 4% -56.2% 12202178 ± 9% numa-vmstat.node0.numa_local
4299742 ± 11% -42.7% 2463318 ± 50% numa-vmstat.node0.numa_miss
4309147 ± 11% -42.5% 2477931 ± 50% numa-vmstat.node0.numa_other
31511758 ± 3% -52.9% 14840322 ± 4% numa-vmstat.node1.nr_dirtied
30618693 ± 3% -54.6% 13902619 ± 4% numa-vmstat.node1.nr_written
4299873 ± 11% -42.7% 2463365 ± 50% numa-vmstat.node1.numa_foreign
25420521 ± 6% -48.5% 13090767 ± 11% numa-vmstat.node1.numa_hit
25237813 ± 6% -48.8% 12913429 ± 12% numa-vmstat.node1.numa_local
7172742 ± 16% -63.9% 2585812 ± 36% numa-vmstat.node1.numa_miss
7355456 ± 16% -62.4% 2763153 ± 34% numa-vmstat.node1.numa_other
101.25 ±141% +257.5% 362.00 ± 82% numa-vmstat.node1.workingset_nodes
149.25 ± 3% +24274.2% 36378 ±172% softirqs.CPU12.NET_RX
73193 ± 12% +16.8% 85481 ± 7% softirqs.CPU14.TIMER
92723 ± 5% +8.3% 100391 ± 3% softirqs.CPU16.RCU
91076 ± 8% +11.0% 101106 ± 3% softirqs.CPU17.RCU
71601 ± 11% +21.9% 87292 ± 8% softirqs.CPU17.TIMER
75826 ± 17% +28.6% 97538 ± 7% softirqs.CPU30.TIMER
21336 ± 18% +26.1% 26904 ± 2% softirqs.CPU34.SCHED
66547 ± 26% +33.0% 88538 ± 12% softirqs.CPU36.RCU
69872 ± 11% +24.4% 86887 ± 9% softirqs.CPU37.TIMER
74595 ± 20% +28.5% 95843 ± 7% softirqs.CPU44.RCU
71518 ± 12% +20.8% 86399 ± 9% softirqs.CPU44.TIMER
72709 ± 12% +19.3% 86749 ± 9% softirqs.CPU50.TIMER
71700 ± 12% +22.1% 87578 ± 8% softirqs.CPU6.TIMER
84070 ± 5% +15.8% 97365 ± 8% softirqs.CPU7.RCU
71608 ± 10% +35.8% 97268 ± 15% softirqs.CPU7.TIMER
71680 ± 13% +20.9% 86648 ± 10% softirqs.CPU8.TIMER
355.25 ± 4% -39.5% 215.00 ± 9% slabinfo.biovec-max.active_objs
355.25 ± 4% -39.5% 215.00 ± 9% slabinfo.biovec-max.num_objs
1203 ± 6% -9.2% 1092 ± 2% slabinfo.blkdev_ioc.active_objs
1243 ± 5% -10.1% 1117 ± 4% slabinfo.blkdev_ioc.num_objs
1119 ± 7% -16.6% 933.00 ± 8% slabinfo.dquot.active_objs
1119 ± 7% -16.6% 933.00 ± 8% slabinfo.dquot.num_objs
2958956 ± 2% +77.1% 5238960 slabinfo.ext4_extent_status.active_objs
49004 ± 3% +80.5% 88440 ± 2% slabinfo.ext4_extent_status.active_slabs
4998512 ± 3% +80.5% 9021005 ± 2% slabinfo.ext4_extent_status.num_objs
49004 ± 3% +80.5% 88440 ± 2% slabinfo.ext4_extent_status.num_slabs
1946 ± 6% -64.9% 683.75 ± 26% slabinfo.ext4_io_end.active_objs
1946 ± 6% -64.9% 683.75 ± 26% slabinfo.ext4_io_end.num_objs
4839 ± 6% -32.2% 3279 ± 9% slabinfo.fsnotify_mark_connector.active_objs
4839 ± 6% -32.2% 3279 ± 9% slabinfo.fsnotify_mark_connector.num_objs
31847 ± 3% +304.4% 128797 slabinfo.jbd2_journal_head.active_objs
976.75 ± 2% +300.0% 3907 slabinfo.jbd2_journal_head.active_slabs
33227 ± 2% +299.8% 132847 slabinfo.jbd2_journal_head.num_objs
976.75 ± 2% +300.0% 3907 slabinfo.jbd2_journal_head.num_slabs
6136 ± 62% -95.8% 257.50 ±127% proc-vmstat.allocstall_movable
2149 ± 47% -97.7% 49.75 ±154% proc-vmstat.allocstall_normal
12950089 ± 40% -96.6% 435795 ± 33% proc-vmstat.compact_daemon_free_scanned
2354 ± 15% -48.3% 1217 ± 12% proc-vmstat.compact_daemon_wake
13066988 ± 39% -96.7% 435795 ± 33% proc-vmstat.compact_free_scanned
545508 ± 40% -86.4% 74068 ± 88% proc-vmstat.compact_isolated
148.50 ± 14% +394.6% 734.50 ± 24% proc-vmstat.kswapd_high_wmark_hit_quickly
4562 -37.2% 2865 ± 6% proc-vmstat.kswapd_low_wmark_hit_quickly
76258 -7.2% 70787 proc-vmstat.nr_active_anon
55881 +151.9% 140753 proc-vmstat.nr_active_file
1.511e+08 -58.0% 63509486 ± 10% proc-vmstat.nr_dirtied
1755193 ± 2% +3.5% 1817148 proc-vmstat.nr_dirty
114286 -5.2% 108393 proc-vmstat.nr_shmem
424044 +9.5% 464234 proc-vmstat.nr_slab_reclaimable
32785 -1.0% 32473 proc-vmstat.nr_slab_unreclaimable
1.495e+08 -58.3% 62292440 ± 11% proc-vmstat.nr_written
76268 -7.2% 70798 proc-vmstat.nr_zone_active_anon
55882 +151.9% 140771 proc-vmstat.nr_zone_active_file
1757596 ± 2% +3.5% 1819265 proc-vmstat.nr_zone_write_pending
25870477 ± 6% -63.9% 9327553 ± 15% proc-vmstat.numa_foreign
4277 ± 50% -53.0% 2010 ± 52% proc-vmstat.numa_hint_faults_local
1.268e+08 -56.9% 54628951 ± 10% proc-vmstat.numa_hit
1.268e+08 -56.9% 54605440 ± 10% proc-vmstat.numa_local
25870477 ± 6% -63.9% 9327553 ± 15% proc-vmstat.numa_miss
25894008 ± 6% -63.9% 9351063 ± 15% proc-vmstat.numa_other
4781 -19.7% 3841 ± 2% proc-vmstat.pageoutrun
14089 ± 6% -58.4% 5854 ± 2% proc-vmstat.pgactivate
5717469 ± 5% -60.7% 2248190 ± 13% proc-vmstat.pgalloc_dma32
1.474e+08 -57.9% 62033715 ± 10% proc-vmstat.pgalloc_normal
1.428e+08 -62.0% 54275602 ± 12% proc-vmstat.pgfree
271840 ± 39% -83.2% 45689 ± 74% proc-vmstat.pgmigrate_success
7.259e+08 -64.1% 2.605e+08 ± 10% proc-vmstat.pgpgout
20728683 ± 40% -96.3% 759921 ±110% proc-vmstat.pgscan_direct
92248882 ± 9% -52.9% 43485504 ± 4% proc-vmstat.pgscan_kswapd
20728682 ± 40% -96.3% 759919 ±110% proc-vmstat.pgsteal_direct
92248829 ± 9% -52.9% 43485456 ± 4% proc-vmstat.pgsteal_kswapd
1.16e+08 -25.8% 86033473 ± 5% proc-vmstat.slabs_scanned
9.44 -10.6% 8.44 ± 6% perf-stat.i.MPKI
3.496e+09 -31.7% 2.389e+09 ± 7% perf-stat.i.branch-instructions
1.80 -0.1 1.70 ± 2% perf-stat.i.branch-miss-rate%
62817951 -35.2% 40720451 ± 9% perf-stat.i.branch-misses
32.34 -7.6 24.75 ± 7% perf-stat.i.cache-miss-rate%
58491266 ± 2% -54.1% 26863081 ± 10% perf-stat.i.cache-misses
1.72e+08 -39.5% 1.041e+08 ± 2% perf-stat.i.cache-references
5886 ± 5% -21.7% 4611 ± 3% perf-stat.i.context-switches
1.75 -13.0% 1.52 ± 2% perf-stat.i.cpi
3.23e+10 -40.9% 1.909e+10 ± 4% perf-stat.i.cpu-cycles
98.25 ± 2% -13.9% 84.61 perf-stat.i.cpu-migrations
662.38 +23.4% 817.14 ± 4% perf-stat.i.cycles-between-cache-misses
56505808 ± 18% -35.5% 36423798 ± 8% perf-stat.i.dTLB-load-misses
5.223e+09 -29.3% 3.695e+09 ± 7% perf-stat.i.dTLB-loads
4846212 ± 10% -45.7% 2629596 perf-stat.i.dTLB-store-misses
3.218e+09 -36.3% 2.05e+09 ± 5% perf-stat.i.dTLB-stores
6579800 ± 27% -55.2% 2948423 ± 21% perf-stat.i.iTLB-load-misses
2347506 ± 7% -36.2% 1496584 ± 18% perf-stat.i.iTLB-loads
1.813e+10 -31.3% 1.245e+10 ± 6% perf-stat.i.instructions
3209 ± 21% +44.6% 4639 ± 18% perf-stat.i.instructions-per-iTLB-miss
0.58 +15.0% 0.66 ± 2% perf-stat.i.ipc
0.45 -40.9% 0.27 ± 4% perf-stat.i.metric.GHz
169.13 -32.1% 114.86 ± 6% perf-stat.i.metric.M/sec
3174 -1.1% 3138 perf-stat.i.minor-faults
23143101 ± 2% -50.2% 11521113 ± 11% perf-stat.i.node-load-misses
27856680 ± 2% -55.0% 12547737 ± 17% perf-stat.i.node-loads
3524499 ± 2% -57.9% 1485166 ± 14% perf-stat.i.node-store-misses
3096777 ± 3% -59.1% 1267360 ± 11% perf-stat.i.node-stores
3174 -1.1% 3138 perf-stat.i.page-faults
9.49 -11.6% 8.39 ± 5% perf-stat.overall.MPKI
1.80 -0.1 1.70 ± 2% perf-stat.overall.branch-miss-rate%
34.01 ± 2% -8.2 25.78 ± 8% perf-stat.overall.cache-miss-rate%
1.78 -13.8% 1.54 ± 2% perf-stat.overall.cpi
552.56 ± 2% +29.4% 714.76 ± 6% perf-stat.overall.cycles-between-cache-misses
0.15 ± 12% -0.0 0.13 ± 3% perf-stat.overall.dTLB-store-miss-rate%
72.61 ± 8% -6.4 66.21 perf-stat.overall.iTLB-load-miss-rate%
2940 ± 23% +48.9% 4378 ± 18% perf-stat.overall.instructions-per-iTLB-miss
0.56 +16.1% 0.65 ± 2% perf-stat.overall.ipc
24110 +67.9% 40488 ± 5% perf-stat.overall.path-length
3.479e+09 -31.7% 2.378e+09 ± 7% perf-stat.ps.branch-instructions
62524565 -35.2% 40535951 ± 9% perf-stat.ps.branch-misses
58206685 ± 2% -54.1% 26734388 ± 10% perf-stat.ps.cache-misses
1.711e+08 -39.5% 1.036e+08 ± 2% perf-stat.ps.cache-references
5859 ± 5% -21.7% 4589 ± 3% perf-stat.ps.context-switches
3.214e+10 -40.9% 1.9e+10 ± 4% perf-stat.ps.cpu-cycles
97.78 ± 2% -13.9% 84.21 perf-stat.ps.cpu-migrations
56233980 ± 18% -35.5% 36253818 ± 8% perf-stat.ps.dTLB-load-misses
5.197e+09 -29.3% 3.677e+09 ± 7% perf-stat.ps.dTLB-loads
4822652 ± 10% -45.7% 2616966 perf-stat.ps.dTLB-store-misses
3.203e+09 -36.3% 2.04e+09 ± 5% perf-stat.ps.dTLB-stores
6548345 ± 27% -55.2% 2934364 ± 21% perf-stat.ps.iTLB-load-misses
2335855 ± 7% -36.2% 1489224 ± 18% perf-stat.ps.iTLB-loads
1.804e+10 -31.3% 1.239e+10 ± 6% perf-stat.ps.instructions
3166 -1.3% 3126 perf-stat.ps.minor-faults
23029576 ± 2% -50.2% 11466112 ± 11% perf-stat.ps.node-load-misses
27721032 ± 2% -55.0% 12486426 ± 17% perf-stat.ps.node-loads
3507651 ± 2% -57.8% 1478603 ± 14% perf-stat.ps.node-store-misses
3082410 ± 3% -59.1% 1261681 ± 11% perf-stat.ps.node-stores
3166 -1.3% 3126 perf-stat.ps.page-faults
3.631e+12 -31.1% 2.501e+12 ± 7% perf-stat.total.instructions
130.25 ± 14% +237.8% 440.00 ± 50% interrupts.49:IR-PCI-MSI.1572878-edge.eth0-TxRx-14
1960 ± 36% -68.6% 615.50 ± 22% interrupts.CPU0.NMI:Non-maskable_interrupts
1960 ± 36% -68.6% 615.50 ± 22% interrupts.CPU0.PMI:Performance_monitoring_interrupts
532.00 ± 90% +97.2% 1049 ± 42% interrupts.CPU0.RES:Rescheduling_interrupts
1089 ± 38% -43.2% 619.00 ± 41% interrupts.CPU1.NMI:Non-maskable_interrupts
1089 ± 38% -43.2% 619.00 ± 41% interrupts.CPU1.PMI:Performance_monitoring_interrupts
446.00 ± 55% -83.6% 73.00 ± 48% interrupts.CPU10.RES:Rescheduling_interrupts
1500 ± 40% -67.7% 484.50 ± 31% interrupts.CPU13.NMI:Non-maskable_interrupts
1500 ± 40% -67.7% 484.50 ± 31% interrupts.CPU13.PMI:Performance_monitoring_interrupts
130.25 ± 14% +237.8% 440.00 ± 50% interrupts.CPU14.49:IR-PCI-MSI.1572878-edge.eth0-TxRx-14
259.75 ± 96% -81.1% 49.00 ± 31% interrupts.CPU15.RES:Rescheduling_interrupts
84.25 ± 31% -56.7% 36.50 ± 32% interrupts.CPU16.RES:Rescheduling_interrupts
1518 ± 49% -72.5% 417.75 ± 29% interrupts.CPU2.NMI:Non-maskable_interrupts
1518 ± 49% -72.5% 417.75 ± 29% interrupts.CPU2.PMI:Performance_monitoring_interrupts
1792 ± 27% -59.8% 720.00 ± 44% interrupts.CPU20.NMI:Non-maskable_interrupts
1792 ± 27% -59.8% 720.00 ± 44% interrupts.CPU20.PMI:Performance_monitoring_interrupts
1021 ± 25% -40.6% 606.00 ± 27% interrupts.CPU22.NMI:Non-maskable_interrupts
1021 ± 25% -40.6% 606.00 ± 27% interrupts.CPU22.PMI:Performance_monitoring_interrupts
1426 ± 13% -33.7% 945.25 ± 18% interrupts.CPU23.NMI:Non-maskable_interrupts
1426 ± 13% -33.7% 945.25 ± 18% interrupts.CPU23.PMI:Performance_monitoring_interrupts
1746 ± 18% -56.8% 754.50 ± 38% interrupts.CPU24.NMI:Non-maskable_interrupts
1746 ± 18% -56.8% 754.50 ± 38% interrupts.CPU24.PMI:Performance_monitoring_interrupts
1778 ± 25% -65.1% 620.25 ± 43% interrupts.CPU25.NMI:Non-maskable_interrupts
1778 ± 25% -65.1% 620.25 ± 43% interrupts.CPU25.PMI:Performance_monitoring_interrupts
1748 ± 55% -80.6% 338.50 ± 10% interrupts.CPU27.NMI:Non-maskable_interrupts
1748 ± 55% -80.6% 338.50 ± 10% interrupts.CPU27.PMI:Performance_monitoring_interrupts
554.50 ± 67% -91.2% 49.00 ± 96% interrupts.CPU27.RES:Rescheduling_interrupts
1607 ± 30% -66.3% 542.25 ± 41% interrupts.CPU28.NMI:Non-maskable_interrupts
1607 ± 30% -66.3% 542.25 ± 41% interrupts.CPU28.PMI:Performance_monitoring_interrupts
2257 ± 44% -81.8% 410.75 ± 21% interrupts.CPU29.NMI:Non-maskable_interrupts
2257 ± 44% -81.8% 410.75 ± 21% interrupts.CPU29.PMI:Performance_monitoring_interrupts
203.25 ± 54% -82.8% 35.00 ± 69% interrupts.CPU29.RES:Rescheduling_interrupts
101.50 ± 31% -63.1% 37.50 ± 42% interrupts.CPU30.RES:Rescheduling_interrupts
1482 ± 14% -77.5% 333.50 ± 31% interrupts.CPU31.NMI:Non-maskable_interrupts
1482 ± 14% -77.5% 333.50 ± 31% interrupts.CPU31.PMI:Performance_monitoring_interrupts
3501 ±140% -99.0% 33.75 ± 37% interrupts.CPU31.RES:Rescheduling_interrupts
1944 ± 13% -70.0% 584.25 ± 47% interrupts.CPU32.NMI:Non-maskable_interrupts
1944 ± 13% -70.0% 584.25 ± 47% interrupts.CPU32.PMI:Performance_monitoring_interrupts
2061 ±136% -97.0% 61.50 ± 47% interrupts.CPU33.RES:Rescheduling_interrupts
161.00 ± 58% -56.4% 70.25 ± 44% interrupts.CPU34.RES:Rescheduling_interrupts
1061 ± 12% -40.2% 634.00 ± 38% interrupts.CPU35.NMI:Non-maskable_interrupts
1061 ± 12% -40.2% 634.00 ± 38% interrupts.CPU35.PMI:Performance_monitoring_interrupts
313.75 ± 79% -89.1% 34.25 ± 43% interrupts.CPU35.RES:Rescheduling_interrupts
2638 ± 55% -82.0% 473.75 ± 37% interrupts.CPU36.NMI:Non-maskable_interrupts
2638 ± 55% -82.0% 473.75 ± 37% interrupts.CPU36.PMI:Performance_monitoring_interrupts
684.00 ±104% -92.7% 50.25 ±123% interrupts.CPU36.RES:Rescheduling_interrupts
363.00 ± 12% +176.0% 1001 ± 77% interrupts.CPU37.CAL:Function_call_interrupts
1505 ± 29% -53.2% 704.25 ± 36% interrupts.CPU37.NMI:Non-maskable_interrupts
1505 ± 29% -53.2% 704.25 ± 36% interrupts.CPU37.PMI:Performance_monitoring_interrupts
1503 ± 21% -57.0% 646.50 ± 16% interrupts.CPU38.NMI:Non-maskable_interrupts
1503 ± 21% -57.0% 646.50 ± 16% interrupts.CPU38.PMI:Performance_monitoring_interrupts
371.00 ± 17% +128.6% 848.00 ± 70% interrupts.CPU39.CAL:Function_call_interrupts
1838 ± 21% -51.9% 883.50 ± 43% interrupts.CPU4.NMI:Non-maskable_interrupts
1838 ± 21% -51.9% 883.50 ± 43% interrupts.CPU4.PMI:Performance_monitoring_interrupts
1775 ± 41% -66.8% 588.75 ± 27% interrupts.CPU40.NMI:Non-maskable_interrupts
1775 ± 41% -66.8% 588.75 ± 27% interrupts.CPU40.PMI:Performance_monitoring_interrupts
305.75 ± 32% -90.6% 28.75 ± 27% interrupts.CPU40.RES:Rescheduling_interrupts
1657 ± 32% -65.8% 567.00 ± 30% interrupts.CPU43.NMI:Non-maskable_interrupts
1657 ± 32% -65.8% 567.00 ± 30% interrupts.CPU43.PMI:Performance_monitoring_interrupts
179.25 ±108% -80.1% 35.75 ± 28% interrupts.CPU43.RES:Rescheduling_interrupts
1956 ± 60% -63.2% 719.50 ± 26% interrupts.CPU44.NMI:Non-maskable_interrupts
1956 ± 60% -63.2% 719.50 ± 26% interrupts.CPU44.PMI:Performance_monitoring_interrupts
1959 ± 55% -71.8% 551.75 ± 29% interrupts.CPU46.NMI:Non-maskable_interrupts
1959 ± 55% -71.8% 551.75 ± 29% interrupts.CPU46.PMI:Performance_monitoring_interrupts
1222 ± 21% -40.2% 730.75 ± 31% interrupts.CPU51.NMI:Non-maskable_interrupts
1222 ± 21% -40.2% 730.75 ± 31% interrupts.CPU51.PMI:Performance_monitoring_interrupts
1495 ± 14% -57.1% 641.75 ± 39% interrupts.CPU54.NMI:Non-maskable_interrupts
1495 ± 14% -57.1% 641.75 ± 39% interrupts.CPU54.PMI:Performance_monitoring_interrupts
363.25 ± 4% +121.5% 804.75 ± 84% interrupts.CPU55.CAL:Function_call_interrupts
1859 ± 24% -68.5% 585.25 ± 21% interrupts.CPU56.NMI:Non-maskable_interrupts
1859 ± 24% -68.5% 585.25 ± 21% interrupts.CPU56.PMI:Performance_monitoring_interrupts
1448 ± 20% -50.8% 712.25 ± 37% interrupts.CPU57.NMI:Non-maskable_interrupts
1448 ± 20% -50.8% 712.25 ± 37% interrupts.CPU57.PMI:Performance_monitoring_interrupts
1876 ± 29% -55.1% 842.25 ± 56% interrupts.CPU58.NMI:Non-maskable_interrupts
1876 ± 29% -55.1% 842.25 ± 56% interrupts.CPU58.PMI:Performance_monitoring_interrupts
365.25 ± 4% +178.7% 1018 ± 81% interrupts.CPU59.CAL:Function_call_interrupts
2317 ± 79% -63.8% 839.25 ± 21% interrupts.CPU60.NMI:Non-maskable_interrupts
2317 ± 79% -63.8% 839.25 ± 21% interrupts.CPU60.PMI:Performance_monitoring_interrupts
203.50 ± 71% -80.7% 39.25 ± 34% interrupts.CPU61.RES:Rescheduling_interrupts
64.50 ± 52% -54.7% 29.25 ± 38% interrupts.CPU62.RES:Rescheduling_interrupts
3477 ± 67% -83.4% 576.50 ± 35% interrupts.CPU63.NMI:Non-maskable_interrupts
3477 ± 67% -83.4% 576.50 ± 35% interrupts.CPU63.PMI:Performance_monitoring_interrupts
2162 ± 30% -70.5% 638.00 ± 57% interrupts.CPU66.NMI:Non-maskable_interrupts
2162 ± 30% -70.5% 638.00 ± 57% interrupts.CPU66.PMI:Performance_monitoring_interrupts
118.25 ± 46% -59.6% 47.75 ± 44% interrupts.CPU66.RES:Rescheduling_interrupts
1610 ± 23% -68.6% 506.25 ± 46% interrupts.CPU67.NMI:Non-maskable_interrupts
1610 ± 23% -68.6% 506.25 ± 46% interrupts.CPU67.PMI:Performance_monitoring_interrupts
152.00 ± 35% -72.4% 42.00 ± 42% interrupts.CPU67.RES:Rescheduling_interrupts
1458 ± 15% -58.4% 607.00 ± 37% interrupts.CPU68.NMI:Non-maskable_interrupts
1458 ± 15% -58.4% 607.00 ± 37% interrupts.CPU68.PMI:Performance_monitoring_interrupts
139.00 ± 78% -80.0% 27.75 ± 57% interrupts.CPU68.RES:Rescheduling_interrupts
1873 ± 40% -52.4% 892.75 ± 38% interrupts.CPU70.NMI:Non-maskable_interrupts
1873 ± 40% -52.4% 892.75 ± 38% interrupts.CPU70.PMI:Performance_monitoring_interrupts
23.00 ± 94% +143.5% 56.00 ± 51% interrupts.CPU70.TLB:TLB_shootdowns
1631 ± 26% -49.3% 828.00 ± 58% interrupts.CPU71.NMI:Non-maskable_interrupts
1631 ± 26% -49.3% 828.00 ± 58% interrupts.CPU71.PMI:Performance_monitoring_interrupts
427.00 ± 36% +116.3% 923.75 ± 55% interrupts.CPU8.CAL:Function_call_interrupts
1098 ± 49% -48.4% 566.25 ± 24% interrupts.CPU8.NMI:Non-maskable_interrupts
1098 ± 49% -48.4% 566.25 ± 24% interrupts.CPU8.PMI:Performance_monitoring_interrupts
104.25 ± 6% -81.3% 19.50 ± 17% interrupts.IWI:IRQ_work_interrupts
117583 ± 8% -47.3% 61984 ± 8% interrupts.NMI:Non-maskable_interrupts
117583 ± 8% -47.3% 61984 ± 8% interrupts.PMI:Performance_monitoring_interrupts
47.58 ± 6% -25.5 22.04 ± 14% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
47.41 ± 6% -25.5 21.95 ± 14% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
37.72 ± 7% -17.4 20.34 ± 14% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
37.52 ± 7% -17.3 20.23 ± 14% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
36.49 ± 7% -16.8 19.70 ± 14% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
36.31 ± 7% -16.7 19.60 ± 14% perf-profile.calltrace.cycles-pp.ext4_buffered_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
35.63 ± 7% -16.5 19.13 ± 14% perf-profile.calltrace.cycles-pp.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write.ksys_write
27.09 ± 8% -12.2 14.85 ± 14% perf-profile.calltrace.cycles-pp.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write
8.88 ± 27% -8.9 0.00 perf-profile.calltrace.cycles-pp.mpage_process_page_bufs.mpage_prepare_extent_to_map.ext4_writepages.do_writepages.__writeback_single_inode
8.29 ± 27% -8.3 0.00 perf-profile.calltrace.cycles-pp.mpage_submit_page.mpage_process_page_bufs.mpage_prepare_extent_to_map.ext4_writepages.do_writepages
9.79 ± 26% -8.0 1.76 ± 14% perf-profile.calltrace.cycles-pp.mpage_prepare_extent_to_map.ext4_writepages.do_writepages.__writeback_single_inode.writeback_sb_inodes
7.82 ± 27% -7.8 0.00 perf-profile.calltrace.cycles-pp.ext4_bio_write_page.mpage_submit_page.mpage_process_page_bufs.mpage_prepare_extent_to_map.ext4_writepages
6.46 ± 63% -6.5 0.00 perf-profile.calltrace.cycles-pp.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe
6.46 ± 63% -6.5 0.00 perf-profile.calltrace.cycles-pp.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe
6.46 ± 63% -6.5 0.00 perf-profile.calltrace.cycles-pp.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe
17.01 ± 5% -6.3 10.73 ± 14% perf-profile.calltrace.cycles-pp.ext4_block_write_begin.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.new_sync_write
6.26 ± 28% -6.3 0.00 perf-profile.calltrace.cycles-pp.ext4_io_submit.ext4_bio_write_page.mpage_submit_page.mpage_process_page_bufs.mpage_prepare_extent_to_map
6.25 ± 28% -6.2 0.00 perf-profile.calltrace.cycles-pp.submit_bio.ext4_io_submit.ext4_bio_write_page.mpage_submit_page.mpage_process_page_bufs
6.23 ± 28% -6.2 0.00 perf-profile.calltrace.cycles-pp.generic_make_request.submit_bio.ext4_io_submit.ext4_bio_write_page.mpage_submit_page
6.09 ± 65% -6.1 0.00 perf-profile.calltrace.cycles-pp.invalidate_mapping_pages.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64
5.87 ± 28% -5.9 0.00 perf-profile.calltrace.cycles-pp.pmem_make_request.generic_make_request.submit_bio.ext4_io_submit.ext4_bio_write_page
15.75 ± 5% -5.5 10.21 ± 14% perf-profile.calltrace.cycles-pp.ext4_da_get_block_prep.ext4_block_write_begin.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
15.59 ± 5% -5.5 10.08 ± 14% perf-profile.calltrace.cycles-pp.ext4_da_map_blocks.ext4_da_get_block_prep.ext4_block_write_begin.ext4_da_write_begin.generic_perform_write
6.11 ± 16% -3.4 2.75 ± 17% perf-profile.calltrace.cycles-pp.grab_cache_page_write_begin.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.new_sync_write
6.05 ± 16% -3.3 2.72 ± 17% perf-profile.calltrace.cycles-pp.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
6.39 ± 9% -3.0 3.40 ± 14% perf-profile.calltrace.cycles-pp.ext4_es_lookup_extent.ext4_da_map_blocks.ext4_da_get_block_prep.ext4_block_write_begin.ext4_da_write_begin
3.60 ± 12% -2.4 1.18 ± 15% perf-profile.calltrace.cycles-pp.__ext4_journal_start_sb.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.new_sync_write
4.58 ± 8% -2.4 2.19 ± 15% perf-profile.calltrace.cycles-pp.ext4_da_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write
2.96 ± 12% -2.0 0.92 ± 18% perf-profile.calltrace.cycles-pp.jbd2__journal_start.__ext4_journal_start_sb.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
2.79 ± 12% -2.0 0.81 ± 18% perf-profile.calltrace.cycles-pp.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_da_write_begin.generic_perform_write
2.21 ± 30% -1.9 0.29 ±100% perf-profile.calltrace.cycles-pp.ext4_end_bio.pmem_make_request.generic_make_request.submit_bio.ext4_io_submit
3.48 ± 27% -1.8 1.66 ± 20% perf-profile.calltrace.cycles-pp.pmem_do_bvec.pmem_make_request.generic_make_request.submit_bio.ext4_io_submit
3.46 ± 27% -1.8 1.65 ± 20% perf-profile.calltrace.cycles-pp.write_pmem.pmem_do_bvec.pmem_make_request.generic_make_request.submit_bio
3.43 ± 27% -1.8 1.63 ± 19% perf-profile.calltrace.cycles-pp.__memcpy_flushcache.write_pmem.pmem_do_bvec.pmem_make_request.generic_make_request
4.08 ± 2% -1.8 2.33 ± 18% perf-profile.calltrace.cycles-pp.__read_extent_tree_block.ext4_find_extent.ext4_ext_map_blocks.ext4_da_map_blocks.ext4_da_get_block_prep
4.00 ± 2% -1.7 2.27 ± 18% perf-profile.calltrace.cycles-pp.__getblk_gfp.__read_extent_tree_block.ext4_find_extent.ext4_ext_map_blocks.ext4_da_map_blocks
3.47 ± 8% -1.7 1.82 ± 13% perf-profile.calltrace.cycles-pp.iov_iter_copy_from_user_atomic.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write
3.83 ± 2% -1.6 2.20 ± 18% perf-profile.calltrace.cycles-pp.__find_get_block.__getblk_gfp.__read_extent_tree_block.ext4_find_extent.ext4_ext_map_blocks
3.42 ± 8% -1.6 1.79 ± 13% perf-profile.calltrace.cycles-pp.copyin.iov_iter_copy_from_user_atomic.generic_perform_write.ext4_buffered_write_iter.new_sync_write
3.40 ± 8% -1.6 1.78 ± 13% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin.iov_iter_copy_from_user_atomic.generic_perform_write.ext4_buffered_write_iter
3.09 ± 8% -1.5 1.64 ± 15% perf-profile.calltrace.cycles-pp.generic_write_end.ext4_da_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write
5.84 ± 2% -1.4 4.44 ± 18% perf-profile.calltrace.cycles-pp.ext4_ext_map_blocks.ext4_da_map_blocks.ext4_da_get_block_prep.ext4_block_write_begin.ext4_da_write_begin
5.61 -1.3 4.30 ± 19% perf-profile.calltrace.cycles-pp.ext4_find_extent.ext4_ext_map_blocks.ext4_da_map_blocks.ext4_da_get_block_prep.ext4_block_write_begin
2.71 ± 8% -1.3 1.45 ± 14% perf-profile.calltrace.cycles-pp.block_write_end.generic_write_end.ext4_da_write_end.generic_perform_write.ext4_buffered_write_iter
2.67 ± 9% -1.2 1.43 ± 14% perf-profile.calltrace.cycles-pp.__block_commit_write.block_write_end.generic_write_end.ext4_da_write_end.generic_perform_write
1.62 ± 55% -1.2 0.40 ± 57% perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin.generic_perform_write
3.06 ± 8% -1.1 1.94 ± 4% perf-profile.calltrace.cycles-pp.ext4_es_insert_extent.ext4_da_map_blocks.ext4_da_get_block_prep.ext4_block_write_begin.ext4_da_write_begin
1.98 ± 4% -1.1 0.87 ± 16% perf-profile.calltrace.cycles-pp.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin.generic_perform_write
2.36 ± 7% -1.0 1.32 ± 18% perf-profile.calltrace.cycles-pp.find_get_entry.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin.generic_perform_write
2.33 ± 7% -1.0 1.31 ± 18% perf-profile.calltrace.cycles-pp.xas_load.find_get_entry.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin
1.16 ± 11% -0.9 0.27 ±100% perf-profile.calltrace.cycles-pp.create_empty_buffers.ext4_block_write_begin.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
1.57 ± 9% -0.7 0.83 ± 11% perf-profile.calltrace.cycles-pp.mark_buffer_dirty.__block_commit_write.block_write_end.generic_write_end.ext4_da_write_end
1.11 ± 7% -0.7 0.41 ± 57% perf-profile.calltrace.cycles-pp.__add_to_page_cache_locked.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin
0.93 ± 6% -0.7 0.26 ±100% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64
1.35 ± 11% -0.6 0.70 ± 11% perf-profile.calltrace.cycles-pp.__set_page_dirty.mark_buffer_dirty.__block_commit_write.block_write_end.generic_write_end
0.88 ± 16% -0.6 0.26 ±100% perf-profile.calltrace.cycles-pp.__xa_set_mark.__set_page_dirty.mark_buffer_dirty.__block_commit_write.block_write_end
0.88 ± 5% -0.6 0.26 ±100% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret
1.92 ± 7% -0.6 1.36 ± 2% perf-profile.calltrace.cycles-pp.__es_insert_extent.ext4_es_insert_extent.ext4_da_map_blocks.ext4_da_get_block_prep.ext4_block_write_begin
1.67 ± 3% -0.3 1.33 ± 18% perf-profile.calltrace.cycles-pp.pagecache_get_page.__find_get_block.__getblk_gfp.__read_extent_tree_block.ext4_find_extent
1.63 ± 3% -0.3 1.31 ± 18% perf-profile.calltrace.cycles-pp.find_get_entry.pagecache_get_page.__find_get_block.__getblk_gfp.__read_extent_tree_block
0.71 ± 25% +0.4 1.11 ± 12% perf-profile.calltrace.cycles-pp.find_get_pages_range_tag.pagevec_lookup_range_tag.mpage_prepare_extent_to_map.ext4_writepages.do_writepages
0.71 ± 25% +0.4 1.12 ± 12% perf-profile.calltrace.cycles-pp.pagevec_lookup_range_tag.mpage_prepare_extent_to_map.ext4_writepages.do_writepages.__writeback_single_inode
0.00 +0.6 0.63 ± 11% perf-profile.calltrace.cycles-pp.__es_insert_extent.ext4_es_insert_extent.ext4_map_blocks.mpage_map_and_submit_extent.ext4_writepages
0.00 +0.7 0.71 ± 16% perf-profile.calltrace.cycles-pp.ext4_bio_write_page.mpage_submit_page.mpage_map_and_submit_buffers.mpage_map_and_submit_extent.ext4_writepages
0.00 +0.7 0.74 ± 16% perf-profile.calltrace.cycles-pp.ext4_release_io_end.ext4_put_io_end.ext4_writepages.do_writepages.__writeback_single_inode
0.00 +0.8 0.75 ± 13% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
0.00 +0.8 0.78 ± 14% perf-profile.calltrace.cycles-pp.ext4_es_insert_extent.ext4_map_blocks.ext4_convert_unwritten_extents.ext4_convert_unwritten_io_end_vec.ext4_put_io_end
0.00 +0.8 0.80 ± 2% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
0.00 +0.8 0.80 ± 22% perf-profile.calltrace.cycles-pp.es_do_reclaim_extents.es_reclaim_extents.__es_shrink.ext4_es_scan.do_shrink_slab
0.00 +0.8 0.81 ± 22% perf-profile.calltrace.cycles-pp.es_reclaim_extents.__es_shrink.ext4_es_scan.do_shrink_slab.shrink_slab
0.00 +0.8 0.81 ± 13% perf-profile.calltrace.cycles-pp.ext4_find_extent.ext4_ext_map_blocks.ext4_map_blocks.mpage_map_and_submit_extent.ext4_writepages
0.00 +0.8 0.81 ± 22% perf-profile.calltrace.cycles-pp.ext4_es_scan.do_shrink_slab.shrink_slab.shrink_node.balance_pgdat
0.00 +0.8 0.81 ± 22% perf-profile.calltrace.cycles-pp.__es_shrink.ext4_es_scan.do_shrink_slab.shrink_slab.shrink_node
0.00 +0.8 0.82 ± 22% perf-profile.calltrace.cycles-pp.shrink_slab.shrink_node.balance_pgdat.kswapd.kthread
0.00 +0.8 0.82 ± 22% perf-profile.calltrace.cycles-pp.do_shrink_slab.shrink_slab.shrink_node.balance_pgdat.kswapd
0.00 +0.9 0.85 ± 16% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt
0.14 ±173% +0.9 1.04 ± 14% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
0.00 +0.9 0.91 ± 15% perf-profile.calltrace.cycles-pp.mpage_submit_page.mpage_map_and_submit_buffers.mpage_map_and_submit_extent.ext4_writepages.do_writepages
0.00 +1.0 0.98 ± 18% perf-profile.calltrace.cycles-pp.ext4_ext_map_blocks.ext4_map_blocks.ext4_convert_unwritten_extents.ext4_convert_unwritten_io_end_vec.ext4_put_io_end
0.00 +1.0 1.02 ± 2% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
0.71 ± 12% +1.1 1.76 ± 12% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
0.00 +1.1 1.08 ± 12% perf-profile.calltrace.cycles-pp.ext4_split_extent.ext4_split_convert_extents.ext4_ext_handle_unwritten_extents.ext4_ext_map_blocks.ext4_map_blocks
0.00 +1.1 1.10 ± 12% perf-profile.calltrace.cycles-pp.ext4_split_convert_extents.ext4_ext_handle_unwritten_extents.ext4_ext_map_blocks.ext4_map_blocks.mpage_map_and_submit_extent
0.00 +1.1 1.12 ± 11% perf-profile.calltrace.cycles-pp.ext4_ext_handle_unwritten_extents.ext4_ext_map_blocks.ext4_map_blocks.mpage_map_and_submit_extent.ext4_writepages
0.00 +1.1 1.12 ± 15% perf-profile.calltrace.cycles-pp.mpage_map_and_submit_buffers.mpage_map_and_submit_extent.ext4_writepages.do_writepages.__writeback_single_inode
0.86 ± 36% +1.1 2.00 ± 27% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
0.00 +1.2 1.21 ± 11% perf-profile.calltrace.cycles-pp.ext4_es_insert_extent.ext4_map_blocks.mpage_map_and_submit_extent.ext4_writepages.do_writepages
0.82 ± 10% +1.3 2.15 ± 6% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.43 ±113% +1.3 1.76 ± 27% perf-profile.calltrace.cycles-pp.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node
0.00 +1.4 1.35 ± 28% perf-profile.calltrace.cycles-pp.xas_create.xas_store.__delete_from_page_cache.__remove_mapping.shrink_page_list
1.04 ± 33% +1.4 2.42 ± 25% perf-profile.calltrace.cycles-pp.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.00 +1.4 1.38 ± 28% perf-profile.calltrace.cycles-pp.xas_store.__delete_from_page_cache.__remove_mapping.shrink_page_list.shrink_inactive_list
0.00 +1.6 1.56 ± 28% perf-profile.calltrace.cycles-pp.__delete_from_page_cache.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_lruvec
1.26 ± 16% +1.6 2.88 ± 8% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.00 +2.0 2.00 ± 16% perf-profile.calltrace.cycles-pp.ext4_map_blocks.ext4_convert_unwritten_extents.ext4_convert_unwritten_io_end_vec.ext4_put_io_end.ext4_writepages
0.00 +2.1 2.07 ± 12% perf-profile.calltrace.cycles-pp.ext4_ext_map_blocks.ext4_map_blocks.mpage_map_and_submit_extent.ext4_writepages.do_writepages
0.00 +2.3 2.28 ± 17% perf-profile.calltrace.cycles-pp.pmem_make_request.generic_make_request.submit_bio.ext4_io_submit.ext4_writepages
0.22 ±173% +2.5 2.71 ± 27% perf-profile.calltrace.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat
0.00 +2.5 2.49 ± 18% perf-profile.calltrace.cycles-pp.generic_make_request.submit_bio.ext4_io_submit.ext4_writepages.do_writepages
0.00 +2.5 2.50 ± 18% perf-profile.calltrace.cycles-pp.submit_bio.ext4_io_submit.ext4_writepages.do_writepages.__writeback_single_inode
0.00 +2.5 2.51 ± 17% perf-profile.calltrace.cycles-pp.ext4_io_submit.ext4_writepages.do_writepages.__writeback_single_inode.writeback_sb_inodes
0.00 +2.6 2.58 ± 15% perf-profile.calltrace.cycles-pp.ext4_convert_unwritten_extents.ext4_convert_unwritten_io_end_vec.ext4_put_io_end.ext4_writepages.do_writepages
0.24 ±173% +2.7 2.89 ± 26% perf-profile.calltrace.cycles-pp.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat.kswapd
0.24 ±173% +2.7 2.90 ± 26% perf-profile.calltrace.cycles-pp.shrink_lruvec.shrink_node.balance_pgdat.kswapd.kthread
0.00 +2.9 2.94 ± 14% perf-profile.calltrace.cycles-pp.ext4_convert_unwritten_io_end_vec.ext4_put_io_end.ext4_writepages.do_writepages.__writeback_single_inode
0.34 ±173% +3.4 3.72 ± 25% perf-profile.calltrace.cycles-pp.shrink_node.balance_pgdat.kswapd.kthread.ret_from_fork
0.34 ±173% +3.4 3.73 ± 25% perf-profile.calltrace.cycles-pp.balance_pgdat.kswapd.kthread.ret_from_fork
0.34 ±173% +3.4 3.73 ± 25% perf-profile.calltrace.cycles-pp.kswapd.kthread.ret_from_fork
2.54 ± 20% +3.4 5.97 ± 12% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
2.73 ± 19% +3.7 6.42 ± 11% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
0.00 +4.0 3.99 ± 15% perf-profile.calltrace.cycles-pp.ext4_put_io_end.ext4_writepages.do_writepages.__writeback_single_inode.writeback_sb_inodes
0.00 +4.6 4.57 ± 12% perf-profile.calltrace.cycles-pp.ext4_map_blocks.mpage_map_and_submit_extent.ext4_writepages.do_writepages.__writeback_single_inode
10.05 ± 24% +4.8 14.88 ± 14% perf-profile.calltrace.cycles-pp.wb_workfn.process_one_work.worker_thread.kthread.ret_from_fork
10.05 ± 24% +4.8 14.88 ± 14% perf-profile.calltrace.cycles-pp.wb_writeback.wb_workfn.process_one_work.worker_thread.kthread
10.05 ± 24% +4.8 14.88 ± 14% perf-profile.calltrace.cycles-pp.__writeback_inodes_wb.wb_writeback.wb_workfn.process_one_work.worker_thread
10.05 ± 24% +4.8 14.88 ± 14% perf-profile.calltrace.cycles-pp.writeback_sb_inodes.__writeback_inodes_wb.wb_writeback.wb_workfn.process_one_work
10.05 ± 24% +4.8 14.88 ± 14% perf-profile.calltrace.cycles-pp.__writeback_single_inode.writeback_sb_inodes.__writeback_inodes_wb.wb_writeback.wb_workfn
10.05 ± 24% +4.8 14.88 ± 14% perf-profile.calltrace.cycles-pp.do_writepages.__writeback_single_inode.writeback_sb_inodes.__writeback_inodes_wb.wb_writeback
10.01 ± 24% +4.8 14.85 ± 14% perf-profile.calltrace.cycles-pp.ext4_writepages.do_writepages.__writeback_single_inode.writeback_sb_inodes.__writeback_inodes_wb
10.13 ± 24% +4.9 14.99 ± 14% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
10.13 ± 24% +4.9 15.00 ± 14% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
0.00 +5.8 5.84 ± 12% perf-profile.calltrace.cycles-pp.mpage_map_and_submit_extent.ext4_writepages.do_writepages.__writeback_single_inode.writeback_sb_inodes
10.93 ± 21% +8.0 18.96 ± 16% perf-profile.calltrace.cycles-pp.ret_from_fork
10.93 ± 21% +8.0 18.96 ± 16% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
34.76 ± 5% +9.6 44.39 ± 12% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
36.24 ± 6% +15.2 51.42 ± 9% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
36.41 ± 6% +15.4 51.83 ± 9% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
38.99 ± 5% +16.5 55.50 ± 9% perf-profile.calltrace.cycles-pp.secondary_startup_64
37.52 ± 6% +17.2 54.72 ± 9% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
37.52 ± 6% +17.2 54.74 ± 9% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
37.52 ± 6% +17.2 54.74 ± 9% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
47.75 ± 6% -25.4 22.31 ± 13% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
47.59 ± 6% -25.4 22.22 ± 13% perf-profile.children.cycles-pp.do_syscall_64
37.76 ± 7% -17.4 20.36 ± 14% perf-profile.children.cycles-pp.ksys_write
37.56 ± 7% -17.3 20.25 ± 14% perf-profile.children.cycles-pp.vfs_write
36.53 ± 7% -16.8 19.72 ± 14% perf-profile.children.cycles-pp.new_sync_write
36.31 ± 7% -16.7 19.60 ± 14% perf-profile.children.cycles-pp.ext4_buffered_write_iter
35.67 ± 7% -16.5 19.16 ± 14% perf-profile.children.cycles-pp.generic_perform_write
27.10 ± 8% -12.2 14.86 ± 14% perf-profile.children.cycles-pp.ext4_da_write_begin
9.09 ± 24% -8.8 0.28 ± 23% perf-profile.children.cycles-pp.mpage_process_page_bufs
10.03 ± 24% -8.3 1.76 ± 14% perf-profile.children.cycles-pp.mpage_prepare_extent_to_map
8.57 ± 24% -7.7 0.91 ± 15% perf-profile.children.cycles-pp.mpage_submit_page
8.09 ± 24% -7.4 0.71 ± 16% perf-profile.children.cycles-pp.ext4_bio_write_page
6.49 ± 61% -6.5 0.00 perf-profile.children.cycles-pp.__x64_sys_fadvise64
6.49 ± 61% -6.5 0.00 perf-profile.children.cycles-pp.ksys_fadvise64_64
6.49 ± 61% -6.5 0.00 perf-profile.children.cycles-pp.generic_fadvise
17.01 ± 5% -6.3 10.73 ± 14% perf-profile.children.cycles-pp.ext4_block_write_begin
6.14 ± 64% -6.1 0.00 perf-profile.children.cycles-pp.invalidate_mapping_pages
15.75 ± 5% -5.5 10.21 ± 14% perf-profile.children.cycles-pp.ext4_da_get_block_prep
15.59 ± 5% -5.5 10.09 ± 14% perf-profile.children.cycles-pp.ext4_da_map_blocks
6.57 ± 23% -4.1 2.51 ± 17% perf-profile.children.cycles-pp.ext4_io_submit
6.59 ± 23% -4.0 2.60 ± 17% perf-profile.children.cycles-pp.submit_bio
6.58 ± 23% -4.0 2.59 ± 17% perf-profile.children.cycles-pp.generic_make_request
6.20 ± 23% -3.8 2.37 ± 17% perf-profile.children.cycles-pp.pmem_make_request
7.76 ± 13% -3.7 4.10 ± 17% perf-profile.children.cycles-pp.pagecache_get_page
4.23 ± 54% -3.4 0.86 ± 27% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
6.12 ± 16% -3.4 2.75 ± 17% perf-profile.children.cycles-pp.grab_cache_page_write_begin
3.75 ± 57% -2.8 0.94 ± 26% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
4.60 ± 8% -2.4 2.19 ± 14% perf-profile.children.cycles-pp.ext4_da_write_end
6.42 ± 9% -2.3 4.11 ± 13% perf-profile.children.cycles-pp.ext4_es_lookup_extent
3.67 ± 22% -2.0 1.70 ± 20% perf-profile.children.cycles-pp.pmem_do_bvec
3.65 ± 22% -2.0 1.70 ± 20% perf-profile.children.cycles-pp.write_pmem
3.62 ± 22% -1.9 1.68 ± 20% perf-profile.children.cycles-pp.__memcpy_flushcache
3.68 ± 12% -1.9 1.74 ± 10% perf-profile.children.cycles-pp.__ext4_journal_start_sb
2.31 ± 25% -1.8 0.50 ± 16% perf-profile.children.cycles-pp.ext4_end_bio
3.48 ± 8% -1.7 1.83 ± 13% perf-profile.children.cycles-pp.iov_iter_copy_from_user_atomic
3.44 ± 8% -1.6 1.80 ± 13% perf-profile.children.cycles-pp.copyin
3.42 ± 8% -1.6 1.79 ± 13% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
3.77 ± 6% -1.6 2.16 ± 15% perf-profile.children.cycles-pp.xas_load
3.02 ± 12% -1.6 1.44 ± 11% perf-profile.children.cycles-pp.jbd2__journal_start
3.11 ± 8% -1.5 1.65 ± 15% perf-profile.children.cycles-pp.generic_write_end
2.84 ± 12% -1.4 1.45 ± 11% perf-profile.children.cycles-pp.start_this_handle
4.02 ± 5% -1.4 2.67 ± 18% perf-profile.children.cycles-pp.find_get_entry
2.72 ± 8% -1.3 1.46 ± 14% perf-profile.children.cycles-pp.block_write_end
2.67 ± 9% -1.2 1.44 ± 14% perf-profile.children.cycles-pp.__block_commit_write
1.73 ± 53% -1.2 0.53 ± 10% perf-profile.children.cycles-pp.__alloc_pages_nodemask
3.94 ± 2% -1.1 2.81 ± 16% perf-profile.children.cycles-pp.__find_get_block
1.98 ± 4% -1.1 0.87 ± 16% perf-profile.children.cycles-pp.add_to_page_cache_lru
4.07 ± 2% -1.0 3.06 ± 16% perf-profile.children.cycles-pp.__getblk_gfp
4.10 ± 2% -1.0 3.12 ± 15% perf-profile.children.cycles-pp.__read_extent_tree_block
1.88 ± 11% -0.8 1.03 ± 11% perf-profile.children.cycles-pp._raw_spin_lock
1.58 ± 9% -0.7 0.84 ± 11% perf-profile.children.cycles-pp.mark_buffer_dirty
1.17 ± 10% -0.7 0.47 ± 18% perf-profile.children.cycles-pp.create_empty_buffers
1.36 ± 11% -0.6 0.71 ± 10% perf-profile.children.cycles-pp.__set_page_dirty
0.82 ± 29% -0.6 0.20 ± 20% perf-profile.children.cycles-pp.__list_del_entry_valid
1.12 ± 7% -0.6 0.51 ± 15% perf-profile.children.cycles-pp.__add_to_page_cache_locked
1.02 ± 6% -0.5 0.47 ± 11% perf-profile.children.cycles-pp.get_page_from_freelist
1.10 ± 18% -0.5 0.56 ± 15% perf-profile.children.cycles-pp.ext4_finish_bio
1.27 ± 10% -0.5 0.73 ± 9% perf-profile.children.cycles-pp.jbd2_journal_stop
1.32 ± 11% -0.5 0.83 ± 8% perf-profile.children.cycles-pp.__ext4_journal_stop
1.02 ± 5% -0.5 0.54 ± 11% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.82 ± 7% -0.5 0.35 ± 17% perf-profile.children.cycles-pp.__lru_cache_add
0.94 ± 6% -0.5 0.48 ± 16% perf-profile.children.cycles-pp.entry_SYSCALL_64
0.76 ± 8% -0.4 0.31 ± 6% perf-profile.children.cycles-pp.rmqueue
0.74 ± 8% -0.4 0.30 ± 18% perf-profile.children.cycles-pp.pagevec_lru_move_fn
0.87 ± 18% -0.4 0.43 ± 16% perf-profile.children.cycles-pp.end_page_writeback
0.86 ± 18% -0.4 0.43 ± 17% perf-profile.children.cycles-pp.test_clear_page_writeback
0.72 ± 11% -0.4 0.30 ± 18% perf-profile.children.cycles-pp.alloc_page_buffers
0.72 ± 19% -0.4 0.31 ± 9% perf-profile.children.cycles-pp.__test_set_page_writeback
0.95 ± 12% -0.4 0.54 ± 18% perf-profile.children.cycles-pp._raw_read_lock
0.88 ± 16% -0.4 0.48 ± 10% perf-profile.children.cycles-pp.__xa_set_mark
0.66 ± 13% -0.4 0.27 ± 17% perf-profile.children.cycles-pp.alloc_buffer_head
0.51 ± 9% -0.4 0.14 ± 18% perf-profile.children.cycles-pp.rmqueue_bulk
0.73 ± 4% -0.4 0.37 ± 14% perf-profile.children.cycles-pp.security_file_permission
0.72 ± 17% -0.3 0.39 ± 10% perf-profile.children.cycles-pp.xas_set_mark
0.68 ± 5% -0.3 0.34 ± 16% perf-profile.children.cycles-pp.common_file_perm
0.64 ± 13% -0.3 0.33 ± 4% perf-profile.children.cycles-pp.ext4_journal_check_start
0.67 ± 10% -0.3 0.38 ± 15% perf-profile.children.cycles-pp.add_transaction_credits
0.48 ± 18% -0.3 0.21 ± 12% perf-profile.children.cycles-pp.clear_page_dirty_for_io
0.53 ± 6% -0.3 0.26 ± 18% perf-profile.children.cycles-pp.aa_file_perm
0.40 ± 15% -0.3 0.14 ± 23% perf-profile.children.cycles-pp.workingset_update_node
0.45 ± 6% -0.2 0.21 ± 12% perf-profile.children.cycles-pp.__mod_lruvec_state
0.43 ± 25% -0.2 0.20 ± 23% perf-profile.children.cycles-pp.bio_alloc_bioset
0.42 ± 13% -0.2 0.21 ± 19% perf-profile.children.cycles-pp.ksys_lseek
0.43 ± 3% -0.2 0.23 ± 19% perf-profile.children.cycles-pp.__pagevec_lru_add_fn
0.37 ± 4% -0.2 0.17 ± 15% perf-profile.children.cycles-pp.account_page_dirtied
0.33 ± 26% -0.2 0.14 ± 20% perf-profile.children.cycles-pp.new_slab
0.32 ± 24% -0.2 0.17 ± 25% perf-profile.children.cycles-pp.mempool_alloc
0.27 ± 9% -0.1 0.14 ± 20% perf-profile.children.cycles-pp.__fdget_pos
0.20 ± 8% -0.1 0.08 ± 24% perf-profile.children.cycles-pp.xas_start
0.31 ± 22% -0.1 0.19 ± 19% perf-profile.children.cycles-pp.generic_make_request_checks
0.24 ± 22% -0.1 0.12 ± 15% perf-profile.children.cycles-pp._raw_spin_lock_irq
0.23 ± 11% -0.1 0.12 ± 20% perf-profile.children.cycles-pp.__fget_light
0.44 ± 8% -0.1 0.33 ± 9% perf-profile.children.cycles-pp.stop_this_handle
0.20 ± 5% -0.1 0.10 ± 9% perf-profile.children.cycles-pp.__mod_node_page_state
0.18 ± 12% -0.1 0.08 ± 8% perf-profile.children.cycles-pp.mem_cgroup_commit_charge
0.18 ± 9% -0.1 0.08 ± 15% perf-profile.children.cycles-pp.mem_cgroup_try_charge
0.20 ± 7% -0.1 0.10 ± 22% perf-profile.children.cycles-pp.page_mapping
0.19 ± 17% -0.1 0.10 ± 13% perf-profile.children.cycles-pp.ext4_llseek
0.18 ± 25% -0.1 0.09 ± 20% perf-profile.children.cycles-pp.bvec_alloc
0.12 ± 21% -0.1 0.04 ± 59% perf-profile.children.cycles-pp.dec_zone_page_state
0.18 ± 11% -0.1 0.11 ± 13% perf-profile.children.cycles-pp.unlock_page
0.16 ± 5% -0.1 0.08 ± 15% perf-profile.children.cycles-pp.__mod_memcg_state
0.19 ± 14% -0.1 0.11 ± 25% perf-profile.children.cycles-pp.node_dirty_ok
0.12 ± 19% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.get_mem_cgroup_from_mm
0.16 ± 21% -0.1 0.09 ± 16% perf-profile.children.cycles-pp.__xa_clear_mark
0.14 ± 3% -0.1 0.07 ± 12% perf-profile.children.cycles-pp.iov_iter_fault_in_readable
0.12 ± 16% -0.1 0.06 ± 9% perf-profile.children.cycles-pp.mem_cgroup_charge_statistics
0.09 ± 20% -0.1 0.03 ±100% perf-profile.children.cycles-pp.blk_throtl_bio
0.12 ± 9% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.down_read
0.10 ± 5% -0.0 0.07 ± 17% perf-profile.children.cycles-pp.ext4_file_write_iter
0.18 ± 3% +0.0 0.20 ± 4% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax
0.06 ± 13% +0.0 0.10 ± 15% perf-profile.children.cycles-pp.update_load_avg
0.07 ± 17% +0.0 0.11 ± 10% perf-profile.children.cycles-pp.mark_page_accessed
0.03 ±100% +0.0 0.07 ± 5% perf-profile.children.cycles-pp.kfree
0.21 ± 7% +0.0 0.25 ± 14% perf-profile.children.cycles-pp.__kmalloc
0.13 ± 8% +0.0 0.17 ± 15% perf-profile.children.cycles-pp.memset_erms
0.19 ± 6% +0.0 0.24 ± 11% perf-profile.children.cycles-pp.__might_sleep
0.00 +0.1 0.05 perf-profile.children.cycles-pp.ext4_init_io_end
0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.schedule
0.00 +0.1 0.06 ± 22% perf-profile.children.cycles-pp.account_process_tick
0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.rcu_eqs_enter
0.00 +0.1 0.06 ± 14% perf-profile.children.cycles-pp.call_cpuidle
0.01 ±173% +0.1 0.07 ± 26% perf-profile.children.cycles-pp.timekeeping_max_deferment
0.00 +0.1 0.06 ± 20% perf-profile.children.cycles-pp.__isolate_lru_page
0.02 ±173% +0.1 0.08 ± 37% perf-profile.children.cycles-pp.delay_tsc
0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.rcu_irq_exit
0.28 ± 5% +0.1 0.34 ± 2% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.07 ± 15% +0.1 0.14 ± 28% perf-profile.children.cycles-pp.native_apic_msr_eoi_write
0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.schedule_idle
0.00 +0.1 0.07 ± 23% perf-profile.children.cycles-pp.__hrtimer_get_next_event
0.21 ± 4% +0.1 0.28 ± 12% perf-profile.children.cycles-pp.__brelse
0.03 ±100% +0.1 0.09 ± 15% perf-profile.children.cycles-pp.timerqueue_add
0.00 +0.1 0.07 ± 16% perf-profile.children.cycles-pp.ext4_data_block_valid
0.00 +0.1 0.07 ± 33% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.03 ±100% +0.1 0.10 ± 11% perf-profile.children.cycles-pp.__intel_pmu_enable_all
0.00 +0.1 0.07 ± 10% perf-profile.children.cycles-pp._raw_write_lock
0.05 ± 58% +0.1 0.12 ± 5% perf-profile.children.cycles-pp.__sched_text_start
0.05 ± 8% +0.1 0.12 ± 8% perf-profile.children.cycles-pp.__remove_hrtimer
0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.idle_cpu
0.01 ±173% +0.1 0.09 ± 31% perf-profile.children.cycles-pp.update_rq_clock
0.03 ±100% +0.1 0.10 ± 16% perf-profile.children.cycles-pp.rcu_idle_exit
0.00 +0.1 0.07 ± 30% perf-profile.children.cycles-pp.crypto_shash_update
0.00 +0.1 0.07 ± 33% perf-profile.children.cycles-pp.pm_qos_request
0.07 ± 17% +0.1 0.14 ± 22% perf-profile.children.cycles-pp.__hrtimer_next_event_base
0.00 +0.1 0.08 ± 19% perf-profile.children.cycles-pp.hrtimer_get_next_event
0.00 +0.1 0.08 ± 14% perf-profile.children.cycles-pp.rcu_dynticks_eqs_exit
0.00 +0.1 0.08 ± 17% perf-profile.children.cycles-pp.__check_block_validity
0.00 +0.1 0.08 ± 17% perf-profile.children.cycles-pp.ext4_inode_csum
0.00 +0.1 0.08 ± 8% perf-profile.children.cycles-pp.ext4_alloc_io_end_vec
0.03 ±100% +0.1 0.11 ± 21% perf-profile.children.cycles-pp.submit_bh_wbc
0.03 ±100% +0.1 0.11 ± 22% perf-profile.children.cycles-pp.enqueue_hrtimer
0.00 +0.1 0.09 ± 26% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
0.03 ±100% +0.1 0.11 ± 22% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
0.01 ±173% +0.1 0.10 ± 24% perf-profile.children.cycles-pp.interrupt_entry
0.00 +0.1 0.09 ± 30% perf-profile.children.cycles-pp.run_posix_cpu_timers
0.00 +0.1 0.09 ± 24% perf-profile.children.cycles-pp.ksoftirqd_running
0.00 +0.1 0.09 ± 17% perf-profile.children.cycles-pp.timerqueue_del
0.01 ±173% +0.1 0.10 ± 58% perf-profile.children.cycles-pp.tick_check_oneshot_broadcast_this_cpu
0.00 +0.1 0.09 ± 19% perf-profile.children.cycles-pp.ext4_inode_csum_set
0.00 +0.1 0.09 ± 24% perf-profile.children.cycles-pp.arch_cpu_idle_enter
0.14 ± 6% +0.1 0.23 ± 7% perf-profile.children.cycles-pp.ext4_ext_drop_refs
0.00 +0.1 0.10 ± 15% perf-profile.children.cycles-pp.rwsem_down_read_slowpath
0.00 +0.1 0.10 ± 27% perf-profile.children.cycles-pp.ext4_extent_block_csum_set
0.00 +0.1 0.10 ± 12% perf-profile.children.cycles-pp.find_get_pages_range
0.05 ± 9% +0.1 0.16 ± 19% perf-profile.children.cycles-pp.native_sched_clock
0.00 +0.1 0.10 ± 17% perf-profile.children.cycles-pp.jbd2_write_access_granted
0.00 +0.1 0.10 ± 14% perf-profile.children.cycles-pp.pagevec_lookup_range
0.00 +0.1 0.10 ± 22% perf-profile.children.cycles-pp.nr_iowait_cpu
0.00 +0.1 0.10 ± 24% perf-profile.children.cycles-pp.update_ts_time_stats
0.00 +0.1 0.10 ± 35% perf-profile.children.cycles-pp.pm_qos_read_value
0.07 ± 31% +0.1 0.18 ± 14% perf-profile.children.cycles-pp.note_gp_changes
0.06 ± 14% +0.1 0.16 ± 11% perf-profile.children.cycles-pp.hrtimer_next_event_without
0.06 ± 13% +0.1 0.17 ± 16% perf-profile.children.cycles-pp.__ext4_get_inode_loc
0.00 +0.1 0.11 ± 10% perf-profile.children.cycles-pp.rwsem_spin_on_owner
0.00 +0.1 0.11 ± 24% perf-profile.children.cycles-pp.rwsem_down_write_slowpath
0.08 ± 19% +0.1 0.20 ± 20% perf-profile.children.cycles-pp.rcu_sched_clock_irq
0.06 ± 11% +0.1 0.17 ± 20% perf-profile.children.cycles-pp.sched_clock
0.04 ±101% +0.1 0.16 ± 18% perf-profile.children.cycles-pp.isolate_lru_pages
0.01 ±173% +0.1 0.13 ± 12% perf-profile.children.cycles-pp.ext4_es_free_extent
0.23 ± 11% +0.1 0.35 ± 3% perf-profile.children.cycles-pp.read_tsc
0.00 +0.1 0.12 ± 12% perf-profile.children.cycles-pp.crc_1
0.00 +0.1 0.12 ± 37% perf-profile.children.cycles-pp.osq_lock
0.00 +0.1 0.12 ± 27% perf-profile.children.cycles-pp.__ext4_ext_dirty
0.10 ± 30% +0.1 0.22 ± 42% perf-profile.children.cycles-pp.tick_nohz_irq_exit
0.24 ± 18% +0.1 0.36 ± 11% perf-profile.children.cycles-pp.xas_find_marked
0.00 +0.1 0.13 ± 38% perf-profile.children.cycles-pp.mutex_lock_io
0.00 +0.1 0.13 ± 38% perf-profile.children.cycles-pp.__mutex_lock
0.14 ± 6% +0.1 0.27 ± 10% perf-profile.children.cycles-pp.native_irq_return_iret
0.07 ± 11% +0.1 0.21 ± 20% perf-profile.children.cycles-pp.sched_clock_cpu
0.09 ± 7% +0.1 0.23 ± 8% perf-profile.children.cycles-pp.find_next_bit
0.08 ± 19% +0.1 0.23 ± 14% perf-profile.children.cycles-pp.io_serial_in
0.00 +0.1 0.14 ± 31% perf-profile.children.cycles-pp.__jbd2_log_wait_for_space
0.00 +0.1 0.14 ± 31% perf-profile.children.cycles-pp.jbd2_log_do_checkpoint
0.06 ± 16% +0.1 0.21 ± 27% perf-profile.children.cycles-pp.jbd2_journal_commit_transaction
0.06 ± 16% +0.1 0.21 ± 27% perf-profile.children.cycles-pp.kjournald2
0.00 +0.2 0.15 ± 19% perf-profile.children.cycles-pp.jbd2_journal_get_write_access
0.00 +0.2 0.15 ± 17% perf-profile.children.cycles-pp.ext4_ext_try_to_merge_right
0.07 ± 34% +0.2 0.23 ± 30% perf-profile.children.cycles-pp.update_sd_lb_stats
0.17 ± 5% +0.2 0.33 ± 10% perf-profile.children.cycles-pp.lapic_next_deadline
0.07 ± 10% +0.2 0.23 ± 14% perf-profile.children.cycles-pp.ext4_reserve_inode_write
0.00 +0.2 0.16 ± 16% perf-profile.children.cycles-pp.ext4_ext_try_to_merge
0.00 +0.2 0.17 ± 13% perf-profile.children.cycles-pp.jbd2_journal_dirty_metadata
0.08 ± 37% +0.2 0.25 ± 31% perf-profile.children.cycles-pp.find_busiest_group
0.08 ± 62% +0.2 0.26 ± 23% perf-profile.children.cycles-pp.wait_for_xmitr
0.09 ± 59% +0.2 0.26 ± 24% perf-profile.children.cycles-pp.uart_console_write
0.22 ± 12% +0.2 0.40 ± 9% perf-profile.children.cycles-pp.scheduler_tick
0.08 ± 63% +0.2 0.26 ± 23% perf-profile.children.cycles-pp.serial8250_console_putchar
0.09 ± 60% +0.2 0.27 ± 21% perf-profile.children.cycles-pp.serial8250_console_write
0.09 ± 60% +0.2 0.27 ± 23% perf-profile.children.cycles-pp.console_unlock
0.18 ± 4% +0.2 0.36 ± 8% perf-profile.children.cycles-pp.native_write_msr
0.10 ± 62% +0.2 0.28 ± 22% perf-profile.children.cycles-pp.irq_work_run_list
0.00 +0.2 0.19 ± 16% perf-profile.children.cycles-pp.rwsem_optimistic_spin
0.09 ± 10% +0.2 0.28 ± 27% perf-profile.children.cycles-pp.cpuidle_governor_latency_req
0.20 ± 15% +0.2 0.40 ± 16% perf-profile.children.cycles-pp.rb_next
0.14 ± 28% +0.2 0.34 ± 33% perf-profile.children.cycles-pp.update_blocked_averages
0.15 ± 33% +0.2 0.35 ± 31% perf-profile.children.cycles-pp.run_timer_softirq
0.14 ± 36% +0.2 0.35 ± 32% perf-profile.children.cycles-pp.__run_timers
0.17 ± 6% +0.2 0.38 ± 15% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
0.15 ± 31% +0.2 0.36 ± 33% perf-profile.children.cycles-pp.run_rebalance_domains
0.14 ± 34% +0.2 0.37 ± 20% perf-profile.children.cycles-pp.rb_erase
0.13 ± 5% +0.2 0.36 ± 11% perf-profile.children.cycles-pp.__next_timer_interrupt
0.00 +0.2 0.23 ± 16% perf-profile.children.cycles-pp.memmove
0.11 ± 25% +0.2 0.35 ± 23% perf-profile.children.cycles-pp.tick_irq_enter
0.13 ± 31% +0.2 0.38 ± 29% perf-profile.children.cycles-pp.load_balance
0.00 +0.2 0.25 ± 12% perf-profile.children.cycles-pp.__ext4_handle_dirty_metadata
0.00 +0.2 0.25 ± 16% perf-profile.children.cycles-pp.__ext4_journal_get_write_access
0.00 +0.3 0.25 ± 8% perf-profile.children.cycles-pp.__wake_up_common_lock
0.79 ± 12% +0.3 1.05 ± 10% perf-profile.children.cycles-pp.__es_tree_search
0.00 +0.3 0.27 ± 18% perf-profile.children.cycles-pp.ext4_ext_insert_extent
0.14 ± 20% +0.3 0.42 ± 24% perf-profile.children.cycles-pp.irq_enter
0.00 +0.3 0.28 ± 12% perf-profile.children.cycles-pp.jbd2_journal_start_reserved
0.20 ± 38% +0.3 0.50 ± 30% perf-profile.children.cycles-pp.rebalance_domains
0.18 ± 46% +0.3 0.49 ± 30% perf-profile.children.cycles-pp.get_partial_node
0.03 ±100% +0.3 0.35 ± 11% perf-profile.children.cycles-pp.ext4_do_update_inode
0.95 ± 11% +0.3 1.27 ± 9% perf-profile.children.cycles-pp.__es_remove_extent
0.20 ± 3% +0.3 0.53 ± 10% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.00 +0.3 0.35 ± 9% perf-profile.children.cycles-pp.__ext4_journal_start_reserved
0.03 ±100% +0.4 0.38 ± 13% perf-profile.children.cycles-pp.ext4_mark_iloc_dirty
0.00 +0.4 0.36 ± 14% perf-profile.children.cycles-pp.__es_find_extent_range
0.00 +0.4 0.36 ± 11% perf-profile.children.cycles-pp.crc32c_pcl_intel_update
0.00 +0.4 0.37 ± 15% perf-profile.children.cycles-pp.__es_scan_range
0.74 ± 21% +0.4 1.11 ± 12% perf-profile.children.cycles-pp.find_get_pages_range_tag
0.74 ± 21% +0.4 1.12 ± 12% perf-profile.children.cycles-pp.pagevec_lookup_range_tag
0.00 +0.4 0.42 ± 15% perf-profile.children.cycles-pp.ext4_es_scan_range
2.03 ± 7% +0.5 2.48 ± 6% perf-profile.children.cycles-pp.__es_insert_extent
0.43 ± 15% +0.5 0.90 ± 10% perf-profile.children.cycles-pp.update_process_times
0.29 ± 58% +0.5 0.81 ± 22% perf-profile.children.cycles-pp.es_reclaim_extents
0.29 ± 58% +0.5 0.81 ± 22% perf-profile.children.cycles-pp.es_do_reclaim_extents
0.30 ± 58% +0.5 0.81 ± 22% perf-profile.children.cycles-pp.ext4_es_scan
0.30 ± 58% +0.5 0.81 ± 22% perf-profile.children.cycles-pp.__es_shrink
0.30 ± 59% +0.5 0.82 ± 22% perf-profile.children.cycles-pp.shrink_slab
0.30 ± 59% +0.5 0.82 ± 22% perf-profile.children.cycles-pp.do_shrink_slab
0.12 ± 18% +0.5 0.65 ± 14% perf-profile.children.cycles-pp.ext4_mark_inode_dirty
0.30 ± 12% +0.5 0.83 ± 2% perf-profile.children.cycles-pp.tick_nohz_next_event
0.46 ± 14% +0.5 0.99 ± 12% perf-profile.children.cycles-pp.tick_sched_handle
0.00 +0.6 0.59 ± 15% perf-profile.children.cycles-pp.ext4_split_extent_at
0.56 ± 17% +0.6 1.21 ± 12% perf-profile.children.cycles-pp.tick_sched_timer
0.38 ± 9% +0.7 1.04 ± 2% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.00 +0.7 0.74 ± 16% perf-profile.children.cycles-pp.ext4_release_io_end
3.09 ± 8% +0.8 3.94 ± 6% perf-profile.children.cycles-pp.ext4_es_insert_extent
0.11 ±100% +1.0 1.13 ± 14% perf-profile.children.cycles-pp.mpage_map_and_submit_buffers
0.53 ± 33% +1.0 1.56 ± 28% perf-profile.children.cycles-pp.__delete_from_page_cache
0.01 ±173% +1.1 1.08 ± 12% perf-profile.children.cycles-pp.ext4_split_extent
0.99 ± 30% +1.1 2.08 ± 26% perf-profile.children.cycles-pp.__softirqentry_text_start
0.27 ± 54% +1.1 1.36 ± 28% perf-profile.children.cycles-pp.xas_create
0.89 ± 9% +1.1 1.99 ± 10% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.00 +1.1 1.10 ± 12% perf-profile.children.cycles-pp.ext4_split_convert_extents
0.83 ± 11% +1.4 2.21 ± 6% perf-profile.children.cycles-pp.menu_select
1.13 ± 32% +1.4 2.53 ± 25% perf-profile.children.cycles-pp.irq_exit
0.02 ±173% +1.5 1.47 ± 12% perf-profile.children.cycles-pp.ext4_ext_handle_unwritten_extents
5.89 +1.6 7.50 ± 13% perf-profile.children.cycles-pp.ext4_ext_map_blocks
1.52 ± 14% +1.7 3.17 ± 8% perf-profile.children.cycles-pp.hrtimer_interrupt
0.76 ± 94% +2.0 2.72 ± 27% perf-profile.children.cycles-pp.shrink_page_list
0.87 ± 96% +2.0 2.89 ± 26% perf-profile.children.cycles-pp.shrink_inactive_list
0.87 ± 96% +2.0 2.90 ± 26% perf-profile.children.cycles-pp.shrink_lruvec
1.18 ± 86% +2.5 3.72 ± 25% perf-profile.children.cycles-pp.shrink_node
0.00 +2.6 2.58 ± 15% perf-profile.children.cycles-pp.ext4_convert_unwritten_extents
0.00 +2.9 2.94 ± 14% perf-profile.children.cycles-pp.ext4_convert_unwritten_io_end_vec
0.58 ± 79% +3.1 3.73 ± 25% perf-profile.children.cycles-pp.balance_pgdat
0.58 ± 79% +3.1 3.73 ± 25% perf-profile.children.cycles-pp.kswapd
2.90 ± 18% +3.5 6.38 ± 12% perf-profile.children.cycles-pp.smp_apic_timer_interrupt
3.13 ± 16% +3.8 6.90 ± 11% perf-profile.children.cycles-pp.apic_timer_interrupt
0.00 +4.0 3.99 ± 15% perf-profile.children.cycles-pp.ext4_put_io_end
10.41 ± 21% +4.5 14.88 ± 14% perf-profile.children.cycles-pp.do_writepages
10.37 ± 21% +4.5 14.86 ± 14% perf-profile.children.cycles-pp.ext4_writepages
10.05 ± 24% +4.8 14.88 ± 14% perf-profile.children.cycles-pp.wb_workfn
10.05 ± 24% +4.8 14.88 ± 14% perf-profile.children.cycles-pp.wb_writeback
10.05 ± 24% +4.8 14.88 ± 14% perf-profile.children.cycles-pp.__writeback_inodes_wb
10.05 ± 24% +4.8 14.88 ± 14% perf-profile.children.cycles-pp.writeback_sb_inodes
10.05 ± 24% +4.8 14.88 ± 14% perf-profile.children.cycles-pp.__writeback_single_inode
10.13 ± 24% +4.9 14.99 ± 14% perf-profile.children.cycles-pp.process_one_work
10.13 ± 24% +4.9 15.00 ± 14% perf-profile.children.cycles-pp.worker_thread
0.22 ±102% +5.6 5.84 ± 12% perf-profile.children.cycles-pp.mpage_map_and_submit_extent
0.11 ±103% +6.5 6.58 ± 13% perf-profile.children.cycles-pp.ext4_map_blocks
10.93 ± 21% +8.0 18.96 ± 16% perf-profile.children.cycles-pp.kthread
10.93 ± 21% +8.0 18.97 ± 16% perf-profile.children.cycles-pp.ret_from_fork
34.79 ± 5% +9.7 44.47 ± 12% perf-profile.children.cycles-pp.intel_idle
37.87 ± 6% +14.7 52.53 ± 9% perf-profile.children.cycles-pp.cpuidle_enter_state
37.87 ± 6% +14.7 52.54 ± 9% perf-profile.children.cycles-pp.cpuidle_enter
38.99 ± 5% +16.5 55.50 ± 9% perf-profile.children.cycles-pp.secondary_startup_64
38.99 ± 5% +16.5 55.50 ± 9% perf-profile.children.cycles-pp.cpu_startup_entry
39.00 ± 5% +16.5 55.51 ± 9% perf-profile.children.cycles-pp.do_idle
37.52 ± 6% +17.2 54.74 ± 9% perf-profile.children.cycles-pp.start_secondary
4.23 ± 54% -3.4 0.86 ± 27% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
6.15 ± 9% -2.4 3.76 ± 14% perf-profile.self.cycles-pp.ext4_es_lookup_extent
3.60 ± 22% -2.0 1.64 ± 17% perf-profile.self.cycles-pp.__memcpy_flushcache
3.40 ± 8% -1.6 1.79 ± 13% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
3.55 ± 6% -1.5 2.07 ± 15% perf-profile.self.cycles-pp.xas_load
2.61 ± 6% -1.3 1.30 ± 15% perf-profile.self.cycles-pp.do_syscall_64
1.28 ± 15% -0.7 0.56 ± 20% perf-profile.self.cycles-pp.start_this_handle
0.82 ± 29% -0.6 0.19 ± 23% perf-profile.self.cycles-pp.__list_del_entry_valid
1.01 ± 5% -0.5 0.53 ± 12% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.99 ± 9% -0.5 0.52 ± 19% perf-profile.self.cycles-pp.__block_commit_write
0.94 ± 6% -0.5 0.48 ± 17% perf-profile.self.cycles-pp.entry_SYSCALL_64
0.78 ± 13% -0.4 0.35 ± 11% perf-profile.self.cycles-pp.jbd2_journal_stop
0.66 ± 10% -0.4 0.23 ± 15% perf-profile.self.cycles-pp.add_transaction_credits
0.94 ± 12% -0.4 0.53 ± 17% perf-profile.self.cycles-pp._raw_read_lock
0.62 ± 19% -0.3 0.27 ± 21% perf-profile.self.cycles-pp.mpage_process_page_bufs
0.80 ± 11% -0.3 0.45 ± 17% perf-profile.self.cycles-pp._raw_spin_lock
0.72 ± 17% -0.3 0.39 ± 10% perf-profile.self.cycles-pp.xas_set_mark
0.59 ± 14% -0.3 0.29 ± 5% perf-profile.self.cycles-pp.ext4_journal_check_start
0.52 ± 7% -0.3 0.26 ± 18% perf-profile.self.cycles-pp.aa_file_perm
1.01 ± 6% -0.3 0.75 ± 20% perf-profile.self.cycles-pp.find_get_entry
0.42 ± 8% -0.2 0.22 ± 8% perf-profile.self.cycles-pp.stop_this_handle
0.34 ± 9% -0.2 0.14 ± 23% perf-profile.self.cycles-pp.workingset_update_node
0.33 ± 19% -0.2 0.14 ± 21% perf-profile.self.cycles-pp.ext4_bio_write_page
0.22 ± 39% -0.2 0.03 ±102% perf-profile.self.cycles-pp.xas_store
0.34 ± 8% -0.2 0.16 ± 25% perf-profile.self.cycles-pp.generic_write_end
0.24 ± 21% -0.2 0.09 ± 22% perf-profile.self.cycles-pp.test_clear_page_writeback
0.20 ± 20% -0.1 0.07 ± 17% perf-profile.self.cycles-pp.__test_set_page_writeback
0.24 ± 17% -0.1 0.11 ± 12% perf-profile.self.cycles-pp.clear_page_dirty_for_io
0.19 ± 10% -0.1 0.07 ± 24% perf-profile.self.cycles-pp.xas_start
0.23 ± 11% -0.1 0.11 ± 21% perf-profile.self.cycles-pp.__fget_light
0.25 ± 2% -0.1 0.14 ± 18% perf-profile.self.cycles-pp.__pagevec_lru_add_fn
0.20 ± 11% -0.1 0.10 ± 15% perf-profile.self.cycles-pp.ext4_da_write_begin
0.23 ± 22% -0.1 0.13 ± 11% perf-profile.self.cycles-pp.ext4_finish_bio
0.19 ± 5% -0.1 0.09 ± 11% perf-profile.self.cycles-pp.__mod_node_page_state
0.19 ± 6% -0.1 0.09 ± 24% perf-profile.self.cycles-pp.page_mapping
0.17 ± 2% -0.1 0.08 ± 16% perf-profile.self.cycles-pp.__mod_lruvec_state
0.21 ± 24% -0.1 0.12 ± 19% perf-profile.self.cycles-pp.new_slab
0.20 ± 9% -0.1 0.11 ± 9% perf-profile.self.cycles-pp.ext4_da_write_end
0.18 ± 18% -0.1 0.10 ± 15% perf-profile.self.cycles-pp.ext4_llseek
0.19 ± 10% -0.1 0.11 ± 21% perf-profile.self.cycles-pp.rmqueue_bulk
0.18 ± 11% -0.1 0.11 ± 13% perf-profile.self.cycles-pp.unlock_page
0.15 ± 4% -0.1 0.07 ± 20% perf-profile.self.cycles-pp.__add_to_page_cache_locked
0.15 ± 4% -0.1 0.08 ± 14% perf-profile.self.cycles-pp.__mod_memcg_state
0.16 ± 2% -0.1 0.09 ± 30% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.12 ± 19% -0.1 0.04 ± 57% perf-profile.self.cycles-pp.get_mem_cgroup_from_mm
0.10 ± 13% -0.1 0.03 ±100% perf-profile.self.cycles-pp.mpage_prepare_extent_to_map
0.12 ± 10% -0.1 0.05 ± 9% perf-profile.self.cycles-pp.account_page_dirtied
0.10 ± 21% -0.1 0.04 ± 58% perf-profile.self.cycles-pp.dec_zone_page_state
0.11 ± 11% -0.1 0.04 ± 59% perf-profile.self.cycles-pp.create_empty_buffers
0.15 ± 7% -0.1 0.08 ± 17% perf-profile.self.cycles-pp.common_file_perm
0.14 ± 10% -0.1 0.08 ± 23% perf-profile.self.cycles-pp.generic_perform_write
0.13 ± 28% -0.1 0.07 ± 19% perf-profile.self.cycles-pp.pmem_make_request
0.12 ± 4% -0.1 0.06 ± 13% perf-profile.self.cycles-pp.iov_iter_fault_in_readable
0.12 ± 14% -0.1 0.07 ± 59% perf-profile.self.cycles-pp.node_dirty_ok
0.10 ± 23% -0.1 0.04 ± 63% perf-profile.self.cycles-pp.___slab_alloc
0.11 ± 4% -0.1 0.05 ± 63% perf-profile.self.cycles-pp.mark_buffer_dirty
0.12 ± 10% -0.1 0.07 ± 19% perf-profile.self.cycles-pp.rmqueue
0.09 ± 11% -0.0 0.04 ± 58% perf-profile.self.cycles-pp.__lru_cache_add
0.07 ± 22% -0.0 0.03 ±100% perf-profile.self.cycles-pp.generic_make_request_checks
0.09 ± 4% -0.0 0.04 ± 57% perf-profile.self.cycles-pp.ext4_block_write_begin
0.09 ± 7% -0.0 0.05 ± 58% perf-profile.self.cycles-pp.__mark_inode_dirty
0.08 ± 5% -0.0 0.07 ± 17% perf-profile.self.cycles-pp.ext4_file_write_iter
0.07 ± 7% +0.0 0.09 ± 13% perf-profile.self.cycles-pp.ext4_es_insert_extent
0.15 ± 3% +0.0 0.18 ± 7% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax
0.07 ± 16% +0.0 0.10 ± 10% perf-profile.self.cycles-pp.mark_page_accessed
0.03 ±100% +0.0 0.07 ± 7% perf-profile.self.cycles-pp.jbd2__journal_start
0.03 ±100% +0.0 0.07 ± 5% perf-profile.self.cycles-pp.kfree
0.17 ± 4% +0.0 0.21 ± 12% perf-profile.self.cycles-pp.__might_sleep
0.06 ± 11% +0.0 0.10 ± 14% perf-profile.self.cycles-pp.ext4_ext_map_blocks
0.05 ± 8% +0.0 0.10 ± 21% perf-profile.self.cycles-pp.__getblk_gfp
0.08 ± 11% +0.0 0.12 ± 11% perf-profile.self.cycles-pp.__read_extent_tree_block
0.01 ±173% +0.1 0.07 ± 31% perf-profile.self.cycles-pp.rebalance_domains
0.01 ±173% +0.1 0.07 ± 25% perf-profile.self.cycles-pp.timekeeping_max_deferment
0.06 ± 11% +0.1 0.12 ± 15% perf-profile.self.cycles-pp.hrtimer_interrupt
0.00 +0.1 0.06 ± 22% perf-profile.self.cycles-pp.account_process_tick
0.00 +0.1 0.06 ± 14% perf-profile.self.cycles-pp.ext4_map_blocks
0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.rcu_eqs_enter
0.00 +0.1 0.06 ± 14% perf-profile.self.cycles-pp.call_cpuidle
0.07 ± 15% +0.1 0.13 ± 29% perf-profile.self.cycles-pp.native_apic_msr_eoi_write
0.00 +0.1 0.06 ± 20% perf-profile.self.cycles-pp.__isolate_lru_page
0.00 +0.1 0.06 ± 16% perf-profile.self.cycles-pp.lapic_next_deadline
0.02 ±173% +0.1 0.08 ± 37% perf-profile.self.cycles-pp.delay_tsc
0.00 +0.1 0.06 ± 26% perf-profile.self.cycles-pp.get_next_timer_interrupt
0.03 ±100% +0.1 0.09 ± 11% perf-profile.self.cycles-pp.__ext4_journal_stop
0.00 +0.1 0.06 ± 13% perf-profile.self.cycles-pp.timerqueue_add
0.00 +0.1 0.06 ± 6% perf-profile.self.cycles-pp._raw_write_lock
0.00 +0.1 0.06 ± 13% perf-profile.self.cycles-pp.rcu_irq_exit
0.21 ± 4% +0.1 0.28 ± 11% perf-profile.self.cycles-pp.__brelse
0.01 ±173% +0.1 0.08 ± 14% perf-profile.self.cycles-pp.free_unref_page_list
0.00 +0.1 0.07 ± 19% perf-profile.self.cycles-pp.rwsem_optimistic_spin
0.00 +0.1 0.07 ± 12% perf-profile.self.cycles-pp.ext4_ext_handle_unwritten_extents
0.00 +0.1 0.07 ± 22% perf-profile.self.cycles-pp.idle_cpu
0.06 ± 16% +0.1 0.13 ± 19% perf-profile.self.cycles-pp.__hrtimer_next_event_base
0.01 ±173% +0.1 0.08 ± 15% perf-profile.self.cycles-pp.scheduler_tick
0.00 +0.1 0.07 ± 20% perf-profile.self.cycles-pp.ktime_get_update_offsets_now
0.00 +0.1 0.07 ± 30% perf-profile.self.cycles-pp.crypto_shash_update
0.00 +0.1 0.07 ± 33% perf-profile.self.cycles-pp.pm_qos_request
0.00 +0.1 0.07 ± 14% perf-profile.self.cycles-pp.__run_timers
0.24 +0.1 0.31 ± 4% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.00 +0.1 0.08 ± 5% perf-profile.self.cycles-pp.perf_mux_hrtimer_handler
0.00 +0.1 0.08 ± 14% perf-profile.self.cycles-pp.rcu_dynticks_eqs_exit
0.03 ±100% +0.1 0.10 ± 20% perf-profile.self.cycles-pp.__hrtimer_run_queues
0.03 ±100% +0.1 0.11 ± 30% perf-profile.self.cycles-pp.update_blocked_averages
0.00 +0.1 0.08 ± 30% perf-profile.self.cycles-pp.load_balance
0.00 +0.1 0.08 ± 17% perf-profile.self.cycles-pp.__es_remove_extent
0.00 +0.1 0.08 ± 21% perf-profile.self.cycles-pp.rcu_core
0.04 ±101% +0.1 0.12 ± 23% perf-profile.self.cycles-pp.rcu_sched_clock_irq
0.00 +0.1 0.09 ± 30% perf-profile.self.cycles-pp.run_posix_cpu_timers
0.00 +0.1 0.09 ± 24% perf-profile.self.cycles-pp.ksoftirqd_running
0.00 +0.1 0.09 ± 21% perf-profile.self.cycles-pp.smp_apic_timer_interrupt
0.01 ±173% +0.1 0.10 ± 24% perf-profile.self.cycles-pp.interrupt_entry
0.01 ±173% +0.1 0.10 ± 58% perf-profile.self.cycles-pp.tick_check_oneshot_broadcast_this_cpu
0.22 ± 24% +0.1 0.32 ± 21% perf-profile.self.cycles-pp.release_pages
0.00 +0.1 0.10 ± 11% perf-profile.self.cycles-pp.rwsem_spin_on_owner
0.07 ± 28% +0.1 0.17 ± 11% perf-profile.self.cycles-pp.note_gp_changes
0.05 ± 9% +0.1 0.15 ± 18% perf-profile.self.cycles-pp.native_sched_clock
0.07 ± 10% +0.1 0.17 ± 18% perf-profile.self.cycles-pp.io_serial_in
0.03 ±100% +0.1 0.14 ± 30% perf-profile.self.cycles-pp.__softirqentry_text_start
0.00 +0.1 0.10 ± 17% perf-profile.self.cycles-pp.jbd2_write_access_granted
0.00 +0.1 0.10 ± 22% perf-profile.self.cycles-pp.nr_iowait_cpu
0.00 +0.1 0.10 ± 35% perf-profile.self.cycles-pp.pm_qos_read_value
0.22 ± 11% +0.1 0.33 ± 3% perf-profile.self.cycles-pp.read_tsc
0.00 +0.1 0.11 ± 11% perf-profile.self.cycles-pp.crc_1
0.00 +0.1 0.12 ± 40% perf-profile.self.cycles-pp.osq_lock
0.05 ± 58% +0.1 0.17 ± 13% perf-profile.self.cycles-pp.tick_nohz_next_event
0.04 ± 57% +0.1 0.16 ± 13% perf-profile.self.cycles-pp.__next_timer_interrupt
0.08 ± 6% +0.1 0.19 ± 10% perf-profile.self.cycles-pp.find_next_bit
0.23 ± 20% +0.1 0.36 ± 11% perf-profile.self.cycles-pp.xas_find_marked
0.03 ±105% +0.1 0.16 ± 33% perf-profile.self.cycles-pp.update_sd_lb_stats
0.01 ±173% +0.1 0.15 ± 19% perf-profile.self.cycles-pp.shrink_page_list
0.14 ± 6% +0.1 0.27 ± 10% perf-profile.self.cycles-pp.native_irq_return_iret
0.00 +0.1 0.14 ± 3% perf-profile.self.cycles-pp.ext4_do_update_inode
0.07 +0.1 0.21 ± 14% perf-profile.self.cycles-pp.do_idle
0.00 +0.2 0.15 ± 11% perf-profile.self.cycles-pp.jbd2_journal_dirty_metadata
0.18 ± 4% +0.2 0.36 ± 8% perf-profile.self.cycles-pp.native_write_msr
0.20 ± 14% +0.2 0.39 ± 17% perf-profile.self.cycles-pp.rb_next
0.14 ± 34% +0.2 0.34 ± 16% perf-profile.self.cycles-pp.rb_erase
0.00 +0.2 0.21 ± 8% perf-profile.self.cycles-pp.memmove
0.49 ± 23% +0.2 0.73 ± 13% perf-profile.self.cycles-pp.find_get_pages_range_tag
0.79 ± 12% +0.3 1.04 ± 10% perf-profile.self.cycles-pp.__es_tree_search
0.00 +0.3 0.27 ± 12% perf-profile.self.cycles-pp.crc32c_pcl_intel_update
0.06 ± 20% +0.4 0.48 ± 17% perf-profile.self.cycles-pp.ext4_end_bio
0.25 ± 9% +0.4 0.69 ± 14% perf-profile.self.cycles-pp.cpuidle_enter_state
0.35 ± 15% +0.5 0.84 ± 19% perf-profile.self.cycles-pp.menu_select
0.23 ± 66% +1.1 1.36 ± 28% perf-profile.self.cycles-pp.xas_create
1.32 ± 5% +1.4 2.68 ± 15% perf-profile.self.cycles-pp.ext4_find_extent
34.76 ± 5% +9.7 44.41 ± 12% perf-profile.self.cycles-pp.intel_idle
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
View attachment "config-5.5.0-rc3-00038-g244adf6426ee31" of type "text/plain" (154419 bytes)
View attachment "job-script" of type "text/plain" (7611 bytes)
View attachment "job.yaml" of type "text/plain" (5176 bytes)
View attachment "reproduce" of type "text/plain" (296 bytes)
Powered by blists - more mailing lists