lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Message-ID: <20190905030647.GU22468@xsang-OptiPlex-9020>
Date:   Thu, 5 Sep 2019 11:06:47 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Johannes Thumshirn <jthumshirn@...e.de>
Cc:     David Sterba <dsterba@...e.com>,
        LKML <linux-kernel@...r.kernel.org>,
        Linus Torvalds <torvalds@...ux-foundation.org>, lkp@...org
Subject: [btrfs]  d5178578bc:  fsmark.files_per_sec 54.4% improvement

Greeting,

FYI, we noticed a 54.4% improvement of fsmark.files_per_sec due to commit:


commit: d5178578bcd461cc79118c7a139882350fe505aa ("btrfs: directly call into crypto framework for checksumming")
https://kernel.googlesource.com/pub/scm/linux/kernel/git/torvalds/linux.git master

in testcase: fsmark
on test machine: 96 threads Intel(R) Xeon(R) CPU @ 2.30GHz with 128G memory
with following parameters:

	iterations: 1x
	nr_threads: 1t
	disk: 1BRD_48G
	fs: btrfs
	filesize: 4M
	test_size: 24G
	sync_method: fsyncBeforeClose
	ucode: 0x400001c
	cpufreq_governor: performance

test-description: The fsmark is a file system benchmark to test synchronous write workloads, for example, mail servers workload.
test-url: https://sourceforge.net/projects/fsmark/





Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml

=========================================================================================
compiler/cpufreq_governor/disk/filesize/fs/iterations/kconfig/nr_threads/rootfs/sync_method/tbox_group/test_size/testcase/ucode:
  gcc-7/performance/1BRD_48G/4M/btrfs/1x/x86_64-rhel-7.2-clear/1t/clear-ota-25590-x86_64-2018-10-18.cgz/fsyncBeforeClose/lkp-csl-2sp4/24G/fsmark/0x400001c

commit: 
  6d97c6e31b ("btrfs: add boilerplate code for directly including the crypto framework")
  d5178578bc ("btrfs: directly call into crypto framework for checksumming")

6d97c6e31b553bc9 d5178578bcd461cc79118c7a139 
---------------- --------------------------- 
       fail:runs  %reproduction    fail:runs
           |             |             |    
           :4           25%           1:4     dmesg.WARNING:at#for_ip_interrupt_entry/0x
          0:4           -3%           0:4     perf-profile.children.cycles-pp.error_entry
         %stddev     %change         %stddev
             \          |                \  
    164.68           +54.4%     254.25        fsmark.files_per_sec
     39.32           -33.7%      26.07        fsmark.time.elapsed_time
     39.32           -33.7%      26.07        fsmark.time.elapsed_time.max
     38.68           -33.8%      25.59        fsmark.time.system_time
     22289 ±  4%    +961.6%     236635 ±154%  cpuidle.C1.usage
      1.33 ± 11%     +23.2%       1.64 ± 10%  iostat.cpu.system
      0.00 ± 90%      +0.2        0.19 ± 96%  mpstat.cpu.all.soft%
      2238 ±  9%     -34.3%       1470 ±  7%  meminfo.Writeback
   1341296 ±  5%     +48.9%    1997123        meminfo.max_used_kB
  12847152           -71.9%    3615650 ±146%  numa-numastat.node0.local_node
  12853433           -71.8%    3624965 ±145%  numa-numastat.node0.numa_hit
     18204 ±  7%   +1169.3%     231055 ±157%  turbostat.C1
   7711970 ±  5%     -27.9%    5561463 ± 14%  turbostat.IRQ
    596106 ±  4%     +47.5%     879524        vmstat.io.bo
      4107 ± 25%     +37.0%       5625 ±  8%  vmstat.system.cs
     15677            +1.2%      15866        proc-vmstat.nr_kernel_stack
    798.00 ±  4%      +8.6%     866.75 ±  2%  proc-vmstat.nr_page_table_pages
    532.00 ± 13%     -36.6%     337.50 ± 18%  proc-vmstat.nr_writeback
    905.00 ±  6%     -10.3%     812.00 ±  8%  proc-vmstat.nr_zone_write_pending
      1659 ± 12%     +80.3%       2992 ± 27%  slabinfo.dmaengine-unmap-16.active_objs
      1659 ± 12%     +80.4%       2993 ± 27%  slabinfo.dmaengine-unmap-16.num_objs
     10830 ±  4%     +10.5%      11972 ±  5%  slabinfo.kmalloc-96.active_objs
     10959 ±  3%      +9.6%      12013 ±  5%  slabinfo.kmalloc-96.num_objs
      5171 ±  4%     +11.8%       5781 ±  6%  slabinfo.skbuff_head_cache.active_objs
      5171 ±  4%     +11.8%       5781 ±  6%  slabinfo.skbuff_head_cache.num_objs
    211956 ± 14%     -20.3%     168984 ±  5%  sched_debug.cpu.avg_idle.avg
      2.42 ±  4%      +7.9%       2.61 ±  4%  sched_debug.cpu.clock.stddev
      2.42 ±  4%      +7.9%       2.61 ±  4%  sched_debug.cpu.clock_task.stddev
     65062 ±  5%     -18.4%      53078 ±  7%  sched_debug.cpu.max_idle_balance_cost.min
     18366 ± 10%     -25.1%      13758 ± 18%  sched_debug.cpu.nr_switches.max
    330.00 ± 16%     -37.3%     206.75 ± 30%  sched_debug.cpu.nr_switches.min
      6.00 ± 11%    +112.5%      12.75 ± 30%  sched_debug.cpu.nr_uninterruptible.max
      1.80 ±  5%     +35.7%       2.45 ± 20%  sched_debug.cpu.nr_uninterruptible.stddev
    340637 ±  6%     -58.3%     141941 ± 65%  numa-meminfo.node0.Active
    216442 ±  9%     -50.7%     106726 ± 56%  numa-meminfo.node0.Active(anon)
    124194 ±  6%     -71.6%      35214 ±154%  numa-meminfo.node0.Active(file)
     14999 ± 38%     -72.8%       4076 ± 80%  numa-meminfo.node0.AnonHugePages
    214189 ± 10%     -50.8%     105279 ± 55%  numa-meminfo.node0.AnonPages
      1749 ±  7%     -75.0%     437.00 ±138%  numa-meminfo.node0.Dirty
  14100489 ±  4%     -61.7%    5404707 ± 95%  numa-meminfo.node0.FilePages
  11743795 ±  5%     -73.3%    3141213 ±162%  numa-meminfo.node0.Inactive
  11743214 ±  5%     -73.3%    3140654 ±162%  numa-meminfo.node0.Inactive(file)
  37592668           +49.8%   56332279 ± 19%  numa-meminfo.node0.MemFree
  28073183           -66.8%    9333571 ±116%  numa-meminfo.node0.MemUsed
      2193 ±  3%     -87.2%     281.75 ±173%  numa-meminfo.node0.Writeback
     26157 ± 85%    +767.7%     226976 ± 41%  numa-meminfo.node1.Active
     26150 ± 85%    +429.0%     138341 ± 45%  numa-meminfo.node1.Active(anon)
     24390 ± 95%    +460.6%     136731 ± 44%  numa-meminfo.node1.AnonPages
      6004 ±  8%     +20.7%       7246 ± 16%  numa-meminfo.node1.KernelStack
  63429780           -29.3%   44858603 ± 23%  numa-meminfo.node1.MemFree
   2590946 ±  3%    +716.8%   21162132 ± 50%  numa-meminfo.node1.MemUsed
    681.75 ± 31%    +152.9%       1724 ± 46%  numa-meminfo.node1.PageTables
     54133 ±  9%     -50.8%      26619 ± 56%  numa-vmstat.node0.nr_active_anon
     31061 ±  6%     -71.6%       8807 ±154%  numa-vmstat.node0.nr_active_file
     53568 ± 10%     -51.0%      26242 ± 55%  numa-vmstat.node0.nr_anon_pages
   3302479 ±  2%     -74.2%     851614 ±162%  numa-vmstat.node0.nr_dirtied
    422.75 ±  5%     -78.8%      89.75 ±131%  numa-vmstat.node0.nr_dirty
   3523118 ±  4%     -61.7%    1350693 ± 95%  numa-vmstat.node0.nr_file_pages
   9397897           +49.9%   14083138 ± 19%  numa-vmstat.node0.nr_free_pages
   2933791 ±  5%     -73.3%     784676 ±162%  numa-vmstat.node0.nr_inactive_file
    580.75 ±  7%     -76.2%     138.00 ±173%  numa-vmstat.node0.nr_writeback
   3301513 ±  2%     -74.2%     851382 ±162%  numa-vmstat.node0.nr_written
     54133 ±  9%     -50.8%      26620 ± 56%  numa-vmstat.node0.nr_zone_active_anon
     31061 ±  6%     -71.6%       8807 ±154%  numa-vmstat.node0.nr_zone_active_file
   2933786 ±  5%     -73.3%     784675 ±162%  numa-vmstat.node0.nr_zone_inactive_file
    945.00 ±  6%     -75.4%     232.00 ±156%  numa-vmstat.node0.nr_zone_write_pending
      6543 ± 85%    +428.4%      34572 ± 45%  numa-vmstat.node1.nr_active_anon
      6105 ± 94%    +459.7%      34174 ± 44%  numa-vmstat.node1.nr_anon_pages
  15857398           -29.3%   11212694 ± 23%  numa-vmstat.node1.nr_free_pages
      6001 ±  8%     +20.6%       7238 ± 17%  numa-vmstat.node1.nr_kernel_stack
    165.00 ± 34%    +158.2%     426.00 ± 48%  numa-vmstat.node1.nr_page_table_pages
      6543 ± 85%    +428.4%      34572 ± 45%  numa-vmstat.node1.nr_zone_active_anon
      8.49 ± 32%     +79.4%      15.23 ± 17%  perf-stat.i.MPKI
   6476206 ±  8%     +34.5%    8713505 ±  5%  perf-stat.i.cache-misses
  49842491 ± 29%     +47.7%   73610781 ± 16%  perf-stat.i.cache-references
      1.31 ±  9%     +23.6%       1.62 ± 10%  perf-stat.i.cpi
      1199 ±  4%     -23.5%     917.96 ±  6%  perf-stat.i.cycles-between-cache-misses
 5.406e+08 ± 11%     +42.5%  7.705e+08 ±  7%  perf-stat.i.dTLB-stores
   2101242 ±  3%     +24.7%    2620977 ±  9%  perf-stat.i.iTLB-load-misses
      2879 ±  7%     -28.1%       2069 ±  3%  perf-stat.i.instructions-per-iTLB-miss
      0.80 ±  6%     -19.3%       0.65 ±  9%  perf-stat.i.ipc
     34.20 ± 15%     -11.6       22.60 ± 12%  perf-stat.i.node-load-miss-rate%
    437467 ±  6%     +96.7%     860683 ±  8%  perf-stat.i.node-loads
   1674958 ±  8%     +62.3%    2718658 ± 10%  perf-stat.i.node-stores
      8.29 ± 29%     +62.6%      13.49 ± 14%  perf-stat.overall.MPKI
      1.23 ±  7%     +21.2%       1.49 ±  9%  perf-stat.overall.cpi
      1135 ±  2%     -18.2%     929.59 ±  6%  perf-stat.overall.cycles-between-cache-misses
      2858 ±  8%     -27.0%       2086 ±  4%  perf-stat.overall.instructions-per-iTLB-miss
      0.82 ±  7%     -17.2%       0.68 ±  9%  perf-stat.overall.ipc
     34.14 ± 10%     -11.0       23.10 ± 10%  perf-stat.overall.node-load-miss-rate%
   6306345 ±  8%     +32.6%    8363118 ±  5%  perf-stat.ps.cache-misses
  48519287 ± 29%     +45.6%   70660007 ± 16%  perf-stat.ps.cache-references
 1.776e+09 ±  7%     -17.2%   1.47e+09 ±  9%  perf-stat.ps.dTLB-loads
 5.265e+08 ± 11%     +40.5%  7.398e+08 ±  7%  perf-stat.ps.dTLB-stores
   2046520 ±  3%     +23.0%    2516676 ±  9%  perf-stat.ps.iTLB-load-misses
    186946            -1.4%     184382        perf-stat.ps.msec
    425993 ±  6%     +93.9%     825998 ±  8%  perf-stat.ps.node-loads
   1630762 ±  8%     +60.0%    2608833 ± 10%  perf-stat.ps.node-stores
 2.239e+11 ±  8%     -41.9%  1.302e+11 ±  8%  perf-stat.total.instructions
     11247 ± 12%     -31.2%       7734 ± 18%  softirqs.CPU0.RCU
     11806 ± 33%     -45.7%       6406 ± 31%  softirqs.CPU1.SCHED
      8276 ± 49%     -46.2%       4449 ±  2%  softirqs.CPU13.SCHED
      9908 ± 10%     -20.1%       7917 ±  2%  softirqs.CPU14.RCU
     22081 ± 21%     -28.3%      15831 ± 12%  softirqs.CPU14.TIMER
     21860 ± 56%     -49.5%      11037 ± 49%  softirqs.CPU15.RCU
     29877 ± 32%     -34.9%      19446 ± 26%  softirqs.CPU15.TIMER
     19610 ± 14%     -14.0%      16864 ±  5%  softirqs.CPU18.TIMER
      9869 ± 15%     -41.3%       5791 ± 29%  softirqs.CPU19.RCU
     19720 ± 11%     -20.6%      15664 ± 10%  softirqs.CPU19.TIMER
      9800 ±  3%     -28.1%       7043 ±  7%  softirqs.CPU20.RCU
     23218 ± 20%     -33.0%      15555 ± 10%  softirqs.CPU20.TIMER
      9907 ± 14%     -30.0%       6931 ±  5%  softirqs.CPU21.RCU
     21868 ± 29%     -30.0%      15300 ± 12%  softirqs.CPU21.TIMER
      9125 ± 16%     -25.4%       6803 ±  5%  softirqs.CPU23.RCU
     20379 ± 25%     -25.1%      15258 ± 12%  softirqs.CPU23.TIMER
     10238 ± 10%     -20.6%       8126 ± 12%  softirqs.CPU24.RCU
     23551 ± 16%     -31.3%      16182 ±  6%  softirqs.CPU24.TIMER
      9888 ±  4%     -26.0%       7320 ± 15%  softirqs.CPU26.RCU
     24596 ± 10%     -35.8%      15802 ± 12%  softirqs.CPU26.TIMER
      9565 ±  6%     -24.6%       7207 ±  9%  softirqs.CPU27.RCU
     22006 ± 12%     -32.8%      14778 ± 10%  softirqs.CPU27.TIMER
     12401 ± 37%     -43.0%       7073 ± 12%  softirqs.CPU28.RCU
     21314 ± 11%     -31.6%      14570 ± 10%  softirqs.CPU28.TIMER
     12988 ± 37%     -32.7%       8741 ±  9%  softirqs.CPU3.RCU
     20972 ± 13%     -27.8%      15138 ± 20%  softirqs.CPU30.TIMER
     23154 ±  9%     -35.5%      14939 ± 17%  softirqs.CPU31.TIMER
     11738 ± 12%     -33.6%       7796 ± 16%  softirqs.CPU32.RCU
     23088 ±  9%     -37.3%      14485 ± 15%  softirqs.CPU32.TIMER
     10670 ± 13%     -31.0%       7363 ± 13%  softirqs.CPU33.RCU
     22917 ±  9%     -39.3%      13913 ± 13%  softirqs.CPU33.TIMER
     10892 ± 11%     -29.2%       7717 ± 14%  softirqs.CPU34.RCU
     22227 ±  9%     -36.6%      14100 ± 12%  softirqs.CPU34.TIMER
     10937 ± 10%     -31.7%       7473 ± 13%  softirqs.CPU35.RCU
     20664 ±  9%     -30.7%      14325 ± 12%  softirqs.CPU35.TIMER
     20578 ± 11%     -31.3%      14140 ± 14%  softirqs.CPU36.TIMER
     11029 ± 15%     -26.0%       8160 ± 20%  softirqs.CPU37.RCU
     10379 ± 13%     -24.1%       7878 ± 18%  softirqs.CPU38.RCU
     11045 ± 24%     -34.5%       7237 ± 13%  softirqs.CPU39.RCU
     21266 ±  4%     -38.0%      13186 ± 11%  softirqs.CPU39.TIMER
     10858 ± 12%     -29.8%       7622 ± 10%  softirqs.CPU40.RCU
     21178 ±  4%     -34.5%      13861 ± 11%  softirqs.CPU40.TIMER
     11548 ±  4%     -32.7%       7766 ±  2%  softirqs.CPU41.RCU
     21869 ±  5%     -34.5%      14325 ±  6%  softirqs.CPU41.TIMER
     10572 ± 13%     -23.3%       8105 ±  9%  softirqs.CPU42.RCU
     21584 ±  6%     -34.7%      14084 ±  5%  softirqs.CPU42.TIMER
     21622 ±  9%     -35.3%      13980 ±  8%  softirqs.CPU43.TIMER
     10517 ±  6%     -20.0%       8409 ± 12%  softirqs.CPU44.RCU
     21217 ± 10%     -35.0%      13782 ± 11%  softirqs.CPU44.TIMER
      9910 ±  5%     -18.4%       8088 ±  9%  softirqs.CPU45.RCU
     20527 ± 11%     -32.7%      13823 ± 10%  softirqs.CPU45.TIMER
      7821 ± 43%     -42.9%       4466 ± 10%  softirqs.CPU46.SCHED
     22070 ± 21%     -37.3%      13836 ± 13%  softirqs.CPU46.TIMER
     20652 ± 11%     -32.6%      13924 ± 12%  softirqs.CPU47.TIMER
      9412 ±  7%     -25.7%       6995 ±  3%  softirqs.CPU48.RCU
     10009 ±  8%     -26.7%       7334 ±  7%  softirqs.CPU49.RCU
      9914 ±  9%     -14.6%       8467 ±  5%  softirqs.CPU5.RCU
     17328 ± 65%     -57.0%       7455 ±  6%  softirqs.CPU51.RCU
     27697 ± 37%     -44.6%      15353 ± 11%  softirqs.CPU51.TIMER
      9617 ± 11%     -18.0%       7890 ±  4%  softirqs.CPU52.RCU
      9552 ± 10%     -16.2%       8002 ±  6%  softirqs.CPU55.RCU
     18941 ± 19%     -18.3%      15481        softirqs.CPU58.TIMER
      9503 ±  9%     -14.8%       8100 ±  8%  softirqs.CPU6.RCU
     11929 ± 51%     -42.5%       6864 ± 10%  softirqs.CPU60.RCU
      9244 ± 12%     -18.5%       7534 ±  7%  softirqs.CPU62.RCU
     19164 ± 16%     -22.5%      14854 ± 12%  softirqs.CPU62.TIMER
     19260 ± 16%     -23.6%      14710 ± 10%  softirqs.CPU64.TIMER
     19990 ± 11%     -25.8%      14826 ± 14%  softirqs.CPU66.TIMER
     19095 ± 10%     -22.5%      14800 ± 12%  softirqs.CPU67.TIMER
     19399 ± 16%     -23.8%      14774 ± 12%  softirqs.CPU69.TIMER
     19082 ± 15%     -21.6%      14952 ± 11%  softirqs.CPU70.TIMER
      9160 ±  6%     -39.8%       5517 ± 26%  softirqs.CPU71.RCU
     21558 ± 15%     -30.5%      14974 ± 12%  softirqs.CPU71.TIMER
     20591 ± 12%     -34.6%      13457 ±  9%  softirqs.CPU72.TIMER
     20531 ± 13%     -31.5%      14066 ± 12%  softirqs.CPU73.TIMER
      9265 ± 17%     -27.7%       6703 ± 13%  softirqs.CPU75.RCU
     20191 ± 12%     -32.5%      13633 ±  8%  softirqs.CPU75.TIMER
     20299 ± 13%     -33.4%      13523 ±  9%  softirqs.CPU76.TIMER
     20105 ± 14%     -29.2%      14235 ± 12%  softirqs.CPU77.TIMER
     20311 ± 13%     -29.4%      14349 ± 19%  softirqs.CPU78.TIMER
     20499 ± 12%     -30.6%      14236 ± 19%  softirqs.CPU79.TIMER
     11087 ± 14%     -32.2%       7522 ± 18%  softirqs.CPU80.RCU
     22326 ±  8%     -37.3%      14005 ± 19%  softirqs.CPU80.TIMER
     10718 ± 14%     -35.1%       6956 ± 11%  softirqs.CPU81.RCU
     22308 ± 10%     -40.4%      13297 ± 11%  softirqs.CPU81.TIMER
     10610 ± 10%     -29.0%       7538 ± 18%  softirqs.CPU82.RCU
     21550 ±  8%     -35.8%      13834 ± 19%  softirqs.CPU82.TIMER
      9870 ±  4%     -25.8%       7320 ± 15%  softirqs.CPU83.RCU
     20046 ± 12%     -33.2%      13387 ± 14%  softirqs.CPU83.TIMER
     20067 ± 12%     -34.2%      13212 ± 13%  softirqs.CPU84.TIMER
      9845 ±  5%     -27.0%       7186 ± 17%  softirqs.CPU85.RCU
     10719 ± 13%     -35.0%       6962 ± 12%  softirqs.CPU86.RCU
     20653 ±  5%     -34.3%      13578 ± 12%  softirqs.CPU86.TIMER
     10133 ± 12%     -22.2%       7879 ± 10%  softirqs.CPU87.RCU
     20899 ±  7%     -34.1%      13779 ± 16%  softirqs.CPU87.TIMER
     10455 ± 12%     -29.1%       7413 ± 13%  softirqs.CPU88.RCU
     20523 ±  5%     -38.1%      12706 ±  8%  softirqs.CPU88.TIMER
     10497 ± 12%     -27.4%       7619 ± 17%  softirqs.CPU89.RCU
     20220 ±  4%     -32.5%      13642 ± 18%  softirqs.CPU89.TIMER
      9714 ± 14%     -28.3%       6965 ±  8%  softirqs.CPU90.RCU
     20595 ±  4%     -35.3%      13328 ±  8%  softirqs.CPU90.TIMER
     10037 ±  8%     -18.6%       8169 ± 18%  softirqs.CPU91.RCU
     21226 ±  8%     -26.9%      15512 ± 14%  softirqs.CPU91.TIMER
     10073 ±  4%     -24.5%       7610 ± 15%  softirqs.CPU92.RCU
      9755 ±  4%     -31.9%       6645 ± 12%  softirqs.CPU93.RCU
     20013 ± 11%     -34.9%      13023 ± 10%  softirqs.CPU93.TIMER
      9610 ±  3%     -30.5%       6683 ± 14%  softirqs.CPU94.RCU
     19702 ± 10%     -33.5%      13101 ±  9%  softirqs.CPU94.TIMER
      9959 ±  4%     -29.5%       7019 ± 11%  softirqs.CPU95.RCU
     19944 ± 11%     -34.4%      13091 ± 14%  softirqs.CPU95.TIMER
    978551 ±  6%     -21.5%     768368 ±  5%  softirqs.RCU
    605892 ±  4%     -26.2%     447040 ±  5%  softirqs.SCHED
   2004596 ±  4%     -25.5%    1492892 ±  4%  softirqs.TIMER
    138496 ± 27%     -22.7%     107084 ± 28%  interrupts.CAL:Function_call_interrupts
     78261 ±  5%     -30.6%      54326 ± 10%  interrupts.CPU0.LOC:Local_timer_interrupts
      1455 ± 26%     -22.7%       1124 ± 28%  interrupts.CPU1.CAL:Function_call_interrupts
     78261 ±  5%     -29.9%      54851 ± 12%  interrupts.CPU1.LOC:Local_timer_interrupts
      1459 ± 27%     -31.0%       1006 ± 11%  interrupts.CPU10.CAL:Function_call_interrupts
     77884 ±  4%     -28.6%      55646 ± 15%  interrupts.CPU10.LOC:Local_timer_interrupts
    166.25 ± 27%    +636.7%       1224 ±131%  interrupts.CPU10.NMI:Non-maskable_interrupts
    166.25 ± 27%    +636.7%       1224 ±131%  interrupts.CPU10.PMI:Performance_monitoring_interrupts
      1459 ± 27%     -22.9%       1125 ± 28%  interrupts.CPU11.CAL:Function_call_interrupts
     78054 ±  5%     -30.8%      53993 ± 11%  interrupts.CPU11.LOC:Local_timer_interrupts
      1460 ± 27%     -23.0%       1123 ± 28%  interrupts.CPU12.CAL:Function_call_interrupts
     77456 ±  6%     -29.9%      54332 ± 11%  interrupts.CPU12.LOC:Local_timer_interrupts
      1451 ± 28%     -22.5%       1124 ± 28%  interrupts.CPU13.CAL:Function_call_interrupts
     77315 ±  6%     -30.7%      53617 ±  8%  interrupts.CPU13.LOC:Local_timer_interrupts
      1473 ± 25%     -23.7%       1124 ± 28%  interrupts.CPU14.CAL:Function_call_interrupts
     78266 ±  5%     -31.4%      53720 ±  9%  interrupts.CPU14.LOC:Local_timer_interrupts
      1459 ± 27%     -22.9%       1125 ± 28%  interrupts.CPU15.CAL:Function_call_interrupts
     77746 ±  5%     -30.4%      54095 ± 10%  interrupts.CPU15.LOC:Local_timer_interrupts
      1463 ± 26%     -24.1%       1110 ± 30%  interrupts.CPU16.CAL:Function_call_interrupts
     78162 ±  5%     -28.8%      55642 ± 14%  interrupts.CPU16.LOC:Local_timer_interrupts
      1459 ± 27%     -23.0%       1123 ± 28%  interrupts.CPU17.CAL:Function_call_interrupts
     78192 ±  6%     -31.8%      53315 ± 11%  interrupts.CPU17.LOC:Local_timer_interrupts
      1458 ± 27%     -26.3%       1075 ± 33%  interrupts.CPU18.CAL:Function_call_interrupts
     78062 ±  5%     -30.1%      54601 ± 10%  interrupts.CPU18.LOC:Local_timer_interrupts
      1459 ± 27%     -22.9%       1125 ± 28%  interrupts.CPU19.CAL:Function_call_interrupts
     77961 ±  4%     -30.7%      53995 ± 10%  interrupts.CPU19.LOC:Local_timer_interrupts
      1457 ± 27%     -22.6%       1127 ± 28%  interrupts.CPU2.CAL:Function_call_interrupts
     77923 ±  5%     -30.0%      54569 ± 11%  interrupts.CPU2.LOC:Local_timer_interrupts
     79095 ±  4%     -32.0%      53800 ± 10%  interrupts.CPU20.LOC:Local_timer_interrupts
      1483 ± 28%     -24.1%       1125 ± 28%  interrupts.CPU21.CAL:Function_call_interrupts
     77931 ±  4%     -31.3%      53549 ± 10%  interrupts.CPU21.LOC:Local_timer_interrupts
      1458 ± 27%     -23.0%       1123 ± 28%  interrupts.CPU22.CAL:Function_call_interrupts
     77934 ±  5%     -31.3%      53503 ± 10%  interrupts.CPU22.LOC:Local_timer_interrupts
      1462 ± 27%     -23.2%       1123 ± 28%  interrupts.CPU23.CAL:Function_call_interrupts
     78013 ±  6%     -31.4%      53500 ± 11%  interrupts.CPU23.LOC:Local_timer_interrupts
      1461 ± 27%     -22.9%       1127 ± 28%  interrupts.CPU24.CAL:Function_call_interrupts
      1457 ± 27%     -22.8%       1125 ± 28%  interrupts.CPU25.CAL:Function_call_interrupts
     78085 ±  4%     -25.9%      57838 ± 19%  interrupts.CPU27.LOC:Local_timer_interrupts
      1457 ± 27%     -22.8%       1125 ± 28%  interrupts.CPU28.CAL:Function_call_interrupts
     78541 ±  5%     -27.2%      57199 ± 17%  interrupts.CPU28.LOC:Local_timer_interrupts
     68.25 ±123%     -92.3%       5.25 ± 84%  interrupts.CPU28.RES:Rescheduling_interrupts
      1456 ± 27%     -22.6%       1127 ± 28%  interrupts.CPU29.CAL:Function_call_interrupts
     78368 ±  5%     -27.4%      56929 ± 17%  interrupts.CPU29.LOC:Local_timer_interrupts
    284.25 ±168%     -99.6%       1.25 ±131%  interrupts.CPU29.RES:Rescheduling_interrupts
      1457 ± 27%     -23.2%       1119 ± 27%  interrupts.CPU3.CAL:Function_call_interrupts
     77929 ±  5%     -29.8%      54700 ± 11%  interrupts.CPU3.LOC:Local_timer_interrupts
      1455 ± 27%     -23.0%       1121 ± 28%  interrupts.CPU30.CAL:Function_call_interrupts
     78015 ±  4%     -27.3%      56702 ± 16%  interrupts.CPU30.LOC:Local_timer_interrupts
      1458 ± 27%     -22.8%       1125 ± 28%  interrupts.CPU31.CAL:Function_call_interrupts
     78199 ±  5%     -28.5%      55876 ± 17%  interrupts.CPU31.LOC:Local_timer_interrupts
      1457 ± 27%     -25.8%       1082 ± 32%  interrupts.CPU32.CAL:Function_call_interrupts
     78612 ±  4%     -29.3%      55592 ± 14%  interrupts.CPU32.LOC:Local_timer_interrupts
      1457 ± 27%     -31.7%     995.00 ± 44%  interrupts.CPU33.CAL:Function_call_interrupts
     78121 ±  4%     -29.8%      54875 ± 11%  interrupts.CPU33.LOC:Local_timer_interrupts
     78203 ±  4%     -29.2%      55393 ± 14%  interrupts.CPU34.LOC:Local_timer_interrupts
      1456 ± 27%     -23.0%       1121 ± 28%  interrupts.CPU35.CAL:Function_call_interrupts
     77507 ±  5%     -27.9%      55848 ± 14%  interrupts.CPU35.LOC:Local_timer_interrupts
      1457 ± 27%     -22.8%       1124 ± 28%  interrupts.CPU36.CAL:Function_call_interrupts
     77977 ±  4%     -28.1%      56081 ± 15%  interrupts.CPU36.LOC:Local_timer_interrupts
      1456 ± 27%     -22.5%       1128 ± 28%  interrupts.CPU37.CAL:Function_call_interrupts
     77366 ±  5%     -27.7%      55934 ± 15%  interrupts.CPU37.LOC:Local_timer_interrupts
      1455 ± 27%     -22.9%       1121 ± 28%  interrupts.CPU38.CAL:Function_call_interrupts
     77040 ±  5%     -28.5%      55103 ± 14%  interrupts.CPU38.LOC:Local_timer_interrupts
     77550 ±  6%     -29.4%      54788 ± 14%  interrupts.CPU39.LOC:Local_timer_interrupts
      1457 ± 27%     -36.0%     932.25 ±  2%  interrupts.CPU4.CAL:Function_call_interrupts
     77681 ±  6%     -28.3%      55710 ± 15%  interrupts.CPU4.LOC:Local_timer_interrupts
      1479 ± 28%     -23.9%       1126 ± 28%  interrupts.CPU40.CAL:Function_call_interrupts
     77451 ±  5%     -26.7%      56790 ± 15%  interrupts.CPU40.LOC:Local_timer_interrupts
      5.00 ±173%   +6895.0%     349.75 ± 98%  interrupts.CPU40.RES:Rescheduling_interrupts
      1455 ± 27%     -22.4%       1128 ± 28%  interrupts.CPU41.CAL:Function_call_interrupts
     77059 ±  5%     -26.6%      56595 ± 15%  interrupts.CPU41.LOC:Local_timer_interrupts
     78166 ±  5%     -27.4%      56720 ± 16%  interrupts.CPU42.LOC:Local_timer_interrupts
      1455 ± 27%     -22.7%       1124 ± 28%  interrupts.CPU43.CAL:Function_call_interrupts
     78157 ±  5%     -27.8%      56439 ± 16%  interrupts.CPU43.LOC:Local_timer_interrupts
      1455 ± 27%     -22.9%       1122 ± 28%  interrupts.CPU44.CAL:Function_call_interrupts
     78325 ±  4%     -29.2%      55471 ± 13%  interrupts.CPU44.LOC:Local_timer_interrupts
     78404 ±  4%     -28.1%      56367 ± 16%  interrupts.CPU45.LOC:Local_timer_interrupts
     77607 ±  4%     -28.1%      55799 ± 13%  interrupts.CPU46.LOC:Local_timer_interrupts
      1.50 ±137%  +27700.0%     417.00 ±104%  interrupts.CPU46.RES:Rescheduling_interrupts
      1443 ± 27%     -22.3%       1121 ± 28%  interrupts.CPU47.CAL:Function_call_interrupts
     78107 ±  5%     -27.2%      56829 ± 15%  interrupts.CPU47.LOC:Local_timer_interrupts
      1457 ± 27%     -25.9%       1079 ± 22%  interrupts.CPU48.CAL:Function_call_interrupts
     78332 ±  5%     -32.1%      53171 ±  9%  interrupts.CPU48.LOC:Local_timer_interrupts
      1438 ± 26%     -21.6%       1127 ± 28%  interrupts.CPU49.CAL:Function_call_interrupts
     78188 ±  5%     -31.0%      53933 ±  9%  interrupts.CPU49.LOC:Local_timer_interrupts
     78067 ±  4%     -30.8%      54012 ± 10%  interrupts.CPU5.LOC:Local_timer_interrupts
    194.75 ±  4%     +57.0%     305.75 ± 19%  interrupts.CPU5.NMI:Non-maskable_interrupts
    194.75 ±  4%     +57.0%     305.75 ± 19%  interrupts.CPU5.PMI:Performance_monitoring_interrupts
      1454 ± 27%     -25.5%       1084 ± 33%  interrupts.CPU50.CAL:Function_call_interrupts
     77820 ±  5%     -29.6%      54777 ± 10%  interrupts.CPU50.LOC:Local_timer_interrupts
      1456 ± 27%     -27.2%       1059 ± 36%  interrupts.CPU51.CAL:Function_call_interrupts
     78177 ±  5%     -29.8%      54891 ± 10%  interrupts.CPU51.LOC:Local_timer_interrupts
      1456 ± 27%     -22.5%       1128 ± 28%  interrupts.CPU52.CAL:Function_call_interrupts
     77875 ±  5%     -30.1%      54448 ± 10%  interrupts.CPU52.LOC:Local_timer_interrupts
      1456 ± 27%     -19.2%       1176 ± 30%  interrupts.CPU53.CAL:Function_call_interrupts
     77613 ±  5%     -29.0%      55083 ± 11%  interrupts.CPU53.LOC:Local_timer_interrupts
      1457 ± 27%     -22.7%       1126 ± 28%  interrupts.CPU54.CAL:Function_call_interrupts
     78382 ±  5%     -30.9%      54168 ± 10%  interrupts.CPU54.LOC:Local_timer_interrupts
      1458 ± 27%     -22.8%       1126 ± 28%  interrupts.CPU55.CAL:Function_call_interrupts
     78344 ±  5%     -31.5%      53685 ±  8%  interrupts.CPU55.LOC:Local_timer_interrupts
      1451 ± 27%     -22.4%       1126 ± 28%  interrupts.CPU56.CAL:Function_call_interrupts
     78328 ±  5%     -31.5%      53616 ±  9%  interrupts.CPU56.LOC:Local_timer_interrupts
      1457 ± 27%     -22.7%       1126 ± 28%  interrupts.CPU57.CAL:Function_call_interrupts
     77662 ±  5%     -29.7%      54627 ± 11%  interrupts.CPU57.LOC:Local_timer_interrupts
      1456 ± 27%     -22.4%       1130 ± 28%  interrupts.CPU58.CAL:Function_call_interrupts
     77953 ±  5%     -31.0%      53764 ± 10%  interrupts.CPU58.LOC:Local_timer_interrupts
    163.50 ± 25%    +718.5%       1338 ±133%  interrupts.CPU58.NMI:Non-maskable_interrupts
    163.50 ± 25%    +718.5%       1338 ±133%  interrupts.CPU58.PMI:Performance_monitoring_interrupts
      1451 ± 27%     -22.8%       1121 ± 28%  interrupts.CPU59.CAL:Function_call_interrupts
     77888 ±  4%     -31.3%      53547 ± 12%  interrupts.CPU59.LOC:Local_timer_interrupts
     77720 ±  5%     -31.6%      53176 ±  9%  interrupts.CPU6.LOC:Local_timer_interrupts
      1456 ± 27%     -22.7%       1126 ± 28%  interrupts.CPU60.CAL:Function_call_interrupts
     77682 ±  5%     -29.7%      54579 ± 11%  interrupts.CPU60.LOC:Local_timer_interrupts
     78898 ±  4%     -30.8%      54610 ± 11%  interrupts.CPU61.LOC:Local_timer_interrupts
      1438 ± 27%     -21.7%       1126 ± 28%  interrupts.CPU62.CAL:Function_call_interrupts
     77907 ±  5%     -30.3%      54273 ± 12%  interrupts.CPU62.LOC:Local_timer_interrupts
      1455 ± 27%     -22.9%       1121 ± 29%  interrupts.CPU63.CAL:Function_call_interrupts
     77489 ±  5%     -30.3%      54021 ± 11%  interrupts.CPU63.LOC:Local_timer_interrupts
      1456 ± 27%     -23.0%       1122 ± 29%  interrupts.CPU64.CAL:Function_call_interrupts
     78168 ±  5%     -31.8%      53339 ± 11%  interrupts.CPU64.LOC:Local_timer_interrupts
      1455 ± 27%     -22.5%       1127 ± 28%  interrupts.CPU65.CAL:Function_call_interrupts
     77850 ±  5%     -30.6%      54043 ± 11%  interrupts.CPU65.LOC:Local_timer_interrupts
      1458 ± 27%     -22.6%       1129 ± 28%  interrupts.CPU66.CAL:Function_call_interrupts
     78270 ±  5%     -32.2%      53064 ± 12%  interrupts.CPU66.LOC:Local_timer_interrupts
      1458 ± 27%     -22.6%       1128 ± 28%  interrupts.CPU67.CAL:Function_call_interrupts
     77961 ±  4%     -31.0%      53756 ± 11%  interrupts.CPU67.LOC:Local_timer_interrupts
      1445 ± 28%     -25.1%       1083 ± 33%  interrupts.CPU68.CAL:Function_call_interrupts
     77089 ±  5%     -30.8%      53345 ± 11%  interrupts.CPU68.LOC:Local_timer_interrupts
      1454 ± 27%     -22.6%       1126 ± 28%  interrupts.CPU69.CAL:Function_call_interrupts
     78244 ±  5%     -32.2%      53067 ± 10%  interrupts.CPU69.LOC:Local_timer_interrupts
      1454 ± 26%     -27.4%       1056 ± 36%  interrupts.CPU7.CAL:Function_call_interrupts
     78414 ±  5%     -30.7%      54305 ±  8%  interrupts.CPU7.LOC:Local_timer_interrupts
      1454 ± 27%     -22.6%       1126 ± 28%  interrupts.CPU70.CAL:Function_call_interrupts
     78128 ±  5%     -31.0%      53929 ± 11%  interrupts.CPU70.LOC:Local_timer_interrupts
     78665 ±  5%     -30.6%      54581 ± 12%  interrupts.CPU71.LOC:Local_timer_interrupts
      1452 ± 27%     -22.4%       1126 ± 28%  interrupts.CPU72.CAL:Function_call_interrupts
     77823 ±  5%     -28.8%      55383 ± 12%  interrupts.CPU72.LOC:Local_timer_interrupts
      1454 ± 27%     -22.7%       1124 ± 28%  interrupts.CPU73.CAL:Function_call_interrupts
     78108 ±  5%     -28.1%      56156 ± 14%  interrupts.CPU73.LOC:Local_timer_interrupts
      1455 ± 27%     -22.6%       1127 ± 28%  interrupts.CPU74.CAL:Function_call_interrupts
     77336 ±  4%     -26.6%      56728 ± 15%  interrupts.CPU74.LOC:Local_timer_interrupts
      1454 ± 27%     -22.5%       1128 ± 28%  interrupts.CPU76.CAL:Function_call_interrupts
      1456 ± 27%     -22.8%       1124 ± 28%  interrupts.CPU77.CAL:Function_call_interrupts
     77413 ±  5%     -27.6%      56070 ± 15%  interrupts.CPU77.LOC:Local_timer_interrupts
      1455 ± 27%     -23.3%       1116 ± 29%  interrupts.CPU78.CAL:Function_call_interrupts
     78173 ±  5%     -27.5%      56689 ± 18%  interrupts.CPU78.LOC:Local_timer_interrupts
      1478 ± 25%     -24.0%       1123 ± 29%  interrupts.CPU79.CAL:Function_call_interrupts
     78118 ±  5%     -27.0%      57003 ± 17%  interrupts.CPU79.LOC:Local_timer_interrupts
      1461 ± 26%     -23.2%       1122 ± 28%  interrupts.CPU8.CAL:Function_call_interrupts
     78797 ±  4%     -30.8%      54522 ± 11%  interrupts.CPU8.LOC:Local_timer_interrupts
      1451 ± 27%     -22.4%       1126 ± 28%  interrupts.CPU80.CAL:Function_call_interrupts
     77864 ±  4%     -28.1%      56007 ± 15%  interrupts.CPU80.LOC:Local_timer_interrupts
      1454 ± 27%     -22.6%       1124 ± 28%  interrupts.CPU81.CAL:Function_call_interrupts
     78115 ±  4%     -28.2%      56124 ± 17%  interrupts.CPU81.LOC:Local_timer_interrupts
      1453 ± 27%     -22.9%       1121 ± 29%  interrupts.CPU82.CAL:Function_call_interrupts
     77800 ±  5%     -28.5%      55657 ± 17%  interrupts.CPU82.LOC:Local_timer_interrupts
      1453 ± 27%     -22.4%       1127 ± 28%  interrupts.CPU83.CAL:Function_call_interrupts
     77472 ±  4%     -28.0%      55760 ± 16%  interrupts.CPU83.LOC:Local_timer_interrupts
      1454 ± 27%     -22.7%       1124 ± 28%  interrupts.CPU84.CAL:Function_call_interrupts
     77998 ±  4%     -28.4%      55827 ± 15%  interrupts.CPU84.LOC:Local_timer_interrupts
      1453 ± 27%     -22.7%       1123 ± 28%  interrupts.CPU85.CAL:Function_call_interrupts
      1455 ± 27%     -22.7%       1124 ± 28%  interrupts.CPU86.CAL:Function_call_interrupts
     76858 ±  5%     -28.1%      55296 ± 13%  interrupts.CPU86.LOC:Local_timer_interrupts
      1453 ± 27%     -22.5%       1126 ± 28%  interrupts.CPU87.CAL:Function_call_interrupts
     77075 ±  5%     -27.3%      56025 ± 18%  interrupts.CPU87.LOC:Local_timer_interrupts
      1453 ± 27%     -22.5%       1126 ± 28%  interrupts.CPU88.CAL:Function_call_interrupts
     77054 ±  5%     -27.9%      55567 ± 18%  interrupts.CPU88.LOC:Local_timer_interrupts
      1453 ± 27%     -22.3%       1129 ± 28%  interrupts.CPU89.CAL:Function_call_interrupts
     76760 ±  5%     -28.0%      55232 ± 15%  interrupts.CPU89.LOC:Local_timer_interrupts
      1460 ± 27%     -23.2%       1121 ± 28%  interrupts.CPU9.CAL:Function_call_interrupts
     78225 ±  4%     -30.6%      54315 ± 11%  interrupts.CPU9.LOC:Local_timer_interrupts
      1453 ± 27%     -26.0%       1076 ± 33%  interrupts.CPU90.CAL:Function_call_interrupts
     76715 ±  5%     -25.4%      57204 ± 17%  interrupts.CPU90.LOC:Local_timer_interrupts
      1453 ± 27%     -22.4%       1127 ± 28%  interrupts.CPU91.CAL:Function_call_interrupts
     78344 ±  4%     -27.3%      56928 ± 15%  interrupts.CPU91.LOC:Local_timer_interrupts
      1457 ± 27%     -22.1%       1134 ± 27%  interrupts.CPU92.CAL:Function_call_interrupts
     78329 ±  4%     -29.2%      55486 ± 14%  interrupts.CPU92.LOC:Local_timer_interrupts
      1456 ± 27%     -22.6%       1127 ± 28%  interrupts.CPU93.CAL:Function_call_interrupts
     78269 ±  4%     -28.8%      55723 ± 15%  interrupts.CPU93.LOC:Local_timer_interrupts
      1456 ± 27%     -22.4%       1130 ± 28%  interrupts.CPU94.CAL:Function_call_interrupts
     77721 ±  6%     -28.4%      55652 ± 16%  interrupts.CPU94.LOC:Local_timer_interrupts
      1438 ± 26%     -21.7%       1126 ± 28%  interrupts.CPU95.CAL:Function_call_interrupts
     77924 ±  5%     -28.3%      55904 ± 13%  interrupts.CPU95.LOC:Local_timer_interrupts
   7484469 ±  5%     -29.2%    5300277 ± 13%  interrupts.LOC:Local_timer_interrupts
      9.12 ± 12%      -9.1        0.00        perf-profile.calltrace.cycles-pp.btrfs_csum_one_bio.btrfs_submit_bio_hook.submit_one_bio.extent_writepages.do_writepages
      9.05 ± 12%      -9.1        0.00        perf-profile.calltrace.cycles-pp.crc32c.btrfs_csum_one_bio.btrfs_submit_bio_hook.submit_one_bio.extent_writepages
      9.04 ± 12%      -9.0        0.00        perf-profile.calltrace.cycles-pp.chksum_update.crc32c.btrfs_csum_one_bio.btrfs_submit_bio_hook.submit_one_bio
      9.04 ± 12%      -9.0        0.00        perf-profile.calltrace.cycles-pp.__crc32c_le.chksum_update.crc32c.btrfs_csum_one_bio.btrfs_submit_bio_hook
     14.00 ± 11%      -6.9        7.13 ± 11%  perf-profile.calltrace.cycles-pp.submit_one_bio.extent_writepages.do_writepages.__filemap_fdatawrite_range.btrfs_fdatawrite_range
     14.00 ± 11%      -6.9        7.13 ± 11%  perf-profile.calltrace.cycles-pp.btrfs_submit_bio_hook.submit_one_bio.extent_writepages.do_writepages.__filemap_fdatawrite_range
     16.54 ± 11%      -5.9       10.62 ± 11%  perf-profile.calltrace.cycles-pp.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe
     16.54 ± 11%      -5.9       10.62 ± 11%  perf-profile.calltrace.cycles-pp.do_fsync.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe
     16.54 ± 11%      -5.9       10.62 ± 11%  perf-profile.calltrace.cycles-pp.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe
     15.84 ± 11%      -5.9        9.92 ± 11%  perf-profile.calltrace.cycles-pp.start_ordered_ops.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64
     15.84 ± 11%      -5.9        9.92 ± 11%  perf-profile.calltrace.cycles-pp.__filemap_fdatawrite_range.btrfs_fdatawrite_range.start_ordered_ops.btrfs_sync_file.do_fsync
     15.84 ± 11%      -5.9        9.92 ± 11%  perf-profile.calltrace.cycles-pp.btrfs_fdatawrite_range.start_ordered_ops.btrfs_sync_file.do_fsync.__x64_sys_fsync
     15.84 ± 11%      -5.9        9.92 ± 11%  perf-profile.calltrace.cycles-pp.extent_writepages.do_writepages.__filemap_fdatawrite_range.btrfs_fdatawrite_range.start_ordered_ops
     15.84 ± 11%      -5.9        9.92 ± 11%  perf-profile.calltrace.cycles-pp.do_writepages.__filemap_fdatawrite_range.btrfs_fdatawrite_range.start_ordered_ops.btrfs_sync_file
     28.93 ±  5%      -4.0       24.96 ±  6%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
     28.91 ±  5%      -4.0       24.94 ±  6%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.61 ± 12%      +0.3        0.89 ± 21%  perf-profile.calltrace.cycles-pp.btrfs_end_bio.brd_make_request.generic_make_request.submit_bio.btrfs_map_bio
      0.79 ± 11%      +0.3        1.09 ± 12%  perf-profile.calltrace.cycles-pp.add_to_page_cache_lru.pagecache_get_page.prepare_pages.btrfs_buffered_write.btrfs_file_write_iter
      0.67 ± 21%      +0.3        0.96 ± 16%  perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.brd_insert_page.brd_do_bvec.brd_make_request.generic_make_request
      0.83 ± 10%      +0.4        1.20 ± 15%  perf-profile.calltrace.cycles-pp.btrfs_dirty_pages.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write.vfs_write
      0.47 ± 58%      +0.4        0.88 ± 21%  perf-profile.calltrace.cycles-pp.end_bio_extent_writepage.btrfs_end_bio.brd_make_request.generic_make_request.submit_bio
      0.45 ± 60%      +0.4        0.87 ± 17%  perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.brd_insert_page.brd_do_bvec.brd_make_request
      1.32 ± 12%      +0.5        1.82 ± 10%  perf-profile.calltrace.cycles-pp.pagecache_get_page.prepare_pages.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write
      0.95 ± 13%      +0.5        1.46 ± 15%  perf-profile.calltrace.cycles-pp.__extent_writepage_io.__extent_writepage.extent_write_cache_pages.extent_writepages.do_writepages
      0.14 ±173%      +0.5        0.65 ± 15%  perf-profile.calltrace.cycles-pp.btrfs_set_range_writeback.__extent_writepage_io.__extent_writepage.extent_write_cache_pages.extent_writepages
      1.35 ± 12%      +0.5        1.88 ± 10%  perf-profile.calltrace.cycles-pp.prepare_pages.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write.vfs_write
      0.14 ±173%      +0.5        0.68 ± 12%  perf-profile.calltrace.cycles-pp.__add_to_page_cache_locked.add_to_page_cache_lru.pagecache_get_page.prepare_pages.btrfs_buffered_write
      0.00            +0.6        0.58 ± 13%  perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.pagecache_get_page.prepare_pages.btrfs_buffered_write.btrfs_file_write_iter
      1.41 ± 14%      +0.8        2.19 ± 13%  perf-profile.calltrace.cycles-pp.__extent_writepage.extent_write_cache_pages.extent_writepages.do_writepages.__filemap_fdatawrite_range
      2.14 ± 10%      +0.9        3.01 ± 10%  perf-profile.calltrace.cycles-pp._raw_spin_lock.brd_insert_page.brd_do_bvec.brd_make_request.generic_make_request
      1.84 ± 12%      +0.9        2.78 ± 12%  perf-profile.calltrace.cycles-pp.extent_write_cache_pages.extent_writepages.do_writepages.__filemap_fdatawrite_range.btrfs_fdatawrite_range
      2.35 ± 13%      +0.9        3.30 ± 12%  perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin.iov_iter_copy_from_user_atomic.btrfs_copy_from_user.btrfs_buffered_write
      2.37 ± 13%      +1.0        3.33 ± 12%  perf-profile.calltrace.cycles-pp.copyin.iov_iter_copy_from_user_atomic.btrfs_copy_from_user.btrfs_buffered_write.btrfs_file_write_iter
      2.40 ± 13%      +1.0        3.39 ± 12%  perf-profile.calltrace.cycles-pp.iov_iter_copy_from_user_atomic.btrfs_copy_from_user.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write
      2.48 ± 13%      +1.0        3.50 ± 13%  perf-profile.calltrace.cycles-pp.btrfs_copy_from_user.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write.vfs_write
      3.20 ± 12%      +1.4        4.59 ± 11%  perf-profile.calltrace.cycles-pp.brd_insert_page.brd_do_bvec.brd_make_request.generic_make_request.submit_bio
      4.24 ± 10%      +1.9        6.11 ± 10%  perf-profile.calltrace.cycles-pp.brd_do_bvec.brd_make_request.generic_make_request.submit_bio.btrfs_map_bio
      4.88 ± 10%      +2.2        7.03 ± 11%  perf-profile.calltrace.cycles-pp.brd_make_request.generic_make_request.submit_bio.btrfs_map_bio.btrfs_submit_bio_hook
      4.88 ± 10%      +2.2        7.04 ± 11%  perf-profile.calltrace.cycles-pp.submit_bio.btrfs_map_bio.btrfs_submit_bio_hook.submit_one_bio.extent_writepages
      4.88 ± 10%      +2.2        7.04 ± 11%  perf-profile.calltrace.cycles-pp.generic_make_request.submit_bio.btrfs_map_bio.btrfs_submit_bio_hook.submit_one_bio
      4.88 ± 10%      +2.2        7.04 ± 11%  perf-profile.calltrace.cycles-pp.btrfs_map_bio.btrfs_submit_bio_hook.submit_one_bio.extent_writepages.do_writepages
      5.29 ± 12%      +2.3        7.54 ± 12%  perf-profile.calltrace.cycles-pp.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write.vfs_write.ksys_write
      5.38 ± 12%      +2.3        7.67 ± 12%  perf-profile.calltrace.cycles-pp.btrfs_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
      5.86 ±  5%      +2.5        8.37 ±  6%  perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5.92 ±  5%      +2.5        8.46 ±  6%  perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5.93 ±  5%      +2.6        8.49 ±  6%  perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      9.27 ± 12%      -9.3        0.00        perf-profile.children.cycles-pp.crc32c
      9.26 ± 12%      -9.3        0.00        perf-profile.children.cycles-pp.chksum_update
      9.26 ± 12%      -9.3        0.00        perf-profile.children.cycles-pp.__crc32c_le
      9.12 ± 12%      -9.0        0.09 ± 11%  perf-profile.children.cycles-pp.btrfs_csum_one_bio
     14.32 ± 11%      -7.0        7.33 ± 12%  perf-profile.children.cycles-pp.submit_one_bio
     14.00 ± 11%      -6.9        7.14 ± 11%  perf-profile.children.cycles-pp.btrfs_submit_bio_hook
     16.21 ± 11%      -6.0       10.17 ± 11%  perf-profile.children.cycles-pp.do_writepages
     16.21 ± 11%      -6.0       10.18 ± 11%  perf-profile.children.cycles-pp.__filemap_fdatawrite_range
     16.54 ± 11%      -5.9       10.62 ± 11%  perf-profile.children.cycles-pp.__x64_sys_fsync
     16.54 ± 11%      -5.9       10.62 ± 11%  perf-profile.children.cycles-pp.do_fsync
     16.54 ± 11%      -5.9       10.62 ± 11%  perf-profile.children.cycles-pp.btrfs_sync_file
     15.84 ± 11%      -5.9        9.92 ± 11%  perf-profile.children.cycles-pp.start_ordered_ops
     15.84 ± 11%      -5.9        9.93 ± 11%  perf-profile.children.cycles-pp.btrfs_fdatawrite_range
     15.84 ± 11%      -5.9        9.93 ± 11%  perf-profile.children.cycles-pp.extent_writepages
     28.93 ±  5%      -4.0       24.96 ±  6%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     28.91 ±  5%      -4.0       24.94 ±  6%  perf-profile.children.cycles-pp.do_syscall_64
      0.22 ± 34%      -0.2        0.03 ±105%  perf-profile.children.cycles-pp.btree_csum_one_bio
      0.32 ± 23%      -0.1        0.18 ± 17%  perf-profile.children.cycles-pp.btree_submit_bio_hook
      0.09 ± 13%      +0.0        0.11 ±  4%  perf-profile.children.cycles-pp.process_one_work
      0.06 ± 16%      +0.0        0.09 ±  5%  perf-profile.children.cycles-pp.normal_work_helper
      0.11 ± 10%      +0.0        0.13 ±  6%  perf-profile.children.cycles-pp.worker_thread
      0.06 ± 16%      +0.0        0.09 ±  4%  perf-profile.children.cycles-pp.syscall_slow_exit_work
      0.06 ± 20%      +0.0        0.09 ± 16%  perf-profile.children.cycles-pp.btrfs_commit_transaction
      0.04 ± 58%      +0.0        0.07 ± 12%  perf-profile.children.cycles-pp.btrfs_insert_empty_items
      0.09 ± 26%      +0.0        0.12 ±  3%  perf-profile.children.cycles-pp.do_sys_open
      0.04 ± 58%      +0.0        0.08 ±  6%  perf-profile.children.cycles-pp.__audit_syscall_exit
      0.08 ± 24%      +0.0        0.12 ±  5%  perf-profile.children.cycles-pp.path_openat
      0.10 ±  8%      +0.0        0.14 ±  8%  perf-profile.children.cycles-pp.alloc_extent_state
      0.08 ± 24%      +0.0        0.12 ±  3%  perf-profile.children.cycles-pp.do_filp_open
      0.08 ± 23%      +0.0        0.12 ± 17%  perf-profile.children.cycles-pp.syscall_return_via_sysret
      0.05 ± 60%      +0.0        0.09 ±  5%  perf-profile.children.cycles-pp.btrfs_finish_ordered_io
      0.05 ± 62%      +0.0        0.09 ± 19%  perf-profile.children.cycles-pp.radix_tree_insert
      0.03 ±100%      +0.0        0.07 ±  7%  perf-profile.children.cycles-pp.ktime_get_real_ts64
      0.04 ± 58%      +0.0        0.08 ± 17%  perf-profile.children.cycles-pp.__put_user_8
      0.12 ± 20%      +0.0        0.16 ±  7%  perf-profile.children.cycles-pp.rcu_eqs_enter
      0.09 ± 13%      +0.0        0.13 ±  8%  perf-profile.children.cycles-pp.btrfs_dec_test_ordered_pending
      0.09 ± 26%      +0.0        0.13 ± 16%  perf-profile.children.cycles-pp.insert_state
      0.10 ± 17%      +0.0        0.14 ± 14%  perf-profile.children.cycles-pp.mem_cgroup_commit_charge
      0.11 ± 19%      +0.0        0.15 ± 13%  perf-profile.children.cycles-pp.dec_zone_page_state
      0.12 ±  6%      +0.0        0.17 ±  5%  perf-profile.children.cycles-pp.find_get_entry
      0.06 ± 60%      +0.0        0.10        perf-profile.children.cycles-pp.btrfs_drop_pages
      0.06 ± 60%      +0.0        0.10 ± 14%  perf-profile.children.cycles-pp.find_delalloc_range
      0.13 ±  9%      +0.0        0.18 ±  6%  perf-profile.children.cycles-pp.kthread
      0.11 ± 33%      +0.0        0.16 ±  6%  perf-profile.children.cycles-pp.unlock_page
      0.09 ± 15%      +0.1        0.14 ± 13%  perf-profile.children.cycles-pp.__mod_node_page_state
      0.01 ±173%      +0.1        0.06 ± 13%  perf-profile.children.cycles-pp.syscall_trace_enter
      0.08 ± 14%      +0.1        0.13 ± 14%  perf-profile.children.cycles-pp._raw_read_lock
      0.12 ± 27%      +0.1        0.18 ± 20%  perf-profile.children.cycles-pp.btrfs_set_extent_delalloc
      0.01 ±173%      +0.1        0.07 ± 19%  perf-profile.children.cycles-pp.btrfs_writepage_cow_fixup
      0.14 ± 26%      +0.1        0.20 ± 18%  perf-profile.children.cycles-pp.__set_extent_bit
      0.13 ± 28%      +0.1        0.19 ± 17%  perf-profile.children.cycles-pp.set_extent_bit
      0.02 ±173%      +0.1        0.08 ± 19%  perf-profile.children.cycles-pp.node_dirty_ok
      0.00            +0.1        0.06 ± 16%  perf-profile.children.cycles-pp.crc_1
      0.01 ±173%      +0.1        0.07 ± 22%  perf-profile.children.cycles-pp.btrfs_inode_rsv_release
      0.15 ±  2%      +0.1        0.21 ± 10%  perf-profile.children.cycles-pp.__x64_sys_gettimeofday
      0.12 ± 11%      +0.1        0.19 ± 18%  perf-profile.children.cycles-pp.account_page_dirtied
      0.00            +0.1        0.06 ± 13%  perf-profile.children.cycles-pp.xas_set_mark
      0.05 ± 62%      +0.1        0.11 ± 40%  perf-profile.children.cycles-pp.alloc_pages_current
      0.00            +0.1        0.07 ± 17%  perf-profile.children.cycles-pp.block_rsv_release_bytes
      0.14 ± 13%      +0.1        0.22 ± 20%  perf-profile.children.cycles-pp.cow_file_range
      0.20 ± 15%      +0.1        0.28 ±  9%  perf-profile.children.cycles-pp.__clear_extent_bit
      0.20 ± 13%      +0.1        0.27 ±  8%  perf-profile.children.cycles-pp.clear_extent_bit
      0.14 ± 13%      +0.1        0.22 ± 20%  perf-profile.children.cycles-pp.btrfs_run_delalloc_range
      0.14 ± 13%      +0.1        0.22 ±  9%  perf-profile.children.cycles-pp.lock_delalloc_pages
      0.12 ± 11%      +0.1        0.20 ± 20%  perf-profile.children.cycles-pp.btrfs_get_extent
      0.20 ±  9%      +0.1        0.28 ±  8%  perf-profile.children.cycles-pp.btrfs_log_inode
      0.20 ±  9%      +0.1        0.29 ±  7%  perf-profile.children.cycles-pp.btrfs_log_dentry_safe
      0.20 ±  9%      +0.1        0.29 ±  7%  perf-profile.children.cycles-pp.btrfs_log_inode_parent
      0.09 ± 11%      +0.1        0.18 ± 19%  perf-profile.children.cycles-pp.__lookup_extent_mapping
      0.21 ± 14%      +0.1        0.30 ±  6%  perf-profile.children.cycles-pp.xas_load
      0.26 ±  6%      +0.1        0.36 ± 14%  perf-profile.children.cycles-pp.__mod_lruvec_state
      0.16 ± 17%      +0.1        0.26 ± 26%  perf-profile.children.cycles-pp.btrfs_delalloc_reserve_metadata
      0.27 ± 12%      +0.1        0.36 ±  5%  perf-profile.children.cycles-pp.clear_page_dirty_for_io
      0.14 ± 14%      +0.1        0.24 ± 16%  perf-profile.children.cycles-pp.btrfs_get_chunk_map
      0.21 ± 13%      +0.1        0.35 ± 10%  perf-profile.children.cycles-pp.find_lock_delalloc_range
      0.26 ±  9%      +0.2        0.41 ± 13%  perf-profile.children.cycles-pp.__process_pages_contig
      0.21 ± 11%      +0.2        0.36 ± 15%  perf-profile.children.cycles-pp.__btrfs_map_block
      0.23 ± 12%      +0.2        0.38 ± 16%  perf-profile.children.cycles-pp.btrfs_bio_fits_in_stripe
      0.20 ± 11%      +0.2        0.36 ± 16%  perf-profile.children.cycles-pp.btrfs_map_block
      0.35 ± 16%      +0.2        0.52 ± 11%  perf-profile.children.cycles-pp.__test_set_page_writeback
      0.32 ± 13%      +0.2        0.48 ± 20%  perf-profile.children.cycles-pp.clear_page_erms
      0.28 ± 15%      +0.2        0.46 ± 14%  perf-profile.children.cycles-pp.submit_extent_page
      0.41 ±  8%      +0.2        0.60 ± 21%  perf-profile.children.cycles-pp.test_clear_page_writeback
      0.40 ±  9%      +0.2        0.60 ± 15%  perf-profile.children.cycles-pp.__set_page_dirty_nobuffers
      0.44 ± 18%      +0.2        0.65 ± 15%  perf-profile.children.cycles-pp.btrfs_set_range_writeback
      0.42 ±  7%      +0.2        0.63 ± 25%  perf-profile.children.cycles-pp.end_page_writeback
      0.00            +0.2        0.21 ± 18%  perf-profile.children.cycles-pp.crc_128
      0.40 ± 12%      +0.2        0.61 ± 18%  perf-profile.children.cycles-pp.prep_new_page
      0.50 ± 11%      +0.2        0.71 ±  9%  perf-profile.children.cycles-pp.__add_to_page_cache_locked
      0.37 ± 14%      +0.2        0.58 ± 13%  perf-profile.children.cycles-pp.writepage_delalloc
      0.62 ± 11%      +0.3        0.90 ± 21%  perf-profile.children.cycles-pp.btrfs_end_bio
      0.60 ± 11%      +0.3        0.89 ± 21%  perf-profile.children.cycles-pp.end_bio_extent_writepage
      0.82 ± 11%      +0.3        1.12 ±  9%  perf-profile.children.cycles-pp.add_to_page_cache_lru
      0.84 ± 10%      +0.4        1.20 ± 15%  perf-profile.children.cycles-pp.btrfs_dirty_pages
      1.03 ±  8%      +0.4        1.48 ± 10%  perf-profile.children.cycles-pp.get_page_from_freelist
      1.27 ±  7%      +0.5        1.74 ±  9%  perf-profile.children.cycles-pp.__alloc_pages_nodemask
      0.96 ± 14%      +0.5        1.47 ± 15%  perf-profile.children.cycles-pp.__extent_writepage_io
      1.35 ± 12%      +0.5        1.88 ± 11%  perf-profile.children.cycles-pp.prepare_pages
      1.42 ± 12%      +0.6        1.99 ±  9%  perf-profile.children.cycles-pp.pagecache_get_page
      1.41 ± 14%      +0.8        2.20 ± 13%  perf-profile.children.cycles-pp.__extent_writepage
      1.84 ± 12%      +0.9        2.79 ± 12%  perf-profile.children.cycles-pp.extent_write_cache_pages
      2.49 ±  8%      +1.0        3.44 ± 10%  perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
      2.37 ± 12%      +1.0        3.33 ± 12%  perf-profile.children.cycles-pp.copyin
      2.41 ± 13%      +1.0        3.39 ± 12%  perf-profile.children.cycles-pp.iov_iter_copy_from_user_atomic
      2.48 ± 13%      +1.0        3.50 ± 13%  perf-profile.children.cycles-pp.btrfs_copy_from_user
      2.78 ±  7%      +1.1        3.86 ± 11%  perf-profile.children.cycles-pp._raw_spin_lock
      3.28 ± 11%      +1.4        4.70 ± 11%  perf-profile.children.cycles-pp.brd_insert_page
      4.33 ± 10%      +1.9        6.23 ± 10%  perf-profile.children.cycles-pp.brd_do_bvec
      4.97 ± 10%      +2.2        7.17 ± 11%  perf-profile.children.cycles-pp.brd_make_request
      4.98 ± 10%      +2.2        7.18 ± 11%  perf-profile.children.cycles-pp.btrfs_map_bio
      4.97 ± 10%      +2.2        7.18 ± 11%  perf-profile.children.cycles-pp.submit_bio
      4.97 ± 10%      +2.2        7.18 ± 11%  perf-profile.children.cycles-pp.generic_make_request
      5.29 ± 12%      +2.3        7.54 ± 12%  perf-profile.children.cycles-pp.btrfs_buffered_write
      5.38 ± 12%      +2.3        7.67 ± 12%  perf-profile.children.cycles-pp.btrfs_file_write_iter
      5.86 ±  5%      +2.5        8.37 ±  6%  perf-profile.children.cycles-pp.new_sync_write
      5.92 ±  5%      +2.5        8.46 ±  6%  perf-profile.children.cycles-pp.vfs_write
      5.93 ±  5%      +2.6        8.49 ±  6%  perf-profile.children.cycles-pp.ksys_write
      9.12 ± 12%      -9.1        0.00        perf-profile.self.cycles-pp.__crc32c_le
      0.04 ± 58%      +0.0        0.07 ±  7%  perf-profile.self.cycles-pp.alloc_extent_state
      0.09 ± 11%      +0.0        0.12 ± 10%  perf-profile.self.cycles-pp.btrfs_buffered_write
      0.11 ± 31%      +0.0        0.14 ±  5%  perf-profile.self.cycles-pp.unlock_page
      0.04 ± 58%      +0.0        0.08 ± 19%  perf-profile.self.cycles-pp.__put_user_8
      0.08 ± 23%      +0.0        0.12 ± 17%  perf-profile.self.cycles-pp.syscall_return_via_sysret
      0.04 ± 58%      +0.0        0.08 ± 15%  perf-profile.self.cycles-pp.btrfs_csum_one_bio
      0.09 ± 12%      +0.0        0.13 ± 19%  perf-profile.self.cycles-pp.prep_new_page
      0.08 ± 14%      +0.0        0.12 ± 15%  perf-profile.self.cycles-pp._raw_read_lock
      0.04 ± 58%      +0.0        0.08 ±  5%  perf-profile.self.cycles-pp.brd_insert_page
      0.03 ±102%      +0.0        0.07 ± 17%  perf-profile.self.cycles-pp.btrfs_get_extent
      0.08 ± 10%      +0.0        0.12 ± 14%  perf-profile.self.cycles-pp.__add_to_page_cache_locked
      0.03 ±102%      +0.0        0.07 ± 22%  perf-profile.self.cycles-pp.radix_tree_insert
      0.09 ± 15%      +0.0        0.14 ± 15%  perf-profile.self.cycles-pp.__mod_node_page_state
      0.01 ±173%      +0.0        0.06 ± 20%  perf-profile.self.cycles-pp.__lru_cache_add
      0.01 ±173%      +0.1        0.07 ± 17%  perf-profile.self.cycles-pp.end_bio_extent_writepage
      0.01 ±173%      +0.1        0.07 ± 17%  perf-profile.self.cycles-pp.btrfs_writepage_cow_fixup
      0.15 ± 14%      +0.1        0.20 ±  8%  perf-profile.self.cycles-pp.xas_load
      0.14 ± 13%      +0.1        0.19 ± 13%  perf-profile.self.cycles-pp.clear_page_dirty_for_io
      0.00            +0.1        0.06 ± 14%  perf-profile.self.cycles-pp.__btrfs_map_block
      0.00            +0.1        0.06 ± 11%  perf-profile.self.cycles-pp.xas_set_mark
      0.00            +0.1        0.06 ± 16%  perf-profile.self.cycles-pp.crc_1
      0.10 ± 18%      +0.1        0.17 ± 22%  perf-profile.self.cycles-pp.test_clear_page_writeback
      0.11 ± 21%      +0.1        0.18 ± 14%  perf-profile.self.cycles-pp.__test_set_page_writeback
      0.65 ±  9%      +0.1        0.72 ±  6%  perf-profile.self.cycles-pp.read_tsc
      0.05 ± 61%      +0.1        0.12 ± 16%  perf-profile.self.cycles-pp.__extent_writepage
      0.12 ±  6%      +0.1        0.20 ± 20%  perf-profile.self.cycles-pp.__process_pages_contig
      0.09 ± 13%      +0.1        0.18 ± 17%  perf-profile.self.cycles-pp.__lookup_extent_mapping
      0.13 ±  9%      +0.1        0.22 ± 21%  perf-profile.self.cycles-pp.__radix_tree_preload
      0.31 ± 12%      +0.1        0.46 ± 13%  perf-profile.self.cycles-pp.clear_page_erms
      0.43 ± 14%      +0.2        0.64 ±  5%  perf-profile.self.cycles-pp.get_page_from_freelist
      0.00            +0.2        0.21 ± 20%  perf-profile.self.cycles-pp.crc_128
      0.93 ± 10%      +0.4        1.30 ± 10%  perf-profile.self.cycles-pp.brd_do_bvec
      2.40 ± 11%      +1.0        3.38 ± 11%  perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      2.69 ±  8%      +1.0        3.72 ± 11%  perf-profile.self.cycles-pp._raw_spin_lock


                                                                                
                             fsmark.time.system_time                            
                                                                                
  40 +-+--------------------------------------------------------------------+   
     |    +.+.+.+..+      +.+.+.+.        +.+          +..+.+             + |   
  35 +-+  :                                                                 |   
  30 +-+  :                                                                 |   
     |   :                                                                  |   
  25 O-O :O O O O  O O O  O O O O  O O O  O O O  O O O O  O O               |   
     |   :                                                                  |   
  20 +-+ :                                                                  |   
     |  :                                                                   |   
  15 +-+:                                                                   |   
  10 +-+:                                                                   |   
     |  :                                                                   |   
   5 +-+                                                                    |   
     | :                                                                    |   
   0 +-+--------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                            fsmark.time.elapsed_time                            
                                                                                
  45 +-+--------------------------------------------------------------------+   
     |                                                                      |   
  40 +-+  +.+.+.+..+.+.+..+.+.+.+..+.+.+..+.+.+..+.+.+.+..+.+.+..+.+.+.+..+.|   
  35 +-+  :                                                                 |   
     |    :                                                                 |   
  30 O-+ :                                                                  |   
  25 +-O :O O O O  O O O  O O O O  O O O  O O O  O O O O  O O               |   
     |   :                                                                  |   
  20 +-+ :                                                                  |   
  15 +-+:                                                                   |   
     |  :                                                                   |   
  10 +-+:                                                                   |   
   5 +-+:                                                                   |   
     | :                                                                    |   
   0 +-+--------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                          fsmark.time.elapsed_time.max                          
                                                                                
  45 +-+--------------------------------------------------------------------+   
     |                                                                      |   
  40 +-+  +.+.+.+..+.+.+..+.+.+.+..+.+.+..+.+.+..+.+.+.+..+.+.+..+.+.+.+..+.|   
  35 +-+  :                                                                 |   
     |    :                                                                 |   
  30 O-+ :                                                                  |   
  25 +-O :O O O O  O O O  O O O O  O O O  O O O  O O O O  O O               |   
     |   :                                                                  |   
  20 +-+ :                                                                  |   
  15 +-+:                                                                   |   
     |  :                                                                   |   
  10 +-+:                                                                   |   
   5 +-+:                                                                   |   
     | :                                                                    |   
   0 +-+--------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                               fsmark.files_per_sec                             
                                                                                
  300 +-+-------------------------------------------------------------------+   
      |                          O                                          |   
  250 O-O  O O O O  O O O O  O O   O  O O O O  O O O O  O O O               |   
      |                                                                     |   
      |                                                                     |   
  200 +-+                                                                   |   
      |    +.+.+.+..+.+.+.+..+.+.+.+..+.+.+.+..+.+.+.+..+.+.+.+..+.+.+.+..+.|   
  150 +-+  :                                                                |   
      |   :                                                                 |   
  100 +-+ :                                                                 |   
      |   :                                                                 |   
      |  :                                                                  |   
   50 +-+:                                                                  |   
      | :                                                                   |   
    0 +-+-------------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Oliver Sang


View attachment "config-5.2.0-rc7-00048-gd517857" of type "text/plain" (175562 bytes)

View attachment "job-script" of type "text/plain" (7779 bytes)

View attachment "job.yaml" of type "text/plain" (5374 bytes)

View attachment "reproduce" of type "text/plain" (521 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ