lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Message-ID: <20210824141416.GB27667@xsang-OptiPlex-9020>
Date:   Tue, 24 Aug 2021 22:14:17 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Hao Xu <haoxu@...ux.alibaba.com>
Cc:     Jens Axboe <axboe@...nel.dk>, LKML <linux-kernel@...r.kernel.org>,
        lkp@...ts.01.org, lkp@...el.com, ying.huang@...el.com,
        feng.tang@...el.com, zhengjun.xing@...ux.intel.com
Subject: [io]  49e7f0c789:  fio.write_iops 6.5% improvement



Greeting,

FYI, we noticed a 6.5% improvement of fio.write_iops due to commit:


commit: 49e7f0c789add1330b111af0b7caeb0e87df063e ("io-wq: fix bug of creating io-wokers unconditionally")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master


in testcase: fio-basic
on test machine: 192 threads 4 sockets Intel(R) Xeon(R) CPU @ 2.20GHz with 192G memory
with following parameters:

	disk: 1SSD
	fs: btrfs
	runtime: 300s
	nr_task: 8
	rw: randwrite
	bs: 4k
	ioengine: io_uring
	test_size: 256g
	cpufreq_governor: performance
	ucode: 0x4003006

test-description: Fio is a tool that will spawn a number of threads or processes doing a particular type of I/O action as specified by the user.
test-url: https://github.com/axboe/fio





Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install                job.yaml  # job file is attached in this email
        bin/lkp split-job --compatible job.yaml  # generate the yaml file for lkp run
        bin/lkp run                    generated-yaml-file

=========================================================================================
bs/compiler/cpufreq_governor/disk/fs/ioengine/kconfig/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/ucode:
  4k/gcc-9/performance/1SSD/btrfs/io_uring/x86_64-rhel-8.3/8/debian-10.4-x86_64-20200603.cgz/300s/randwrite/lkp-csl-2ap1/256g/fio-basic/0x4003006

commit: 
  4956b9eaad ("io_uring: rsrc ref lock needs to be IRQ safe")
  49e7f0c789 ("io-wq: fix bug of creating io-wokers unconditionally")

4956b9eaad456a88 49e7f0c789add1330b111af0b7c 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
      0.05 ± 13%      -0.0        0.01 ± 21%  fio.latency_100ms%
      3.86 ±  7%      -0.8        3.05 ± 25%  fio.latency_100us%
     59.74 ±  3%      -4.8       54.98 ±  4%  fio.latency_10ms%
      0.03 ± 21%      -0.0        0.01        fio.latency_20us%
     17.26 ±  4%      -7.0       10.29 ± 35%  fio.latency_250us%
      0.01            -0.0        0.00        fio.latency_2us%
      0.01            -0.0        0.00        fio.latency_4us%
      1.65 ±  6%     +10.4       12.01 ± 42%  fio.latency_500us%
      0.57 ±  7%      -0.5        0.10 ± 27%  fio.latency_50ms%
      0.25 ± 20%      -0.1        0.13 ± 30%  fio.latency_750us%
 1.339e+08            +6.5%  1.426e+08 ±  3%  fio.time.file_system_outputs
   1399221 ±  8%     -99.6%       5944 ± 16%  fio.time.involuntary_context_switches
     77553           -68.7%      24263 ± 11%  fio.time.minor_page_faults
    409.83 ±  2%     -27.4%     297.50 ± 15%  fio.time.percent_of_cpu_this_job_got
      1178 ±  2%     -29.9%     825.64 ± 16%  fio.time.system_time
     56.44           +22.6%      69.22 ±  3%  fio.time.user_time
  16736113            +6.5%   17820174 ±  3%  fio.workload
    217.84            +6.5%     232.03 ±  3%  fio.write_bw_MBps
  15269888 ±  4%     -32.9%   10245461 ±  5%  fio.write_clat_99%_us
   4587051            -6.0%    4312390 ±  3%  fio.write_clat_mean_us
  18522537 ±  3%     -10.1%   16652081 ±  6%  fio.write_clat_stddev
     55768            +6.5%      59399 ±  3%  fio.write_iops
      2314           -29.0%       1642 ±  2%  fio.write_slat_mean_us
     64378           -97.9%       1372 ± 19%  fio.write_slat_stddev
     93.81            +3.8%      97.38        iostat.cpu.idle
      6.07 ±  3%     -58.7%       2.51 ±  4%  iostat.cpu.system
      0.15            -0.0        0.11 ±  5%  mpstat.cpu.all.irq%
      0.14 ±  3%      -0.1        0.04 ± 10%  mpstat.cpu.all.soft%
      5.80 ±  3%      -3.4        2.37 ±  4%  mpstat.cpu.all.sys%
    266156            +6.0%     282160 ±  3%  vmstat.io.bo
    239.00 ± 30%     -97.7%       5.50 ±  9%  vmstat.procs.r
    116028           -14.0%      99777        vmstat.system.in
   1233071 ±  3%     -97.2%      34438        meminfo.KernelStack
   4380278           -26.7%    3211647 ±  2%  meminfo.SUnreclaim
   5092429           -23.0%    3922629 ±  2%  meminfo.Slab
   1516197 ±  2%     -78.8%     320788        meminfo.VmallocUsed
      2166 ±  3%     -20.5%       1721        meminfo.Writeback
    306494 ±  2%     -96.5%      10695 ± 14%  numa-meminfo.node0.KernelStack
    688.00 ± 57%     -81.4%     127.83 ± 71%  numa-meminfo.node1.Active(anon)
    311234 ±  5%     -97.6%       7466 ± 11%  numa-meminfo.node1.KernelStack
    288649 ± 11%     -97.3%       7844 ± 11%  numa-meminfo.node2.KernelStack
   1003414 ± 18%     -43.9%     562515 ± 63%  numa-meminfo.node2.SUnreclaim
    329049 ±  9%     -97.4%       8450 ± 21%  numa-meminfo.node3.KernelStack
   9936713 ±  5%     -76.9%    2293578 ±142%  numa-numastat.node1.local_node
   9936855 ±  5%     -76.9%    2293700 ±142%  numa-numastat.node1.numa_hit
   9479455 ± 11%     -54.7%    4297938 ± 66%  numa-numastat.node2.local_node
   9479816 ± 11%     -54.7%    4298406 ± 66%  numa-numastat.node2.numa_hit
    586.50 ± 19%     -55.1%     263.17 ± 45%  numa-numastat.node2.other_node
    472.50 ± 38%     -64.4%     168.00 ± 82%  numa-numastat.node3.other_node
    105.33 ±  4%     -66.1%      35.67 ± 38%  turbostat.Avg_MHz
      7.19 ±  3%      -4.6        2.56 ± 37%  turbostat.Busy%
  10873854 ±  5%     -52.3%    5182215 ± 52%  turbostat.C1E
      2.81 ±  4%      -1.4        1.40 ± 39%  turbostat.C1E%
     50.18 ±  3%     -31.4%      34.42 ± 37%  turbostat.CPU%c1
     42.62 ±  4%     +47.9%      63.03 ± 21%  turbostat.CPU%c6
  17315724 ±  6%     -36.9%   10924425 ± 42%  turbostat.IRQ
     21.30 ± 23%    +291.9%      83.47 ± 52%  turbostat.Pkg%pc2
    119.72           -16.6%      99.81 ±  9%  turbostat.PkgWatt
    305449 ±  2%     -96.5%      10693 ± 14%  numa-vmstat.node0.nr_kernel_stack
    171.50 ± 57%     -81.6%      31.50 ± 72%  numa-vmstat.node1.nr_active_anon
    310666 ±  5%     -97.6%       7464 ± 11%  numa-vmstat.node1.nr_kernel_stack
    171.50 ± 57%     -81.6%      31.50 ± 72%  numa-vmstat.node1.nr_zone_active_anon
   5228773 ±  9%     -69.1%    1615960 ±107%  numa-vmstat.node1.numa_hit
   5218279 ±  9%     -69.2%    1605806 ±107%  numa-vmstat.node1.numa_local
    287601 ± 11%     -97.3%       7841 ± 11%  numa-vmstat.node2.nr_kernel_stack
    250835 ± 18%     -43.9%     140762 ± 63%  numa-vmstat.node2.nr_slab_unreclaimable
   5194508 ± 17%     -50.5%    2571450 ± 64%  numa-vmstat.node2.numa_hit
   5183184 ± 17%     -50.6%    2561990 ± 65%  numa-vmstat.node2.numa_local
    328244 ±  9%     -97.4%       8447 ± 21%  numa-vmstat.node3.nr_kernel_stack
  20705401            +6.3%   22007142 ±  3%  proc-vmstat.nr_dirtied
    455629            +3.6%     472088 ±  2%  proc-vmstat.nr_dirty
   4677015            +1.2%    4734237        proc-vmstat.nr_dirty_background_threshold
   9365467            +1.2%    9480050        proc-vmstat.nr_dirty_threshold
  10179299            +6.0%   10791700 ±  3%  proc-vmstat.nr_file_pages
   8641718            +6.4%    9193417 ±  3%  proc-vmstat.nr_inactive_file
   1231898 ±  3%     -97.2%      34449        proc-vmstat.nr_kernel_stack
   1095036           -26.7%     803065 ±  2%  proc-vmstat.nr_slab_unreclaimable
    551.67 ±  3%     -20.6%     438.17        proc-vmstat.nr_writeback
  20126821            +6.0%   21339414 ±  3%  proc-vmstat.nr_written
   8641718            +6.4%    9193418 ±  3%  proc-vmstat.nr_zone_inactive_file
    456256            +3.6%     472608 ±  2%  proc-vmstat.nr_zone_write_pending
     73885 ±  3%     -71.2%      21271 ± 14%  proc-vmstat.numa_hint_faults
     55528 ±  5%     -71.3%      15920 ± 16%  proc-vmstat.numa_hint_faults_local
  41199082 ±  2%     -52.2%   19704059 ± 14%  proc-vmstat.numa_hit
  41197887 ±  2%     -52.2%   19711757 ± 14%  proc-vmstat.numa_local
     93747 ± 20%     -50.2%      46700 ± 17%  proc-vmstat.numa_pte_updates
  41201950 ±  2%     -47.6%   21574441 ±  2%  proc-vmstat.pgalloc_normal
   1267460            -4.0%    1217143        proc-vmstat.pgfault
  21880105 ±  3%     -95.2%    1052708        proc-vmstat.pgfree
  80510442            +6.0%   85359836 ±  3%  proc-vmstat.pgpgout
      2456 ± 12%     +20.0%       2946 ± 14%  slabinfo.PING.active_objs
      2456 ± 12%     +20.0%       2946 ± 14%  slabinfo.PING.num_objs
      3066 ±  2%     -42.2%       1771 ± 19%  slabinfo.biovec-max.active_objs
    401.67 ±  2%     -42.2%     232.17 ± 19%  slabinfo.biovec-max.active_slabs
      3217 ±  2%     -42.1%       1861 ± 19%  slabinfo.biovec-max.num_objs
    401.67 ±  2%     -42.2%     232.17 ± 19%  slabinfo.biovec-max.num_slabs
     31652 ±  9%     -27.8%      22839 ± 14%  slabinfo.btrfs_delayed_tree_ref.active_objs
    846.00 ±  9%     -27.0%     618.00 ± 14%  slabinfo.btrfs_delayed_tree_ref.active_slabs
     33009 ±  9%     -26.9%      24123 ± 14%  slabinfo.btrfs_delayed_tree_ref.num_objs
    846.00 ±  9%     -27.0%     618.00 ± 14%  slabinfo.btrfs_delayed_tree_ref.num_slabs
     42626 ±  2%     -48.2%      22100 ± 20%  slabinfo.btrfs_ordered_extent.active_objs
      1160 ±  2%     -48.3%     600.50 ± 20%  slabinfo.btrfs_ordered_extent.active_slabs
     42968 ±  2%     -48.2%      22239 ± 20%  slabinfo.btrfs_ordered_extent.num_objs
      1160 ±  2%     -48.3%     600.50 ± 20%  slabinfo.btrfs_ordered_extent.num_slabs
      8211           -23.3%       6301 ± 17%  slabinfo.buffer_head.active_objs
      8211           -23.3%       6301 ± 17%  slabinfo.buffer_head.num_objs
      6779 ±  7%     -30.2%       4735 ± 11%  slabinfo.files_cache.active_objs
      6779 ±  7%     -30.2%       4735 ± 11%  slabinfo.files_cache.num_objs
     74707 ±  4%     -34.8%      48731 ± 17%  slabinfo.fsnotify_mark_connector.active_objs
    592.33 ±  4%     -34.9%     385.33 ± 17%  slabinfo.fsnotify_mark_connector.active_slabs
     75902 ±  4%     -34.9%      49395 ± 17%  slabinfo.fsnotify_mark_connector.num_objs
    592.33 ±  4%     -34.9%     385.33 ± 17%  slabinfo.fsnotify_mark_connector.num_slabs
    150767 ±  2%     -77.8%      33494 ±  3%  slabinfo.kmalloc-128.active_objs
      2375 ±  2%     -77.9%     524.83 ±  3%  slabinfo.kmalloc-128.active_slabs
    152040 ±  2%     -77.9%      33616 ±  3%  slabinfo.kmalloc-128.num_objs
      2375 ±  2%     -77.9%     524.83 ±  3%  slabinfo.kmalloc-128.num_slabs
     63523 ±  7%     -74.0%      16500 ± 36%  slabinfo.kmalloc-192.active_objs
      1515 ±  7%     -73.8%     397.00 ± 36%  slabinfo.kmalloc-192.active_slabs
     63658 ±  7%     -73.8%      16696 ± 36%  slabinfo.kmalloc-192.num_objs
      1515 ±  7%     -73.8%     397.00 ± 36%  slabinfo.kmalloc-192.num_slabs
    473410           -70.9%     137824        slabinfo.kmalloc-32.active_objs
      3717           -70.9%       1080        slabinfo.kmalloc-32.active_slabs
    475867           -70.9%     138306        slabinfo.kmalloc-32.num_objs
      3717           -70.9%       1080        slabinfo.kmalloc-32.num_slabs
    254377 ±  2%     -58.9%     104504 ±  2%  slabinfo.kmalloc-64.active_objs
      3993 ±  2%     -59.1%       1635 ±  2%  slabinfo.kmalloc-64.active_slabs
    255597 ±  2%     -59.0%     104686 ±  2%  slabinfo.kmalloc-64.num_objs
      3993 ±  2%     -59.1%       1635 ±  2%  slabinfo.kmalloc-64.num_slabs
    413431           -75.2%     102570        slabinfo.kmalloc-8.active_objs
    809.00           -74.3%     207.83 ±  2%  slabinfo.kmalloc-8.active_slabs
    414373           -74.2%     106772 ±  2%  slabinfo.kmalloc-8.num_objs
    809.00           -74.3%     207.83 ±  2%  slabinfo.kmalloc-8.num_slabs
      5281 ±  8%     -40.0%       3169 ± 17%  slabinfo.kmalloc-cg-192.active_objs
      5281 ±  8%     -40.0%       3169 ± 17%  slabinfo.kmalloc-cg-192.num_objs
      4601 ±  8%     -32.7%       3097 ± 12%  slabinfo.kmalloc-cg-1k.active_objs
      4611 ±  8%     -32.8%       3098 ± 12%  slabinfo.kmalloc-cg-1k.num_objs
      1499 ±  8%     +15.6%       1734 ±  3%  slabinfo.kmalloc-cg-64.active_objs
      1499 ±  8%     +15.6%       1734 ±  3%  slabinfo.kmalloc-cg-64.num_objs
      5437 ±  3%     -21.7%       4258 ± 14%  slabinfo.mm_struct.active_objs
      5437 ±  3%     -21.7%       4258 ± 14%  slabinfo.mm_struct.num_objs
     41256 ±  4%     -44.0%      23115 ± 18%  slabinfo.mnt_cache.active_objs
    816.67 ±  4%     -44.2%     455.83 ± 17%  slabinfo.mnt_cache.active_slabs
     41674 ±  4%     -44.2%      23268 ± 17%  slabinfo.mnt_cache.num_objs
    816.67 ±  4%     -44.2%     455.83 ± 17%  slabinfo.mnt_cache.num_slabs
     15207 ±  4%     -30.9%      10513 ± 16%  slabinfo.pde_opener.active_objs
     15207 ±  4%     -30.9%      10513 ± 16%  slabinfo.pde_opener.num_objs
    189783 ±  2%     -93.0%      13332 ±  3%  slabinfo.pid.active_objs
      2968 ±  2%     -93.0%     207.67 ±  3%  slabinfo.pid.active_slabs
    190011 ±  2%     -93.0%      13332 ±  3%  slabinfo.pid.num_objs
      2968 ±  2%     -93.0%     207.67 ±  3%  slabinfo.pid.num_slabs
     13191            -9.7%      11916 ±  4%  slabinfo.proc_inode_cache.active_objs
     13191            -9.7%      11916 ±  4%  slabinfo.proc_inode_cache.num_objs
      3939 ±  3%     -17.0%       3270 ±  5%  slabinfo.sighand_cache.active_objs
      3945 ±  3%     -16.3%       3303 ±  5%  slabinfo.sighand_cache.num_objs
      7171 ±  3%     -10.2%       6437 ±  6%  slabinfo.signal_cache.active_objs
      7225 ±  3%     -10.8%       6445 ±  6%  slabinfo.signal_cache.num_objs
     77785 ±  3%     -96.6%       2629        slabinfo.task_struct.active_objs
     77789 ±  3%     -96.6%       2643        slabinfo.task_struct.active_slabs
     77789 ±  3%     -96.6%       2643        slabinfo.task_struct.num_objs
     77789 ±  3%     -96.6%       2643        slabinfo.task_struct.num_slabs
      5752 ±  2%     -14.5%       4917 ±  5%  slabinfo.trace_event_file.active_objs
      5857 ±  2%     -14.8%       4988 ±  6%  slabinfo.trace_event_file.num_objs
    174574 ±  2%     -81.8%      31777        slabinfo.vmap_area.active_objs
      4179 ±  3%     -88.1%     497.67        slabinfo.vmap_area.active_slabs
    267512 ±  3%     -88.1%      31895        slabinfo.vmap_area.num_objs
      4179 ±  3%     -88.1%     497.67        slabinfo.vmap_area.num_slabs
     10531 ±141%     -94.9%     534.83 ±157%  softirqs.CPU12.NET_RX
     14547 ±  4%     -64.8%       5117 ±113%  softirqs.CPU123.RCU
     15217 ±  3%     -55.1%       6829 ± 85%  softirqs.CPU123.SCHED
     14546 ±  4%     -64.4%       5174 ±111%  softirqs.CPU124.RCU
     15266 ±  3%     -57.1%       6551 ± 82%  softirqs.CPU124.SCHED
     14620 ±  5%     -63.7%       5306 ±106%  softirqs.CPU125.RCU
     15419 ±  3%     -57.2%       6596 ± 82%  softirqs.CPU125.SCHED
     15752 ±  4%     -58.1%       6593 ± 82%  softirqs.CPU126.SCHED
     14453 ±  4%     -65.4%       4999 ±111%  softirqs.CPU127.RCU
     14649 ±  4%     -66.6%       4890 ±111%  softirqs.CPU128.RCU
     15105 ±  3%     -56.8%       6531 ± 80%  softirqs.CPU128.SCHED
     14879 ±  7%     -67.1%       4899 ±112%  softirqs.CPU129.RCU
     14978 ±  2%     -55.7%       6633 ± 81%  softirqs.CPU129.SCHED
     14645 ±  3%     -65.8%       5012 ±114%  softirqs.CPU130.RCU
     15351 ±  3%     -55.5%       6833 ± 84%  softirqs.CPU130.SCHED
     14766 ±  5%     -64.8%       5191 ±115%  softirqs.CPU131.RCU
     14583 ±  3%     -66.5%       4891 ±113%  softirqs.CPU134.RCU
     14495 ±  4%     -66.3%       4878 ±113%  softirqs.CPU135.RCU
     14370 ±  4%     -66.9%       4761 ±114%  softirqs.CPU136.RCU
     14991 ±  3%     -58.1%       6274 ± 79%  softirqs.CPU136.SCHED
     14717 ±  4%     -68.4%       4647 ±111%  softirqs.CPU137.RCU
     15103 ±  4%     -57.3%       6443 ± 79%  softirqs.CPU137.SCHED
     14623 ±  3%     -68.2%       4650 ±112%  softirqs.CPU138.RCU
     15095 ±  2%     -57.9%       6352 ± 78%  softirqs.CPU138.SCHED
     14411 ±  3%     -68.0%       4615 ±115%  softirqs.CPU139.RCU
     14567 ±  4%     -65.4%       5046 ±105%  softirqs.CPU140.RCU
     15355 ±  6%     -56.8%       6638 ± 80%  softirqs.CPU140.SCHED
     14745 ±  2%     -57.6%       6247 ± 79%  softirqs.CPU141.SCHED
     14389 ±  4%     -67.0%       4742 ±112%  softirqs.CPU142.RCU
     14516 ±  5%     -66.4%       4880 ±108%  softirqs.CPU143.RCU
     15071 ±  3%     -57.3%       6437 ± 79%  softirqs.CPU143.SCHED
     14881 ±  8%     -37.9%       9236 ± 44%  softirqs.CPU147.SCHED
     14488 ± 11%     -40.4%       8637 ± 51%  softirqs.CPU148.RCU
     15145 ±  9%     -37.1%       9526 ± 40%  softirqs.CPU148.SCHED
     14730 ± 12%     -38.6%       9043 ± 49%  softirqs.CPU152.RCU
     14455 ± 11%     -41.0%       8523 ± 53%  softirqs.CPU153.RCU
     14334 ± 10%     -37.9%       8907 ± 46%  softirqs.CPU154.RCU
     14563 ± 11%     -35.7%       9367 ± 46%  softirqs.CPU155.RCU
     14452 ± 10%     -41.5%       8458 ± 54%  softirqs.CPU156.RCU
     14381 ± 11%     -38.7%       8812 ± 49%  softirqs.CPU157.RCU
     14377 ± 10%     -37.3%       9021 ± 47%  softirqs.CPU158.RCU
     14660 ± 10%     -42.6%       8410 ± 54%  softirqs.CPU159.RCU
     14047 ± 13%     -39.4%       8508 ± 48%  softirqs.CPU160.RCU
     13823 ± 11%     -36.4%       8789 ± 50%  softirqs.CPU162.RCU
     13810 ± 11%     -38.0%       8563 ± 47%  softirqs.CPU163.RCU
     13952 ± 11%     -36.8%       8815 ± 47%  softirqs.CPU164.RCU
     13860 ± 10%     -38.7%       8498 ± 45%  softirqs.CPU165.RCU
     14959 ±  9%     -32.5%      10099 ± 41%  softirqs.CPU165.SCHED
     13364 ±  4%     -64.3%       4768 ±104%  softirqs.CPU27.RCU
     13707 ±  3%     -57.7%       5797 ± 72%  softirqs.CPU27.SCHED
     13172 ±  5%     -66.6%       4402 ±102%  softirqs.CPU28.RCU
     13555 ±  4%     -59.9%       5433 ± 69%  softirqs.CPU28.SCHED
     13171 ±  5%     -64.0%       4735 ±103%  softirqs.CPU29.RCU
     13744 ±  5%     -57.6%       5829 ± 73%  softirqs.CPU29.SCHED
     13465 ±  8%     -63.3%       4939 ± 98%  softirqs.CPU30.RCU
     13774 ±  4%     -58.8%       5677 ± 74%  softirqs.CPU30.SCHED
     13209 ±  4%     -64.5%       4687 ±104%  softirqs.CPU31.RCU
     13569 ±  4%     -58.7%       5603 ± 71%  softirqs.CPU31.SCHED
     13473 ±  4%     -64.9%       4723 ±105%  softirqs.CPU32.RCU
     13421 ±  3%     -57.6%       5691 ± 73%  softirqs.CPU32.SCHED
     13455 ±  2%     -57.6%       5711 ± 73%  softirqs.CPU33.SCHED
     13518 ±  7%     -64.0%       4860 ±102%  softirqs.CPU34.RCU
     13345 ±  4%     -55.6%       5927 ± 74%  softirqs.CPU34.SCHED
     13341 ±  4%     -55.6%       5920 ± 79%  softirqs.CPU36.SCHED
     13732 ±  5%     -64.2%       4916 ±112%  softirqs.CPU45.RCU
     13645 ±  4%     -55.4%       6080 ± 81%  softirqs.CPU45.SCHED
     13762 ±  2%     -56.1%       6046 ± 79%  softirqs.CPU46.SCHED
     13872 ±  4%     -63.1%       5114 ±109%  softirqs.CPU47.RCU
     13452 ± 10%     -35.6%       8662 ± 43%  softirqs.CPU50.RCU
     13169 ± 10%     -32.1%       8936 ± 40%  softirqs.CPU52.RCU
     13417 ±  9%     -36.0%       8591 ± 41%  softirqs.CPU54.RCU
     13336 ± 11%     -34.0%       8800 ± 37%  softirqs.CPU55.RCU
     13624 ±  8%     -31.9%       9282 ± 33%  softirqs.CPU55.SCHED
     12903 ±  9%     -35.2%       8356 ± 39%  softirqs.CPU57.RCU
     12886 ±  8%     -32.8%       8661 ± 37%  softirqs.CPU58.RCU
     12899 ±  9%     -31.6%       8821 ± 39%  softirqs.CPU59.RCU
     12868 ±  9%     -33.2%       8599 ± 37%  softirqs.CPU62.RCU
     13316 ±  7%     -35.3%       8610 ± 32%  softirqs.CPU62.SCHED
     12813 ± 10%     -32.9%       8600 ± 37%  softirqs.CPU63.RCU
     13036 ±  7%     -32.4%       8812 ± 33%  softirqs.CPU63.SCHED
     13099 ± 11%     -37.6%       8178 ± 46%  softirqs.CPU70.RCU
     13551 ±  7%     -35.8%       8704 ± 38%  softirqs.CPU70.SCHED
   2820557 ±  2%     -30.8%    1951127 ±  4%  softirqs.RCU
   2928365           -26.2%    2162292 ±  5%  softirqs.SCHED
    182814           -60.4%      72343 ±  5%  softirqs.TIMER
     20875 ±142%     -95.6%     928.50 ±166%  interrupts.33:PCI-MSI.524291-edge.eth0-TxRx-2
     16010 ± 17%     +47.1%      23545 ±  9%  interrupts.CPU101.CAL:Function_call_interrupts
     17863 ± 18%     +41.1%      25197 ± 22%  interrupts.CPU102.CAL:Function_call_interrupts
     17527 ± 15%     +72.4%      30208 ± 47%  interrupts.CPU102.RES:Rescheduling_interrupts
     17185 ± 19%     +83.9%      31604 ± 57%  interrupts.CPU104.RES:Rescheduling_interrupts
     16777 ± 15%     +90.7%      32001 ± 64%  interrupts.CPU105.RES:Rescheduling_interrupts
     16214 ± 12%     +46.3%      23725 ± 25%  interrupts.CPU106.CAL:Function_call_interrupts
     17396 ± 17%    +104.7%      35607 ± 53%  interrupts.CPU106.RES:Rescheduling_interrupts
     15952 ± 17%     +83.0%      29195 ± 22%  interrupts.CPU107.CAL:Function_call_interrupts
     17502 ± 17%    +109.5%      36664 ± 54%  interrupts.CPU107.RES:Rescheduling_interrupts
     16424 ± 17%     +81.8%      29867 ± 26%  interrupts.CPU108.CAL:Function_call_interrupts
     17388 ± 16%     +98.7%      34556 ± 65%  interrupts.CPU108.RES:Rescheduling_interrupts
     17067 ± 18%     +71.8%      29328 ± 27%  interrupts.CPU109.CAL:Function_call_interrupts
     17034 ± 19%    +126.1%      38521 ± 64%  interrupts.CPU109.RES:Rescheduling_interrupts
     17854 ± 19%    +117.1%      38753 ± 66%  interrupts.CPU110.RES:Rescheduling_interrupts
     16796 ± 15%     +96.1%      32938 ± 31%  interrupts.CPU111.CAL:Function_call_interrupts
     17093 ± 19%    +122.4%      38010 ± 61%  interrupts.CPU111.RES:Rescheduling_interrupts
     15940 ± 18%    +133.4%      37204 ± 74%  interrupts.CPU112.RES:Rescheduling_interrupts
     16261 ± 14%     +78.8%      29072 ± 45%  interrupts.CPU113.CAL:Function_call_interrupts
     16231 ± 17%    +134.1%      37991 ± 61%  interrupts.CPU113.RES:Rescheduling_interrupts
     17040 ± 15%     +69.4%      28874 ± 39%  interrupts.CPU114.CAL:Function_call_interrupts
     16118 ± 18%    +137.5%      38284 ± 64%  interrupts.CPU114.RES:Rescheduling_interrupts
     16851 ± 16%     +95.3%      32910 ± 27%  interrupts.CPU115.CAL:Function_call_interrupts
     15843 ± 17%    +136.4%      37459 ± 64%  interrupts.CPU115.RES:Rescheduling_interrupts
     16407 ± 16%     +79.8%      29494 ± 45%  interrupts.CPU116.CAL:Function_call_interrupts
     15713 ± 18%    +138.3%      37449 ± 73%  interrupts.CPU116.RES:Rescheduling_interrupts
     15164 ± 17%    +133.7%      35446 ± 77%  interrupts.CPU117.RES:Rescheduling_interrupts
     14807 ± 15%     +84.5%      27317 ± 43%  interrupts.CPU118.CAL:Function_call_interrupts
     15494 ± 15%    +145.8%      38082 ± 67%  interrupts.CPU118.RES:Rescheduling_interrupts
     16016 ± 20%     +70.4%      27297 ± 46%  interrupts.CPU119.CAL:Function_call_interrupts
     20875 ±142%     -95.6%     928.50 ±166%  interrupts.CPU12.33:PCI-MSI.524291-edge.eth0-TxRx-2
     72427 ±  3%     -71.7%      20475 ±114%  interrupts.CPU120.LOC:Local_timer_interrupts
     73052 ±  3%     -73.1%      19654 ±135%  interrupts.CPU121.LOC:Local_timer_interrupts
     75077 ±  2%     -73.2%      20098 ±133%  interrupts.CPU122.LOC:Local_timer_interrupts
     74218 ±  3%     -72.0%      20810 ±134%  interrupts.CPU123.LOC:Local_timer_interrupts
     74924 ±  2%     -74.5%      19091 ±128%  interrupts.CPU124.LOC:Local_timer_interrupts
     75511 ±  4%     -76.0%      18105 ±133%  interrupts.CPU125.LOC:Local_timer_interrupts
     74836 ±  2%     -76.3%      17719 ±132%  interrupts.CPU126.LOC:Local_timer_interrupts
     74821 ±  2%     -77.3%      17000 ±134%  interrupts.CPU127.LOC:Local_timer_interrupts
     73994 ±  3%     -76.6%      17296 ±129%  interrupts.CPU128.LOC:Local_timer_interrupts
     73972 ±  2%     -77.2%      16879 ±130%  interrupts.CPU129.LOC:Local_timer_interrupts
     13157 ± 14%     +32.4%      17419 ± 17%  interrupts.CPU13.CAL:Function_call_interrupts
      6007 ± 11%     +95.1%      11723 ± 58%  interrupts.CPU13.RES:Rescheduling_interrupts
     74693 ±  2%     -76.2%      17812 ±133%  interrupts.CPU130.LOC:Local_timer_interrupts
     74648 ±  4%     -75.7%      18175 ±133%  interrupts.CPU131.LOC:Local_timer_interrupts
     74852 ±  3%     -74.3%      19252 ±130%  interrupts.CPU132.LOC:Local_timer_interrupts
     74104 ±  2%     -75.0%      18498 ±133%  interrupts.CPU133.LOC:Local_timer_interrupts
     74126           -75.6%      18063 ±134%  interrupts.CPU134.LOC:Local_timer_interrupts
     73295 ±  2%     -76.0%      17586 ±133%  interrupts.CPU135.LOC:Local_timer_interrupts
     73035 ±  3%     -72.6%      20008 ±135%  interrupts.CPU136.LOC:Local_timer_interrupts
     74365 ±  4%     -79.0%      15622 ±133%  interrupts.CPU137.LOC:Local_timer_interrupts
     73455 ±  2%     -78.0%      16140 ±131%  interrupts.CPU138.LOC:Local_timer_interrupts
     72090           -77.1%      16519 ±135%  interrupts.CPU139.LOC:Local_timer_interrupts
     73629 ±  2%     -75.9%      17731 ±131%  interrupts.CPU140.LOC:Local_timer_interrupts
     72093 ±  2%     -77.5%      16251 ±133%  interrupts.CPU141.LOC:Local_timer_interrupts
     72806 ±  2%     -77.5%      16410 ±132%  interrupts.CPU142.LOC:Local_timer_interrupts
     73033 ±  3%     -77.1%      16756 ±131%  interrupts.CPU143.LOC:Local_timer_interrupts
     72181 ±  7%     -54.3%      32968 ± 44%  interrupts.CPU144.LOC:Local_timer_interrupts
     72845 ± 10%     -56.3%      31816 ± 52%  interrupts.CPU145.LOC:Local_timer_interrupts
     73265 ±  9%     -59.3%      29809 ± 54%  interrupts.CPU146.LOC:Local_timer_interrupts
     72857 ±  8%     -60.2%      28965 ± 59%  interrupts.CPU147.LOC:Local_timer_interrupts
     73391 ± 10%     -58.1%      30724 ± 54%  interrupts.CPU148.LOC:Local_timer_interrupts
     74557 ±  6%     -47.3%      39275 ± 52%  interrupts.CPU149.LOC:Local_timer_interrupts
     73259 ±  8%     -57.4%      31201 ± 60%  interrupts.CPU150.LOC:Local_timer_interrupts
     73874 ±  9%     -54.9%      33323 ± 60%  interrupts.CPU151.LOC:Local_timer_interrupts
     74681 ± 10%     -56.8%      32229 ± 55%  interrupts.CPU152.LOC:Local_timer_interrupts
     74665 ± 10%     -55.7%      33084 ± 56%  interrupts.CPU153.LOC:Local_timer_interrupts
     73867 ±  9%     -56.6%      32062 ± 57%  interrupts.CPU154.LOC:Local_timer_interrupts
     73962 ±  8%     -50.5%      36597 ± 47%  interrupts.CPU155.LOC:Local_timer_interrupts
     74510 ±  8%     -58.5%      30891 ± 63%  interrupts.CPU156.LOC:Local_timer_interrupts
     73802 ±  8%     -57.7%      31196 ± 61%  interrupts.CPU157.LOC:Local_timer_interrupts
     73839 ±  9%     -54.4%      33690 ± 59%  interrupts.CPU158.LOC:Local_timer_interrupts
     75092 ±  9%     -58.7%      30991 ± 64%  interrupts.CPU159.LOC:Local_timer_interrupts
     73923 ±  9%     -56.1%      32453 ± 54%  interrupts.CPU160.LOC:Local_timer_interrupts
     73316 ± 10%     -55.4%      32707 ± 61%  interrupts.CPU161.LOC:Local_timer_interrupts
     73491 ±  9%     -54.6%      33372 ± 57%  interrupts.CPU162.LOC:Local_timer_interrupts
     73621 ± 11%     -56.4%      32089 ± 58%  interrupts.CPU163.LOC:Local_timer_interrupts
     73539 ±  8%     -55.4%      32822 ± 58%  interrupts.CPU164.LOC:Local_timer_interrupts
     72951 ±  9%     -56.1%      32047 ± 56%  interrupts.CPU165.LOC:Local_timer_interrupts
     72166 ± 10%     -56.4%      31460 ± 56%  interrupts.CPU166.LOC:Local_timer_interrupts
     72963 ± 11%     -54.2%      33406 ± 56%  interrupts.CPU167.LOC:Local_timer_interrupts
     73475 ±  3%     -75.2%      18251 ±120%  interrupts.CPU24.LOC:Local_timer_interrupts
     70205 ±  2%     -77.1%      16105 ±139%  interrupts.CPU26.LOC:Local_timer_interrupts
     68005 ±  2%     -80.0%      13630 ±127%  interrupts.CPU27.LOC:Local_timer_interrupts
     66077 ±  4%     -82.0%      11915 ±130%  interrupts.CPU28.LOC:Local_timer_interrupts
     66181 ±  3%     -81.1%      12538 ±122%  interrupts.CPU29.LOC:Local_timer_interrupts
     66238 ±  3%     -80.7%      12752 ±133%  interrupts.CPU30.LOC:Local_timer_interrupts
     65953 ±  3%     -81.3%      12353 ±131%  interrupts.CPU31.LOC:Local_timer_interrupts
     65886 ±  4%     -80.2%      13070 ±132%  interrupts.CPU32.LOC:Local_timer_interrupts
     66328 ±  2%     -79.3%      13703 ±145%  interrupts.CPU33.LOC:Local_timer_interrupts
     64962 ±  3%     -76.7%      15125 ±122%  interrupts.CPU34.LOC:Local_timer_interrupts
     64685 ±  2%     -77.7%      14397 ±139%  interrupts.CPU35.LOC:Local_timer_interrupts
     65119 ±  3%     -78.3%      14153 ±139%  interrupts.CPU36.LOC:Local_timer_interrupts
     64116 ±  4%     -74.4%      16427 ±137%  interrupts.CPU37.LOC:Local_timer_interrupts
     64913 ±  3%     -72.7%      17708 ±141%  interrupts.CPU38.LOC:Local_timer_interrupts
     65303 ±  3%     -74.1%      16881 ±140%  interrupts.CPU39.LOC:Local_timer_interrupts
     65009 ±  4%     -79.1%      13593 ±146%  interrupts.CPU40.LOC:Local_timer_interrupts
     65844 ±  3%     -72.9%      17867 ±139%  interrupts.CPU43.LOC:Local_timer_interrupts
     66450 ±  3%     -74.3%      17053 ±136%  interrupts.CPU44.LOC:Local_timer_interrupts
     66983 ±  3%     -74.5%      17070 ±138%  interrupts.CPU45.LOC:Local_timer_interrupts
     66800 ±  2%     -77.1%      15294 ±137%  interrupts.CPU46.LOC:Local_timer_interrupts
     67329 ±  2%     -76.5%      15817 ±138%  interrupts.CPU47.LOC:Local_timer_interrupts
     73052 ±  9%     -49.7%      36725 ± 50%  interrupts.CPU48.LOC:Local_timer_interrupts
     68385 ±  8%     -52.2%      32657 ± 56%  interrupts.CPU49.LOC:Local_timer_interrupts
     14015 ± 11%     +72.3%      24147 ± 43%  interrupts.CPU5.CAL:Function_call_interrupts
     67240 ±  8%     -54.2%      30777 ± 54%  interrupts.CPU50.LOC:Local_timer_interrupts
     67409 ±  7%     -48.7%      34548 ± 43%  interrupts.CPU51.LOC:Local_timer_interrupts
     65839 ±  8%     -53.3%      30714 ± 49%  interrupts.CPU52.LOC:Local_timer_interrupts
     67648 ±  7%     -58.4%      28153 ± 51%  interrupts.CPU53.LOC:Local_timer_interrupts
     67836 ±  7%     -59.4%      27537 ± 53%  interrupts.CPU54.LOC:Local_timer_interrupts
     65796 ±  8%     -57.6%      27913 ± 43%  interrupts.CPU55.LOC:Local_timer_interrupts
     64730 ±  9%     -55.9%      28569 ± 41%  interrupts.CPU56.LOC:Local_timer_interrupts
     64616 ±  8%     -58.6%      26724 ± 45%  interrupts.CPU57.LOC:Local_timer_interrupts
     64181 ±  7%     -54.4%      29264 ± 33%  interrupts.CPU58.LOC:Local_timer_interrupts
     63750 ±  6%     -55.6%      28334 ± 37%  interrupts.CPU59.LOC:Local_timer_interrupts
      6159 ± 12%     +79.5%      11057 ± 55%  interrupts.CPU6.RES:Rescheduling_interrupts
     63719 ±  8%     -49.8%      31958 ± 29%  interrupts.CPU60.LOC:Local_timer_interrupts
     63149 ±  8%     -54.0%      29028 ± 44%  interrupts.CPU61.LOC:Local_timer_interrupts
     64562 ±  7%     -59.7%      26017 ± 42%  interrupts.CPU62.LOC:Local_timer_interrupts
     62870 ±  8%     -59.1%      25711 ± 46%  interrupts.CPU63.LOC:Local_timer_interrupts
     63250 ±  8%     -59.2%      25800 ± 51%  interrupts.CPU64.LOC:Local_timer_interrupts
     64252 ± 10%     -56.7%      27827 ± 48%  interrupts.CPU65.LOC:Local_timer_interrupts
     64266 ±  7%     -57.9%      27071 ± 56%  interrupts.CPU66.LOC:Local_timer_interrupts
     64679 ±  8%     -60.4%      25597 ± 58%  interrupts.CPU67.LOC:Local_timer_interrupts
     64523 ±  8%     -55.1%      28970 ± 59%  interrupts.CPU68.LOC:Local_timer_interrupts
     64860 ±  8%     -59.5%      26244 ± 51%  interrupts.CPU69.LOC:Local_timer_interrupts
     65999 ±  7%     -62.0%      25048 ± 53%  interrupts.CPU70.LOC:Local_timer_interrupts
     66372 ±  8%     -59.9%      26642 ± 51%  interrupts.CPU71.LOC:Local_timer_interrupts
     69485 ±  7%     -50.4%      34481 ± 53%  interrupts.CPU84.LOC:Local_timer_interrupts
     68752 ±  7%     -50.3%      34173 ± 54%  interrupts.CPU86.LOC:Local_timer_interrupts
     70141 ±  5%     -51.1%      34264 ± 54%  interrupts.CPU89.LOC:Local_timer_interrupts
     70623 ±  7%     -53.1%      33113 ± 55%  interrupts.CPU90.LOC:Local_timer_interrupts
     71194 ±  6%     -57.4%      30316 ± 64%  interrupts.CPU92.LOC:Local_timer_interrupts
     16189 ± 17%     +69.7%      27479 ± 45%  interrupts.CPU99.RES:Rescheduling_interrupts
  14165420           -47.3%    7469656 ±  3%  interrupts.LOC:Local_timer_interrupts
   2073280           +24.7%    2584771 ±  4%  interrupts.RES:Rescheduling_interrupts


                                                                                
                                   fio.write_iops                               
                                                                                
  65000 +-------------------------------------------------------------------+   
  64000 |-+           O                                                     |   
        |                                                       O           |   
  63000 |-+                                                                 |   
  62000 |-+                       O                                         |   
  61000 |-+                                                                 |   
  60000 |-+             O      O                                   O        |   
        | O    O    O                         O      O                      |   
  59000 |-+                  O      O O  O      O      O O                O |   
  58000 |-+  O   O         O               O      O         O O      O O    |   
  57000 |-+                                                     +..         |   
  56000 |-+             +.. .+.                  .+..+.    .+. +   +.       |   
        |.+..      .+. +   +   +.. .+.+..+.+..+.+      +.+.   +      +.+.. .|   
  55000 |-+   .+.+.   +           +                                       + |   
  54000 +-------------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


---
0DAY/LKP+ Test Infrastructure                   Open Source Technology Center
https://lists.01.org/hyperkitty/list/lkp@lists.01.org       Intel Corporation

Thanks,
Oliver Sang


View attachment "config-5.14.0-rc1-00020-g49e7f0c789ad" of type "text/plain" (175522 bytes)

View attachment "job-script" of type "text/plain" (8179 bytes)

View attachment "job.yaml" of type "text/plain" (5598 bytes)

View attachment "reproduce" of type "text/plain" (741 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ