lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Message-ID: <20201215093333.GJ67148@shao2-debian>
Date:   Tue, 15 Dec 2020 17:33:33 +0800
From:   kernel test robot <rong.a.chen@...el.com>
To:     Giovanni Cabiddu <giovanni.cabiddu@...el.com>
Cc:     Herbert Xu <herbert@...dor.apana.org.au>,
        Fiona Trahe <fiona.trahe@...el.com>,
        Andy Shevchenko <andriy.shevchenko@...el.com>,
        LKML <linux-kernel@...r.kernel.org>, lkp@...ts.01.org,
        lkp@...el.com, ying.huang@...el.com, feng.tang@...el.com,
        zhengjun.xing@...el.com
Subject: [crypto] daf88f3757: fio.write_iops 5.9% improvement

Greeting,

FYI, we noticed a 5.9% improvement of fio.write_iops due to commit:


commit: daf88f3757ecb7aed4dd05a1ca8c8b4ac378d6c3 ("crypto: qat - remove unused function")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master


in testcase: fio-basic
on test machine: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 256G memory
with following parameters:

	disk: 2pmem
	fs: xfs
	mount_option: dax
	runtime: 200s
	nr_task: 50%
	time_based: tb
	rw: write
	bs: 4k
	ioengine: mmap
	test_size: 200G
	cpufreq_governor: performance
	ucode: 0x5003003

test-description: Fio is a tool that will spawn a number of threads or processes doing a particular type of I/O action as specified by the user.
test-url: https://github.com/axboe/fio





Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml

=========================================================================================
bs/compiler/cpufreq_governor/disk/fs/ioengine/kconfig/mount_option/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/time_based/ucode:
  4k/gcc-9/performance/2pmem/xfs/mmap/x86_64-rhel-8.3/dax/50%/debian-10.4-x86_64-20200603.cgz/200s/write/lkp-csl-2sp6/200G/fio-basic/tb/0x5003003

commit: 
  v5.10-rc1
  daf88f3757 ("crypto: qat - remove unused function")

       v5.10-rc1 daf88f3757ecb7aed4dd05a1ca8 
---------------- --------------------------- 
       fail:runs  %reproduction    fail:runs
           |             |             |    
          0:1          106%           1:4     perf-profile.children.cycles-pp.error_entry
          0:1           19%           0:4     perf-profile.self.cycles-pp.error_entry
         %stddev     %change         %stddev
             \          |                \  
      0.09            +0.0        0.11 ±  8%  perf-profile.self.cycles-pp.xfs_direct_write_iomap_begin
      0.01            -0.0        0.00        fio.latency_1000us%
      0.01            -0.0        0.00        fio.latency_10ms%
     52.71           +30.8       83.51        fio.latency_20us%
      0.01            -0.0        0.00        fio.latency_250ms%
      0.01            -0.0        0.00        fio.latency_4ms%
     47.28           -30.9       16.42 ±  8%  fio.latency_50us%
     23750            -3.2%      22982 ±  2%  fio.time.involuntary_context_switches
 4.714e+08            +5.9%  4.994e+08        fio.time.minor_page_faults
 4.714e+08            +5.9%  4.994e+08        fio.workload
      9206            +5.9%       9753        fio.write_bw_MBps
     21888            -6.1%      20544        fio.write_clat_90%_us
     23424            -6.0%      22016        fio.write_clat_95%_us
     27008            -4.7%      25728        fio.write_clat_99%_us
     20030            -5.8%      18866        fio.write_clat_mean_us
     10094           -23.6%       7715 ± 18%  fio.write_clat_stddev
   2356822            +5.9%    2496918        fio.write_iops
     15.67            -1.9%      15.37        boot-time.dhcp
      1678            -4.9%       1595 ±  4%  boot-time.idle
    142207           +27.7%     181659 ±  3%  meminfo.Active
    142079           +27.8%     181543 ±  3%  meminfo.Active(anon)
   5253120           +39.0%    7303680 ± 14%  meminfo.DirectMap2M
   1032574           +20.6%    1245626 ± 15%  numa-numastat.node0.local_node
   1063704           +19.3%    1268874 ± 14%  numa-numastat.node0.numa_hit
     99.00         +7991.7%       8010 ±167%  numa-numastat.node1.other_node
      1095           +20.0%       1314 ± 10%  slabinfo.Acpi-Parse.active_objs
      1095           +20.0%       1314 ± 10%  slabinfo.Acpi-Parse.num_objs
      3903           +15.2%       4497 ±  2%  slabinfo.kmalloc-rcl-64.active_objs
      3903           +15.2%       4497 ±  2%  slabinfo.kmalloc-rcl-64.num_objs
      1974           +21.4%       2397 ±  5%  slabinfo.kmalloc-rcl-96.active_objs
      1974           +21.4%       2397 ±  5%  slabinfo.kmalloc-rcl-96.num_objs
      4224            -9.7%       3816 ±  3%  slabinfo.skbuff_head_cache.active_objs
      4224            -9.7%       3816 ±  3%  slabinfo.skbuff_head_cache.num_objs
    168.00           +87.5%     315.00 ± 33%  slabinfo.xfs_buf.active_objs
    168.00           +87.5%     315.00 ± 33%  slabinfo.xfs_buf.num_objs
    520.00           -52.1%     249.00 ± 71%  numa-vmstat.node0.nr_active_anon
      7575           +15.7%       8761 ±  8%  numa-vmstat.node0.nr_kernel_stack
      3731         +1893.7%      74386 ±161%  numa-vmstat.node0.nr_mapped
    336.00           -41.5%     196.50 ± 51%  numa-vmstat.node0.nr_mlock
    860.00         +8249.9%      71809 ±167%  numa-vmstat.node0.nr_shmem
     24648           +15.7%      28508 ±  8%  numa-vmstat.node0.nr_slab_unreclaimable
    520.00           -52.1%     249.00 ± 71%  numa-vmstat.node0.nr_zone_active_anon
     34802           +29.7%      45154 ±  3%  numa-vmstat.node1.nr_active_anon
     17541           +52.0%      26657 ± 27%  numa-vmstat.node1.nr_anon_pages
     34802           +29.7%      45154 ±  3%  numa-vmstat.node1.nr_zone_active_anon
     21522          +318.3%      90028 ± 61%  numa-vmstat.node1.numa_other
      2176           -49.7%       1095 ± 66%  numa-meminfo.node0.Active
      2080           -52.1%     995.50 ± 71%  numa-meminfo.node0.Active(anon)
    159744           -26.0%     118206 ± 20%  numa-meminfo.node0.AnonHugePages
      7582           +15.6%       8764 ±  8%  numa-meminfo.node0.KernelStack
     14358         +1971.7%     297452 ±161%  numa-meminfo.node0.Mapped
   3775134           +18.3%    4467361 ± 13%  numa-meminfo.node0.MemUsed
      1344           -41.6%     785.50 ± 51%  numa-meminfo.node0.Mlocked
     98606           +15.7%     114046 ±  8%  numa-meminfo.node0.SUnreclaim
      3439         +8252.3%     287235 ±167%  numa-meminfo.node0.Shmem
    139195           +29.7%     180575 ±  3%  numa-meminfo.node1.Active
    139163           +29.7%     180559 ±  3%  numa-meminfo.node1.Active(anon)
     39355          +107.6%      81695 ± 29%  numa-meminfo.node1.AnonHugePages
     70147           +52.0%     106637 ± 27%  numa-meminfo.node1.AnonPages
     35315           +28.5%      45393 ±  3%  proc-vmstat.nr_active_anon
    574816            +2.1%     587055        proc-vmstat.nr_file_pages
     16071            +2.8%      16516        proc-vmstat.nr_kernel_stack
    458909            +6.1%     487082        proc-vmstat.nr_page_table_pages
    317028            +3.4%     327836        proc-vmstat.nr_shmem
     51381            -1.1%      50830        proc-vmstat.nr_slab_unreclaimable
     35315           +28.5%      45393 ±  3%  proc-vmstat.nr_zone_active_anon
   2752314            +4.8%    2884284        proc-vmstat.numa_hit
   2720860            +4.9%    2852909        proc-vmstat.numa_local
    550.00         +1693.2%       9862 ± 67%  proc-vmstat.numa_pages_migrated
     70822           +31.3%      92981 ±  3%  proc-vmstat.pgactivate
   2852741            +5.0%    2995650        proc-vmstat.pgalloc_normal
 4.726e+08            +5.9%  5.006e+08        proc-vmstat.pgfault
   2649470            +4.5%    2769520        proc-vmstat.pgfree
    550.00         +1693.2%       9862 ± 67%  proc-vmstat.pgmigrate_success
     38080            +5.0%      39999        proc-vmstat.pgreuse
    920942            +5.9%     975683        proc-vmstat.thp_fault_fallback
    157.77          -100.0%       0.00        sched_debug.cfs_rq:/.MIN_vruntime.avg
      8445          -100.0%       0.00        sched_debug.cfs_rq:/.MIN_vruntime.max
      1088          -100.0%       0.00        sched_debug.cfs_rq:/.MIN_vruntime.stddev
    157.77          -100.0%       0.00        sched_debug.cfs_rq:/.max_vruntime.avg
      8445          -100.0%       0.00        sched_debug.cfs_rq:/.max_vruntime.max
      1088          -100.0%       0.00        sched_debug.cfs_rq:/.max_vruntime.stddev
    191356           -13.8%     165009 ±  7%  sched_debug.cfs_rq:/.min_vruntime.max
      1.25           -20.0%       1.00        sched_debug.cfs_rq:/.nr_running.max
      1063            +8.5%       1153 ±  4%  sched_debug.cfs_rq:/.runnable_avg.max
      1063            +8.3%       1151 ±  4%  sched_debug.cfs_rq:/.util_avg.max
      2.62           +12.9%       2.96 ±  3%  sched_debug.cpu.clock.stddev
      0.00           +21.2%       0.00 ± 18%  sched_debug.cpu.next_balance.stddev
      1.25           -20.0%       1.00        sched_debug.cpu.nr_running.max
     41575           -23.4%      31826 ± 17%  sched_debug.cpu.nr_switches.max
     37046           -28.9%      26350 ± 26%  sched_debug.cpu.sched_count.max
     18461           -28.9%      13121 ± 26%  sched_debug.cpu.sched_goidle.max
     19536           -33.5%      13000 ± 26%  sched_debug.cpu.ttwu_count.max
      5010          +312.7%      20675 ± 38%  softirqs.CPU10.SCHED
      4120          +401.1%      20647 ± 42%  softirqs.CPU12.SCHED
      4225          +372.0%      19942 ± 39%  softirqs.CPU13.SCHED
      4708          +437.7%      25312 ±  5%  softirqs.CPU14.SCHED
      5302          +278.4%      20065 ± 40%  softirqs.CPU15.SCHED
      5022          +301.2%      20147 ± 40%  softirqs.CPU16.SCHED
      4280          +368.8%      20062 ± 41%  softirqs.CPU17.SCHED
      4686          +330.4%      20170 ± 39%  softirqs.CPU18.SCHED
      4110          +383.4%      19869 ± 40%  softirqs.CPU21.SCHED
      5551          +267.4%      20393 ± 39%  softirqs.CPU22.SCHED
      5109          +285.5%      19693 ± 40%  softirqs.CPU23.SCHED
      4594          +418.7%      23828 ± 16%  softirqs.CPU3.SCHED
     33085           -69.9%       9959 ±103%  softirqs.CPU30.SCHED
     27523           -64.3%       9831 ± 97%  softirqs.CPU34.SCHED
     26158           -84.1%       4148 ± 10%  softirqs.CPU35.SCHED
     26085           -83.6%       4288 ± 13%  softirqs.CPU36.SCHED
      3832          +434.8%      20494 ± 45%  softirqs.CPU4.SCHED
     26639           -59.1%      10888 ± 79%  softirqs.CPU41.SCHED
     14491           -69.4%       4433 ± 21%  softirqs.CPU47.SCHED
      3952          +448.8%      21687 ± 45%  softirqs.CPU5.SCHED
     26317           -73.8%       6906 ± 75%  softirqs.CPU51.SCHED
     16151          -100.0%       0.50 ±173%  softirqs.CPU53.NET_RX
     28193           -65.6%       9705 ±108%  softirqs.CPU53.SCHED
     12886           -53.9%       5946 ±  2%  softirqs.CPU62.RCU
     29154           -86.6%       3910 ±  9%  softirqs.CPU62.SCHED
     73.00         +3777.1%       2830 ±165%  softirqs.CPU64.TIMER
      3677          +110.8%       7751 ± 54%  softirqs.CPU69.RCU
      4405          +360.8%      20300 ± 44%  softirqs.CPU7.SCHED
      3702          +457.0%      20619 ± 47%  softirqs.CPU79.SCHED
      4573          +282.4%      17486 ± 47%  softirqs.CPU8.SCHED
      3581          +655.1%      27039 ±  3%  softirqs.CPU83.SCHED
      3620          +622.6%      26158 ±  2%  softirqs.CPU84.SCHED
      4440          +359.6%      20406 ± 44%  softirqs.CPU9.SCHED
      3555           +95.5%       6950 ± 76%  softirqs.CPU92.SCHED
     13752           +94.0%      26681 ±  2%  softirqs.CPU95.SCHED
     30585           -71.2%       8799 ± 26%  softirqs.NET_RX
 6.178e+09            +3.5%  6.396e+09        perf-stat.i.branch-instructions
      0.39            -0.0        0.38        perf-stat.i.branch-miss-rate%
     69.60            +1.8       71.39        perf-stat.i.cache-miss-rate%
 1.832e+08            +5.1%  1.925e+08        perf-stat.i.cache-misses
      4.93            -3.4%       4.76        perf-stat.i.cpi
    736.97            -4.5%     703.46        perf-stat.i.cycles-between-cache-misses
 7.055e+09            +3.3%  7.285e+09        perf-stat.i.dTLB-loads
  12407035            +5.1%   13040942        perf-stat.i.dTLB-store-misses
 2.629e+09            +5.8%  2.781e+09        perf-stat.i.dTLB-stores
 2.707e+10            +3.8%  2.809e+10        perf-stat.i.instructions
      0.20            +3.4%       0.21        perf-stat.i.ipc
    169.10            +3.8%     175.48        perf-stat.i.metric.M/sec
   2337072            +5.9%    2475099        perf-stat.i.minor-faults
    318763            +8.9%     347151 ±  3%  perf-stat.i.node-loads
     73.28           -25.2       48.03 ± 32%  perf-stat.i.node-store-miss-rate%
  59253072           -31.6%   40500590 ± 34%  perf-stat.i.node-store-misses
  21486078          +102.2%   43449458 ± 29%  perf-stat.i.node-stores
   2338463            +5.9%    2476485        perf-stat.i.page-faults
      0.39            -0.0        0.37 ±  2%  perf-stat.overall.branch-miss-rate%
     69.77            +1.8       71.53        perf-stat.overall.cache-miss-rate%
      4.94            -3.6%       4.77        perf-stat.overall.cpi
    730.45            -4.8%     695.59        perf-stat.overall.cycles-between-cache-misses
      0.20            +3.7%       0.21        perf-stat.overall.ipc
     73.39           -25.4       48.03 ± 32%  perf-stat.overall.node-store-miss-rate%
     11596            -2.0%      11361        perf-stat.overall.path-length
 6.147e+09            +3.5%  6.364e+09        perf-stat.ps.branch-instructions
 1.823e+08            +5.1%  1.915e+08        perf-stat.ps.cache-misses
  7.02e+09            +3.3%  7.249e+09        perf-stat.ps.dTLB-loads
  12345529            +5.1%   12975883        perf-stat.ps.dTLB-store-misses
 2.616e+09            +5.8%  2.767e+09        perf-stat.ps.dTLB-stores
 2.694e+10            +3.8%  2.795e+10        perf-stat.ps.instructions
   2325462            +5.9%    2462734        perf-stat.ps.minor-faults
    317211            +8.9%     345458 ±  3%  perf-stat.ps.node-loads
  58958077           -31.6%   40298328 ± 34%  perf-stat.ps.node-store-misses
  21379396          +102.2%   43232155 ± 29%  perf-stat.ps.node-stores
   2326850            +5.9%    2464121        perf-stat.ps.page-faults
 5.466e+12            +3.8%  5.674e+12        perf-stat.total.instructions
     15863          -100.0%       3.00 ±100%  interrupts.50:PCI-MSI.31981583-edge.i40e-eth0-TxRx-14
    179.00           -99.4%       1.00 ±173%  interrupts.63:PCI-MSI.31981596-edge.i40e-eth0-TxRx-27
      7248          -100.0%       0.00        interrupts.66:PCI-MSI.31981599-edge.i40e-eth0-TxRx-30
    536.00           -99.8%       1.00 ±173%  interrupts.84:PCI-MSI.31981617-edge.i40e-eth0-TxRx-48
     24603          -100.0%       1.00 ±173%  interrupts.89:PCI-MSI.31981622-edge.i40e-eth0-TxRx-53
     48892            -2.3%      47789        interrupts.CAL:Function_call_interrupts
    630.00           -35.7%     405.25 ± 23%  interrupts.CPU0.CAL:Function_call_interrupts
    242.00          +209.5%     749.00 ± 34%  interrupts.CPU1.CAL:Function_call_interrupts
      7818           -43.0%       4452 ± 55%  interrupts.CPU10.NMI:Non-maskable_interrupts
      7818           -43.0%       4452 ± 55%  interrupts.CPU10.PMI:Performance_monitoring_interrupts
    197.00           -67.8%      63.50 ±119%  interrupts.CPU10.RES:Rescheduling_interrupts
    203.00           -72.0%      56.75 ±134%  interrupts.CPU12.RES:Rescheduling_interrupts
    206.00           -71.2%      59.25 ±128%  interrupts.CPU13.RES:Rescheduling_interrupts
     15863          -100.0%       2.50 ±107%  interrupts.CPU14.50:PCI-MSI.31981583-edge.i40e-eth0-TxRx-14
      7799           -54.2%       3574 ± 34%  interrupts.CPU14.NMI:Non-maskable_interrupts
      7799           -54.2%       3574 ± 34%  interrupts.CPU14.PMI:Performance_monitoring_interrupts
    198.00           -92.4%      15.00 ± 27%  interrupts.CPU14.RES:Rescheduling_interrupts
      7799           -38.3%       4808 ± 43%  interrupts.CPU15.NMI:Non-maskable_interrupts
      7799           -38.3%       4808 ± 43%  interrupts.CPU15.PMI:Performance_monitoring_interrupts
    195.00           -69.5%      59.50 ±125%  interrupts.CPU15.RES:Rescheduling_interrupts
      7798           -38.3%       4807 ± 43%  interrupts.CPU16.NMI:Non-maskable_interrupts
      7798           -38.3%       4807 ± 43%  interrupts.CPU16.PMI:Performance_monitoring_interrupts
    197.00           -70.1%      59.00 ±125%  interrupts.CPU16.RES:Rescheduling_interrupts
      7797           -38.3%       4807 ± 43%  interrupts.CPU17.NMI:Non-maskable_interrupts
      7797           -38.3%       4807 ± 43%  interrupts.CPU17.PMI:Performance_monitoring_interrupts
    201.00           -71.6%      57.00 ±131%  interrupts.CPU17.RES:Rescheduling_interrupts
      7798           -38.4%       4806 ± 43%  interrupts.CPU18.NMI:Non-maskable_interrupts
      7798           -38.4%       4806 ± 43%  interrupts.CPU18.PMI:Performance_monitoring_interrupts
    200.00           -70.4%      59.25 ±126%  interrupts.CPU18.RES:Rescheduling_interrupts
      7.00          +771.4%      61.00 ±127%  interrupts.CPU20.RES:Rescheduling_interrupts
      7798           -38.4%       4806 ± 43%  interrupts.CPU21.NMI:Non-maskable_interrupts
      7798           -38.4%       4806 ± 43%  interrupts.CPU21.PMI:Performance_monitoring_interrupts
    202.00           -70.3%      60.00 ±121%  interrupts.CPU21.RES:Rescheduling_interrupts
      7797           -42.9%       4449 ± 55%  interrupts.CPU22.NMI:Non-maskable_interrupts
      7797           -42.9%       4449 ± 55%  interrupts.CPU22.PMI:Performance_monitoring_interrupts
    193.00           -68.1%      61.50 ±117%  interrupts.CPU22.RES:Rescheduling_interrupts
      7797           -42.9%       4449 ± 55%  interrupts.CPU23.NMI:Non-maskable_interrupts
      7797           -42.9%       4449 ± 55%  interrupts.CPU23.PMI:Performance_monitoring_interrupts
    193.00           -67.7%      62.25 ±119%  interrupts.CPU23.RES:Rescheduling_interrupts
      2398           -83.0%     408.50 ± 25%  interrupts.CPU24.CAL:Function_call_interrupts
      9.00         +1452.8%     139.75 ± 55%  interrupts.CPU25.RES:Rescheduling_interrupts
      2887          +128.1%       6584 ± 32%  interrupts.CPU26.NMI:Non-maskable_interrupts
      2887          +128.1%       6584 ± 32%  interrupts.CPU26.PMI:Performance_monitoring_interrupts
     19.00         +1527.6%     309.25 ± 59%  interrupts.CPU26.RES:Rescheduling_interrupts
    179.00           -99.4%       1.00 ±173%  interrupts.CPU27.63:PCI-MSI.31981596-edge.i40e-eth0-TxRx-27
      1550           -63.9%     559.75 ± 30%  interrupts.CPU27.CAL:Function_call_interrupts
      2881           +86.4%       5369 ± 45%  interrupts.CPU27.NMI:Non-maskable_interrupts
      2881           +86.4%       5369 ± 45%  interrupts.CPU27.PMI:Performance_monitoring_interrupts
    529.00           -73.1%     142.50 ± 41%  interrupts.CPU27.RES:Rescheduling_interrupts
    689.00           -31.9%     469.25 ±  7%  interrupts.CPU28.CAL:Function_call_interrupts
      2861          +129.6%       6570 ± 32%  interrupts.CPU28.NMI:Non-maskable_interrupts
      2861          +129.6%       6570 ± 32%  interrupts.CPU28.PMI:Performance_monitoring_interrupts
      2864           +87.2%       5360 ± 45%  interrupts.CPU29.NMI:Non-maskable_interrupts
      2864           +87.2%       5360 ± 45%  interrupts.CPU29.PMI:Performance_monitoring_interrupts
      9.00         +1344.4%     130.00 ± 58%  interrupts.CPU29.RES:Rescheduling_interrupts
      7819           -67.6%       2533 ± 24%  interrupts.CPU3.NMI:Non-maskable_interrupts
      7819           -67.6%       2533 ± 24%  interrupts.CPU3.PMI:Performance_monitoring_interrupts
    209.00           -82.1%      37.50 ±119%  interrupts.CPU3.RES:Rescheduling_interrupts
      7248          -100.0%       0.00        interrupts.CPU30.66:PCI-MSI.31981599-edge.i40e-eth0-TxRx-30
      7.00         +2071.4%     152.00 ± 52%  interrupts.CPU31.RES:Rescheduling_interrupts
    138.00           -51.4%      67.00 ± 57%  interrupts.CPU31.TLB:TLB_shootdowns
      8.00         +1800.0%     152.00 ± 52%  interrupts.CPU32.RES:Rescheduling_interrupts
      6.00         +2491.7%     155.50 ± 48%  interrupts.CPU33.RES:Rescheduling_interrupts
      6.00         +2608.3%     162.50 ± 53%  interrupts.CPU34.RES:Rescheduling_interrupts
      2860          +172.8%       7802        interrupts.CPU35.NMI:Non-maskable_interrupts
      2860          +172.8%       7802        interrupts.CPU35.PMI:Performance_monitoring_interrupts
     11.00         +1738.6%     202.25 ±  2%  interrupts.CPU35.RES:Rescheduling_interrupts
    599.00           -22.7%     463.25 ±  3%  interrupts.CPU36.CAL:Function_call_interrupts
      2877          +171.2%       7802        interrupts.CPU36.NMI:Non-maskable_interrupts
      2877          +171.2%       7802        interrupts.CPU36.PMI:Performance_monitoring_interrupts
     19.00          +947.4%     199.00 ±  2%  interrupts.CPU36.RES:Rescheduling_interrupts
    137.00           -42.9%      78.25 ± 44%  interrupts.CPU37.TLB:TLB_shootdowns
      2864          +129.3%       6568 ± 32%  interrupts.CPU38.NMI:Non-maskable_interrupts
      2864          +129.3%       6568 ± 32%  interrupts.CPU38.PMI:Performance_monitoring_interrupts
     13.00         +1140.4%     161.25 ± 50%  interrupts.CPU38.RES:Rescheduling_interrupts
    117.00           -37.2%      73.50 ± 50%  interrupts.CPU38.TLB:TLB_shootdowns
      2858          +129.9%       6570 ± 32%  interrupts.CPU39.NMI:Non-maskable_interrupts
      2858          +129.9%       6570 ± 32%  interrupts.CPU39.PMI:Performance_monitoring_interrupts
      9.00         +1333.3%     129.00 ± 56%  interrupts.CPU39.RES:Rescheduling_interrupts
    203.00           -70.3%      60.25 ±133%  interrupts.CPU4.RES:Rescheduling_interrupts
      9.00         +1572.2%     150.50 ± 48%  interrupts.CPU40.RES:Rescheduling_interrupts
      2857          +129.8%       6566 ± 32%  interrupts.CPU41.NMI:Non-maskable_interrupts
      2857          +129.8%       6566 ± 32%  interrupts.CPU41.PMI:Performance_monitoring_interrupts
     11.00         +1265.9%     150.25 ± 50%  interrupts.CPU41.RES:Rescheduling_interrupts
      2857          +130.2%       6575 ± 32%  interrupts.CPU42.NMI:Non-maskable_interrupts
      2857          +130.2%       6575 ± 32%  interrupts.CPU42.PMI:Performance_monitoring_interrupts
     10.00         +1390.0%     149.00 ± 49%  interrupts.CPU42.RES:Rescheduling_interrupts
    144.00           -41.8%      83.75 ± 36%  interrupts.CPU42.TLB:TLB_shootdowns
      2857          +129.9%       6568 ± 32%  interrupts.CPU43.NMI:Non-maskable_interrupts
      2857          +129.9%       6568 ± 32%  interrupts.CPU43.PMI:Performance_monitoring_interrupts
     11.00         +1247.7%     148.25 ± 49%  interrupts.CPU43.RES:Rescheduling_interrupts
      2857           +68.3%       4809 ± 43%  interrupts.CPU44.NMI:Non-maskable_interrupts
      2857           +68.3%       4809 ± 43%  interrupts.CPU44.PMI:Performance_monitoring_interrupts
      2857          +129.9%       6567 ± 32%  interrupts.CPU45.NMI:Non-maskable_interrupts
      2857          +129.9%       6567 ± 32%  interrupts.CPU45.PMI:Performance_monitoring_interrupts
     18.00          +770.8%     156.75 ± 50%  interrupts.CPU45.RES:Rescheduling_interrupts
      2857          +129.9%       6568 ± 32%  interrupts.CPU46.NMI:Non-maskable_interrupts
      2857          +129.9%       6568 ± 32%  interrupts.CPU46.PMI:Performance_monitoring_interrupts
     15.00          +888.3%     148.25 ± 48%  interrupts.CPU46.RES:Rescheduling_interrupts
      2894          +169.5%       7799        interrupts.CPU47.NMI:Non-maskable_interrupts
      2894          +169.5%       7799        interrupts.CPU47.PMI:Performance_monitoring_interrupts
    109.00           +86.9%     203.75 ±  5%  interrupts.CPU47.RES:Rescheduling_interrupts
    536.00           -99.9%       0.75 ±173%  interrupts.CPU48.84:PCI-MSI.31981617-edge.i40e-eth0-TxRx-48
      7.00         +1467.9%     109.75 ± 88%  interrupts.CPU49.RES:Rescheduling_interrupts
      1429          +273.1%       5332 ± 46%  interrupts.CPU50.NMI:Non-maskable_interrupts
      1429          +273.1%       5332 ± 46%  interrupts.CPU50.PMI:Performance_monitoring_interrupts
      1429          +445.4%       7793        interrupts.CPU51.NMI:Non-maskable_interrupts
      1429          +445.4%       7793        interrupts.CPU51.PMI:Performance_monitoring_interrupts
     12.00         +1406.2%     180.75 ± 24%  interrupts.CPU51.RES:Rescheduling_interrupts
      1429          +359.4%       6565 ± 32%  interrupts.CPU52.NMI:Non-maskable_interrupts
      1429          +359.4%       6565 ± 32%  interrupts.CPU52.PMI:Performance_monitoring_interrupts
      3.00         +5100.0%     156.00 ± 56%  interrupts.CPU52.RES:Rescheduling_interrupts
     24603          -100.0%       0.75 ±173%  interrupts.CPU53.89:PCI-MSI.31981622-edge.i40e-eth0-TxRx-53
      1429          +359.2%       6561 ± 32%  interrupts.CPU54.NMI:Non-maskable_interrupts
      1429          +359.2%       6561 ± 32%  interrupts.CPU54.PMI:Performance_monitoring_interrupts
      1432          +358.6%       6566 ± 32%  interrupts.CPU55.NMI:Non-maskable_interrupts
      1432          +358.6%       6566 ± 32%  interrupts.CPU55.PMI:Performance_monitoring_interrupts
      1429          +359.1%       6561 ± 32%  interrupts.CPU56.NMI:Non-maskable_interrupts
      1429          +359.1%       6561 ± 32%  interrupts.CPU56.PMI:Performance_monitoring_interrupts
      0.00       +1.3e+104%     131.50 ± 63%  interrupts.CPU56.RES:Rescheduling_interrupts
      1429          +359.5%       6566 ± 32%  interrupts.CPU57.NMI:Non-maskable_interrupts
      1429          +359.5%       6566 ± 32%  interrupts.CPU57.PMI:Performance_monitoring_interrupts
      0.00       +1.5e+104%     154.50 ± 57%  interrupts.CPU57.RES:Rescheduling_interrupts
      1429          +359.4%       6565 ± 32%  interrupts.CPU58.NMI:Non-maskable_interrupts
      1429          +359.4%       6565 ± 32%  interrupts.CPU58.PMI:Performance_monitoring_interrupts
    205.00           -51.7%      99.00 ± 66%  interrupts.CPU6.RES:Rescheduling_interrupts
      1433          +358.1%       6565 ± 32%  interrupts.CPU60.NMI:Non-maskable_interrupts
      1433          +358.1%       6565 ± 32%  interrupts.CPU60.PMI:Performance_monitoring_interrupts
      6.00         +2545.8%     158.75 ± 52%  interrupts.CPU60.RES:Rescheduling_interrupts
      1437          +358.7%       6592 ± 31%  interrupts.CPU61.NMI:Non-maskable_interrupts
      1437          +358.7%       6592 ± 31%  interrupts.CPU61.PMI:Performance_monitoring_interrupts
      2859          +172.8%       7799        interrupts.CPU62.NMI:Non-maskable_interrupts
      2859          +172.8%       7799        interrupts.CPU62.PMI:Performance_monitoring_interrupts
      3.00         +6825.0%     207.75        interrupts.CPU62.RES:Rescheduling_interrupts
    487.00            -9.4%     441.25 ±  3%  interrupts.CPU63.CAL:Function_call_interrupts
      2858          +130.4%       6585 ± 31%  interrupts.CPU63.NMI:Non-maskable_interrupts
      2858          +130.4%       6585 ± 31%  interrupts.CPU63.PMI:Performance_monitoring_interrupts
      5.00         +3050.0%     157.50 ± 52%  interrupts.CPU63.RES:Rescheduling_interrupts
      1188           -62.5%     446.00 ±  5%  interrupts.CPU64.CAL:Function_call_interrupts
      8.00         +1903.1%     160.25 ± 49%  interrupts.CPU64.RES:Rescheduling_interrupts
      2857          +129.8%       6566 ± 32%  interrupts.CPU65.NMI:Non-maskable_interrupts
      2857          +129.8%       6566 ± 32%  interrupts.CPU65.PMI:Performance_monitoring_interrupts
      3.00         +5141.7%     157.25 ± 53%  interrupts.CPU65.RES:Rescheduling_interrupts
      2858          +129.8%       6568 ± 32%  interrupts.CPU66.NMI:Non-maskable_interrupts
      2858          +129.8%       6568 ± 32%  interrupts.CPU66.PMI:Performance_monitoring_interrupts
      5.00         +3040.0%     157.00 ± 54%  interrupts.CPU66.RES:Rescheduling_interrupts
      0.00       +1.1e+104%     108.50 ± 90%  interrupts.CPU67.RES:Rescheduling_interrupts
      2858          +129.8%       6567 ± 32%  interrupts.CPU69.NMI:Non-maskable_interrupts
      2858          +129.8%       6567 ± 32%  interrupts.CPU69.PMI:Performance_monitoring_interrupts
      0.00       +1.6e+104%     156.00 ± 55%  interrupts.CPU69.RES:Rescheduling_interrupts
      7798           -42.9%       4450 ± 55%  interrupts.CPU7.NMI:Non-maskable_interrupts
      7798           -42.9%       4450 ± 55%  interrupts.CPU7.PMI:Performance_monitoring_interrupts
      2858          +129.8%       6567 ± 32%  interrupts.CPU70.NMI:Non-maskable_interrupts
      2858          +129.8%       6567 ± 32%  interrupts.CPU70.PMI:Performance_monitoring_interrupts
      2.00         +7862.5%     159.25 ± 53%  interrupts.CPU70.RES:Rescheduling_interrupts
      2863          +129.3%       6566 ± 32%  interrupts.CPU71.NMI:Non-maskable_interrupts
      2863          +129.3%       6566 ± 32%  interrupts.CPU71.PMI:Performance_monitoring_interrupts
      4.00         +4056.2%     166.25 ± 53%  interrupts.CPU71.RES:Rescheduling_interrupts
    215.00           -70.7%      63.00 ±130%  interrupts.CPU74.RES:Rescheduling_interrupts
    120.00           -33.5%      79.75 ± 52%  interrupts.CPU75.TLB:TLB_shootdowns
    119.00           -35.7%      76.50 ± 55%  interrupts.CPU76.TLB:TLB_shootdowns
    207.00           -61.0%      80.75 ±101%  interrupts.CPU77.RES:Rescheduling_interrupts
    205.00           -73.3%      54.75 ±157%  interrupts.CPU79.RES:Rescheduling_interrupts
    199.00           -60.4%      78.75 ±100%  interrupts.CPU8.RES:Rescheduling_interrupts
    119.00           -31.5%      81.50 ± 53%  interrupts.CPU80.TLB:TLB_shootdowns
    204.00           -95.2%       9.75 ± 66%  interrupts.CPU83.RES:Rescheduling_interrupts
    114.00           -46.1%      61.50 ± 56%  interrupts.CPU83.TLB:TLB_shootdowns
    205.00           -94.5%      11.25 ± 50%  interrupts.CPU84.RES:Rescheduling_interrupts
    123.00           -23.8%      93.75 ± 29%  interrupts.CPU85.TLB:TLB_shootdowns
    127.00           -29.3%      89.75 ± 43%  interrupts.CPU86.TLB:TLB_shootdowns
    206.00           -71.5%      58.75 ±143%  interrupts.CPU88.RES:Rescheduling_interrupts
    207.00           -72.6%      56.75 ±150%  interrupts.CPU89.RES:Rescheduling_interrupts
    201.00           -71.5%      57.25 ±139%  interrupts.CPU9.RES:Rescheduling_interrupts
    206.00           -73.8%      54.00 ±161%  interrupts.CPU90.RES:Rescheduling_interrupts
    165.00           -44.1%      92.25 ± 32%  interrupts.CPU90.TLB:TLB_shootdowns
    124.00           -28.4%      88.75 ± 30%  interrupts.CPU92.TLB:TLB_shootdowns
    125.00           -27.2%      91.00 ± 29%  interrupts.CPU93.TLB:TLB_shootdowns
      7793           -51.5%       3775 ± 30%  interrupts.CPU95.NMI:Non-maskable_interrupts
      7793           -51.5%       3775 ± 30%  interrupts.CPU95.PMI:Performance_monitoring_interrupts
    232.00           -89.0%      25.50 ± 93%  interrupts.CPU95.RES:Rescheduling_interrupts
    153.00           -36.3%      97.50 ± 41%  interrupts.CPU95.TLB:TLB_shootdowns
    553.00           +31.7%     728.50 ±  3%  interrupts.IWI:IRQ_work_interrupts
    404122           +30.2%     526250 ± 12%  interrupts.NMI:Non-maskable_interrupts
    404122           +30.2%     526250 ± 12%  interrupts.PMI:Performance_monitoring_interrupts


                                                                                
                                  fio.write_bw_MBps                             
                                                                                
  10100 +-------------------------------------------------------------------+   
  10000 |-+O                                                                |   
        |             O                                                     |   
   9900 |-+       O                O                                        |   
   9800 |-+    O            O                       O             O  O      |   
        |                              O         O      O     O          O  |   
   9700 |-+              O      O         O  O             O                |   
   9600 |-+                                                                 |   
   9500 |-+                                                                 |   
        |                                                                   |   
   9400 |-+                                                                 |   
   9300 |..  ..+..                                                          |   
        |  +.     +...                                                      |   
   9200 |-+           +                                                     |   
   9100 +-------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                    fio.write_iops                              
                                                                                
   2.6e+06 +----------------------------------------------------------------+   
           |                                                                |   
           |  O         O                                                   |   
  2.55e+06 |-+                                                              |   
           |         O               O                                      |   
           |      O            O                     O            O   O     |   
   2.5e+06 |-+                          O         O      O  O  O         O  |   
           |               O      O         O  O                            |   
  2.45e+06 |-+                                                              |   
           |                                                                |   
           |                                                                |   
   2.4e+06 |-+                                                              |   
           |..  ..+..                                                       |   
           |  +.     +..                                                    |   
  2.35e+06 +----------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                               fio.write_clat_mean_us                           
                                                                                
  20200 +-------------------------------------------------------------------+   
  20000 |-+         ..+                                                     |   
        | .+...  .+.                                                        |   
  19800 |.+    +.                                                           |   
  19600 |-+                                                                 |   
        |                                                                   |   
  19400 |-+                                                                 |   
  19200 |-+                                                                 |   
  19000 |-+              O      O         O  O             O                |   
        |                              O         O      O     O          O  |   
  18800 |-+    O            O                       O             O  O      |   
  18600 |-+       O                O                                        |   
        |             O                                                     |   
  18400 |-+O                                                                |   
  18200 +-------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                fio.write_clat_90__us                           
                                                                                
  22000 +-------------------------------------------------------------------+   
        |        .+...+                                                     |   
        |..+...+.                                                           |   
  21500 |-+                                                                 |   
        |                                                                   |   
        |                                                                   |   
  21000 |-+                                                                 |   
        |                                                                   |   
  20500 |-+              O      O         O  O   O      O  O  O      O   O  |   
        |                   O      O   O            O             O         |   
        |                                                                   |   
  20000 |-+    O  O                                                         |   
        |  O          O                                                     |   
        |                                                                   |   
  19500 +-------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                fio.latency_20us_                               
                                                                                
  95 +----------------------------------------------------------------------+   
     |   O         O                                                        |   
  90 |-+    O   O                O                                          |   
  85 |-+                  O          O          O  O   O  O      O      O   |   
     |                 O      O          O  O                 O      O      |   
  80 |-+                                                                    |   
  75 |-+                                                                    |   
     |                                                                      |   
  70 |-+                                                                    |   
  65 |-+                                                                    |   
     |                                                                      |   
  60 |...+..+..                                                             |   
  55 |-+       .                                                            |   
     |          +..+                                                        |   
  50 +----------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                fio.latency_50us_                               
                                                                                
  50 +----------------------------------------------------------------------+   
     |         .+..+                                                        |   
  45 |-+     ..                                                             |   
  40 |...+..+                                                               |   
     |                                                                      |   
  35 |-+                                                                    |   
  30 |-+                                                                    |   
     |                                                                      |   
  25 |-+                                                                    |   
  20 |-+                                                                    |   
     |                 O      O          O  O                 O      O      |   
  15 |-+                  O          O          O  O   O  O      O      O   |   
  10 |-+    O   O                O                                          |   
     |   O         O                                                        |   
   5 +----------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                     fio.workload                               
                                                                                
  5.15e+08 +----------------------------------------------------------------+   
           |            O                                                   |   
   5.1e+08 |-+       O                                                      |   
  5.05e+08 |-+                       O                                      |   
           |      O            O                     O            O   O     |   
     5e+08 |-+                          O         O      O     O         O  |   
  4.95e+08 |-+             O      O         O  O            O               |   
           |                                                                |   
   4.9e+08 |-+                                                              |   
  4.85e+08 |-+                                                              |   
           |                                                                |   
   4.8e+08 |-+  ..+..                                                       |   
  4.75e+08 |..+.                                                            |   
           |         +..                                                    |   
   4.7e+08 +----------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                              fio.time.minor_page_faults                        
                                                                                
  5.15e+08 +----------------------------------------------------------------+   
           |            O                                                   |   
   5.1e+08 |-+       O                                                      |   
  5.05e+08 |-+                       O                                      |   
           |      O            O                     O            O   O     |   
     5e+08 |-+                          O         O      O     O         O  |   
  4.95e+08 |-+             O      O         O  O            O               |   
           |                                                                |   
   4.9e+08 |-+                                                              |   
  4.85e+08 |-+                                                              |   
           |                                                                |   
   4.8e+08 |-+  ..+..                                                       |   
  4.75e+08 |..+.                                                            |   
           |         +..                                                    |   
   4.7e+08 +----------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Rong Chen


View attachment "config-5.10.0-rc1-00001-gdaf88f3757ec" of type "text/plain" (171317 bytes)

View attachment "job-script" of type "text/plain" (8454 bytes)

View attachment "job.yaml" of type "text/plain" (5945 bytes)

View attachment "reproduce" of type "text/plain" (948 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ