lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Message-ID: <20201110082325.GB4236@xsang-OptiPlex-9020>
Date:   Tue, 10 Nov 2020 16:23:25 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Dave Chinner <dchinner@...hat.com>
Cc:     "Darrick J. Wong" <darrick.wong@...cle.com>,
        Brian Foster <bfoster@...hat.com>,
        Christoph Hellwig <hch@....de>,
        Allison Collins <allison.henderson@...cle.com>,
        LKML <linux-kernel@...r.kernel.org>, lkp@...ts.01.org,
        lkp@...el.com, ying.huang@...el.com, feng.tang@...el.com,
        zhengjun.xing@...el.com
Subject: [xfs]  2def2845cc:  reaim.jobs_per_min -6.3% regression

Greeting,

FYI, we noticed a -6.3% regression of reaim.jobs_per_min due to commit:


commit: 2def2845cc33390e39b51440508043e4981e10ee ("xfs: don't allow log IO to be throttled")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master


in testcase: reaim
on test machine: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 256G memory
with following parameters:

	runtime: 300s
	nr_task: 100
	disk: 1HDD
	fs: xfs
	test: disk
	cpufreq_governor: performance
	ucode: 0x5002f01

test-description: REAIM is an updated and improved version of AIM 7 benchmark.
test-url: https://sourceforge.net/projects/re-aim-7/



If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang@...el.com>


Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml

=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode:
  gcc-9/performance/1HDD/xfs/x86_64-rhel-8.3/100/debian-10.4-x86_64-20200603.cgz/300s/lkp-csl-2sp6/disk/reaim/0x5002f01

commit: 
  0e7ab7efe7 ("xfs: Throttle commits on delayed background CIL push")
  2def2845cc ("xfs: don't allow log IO to be throttled")

0e7ab7efe77451cb 2def2845cc33390e39b51440508 
---------------- --------------------------- 
       fail:runs  %reproduction    fail:runs
           |             |             |    
          0:4            4%           0:4     perf-profile.children.cycles-pp.error_entry
         %stddev     %change         %stddev
             \          |                \  
      4061            -6.3%       3803        reaim.jobs_per_min
     40.61            -6.3%      38.04        reaim.jobs_per_min_child
      4119            -7.2%       3822        reaim.max_jobs_per_min
    147.77            +6.8%     157.75        reaim.parent_time
      1.22            +8.7%       1.32 ±  9%  reaim.std_dev_percent
      1.77           +16.0%       2.05 ±  9%  reaim.std_dev_time
    194096 ± 15%     -27.2%     141268        reaim.time.file_system_inputs
   1222606 ± 15%     -27.4%     887346        reaim.time.file_system_outputs
    717473 ± 15%     -28.7%     511890        reaim.time.voluntary_context_switches
     17301 ±  4%      -8.3%      15858        meminfo.Shmem
     75.03            -2.1%      73.49        iostat.cpu.idle
     22.42            +6.5%      23.89        iostat.cpu.iowait
   2440535 ± 14%     -28.1%    1753829 ±  4%  numa-numastat.node0.local_node
   2453004 ± 15%     -28.2%    1761604 ±  3%  numa-numastat.node0.numa_hit
    525.50 ±  9%     -25.3%     392.50 ± 13%  slabinfo.biovec-128.active_objs
    525.50 ±  9%     -25.3%     392.50 ± 13%  slabinfo.biovec-128.num_objs
     20303 ±  4%      -7.4%      18804        slabinfo.vmap_area.num_objs
      1.50 ±173%  +1.1e+06%      16109 ± 57%  softirqs.CPU19.BLOCK
    152935 ±  2%     -23.6%     116784 ± 13%  softirqs.CPU56.TIMER
     51623 ± 16%     -38.0%      32016 ± 16%  softirqs.CPU67.SCHED
    142643 ± 20%     -29.0%     101205 ±  5%  softirqs.CPU70.RCU
    142574 ± 20%     -28.9%     101327 ±  5%  softirqs.CPU72.RCU
     74.50            -2.0%      73.00        vmstat.cpu.id
     22.00            +5.7%      23.25        vmstat.cpu.wa
    232.75            -6.1%     218.50        vmstat.io.bi
      1338            -4.4%       1280        vmstat.io.bo
      6326            -5.4%       5985        vmstat.system.cs
    145950 ± 15%     -27.4%     105915        proc-vmstat.nr_dirtied
      1903            +3.7%       1973        proc-vmstat.nr_page_table_pages
      4326 ±  4%      -8.4%       3964        proc-vmstat.nr_shmem
    100259 ± 15%     -27.4%      72781        proc-vmstat.nr_written
     14056 ± 14%     -26.9%      10272        proc-vmstat.pgactivate
     97048 ± 15%     -27.2%      70634        proc-vmstat.pgpgin
      0.04 ±  9%     +17.2%       0.05 ± 11%  sched_debug.cfs_rq:/.nr_running.avg
     -4805          -283.9%       8839 ± 13%  sched_debug.cfs_rq:/.spread0.avg
     21130 ± 15%     +87.8%      39689 ± 22%  sched_debug.cfs_rq:/.spread0.max
    -15034           -93.4%    -993.05        sched_debug.cfs_rq:/.spread0.min
   -182.12           -45.4%     -99.37        sched_debug.cpu.nr_uninterruptible.min
     30.60 ± 18%     -27.3%      22.25 ±  6%  sched_debug.cpu.nr_uninterruptible.stddev
     84620 ± 18%     -33.2%      56548 ±  7%  sched_debug.cpu.ttwu_count.max
      6338            -5.5%       5993        perf-stat.i.context-switches
    464.81            -4.8%     442.62        perf-stat.i.cpu-migrations
     14048            -4.6%      13401        perf-stat.i.minor-faults
     14048            -4.6%      13401        perf-stat.i.page-faults
  22155514 ±  2%      +5.9%   23459873 ±  2%  perf-stat.overall.path-length
      6323            -5.5%       5974        perf-stat.ps.context-switches
    463.67            -4.8%     441.27        perf-stat.ps.cpu-migrations
     14013            -4.7%      13359        perf-stat.ps.minor-faults
     14013            -4.7%      13359        perf-stat.ps.page-faults
    186331 ± 33%     -59.9%      74791 ± 15%  numa-meminfo.node0.Active
    186144 ± 33%     -59.9%      74661 ± 15%  numa-meminfo.node0.Active(anon)
    128035 ± 39%     -72.8%      34841 ± 37%  numa-meminfo.node0.AnonHugePages
    184229 ± 34%     -61.2%      71407 ± 16%  numa-meminfo.node0.AnonPages
   1258315 ±  6%     -12.1%    1105624 ±  8%  numa-meminfo.node0.MemUsed
    121848 ± 51%     +92.5%     234595 ±  4%  numa-meminfo.node1.Active
    121762 ± 51%     +92.6%     234455 ±  4%  numa-meminfo.node1.Active(anon)
     82419 ± 68%    +105.4%     169298 ±  7%  numa-meminfo.node1.AnonHugePages
    117855 ± 52%     +97.5%     232775 ±  5%  numa-meminfo.node1.AnonPages
     13905 ± 16%     +19.6%      16627 ± 13%  numa-meminfo.node1.Mapped
     46543 ± 33%     -59.9%      18669 ± 15%  numa-vmstat.node0.nr_active_anon
     46061 ± 34%     -61.2%      17853 ± 16%  numa-vmstat.node0.nr_anon_pages
     33533 ± 13%     -29.5%      23625        numa-vmstat.node0.nr_dirtied
     21898 ± 13%     -29.6%      15420 ±  2%  numa-vmstat.node0.nr_written
     46543 ± 33%     -59.9%      18669 ± 15%  numa-vmstat.node0.nr_zone_active_anon
   1946823 ± 10%     -20.2%    1553363 ±  4%  numa-vmstat.node0.numa_hit
     30438 ± 51%     +92.6%      58610 ±  4%  numa-vmstat.node1.nr_active_anon
     29461 ± 52%     +97.5%      58190 ±  5%  numa-vmstat.node1.nr_anon_pages
      3477 ± 16%     +19.6%       4158 ± 13%  numa-vmstat.node1.nr_mapped
     30438 ± 51%     +92.6%      58610 ±  4%  numa-vmstat.node1.nr_zone_active_anon
      1.75 ±116%   +3442.9%      62.00 ±158%  interrupts.111:PCI-MSI.31981644-edge.i40e-eth0-TxRx-75
      0.00       +2.4e+104%     242.00 ±158%  interrupts.125:PCI-MSI.31981658-edge.i40e-eth0-TxRx-89
    861.75 ± 95%     -80.6%     167.50 ±  4%  interrupts.CPU1.RES:Rescheduling_interrupts
    179.00 ±  2%     -18.3%     146.25 ±  9%  interrupts.CPU11.NMI:Non-maskable_interrupts
    179.00 ±  2%     -18.3%     146.25 ±  9%  interrupts.CPU11.PMI:Performance_monitoring_interrupts
     69.50 ± 44%     -50.7%      34.25 ± 14%  interrupts.CPU13.TLB:TLB_shootdowns
    170.50 ±  8%     -22.7%     131.75 ± 30%  interrupts.CPU15.NMI:Non-maskable_interrupts
    170.50 ±  8%     -22.7%     131.75 ± 30%  interrupts.CPU15.PMI:Performance_monitoring_interrupts
    173.25 ±  7%     -15.6%     146.25 ±  7%  interrupts.CPU16.NMI:Non-maskable_interrupts
    173.25 ±  7%     -15.6%     146.25 ±  7%  interrupts.CPU16.PMI:Performance_monitoring_interrupts
    249.00 ± 25%     -45.0%     137.00 ± 16%  interrupts.CPU16.RES:Rescheduling_interrupts
    240.00 ± 33%     -39.7%     144.75 ± 19%  interrupts.CPU17.RES:Rescheduling_interrupts
    147.75 ± 50%     -60.9%      57.75 ± 76%  interrupts.CPU18.TLB:TLB_shootdowns
    202.25 ± 13%     -25.2%     151.25 ±  7%  interrupts.CPU2.RES:Rescheduling_interrupts
     85.00 ± 20%     -31.5%      58.25 ± 14%  interrupts.CPU20.TLB:TLB_shootdowns
    257.75 ± 19%     -26.4%     189.75 ± 11%  interrupts.CPU22.RES:Rescheduling_interrupts
     72.25 ± 25%     -33.9%      47.75 ± 22%  interrupts.CPU22.TLB:TLB_shootdowns
    321.75 ± 47%     -44.4%     179.00 ± 11%  interrupts.CPU23.RES:Rescheduling_interrupts
    270.25 ± 19%     -31.8%     184.25 ± 13%  interrupts.CPU25.RES:Rescheduling_interrupts
    164.75 ±  7%     -12.9%     143.50 ±  9%  interrupts.CPU26.NMI:Non-maskable_interrupts
    164.75 ±  7%     -12.9%     143.50 ±  9%  interrupts.CPU26.PMI:Performance_monitoring_interrupts
      2657 ± 12%     -24.4%       2008 ±  2%  interrupts.CPU27.CAL:Function_call_interrupts
      2728 ± 13%     -26.0%       2019 ±  3%  interrupts.CPU28.CAL:Function_call_interrupts
    159.75 ±  2%     -20.7%     126.75 ± 26%  interrupts.CPU28.NMI:Non-maskable_interrupts
    159.75 ±  2%     -20.7%     126.75 ± 26%  interrupts.CPU28.PMI:Performance_monitoring_interrupts
    205.00 ± 15%     -20.7%     162.50 ±  8%  interrupts.CPU28.RES:Rescheduling_interrupts
    176.50 ±  6%     -37.1%     111.00 ± 38%  interrupts.CPU3.NMI:Non-maskable_interrupts
    176.50 ±  6%     -37.1%     111.00 ± 38%  interrupts.CPU3.PMI:Performance_monitoring_interrupts
    174.50 ±  7%     -14.3%     149.50 ±  6%  interrupts.CPU30.NMI:Non-maskable_interrupts
    174.50 ±  7%     -14.3%     149.50 ±  6%  interrupts.CPU30.PMI:Performance_monitoring_interrupts
    233.00 ± 19%     -29.8%     163.50 ± 10%  interrupts.CPU31.RES:Rescheduling_interrupts
    163.00 ±  8%     -22.5%     126.25 ± 29%  interrupts.CPU32.NMI:Non-maskable_interrupts
    163.00 ±  8%     -22.5%     126.25 ± 29%  interrupts.CPU32.PMI:Performance_monitoring_interrupts
    164.00 ±  6%     -15.5%     138.50 ±  6%  interrupts.CPU33.NMI:Non-maskable_interrupts
    164.00 ±  6%     -15.5%     138.50 ±  6%  interrupts.CPU33.PMI:Performance_monitoring_interrupts
    173.00 ±  8%     -15.6%     146.00 ±  9%  interrupts.CPU36.NMI:Non-maskable_interrupts
    173.00 ±  8%     -15.6%     146.00 ±  9%  interrupts.CPU36.PMI:Performance_monitoring_interrupts
    199.50 ± 21%     -27.3%     145.00 ± 11%  interrupts.CPU36.RES:Rescheduling_interrupts
    167.75 ±  8%     -14.8%     143.00 ±  7%  interrupts.CPU37.NMI:Non-maskable_interrupts
    167.75 ±  8%     -14.8%     143.00 ±  7%  interrupts.CPU37.PMI:Performance_monitoring_interrupts
    170.50 ±  5%     -27.6%     123.50 ± 22%  interrupts.CPU41.NMI:Non-maskable_interrupts
    170.50 ±  5%     -27.6%     123.50 ± 22%  interrupts.CPU41.PMI:Performance_monitoring_interrupts
    179.75 ± 15%     -22.0%     140.25 ±  6%  interrupts.CPU42.NMI:Non-maskable_interrupts
    179.75 ± 15%     -22.0%     140.25 ±  6%  interrupts.CPU42.PMI:Performance_monitoring_interrupts
    197.25 ±  5%     -29.5%     139.00 ± 11%  interrupts.CPU42.RES:Rescheduling_interrupts
      2719 ± 11%     -25.9%       2016 ±  2%  interrupts.CPU44.CAL:Function_call_interrupts
    193.75 ± 11%     -24.1%     147.00 ±  6%  interrupts.CPU44.RES:Rescheduling_interrupts
    349.75 ± 79%     -55.1%     157.00 ± 24%  interrupts.CPU45.RES:Rescheduling_interrupts
    172.75 ± 15%     -15.9%     145.25 ±  4%  interrupts.CPU46.NMI:Non-maskable_interrupts
    172.75 ± 15%     -15.9%     145.25 ±  4%  interrupts.CPU46.PMI:Performance_monitoring_interrupts
    182.25 ±  9%     -20.6%     144.75 ± 13%  interrupts.CPU48.NMI:Non-maskable_interrupts
    182.25 ±  9%     -20.6%     144.75 ± 13%  interrupts.CPU48.PMI:Performance_monitoring_interrupts
    196.25 ± 12%     -27.3%     142.75 ±  7%  interrupts.CPU49.NMI:Non-maskable_interrupts
    196.25 ± 12%     -27.3%     142.75 ±  7%  interrupts.CPU49.PMI:Performance_monitoring_interrupts
    180.75 ±  8%     -29.5%     127.50 ± 14%  interrupts.CPU50.NMI:Non-maskable_interrupts
    180.75 ±  8%     -29.5%     127.50 ± 14%  interrupts.CPU50.PMI:Performance_monitoring_interrupts
    175.75 ±  6%     -37.3%     110.25 ± 35%  interrupts.CPU51.NMI:Non-maskable_interrupts
    175.75 ±  6%     -37.3%     110.25 ± 35%  interrupts.CPU51.PMI:Performance_monitoring_interrupts
    172.50 ±  6%     -25.8%     128.00 ± 18%  interrupts.CPU52.NMI:Non-maskable_interrupts
    172.50 ±  6%     -25.8%     128.00 ± 18%  interrupts.CPU52.PMI:Performance_monitoring_interrupts
    198.00 ± 54%     -40.7%     117.50 ±  3%  interrupts.CPU52.RES:Rescheduling_interrupts
    182.00 ±  4%     -30.2%     127.00 ± 17%  interrupts.CPU53.NMI:Non-maskable_interrupts
    182.00 ±  4%     -30.2%     127.00 ± 17%  interrupts.CPU53.PMI:Performance_monitoring_interrupts
    176.25 ±  8%     -29.1%     125.00 ± 12%  interrupts.CPU54.NMI:Non-maskable_interrupts
    176.25 ±  8%     -29.1%     125.00 ± 12%  interrupts.CPU54.PMI:Performance_monitoring_interrupts
    174.25 ±  2%     -38.7%     106.75 ± 24%  interrupts.CPU56.NMI:Non-maskable_interrupts
    174.25 ±  2%     -38.7%     106.75 ± 24%  interrupts.CPU56.PMI:Performance_monitoring_interrupts
    291.75 ± 61%     -58.2%     122.00 ±  7%  interrupts.CPU56.RES:Rescheduling_interrupts
    177.50 ±  6%     -31.5%     121.50 ± 19%  interrupts.CPU57.NMI:Non-maskable_interrupts
    177.50 ±  6%     -31.5%     121.50 ± 19%  interrupts.CPU57.PMI:Performance_monitoring_interrupts
    146.50 ± 17%     -28.2%     105.25 ± 24%  interrupts.CPU57.RES:Rescheduling_interrupts
    172.00 ±  2%     -30.8%     119.00 ± 18%  interrupts.CPU58.NMI:Non-maskable_interrupts
    172.00 ±  2%     -30.8%     119.00 ± 18%  interrupts.CPU58.PMI:Performance_monitoring_interrupts
    181.50 ± 17%     -33.7%     120.25 ± 21%  interrupts.CPU62.NMI:Non-maskable_interrupts
    181.50 ± 17%     -33.7%     120.25 ± 21%  interrupts.CPU62.PMI:Performance_monitoring_interrupts
    170.25 ±  5%     -25.3%     127.25 ± 19%  interrupts.CPU63.NMI:Non-maskable_interrupts
    170.25 ±  5%     -25.3%     127.25 ± 19%  interrupts.CPU63.PMI:Performance_monitoring_interrupts
    218.75 ± 52%     -54.1%     100.50 ±  7%  interrupts.CPU64.RES:Rescheduling_interrupts
    225.00 ± 33%     -54.9%     101.50 ± 10%  interrupts.CPU65.RES:Rescheduling_interrupts
    140.25 ±  7%     -33.0%      94.00 ± 11%  interrupts.CPU68.RES:Rescheduling_interrupts
    143.00 ± 11%     -31.5%      98.00 ±  7%  interrupts.CPU70.RES:Rescheduling_interrupts
    201.50 ± 46%     -52.6%      95.50 ±  5%  interrupts.CPU71.RES:Rescheduling_interrupts
    164.25 ±  4%     -12.3%     144.00 ±  9%  interrupts.CPU73.NMI:Non-maskable_interrupts
    164.25 ±  4%     -12.3%     144.00 ±  9%  interrupts.CPU73.PMI:Performance_monitoring_interrupts
      1.50 ±137%   +4016.7%      61.75 ±158%  interrupts.CPU75.111:PCI-MSI.31981644-edge.i40e-eth0-TxRx-75
    168.25 ±  7%     -32.7%     113.25 ± 33%  interrupts.CPU76.NMI:Non-maskable_interrupts
    168.25 ±  7%     -32.7%     113.25 ± 33%  interrupts.CPU76.PMI:Performance_monitoring_interrupts
    191.50 ± 19%     -33.7%     127.00 ±  3%  interrupts.CPU77.RES:Rescheduling_interrupts
      2610 ± 10%     -20.4%       2079 ±  3%  interrupts.CPU82.CAL:Function_call_interrupts
     98.25 ± 26%     +74.0%     171.00 ± 28%  interrupts.CPU83.NMI:Non-maskable_interrupts
     98.25 ± 26%     +74.0%     171.00 ± 28%  interrupts.CPU83.PMI:Performance_monitoring_interrupts
    189.00 ± 13%     -30.7%     131.00 ±  5%  interrupts.CPU85.RES:Rescheduling_interrupts
      2686 ± 11%     -25.7%       1996        interrupts.CPU87.CAL:Function_call_interrupts
    182.25 ± 12%     -23.2%     140.00 ±  9%  interrupts.CPU87.RES:Rescheduling_interrupts
      2681 ± 10%     -19.9%       2148 ±  4%  interrupts.CPU89.CAL:Function_call_interrupts
    180.75 ±  4%     -17.6%     149.00 ± 11%  interrupts.CPU9.NMI:Non-maskable_interrupts
    180.75 ±  4%     -17.6%     149.00 ± 11%  interrupts.CPU9.PMI:Performance_monitoring_interrupts
    270.25 ± 35%     -44.1%     151.00 ± 14%  interrupts.CPU9.RES:Rescheduling_interrupts
      2758 ± 13%     -24.7%       2076 ±  3%  interrupts.CPU90.CAL:Function_call_interrupts
    179.00 ± 16%     -32.1%     121.50 ±  7%  interrupts.CPU90.RES:Rescheduling_interrupts
     75.00 ± 21%     -34.7%      49.00 ± 24%  interrupts.CPU91.TLB:TLB_shootdowns
    170.75 ± 13%     -26.6%     125.25 ± 19%  interrupts.CPU94.NMI:Non-maskable_interrupts
    170.75 ± 13%     -26.6%     125.25 ± 19%  interrupts.CPU94.PMI:Performance_monitoring_interrupts
    183.25 ± 15%     -25.1%     137.25 ± 13%  interrupts.CPU95.RES:Rescheduling_interrupts
     15339 ±  3%     -11.9%      13510 ±  4%  interrupts.NMI:Non-maskable_interrupts
     15339 ±  3%     -11.9%      13510 ±  4%  interrupts.PMI:Performance_monitoring_interrupts
      9.27 ± 14%      -5.0        4.32 ± 16%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
      9.27 ± 14%      -4.9        4.32 ± 16%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
      7.79 ± 25%      -3.6        4.15 ± 32%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.sync
      7.79 ± 25%      -3.6        4.15 ± 32%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.sync
      7.79 ± 25%      -3.6        4.15 ± 32%  perf-profile.calltrace.cycles-pp.__x64_sys_sync.do_syscall_64.entry_SYSCALL_64_after_hwframe.sync
      7.79 ± 25%      -3.6        4.15 ± 32%  perf-profile.calltrace.cycles-pp.ksys_sync.__x64_sys_sync.do_syscall_64.entry_SYSCALL_64_after_hwframe.sync
      7.80 ± 25%      -3.6        4.16 ± 32%  perf-profile.calltrace.cycles-pp.sync
      7.34 ± 30%      -3.4        3.90 ± 31%  perf-profile.calltrace.cycles-pp.iterate_supers.ksys_sync.__x64_sys_sync.do_syscall_64.entry_SYSCALL_64_after_hwframe
      6.87 ± 31%      -3.3        3.58 ± 30%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.iterate_supers.ksys_sync.__x64_sys_sync
      6.89 ± 31%      -3.3        3.60 ± 29%  perf-profile.calltrace.cycles-pp._raw_spin_lock.iterate_supers.ksys_sync.__x64_sys_sync.do_syscall_64
      1.17 ± 36%      -0.9        0.29 ±100%  perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.18 ± 36%      -0.9        0.30 ±100%  perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.11 ± 37%      -0.8        0.27 ±100%  perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.10 ± 37%      -0.8        0.27 ±100%  perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
      0.84 ± 18%      -0.4        0.46 ± 60%  perf-profile.calltrace.cycles-pp.xfs_file_fsync.xfs_file_buffered_aio_write.new_sync_write.vfs_write.ksys_write
      0.94 ± 14%      -0.3        0.65 ± 18%  perf-profile.calltrace.cycles-pp.xfs_file_buffered_aio_write.new_sync_write.vfs_write.ksys_write.do_syscall_64
      1.13 ±  3%      +0.2        1.30        perf-profile.calltrace.cycles-pp.__next_timer_interrupt.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select
      1.78 ±  7%      +0.2        2.02 ±  4%  perf-profile.calltrace.cycles-pp.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle
      1.02 ±  7%      +0.3        1.35 ±  5%  perf-profile.calltrace.cycles-pp.rebalance_domains.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt
      0.40 ± 57%      +0.3        0.75 ± 16%  perf-profile.calltrace.cycles-pp.load_balance.rebalance_domains.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt
      0.14 ±173%      +0.5        0.59 ±  6%  perf-profile.calltrace.cycles-pp._find_next_bit.__next_timer_interrupt.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length
      0.29 ±100%      +0.5        0.74 ± 22%  perf-profile.calltrace.cycles-pp.rcu_sched_clock_irq.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
      2.64 ±  8%      +0.6        3.19 ± 12%  perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
      2.77 ±  8%      +0.6        3.35 ± 15%  perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt
      0.70 ± 18%      +0.6        1.33 ± 11%  perf-profile.calltrace.cycles-pp.__do_execve_file.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
      0.70 ± 18%      +0.6        1.34 ± 11%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.execve
      0.70 ± 18%      +0.6        1.34 ± 11%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
      0.70 ± 18%      +0.6        1.34 ± 11%  perf-profile.calltrace.cycles-pp.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
      0.70 ± 19%      +0.6        1.35 ± 12%  perf-profile.calltrace.cycles-pp.execve
      3.97 ±  9%      +0.8        4.73 ±  7%  perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
      0.00            +1.1        1.14 ± 39%  perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
      0.00            +1.1        1.15 ± 39%  perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
      0.00            +1.1        1.15 ± 39%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
      0.00            +1.1        1.15 ± 39%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
      5.79 ±  4%      +1.1        6.94 ±  7%  perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
      0.00            +1.2        1.16 ± 38%  perf-profile.calltrace.cycles-pp.write
     77.51 ±  4%      +5.1       82.62 ±  2%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
     77.51 ±  4%      +5.1       82.62 ±  2%  perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
     77.46 ±  4%      +5.1       82.58 ±  2%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
     78.36 ±  4%      +5.3       83.65 ±  2%  perf-profile.calltrace.cycles-pp.secondary_startup_64
      8.05 ± 27%      -3.7        4.39 ± 31%  perf-profile.children.cycles-pp.__x64_sys_sync
      8.05 ± 27%      -3.7        4.39 ± 31%  perf-profile.children.cycles-pp.ksys_sync
      8.73 ± 26%      -3.7        5.08 ± 23%  perf-profile.children.cycles-pp._raw_spin_lock
      7.80 ± 25%      -3.6        4.16 ± 32%  perf-profile.children.cycles-pp.sync
      7.36 ± 29%      -3.3        4.08 ± 32%  perf-profile.children.cycles-pp.iterate_supers
      0.68 ± 24%      -0.4        0.31 ± 29%  perf-profile.children.cycles-pp.iterate_bdevs
      0.79 ±  9%      -0.4        0.43 ± 29%  perf-profile.children.cycles-pp.queued_write_lock_slowpath
      0.94 ± 14%      -0.3        0.65 ± 18%  perf-profile.children.cycles-pp.xfs_file_buffered_aio_write
      0.78 ± 16%      -0.3        0.49 ± 26%  perf-profile.children.cycles-pp.__do_sys_wait4
      0.78 ± 17%      -0.3        0.48 ± 25%  perf-profile.children.cycles-pp.do_wait
      0.78 ± 34%      -0.3        0.49 ±  5%  perf-profile.children.cycles-pp.ksys_mmap_pgoff
      0.78 ± 16%      -0.3        0.49 ± 26%  perf-profile.children.cycles-pp.kernel_wait4
      0.84 ± 18%      -0.3        0.58 ± 16%  perf-profile.children.cycles-pp.xfs_file_fsync
      0.93 ± 16%      -0.3        0.67 ± 23%  perf-profile.children.cycles-pp.free_pgtables
      0.40 ± 19%      -0.2        0.21 ± 33%  perf-profile.children.cycles-pp.queued_read_lock_slowpath
      0.55 ± 18%      -0.2        0.38 ± 11%  perf-profile.children.cycles-pp.pick_next_task_fair
      0.54 ± 16%      -0.2        0.37 ±  8%  perf-profile.children.cycles-pp.newidle_balance
      0.89 ± 12%      -0.2        0.73 ± 17%  perf-profile.children.cycles-pp.__schedule
      0.39 ± 17%      -0.2        0.23 ± 14%  perf-profile.children.cycles-pp.submit_bio
      0.39 ± 17%      -0.2        0.23 ± 14%  perf-profile.children.cycles-pp.generic_make_request
      0.42 ± 11%      -0.2        0.27 ± 12%  perf-profile.children.cycles-pp.enqueue_task_fair
      0.33 ± 23%      -0.1        0.18 ± 14%  perf-profile.children.cycles-pp.__xfs_log_force_lsn
      0.37 ± 20%      -0.1        0.22 ± 14%  perf-profile.children.cycles-pp.blk_mq_make_request
      0.41 ± 13%      -0.1        0.27 ± 13%  perf-profile.children.cycles-pp.activate_task
      0.40 ± 11%      -0.1        0.26 ± 11%  perf-profile.children.cycles-pp.ttwu_do_activate
      0.40 ± 12%      -0.1        0.26 ± 11%  perf-profile.children.cycles-pp.enqueue_entity
      0.29 ± 13%      -0.1        0.18 ± 12%  perf-profile.children.cycles-pp.__account_scheduler_latency
      0.23 ± 18%      -0.1        0.13 ± 22%  perf-profile.children.cycles-pp.arch_stack_walk
      0.21 ± 19%      -0.1        0.12 ± 15%  perf-profile.children.cycles-pp.do_writepages
      0.16 ± 15%      -0.1        0.07 ± 61%  perf-profile.children.cycles-pp.unwind_next_frame
      0.21 ± 18%      -0.1        0.12 ± 15%  perf-profile.children.cycles-pp.xfs_vm_writepages
      0.23 ± 15%      -0.1        0.15 ± 19%  perf-profile.children.cycles-pp.stack_trace_save_tsk
      0.20 ± 11%      -0.1        0.12 ± 13%  perf-profile.children.cycles-pp.file_write_and_wait_range
      0.20 ± 18%      -0.1        0.12 ± 28%  perf-profile.children.cycles-pp.io_schedule
      0.18 ± 12%      -0.1        0.10 ± 19%  perf-profile.children.cycles-pp.xfs_file_read_iter
      0.16 ± 30%      -0.1        0.09 ± 29%  perf-profile.children.cycles-pp.down_read
      0.24 ±  9%      -0.1        0.17 ±  4%  perf-profile.children.cycles-pp.new_sync_read
      0.27 ± 11%      -0.1        0.21 ± 14%  perf-profile.children.cycles-pp.blk_done_softirq
      0.16 ± 19%      -0.1        0.10 ± 15%  perf-profile.children.cycles-pp.__filemap_fdatawrite_range
      0.12 ± 16%      -0.1        0.06 ± 67%  perf-profile.children.cycles-pp.free_pages_and_swap_cache
      0.12 ± 37%      -0.1        0.07 ± 36%  perf-profile.children.cycles-pp.legitimize_path
      0.25 ± 11%      -0.1        0.19 ± 12%  perf-profile.children.cycles-pp.scsi_end_request
      0.12 ± 24%      -0.1        0.07 ± 12%  perf-profile.children.cycles-pp.__rq_qos_throttle
      0.12 ± 24%      -0.1        0.07 ± 12%  perf-profile.children.cycles-pp.rq_qos_wait
      0.12 ± 24%      -0.1        0.07 ± 12%  perf-profile.children.cycles-pp.wbt_wait
      0.25 ± 11%      -0.1        0.20 ± 11%  perf-profile.children.cycles-pp.scsi_io_completion
      0.10 ± 21%      -0.0        0.06 ± 13%  perf-profile.children.cycles-pp.wake_up_page_bit
      0.10 ± 21%      -0.0        0.05 ±  8%  perf-profile.children.cycles-pp.generic_file_buffered_read
      0.12 ± 16%      -0.0        0.08 ± 19%  perf-profile.children.cycles-pp.__mmap
      0.12 ±  8%      +0.0        0.14 ±  9%  perf-profile.children.cycles-pp.trigger_load_balance
      0.13 ± 20%      +0.0        0.17 ± 12%  perf-profile.children.cycles-pp.wp_page_copy
      0.13 ± 26%      +0.0        0.17 ±  7%  perf-profile.children.cycles-pp.cpumask_next_and
      0.03 ±100%      +0.0        0.07 ± 10%  perf-profile.children.cycles-pp.sync_regs
      0.08 ± 58%      +0.1        0.15 ± 11%  perf-profile.children.cycles-pp.__libc_start_main
      0.08 ± 58%      +0.1        0.15 ± 11%  perf-profile.children.cycles-pp.main
      0.08 ± 58%      +0.1        0.15 ± 11%  perf-profile.children.cycles-pp.run_builtin
      0.08 ± 58%      +0.1        0.15 ± 11%  perf-profile.children.cycles-pp.cmd_stat
      0.08 ± 58%      +0.1        0.15 ± 11%  perf-profile.children.cycles-pp.__run_perf_stat
      0.04 ±104%      +0.1        0.12 ± 10%  perf-profile.children.cycles-pp.rb_insert_color
      0.07 ± 58%      +0.1        0.15 ± 11%  perf-profile.children.cycles-pp.dispatch_events
      0.07 ± 58%      +0.1        0.15 ± 11%  perf-profile.children.cycles-pp.process_interval
      0.07 ± 58%      +0.1        0.15 ± 11%  perf-profile.children.cycles-pp.read_counters
      0.01 ±173%      +0.1        0.09 ± 46%  perf-profile.children.cycles-pp.sys_imageblit
      0.01 ±173%      +0.1        0.09 ± 46%  perf-profile.children.cycles-pp.drm_fb_helper_sys_imageblit
      0.03 ±102%      +0.1        0.11 ± 33%  perf-profile.children.cycles-pp.vt_console_print
      0.01 ±173%      +0.1        0.10 ± 42%  perf-profile.children.cycles-pp.bit_putcs
      0.01 ±173%      +0.1        0.10 ± 42%  perf-profile.children.cycles-pp.fbcon_redraw
      0.01 ±173%      +0.1        0.10 ± 42%  perf-profile.children.cycles-pp.fbcon_putcs
      0.01 ±173%      +0.1        0.11 ± 36%  perf-profile.children.cycles-pp.lf
      0.01 ±173%      +0.1        0.11 ± 36%  perf-profile.children.cycles-pp.con_scroll
      0.01 ±173%      +0.1        0.11 ± 36%  perf-profile.children.cycles-pp.fbcon_scroll
      1.05 ±  5%      +0.1        1.14 ±  5%  perf-profile.children.cycles-pp.sched_clock_cpu
      0.19 ± 13%      +0.1        0.28 ± 35%  perf-profile.children.cycles-pp.rcu_irq_enter
      0.80 ±  7%      +0.1        0.91 ±  3%  perf-profile.children.cycles-pp._find_next_bit
      0.32 ± 13%      +0.1        0.44 ± 16%  perf-profile.children.cycles-pp.__intel_pmu_enable_all
      0.65 ±  7%      +0.1        0.77 ±  6%  perf-profile.children.cycles-pp.irqtime_account_irq
      0.00            +0.1        0.13 ± 57%  perf-profile.children.cycles-pp.open64
      0.29 ±  5%      +0.1        0.43 ± 31%  perf-profile.children.cycles-pp.run_timer_softirq
      0.10 ±  7%      +0.2        0.27 ±  7%  perf-profile.children.cycles-pp.read
      1.02 ±  3%      +0.2        1.20        perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
      0.07 ± 67%      +0.2        0.25 ± 29%  perf-profile.children.cycles-pp.delay_tsc
      1.25 ±  6%      +0.2        1.44 ±  3%  perf-profile.children.cycles-pp.__next_timer_interrupt
      0.56 ±  9%      +0.2        0.76 ± 23%  perf-profile.children.cycles-pp.rcu_sched_clock_irq
      0.57 ± 15%      +0.2        0.79 ± 23%  perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
      0.00            +0.3        0.27 ± 23%  perf-profile.children.cycles-pp.__waitpid
      1.79 ±  7%      +0.3        2.07 ±  4%  perf-profile.children.cycles-pp.get_next_timer_interrupt
      0.07 ±173%      +0.3        0.36 ±  9%  perf-profile.children.cycles-pp.wake_up_klogd_work_func
      0.00            +0.3        0.34 ± 49%  perf-profile.children.cycles-pp.creat64
      1.04 ±  6%      +0.3        1.39 ±  6%  perf-profile.children.cycles-pp.rebalance_domains
      0.00            +0.4        0.36 ± 17%  perf-profile.children.cycles-pp.unlink
      0.58 ± 13%      +0.4        0.98 ± 20%  perf-profile.children.cycles-pp.io_serial_in
      0.76 ± 14%      +0.4        1.17 ± 13%  perf-profile.children.cycles-pp.irq_work_run_list
      0.65 ± 15%      +0.5        1.19 ± 22%  perf-profile.children.cycles-pp.serial8250_console_putchar
      0.68 ± 13%      +0.6        1.24 ± 23%  perf-profile.children.cycles-pp.uart_console_write
      0.67 ± 15%      +0.6        1.23 ± 22%  perf-profile.children.cycles-pp.wait_for_xmitr
      0.70 ± 14%      +0.6        1.29 ± 23%  perf-profile.children.cycles-pp.serial8250_console_write
      0.70 ± 19%      +0.6        1.35 ± 12%  perf-profile.children.cycles-pp.execve
      0.74 ± 14%      +0.7        1.40 ± 23%  perf-profile.children.cycles-pp.console_unlock
      2.77 ±  7%      +0.7        3.51 ± 14%  perf-profile.children.cycles-pp.update_process_times
      2.88 ±  6%      +0.8        3.66 ± 17%  perf-profile.children.cycles-pp.tick_sched_handle
      4.11 ±  8%      +0.9        5.05 ±  7%  perf-profile.children.cycles-pp.tick_sched_timer
      0.03 ±100%      +1.1        1.16 ± 38%  perf-profile.children.cycles-pp.write
      6.00 ±  3%      +1.4        7.38 ±  9%  perf-profile.children.cycles-pp.__hrtimer_run_queues
     11.46 ± 10%      +2.1       13.59 ±  5%  perf-profile.children.cycles-pp.hrtimer_interrupt
     77.51 ±  4%      +5.1       82.62 ±  2%  perf-profile.children.cycles-pp.start_secondary
     78.36 ±  4%      +5.3       83.65 ±  2%  perf-profile.children.cycles-pp.secondary_startup_64
     78.36 ±  4%      +5.3       83.65 ±  2%  perf-profile.children.cycles-pp.cpu_startup_entry
     78.36 ±  4%      +5.3       83.65 ±  2%  perf-profile.children.cycles-pp.do_idle
      0.15 ± 28%      -0.1        0.08 ± 27%  perf-profile.self.cycles-pp.down_read
      0.12 ± 16%      -0.1        0.06 ± 68%  perf-profile.self.cycles-pp.free_pages_and_swap_cache
      0.03 ±100%      +0.0        0.07 ± 10%  perf-profile.self.cycles-pp.sync_regs
      0.04 ±104%      +0.1        0.12 ±  7%  perf-profile.self.cycles-pp.rb_insert_color
      0.52 ±  7%      +0.1        0.59 ±  6%  perf-profile.self.cycles-pp.__next_timer_interrupt
      0.01 ±173%      +0.1        0.09 ± 46%  perf-profile.self.cycles-pp.sys_imageblit
      0.14 ± 13%      +0.1        0.23 ± 39%  perf-profile.self.cycles-pp.sched_clock_cpu
      0.17 ±  7%      +0.1        0.27 ± 35%  perf-profile.self.cycles-pp.run_timer_softirq
      0.32 ± 13%      +0.1        0.44 ± 16%  perf-profile.self.cycles-pp.__intel_pmu_enable_all
      0.07 ± 67%      +0.2        0.25 ± 29%  perf-profile.self.cycles-pp.delay_tsc
      0.58 ± 13%      +0.4        0.98 ± 20%  perf-profile.self.cycles-pp.io_serial_in


                                                                                
                                reaim.jobs_per_min                              
                                                                                
  4200 +--------------------------------------------------------------------+   
  4150 |-+    +..           +.. .+..                                        |   
       |     :       +..+. +   +                                            |   
  4100 |.+.. :   +. +     +         +.       +.     +..                   +.|   
  4050 |-+  +      +                  +.+    : +    :            .+..+. ..  |   
       |           O                     +  :   +  :   +.+.+..+.+      +    |   
  4000 |-+                                + :    + :                        |   
  3950 |-+                          O      +      +                         |   
  3900 |-+                       O           O                              |   
       | O  O        O  O   O         O O                                   |   
  3850 |-+    O  O             O           O   O    O    O                O |   
  3800 |-+                                                 O      O    O    |   
       |                  O                                   O      O      |   
  3750 |-+                                        O    O        O           |   
  3700 +--------------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Oliver Sang


View attachment "config-5.6.0-rc4-00120-g2def2845cc3339" of type "text/plain" (155869 bytes)

View attachment "job-script" of type "text/plain" (8065 bytes)

View attachment "job.yaml" of type "text/plain" (5590 bytes)

View attachment "reproduce" of type "text/plain" (727 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ