lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Date:   Mon, 13 Mar 2017 16:57:15 +0100
From:   Thorsten Leemhuis <regressions@...mhuis.info>
To:     Chao Yu <yuchao0@...wei.com>
Cc:     kernel test robot <xiaolong.ye@...el.com>, lkp@...org,
        linux-kernel@...r.kernel.org, Jaegeuk Kim <jaegeuk@...nel.org>
Subject: Re: [lkp-robot] [f2fs] 4ac912427c: -33.7% aim7.jobs-per-min
 regression

@Chao Yu/@...geuk Kim: I'm considering to add this to the regressions
report for 4.11; or is there a reason why it shouldn't be considered a
regression? Ciao, Thorsten

On 08.03.2017 02:21, kernel test robot wrote:
> 
> Greeting,
> 
> We noticed a -33.7 regression of aim7.jobs-per-min due to commit:
> 
> commit: 4ac912427c4214d8031d9ad6fbc3bc75e71512df ("f2fs: introduce free nid bitmap")
> https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
> 
> in testcase: aim7
> on test machine: 40 threads Intel(R) Xeon(R) CPU E5-2690 v2 @ 3.00GHz with 384G memory
> with following parameters:
> 
> 	disk: 1BRD_48G
> 	fs: f2fs
> 	test: disk_wrt
> 	load: 3000
> 	cpufreq_governor: performance
> 
> test-description: AIM7 is a traditional UNIX system level benchmark suite which is used to test and measure the performance of multiuser system.
> test-url: https://sourceforge.net/projects/aimbench/files/aim-suite7/
> 
> 
> 
> Details are as below:
> -------------------------------------------------------------------------------------------------->
> 
> 
> To reproduce:
> 
>         git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
>         cd lkp-tests
>         bin/lkp install job.yaml  # job file is attached in this email
>         bin/lkp run     job.yaml
> 
> testcase/path_params/tbox_group/run: aim7/1BRD_48G-f2fs-disk_wrt-3000-performance/lkp-ivb-ep01
> 
> ced2c7ea8e99b467  4ac912427c4214d8031d9ad6fb
> ----------------  --------------------------
>          %stddev      change         %stddev
>              \          |                \
>     117419 ±  1%     -33.7%      77863 ±  0%  aim7.jobs-per-min
>     153.78 ±  1%     +50.6%     231.63 ±  0%  aim7.time.elapsed_time
>     153.78 ±  1%     +50.6%     231.63 ±  0%  aim7.time.elapsed_time.max
>     805644 ±  3%     +11.3%     896604 ±  0%  aim7.time.involuntary_context_switches
>       5408 ±  1%     +15.4%       6240 ±  0%  aim7.time.system_time
>    5066069 ±  0%     +10.5%    5600256 ±  9%  meminfo.DirectMap2M
>     135538 ±  8%     -41.9%      78738 ±  8%  meminfo.Dirty
>     980.67 ± 16%     -67.8%     315.50 ± 12%  meminfo.Writeback
>      71322 ± 10%     -44.0%      39953 ±  1%  numa-meminfo.node0.Dirty
>      11158 ± 18%     -27.1%       8132 ±  0%  numa-meminfo.node0.Mapped
>      56776 ±  6%     -32.5%      38309 ±  0%  numa-meminfo.node1.Dirty
>       9684 ± 22%     +30.9%      12676 ±  0%  numa-meminfo.node1.Mapped
>       6069 ± 57%     -78.1%       1328 ± 18%  softirqs.NET_RX
>     619333 ±  4%      +8.0%     669152 ±  3%  softirqs.RCU
>     128030 ±  2%     +33.3%     170724 ±  0%  softirqs.SCHED
>    2331994 ±  1%     +15.3%    2688290 ±  0%  softirqs.TIMER
>       7701 ±  1%     -35.7%       4948 ±  3%  vmstat.io.bo
>      64.67 ±  2%     -39.7%      39.00 ±  2%  vmstat.procs.b
>     333.33 ±  7%     -48.5%     171.50 ±  2%  vmstat.procs.r
>      17530 ±  1%     -23.4%      13425 ±  1%  vmstat.system.cs
>      47642 ±  1%      -5.3%      45100 ±  1%  vmstat.system.in
>      33522 ±  4%     -43.1%      19068 ±  0%  proc-vmstat.nr_dirty
>     236.00 ± 14%     -66.1%      80.00 ±  3%  proc-vmstat.nr_writeback
>      33907 ±  4%     -43.3%      19222 ±  0%  proc-vmstat.nr_zone_write_pending
>      28194 ± 10%     +10.4%      31131 ±  6%  proc-vmstat.pgactivate
>     746402 ±  2%     +24.6%     929960 ±  3%  proc-vmstat.pgfault
>     153.78 ±  1%     +50.6%     231.63 ±  0%  time.elapsed_time
>     153.78 ±  1%     +50.6%     231.63 ±  0%  time.elapsed_time.max
>     805644 ±  3%     +11.3%     896604 ±  0%  time.involuntary_context_switches
>       3524 ±  0%     -23.4%       2701 ±  0%  time.percent_of_cpu_this_job_got
>       5408 ±  1%     +15.4%       6240 ±  0%  time.system_time
>      12.19 ±  1%     +36.7%      16.66 ±  0%  time.user_time
>   48260939 ±  3%     +12.1%   54110616 ±  2%  cpuidle.C1-IVT.time
>   33149237 ±  5%     +52.6%   50597349 ±  1%  cpuidle.C1E-IVT.time
>      89642 ±  4%     +52.8%     136976 ±  0%  cpuidle.C1E-IVT.usage
>   13534795 ±  6%    +276.3%   50934566 ± 55%  cpuidle.C3-IVT.time
>      42893 ±  6%    +138.8%     102439 ± 30%  cpuidle.C3-IVT.usage
>  6.431e+08 ±  2%    +390.1%  3.152e+09 ± 10%  cpuidle.C6-IVT.time
>     802009 ±  2%    +375.3%    3811880 ± 10%  cpuidle.C6-IVT.usage
>    1535987 ±  4%    +156.3%    3936830 ±  4%  cpuidle.POLL.time
>      88.14 ±  0%     -24.9%      66.17 ±  3%  turbostat.%Busy
>       2659 ±  0%     -44.7%       1471 ±  3%  turbostat.Avg_MHz
>       3016 ±  0%     -26.3%       2224 ±  0%  turbostat.Bzy_MHz
>       5.20 ±  5%    +127.0%      11.80 ±  2%  turbostat.CPU%c1
> 
> 
> 
>                                 perf-stat.page-faults
> 
>    1e+06 ++-----------------------------------------------------------------+
>   900000 O+O O   O O  O       O            O O                              |
>          |     O        O O O   O O O O O          O                        |
>   800000 ++              .*.*.                .*. .*.         .*..          |
>   700000 ++*.*.*.*.*..*.*     *.*.*.*.*.*..*.*   *   *.*.*.*.*    *.*.*.*   *
>          | :                                                            :   |
>   600000 ++:                                                            :   |
>   500000 ++                                                              : :|
>   400000 ++                                                              : :|
>          |:                                                              : :|
>   300000 ++                                                              : :|
>   200000 ++                                                              : :|
>          |                                                                : |
>   100000 ++                                                               : |
>        0 *+------------------------------------O-O------------------------*-+
> 
> 
>                                perf-stat.minor-faults
> 
>    1e+06 ++-----------------------------------------------------------------+
>   900000 O+O O   O O  O       O            O O                              |
>          |     O        O O O   O O O O O          O                        |
>   800000 ++              .*.*.                .*. .*.         .*..          |
>   700000 ++*.*.*.*.*..*.*     *.*.*.*.*.*..*.*   *   *.*.*.*.*    *.*.*.*   *
>          | :                                                            :   |
>   600000 ++:                                                            :   |
>   500000 ++                                                              : :|
>   400000 ++                                                              : :|
>          |:                                                              : :|
>   300000 ++                                                              : :|
>   200000 ++                                                              : :|
>          |                                                                : |
>   100000 ++                                                               : |
>        0 *+------------------------------------O-O------------------------*-+
> 
> 
>                                   aim7.jobs-per-min
> 
>   140000 ++-----------------------------------------------------------------+
>          | *.     .*..     .*.*.*.*.*.*.*..*.*.*.*.*.*.                     |
>   120000 ++: *.*.*    *.*.*                            *.*.*.*.*..*.*.*.    *
>          | :                                                            *   |
>   100000 ++:                                                            :   |
>          |:                                                             :   |
>    80000 O+O O O O O  O O O O O O O O O O  O O     O                     : :|
>          |:                                                              : :|
>    60000 ++                                                              : :|
>          |:                                                              : :|
>    40000 ++                                                              : :|
>          |                                                               : :|
>    20000 ++                                                               : |
>          |                                                                : |
>        0 *+------------------------------------O-O------------------------*-+
> 
> 
> 
> 	[*] bisect-good sample
> 	[O] bisect-bad  sample
> 
> 
> Disclaimer:
> Results have been estimated based on internal Intel analysis and are provided
> for informational purposes only. Any difference in system hardware or software
> design or configuration may affect actual performance.
> 
> 
> Thanks,
> Xiaolong
> 

Powered by blists - more mailing lists