linux-kernel - [lkp-robot] [EXPERIMENTAL] 72536b6862: netperf.Throughput

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [day] [month] [year] [list]

Message-ID: <20170920020530.GA30230@yexl-desktop>
Date:   Wed, 20 Sep 2017 10:05:30 +0800
From:   kernel test robot <xiaolong.ye@...el.com>
To:     "Paul E. McKenney" <paulmck@...ux.vnet.ibm.com>
Cc:     LKML <linux-kernel@...r.kernel.org>,
        "Paul E. McKenney" <paulmck@...ux.vnet.ibm.com>, lkp@...org
Subject: [lkp-robot] [EXPERIMENTAL]  72536b6862:  netperf.Throughput_Mbps
 -6.0% regression


Greeting,

FYI, we noticed a -6.0% regression of netperf.Throughput_Mbps due to commit:


commit: 72536b68621517bc5ffb3275a79cd76111f71d02 ("EXPERIMENTAL: Diagnostics for lost timer events")
https://git.kernel.org/cgit/linux/kernel/git/paulmck/linux-rcu.git dev.2017.09.19b

in testcase: netperf
on test machine: 4 threads Intel(R) Core(TM) i5-3317U CPU @ 1.70GHz with 4G memory
with following parameters:

	ip: ipv4
	runtime: 900s
	nr_threads: 1
	cluster: cs-localhost
	test: TCP_MAERTS
	cpufreq_governor: performance

test-description: Netperf is a benchmark that can be use to measure various aspect of networking performance.
test-url: http://www.netperf.org/netperf/


Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml

testcase/path_params/tbox_group/run: netperf/ipv4-900s-1-cs-localhost-TCP_MAERTS-performance/lkp-u410

0f27edb3ca0a17cf  72536b68621517bc5ffb3275a7  
----------------  --------------------------  
     12.31 ±  8%        26%      15.47 ±  8%  netperf.time.user_time
     31896              -6%      29977        netperf.Throughput_Mbps
      8802              11%       9774        vmstat.system.in
          1:4          -25%            :4     kmsg.DHCP/BOOTP:Reply_not_for_us_on_eth#,op[#]xid[#]
      0.09 ± 11%        39%       0.13 ± 16%  perf-stat.dTLB-load-miss-rate%
 9.713e+08 ± 18%        36%  1.321e+09 ± 18%  perf-stat.dTLB-load-misses
      1.36               5%       1.42        perf-stat.branch-miss-rate%
     19789             144%      48346        perf-stat.cpu-migrations
 7.813e+11 ±  6%        -8%  7.185e+11 ±  5%  perf-stat.dTLB-stores
      6423             -15%       5470        perf-stat.instructions-per-iTLB-miss


                                                                                
                              perf-stat.cpu-migrations                          
                                                                                
  60000 +-+-----------------------------------------------------------------+   
        O    O    O           O                                             |   
  55000 +-+         O    O O    O           O  O O  O    O                  |   
  50000 +-O                        O O  O O           O    O O         O    |   
        |      O       O                                        O O  O      |   
  45000 +-+                                                                 |   
  40000 +-+                                                                 |   
        |                                                                   |   
  35000 +-+                                                                 |   
  30000 +-+                                                                 |   
        |                                                                   |   
  25000 +-+                                                                 |   
  20000 +-+                    .+.. .+..+.         .+.                     .|   
        | +..+.+..+.+..+.+.+..+    +      +.+..+.+.   +..+.+.+..+.+..+.+..+ |   
  15000 +-+-----------------------------------------------------------------+   
                                                                                

[*] bisect-good sample
[O] bisect-bad  sample


Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Xiaolong

View attachment "config-4.14.0-rc1-00015-g72536b6" of type "text/plain" (163255 bytes)

View attachment "job-script" of type "text/plain" (7218 bytes)

View attachment "job.yaml" of type "text/plain" (4804 bytes)

View attachment "reproduce" of type "text/plain" (331 bytes)