lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Message-ID: <20170526070317.GB31294@yexl-desktop>
Date:   Fri, 26 May 2017 15:03:18 +0800
From:   kernel test robot <xiaolong.ye@...el.com>
To:     "Paul E. McKenney" <paulmck@...ux.vnet.ibm.com>
Cc:     LKML <linux-kernel@...r.kernel.org>,
        "Paul E. McKenney" <paulmck@...ux.vnet.ibm.com>, lkp@...org
Subject: [lkp-robot] [rcu]  d34303a1ef:  unixbench.score -12.8% regression


Greeting,

FYI, we noticed a -12.8% regression of unixbench.score due to commit:


commit: d34303a1ef67e7e38e79d63d2b3aca1a12df3b37 ("rcu: Eliminate NOCBs CPU-state Kconfig options")
https://git.kernel.org/cgit/linux/kernel/git/paulmck/linux-rcu.git dev.2017.05.25a

in testcase: unixbench
on test machine: 12 threads Intel(R) Atom(R) CPU 3958 @ 2.00GHz with 64G memory
with following parameters:

	runtime: 300s
	nr_task: 1
	test: spawn
	cpufreq_governor: performance

test-description: UnixBench is the original BYTE UNIX benchmark suite aims to test performance of Unix-like system.
test-url: https://github.com/kdlucas/byte-unixbench



Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/01org/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml

testcase/path_params/tbox_group/run: unixbench/300s-1-spawn-performance/lkp-denverton3

6e74c237c410c0c7  d34303a1ef67e7e38e79d63d2b  
----------------  --------------------------  
         %stddev      change         %stddev
             \          |                \  
       480             -13%        418        unixbench.score
   3539621             -12%    3125335        unixbench.time.voluntary_context_switches
  42363545             -14%   36485173        unixbench.time.minor_page_faults
    176944              76%     311173 ±  3%  interrupts.CAL:Function_call_interrupts
     28259               4%      29287        vmstat.system.in
     55147              -7%      51021        vmstat.system.cs
         0            1e+04       9887 ±103%  latency_stats.avg.perf_event_alloc.SYSC_perf_event_open.SyS_perf_event_open.entry_SYSCALL_64_fastpath
         0            1e+04       9887 ±103%  latency_stats.max.perf_event_alloc.SYSC_perf_event_open.SyS_perf_event_open.entry_SYSCALL_64_fastpath
         0            1e+04       9887 ±103%  latency_stats.sum.perf_event_alloc.SYSC_perf_event_open.SyS_perf_event_open.entry_SYSCALL_64_fastpath
      2.99              45%       4.34        perf-stat.branch-miss-rate%
      8.00              26%      10.06        perf-stat.cache-miss-rate%
 2.881e+09              26%  3.619e+09        perf-stat.branch-misses
 3.134e+09              22%  3.831e+09        perf-stat.cache-misses
      0.04 ±  5%        13%       0.04 ±  3%  perf-stat.iTLB-load-miss-rate%
  18327237              -7%   16964457        perf-stat.context-switches
      0.51             -11%       0.45        perf-stat.ipc
 5.116e+11             -12%  4.489e+11        perf-stat.iTLB-loads
      2550 ±  5%       -13%       2223 ±  5%  perf-stat.instructions-per-iTLB-miss
 5.113e+11             -13%  4.436e+11        perf-stat.instructions
  9.62e+10             -13%  8.335e+10        perf-stat.branch-instructions
  42719474             -14%   36840024        perf-stat.minor-faults
  42719477             -14%   36840026        perf-stat.page-faults
    437104 ±  3%       -26%     322992 ±  3%  perf-stat.cpu-migrations



                       interrupts.CAL:Function_call_interrupts

  450000 ++-----------------------------------------------------------------+
         |                                                                  |
  400000 ++             O                                                   |
         |                                                                  |
         |                                                                  |
  350000 ++O              O  O                                              |
         O    O    O O         O  O    O    O O  O      O                   |
  300000 ++     O                   O    O         O  O    O                |
         |                                                                  |
  250000 ++                                                                 |
         |                   *                                              |
         |                  + +                                             |
  200000 ++    .*..        +   *..*.       .*.  .*.    .*.. .*..            |
         *.*..*    *.*..*.*         *..*.*.   *.   *..*    *    *.*..*.*..*.*
  150000 ++-----------------------------------------------------------------+


                                perf-stat.instructions

  5.3e+11 ++----------------------------------------------------------------+
  5.2e+11 ++                                            *..                 |
          | *..*.*..         .*.                       +    .*.. .*..*.    .*
  5.1e+11 ++        *.*..*.*.   *.*..      .*..*.*..*.*    *    *      *..* |
    5e+11 *+                          .*..*                                 |
          |                          *                                      |
  4.9e+11 ++                                                                |
  4.8e+11 ++                                                                |
  4.7e+11 ++                                                                |
          |                            O    O                               |
  4.6e+11 ++                                            O                   |
  4.5e+11 ++   O O                   O    O      O                          |
          O O         O  O      O O            O           O                |
  4.4e+11 ++        O      O  O                     O O                     |
  4.3e+11 ++----------------------------------------------------------------+


                             perf-stat.branch-instructions

    1e+11 ++----------------------------------------------------------------+
  9.8e+10 ++                                            *..                 |
          | *.. .*..         .*.                       +    .*.. .*..*.    .*
  9.6e+10 ++   *    *.*..*.*.   *.*..      .*..*.*..*.*    *    *      *..* |
  9.4e+10 *+                          .*..*                                 |
          |                          *                                      |
  9.2e+10 ++                                                                |
    9e+10 ++                                                                |
  8.8e+10 ++                                                                |
          |                            O    O                               |
  8.6e+10 ++                         O    O      O      O                   |
  8.4e+10 O+   O O    O         O O            O           O                |
          | O       O    O O  O                                             |
  8.2e+10 ++                                        O O                     |
    8e+10 ++----------------------------------------------------------------+


                                 perf-stat.iTLB-loads

  5.3e+11 ++-----*---------------------*------------------------------------+
  5.2e+11 ++     :+                  *    *                                 |
          |     :  +         .*.   ..      +                             .*.*
  5.1e+11 *+*.. :   *.*..*.*.   *.*         *..*.*..*.*.  .*.*..*.*.. .*.   |
    5e+11 ++   *                                        *.           *      |
          |                                                                 |
  4.9e+11 ++                                                                |
  4.8e+11 ++                                                                |
  4.7e+11 ++                                                                |
          |                                                                 |
  4.6e+11 ++        O O                               O                     |
  4.5e+11 ++O    O                   O    O         O      O                |
          O              O    O O O            O                            |
  4.4e+11 ++   O           O           O    O    O      O                   |
  4.3e+11 ++----------------------------------------------------------------+


                                 perf-stat.page-faults

  4.4e+07 ++----------------------------------------------------------------+
          |                   *.                                  *..       |
  4.3e+07 ++  .*.  .*.*..*. ..  *.    .*..*.  .*.  .*.*.  .*.    +    .*..*.*
  4.2e+07 *+*.   *.        *      *..*      *.   *.     *.   *..*    *      |
          |                                                                 |
  4.1e+07 ++                                                                |
    4e+07 ++                                                                |
          |                                                                 |
  3.9e+07 ++                                                                |
  3.8e+07 ++                                                                |
          |                                                                 |
  3.7e+07 ++          O              O    O    O O  O O    O                |
  3.6e+07 O+   O O  O    O O    O O    O    O           O                   |
          | O                 O                                             |
  3.5e+07 ++----------------------------------------------------------------+


                              perf-stat.context-switches

  1.95e+07 ++---------------------------------------------------------------+
           |                             .*                                 |
   1.9e+07 ++                           *  :                                |
           |                           +    :                               |
           |     .*..                 +     :                               |
  1.85e+07 *+*..*    *.*.*..*.  .*.*.*       *.  .*.    .*.*.. .*.    .*.. .*
           |                  *.               *.   *.*.      *   *..*    * |
   1.8e+07 ++                                                               |
           |                                                                |
  1.75e+07 ++                                                               |
           |                                                                |
           |                                             O                  |
   1.7e+07 ++O  O O  O O O  O O  O O              O O O    O                |
           O                         O  O O  O O                            |
  1.65e+07 ++---------------------------------------------------------------+


                                perf-stat.minor-faults

  4.4e+07 ++----------------------------------------------------------------+
          |                   *.                                  *..       |
  4.3e+07 ++  .*.  .*.*..*. ..  *.    .*..*.  .*.  .*.*.  .*.    +    .*..*.*
  4.2e+07 *+*.   *.        *      *..*      *.   *.     *.   *..*    *      |
          |                                                                 |
  4.1e+07 ++                                                                |
    4e+07 ++                                                                |
          |                                                                 |
  3.9e+07 ++                                                                |
  3.8e+07 ++                                                                |
          |                                                                 |
  3.7e+07 ++          O              O    O    O O  O O    O                |
  3.6e+07 O+   O O  O    O O    O O    O    O           O                   |
          | O                 O                                             |
  3.5e+07 ++----------------------------------------------------------------+


                            perf-stat.branch-miss-rate_

  4.6 ++--------------------------------------------------------------------+
  4.4 ++                                          O                         |
      |               O                      O       O O  O                 |
  4.2 ++ O      O  O    O  O O  O  O O  O O    O                            |
    4 O+   O  O                                                             |
      |                                                                     |
  3.8 ++                                                                    |
  3.6 ++                                                                    |
  3.4 ++                                                                    |
      |                                                                     |
  3.2 ++     .*.                                           .*..             |
    3 *+.*.*.   *..*.. .*..*.*..*..*      *..*.*..*..*.  .*    *..*.*..*.*..*
      |               *             :    +             *.                   |
  2.8 ++                            :  .*                                   |
  2.6 ++-----------------------------*--------------------------------------+


                                  unixbench.score

  490 ++-------------------*------------------------------------------------+
      *..*.*..*.*..    .*.   *..*..*.*..*.*..*.*..*.. .*..*.*..*..    .*.*..|
  480 ++           *..*                              *            *.*.      *
  470 ++                                                                    |
      |                                                                     |
  460 ++                                                                    |
  450 ++                                                                    |
      |                                                                     |
  440 ++                                                                    |
  430 ++                                                                    |
      |                                                                     |
  420 ++                                          O  O O  O                 |
  410 ++ O O    O          O O     O O  O O  O O                            |
      O       O    O  O O       O                                           |
  400 ++--------------------------------------------------------------------+


                           unixbench.time.minor_page_faults

  4.4e+07 ++----------------------------------------------------------------+
          |                                                       *..       |
  4.3e+07 ++  .*.  .*.  .*.  .*.*     .*..                       +       .*.*
  4.2e+07 *+*.   *.   *.   *.    +  .*    *.*..*.*..*.*.*..*.*..*    *.*.   |
          |                       *.                                        |
  4.1e+07 ++                                                                |
    4e+07 ++                                                                |
          |                                                                 |
  3.9e+07 ++                                                                |
  3.8e+07 ++                                                                |
          |                                                                 |
  3.7e+07 ++                                   O           O                |
  3.6e+07 O+   O      O  O      O    O O  O O    O  O O O                   |
          |      O  O      O  O   O                                         |
  3.5e+07 ++O---------------------------------------------------------------+


                       unixbench.time.voluntary_context_switches

  3.7e+06 ++----------------------------------------------------------------+
          |                                                                 |
  3.6e+06 ++    .*..      .*..*. .*.. .*..*.                                |
          |.*..*    *.*..*      *    *      *..*.*..*. .*..*.*..*.  .*.*..*.|
  3.5e+06 *+                                          *           *.        *
          |                                                                 |
  3.4e+06 ++                                                                |
          |                                                                 |
  3.3e+06 ++                                                                |
          |                                                                 |
  3.2e+06 ++                                                                |
          |                                         O   O  O                |
  3.1e+06 ++O  O              O      O O  O O  O O    O                     |
          O      O  O O  O O    O O                                         |
    3e+06 ++----------------------------------------------------------------+

  [*] bisect-good sample
  [O] bisect-bad  sample


Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Xiaolong

View attachment "config-4.12.0-rc1-00084-gd34303a1" of type "text/plain" (159054 bytes)

View attachment "job-script" of type "text/plain" (6724 bytes)

View attachment "job.yaml" of type "text/plain" (4324 bytes)

View attachment "reproduce" of type "text/plain" (126 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ