lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Date:   Mon, 5 Jun 2017 10:32:28 +0800
From:   kernel test robot <xiaolong.ye@...el.com>
To:     Jan Kara <jack@...e.cz>
Cc:     Theodore Ts'o <tytso@....edu>, LKML <linux-kernel@...r.kernel.org>,
        Stephen Rothwell <sfr@...b.auug.org.au>, lkp@...org
Subject: [lkp-robot] [ext4]  4f8caa60a5:  fio.write_bw_MBps 11% improvement


Greeting,

FYI, we noticed a 11% improvement of fio.write_bw_MBps due to commit:


commit: 4f8caa60a5a13a78f26198618f21774bd6aa6498 ("ext4: fix data corruption with EXT4_GET_BLOCKS_ZERO")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master

in testcase: fio-basic
on test machine: 16 threads Intel(R) Xeon(R) CPU D-1541 @ 2.10GHz with 8G memory
with following parameters:

	runtime: 300s
	disk: 1SSD
	fs: ext4
	nr_task: 64
	rw: randwrite
	bs: 4k
	ioengine: sync
	test_size: 400g
	cpufreq_governor: performance

test-description: Fio is a tool that will spawn a number of threads or processes doing a particular type of I/O action as specified by the user.
test-url: https://github.com/axboe/fio



Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/01org/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml

testcase/path_params/tbox_group/run: fio-basic/300s-1SSD-ext4-64-randwrite-4k-sync-400g-performance/lkp-bdw-de1

b8cb5a545c3dd8b9  4f8caa60a5a13a78f26198618f  
----------------  --------------------------  
         %stddev      change         %stddev
             \          |                \  
     80.87              11%      89.62        fio.write_bw_MBps
      0.05             135%       0.12 ±  3%  fio.latency_100us%
      0.78              67%       1.30 ±  3%  fio.latency_100ms%
      0.19 ±  6%        30%       0.25 ±  5%  fio.latency_50ms%
      0.15 ±  5%        11%       0.17        fio.latency_50us%
      3.97              11%       4.41        fio.latency_20us%
     20703              11%      22942        fio.write_iops
     81.03                       82.20        fio.latency_10us%
      3088             -10%       2787        fio.write_clat_mean_us
     18124             -10%      16324        fio.write_clat_stddev
    119552             -13%     103936        fio.write_clat_99%_us
     11.62 ±  3%       -14%       9.99        fio.latency_4us%
      0.12 ±  3%       -27%       0.09        fio.latency_250us%
      2.01             -29%       1.42        fio.latency_250ms%
     39.32              13%      44.57        fio.time.system_time
        15              13%         17        fio.time.percent_of_cpu_this_job_got
  49707540              11%   55081532        fio.time.file_system_outputs
    242428              10%     267403        fio.time.voluntary_context_switches
       186               8%        201        turbostat.Avg_MHz
      7.51               8%       8.13        turbostat.%Busy
    204308               7%     217660        vmstat.io.bo
     19227              18%      22646        vmstat.system.cs
     40994               8%      44327        vmstat.system.in
      2811              17%       3303        iostat.sda.wrqm/s
     24629              13%      27939        iostat.sda.w/s
    221981               6%     235455        iostat.sda.wkB/s
      6.54               3%       6.76        iostat.sda.avgqu-sz
    5825638              18%    6863100        perf-stat.context-switches
 1.091e+08 ±  3%        13%  1.234e+08 ±  3%  perf-stat.dTLB-load-misses
     30404              13%      34398        perf-stat.cpu-migrations
 1.426e+11 ±  5%        12%  1.597e+11        perf-stat.dTLB-loads
 6.696e+10 ±  5%        11%  7.427e+10        perf-stat.dTLB-stores
 1.131e+09 ±  4%        10%  1.248e+09        perf-stat.branch-misses
 5.751e+09              10%  6.302e+09        perf-stat.cache-misses
 5.751e+09              10%  6.302e+09        perf-stat.cache-references
 1.749e+08               8%  1.886e+08        perf-stat.iTLB-loads
      1.01                        1.04        perf-stat.branch-miss-rate%




                                fio.write_bw_MBps

  92 ++---------------------------------------------------------------------+
     |                   O                                                  |
  90 O+O O O O O   O O O   O O O O                                          |
     |           O                 O O O OO O O O                           |
     |                                                                      |
  88 ++                                                                     |
     |                                                                      |
  86 ++                                                                     |
     |                                                                      |
  84 ++                                                                     |
     |                                                                      |
     |                                                                      |
  82 ++                                                      .*.            |
     *.*.*.*.*.*.*.*.*.*.*.*.*.*.*. .*.*.**.*.*. .*.*.*.*.*.*   *.*.*.*.*.*.*
  80 ++----------------------------*------------*---------------------------+


                                   fio.write_iops

  23500 ++------------------------------------------------------------------+
        |                  O                                                |
  23000 O+O O O OO O O O O   O O OO               O                         |
        |                           O O O O O O O                           |
        |                                                                   |
  22500 ++                                                                  |
        |                                                                   |
  22000 ++                                                                  |
        |                                                                   |
  21500 ++                                                                  |
        |                                                                   |
        |                                                                   |
  21000 ++                                                    .*.           |
        *.*.*.*.**.*.*.*.*.*.*.*.**. .*.*.*.*.*.*. *.*.*.*.*.*   *.**.*.*.*.*
  20500 ++--------------------------*-------------*-------------------------+


                              fio.write_clat_mean_us

  3150 ++-------------------------------------------------------------------+
       |                           .*.          .*.                         |
  3100 *+*.*.*.*.*.**.*.*.*.*.*.*.*   *.*.**.*.*   *.*.*.*.*.*. .**.*.*.*.*.*
  3050 ++                                                      *            |
       |                                                                    |
  3000 ++                                                                   |
  2950 ++                                                                   |
       |                                                                    |
  2900 ++                                                                   |
  2850 ++                                                                   |
       |                                                                    |
  2800 ++                           O O O OO O O O                          |
  2750 O+O O O O O OO O O   O O O O                                         |
       |                  O                                                 |
  2700 ++-------------------------------------------------------------------+


                                fio.write_clat_stddev

  18500 ++------------------------------------------------------------------+
        |  .*.                     .*.*.   .*.   .**.   .*.                 |
        *.*   *.**.*.*.*.*.*.*.*.**     *.*   *.*    *.*   *.*.*.*.**.*.*.*.*
  18000 ++                                                                  |
        |                                                                   |
        |                                                                   |
  17500 ++                                                                  |
        |                                                                   |
  17000 ++                                                                  |
        |                                                                   |
        |                                                                   |
  16500 ++                                                                  |
        |        O           O O O  O O O O O O O O                         |
        O O O O O  O O O O O      O                                         |
  16000 ++------------------------------------------------------------------+


                                fio.write_clat_99__us

  122000 ++-----------------------------------------------------------------+
  120000 ++*.*. *.   .*. .*.  .*. .*.*.*.*.**. .*.*.*.*.**. .*.*.*.   *.    |
         *     *  *.*   *   **   *            *            *       *.*  *.*.*
  118000 ++                                                                 |
  116000 ++                                                                 |
         |                                                                  |
  114000 ++                                                                 |
  112000 ++                                                                 |
  110000 ++                                                                 |
         |                                                                  |
  108000 ++                                                                 |
  106000 ++                                                                 |
         |                                                                  |
  104000 O+O O OO O O O O O OO O O O O O O OO O O O                         |
  102000 ++-----------------------------------------------------------------+


                                 fio.latency_20us_

  4.6 ++--------------------------------------------------------------------+
      |   O             O        O                                          |
  4.5 ++    O O   O          O     O O O O   O                              |
  4.4 O+        O     O        O           O     O                          |
      | O           O    O O                   O                            |
  4.3 ++                                                                    |
  4.2 ++                                                                    |
      |                                                                     |
  4.1 ++*                                                                  .*
    4 ++ :  *.*         *                                                .* |
      *  : +   +       + *.      *   *. .*.*.*.*   *. .*.*.**   *.*.*. .*   |
  3.9 ++  *     *. .*.*    *.   + + +  *        + +  *       :  :     *     |
  3.8 ++          *          *.*   *             *           : :            |
      |                                                       ::            |
  3.7 ++------------------------------------------------------*-------------+


                                fio.latency_100us_

  0.12 O+O-O---O-O-OO-O-O-----O-O-O--------O-O-O----------------------------+
       |                                                                    |
  0.11 ++    O            O O       O O O O      O                          |
       |                                                                    |
   0.1 ++                                                                   |
       |                                                                    |
  0.09 ++                                                                   |
       |                                                                    |
  0.08 ++                                                                   |
       |                                                                    |
  0.07 ++                                                                   |
       |                                                                    |
  0.06 *+*.*.*.*.*  *   *.*     *.*     *.*    *     *.*     *.*  *.*       |
       |          + :+ +   +   +   +   +   :  + +   +   +   +   + :  +      |
  0.05 ++----------*--*-----*-*-----*-*----*-*---*-*-----*-*-----*----*-*-*-*


                                 fio.latency_250us_

   0.13 ++*---*-------------------------------*------------*--------------*-+
        | ::  ::                              ::           ::             ::|
  0.125 ++ : : :                             : :          : :            : :|
   0.12 ++  ::  :                            :  :         :  :           :  |
        *   *   **.*.*.*.*.*.*.*.**.*.*.*.*.*   *.**.*.*.*   *.*.*.**.*.*   *
  0.115 ++                                                                  |
        |                                                                   |
   0.11 ++                                                                  |
        |                                                                   |
  0.105 ++                                                                  |
    0.1 ++                                                                  |
        |                                                                   |
  0.095 ++                                                                  |
        |                                                                   |
   0.09 O+O-O-O-OO-O-O-O-O-O-O-O-OO-O-O-O-O-O-O-O-O-------------------------+


                                fio.latency_100ms_

  1.5 ++--------------------------------------------------------------------+
      |     O                                                               |
  1.4 O+                OO       O                                          |
  1.3 ++  O   O                      O   O O   O                            |
      | O       O O O O    O O O   O   O         O                          |
  1.2 ++                                     O                              |
      |                                                                     |
  1.1 ++                                                                    |
      |                                                                     |
    1 ++                                                                    |
      |                                                                     |
  0.9 ++                                                                    |
  0.8 *+ .*.   .*.*.        .*. .*. .*.*.*.   .*. .*.*.*.   *.*.*. .*.*.*.  |
      | *   *.*     *.*.**.*   *   *       *.*   *       *.*      *       *.*
  0.7 ++--------------------------------------------------------------------+


                                fio.latency_250ms_

  2.1 ++--------------------------------------------------------------------+
      |                            *        .*.*.*        .**    .*.   .*.*.*
    2 *+*   *.*.*.*. .*.**.*. .*. + + .*. .*      + .*. .*   :  *   *.*     |
  1.9 ++ + +        *        *   *   *   *         *   *     : +            |
      |   *                                                   *             |
  1.8 ++                                                                    |
      |                                                                     |
  1.7 ++                                                                    |
      |                                                                     |
  1.6 ++                                                                    |
  1.5 ++                                                                    |
      | O         O   O    O O               O                              |
  1.4 ++        O   O          O   O O O O O   O O                          |
      O   O   O         O        O                                          |
  1.3 ++----O------------O--------------------------------------------------+


                              fio.time.system_time

  45 ++--------------------------O--------------O---------------------------+
     |       O         O O   O O     O   OO O O                             |
  44 O+O O O   O O O O     O       O   O                                    |
     |                                                                      |
  43 ++                                                                     |
     |                                                                      |
  42 ++                                                                     |
     |                                                                      |
  41 ++                                                                     |
     |                                                                      |
  40 ++                                                                     |
     *.*.                                  .*.           .*. .*. .*.*. .*.*.*
  39 ++  *. .*.     .*.*.*.         .*.*. *   *. .*.*. .*   *   *     *     |
     |     *   *. .*       *.*.*.*.*     *      *     *                     |
  38 ++----------*----------------------------------------------------------+


  [*] bisect-good sample
  [O] bisect-bad  sample


Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Xiaolong

View attachment "config-4.12.0-rc2-00012-g4f8caa60" of type "text/plain" (159381 bytes)

View attachment "job-script" of type "text/plain" (7347 bytes)

View attachment "job.yaml" of type "text/plain" (4914 bytes)

View attachment "reproduce" of type "text/plain" (435 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ