lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Message-ID: <20111214143156.GA22511@localhost>
Date:	Wed, 14 Dec 2011 22:31:56 +0800
From:	Wu Fengguang <fengguang.wu@...el.com>
To:	linux-fsdevel@...r.kernel.org
Cc:	LKML <linux-kernel@...r.kernel.org>,
	Dave Chinner <david@...morbit.com>,
	Christoph Hellwig <hch@...radead.org>
Subject: XFS/btrfs performance after IO-less dirty throttling

Hi,

This very basic 1-disk performance comparison shows +8.3% overall
improvements for XFS and +6.2% for btrfs.

The thresh=1M cases see big "regressions", however that's due to much
more strictly executed global dirty limit. So not real problems.

The other big regressions happen in the XFS UKEY-thresh=100M cases.
Need to explore what's going on inside XFS...

wfg@bee /export/writeback% ./compare -g xfs fat/*/*-3.1.0+ fat/*/*-3.2.0-rc3
                  3.1.0+                 3.2.0-rc3
------------------------  ------------------------
                   43.24       +11.6%        48.26  fat/UKEY-HDD/xfs-100dd-1-3.1.0+
                   51.35        +8.3%        55.62  fat/UKEY-HDD/xfs-10dd-1-3.1.0+
                   58.73        +5.7%        62.09  fat/UKEY-HDD/xfs-1dd-1-3.1.0+
                    4.17       -37.8%         2.59  fat/UKEY-thresh=100M/xfs-100dd-1-3.1.0+
                    4.14       -53.3%         1.94  fat/UKEY-thresh=100M/xfs-10dd-1-3.1.0+
                    6.30        +0.4%         6.33  fat/UKEY-thresh=100M/xfs-1dd-1-3.1.0+
                    8.88       +18.0%        10.48  fat/fio/xfs-fio_fat_mmap_randwrite_4k-1-3.1.0+
                   36.01       +25.2%        45.07  fat/fio/xfs-fio_fat_mmap_randwrite_64k-1-3.1.0+
                   47.04        +9.2%        51.38  fat/fio/xfs-fio_fat_rates-1-3.1.0+
                   38.23       +22.7%        46.92  fat/thresh=1000M/xfs-100dd-1-3.1.0+
                   45.17       +22.6%        55.39  fat/thresh=1000M/xfs-10dd-1-3.1.0+
                   51.66        +9.2%        56.44  fat/thresh=1000M/xfs-1dd-1-3.1.0+
                   38.31       +23.2%        47.18  fat/thresh=1000M:990M/xfs-100dd-1-3.1.0+
                   43.60       +26.1%        54.99  fat/thresh=1000M:990M/xfs-10dd-1-3.1.0+
                   50.14       +14.4%        57.39  fat/thresh=1000M:990M/xfs-1dd-1-3.1.0+
                   38.06       +26.8%        48.26  fat/thresh=1000M:999M/xfs-100dd-1-3.1.0+
                   42.43       +28.1%        54.34  fat/thresh=1000M:999M/xfs-10dd-1-3.1.0+
                   50.30       +10.4%        55.53  fat/thresh=1000M:999M/xfs-1dd-1-3.1.0+
                   28.89        -3.9%        27.76  fat/thresh=100M/xfs-100dd-1-3.1.0+
                   44.94        +3.6%        46.54  fat/thresh=100M/xfs-10dd-1-3.1.0+
                   55.60        -3.0%        53.95  fat/thresh=100M/xfs-1dd-1-3.1.0+
                   37.05       -15.2%        31.43  fat/thresh=10M/xfs-10dd-1-3.1.0+
                   55.42        +1.1%        56.03  fat/thresh=10M/xfs-1dd-1-3.1.0+
                   41.64       -30.3%        29.00  fat/thresh=1M/xfs-10dd-1-3.1.0+
                   56.68        -4.5%        54.14  fat/thresh=1M/xfs-1dd-1-3.1.0+
                  977.98        +8.3%      1059.05  TOTAL write_bw
wfg@bee /export/writeback% ./compare -g btrfs fat/*/*-3.1.0+ fat/*/*-3.2.0-rc3
                  3.1.0+                 3.2.0-rc3
------------------------  ------------------------
                   53.49       +19.6%        63.98  fat/UKEY-HDD/btrfs-100dd-1-3.1.0+
                   56.50       +11.8%        63.19  fat/UKEY-HDD/btrfs-10dd-1-3.1.0+
                   60.07        +6.3%        63.83  fat/UKEY-HDD/btrfs-1dd-1-3.1.0+
                    4.81       +26.8%         6.10  fat/UKEY-thresh=100M/btrfs-100dd-1-3.1.0+
                    5.00       +23.2%         6.16  fat/UKEY-thresh=100M/btrfs-10dd-1-3.1.0+
                    5.99        +1.8%         6.10  fat/UKEY-thresh=100M/btrfs-1dd-1-3.1.0+
                   15.98       -10.6%        14.29  fat/fio/btrfs-fio_fat_mmap_randwrite_4k-1-3.1.0+
                   52.02        +5.4%        54.85  fat/fio/btrfs-fio_fat_mmap_randwrite_64k-1-3.1.0+
                   56.01        +2.6%        57.48  fat/fio/btrfs-fio_fat_rates-1-3.1.0+
                   52.42       +10.4%        57.85  fat/thresh=1000M/btrfs-100dd-1-3.1.0+
                   53.75        +7.7%        57.86  fat/thresh=1000M/btrfs-10dd-1-3.1.0+
                   53.23       +11.2%        59.18  fat/thresh=1000M/btrfs-1dd-1-3.1.0+
                   55.11        +5.3%        58.02  fat/thresh=1000M:990M/btrfs-100dd-1-3.1.0+
                   53.01        +5.3%        55.83  fat/thresh=1000M:990M/btrfs-10dd-1-3.1.0+
                   55.71        +5.9%        58.97  fat/thresh=1000M:990M/btrfs-1dd-1-3.1.0+
                   54.07        +6.5%        57.61  fat/thresh=1000M:999M/btrfs-100dd-1-3.1.0+
                   53.05        +4.1%        55.21  fat/thresh=1000M:999M/btrfs-10dd-1-3.1.0+
                   54.79        +5.6%        57.85  fat/thresh=1000M:999M/btrfs-1dd-1-3.1.0+
                   56.42        +2.9%        58.06  fat/thresh=100M/btrfs-100dd-1-3.1.0+
                   57.41        +1.5%        58.26  fat/thresh=100M/btrfs-10dd-1-3.1.0+
                   58.12        +4.1%        60.50  fat/thresh=100M/btrfs-1dd-1-3.1.0+
                   44.41       +29.2%        57.37  fat/thresh=10M/btrfs-10dd-1-3.1.0+
                   54.33        +9.3%        59.37  fat/thresh=10M/btrfs-1dd-1-3.1.0+
                    5.00       -47.3%         2.64  fat/thresh=1M/btrfs-10dd-1-3.1.0+
                   15.21       -83.6%         2.50  fat/thresh=1M/btrfs-1dd-1-3.1.0+
                 1085.90        +6.2%      1153.08  TOTAL write_bw

It performs roughly the same with the pending writeback changes:

wfg@bee /export/writeback% ./compare -g xfs fat/*/*-3.1.0+ fat/*/*-3.2.0-rc3-pause6+
                  3.1.0+         3.2.0-rc3-pause6+
------------------------  ------------------------
                   43.24        +9.2%        47.21  fat/UKEY-HDD/xfs-100dd-1-3.1.0+
                   51.35        +8.9%        55.90  fat/UKEY-HDD/xfs-10dd-1-3.1.0+
                   58.73        +5.8%        62.15  fat/UKEY-HDD/xfs-1dd-1-3.1.0+
                    4.17       -33.1%         2.79  fat/UKEY-thresh=100M/xfs-100dd-1-3.1.0+
                    4.14       -23.9%         3.15  fat/UKEY-thresh=100M/xfs-10dd-1-3.1.0+
                    6.30        +0.2%         6.32  fat/UKEY-thresh=100M/xfs-1dd-1-3.1.0+
                    8.88       +10.2%         9.78  fat/fio/xfs-fio_fat_mmap_randwrite_4k-1-3.1.0+
                   36.01       +24.4%        44.80  fat/fio/xfs-fio_fat_mmap_randwrite_64k-1-3.1.0+
                   47.04       +11.9%        52.64  fat/fio/xfs-fio_fat_rates-1-3.1.0+
                   38.23       +27.9%        48.89  fat/thresh=1000M/xfs-100dd-1-3.1.0+
                   45.17       +21.0%        54.67  fat/thresh=1000M/xfs-10dd-1-3.1.0+
                   51.66       +11.2%        57.46  fat/thresh=1000M/xfs-1dd-1-3.1.0+
                   38.31       +15.1%        44.08  fat/thresh=1000M:990M/xfs-100dd-1-3.1.0+
                   43.60       +24.8%        54.41  fat/thresh=1000M:990M/xfs-10dd-1-3.1.0+
                   50.14       +13.4%        56.87  fat/thresh=1000M:990M/xfs-1dd-1-3.1.0+
                   38.06       +28.9%        49.05  fat/thresh=1000M:999M/xfs-100dd-1-3.1.0+
                   42.43       +28.3%        54.41  fat/thresh=1000M:999M/xfs-10dd-1-3.1.0+
                   50.30        +8.1%        54.36  fat/thresh=1000M:999M/xfs-1dd-1-3.1.0+
                   28.89        -1.2%        28.55  fat/thresh=100M/xfs-100dd-1-3.1.0+
                   44.94        +5.3%        47.33  fat/thresh=100M/xfs-10dd-1-3.1.0+
                   55.60        +3.4%        57.48  fat/thresh=100M/xfs-1dd-1-3.1.0+
                   37.05       -14.5%        31.68  fat/thresh=10M/xfs-10dd-1-3.1.0+
                   55.42        +0.6%        55.77  fat/thresh=10M/xfs-1dd-1-3.1.0+
                   41.64       -30.8%        28.82  fat/thresh=1M/xfs-10dd-1-3.1.0+
                   56.68        -3.0%        54.98  fat/thresh=1M/xfs-1dd-1-3.1.0+
                  977.98        +8.7%      1063.55  TOTAL write_bw

wfg@bee /export/writeback% ./compare -g btrfs fat/*/*-{3.1.0+,3.2.0-rc3-pause6+}
                  3.1.0+         3.2.0-rc3-pause6+
------------------------  ------------------------
                   53.49       +19.2%        63.75  fat/UKEY-HDD/btrfs-100dd-1-3.1.0+
                   56.50       +14.1%        64.49  fat/UKEY-HDD/btrfs-10dd-1-3.1.0+
                   60.07        +6.7%        64.11  fat/UKEY-HDD/btrfs-1dd-1-3.1.0+
                    4.81       +27.4%         6.12  fat/UKEY-thresh=100M/btrfs-100dd-1-3.1.0+
                    5.00       +21.7%         6.09  fat/UKEY-thresh=100M/btrfs-10dd-1-3.1.0+
                    5.99        +1.9%         6.11  fat/UKEY-thresh=100M/btrfs-1dd-1-3.1.0+
                   15.98        -8.5%        14.62  fat/fio/btrfs-fio_fat_mmap_randwrite_4k-1-3.1.0+
                   52.02        +4.2%        54.20  fat/fio/btrfs-fio_fat_mmap_randwrite_64k-1-3.1.0+
                   56.01        +1.0%        56.57  fat/fio/btrfs-fio_fat_rates-1-3.1.0+
                   52.42       +11.4%        58.38  fat/thresh=1000M/btrfs-100dd-1-3.1.0+
                   53.75        +9.2%        58.67  fat/thresh=1000M/btrfs-10dd-1-3.1.0+
                   53.23        +9.6%        58.34  fat/thresh=1000M/btrfs-1dd-1-3.1.0+
                   55.11        +5.8%        58.33  fat/thresh=1000M:990M/btrfs-100dd-1-3.1.0+
                   53.01        +6.8%        56.62  fat/thresh=1000M:990M/btrfs-10dd-1-3.1.0+
                   55.71        +3.8%        57.84  fat/thresh=1000M:990M/btrfs-1dd-1-3.1.0+
                   54.07        +6.9%        57.78  fat/thresh=1000M:999M/btrfs-100dd-1-3.1.0+
                   53.05        +5.3%        55.87  fat/thresh=1000M:999M/btrfs-10dd-1-3.1.0+
                   54.79        +4.2%        57.09  fat/thresh=1000M:999M/btrfs-1dd-1-3.1.0+
                   56.42        +2.7%        57.97  fat/thresh=100M/btrfs-100dd-1-3.1.0+
                   57.41        +1.9%        58.51  fat/thresh=100M/btrfs-10dd-1-3.1.0+
                   58.12        +1.0%        58.71  fat/thresh=100M/btrfs-1dd-1-3.1.0+
                   44.41       +31.0%        58.16  fat/thresh=10M/btrfs-10dd-1-3.1.0+
                   54.33        +7.9%        58.60  fat/thresh=10M/btrfs-1dd-1-3.1.0+
                    5.00       -55.3%         2.24  fat/thresh=1M/btrfs-10dd-1-3.1.0+
                   15.21       -81.0%         2.89  fat/thresh=1M/btrfs-1dd-1-3.1.0+
                 1085.90        +6.1%      1152.06  TOTAL write_bw

Thanks,
Fengguang
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ