linux-ext4 - [PATCH 4.19 0/4] ext4: improve delalloc buffer write performance

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [day] [month] [year] [list]

Message-ID: <BFA78356E2E71FF0+20240720155234.573790-1-wangyuli@uniontech.com>
Date: Sat, 20 Jul 2024 23:51:59 +0800
From: WangYuli <wangyuli@...ontech.com>
To: stable@...r.kernel.org,
	gregkh@...uxfoundation.org,
	sashal@...nel.org,
	yi.zhang@...wei.com
Cc: jack@...e.cz,
	tytso@....edu,
	adilger.kernel@...ger.ca,
	linux-ext4@...r.kernel.org,
	linux-kernel@...r.kernel.org,
	yukuai3@...wei.com,
	niecheng1@...ontech.com,
	zhangdandan@...ontech.com,
	guanwentao@...ontech.com,
	WangYuli <wangyuli@...ontech.com>
Subject: [PATCH 4.19 0/4] ext4: improve delalloc buffer write performance

A patchset from linux-5.15 should be backported to 4.19 that can
significantly improve ext4 fs read and write performance. Unixbench test
results for linux-4.19.318 on Phytium D2000 CPU are shown below.

Test cmd: (Phytium D2000 only has 8 cores)
  ./Run fs -c 8

Before this patch set:
  File Copy 1024 bufsize 2000 maxblocks		1124181
  File Copy 256 bufsize 500 maxblocks		281885
  File Copy 4096 bufsize 8000 maxblocks		3383785
  File Read 1024 bufsize 2000 maxblocks		8702173
  File Read 256 bufsize 500 maxblocks		3869384
  File Read 4096 bufsize 8000 maxblocks		13043151
  File Write 1024 bufsize 2000 maxblocks	1107185
  File Write 256 bufsize 500 maxblocks 		270493
  File Write 4096 bufsize 8000 maxblocks	4018084

After this patch set:
  File Copy 1024 bufsize 2000 maxblocks         2026206
  File Copy 256 bufsize 500 maxblocks           829534
  File Copy 4096 bufsize 8000 maxblocks         4066659
  File Read 1024 bufsize 2000 maxblocks         8877219
  File Read 256 bufsize 500 maxblocks           3997445
  File Read 4096 bufsize 8000 maxblocks         13179885
  File Write 1024 bufsize 2000 maxblocks        4256929
  File Write 256 bufsize 500 maxblocks          1305320
  File Write 4096 bufsize 8000 maxblocks	10721052

We can observe a quantum leap in the test results as a consequence of
applying this patchset

Link: https://lore.kernel.org/all/20210716122024.1105856-1-yi.zhang@huawei.com/



Original description:

This patchset address to improve buffer write performance with delalloc.
The first patch reduce the unnecessary update i_disksize, the second two
patch refactor the inline data write procedure and also do some small
fix, the last patch do improve by remove all unnecessary journal handle
in the delalloc write procedure.

After this patch set, we could get a lot of performance improvement.
Below is the Unixbench comparison data test on my machine with 'Intel
Xeon Gold 5120' CPU and nvme SSD backend.

Test cmd:

  ./Run -c 56 -i 3 fstime fsbuffer fsdisk

Before this patch set:

  System Benchmarks Partial Index           BASELINE       RESULT   INDEX
  File Copy 1024 bufsize 2000 maxblocks       3960.0     422965.0   1068.1
  File Copy 256 bufsize 500 maxblocks         1655.0     105077.0   634.9
  File Copy 4096 bufsize 8000 maxblocks       5800.0    1429092.0   2464.0
                                                                    ========
  System Benchmarks Index Score (Partial Only)                      1186.6

After this patch set:

  System Benchmarks Partial Index           BASELINE       RESULT   INDEX
  File Copy 1024 bufsize 2000 maxblocks       3960.0     732716.0   1850.3
  File Copy 256 bufsize 500 maxblocks         1655.0     184940.0   1117.5
  File Copy 4096 bufsize 8000 maxblocks       5800.0    2427152.0   4184.7
                                                                    ========
  System Benchmarks Index Score (Partial Only)                      2053.0




Zhang Yi (4):
  ext4: check and update i_disksize properly
  ext4: correct the error path of ext4_write_inline_data_end()
  ext4: factor out write end code of inline file
  ext4: drop unnecessary journal handle in delalloc write

 fs/ext4/ext4.h   |   3 -
 fs/ext4/inline.c | 120 ++++++++++++++++++-------------------
 fs/ext4/inode.c  | 150 ++++++++++++-----------------------------------
 3 files changed, 99 insertions(+), 174 deletions(-)

-- 
2.31.1