linux-ext4 - 3.2 and 3.1 filesystem scalability measurements

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [thread-next>] [day] [month] [year] [list]

Date:	Sun, 29 Jan 2012 23:09:43 -0500
From:	Eric Whitney <eric.whitney@...com>
To:	Ext4 Developers List <linux-ext4@...r.kernel.org>,
	linux-fsdevel@...r.kernel.org
Subject: 3.2 and 3.1 filesystem scalability measurements

I've posted the results of some 3.2 and 3.1 ext4 scalability 
measurements and comparisons on a 48 core x86-64 server at:

http://free.linux.hp.com/~enw/ext4/3.2

This includes throughput and CPU efficiency graphs for five simple 
workloads, the raw data for same, plus lockstats on ext4 filesystems 
with and without journals.  The data have been useful in improving ext4 
scalability as a function of core and thread count in the past.

For reference, ext3, xfs, and btrfs data are also included.

The most notable improvement in 3.2 is a big scalability gain for 
journaled ext4 when running the large_file_creates workload.  This 
bisects cleanly to Wu Fengguang's IO-less balance_dirty_pages() patch 
which was included in the 3.2 merge window.

(Please note that the test system's hardware and firmware configuration 
has changed since my last posting, so this data set cannot be directly 
compared with my older sets.)

Thanks,
Eric

--
To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html