linux-ext4 - Re: getdents - ext4 vs btrfs performance

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <CADDYkjQn-2-XjAZYe6AZeVcNa_A3Jc_qYcOUd3bExBDNWxDMUw@mail.gmail.com>
Date:	Thu, 1 Mar 2012 15:57:50 +0100
From:	Jacek Luczak <difrost.kernel@...il.com>
To:	Chris Mason <chris.mason@...cle.com>,
	Jacek Luczak <difrost.kernel@...il.com>,
	Hillf Danton <dhillf@...il.com>, linux-ext4@...r.kernel.org,
	linux-fsdevel <linux-fsdevel@...r.kernel.org>,
	LKML <linux-kernel@...r.kernel.org>, linux-btrfs@...r.kernel.org,
	lczerner@...hat.com
Subject: Re: getdents - ext4 vs btrfs performance

2012/3/1 Chris Mason <chris.mason@...cle.com>:
> On Thu, Mar 01, 2012 at 03:43:41PM +0100, Jacek Luczak wrote:
>> 2012/3/1 Chris Mason <chris.mason@...cle.com>:
>> > XFS will probably beat btrfs in this test.  Their directory indexes
>> > reflect on disk layout very well.
>>
>> True, but not that fast on small files.
>>
>> Except the question I've raised in first mail there's a point in all
>> those action. We are maintaining host that are used for building
>> software: random access, lot of small files and dirs (always a co),
>> heavy parallel IO. We were testing XFS vs ext4 a year ago and XFS was
>> around 10% slower on build times. We did not - yet - done same on
>> btrfs. Now we're looking for replacement for ext4 as we suffer from
>> those issue - but we were not aware of that until stepped into this
>> issue.
>>
>> If you would like me to do some specific tests around ext4 and btrfs,
>> let me know.
>
> I'm always curious to see comparisons in real world workloads.  You
> should definitely consider testing XFS again, the big three filesystems
> are under pretty constant improvement.  For btrfs, please stick to 3.2
> kernels and higher.

That's the plan but I'm waiting for more of the briliant work that
recently popped up in XFS. For btrfs, the 3.2 introduced changes led
me to give here a try. I don't have nice pictures and digits in my
hand now but first tests shown close to 40% of timing improvements
between 2.6.39.4 and 3.2.7 - keep doing that great work guys (and
girls if any)!

-Jacek
--
To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html