linux-ext4 - Re: [RFC] Ext3 online defrag

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <45421698.2070704@redhat.com>
Date:	Fri, 27 Oct 2006 09:24:24 -0500
From:	Eric Sandeen <sandeen@...hat.com>
To:	Alex Tomas <alex@...sterfs.com>
CC:	sho@...s.nec.co.jp, tytso@....edu, jack@...e.cz,
	linux-fsdevel@...r.kernel.org, linux-ext4@...r.kernel.org
Subject: Re: [RFC] Ext3 online defrag

Alex Tomas wrote:
>>>>>> Eric Sandeen (ES) writes:
> 
>  ES> Alex Tomas wrote:
>  >> 3) scalable reservation
>  >> required for delayed allocation to avoid -ENOSPC at flush time.
>  >> current version uses per-sb spinlock.
> 
>  ES> Can you elaborate on this issue?  Shouldn't delayed allocation
>  ES> decrement free space immediately, and only the actual block location
>  ES> choice is delayed?  Or is this due to potential extra metadata space
>  ES> required as blocks are allocated?
> 
> exactly. in this case, reservation has nothing to do with allocation
> or preallocation of real blocks. this is just a *per-sb counter* of
> blocks reserved for allocation at flush time. it includes all
> non-allocated-yet blocks and metadata needed to allocate them (bitmaps,
> group descriptors, blocks extent tree, etc). the previous version
> of mballoc has reservation, but it doesn't scale very well being
> a single global counter protected by the spinlock. at least, in many
> regular loads I observed the reservation function in top30 of oprofile.

Thanks. XFS recently made similar scalability changes in this area, see the 2006 
OLS paper, if you're interested.

-Eric
-
To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html