linux-ext4 - RE: Re: Re: [PATCH] ext4: hand over jobs handling discard commands on commit complete phase to kworkers

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [day] [month] [year] [list]

Message-ID: <20170517234711epcms1p58f4f1cc3fa6824c344c7ea74ce2d1ab2@epcms1p5>
Date:   Wed, 17 May 2017 23:47:11 +0000
From:   Daeho Jeong <daeho.jeong@...sung.com>
To:     Daeho Jeong <daeho.jeong@...sung.com>
CC:     Jan Kara <jack@...e.cz>, "jack@...e.com" <jack@...e.com>,
        "tytso@....edu" <tytso@....edu>,
        "linux-ext4@...r.kernel.org" <linux-ext4@...r.kernel.org>
Subject: RE: Re: Re: [PATCH] ext4: hand over jobs handling discard commands
 on commit complete phase to kworkers

> > We already freed all the blocks in the block bitmap and increased
> > sbi->s_freeclusters_counter in ext4_free_blocks() in advance of
> > ext4_free_data_callback() which is handling discard commands and releasing
> > blocks in the buddy cache. So, I think that it's ok about ENOSPC, because
> > we are ckecking whether we can allocate the blocks or not using
> > ext4_claim_free_clusters(), which is just seeing sbi->s_freeclusters_counter,
> > and the blocks were already freed from on-disk block bitmap.
 
> No, there is a fundamental problem there. You cannot reuse the blocks until
> ext4_free_data_callback() is finished so this is effectively making blocks
> still used (as you could discard newly written data). And I'm pretty sure
> the allocator takes care not to return blocks for which
> ext4_free_data_callback() hasn't finished. And currently we use transaction
> commit as a way to force releasing of blocks to the allocator which your
> patch breaks.

> > Yes, I agree with you about that the discard handling will be still slow.
> > However, by hiding this, we can get a better responsiveness of fsync() from
> > 30s to 0.255s in the worst case and this is very important to mobile environments
> > where fsync() delay means the users have to wait to do the next action in a while.
> > For the higher file fragmentation, even now, we cannot free the blocks fastly
> > in the buddy cache because we have to handle all the discard commands before
> > freeing blocks in the buddy. So, we already have the same problem now. :-)
 
> No, currently the fragmentation isn't as bad as everybody is stalled
> waiting for discard to finish. So latencies are crap but file
> fragmentation is reduced. And if you just offload discarding (and let's
> assume we can fix those ENOSPC problems), you just postpone the problems
> by a bit - if you get a load that is constantly allocating and freeing
> blocks, you'll soon hit a situation where you are effectively waiting for
> discard anyway because all blocks are queued in the discard queue.

I know the block allocator cannot reuse the blocks that are not discarded yet
and I thought the allocator would find another feasible blocks within the blocks
which are not marked as used in the buddy. It's true normally. But, on the low
free space condition, aha, you're right, the block allocator might find the shorter
size of chunk than the requested size or none of blocks and it might cause
filesystem fragmentation. Making free blocks in the buddy ASAP is also very
important for the filesystem not to be fragmented. I have overlooked that point.
Now, I can understand what you are saying. Thank you so much.

As Christoph and you said, using __blkdev_issue_discard() function for parallel
discard commands handling on the commit phase will be better solution.
I will be back with this solution soon.

Thank you guys again.