| lists.openwall.net | lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC | |
|
Open Source and information security mailing list archives
| ||
|
Date: Wed, 2 Mar 2011 13:10:30 +0100 (CET)
From: Lukas Czerner <lczerner@...hat.com>
To: Kyungmin Park <kmpark@...radead.org>
cc: Lukas Czerner <lczerner@...hat.com>,
OGAWA Hirofumi <hirofumi@...l.parknet.co.jp>,
linux-kernel@...r.kernel.org, linux-fsdevel@...r.kernel.org
Subject: Re: [PATCH v3] fat: Batched discard support for fat
On Wed, 2 Mar 2011, Kyungmin Park wrote:
> On Wed, Mar 2, 2011 at 11:07 AM, Kyungmin Park <kmpark@...radead.org> wrote:
> > On Mon, Feb 28, 2011 at 9:51 PM, Lukas Czerner <lczerner@...hat.com> wrote:
> >> On Mon, 28 Feb 2011, Kyungmin Park wrote:
> >>
> >>> On Fri, Feb 25, 2011 at 8:17 PM, Lukas Czerner <lczerner@...hat.com> wrote:
> >>> > On Fri, 25 Feb 2011, Kyungmin Park wrote:
> >>> >
> >>> >> From: Kyungmin Park <kyungmin.park@...sung.com>
> >>> >>
> >>> >> FAT supports batched discard as ext4.
> >>> >>
> >>> >> Cited from Lukas words.
> >>> >> "The current solution is not ideal because of its bad performance impact.
> >>> >> So basic idea to improve things is to avoid discarding every time some
> >>> >> blocks are freed. and instead batching is together into bigger trims,
> >>> >> which tends to be more effective."
> >>> >>
> >>> >> You can find an information in detail at following URLs.
> >>> >> http://lwn.net/Articles/397538/
> >>> >> http://lwn.net/Articles/383933/
> >>> >>
> >>> >> Clearify the meaning of "len" (Cited form Lukas mail)
> >>> >>
> >>> >> Let the "O" be free (bytes, blocks, whatever), and "=" be used.
> >>> >> Now, we have a filesystem like this.
> >>> >>
> >>> >> OOOO==O===OO===OOOOO==O===O===OOOOOOO===
> >>> >> ^ ^
> >>> >> 0 40
> >>> >>
> >>> >> This is how it supposed to wotk if you have called FITIRM with parameters:
> >>> >>
> >>> >> start = 0
> >>> >> minlen = 2
> >>> >> len = 20
> >>> >>
> >>> >> So you will go through (blocks, bytes...) 0 -> 20
> >>> >>
> >>> >> OOOO==O===OO===OOOOO==O===O===OOOOOOO===
> >>> >> ^ ^
> >>> >> 0 20
> >>> >>
> >>> >> So, you will call discard on extents:
> >>> >>
> >>> >> 0-3
> >>> >> You'll skip 6 because is smaller than minlen
> >>> >> 10-11
> >>> >> 15-19
> >>> >>
> >>> >> instead of
> >>> >>
> >>> >> 0-3
> >>> >> 10-11
> >>> >> 15-19
> >>> >> 30-36
> >>> >
> >>> > Hi thanks for the next version. And again I have to ask: Did you test it
> >>> > ? and how ? Did you tried xfstest No. 251 ? Couple of comments bellow.
> >>>
> >>> I tested it with your test program. Of course I modified for our
> >>> environment (eMMC).
> >>
> >> Ok, good.
> >>
> >>>
> >>> #include <errno.h>
> >>> #include <fcntl.h>
> >>> #include <stdio.h>
> >>> #include <stdint.h>
> >>> #include <sys/ioctl.h>
> >>>
> >>> struct fstrim_range {
> >>> uint64_t start;
> >>> uint64_t len;
> >>> uint64_t minlen;
> >>> };
> >>>
> >>> #define FITRIM _IOWR('X', 121, struct fstrim_range)
> >>>
> >>> int main(int argc, char **argv)
> >>> {
> >>> struct fstrim_range range;
> >>> uint64_t len;
> >>> int fd;
> >>>
> >>> if (argc < 2) {
> >>> fprintf(stderr, "usage: %s mountpoint [size]\n", argv[0]);
> >>> return 1;
> >>> }
> >>>
> >>> if (argc == 3)
> >>> len = atoll(argv[1]);
> >>> else
> >>> len = ((1UL<<31) - 1);
> >>>
> >>> range.start = 0;
> >>> range.len = len;
> >>> range.minlen = 256 * 1024; /* Minimum is 256KiB */
> >>
> >> Why exactly you need to set this ? What will happen if the minlen is 0 ?
> >
> > It's dependent on eMMC chip. it's for our environment. If it passed
> > with 0, the code is working but the less than 256KiB trim command is
> > meaningless.
Ok but user would not care, actually he would not even know so it is
good that this will work, but if kernel knows what minlen value is
meaningless maybe you should adjust that properly the same way as you
are adjusting according to the discard_granularity ?
..snip..
>
> How about this code?
>
> while (count < sbi->max_cluster) {
> if (fatent.entry >= sbi->max_cluster)
> fatent.entry = FAT_START_ENT;
> /* readahead of fat blocks */
> if ((cur_block & reada_mask) == 0) {
> unsigned long rest = sbi->fat_length - cur_block;
> fat_ent_reada(sb, &fatent, min(reada_blocks, rest));
> }
> cur_block++;
>
> err = fat_ent_read_block(sb, &fatent);
> if (err)
> goto out;
>
> do {
> if (ops->ent_get(&fatent) == FAT_ENT_FREE) {
> free++;
> if (!entry)
> entry = fatent.entry;
> } else if (entry) {
> /*
> * Discard if free entry is equal or greater
> * than minimum length
> */
This comment states what we can already see in the simple condition, so
it is not needed, but rather comment while() and do..while loops. But as
I said I am not familiar with FAT code so that might be just my fault.
> if (free >= minlen) {
> fat_issue_discard(sb, entry, free);
> trimmed += free;
> }
> free = 0;
> entry = 0;
> }
> count++;
> /* Check the loop count */
same thing with this comment, we can see that in the simple condition.
> if (count >= len)
> goto done;
> } while (fat_ent_next(sbi, &fatent));
> }
> done:
> if (free >= minlen) {
> fat_issue_discard(sb, entry, free);
> trimmed += free;
> }
> range->len = (trimmed * sbi->sec_per_clus) << sb->s_blocksize_bits;
> fatent_brelse(&fatent);
> out:
> unlock_fat(sbi);
> return err;
>
It looks better, thanks for your work!
-Lukas
..snip..
Powered by blists - more mailing lists