[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-ID:
<DM6PR10MB4347C97E2645B45A66CA0D76A02C2@DM6PR10MB4347.namprd10.prod.outlook.com>
Date: Tue, 19 Mar 2024 11:25:09 +0000
From: Srivathsa Dara <srivathsa.d.dara@...cle.com>
To: Andreas Dilger <adilger@...ger.ca>
CC: Ext4 Developers List <linux-ext4@...r.kernel.org>,
Theodore Ts'o
<tytso@....edu>,
Rajesh Sivaramasubramaniom
<rajesh.sivaramasubramaniom@...cle.com>,
Junxiao Bi <junxiao.bi@...cle.com>
Subject: RE: [External] : Re: [RESEND PATCH] e2fsprogs: misc/mke2fs.8.in:
Correct valid cluster-size values
>
>
> -----Original Message-----
> From: Andreas Dilger <adilger@...ger.ca>
> Sent: Saturday, March 16, 2024 3:02 AM
> To: Srivathsa Dara <srivathsa.d.dara@...cle.com>
> Cc: Ext4 Developers List <linux-ext4@...r.kernel.org>;
> Theodore Ts'o <tytso@....edu>; Rajesh Sivaramasubramaniom
> <rajesh.sivaramasubramaniom@...cle.com>;
> Junxiao Bi <junxiao.bi@...cle.com>
> Re: [RESEND PATCH] e2fsprogs: misc/mke2fs.8.in: Correct valid cluster-size values
>
> On Mar 14, 2024, at 3:31 AM, Srivathsa Dara <srivathsa.d.dara@...cle.com> wrote:
> >
> > According to the mke2fs man page, the supported cluster-size values
> > for an ext4 filesystem are 2048 to 256M bytes. However, this is not
> > the case.
> >
> > When mkfs is run to create a filesystem with following specifications:
> > * 1k blocksize and cluster-size greater than 32M
> > * 2k blocksize and cluster-size greater than 64M
> > * 4k blocksize and cluster-size greater than 128M mkfs fails with
> > "Invalid argument passed to ext2 library while trying to create
> > journal" error. In general, when the cluster-size to blocksize ratio
> > is greater than 32k, mkfs fails with this error.
> >
> > Went through the code and found out that the function
> > `ext2fs_new_range()` is the source of this error. This is because when
> > the cluster-size to blocksize ratio exceeds 32k, the length argument
> > to the function `ext2fs_new_range()` results in 0. Hence, the error.
> >
> > This patch corrects the valid cluster-size values.
> > ---
> > misc/mke2fs.8.in | 6 +++---
> > 1 file changed, 3 insertions(+), 3 deletions(-)
> >
> > diff --git a/misc/mke2fs.8.in b/misc/mke2fs.8.in index
> > e6bfc6d6..b5b02144 100644
> > --- a/misc/mke2fs.8.in
> > +++ b/misc/mke2fs.8.in
> > @@ -230,9 +230,9 @@ test is used instead of a fast read-only test.
> > .TP
> > .B \-C " cluster-size"
> > Specify the size of cluster in bytes for filesystems using the
> > bigalloc -feature. Valid cluster-size values are from 2048 to 256M
> > bytes per -cluster. This can only be specified if the bigalloc
> > feature is -enabled. (See the
> > +feature. Valid cluster-size values are from 2048 to 128M bytes per
> > +cluster based on filesystem blocksize. This can only be specified if
> > +the bigalloc feature is enabled. (See the
> > .B ext4 (5)
>
>
> This is an improvement, but doesn't really explain the details of the limits.
> Instead of "based on filesystem blocksize." I think writing "between 2-32768
> times the filesystem blocksize." or similar would be more clear and explain
> how the actual limits relate to the blocksize.
Hi, Andreas. Thank you for the comment. Here are the details:
The function ext2fs_new_range() is causing the error. This function gets
called while creating the journal inode.
The purpose of ext2fs_new_range() is to return atleast requested amount of
free memory.
Following is case, where the function returns successfully:
Breakpoint 5, ext2fs_new_range (fs=fs@...ry=0x555555779070,
flags=flags@...ry=0, goal=131072, len=len@...ry=32768,
map=map@...ry=0x0, pblk=pblk@...ry=0x7fffffffd120, plen=0x7fffffffd128)
at alloc.c:407
If we observe we can see that the argument length is positive value (32768),
hence the function allocates atleast requested amount of memory and returns
successfully.
Now, lets look at the function arguments, when it is returning error:
Breakpoint 5, ext2fs_new_range (fs=fs@...ry=0x555555779070,
flags=flags@...ry=0,
goal=262144, len=len@...ry=0, map=map@...ry=0x0,
pblk=pblk@...ry=0x7fffffffd140,
plen=0x7fffffffd148) at alloc.c:407
The length argument is 0. Therefore, function is returning an error.
The value of len argument is calculate based on the values of blocksize,
cluster_size.
Following are steps through which len value is calculated:
len = EXT_INIT_MAX_LEN & ~EXT2FS_CLUSTER_MASK(fs);
* EXT_INIT_MAX_LEN = 1 << 15
* EXT2FS_CLUSTER_MASK(fs) = ((1 << (fs)->cluster_ratio_bits) - 1)
* fs->cluster_ratio_bits = super->s_log_cluster_size - super->s_log_block_size;
* super->s_log_cluster_size = int_log2(cluster_size >> EXT2_MIN_CLUSTER_LOG_SIZE);
where EXT2_MIN_CLUSTER_LOG_SIZE = 10
* super->s_log_block_size = int_log2(blocksize >> EXT2_MIN_BLOCK_LOG_SIZE)
where EXT2_MIN_BLOCK_LOG_SIZE = 10
Following table which gives len value, for different combinations of
blocksize and clustersize:
A = blocksize
B = clustersize
C = s_log_block_size
D = s_log_cluster_size
E = D - C
F = ((1<<E)-1)
len = (32768 & ~F)
len is passed as argument to ext2fs_new_range().
Failure cases:
------------------------------------------
A | B | C | D | E | F | len
------------------------------------------
1k 64m 0 16 16 65535 0
1k 128m 0 17 17 131071 0
1k 256m 0 18 18 262143 0
2k 128m 1 17 16 65535 0
2k 256m 1 18 17 131071 0
4k 256m 2 18 16 65535 0
successful cases:
1k 32m 0 15 15 32767 32768
2k 64m 1 16 15 32767 32768
4k 128m 2 17 15 32767 32768
For successful cases, len is valid value (len>0), whereas for the
failed case length is zero. Hence, the error 'Invalid Argument'.
The conclusion is that mkfs.ext4 fails for all the cases, where
the ratio of cluster_size to blocksize is greaterthan or equal to 2^16.
>
> Cheers, Andreas
Thanks, Srivathsa
Powered by blists - more mailing lists