lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-ID: <AANLkTikixQLgsf=HTYkT3Xrv6m+JTJ_UoKSvc9VRfQoL@mail.gmail.com>
Date:	Sun, 20 Mar 2011 12:33:44 +0200
From:	Amir Goldstein <amir73il@...il.com>
To:	"Theodore Ts'o" <tytso@....edu>
Cc:	linux-ext4@...r.kernel.org
Subject: Re: [PATCH, RFC 00/12] bigalloc patchset

On Sat, Mar 19, 2011 at 11:28 PM, Theodore Ts'o <tytso@....edu> wrote:
> This is an initial patchset of the bigalloc patches to ext4.  This patch
> adds support for clustered allocation, so that each bit in the ext4
> block allocation bitmap addresses a power of two number of blocks.  For
> example, if the file system is mainly going to be storing large files in
> the 4-32 megabyte range, it might make sense to set a cluster size of 1
> megabyte.  This means that each bit in the block allocaiton bitmap would
> now address 256 4k blocks, and it means that the size of the block
> bitmaps for a 2T file system shrinks from 64 megabytes to 256k.  It also
> means that a block group addresses 32 gigabytes instead of 128
> megabytes, also shrinking the amount of file system overhead for
> metadata.
>
> The cost is increased disk space efficiency.  Directories will consume
> 1T, as will extent tree blocks.  (I am on the fence as to whether I
> should add complexity so that in the rare case that an inode needs more
> than 344 extents --- a highly fragmented file indeed --- and need a
> second extent tree block, we can avoid allocating any cluster and
> instead use another block from the cluster used by the inode.  The
> concern is the amount of complexity this adds to the e2fsck, not just to
> the kernel.)

Unless you define extent tree block size = cluster size.
Shouldn't be too hard to teach that to kernel and fsck, right?

>
> To test these patches, I have used an *extremely* kludgy set of patches
> to e2fsprogs, which are attached below.  These patches need *extensive*
> revision before I would consider them clean enough suitable for
> committing into e2fsprogs, but they were sufficient for me to do the
> kernel-side changes --- mke2fs, dumpe2fs, and debugfs work.  E2fsck most
> definitely does _not_ work at this stage.
>
> Please comment!  I do not intend for these patches to be merged during
> the 2.6.39 merge window.  I am targetting 2.6.40, 3 months from now,
> since these patches are quite extensive.
>
>                                                        - Ted
>
> Theodore Ts'o (12):
>  ext4: read-only support for bigalloc file systems
>  ext4: enforce bigalloc restrictions (e.g., no online resizing, etc.)
>  ext4: Convert instances of EXT4_BLOCKS_PER_GROUP to
>    EXT4_CLUSTERS_PER_GROUP
>  ext4: Remove block bitmap initialization in ext4_new_inode()
>  ext4: factor out block group accounting into functions
>  ext4: split out ext4_free_blocks_after_init()
>  ext4: bigalloc changes to block bitmap initialization functions
>  ext4: Convert block group-relative offsets to use clusters
>  ext4: teach ext4_ext_map_blocks() about the bigalloc feature


I think you are missing an important patch here:

ext4: teach ext4_free_blocks() about the bigalloc feature

Free only clusters whose 'base' block is contained within the
requested blocks range.


>  ext4: teach ext4_statfs() to deal with clusters if bigalloc is
>    enabled
>  ext4: tune mballoc's default group prealloc size for bigalloc file
>    systems
>  ext4: enable mounting bigalloc as read/write
>
>  fs/ext4/balloc.c  |  268 +++++++++++++++++++++++++++++++++--------------------
>  fs/ext4/ext4.h    |   47 ++++++++--
>  fs/ext4/extents.c |  132 +++++++++++++++++++++++---
>  fs/ext4/ialloc.c  |   37 --------
>  fs/ext4/inode.c   |    7 ++
>  fs/ext4/ioctl.c   |   33 ++++++-
>  fs/ext4/mballoc.c |   49 ++++++----
>  fs/ext4/mballoc.h |    3 +-
>  fs/ext4/super.c   |  100 ++++++++++++++++----
>  9 files changed, 472 insertions(+), 204 deletions(-)
>
> --
> 1.7.3.1
>
> ------------------- e2fsprogs patches follow below
>
> diff --git a/lib/ext2fs/bmap64.h b/lib/ext2fs/bmap64.h
> index b0aa84c..cfbdfd6 100644
> --- a/lib/ext2fs/bmap64.h
> +++ b/lib/ext2fs/bmap64.h
> @@ -31,6 +31,10 @@ struct ext2fs_struct_generic_bitmap {
>         ((bmap)->magic == EXT2_ET_MAGIC_BLOCK_BITMAP64) || \
>         ((bmap)->magic == EXT2_ET_MAGIC_INODE_BITMAP64))
>
> +/* Bitmap flags */
> +
> +#define EXT2_BMFLAG_CLUSTER 0x0001
> +
>  struct ext2_bitmap_ops {
>        int     type;
>        /* Generic bmap operators */
> diff --git a/lib/ext2fs/ext2_fs.h b/lib/ext2fs/ext2_fs.h
> index a89e33b..0970506 100644
> --- a/lib/ext2fs/ext2_fs.h
> +++ b/lib/ext2fs/ext2_fs.h
> @@ -228,9 +228,13 @@ struct ext2_dx_countlimit {
>
>  #define EXT2_BLOCKS_PER_GROUP(s)       (EXT2_SB(s)->s_blocks_per_group)
>  #define EXT2_INODES_PER_GROUP(s)       (EXT2_SB(s)->s_inodes_per_group)
> +#define EXT2_CLUSTERS_PER_GROUP(s)     (EXT2_SB(s)->s_clusters_per_group)
>  #define EXT2_INODES_PER_BLOCK(s)       (EXT2_BLOCK_SIZE(s)/EXT2_INODE_SIZE(s))
>  /* limits imposed by 16-bit value gd_free_{blocks,inode}_count */
> -#define EXT2_MAX_BLOCKS_PER_GROUP(s)   ((1 << 16) - 8)
> +#define EXT2_MAX_BLOCKS_PER_GROUP(s)   (((1 << 16) - 8) *      \
> +                                        (EXT2_CLUSTER_SIZE(s) / \
> +                                         EXT2_BLOCK_SIZE(s)))
> +#define EXT2_MAX_CLUSTERS_PER_GROUP(s) ((1 << 16) - 8)
>  #define EXT2_MAX_INODES_PER_GROUP(s)   ((1 << 16) - EXT2_INODES_PER_BLOCK(s))
>  #ifdef __KERNEL__
>  #define EXT2_DESC_PER_BLOCK(s)         (EXT2_SB(s)->s_desc_per_block)
> diff --git a/lib/ext2fs/ext2fs.h b/lib/ext2fs/ext2fs.h
> index d3eb31d..a065e87 100644
> --- a/lib/ext2fs/ext2fs.h
> +++ b/lib/ext2fs/ext2fs.h
> @@ -207,7 +207,7 @@ struct struct_ext2_filsys {
>        char *                          device_name;
>        struct ext2_super_block *       super;
>        unsigned int                    blocksize;
> -       int                             clustersize;
> +       int                             cluster_ratio;
>        dgrp_t                          group_desc_count;
>        unsigned long                   desc_blocks;
>        struct opaque_ext2_group_desc * group_desc;
> @@ -232,7 +232,8 @@ struct struct_ext2_filsys {
>        /*
>         * Reserved for future expansion
>         */
> -       __u32                           reserved[7];
> +       __u32                           clustersize;
> +       __u32                           reserved[6];
>
>        /*
>         * Reserved for the use of the calling application.
> @@ -553,7 +554,8 @@ typedef struct ext2_icount *ext2_icount_t;
>                                         EXT2_FEATURE_RO_COMPAT_LARGE_FILE|\
>                                         EXT4_FEATURE_RO_COMPAT_DIR_NLINK|\
>                                         EXT4_FEATURE_RO_COMPAT_EXTRA_ISIZE|\
> -                                        EXT4_FEATURE_RO_COMPAT_GDT_CSUM)
> +                                        EXT4_FEATURE_RO_COMPAT_GDT_CSUM|\
> +                                        EXT4_FEATURE_RO_COMPAT_BIGALLOC)
>
>  /*
>  * These features are only allowed if EXT2_FLAG_SOFTSUPP_FEATURES is passed
> diff --git a/lib/ext2fs/gen_bitmap64.c b/lib/ext2fs/gen_bitmap64.c
> index df095ac..60321df 100644
> --- a/lib/ext2fs/gen_bitmap64.c
> +++ b/lib/ext2fs/gen_bitmap64.c
> @@ -559,3 +559,85 @@ int ext2fs_warn_bitmap32(ext2fs_generic_bitmap bitmap, const char *func)
>                        "called %s with 64-bit bitmap", func);
>  #endif
>  }
> +
> +errcode_t ext2fs_allocate_cluster_bitmap(ext2_filsys fs,
> +                                        const char *descr,
> +                                        ext2fs_block_bitmap *ret)
> +{
> +       __u64           start, end, real_end;
> +       errcode_t       retval;
> +
> +       EXT2_CHECK_MAGIC(fs, EXT2_ET_MAGIC_EXT2FS_FILSYS);
> +
> +       if (!(fs->flags & EXT2_FLAG_64BITS))
> +               return EXT2_ET_CANT_USE_LEGACY_BITMAPS;
> +
> +       fs->write_bitmaps = ext2fs_write_bitmaps;
> +
> +       start = (fs->super->s_first_data_block >>
> +                EXT2_CLUSTER_SIZE_BITS(fs->super));
> +       end = (ext2fs_blocks_count(fs->super) - 1) / fs->cluster_ratio;
> +       real_end = ((__u64) EXT2_CLUSTERS_PER_GROUP(fs->super)
> +                   * (__u64) fs->group_desc_count)-1 + start;
> +
> +       retval = ext2fs_alloc_generic_bmap(fs,
> +                                          EXT2_ET_MAGIC_BLOCK_BITMAP64,
> +                                          EXT2FS_BMAP64_BITARRAY,
> +                                          start, end, real_end, descr, ret);
> +       if (retval)
> +               return retval;
> +
> +       (*ret)->flags = EXT2_BMFLAG_CLUSTER;
> +
> +       printf("Returning 0...\n");
> +       return 0;
> +}
> +
> +int ext2fs_is_cluster_bitmap(ext2fs_block_bitmap bm)
> +{
> +       if (EXT2FS_IS_32_BITMAP(bm))
> +               return 0;
> +
> +       return (bm->flags & EXT2_BMFLAG_CLUSTER);
> +}
> +
> +errcode_t ext2fs_convert_to_cluster_bitmap(ext2_filsys fs,
> +                                         ext2fs_block_bitmap bmap,
> +                                         ext2fs_block_bitmap *ret)
> +{
> +       ext2fs_block_bitmap     cmap;
> +       errcode_t               retval;
> +       blk64_t                 i, j, b_end, c_end;
> +       int                     n;
> +
> +       retval = ext2fs_allocate_cluster_bitmap(fs, "converted cluster bitmap",
> +                                               ret);
> +       if (retval)
> +               return retval;
> +
> +       cmap = *ret;
> +       i = bmap->start;
> +       b_end = bmap->end;
> +       bmap->end = bmap->real_end;
> +       j = cmap->start;
> +       c_end = cmap->end;
> +       cmap->end = cmap->real_end;
> +       n = 0;
> +       while (i < bmap->real_end) {
> +               if (ext2fs_test_block_bitmap2(bmap, i)) {
> +                       ext2fs_mark_block_bitmap2(cmap, j);
> +                       i += fs->cluster_ratio - n;
> +                       j++;
> +                       n = 0;
> +                       continue;
> +               }
> +               i++; n++;
> +               if (n >= fs->cluster_ratio) {
> +                       j++;
> +                       n = 0;
> +               }
> +       }
> +       bmap->end = b_end;
> +       cmap->end = c_end;
> +       return 0;
> +}
> diff --git a/lib/ext2fs/initialize.c b/lib/ext2fs/initialize.c
> index e1f229b..00a8b38 100644
> --- a/lib/ext2fs/initialize.c
> +++ b/lib/ext2fs/initialize.c
> @@ -94,6 +94,7 @@ errcode_t ext2fs_initialize(const char *name, int flags,
>        blk_t           numblocks;
>        int             rsv_gdt;
>        int             csum_flag;
> +       int             bigalloc_flag;
>        int             io_flags;
>        char            *buf = 0;
>        char            c;
> @@ -134,12 +135,25 @@ errcode_t ext2fs_initialize(const char *name, int flags,
>
>  #define set_field(field, default) (super->field = param->field ? \
>                                   param->field : (default))
> +#define assign_field(field)    (super->field = param->field)
>
>        super->s_magic = EXT2_SUPER_MAGIC;
>        super->s_state = EXT2_VALID_FS;
>
> -       set_field(s_log_block_size, 0); /* default blocksize: 1024 bytes */
> -       set_field(s_log_cluster_size, 0);
> +       bigalloc_flag = EXT2_HAS_RO_COMPAT_FEATURE(param,
> +                                  EXT4_FEATURE_RO_COMPAT_BIGALLOC);
> +
> +       assign_field(s_log_block_size);
> +
> +       if (bigalloc_flag) {
> +               set_field(s_log_cluster_size, super->s_log_block_size+4);
> +               if (super->s_log_block_size > super->s_log_cluster_size) {
> +                       retval = EXT2_ET_INVALID_ARGUMENT;
> +                       goto cleanup;
> +               }
> +       } else
> +               super->s_log_cluster_size = super->s_log_block_size;
> +
>        set_field(s_first_data_block, super->s_log_block_size ? 0 : 1);
>        set_field(s_max_mnt_count, 0);
>        set_field(s_errors, EXT2_ERRORS_DEFAULT);
> @@ -183,14 +197,36 @@ errcode_t ext2fs_initialize(const char *name, int flags,
>
>        fs->blocksize = EXT2_BLOCK_SIZE(super);
>        fs->clustersize = EXT2_CLUSTER_SIZE(super);
> +       fs->cluster_ratio = fs->clustersize / fs->blocksize;
> +
> +       if (bigalloc_flag) {
> +               if (param->s_blocks_per_group &&
> +                   param->s_clusters_per_group &&
> +                   ((param->s_clusters_per_group * fs->cluster_ratio) !=
> +                    param->s_blocks_per_group)) {
> +                       retval = EXT2_ET_INVALID_ARGUMENT;
> +                       goto cleanup;
> +               }
> +               if (param->s_clusters_per_group)
> +                       assign_field(s_clusters_per_group);
> +               else if (param->s_blocks_per_group)
> +                       super->s_clusters_per_group =
> +                               param->s_blocks_per_group / fs->cluster_ratio;
> +               else
> +                       super->s_clusters_per_group = fs->blocksize * 8;
> +               if (super->s_clusters_per_group > EXT2_MAX_CLUSTERS_PER_GROUP(super))
> +                       super->s_blocks_per_group = EXT2_MAX_CLUSTERS_PER_GROUP(super);
> +               super->s_blocks_per_group = super->s_clusters_per_group;
> +               super->s_blocks_per_group *= fs->cluster_ratio;
> +       } else {
> +               set_field(s_blocks_per_group, fs->blocksize * 8);
> +               if (super->s_blocks_per_group > EXT2_MAX_BLOCKS_PER_GROUP(super))
> +                       super->s_blocks_per_group = EXT2_MAX_BLOCKS_PER_GROUP(super);
> +               super->s_clusters_per_group = super->s_blocks_per_group;
> +       }
>
> -       /* default: (fs->blocksize*8) blocks/group, up to 2^16 (GDT limit) */
> -       set_field(s_blocks_per_group, fs->blocksize * 8);
> -       if (super->s_blocks_per_group > EXT2_MAX_BLOCKS_PER_GROUP(super))
> -               super->s_blocks_per_group = EXT2_MAX_BLOCKS_PER_GROUP(super);
> -       super->s_clusters_per_group = super->s_blocks_per_group;
> -
> -       ext2fs_blocks_count_set(super, ext2fs_blocks_count(param));
> +       ext2fs_blocks_count_set(super, ext2fs_blocks_count(param) &
> +                               ~((blk64_t) fs->cluster_ratio - 1));
>        ext2fs_r_blocks_count_set(super, ext2fs_r_blocks_count(param));
>        if (ext2fs_r_blocks_count(super) >= ext2fs_blocks_count(param)) {
>                retval = EXT2_ET_INVALID_ARGUMENT;
> @@ -246,7 +282,7 @@ retry:
>         */
>        ipg = ext2fs_div_ceil(super->s_inodes_count, fs->group_desc_count);
>        if (ipg > fs->blocksize * 8) {
> -               if (super->s_blocks_per_group >= 256) {
> +               if (!bigalloc_flag && super->s_blocks_per_group >= 256) {
>                        /* Try again with slightly different parameters */
>                        super->s_blocks_per_group -= 8;
>                        ext2fs_blocks_count_set(super,
> diff --git a/lib/ext2fs/openfs.c b/lib/ext2fs/openfs.c
> index 90abed1..8b37852 100644
> --- a/lib/ext2fs/openfs.c
> +++ b/lib/ext2fs/openfs.c
> @@ -251,6 +251,7 @@ errcode_t ext2fs_open2(const char *name, const char *io_options,
>                goto cleanup;
>        }
>        fs->clustersize = EXT2_CLUSTER_SIZE(fs->super);
> +       fs->cluster_ratio = fs->clustersize / fs->blocksize;
>        fs->inode_blocks_per_group = ((EXT2_INODES_PER_GROUP(fs->super) *
>                                       EXT2_INODE_SIZE(fs->super) +
>                                       EXT2_BLOCK_SIZE(fs->super) - 1) /
> diff --git a/lib/ext2fs/rw_bitmaps.c b/lib/ext2fs/rw_bitmaps.c
> index 3031b7d..aeea997 100644
> --- a/lib/ext2fs/rw_bitmaps.c
> +++ b/lib/ext2fs/rw_bitmaps.c
> @@ -51,7 +51,7 @@ static errcode_t write_bitmaps(ext2_filsys fs, int do_inode, int do_block)
>
>        inode_nbytes = block_nbytes = 0;
>        if (do_block) {
> -               block_nbytes = EXT2_BLOCKS_PER_GROUP(fs->super) / 8;
> +               block_nbytes = EXT2_CLUSTERS_PER_GROUP(fs->super) / 8;
>                retval = ext2fs_get_memalign(fs->blocksize, fs->blocksize,
>                                             &block_buf);
>                if (retval)
> @@ -85,7 +85,7 @@ static errcode_t write_bitmaps(ext2_filsys fs, int do_inode, int do_block)
>                        /* Force bitmap padding for the last group */
>                        nbits = ((ext2fs_blocks_count(fs->super)
>                                  - (__u64) fs->super->s_first_data_block)
> -                                % (__u64) EXT2_BLOCKS_PER_GROUP(fs->super));
> +                                % (__u64) EXT2_CLUSTERS_PER_GROUP(fs->super));
>                        if (nbits)
>                                for (j = nbits; j < fs->blocksize * 8; j++)
>                                        ext2fs_set_bit(j, block_buf);
> @@ -141,7 +141,7 @@ static errcode_t read_bitmaps(ext2_filsys fs, int do_inode, int do_block)
>        char *block_bitmap = 0, *inode_bitmap = 0;
>        char *buf;
>        errcode_t retval;
> -       int block_nbytes = EXT2_BLOCKS_PER_GROUP(fs->super) / 8;
> +       int block_nbytes = EXT2_CLUSTERS_PER_GROUP(fs->super) / 8;
>        int inode_nbytes = EXT2_INODES_PER_GROUP(fs->super) / 8;
>        int csum_flag = 0;
>        int do_image = fs->flags & EXT2_FLAG_IMAGE_FILE;
> @@ -219,7 +219,7 @@ static errcode_t read_bitmaps(ext2_filsys fs, int do_inode, int do_block)
>                }
>                blk = (fs->image_header->offset_blockmap /
>                       fs->blocksize);
> -               blk_cnt = (blk64_t)EXT2_BLOCKS_PER_GROUP(fs->super) *
> +               blk_cnt = (blk64_t)EXT2_CLUSTERS_PER_GROUP(fs->super) *
>                        fs->group_desc_count;
>                while (block_nbytes > 0) {
>                        retval = io_channel_read_blk64(fs->image_io, blk++,
> diff --git a/misc/dumpe2fs.c b/misc/dumpe2fs.c
> index c01ffe5..d3f617a 100644
> --- a/misc/dumpe2fs.c
> +++ b/misc/dumpe2fs.c
> @@ -71,25 +71,26 @@ static void print_range(unsigned long long a, unsigned long long b)
>                printf("%llu-%llu", a, b);
>  }
>
> -static void print_free (unsigned long group, char * bitmap,
> -                       unsigned long nbytes, unsigned long offset)
> +static void print_free(unsigned long group, char * bitmap,
> +                      unsigned long nbytes, unsigned long offset, int ratio)
>  {
>        int p = 0;
>        unsigned long i;
>        unsigned long j;
>
> +       offset /= ratio;
>        offset += group * nbytes;
>        for (i = 0; i < nbytes; i++)
>                if (!in_use (bitmap, i))
>                {
>                        if (p)
>                                printf (", ");
> -                       print_number(i + offset);
> +                       print_number((i + offset) * ratio);
>                        for (j = i; j < nbytes && !in_use (bitmap, j); j++)
>                                ;
>                        if (--j != i) {
>                                fputc('-', stdout);
> -                               print_number(j + offset);
> +                               print_number((j + offset) * ratio);
>                                i = j;
>                        }
>                        p = 1;
> @@ -153,7 +154,7 @@ static void list_desc (ext2_filsys fs)
>        blk64_t         blk_itr = fs->super->s_first_data_block;
>        ext2_ino_t      ino_itr = 1;
>
> -       block_nbytes = EXT2_BLOCKS_PER_GROUP(fs->super) / 8;
> +       block_nbytes = EXT2_CLUSTERS_PER_GROUP(fs->super) / 8;
>        inode_nbytes = EXT2_INODES_PER_GROUP(fs->super) / 8;
>
>        if (fs->block_map)
> @@ -238,18 +239,19 @@ static void list_desc (ext2_filsys fs)
>                        fputs(_("  Free blocks: "), stdout);
>                        ext2fs_get_block_bitmap_range2(fs->block_map,
>                                 blk_itr, block_nbytes << 3, block_bitmap);
> -                       print_free (i, block_bitmap,
> -                                   fs->super->s_blocks_per_group,
> -                                   fs->super->s_first_data_block);
> +                       print_free(i, block_bitmap,
> +                                  fs->super->s_clusters_per_group,
> +                                  fs->super->s_first_data_block,
> +                                  fs->cluster_ratio);
>                        fputc('\n', stdout);
> -                       blk_itr += fs->super->s_blocks_per_group;
> +                       blk_itr += fs->super->s_clusters_per_group;
>                }
>                if (inode_bitmap) {
>                        fputs(_("  Free inodes: "), stdout);
>                        ext2fs_get_inode_bitmap_range2(fs->inode_map,
>                                 ino_itr, inode_nbytes << 3, inode_bitmap);
> -                       print_free (i, inode_bitmap,
> -                                   fs->super->s_inodes_per_group, 1);
> +                       print_free(i, inode_bitmap,
> +                                  fs->super->s_inodes_per_group, 1, 1);
>                        fputc('\n', stdout);
>                        ino_itr += fs->super->s_inodes_per_group;
>                }
> diff --git a/misc/mke2fs.c b/misc/mke2fs.c
> index 9798b88..079638f 100644
> --- a/misc/mke2fs.c
> +++ b/misc/mke2fs.c
> @@ -815,7 +815,8 @@ static __u32 ok_features[3] = {
>                EXT4_FEATURE_RO_COMPAT_DIR_NLINK|
>                EXT4_FEATURE_RO_COMPAT_EXTRA_ISIZE|
>                EXT2_FEATURE_RO_COMPAT_SPARSE_SUPER|
> -               EXT4_FEATURE_RO_COMPAT_GDT_CSUM
> +               EXT4_FEATURE_RO_COMPAT_GDT_CSUM|
> +               EXT4_FEATURE_RO_COMPAT_BIGALLOC
>  };
>
>
> @@ -1252,7 +1253,7 @@ profile_error:
>        }
>
>        while ((c = getopt (argc, argv,
> -                   "b:cf:g:G:i:jl:m:no:qr:s:t:vE:FI:J:KL:M:N:O:R:ST:U:V")) != EOF) {
> +                   "b:cg:i:jl:m:no:qr:s:t:vC:E:FG:I:J:KL:M:N:O:R:ST:U:V")) != EOF) {
>                switch (c) {
>                case 'b':
>                        blocksize = strtol(optarg, &tmp, 0);
> @@ -1275,17 +1276,17 @@ profile_error:
>                case 'c':       /* Check for bad blocks */
>                        cflag++;
>                        break;
> -               case 'f':
> +               case 'C':
>                        size = strtoul(optarg, &tmp, 0);
> -                       if (size < EXT2_MIN_BLOCK_SIZE ||
> -                           size > EXT2_MAX_BLOCK_SIZE || *tmp) {
> +                       if (size < EXT2_MIN_CLUSTER_SIZE ||
> +                           size > EXT2_MAX_CLUSTER_SIZE || *tmp) {
>                                com_err(program_name, 0,
>                                        _("invalid fragment size - %s"),
>                                        optarg);
>                                exit(1);
>                        }
> -                       fprintf(stderr, _("Warning: fragments not supported.  "
> -                              "Ignoring -f option\n"));
> +                       fs_param.s_log_cluster_size =
> +                               int_log2(size >> EXT2_MIN_CLUSTER_LOG_SIZE);
>                        break;
>                case 'g':
>                        fs_param.s_blocks_per_group = strtoul(optarg, &tmp, 0);
> @@ -1515,8 +1516,6 @@ profile_error:
>                check_plausibility(device_name);
>        check_mount(device_name, force, _("filesystem"));
>
> -       fs_param.s_log_cluster_size = fs_param.s_log_block_size;
> -
>        /* Determine the size of the device (if possible) */
>        if (noaction && fs_blocks_count) {
>                dev_size = fs_blocks_count;
> @@ -1752,16 +1751,24 @@ profile_error:
>                }
>        }
>
> +       fs_param.s_log_block_size =
> +               int_log2(blocksize >> EXT2_MIN_BLOCK_LOG_SIZE);
> +       if (fs_param.s_feature_ro_compat & EXT4_FEATURE_RO_COMPAT_BIGALLOC) {
> +               if (fs_param.s_log_cluster_size == 0)
> +                       fs_param.s_log_cluster_size =
> +                               fs_param.s_log_block_size + 4;
> +       } else
> +               fs_param.s_log_cluster_size = fs_param.s_log_block_size;
> +
>        if (inode_ratio == 0) {
>                inode_ratio = get_int_from_profile(fs_types, "inode_ratio",
>                                                   8192);
>                if (inode_ratio < blocksize)
>                        inode_ratio = blocksize;
> +               if (inode_ratio < EXT2_CLUSTER_SIZE(&fs_param))
> +                       inode_ratio = EXT2_CLUSTER_SIZE(&fs_param);
>        }
>
> -       fs_param.s_log_cluster_size = fs_param.s_log_block_size =
> -               int_log2(blocksize >> EXT2_MIN_BLOCK_LOG_SIZE);
> -
>  #ifdef HAVE_BLKID_PROBE_GET_TOPOLOGY
>        retval = get_device_geometry(device_name, &fs_param, psector_size);
>        if (retval < 0) {
> @@ -2049,6 +2056,33 @@ static int mke2fs_discard_device(ext2_filsys fs)
>        return retval;
>  }
>
> +static fix_cluster_bg_counts(ext2_filsys fs)
> +{
> +       blk64_t cluster, num_clusters, tot_free;
> +       int     grp_free, num_free, group, num;
> +
> +       num_clusters = ext2fs_blocks_count(fs->super) / fs->cluster_ratio;
> +       tot_free = num_free = num = group = grp_free = 0;
> +       for (cluster = fs->super->s_first_data_block / fs->cluster_ratio;
> +            cluster < num_clusters; cluster++) {
> +               if (!ext2fs_test_block_bitmap2(fs->block_map, cluster)) {
> +                       grp_free++;
> +                       tot_free++;
> +               }
> +               num++;
> +               if ((num == fs->super->s_clusters_per_group) ||
> +                   (cluster == num_clusters-1)) {
> +                       printf("Group %d has free #: %d\n", group, grp_free);
> +                       ext2fs_bg_free_blocks_count_set(fs, group, grp_free);
> +                       ext2fs_group_desc_csum_set(fs, group);
> +                       num = 0;
> +                       grp_free = 0;
> +                       group++;
> +               }
> +       }
> +       ext2fs_free_blocks_count_set(fs->super, tot_free);
> +}
> +
>  int main (int argc, char *argv[])
>  {
>        errcode_t       retval = 0;
> @@ -2367,6 +2401,17 @@ int main (int argc, char *argv[])
>        }
>  no_journal:
>
> +       if (EXT2_HAS_RO_COMPAT_FEATURE(&fs_param,
> +                                      EXT4_FEATURE_RO_COMPAT_BIGALLOC)) {
> +               ext2fs_block_bitmap cluster_map;
> +
> +               retval = ext2fs_convert_to_cluster_bitmap(fs, fs->block_map,
> +                                                        &cluster_map);
> +               ext2fs_free_block_bitmap(fs->block_map);
> +               fs->block_map = cluster_map;
> +               fix_cluster_bg_counts(fs);
> +       }
> +
>        if (!quiet)
>                printf(_("Writing superblocks and "
>                       "filesystem accounting information: "));
> --
> To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
> the body of a message to majordomo@...r.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>
--
To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ