linux-ext4 - [PATCH v4 0/7] 64bit inode e2fsprogs support

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Message-Id: <20180504070923.45140-1-c17828@cray.com>
Date:   Fri,  4 May 2018 10:09:16 +0300
From:   c17828 <artem.blagodarenko@...il.com>
To:     linux-ext4@...r.kernel.org
Cc:     adilger.kernel@...ger.ca
Subject: [PATCH v4 0/7] 64bit inode e2fsprogs support

With current hardware clusters faced with the trouble of
creating enough inodes on partitions. Lustre has 0-size
files to store some information about files. Current
MDS disk sizes allow to store large amount of such files, but
EXT4 limits this number to ~4 billions.

Lustre FS has features like DNE to distribute metadata over many targets
(disks), but disks are used not effectively. It would be great to have
ability to store more then ~4 billions inodes on one EXT4 file system.

4th version of patches set. Changes since v3:
* Fixed inodes numbers printing
* INCOMPAT_DIRDATA is enabled on early fsck stage if INCOMPAT_INODE64 is enabled
* 64bit cleanup for superblocks fields: s_inodes_count, free_inodes_count,
  last_orphan, first_error_ino, last_error_ino
* Helpers added to separate patch
* "fid:" prefix added in the original 1/7 patch

Andreas Dilger (2):
  e2fsck: add support for dirdata feature
  tests: add basic tests for dirdata feature

Artem Blagodarenko (4):
  debugfs: 64bit inode support
  ext2fs: Add helper functions to access inode numbers
  ext2fs: add EXT4_FEATURE_INCOMPAT_64INODE support
  e2fsck: INODE64 high part is more important then LUFID

Bobi Jam (1):
  tests: e2fsck -D does not change dirdata

 debugfs/debugfs.c                 |   2 +-
 debugfs/htree.c                   |   2 +-
 debugfs/ls.c                      |  69 ++++-
 debugfs/set_fields.c              |   3 +-
 debugfs/util.c                    |   7 +-
 e2fsck/dirinfo.c                  |  28 +--
 e2fsck/e2fsck.h                   |  22 +-
 e2fsck/extents.c                  |   8 +-
 e2fsck/journal.c                  |   2 +-
 e2fsck/pass1.c                    |  24 +-
 e2fsck/pass1b.c                   |   2 +-
 e2fsck/pass2.c                    | 174 ++++++++++---
 e2fsck/pass3.c                    |   9 +-
 e2fsck/pass4.c                    |   2 +-
 e2fsck/pass5.c                    |  20 +-
 e2fsck/problem.c                  |  10 +
 e2fsck/problem.h                  |   8 +-
 e2fsck/quota.c                    |   2 +-
 e2fsck/rehash.c                   |  82 +++---
 e2fsck/super.c                    |  23 +-
 e2fsck/unix.c                     |  17 +-
 ext2ed/inode_com.c                |   7 +-
 ext2ed/super_com.c                |   6 +-
 lib/e2p/feature.c                 |   2 +
 lib/e2p/ls.c                      |  17 +-
 lib/ext2fs/alloc.c                |   8 +-
 lib/ext2fs/alloc_stats.c          |   6 +-
 lib/ext2fs/bitmaps.c              |   2 +-
 lib/ext2fs/dirblock.c             |  33 +++
 lib/ext2fs/ext2_fs.h              |  32 ++-
 lib/ext2fs/ext2fs.h               |  65 ++++-
 lib/ext2fs/extent.c               |   2 +-
 lib/ext2fs/gen_bitmap64.c         |   3 +-
 lib/ext2fs/get_num_dirs.c         |   4 +-
 lib/ext2fs/icount.c               |   7 +-
 lib/ext2fs/initialize.c           |  20 +-
 lib/ext2fs/inline_data.c          |  16 +-
 lib/ext2fs/inode.c                |   8 +-
 lib/ext2fs/link.c                 |  10 +-
 lib/ext2fs/newdir.c               |   4 +-
 lib/ext2fs/openfs.c               |   2 +-
 lib/ext2fs/rw_bitmaps.c           |   2 +-
 lib/ext2fs/swapfs.c               |   6 +
 lib/ext2fs/tst_bitmaps.c          |   7 +-
 lib/ext2fs/tst_iscan.c            |   2 +-
 lib/ext2fs/tst_super_size.c       |   8 +-
 misc/findsuper.c                  |   8 +-
 misc/fuse2fs.c                    |  20 +-
 misc/mke2fs.c                     |  38 ++-
 misc/tune2fs.c                    |  12 +-
 resize/main.c                     |   3 +-
 resize/resize2fs.c                |  30 +--
 tests/f_dir_optimize/expect.1     | 511 ++++++++++++++++++++++++++++++++++++++
 tests/f_dir_optimize/expect.2     | 511 ++++++++++++++++++++++++++++++++++++++
 tests/f_dir_optimize/image.gz     | Bin 0 -> 102520 bytes
 tests/f_dir_optimize/name         |   1 +
 tests/f_dir_optimize/script       |  36 +++
 tests/f_dirdata/expect.1          |  15 ++
 tests/f_dirdata/expect.2          |   7 +
 tests/f_dirdata/image.gz          | Bin 0 -> 72169 bytes
 tests/f_dirdata/name              |   1 +
 tests/f_dirdata_optimize/expect.1 |  10 +
 tests/f_dirdata_optimize/expect.2 |   7 +
 tests/f_dirdata_optimize/image.gz | Bin 0 -> 32121 bytes
 tests/f_dirdata_optimize/name     |   1 +
 tests/f_dirdata_optimize/script   |   3 +
 tests/progs/test_icount.c         |   4 +-
 67 files changed, 1756 insertions(+), 257 deletions(-)
 create mode 100644 tests/f_dir_optimize/expect.1
 create mode 100644 tests/f_dir_optimize/expect.2
 create mode 100644 tests/f_dir_optimize/image.gz
 create mode 100644 tests/f_dir_optimize/name
 create mode 100644 tests/f_dir_optimize/script
 create mode 100644 tests/f_dirdata/expect.1
 create mode 100644 tests/f_dirdata/expect.2
 create mode 100644 tests/f_dirdata/image.gz
 create mode 100644 tests/f_dirdata/name
 create mode 100644 tests/f_dirdata_optimize/expect.1
 create mode 100644 tests/f_dirdata_optimize/expect.2
 create mode 100644 tests/f_dirdata_optimize/image.gz
 create mode 100644 tests/f_dirdata_optimize/name
 create mode 100644 tests/f_dirdata_optimize/script

-- 
2.14.3 (Apple Git-98)