linux-kernel - some update // Re: [GIT PULL] erofs updates for 6.8-rc1

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives
Hash Suite for Android: free password hash cracker in your pocket
[<prev] [next>] [<thread-prev] [day] [month] [year] [list]
Date: Wed, 10 Jan 2024 20:26:24 +0800
From: Gao Xiang <xiang@...nel.org>
To: Linus Torvalds <torvalds@...uxfoundation.org>
Cc: linux-erofs@...ts.ozlabs.org, LKML <linux-kernel@...r.kernel.org>,
	Jingbo Xu <jefflexu@...ux.alibaba.com>, Chao Yu <chao@...nel.org>,
	Yue Hu <huyue2@...lpad.com>
Subject: some update // Re: [GIT PULL] erofs updates for 6.8-rc1

Hi Linus,

Sorry, could you consider pull this tag "erofs-for-6.8-rc1-2" instead of
the previous email one since commit de9bced860d4 ("erofs: fix
inconsistent per-file compression format") was just found
problematically on some LZMA images.

Since the previous email hasn't been processed, it'd be better to drop
this problematic patch directly and submit a new fix later instead of
fixing a fix commit.

The description for this pull request is still as below:

In this cycle, we'd like to enable basic sub-page compressed data
support for Android ecosystem (for vendors to try out 16k page size
with 4k-block images in their compatibility mode) as well as container
images (so that 4k-block images can be parsed on arm64 cloud servers
using 64k page size.)

In addition, there are several bugfixes and cleanups as usual.  All
commits have been in -next for a while and no potential merge conflict
is observed.

Sorry again,
Gao Xiang

The following changes since commit 2cc14f52aeb78ce3f29677c2de1f06c0e91471ab:

  Linux 6.7-rc3 (2023-11-26 19:59:33 -0800)

are available in the Git repository at:

  git://git.kernel.org/pub/scm/linux/kernel/git/xiang/erofs.git tags/erofs-for-6.8-rc1-2

for you to fetch changes up to aa12a790d31be14b289d5a2c6f41ca535fcc7841:

  erofs: make erofs_{err,info}() support NULL sb parameter (2024-01-10 19:59:39 +0800)

----------------------------------------------------------------
Changes since last update:

 - Add basic sub-page compressed data support;

 - Fix a memory leak on MicroLZMA and DEFLATE compression;

 - Fix a rare LZ4 inplace decompression issue on recent x86 CPUs;

 - Fix a KASAN issue reported by syzbot around crafted images;

 - Some cleanups.

----------------------------------------------------------------
Chunhai Guo (1):
      erofs: make erofs_{err,info}() support NULL sb parameter

Gao Xiang (9):
      erofs: fix memory leak on short-lived bounced pages
      erofs: fix lz4 inplace decompression
      erofs: support I/O submission for sub-page compressed blocks
      erofs: record `pclustersize` in bytes instead of pages
      erofs: fix up compacted indexes for block size < 4096
      erofs: fix ztailpacking for subpage compressed blocks
      erofs: refine z_erofs_transform_plain() for sub-page block support
      erofs: enable sub-page compressed block support
      erofs: avoid debugging output for (de)compressed data

Yue Hu (1):
      erofs: allow partially filled compressed bvecs

 fs/erofs/decompressor.c         | 120 +++++++++---------
 fs/erofs/decompressor_deflate.c |   2 +-
 fs/erofs/inode.c                |   6 +-
 fs/erofs/super.c                |  10 +-
 fs/erofs/zdata.c                | 267 ++++++++++++++++++----------------------
 fs/erofs/zmap.c                 |  32 +++--
 6 files changed, 211 insertions(+), 226 deletions(-)


On Sun, Jan 07, 2024 at 10:27:56PM +0800, Gao Xiang wrote:
> Hi Linus,
> 
> Could you consider this pull request for 6.8-rc1?
> 
> In this cycle, we'd like to enable basic sub-page compressed data
> support for Android ecosystem (for vendors to try out 16k page size
> with 4k-block images in their compatibility mode) as well as container
> images (so that 4k-block images can be parsed on arm64 cloud servers
> using 64k page size.)
> 
> In addition, there are several bugfixes and cleanups as usual.  All
> commits have been in -next for a while and no potential merge conflict
> is observed.
> 
> Thanks,
> Gao Xiang
> 
> The following changes since commit 2cc14f52aeb78ce3f29677c2de1f06c0e91471ab:
> 
>   Linux 6.7-rc3 (2023-11-26 19:59:33 -0800)
> 
> are available in the Git repository at:
> 
>   git://git.kernel.org/pub/scm/linux/kernel/git/xiang/erofs.git tags/erofs-for-6.8-rc1
> 
> for you to fetch changes up to 070aafcd2482dc31a12a3eda5d459c45496d6fb6:
> 
>   erofs: make erofs_{err,info}() support NULL sb parameter (2024-01-04 00:23:13 +0800)
> 
> ----------------------------------------------------------------
> Changes since last update:
> 
>  - Add basic sub-page compressed data support;
> 
>  - Fix a memory leak on MicroLZMA and DEFLATE compression;
> 
>  - Fix a rare LZ4 inplace decompression issue on recent x86 CPUs;
> 
>  - Two syzbot fixes around crafted images;
> 
>  - Some cleanups.
> 
> ----------------------------------------------------------------
> Chunhai Guo (1):
>       erofs: make erofs_{err,info}() support NULL sb parameter
> 
> Gao Xiang (10):
>       erofs: fix memory leak on short-lived bounced pages
>       erofs: fix lz4 inplace decompression
>       erofs: support I/O submission for sub-page compressed blocks
>       erofs: record `pclustersize` in bytes instead of pages
>       erofs: fix up compacted indexes for block size < 4096
>       erofs: fix ztailpacking for subpage compressed blocks
>       erofs: refine z_erofs_transform_plain() for sub-page block support
>       erofs: enable sub-page compressed block support
>       erofs: fix inconsistent per-file compression format
>       erofs: avoid debugging output for (de)compressed data
> 
> Yue Hu (1):
>       erofs: allow partially filled compressed bvecs
> 
>  fs/erofs/decompressor.c         | 122 +++++++++---------
>  fs/erofs/decompressor_deflate.c |   2 +-
>  fs/erofs/inode.c                |   6 +-
>  fs/erofs/super.c                |  10 +-
>  fs/erofs/zdata.c                | 267 ++++++++++++++++++----------------------
>  fs/erofs/zmap.c                 |  41 +++---
>  6 files changed, 218 insertions(+), 230 deletions(-)