linux-kernel - Re: [PATCH RFC 0/4] erofs-utils: Add --meta_fix and --meta

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite for Android: free password hash cracker in your pocket

[<prev] [next>] [<thread-prev] [day] [month] [year] [list]

Message-ID: <bcf043d2-e96b-4f8d-b83b-de2b5ad4657e@linux.alibaba.com>
Date: Thu, 24 Apr 2025 08:39:57 +0800
From: Gao Xiang <hsiangkao@...ux.alibaba.com>
To: Hongbo Li <lihongbo22@...wei.com>, xiang@...nel.org, chao@...nel.org,
 huyue2@...lpad.com, jefflexu@...ux.alibaba.com
Cc: linux-erofs@...ts.ozlabs.org, linux-kernel@...r.kernel.org
Subject: Re: [PATCH RFC 0/4] erofs-utils: Add --meta_fix and --meta_only
 format options



On 2025/4/22 22:37, Hongbo Li wrote:
> 
> 
> On 2025/4/22 21:50, Gao Xiang wrote:
>> Hi Hongbo,
>>
>> On 2025/4/22 20:36, Hongbo Li wrote:
>>> In this patchset, we have added two formatting options --meta_fix and
>>> --meta_only to extend the ability of EROFS. In the case of using OBS,
>>> we can convert the directory tree structure from OBS into the erofs
>>> image and implement on-demand loading logic based on this. Since OBS
>>> objects are often large, we need to separate the metadata area from
>>> the data area, which is the reason we introduce the --meta_fix option.
>>> To accelerate the formatting process, we can skip the formatting of
>>> the raw data by adding --meta_only option.
>>
>> Thanks for the patches!
>>
>> I wonder if it's possible to reuse blobchunk.c codebase for
>> such usage in the short term.
>>
> Our initial plan was to reuse the blobchunk.c logic, but we found that the chunk-based layout has some minor issues when handling contiguous blocks—it would result in multiple elements in the chunk index array (whereas blobraw expects only oversized chunks).

Sorry for late reply.

It seems blobchunk bugs? Could you submit fixes for this?

Thanks,
Gao Xiang