linux-kernel - Re: [PATCH 2/4] crypto: qat

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <20230905162302.GD14420@twin.jikos.cz>
Date:   Tue, 5 Sep 2023 18:23:02 +0200
From:   David Sterba <dsterba@...e.cz>
To:     Giovanni Cabiddu <giovanni.cabiddu@...el.com>
Cc:     Herbert Xu <herbert@...dor.apana.org.au>,
        Linus Torvalds <torvalds@...ux-foundation.org>,
        ardb@...nel.org, kees@...nel.org, linux-kernel@...r.kernel.org,
        enlin.mu@...soc.com, ebiggers@...gle.com, gpiccoli@...lia.com,
        willy@...radead.org, yunlong.xing@...soc.com,
        yuxiaozhang@...gle.com, qat-linux@...el.com,
        Linux Crypto Mailing List <linux-crypto@...r.kernel.org>,
        Yang Shen <shenyang39@...wei.com>,
        Zhou Wang <wangzhou1@...ilicon.com>,
        Weigang Li <weigang.li@...el.com>, Chris Mason <clm@...a.com>,
        Brian Will <brian.will@...el.com>, linux-btrfs@...r.kernel.org
Subject: Re: [PATCH 2/4] crypto: qat - Remove zlib-deflate

On Tue, Sep 05, 2023 at 02:15:44PM +0100, Giovanni Cabiddu wrote:
> Hi Herbert,
> 
> On Wed, Aug 30, 2023 at 06:08:47PM +0800, Herbert Xu wrote:
> > Remove the implementation of zlib-deflate because it is completely
> > unused in the kernel.
> We are working at a new revision of [1] which enables BTRFS to use acomp
> for offloading zlib-deflate. We see that there is value in using QAT for
> such use case in terms of throughput / CPU utilization / compression ratio
> compared to software.
> Zlib-deflate is preferred to deflate since BTRFS already uses that
> format.
> 
> We expect to send this patch for 6.7.
> Can we keep zlib-deflate in the kernel?
> 
> Thanks,
> 
> [1] https://patchwork.kernel.org/project/linux-btrfs/patch/1467083180-111750-1-git-send-email-weigang.li@intel.com/

The patch is from 2016 and zlib though still supported has been
superseded by zstd that is from 2017. It would be good to see numbers
comparing zlib (cpu), zlib (qat) against relevant zstd levels. The
offloading might be an improvement and worth adding the support
otherwise I don't see much reason to add it unless there are users.

I can see there's QAT support for zstd too,
https://github.com/intel/QAT-ZSTD-Plugin, can't find one for lzo but in
case ther's QAT for all 3 algorithms used by btrfs I wouldn't mind
keeping the QAT support for zlib for parity.