linux-kernel - Re: better/faster kernel tarball compression

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <jo2k77-9sp.ln1@chipmunk.wormnet.eu>
Date:	Mon, 22 Mar 2010 12:00:51 +0000
From:	Alexander Clouter <alex@...riz.org.uk>
To:	linux-kernel@...r.kernel.org
Subject: Re: better/faster kernel tarball compression

Tomasz Chmielewski <mangoo@...g.org> wrote:
>
>> 403804160 linux-2.6.34-rc2.tar
>>   67479563 linux-2.6.34-rc2.tar.bz2
>>   58452531 linux-2.6.34-rc2.tar.lz
> 
> Speaking of file sizes, xz[1] already provides better compression:
> 
> xz -k -9 linux-2.6.34-rc2.tar
> 
>     55320408 linux-2.6.34-rc2.tar.xz
> 
> xz -e -k -9 linux-2.6.34-rc2.tar
> 
>     54800808 linux-2.6.34-rc2.tar.xz
> 
> One drawback of xz is that it's not multi-threaded, much like bzip2 or 
> gzip; would be great if it could be changed.
> 
For some time there has been a multi-threaded bzip2 called 
pbzip2[1], for some time; hell even Debian has it :)

I have no idea why the original poster is trying to say how "all teh 
awesome" his code is being faster, well 'duh' it is using all the cores 
on $BOX rather than just a single one.

I would be interested in comparisons against pbzip2 and the amusingly 
named pigz[2]...plus a bunch of memory use comparisons, my AR7 board 
only has 16MB of RAM :)

Cheers

[1] http://compression.ca/pbzip2/ - supports stdio (de)compression
[2] http://www.zlib.net/pigz/ - no idea if this supports stdio

-- 
Alexander Clouter
.sigmonster says: Approved for veterans.

--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/