linux-kernel - makedumpfile parallel dumping test

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [day] [month] [year] [list]

Message-ID: <51751B21.4080505@hp.com>
Date:	Mon, 22 Apr 2013 19:12:33 +0800
From:	Jingbai Ma <jingbai.ma@...com>
To:	Vivek Goyal <vgoyal@...hat.com>,
	HATAYAMA Daisuke <d.hatayama@...fujitsu.com>,
	zhangyanfei@...fujitsu.com,
	"Mitchell, Lisa (MCLinux in Fort Collins)" <lisa.mitchell@...com>,
	"kumagai-atsushi@....nes.nec.co.jp" 
	<kumagai-atsushi@....nes.nec.co.jp>,
	"Eric W. Biederman" <ebiederm@...ssion.com>, cpw@....com,
	akpm@...ux-foundation.org,
	"yinghai@...nel.org" <yinghai@...nel.org>
CC:	jingbai.ma@...com,
	"kexec@...ts.infradead.org" <kexec@...ts.infradead.org>,
	"linux-kernel@...r.kernel.org" <linux-kernel@...r.kernel.org>
Subject: makedumpfile parallel dumping test

Hi all,

I have done some experiments on parallel kernel dumping. I would like to 
share the test result with you. Hope it helps.

Test environment:
Machine: HP ProLiant DL980 G7 with 4TB RAM.
CPU: Intel(R) Xeon(R) CPU E7- 2860  @ 2.27GHz (8 sockets, 10 cores) (4 
CPU were enabled the 2nd kernel by nr_cpus=4)
Kernel 3.9.0-rc7
kexec-tools 2.0.4
makedumpfile v1.5.3 with lzo library
crashkernel=4096M (I have tested with 2048M but failed with OOM on 3 or 
4 parallels dumping in cyclic mode)

I didn't get a real multipath storage device, so I just put dump files 
on 4 different disks via 3 HP Smart Array controllers. (mounted on /0, 
/1, /2 and /3 in the capture kernel)

Measured time like this (for example: lzo compression, non-cyclic, 4 
parallels):
time makedumpfile -l -non-cyclic --split --message-level 23 -d 31 
/proc/vmcore /0/vmcore_0 /1/vmcore_1 /2/vmcore_2 /3/vmcore_3

I run several tests with different option, parallels from 1 to 4, and 
combined with zlib and lzo compression.

Test result:
-----------------------------------------------------------------
|               |Parallels 1|Parallels 2|Parallels 3|Parallels 4|
-----------------------------------------------------------------
|zlib cyclic    | 42m25.321s|  34m0.168s| 29m44.908s| 28m50.387s|
-----------------------------------------------------------------
|zlib non-cyclic|  42m7.842s| 28m28.275s| 23m25.750s|  21m6.476s|
-----------------------------------------------------------------
|lzo cyclic     | 23m40.010s| 18m19.932s| 21m47.903s| 22m47.605s|
-----------------------------------------------------------------
|lzo non-cyclic | 20m45.749s| 16m42.045s| 15m41.070s| 15m18.605s|
-----------------------------------------------------------------


-- 
Thanks,
Jingbai Ma
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/