linux-kernel - Re: [PATCH 3/3] coccicheck: add parallel execution

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <4E1E510A.6010005@cuw.edu>
Date:	Wed, 13 Jul 2011 21:14:34 -0500
From:	Greg Dietsche <gregory.dietsche@....edu>
To:	Joe Perches <joe@...ches.com>
CC:	julia@...u.dk, Gilles.Muller@...6.fr, npalix.work@...il.com,
	rdunlap@...otime.net, linux-doc@...r.kernel.org,
	linux-kernel@...r.kernel.org, cocci@...u.dk
Subject: Re: [PATCH 3/3] coccicheck: add parallel execution

On 07/12/2011 09:42 PM, Joe Perches wrote:
> On Tue, 2011-07-12 at 20:26 -0500, Greg Dietsche wrote:
>    
>> For example to process 6 SmPL patches at the same time:
>> 	make coccicheck PARALLEL=6
>> Results are held in /tmp until the scripts finish. By doing this the
>> script is able to collate the results from each SmPL patch instead of
>> interleaving them in the output.
>>      
> You might try adding support for gnu parallel instead.
> http://www.gnu.org/software/parallel/
>
>    
That is a very interesting and useful tool :) I'd never heard of it 
before. The man page scares me a little bit - lots of options are marked 
as "alpha testing," but the ones i tried seemed to work fine. Anyway, 
without any modifications to Coccinelle, it is possible to do this:

ls scripts/coccinelle/*/*.cocci | parallel -j+0 make coccicheck COCCI={} 
MODE=patch

it seems to behave mostly like my patch, but doesn't cleanup quite as 
well if you decide to kill it with ctrl-c (it leaves instances of spatch 
running). On the upside, it is up to 3 seconds faster than my patch 
(because my patch waits 3 seconds before checking on the number of jobs 
that are running).

Greg
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/