linux-kernel - Re: [LTP] [ANNOUNCE] The Linux Test Project has been Released for June 2007,

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite for Android: free password hash cracker in your pocket

[<prev] [next>] [thread-next>] [day] [month] [year] [list]

Message-Id: <20070702085054.0efb79ff.rdunlap@xenotime.net>
Date:	Mon, 2 Jul 2007 08:50:54 -0700
From:	Randy Dunlap <rdunlap@...otime.net>
To:	Subrata Modak <subrata@...ux.vnet.ibm.com>
Cc:	ltp-list@...ts.sourceforge.net, linux-kernel@...r.kernel.org,
	ltp-announce@...ts.sourceforge.net
Subject: Re: [LTP] [ANNOUNCE] The Linux Test Project has been Released for
 June 2007,

On Mon, 02 Jul 2007 12:28:50 +0530 Subrata Modak wrote:

>   :-) *Dear All*,
>  
> *Note(s) from the Maintainer: *
> * We have seen that the LTP mailing lists has become active for the last 
> couple of months. Thanks to all who has made this happen. We as an 
> integrated team can work hard to make this Project a resounding success. 
> Following are the different milestones/activities that we aim to 
> perform/achieve in the coming months:
> 1) Investigation into LTP Log(s) Library to make this more meaningful 
> and parsible. Kindly provide your inputs for the output that LTP 
> generates now and whether/how you would like it to be in future

I don't know if this qualifies as an input for the output, but
I use a script to parse the results file to compute a gross/overall
"SCORE" value.  Instead of looking at lines that contain
"termination_id" (e.g.:
duration=0 termination_type=exited termination_id=0 corefile=no
), I look at the test results output format messages and count
them (ignoring the INFO lines) and then compute a SCORE based on
all of those lines.  Obviously that's why I've been changing several
test cases to use the standard test results output format.

ltprun-summary.sh is attached.  It uses prtag2tag.pl, which is also
attached.  (I also do this summary SCORE for the Open Posix Test suite.)

Example summary + SCORE:

Using logfile=/cruc/runs/1789/test_output/ltp.log
build errors:  0 lines
PASS:          2225
WARNing:       1
BROKen:        1
RETiRed:       0
FAIL:          0
CONFig error:  11
SCORE.ltp:        99.5

> *Please also see the ChangeLog Below (June 2007):* *

so "[PATCH] float tests: use standard test results output"
(http://sourceforge.net/mailarchive/forum.php?thread_name=20070622214652.d137d055.rdunlap%40xenotime.net&forum_name=ltp-list)
will be added next month?

---
~Randy
*** Remember to use Documentation/SubmitChecklist when testing your code ***

Download attachment "ltprun-summary.sh" of type "application/x-shellscript" (1554 bytes)

Download attachment "prtag2tag.pl" of type "application/x-perl" (744 bytes)