linux-kernel - Re: Number of bugs

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <20080522075135.4933161c@infradead.org>
Date:	Thu, 22 May 2008 07:51:35 -0700
From:	Arjan van de Ven <arjan@...radead.org>
To:	Adrian Bunk <bunk@...nel.org>
Cc:	Bosko Radivojevic <bosko.radivojevic@...il.com>,
	linux-kernel@...r.kernel.org
Subject: Re: Number of bugs - statistics

On Thu, 22 May 2008 17:41:14 +0300
Adrian Bunk <bunk@...nel.org> wrote:

> On Thu, May 22, 2008 at 02:28:17PM +0200, Bosko Radivojevic wrote:
> 
> > Hi!
> 
> Hi Bosko!
> 
> > Is there any kind of analysis of number of (reported or resolved)
> > bugs through time in Linux kernel floating around? I'm trying to
> > convince my colleagues that newer kernel version does not mean more
> > bugs than the previous 'well tested' ones.
> 
> We definitely have many regressions (something that previously worked
> does no longer work) in each kernel.

... and many of those regressions are things people are unlikely to
hit. And we fix many long standing bugs as well.

Maybe some other data:
* The incoming rate of ACPI bugs has been pretty much flat the last 3
years, while the number of Linux (and ACPI) users has grown
significantly. The number of unfixed bugs has more than halved, from
over 200 to well below 100.
* The SCSI maintainer also reports that he sees flat to declining bug
rates; again with the increase in Linux user base that is a good sign

> 
> > Any kind of (research) reports or papers that address this issue is
> > more than welcome.
> 
> Any such reports or papers would anyway be flawed since we have no
> data one could use for doing serious statistics.

We have data for 2.6.25 at least, on which we can and do serious
statistics. Unfortunately we don't have that for older kernels.
What we have for older kernels only comes from lkml reports (which
isn't very representative), but that shows that the bug report pattern
is a bit spikey, in that kernels that get picked up by popular
distributions get more reports than those that don't (no big surprise,
those just have a much larger user base), but otherwise there's no up
or down trend to be seen there.

> 
> > Thanks!
> > 
> > Sincerely,
> > Bosko
> 
> cu
> Adrian
> 
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/