| lists.openwall.net | lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC | |
|
Open Source and information security mailing list archives
| ||
|
Date: Tue, 13 Aug 2019 13:29:40 +0200
From: Knut Omang <knut.omang@...cle.com>
To: Brendan Higgins <brendanhiggins@...gle.com>
Cc: "open list:KERNEL SELFTEST FRAMEWORK"
<linux-kselftest@...r.kernel.org>,
Linux Kernel Mailing List <linux-kernel@...r.kernel.org>,
"open list:DOCUMENTATION" <linux-doc@...r.kernel.org>,
linux-kbuild <linux-kbuild@...r.kernel.org>,
Shuah Khan <shuah@...nel.org>,
Jonathan Corbet <corbet@....net>,
Masahiro Yamada <yamada.masahiro@...ionext.com>,
Michal Marek <michal.lkml@...kovi.net>,
Greg Kroah-Hartman <gregkh@...uxfoundation.org>,
Shreyans Devendra Doshi <0xinfosect0r@...il.com>,
Alan Maguire <alan.maguire@...cle.com>,
Kevin Hilman <khilman@...libre.com>,
Hidenori Yamaji <hidenori.yamaji@...y.com>,
Frank Rowand <frowand.list@...il.com>,
Timothy Bird <Tim.Bird@...y.com>,
Luis Chamberlain <mcgrof@...nel.org>,
"Theodore Ts'o" <tytso@....edu>, Daniel Vetter <daniel@...ll.ch>,
Stephen Boyd <sboyd@...nel.org>
Subject: Re: [RFC 00/19] Integration of Kernel Test Framework (KTF) into the
kernel tree
On Tue, 2019-08-13 at 01:17 -0700, Brendan Higgins wrote:
> On Mon, Aug 12, 2019 at 11:11 PM Knut Omang <knut.omang@...cle.com> wrote:
> [...]
> > Alan Maguire (3):
> > ktf: Implementation of ktf support for overriding function entry and return.
> > ktf: A simple debugfs interface to test results
> > ktf: Simple coverage support
> >
> > Knut Omang (16):
> > kbuild: Fixes to rules for host-cshlib and host-cxxshlib
> > ktf: Introduce the main part of the kernel side of ktf
> > ktf: Introduce a generic netlink protocol for test result communication
> > ktf: An implementation of a generic associative array container
> > ktf: Configurable context support for network info setup
> > ktf: resolve: A helper utility to aid in exposing private kernel symbols to KTF tests.
> > ktf: Add documentation for Kernel Test Framework (KTF)
> > ktf: Add a small test suite with a few tests to test KTF itself
> > ktf: Main part of user land library for executing tests
> > ktf: Integration logic for running ktf tests from googletest
> > ktf: Internal debugging facilities
> > ktf: Some simple examples
> > ktf: Some user applications to run tests
> > ktf: Toplevel ktf Makefile/makefile includes and scripts to run from kselftest
> > kselftests: Enable building ktf
> > Documentation/dev-tools: Add index entry for KTF documentation
> >
> > Documentation/dev-tools/index.rst | 1 +-
> > Documentation/dev-tools/ktf/concepts.rst | 242 +++-
> > Documentation/dev-tools/ktf/debugging.rst | 248 +++-
> > Documentation/dev-tools/ktf/examples.rst | 26 +-
> > Documentation/dev-tools/ktf/features.rst | 307 ++++-
> > Documentation/dev-tools/ktf/implementation.rst | 70 +-
> > Documentation/dev-tools/ktf/index.rst | 14 +-
> > Documentation/dev-tools/ktf/installation.rst | 73 +-
> > Documentation/dev-tools/ktf/introduction.rst | 134 ++-
> > Documentation/dev-tools/ktf/progref.rst | 144 ++-
> > scripts/Makefile.host | 17 +-
> > tools/testing/selftests/Makefile | 1 +-
> > tools/testing/selftests/ktf/Makefile | 21 +-
> > tools/testing/selftests/ktf/examples/Makefile | 17 +-
> > tools/testing/selftests/ktf/examples/h2.c | 45 +-
> > tools/testing/selftests/ktf/examples/h3.c | 84 +-
> > tools/testing/selftests/ktf/examples/h4.c | 62 +-
> > tools/testing/selftests/ktf/examples/hello.c | 38 +-
> > tools/testing/selftests/ktf/examples/kgdemo.c | 61 +-
> > tools/testing/selftests/ktf/kernel/Makefile | 15 +-
> > tools/testing/selftests/ktf/kernel/ktf.h | 604 +++++++-
> > tools/testing/selftests/ktf/kernel/ktf_context.c | 409 +++++-
> > tools/testing/selftests/ktf/kernel/ktf_cov.c | 690 ++++++++-
> > tools/testing/selftests/ktf/kernel/ktf_cov.h | 94 +-
> > tools/testing/selftests/ktf/kernel/ktf_debugfs.c | 356 ++++-
> > tools/testing/selftests/ktf/kernel/ktf_debugfs.h | 34 +-
> > tools/testing/selftests/ktf/kernel/ktf_map.c | 261 +++-
> > tools/testing/selftests/ktf/kernel/ktf_map.h | 154 ++-
> > tools/testing/selftests/ktf/kernel/ktf_netctx.c | 132 ++-
> > tools/testing/selftests/ktf/kernel/ktf_netctx.h | 64 +-
> > tools/testing/selftests/ktf/kernel/ktf_nl.c | 516 ++++++-
> > tools/testing/selftests/ktf/kernel/ktf_nl.h | 15 +-
> > tools/testing/selftests/ktf/kernel/ktf_override.c | 45 +-
> > tools/testing/selftests/ktf/kernel/ktf_override.h | 15 +-
> > tools/testing/selftests/ktf/kernel/ktf_test.c | 397 +++++-
> > tools/testing/selftests/ktf/kernel/ktf_test.h | 381 ++++-
> > tools/testing/selftests/ktf/kernel/ktf_unlproto.h | 105 +-
> > tools/testing/selftests/ktf/lib/Makefile | 21 +-
> > tools/testing/selftests/ktf/lib/ktf.h | 114 +-
> > tools/testing/selftests/ktf/lib/ktf_debug.cc | 20 +-
> > tools/testing/selftests/ktf/lib/ktf_debug.h | 59 +-
> > tools/testing/selftests/ktf/lib/ktf_int.cc | 1031 ++++++++++++-
> > tools/testing/selftests/ktf/lib/ktf_int.h | 84 +-
> > tools/testing/selftests/ktf/lib/ktf_run.cc | 177 ++-
> > tools/testing/selftests/ktf/lib/ktf_unlproto.c | 21 +-
> > tools/testing/selftests/ktf/scripts/ktf_syms.mk | 16 +-
> > tools/testing/selftests/ktf/scripts/resolve | 188 ++-
> > tools/testing/selftests/ktf/scripts/runtests.mk | 3 +-
> > tools/testing/selftests/ktf/scripts/runtests.sh | 100 +-
> > tools/testing/selftests/ktf/scripts/top_make.mk | 14 +-
> > tools/testing/selftests/ktf/selftest/Makefile | 17 +-
> > tools/testing/selftests/ktf/selftest/context.c | 149 ++-
> > tools/testing/selftests/ktf/selftest/context.h | 15 +-
> > tools/testing/selftests/ktf/selftest/context_self.h | 34 +-
> > tools/testing/selftests/ktf/selftest/hybrid.c | 35 +-
> > tools/testing/selftests/ktf/selftest/hybrid.h | 24 +-
> > tools/testing/selftests/ktf/selftest/hybrid_self.h | 27 +-
> > tools/testing/selftests/ktf/selftest/ktf_syms.txt | 17 +-
> > tools/testing/selftests/ktf/selftest/self.c | 661 ++++++++-
> > tools/testing/selftests/ktf/user/Makefile | 26 +-
> > tools/testing/selftests/ktf/user/hybrid.cc | 39 +-
> > tools/testing/selftests/ktf/user/ktfcov.cc | 68 +-
> > tools/testing/selftests/ktf/user/ktfrun.cc | 20 +-
> > tools/testing/selftests/ktf/user/ktftest.cc | 46 +-
> > 64 files changed, 8909 insertions(+), 9 deletions(-)
>
> It also looks like all your test code lives outside of the kernel
> source dir. I take it you intend for tests to live in
> tools/testing/selftests/ktf/ ?
Good point,
with this RFC it would be just to add another directory under ktf/
but this was just to find a simple way to integrate it below selftests,
without interfering with the current structure.
I imagine a tighter integration/unification between normal Kbuild targets and selftests
targets that also took kernel module building into consideration would be a better solution.
I think this is a good topic for discussion.
As I indicate above, I think it is problematic that test code has to be explicitly
configured in as we configure code features of the kernel, which changes the "logical"
kernel we build.
So some more "native" support for test modules are desired, IMHO.
Knut
> [...]
Powered by blists - more mailing lists