lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Message-Id: <20240809162557.32300-1-laura.nao@collabora.com>
Date: Fri,  9 Aug 2024 18:25:57 +0200
From: Laura Nao <laura.nao@...labora.com>
To: kernelci@...ts.linux.dev
Cc: linux-kselftest@...r.kernel.org,
	linux-kernel@...r.kernel.org
Subject: Testing Quality Call notes - 2024-08-08

Hello,

KernelCI is hosting a bi-weekly call on Thursday to discuss improvements
to existing upstream tests, the development of new tests to increase 
kernel testing coverage, and the enablement of these tests in KernelCI. 

Below is a list of the tests the community has been working on and their 
latest status updates, as discussed in the last meeting held on 
2024-08-08:

*KTAP performance counters*

- Upcoming presentation @LPC2024 by Tim Bird on adding benchmark results 
  to KTAP: https://lpc.events/event/18/contributions/1791/
- Proposing new system to handle benchmark data, composed of 3 parts:
  adding syntax to KTAP to support benchmark values, using a set of
  external criteria for interpreting benchmark results, an automated tool
  to determine and set the reference values used in these criteria.
- One related topic for discussion is where to store the reference files
  and the test configuration, including all details that might impact the
  results.

*Missing devices kselftest*

- Proposing new kselftest to report devices that go missing in the system:
  https://lore.kernel.org/all/20240724-kselftest-dev-exist-v1-1-9bc21aa761b5@collabora.com/#r
- Received feedback on the usability of the test and main unknowns about
  management of reference files in tests

*Boot time test*

- RFC:
  https://lore.kernel.org/all/20240725110622.96301-1-laura.nao@collabora.com/T/#ma568382acdc81af65c30fe3823a7be3e49f98108
- Got feedback on the potential use of scripts from pm-graph. The
  bootgraph.py script could be adapted for the test with some
  modifications, such as adding support for machine-readable output and
  different ftrace configurations.

*Suspend/resume in cpufreq kselftest*

- Sent v2 for patch adding RTC wakeup alarm in the cpufreq kselftest:
  https://lore.kernel.org/lkml/20240715192634.19272-1-shreeya.patel@collabora.com/
- Looking into using the sleepgraph.py script from pm-graph to calculate
  suspend/hibernation and resume time:
  https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/tools/power/pm-graph/sleepgraph.py?h=v6.11-rc1
- Would require additional configs to be enabled in an automated
  environment

*TAP conformance in kselftests and other fixes*

- Some dead selftests were removed:
  https://lore.kernel.org/all/20240725110817.659099-1-usama.anjum@collabora.com
  and
  https://lore.kernel.org/all/20240725121212.808206-1-usama.anjum@collabora.com
- Bitmap test module conversion to KUnit was not accepted:
  https://lore.kernel.org/lkml/49108735-c776-4b6f-8264-62a827dd7b26@collabora.com/T/
- Fixing error when kvm suite is built for unsupported architecure:
  https://lore.kernel.org/kvm/c2aaa06e-e86d-4af9-bce4-6067e53cdf39@collabora.com/T/

Please reply to this thread if you'd like to join the call or discuss any
of the topics further. We look forward to collaborating with the community
to improve upstream tests and expand coverage to more areas of interest
within the kernel.

Best regards,

Laura Nao


Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ