Message-ID: <ZvqQxP9KVW6PqFOo@yuki.lan>
Date: Mon, 30 Sep 2024 13:51:32 +0200
From: Cyril Hrubis <chrubis@...e.cz>
To: ltp@...ts.linux.it, linux-kernel@...r.kernel.org,
	libc-alpha@...rceware.org
Cc: lwn@....net, akpm@...ux-foundation.org, torvalds@...ux-foundation.org
Subject: [ANNOUNCE] The Linux Test Project has been released for SEPTEMBER
 2024

Good news everyone,

the Linux Test Project test suite stable release for *September 2024* has been
released.

Since the last release 266 patches by 47 authors were merged.

Patch review is what most of the projects struggle with and LTP is no
different. If you can spare some effort helping with the patch review is more
than welcomed.

NOTABLE CHANGES
===============

* New tests

  - chown09 regression test for 5d1f903f75a8 ("attr: block mode changes of symlinks")
  - request_key06 Negative tests for request_key() syscall
  - signalfd02 Negative tests for signalfd() syscall
  - mseal02 Negative tests for mseal() syscall
  - hugeshmget06 A hugepage shm test
  - landlock07 Landlock Houdini reproducer aka CVE-2024-42318
  - getcpu02 Negative tests for getcpu() syscall
  - landlock06 Tests for LANDLOCK_ACCESS_FS_IOCTL_DEV
  - landlock05 Tests for LONDLOCK_ACCESS_FS_REFER
  - landlock04 Tests that syscalls are enabled/disable accordingly to the ruleset
  - landlock03 Negative tests for landlock_restrict_self() syscall
  - landlock02 Negative tests for landlock_add_rule() syscall
  - landlock01 Negative tests for landlock_create_ruleset() syscall
  - mseal01 Tests that memory is protected from being changed after it's sealed
  - fchmodat2_02 Negative tests for fchmodat2()
  - fchmodat2_01 Tests for AT_SYMLINK_NOFOLLOW for fchmodat2()
  - cachestat04 Checks that cachestat() syscall either reports EBADF or zeroed
    statistics on all kinds of unsupported fds
  - cachestat03 Negative tests for cachestat() syscall
  - cachestat02 Basic cachestat tests with fd pointing to shared memory
  - cachestat01 Basic cachestat tests for regular files
  - shutdown01 Basic shutdown tests
  - shutdown02 Negative tests for shutdown() sycall

* The symlink01 mess is being split into separate testcases

  - open15 A test that open() syscall works correctly with symlinks
  - lstat03 A basic lstat() test.
  - rename15 Tests that rename works correctly with symlinks
  - chmod08 Tests that chmod() works correctly with symlinks

* Increased coverage

  - readdir and getdents tests were enabled to run on all supported filesystems
    after we found that bcachefs had sublty broken implementation
  - gedent02 Adds more negative tests
  - timer_settime01 Now checks for premature timer expiration as well
  - pkey01 Now includes tests for PKEY_DISABLE_EXECUTE
  - request_key01 Added more negative tests
  - acct02 Added more negative tests
  - prctl04 has been renamed to seccomp01 and now covers also the seccomp()
    syscall along with the older prctl(PR_SET_SECCOMP) calls
  - msync04 now uses direct I/O to verify that data have been written to disk

* Rewritten tests

  - fork05 was rewritten and correctly reports TCONF on non i386 hardware
  - fcnt14 a file locking test was rewriten to generate subtests at runtime
  - sched_starvation now autocallibrates expected runtime based on CPU speed
  - sched_footbal was rewritten and is now executed as part of the sched
    runtest file

* The test library now supports specifying mkfs and mount options per a
  filesystem

* Bunch of checks for kernels older than 4.4 were removed from the tests since
  the currently minimal kernel version LTP supports is 4.4

* We have a new shell test library that:
  - makes shell code seamlessly interoperable with C
  - reuses most of the C test library
  - makes use shared memory to report test results
  - there are currently no tests using this library, we will start rewriting
    existing tests after the release

* 3 testcases were converted to the new test library

+ The usual amount of fixes and cleanups

REMOVED SCRIPTS AND FILES
=========================

- Removed old and outdated man pages.

- Removed ltpmenu an legacy script that was unmaintained for a decade.

NOTABLE CHANGES IN NETWORK TESTS
================================
brought to you by Petr Vorel

- nfsstat02.sh new test for per-NS NFS client statistics
               (checks that /proc/net/rpc/nfs exists in nested network namespaces)

- nfsstat01.sh read client stats from netns rhost
               (fix for kernel 6.9, backported up to 5.10 so far)

- nfs02.sh Added subtest for O_DIRECT

KIRK
====

- Kirk has been update to 1.4
- Kirk can now be installed from pypi

DOWNLOAD AND LINKS
==================

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20240930

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://linux-test-project.readthedocs.io/en/latest/developers/test_case_tutorial.html

And our library API documentation at:

https://linux-test-project.readthedocs.io/en/latest/developers/api_c_tests.html

Patches, new tests, bugs, comments or questions should go to to our mailing
list at ltp@...ts.linux.it.

CREDITS
=======

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20240129..

   233	Petr Vorel <pvorel@...e.cz>
    74	Andrea Cervesato <andrea.cervesato@...e.com>
    39	Martin Doucha <mdoucha@...e.cz>
    36	Li Wang <liwang@...hat.com>
    25	Cyril Hrubis <chrubis@...e.cz>
    25	Yang Xu <xuyang2018.jy@...itsu.com>
    22	Xinjian Ma (Fujitsu) <maxj.fnst@...itsu.com>
    21	Wei Gao <wegao@...e.com>
    15	Andrea Manzini <andrea.manzini@...e.com>
     6	Avinesh Kumar <akumar@...e.de>
     6	Edward Liaw <edliaw@...gle.com>
     6	John Stultz <jstultz@...gle.com>
     4	Hui Min Mina Chou <minachou@...estech.com>
     4	Jan Stancek <jstancek@...hat.com>
     3	Andreas Schwab <schwab@...e.de>
     3	Xiao Yang <ice_yangxiao@....com>
     3	lufei <lufei@...ontech.com>
     2	Dennis Brendel <dbrendel@...hat.com>
     2	Jiwei Sun <sunjw10@...ovo.com>
     2	Po-Hsu Lin <po-hsu.lin@...onical.com>
     1	Ajay Kaher <ajay.kaher@...adcom.com>
     1	Amir Goldstein <amir73il@...il.com>
     1	Chen Haonan <chen.haonan2@....com.cn>
     1	Chuck Lever <chuck.lever@...cle.com>
     1	Detlef Riekenberg via ltp <ltp@...ts.linux.it>
     1	Filippo Storniolo <fstornio@...hat.com>
     1	Haifeng Xu <haifeng.xu@...pee.com>
     1	Jingyi Song <jingyisong@...t.edu.cn>
     1	Khem Raj <raj.khem@...il.com>
     1	Kuan-Ying Lee <kuan-ying.lee@...onical.com>
     1	Li Xiaosong <rj45usb@....com>
     1	Madadi Vineeth Reddy <vineethr@...ux.ibm.com>
     1	Mete Durlu <meted@...ux.ibm.com>
     1	Murphy Zhou <jencce.kernel@...il.com>
     1	Nirjhar Roy <nirjhar@...ux.ibm.com>
     1	Remi Peuvergne <remi.peuvergne@...zen-solutions.net>
     1	Sachin P Bappalige <sachinpb@...ux.ibm.com>
     1	Samasth Norway Ananda <samasth.norway.ananda@...cle.com>
     1	Sebastian Chlad <sebastianchlad@...il.com>
     1	Sergey Ulanov via ltp <ltp@...ts.linux.it>
     1	Shiyang Ruan <ruansy.fnst@...itsu.com>
     1	Shizhao Chen <shichen@...hat.com>
     1	Wenjie Xu <xuwenjie04@...du.com>
     1	Xiangyu Chen <xiangyu.chen@...driver.com>
     1	Yiwei Lin <s921975628@...il.com>
     1	Zizhi Wo <wozizhi@...wei.com>
     1	yangfeng <yangfeng@...inos.cn>

And also thanks to patch reviewers:

git log 20240129.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

    212 Petr Vorel <pvorel@...e.cz>
    181 Cyril Hrubis <chrubis@...e.cz>
    108 Li Wang <liwang@...hat.com>
     39 Avinesh Kumar <akumar@...e.de>
     28 Andrea Cervesato <andrea.cervesato@...e.com>
     16 Martin Doucha <mdoucha@...e.cz>
     10 Jan Stancek <jstancek@...hat.com>
      6 Jan Kara <jack@...e.cz>
      4 Wei Gao <wegao@...e.com>
      4 Richard Palethorpe <io@...hiejp.com>
      3 Marius Kittler <mkittler@...e.de>
      3 Amir Goldstein <amir73il@...il.com>
      2 Adrian Huang <ahuang12@...ovo.com>
      1 Vlastimil Babka <vbabka@...e.cz>
      1 Po-Hsu Lin <po-hsu.lin@...onical.com>
      1 Matt Bobrowski <mattbobrowski@...gle.com>
      1 Kent Overstreet <kent.overstreet@...ux.dev>
      1 Joerg Vehlow <joerg.vehlow@....de>

-- 
Cyril Hrubis
chrubis@...e.cz

Powered by blists - more mailing lists