Message-ID: <aDlqOKWSZTzGqrsN@yuki.lan>
Date: Fri, 30 May 2025 10:20:08 +0200
From: Cyril Hrubis <chrubis@...e.cz>
To: ltp@...ts.linux.it, linux-kernel@...r.kernel.org,
	libc-alpha@...rceware.org,
	valgrind-developers@...ts.sourceforge.net
Cc: lwn@....net, akpm@...ux-foundation.org, torvalds@...ux-foundation.org
Subject: [ANNOUNCE] The Linux Test Project has been released for MAY 2025

Good news everyone,

the Linux Test Project test suite stable release for *May 2025* has been
released.

Since the last release 282 patches by 33 authors were merged.

Patch review is what most of the projects struggle with and LTP is no
different. If you can spare some effort helping with the patch review is more
than welcomed.

NOTABLE CHANGES
===============

* New tests
  - kvm_vmx01 test for emulated VMREAD/VMWRITE instructions
  - kvm_vmx02 test for Intel VMX virtualized APIC
  - flock07 test for EINTR error
  - move_mount03 test for mount beneath top mount
  - fanotify24 test for FAN_PRE_ACCESS and FAN_DENY_ERRNO
  - unshare03 check for EMFILE when unsharing fd would hit the limits
  - fcntl40 test fcntl F_CREATED_QUERY
  - ioctl_fiemap01 functionality test for fiemap ioctl()
  - unshare04 tests that unshare(CLONE_NEWNS) unshares CWD
  - mmap22 test for new MAP_DROPPABLE flag

* Increased coverage
  - fanotify13 test case for FAN_DELETE_SELF
  - fanotify05 test reporting overflow event with FAN_REPORT_FD_ERROR
  - fanotify21 test reporting event with RDWR fd on RO mount
  - fanotify21 test reporting fd open errors with FAN_REPORT_FD_ERROR
  - flock02 test for EWOULDBLOCK errno
  - fchownat03 more tests for invalid inputs
  - fanotify14 test invalid init flags with permission and pre-content events
  - fanotify03 test cases for permission events on children
  - pause01 tests now for more signals not just EINTR
  - setrlimit06 test resource limit64 for process

* Removed tests
  - The test_controllers.sh is now disabled when v2 hierarchy is present
  - A few old and broken tests were removed from test_controllers.sh

* kirk was updated to version 2.1 see the release notes at:
  https://github.com/linux-test-project/kirk/releases

* New test catalogue generated from test metadata is live at:
  https://linux-test-project.readthedocs.io/en/latest/users/test_catalog.html

* We have a new metadata extractor for a shell and first test that is parsed:
  https://linux-test-project.readthedocs.io/en/latest/users/test_catalog.html#vma05-sh

* A few tests have been fixed not to be miscompiled by gcc-15
  - we had problems with changes in structure zero initializations where
    suddenly anonymous unions were not zero initialized anymore
  - and also with optimzer changes that now remove malloc() + free() pairs
    if the memmory is no touched between the calls

* The tst_brk() behavior has finally been clarified and fixed, for details see
  LTP commit a1f82704c28d ("lib/tst_test.c: Fix tst_brk() handling").

* New library test now have reproducible output that leaves out data that
  change between runs from the output, it's enabled with setting env variable
  LTP_REPRODUCIBLE_OUTPUT=1

* Our github CI is now connected to patchwork and runs LTP
  compilation tests for patches:

  https://patchwork.ozlabs.org/project/ltp/list/

* The LTP_SINGLE_FS_TYPE now honors test specific filesystem skiplists and thus
  can be used for general testing. There is new variable
  TST_FORCE_SINGLE_FS_TYPE that ignores skiplists and is supposed to be used
  for test development (which was previously the case for LTP_SINGLE_FS_TYPE).

* The ipc runtest file that cointained only pipeio test was merged into
  syscalls runtest file

* The horrible mess in testcases/kernel/mem/lib/ library was untangled into
  smaller pieces

* 43 testcases were converted to the new test library

+ The usual amount of fixes and cleanups


NOTABLE CHANGES IN IMA TESTS
============================
brought to you by Petr Vorel

* Add support to load predefined example IMA policy with LTP_IMA_LOAD_POLICY=1
  environment variable.

  This allows to run tests which are otherwise skipped due required policy not
  being loaded. SUT should be rebooted after each IMA tests (unless
  CONFIG_IMA_WRITE_POLICY=y` the policy can be written only once or policies
  can influence each other).

* Added additional ToMToU and open-writer violation tests (new in kernel v6.14)

* IMA: Allow to disable LSM warnings and use it for IMA (avoid misleading warnings)

+ Add some example IMA policies


DOWNLOAD AND LINKS
==================

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20250530

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://linux-test-project.readthedocs.io/en/latest/developers/test_case_tutorial.html

And our library API documentation at:

https://linux-test-project.readthedocs.io/en/latest/developers/api_c_tests.html

Patches, new tests, bugs, comments or questions should go to to our mailing
list at ltp@...ts.linux.it.


CREDITS
=======

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20250130..

    80  Petr Vorel <pvorel@...e.cz>
    25  Cyril Hrubis <chrubis@...e.cz>
    24  Ricardo B. Marlière <rbm@...e.com>
    22  Martin Doucha <mdoucha@...e.cz>
    21  Andrea Cervesato <andrea.cervesato@...e.com>
    17  Ma Xinjian via ltp <ltp@...ts.linux.it>
    14  Li Wang <liwang@...hat.com>
    13  Amir Goldstein <amir73il@...il.com>
    11  Xinjian Ma (Fujitsu) <maxj.fnst@...itsu.com>
    10  Jan Stancek <jstancek@...hat.com>
    10  Wei Gao <wegao@...e.com>
     5  Mimi Zohar <zohar@...ux.ibm.com>
     4  Shiyang Ruan <ruansy.fnst@...itsu.com>
     3  Avinesh Kumar <akumar@...e.de>
     3  Jeff Moyer <jmoyer@...hat.com>
     2  Edward Liaw <edliaw@...gle.com>
     2  lufei <lufei@...ontech.com>
     1  Ajay Kaher <ajay.kaher@...adcom.com>
     1  Binh Hoang <htb511@...il.com>
     1  Dan Carpenter <dan.carpenter@...aro.org>
     1  Jan Polensky <japo@...ux.ibm.com>
     1  Jin Guojie <guojie.jin@...il.com>
     1  John Morin <John.Morin@...ms.com>
     1  Li Xiaosong <rj45usb@....com>
     1  Luiz Capitulino <luizcap@...hat.com>
     1  Ross Burton <ross.burton@....com>
     1  Siddhesh Poyarekar <siddhesh@...plt.org>
     1  Stuart R. Anderson <anderson@...sweng.com>
     1  T.J. Mercier <tjmercier@...gle.com>
     1  Xiao Liang <xiliang@...hat.com>
     1  Zhao Mengmeng <zhaomengmeng@...inos.cn>
     1  dy455990 <dy455990@...baba-inc.com>
     1  wangxuewen <wangxuewen@...inos.cn>

And also thanks to patch reviewers:

git log 20250130.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

    108 Petr Vorel <pvorel@...e.cz>
     71 Andrea Cervesato <andrea.cervesato@...e.com>
     62 Cyril Hrubis <chrubis@...e.cz>
     53 Li Wang <liwang@...hat.com>
     11 Mimi Zohar <zohar@...ux.ibm.com>
      9 Martin Doucha <mdoucha@...e.cz>
      7 Jan Stancek <jstancek@...hat.com>
      7 Ricardo B. Marlière <ricardo@...liere.net>
      6 Jan Kara <jack@...e.cz>
      5 Avinesh Kumar <akumar@...e.de>

-- 
Cyril Hrubis
chrubis@...e.cz

Powered by blists - more mailing lists