Message-ID: <Z5vVMpub3x__Bj64@yuki.lan>
Date: Thu, 30 Jan 2025 20:38:26 +0100
From: Cyril Hrubis <chrubis@...e.cz>
To: ltp@...ts.linux.it, linux-kernel@...r.kernel.org,
	libc-alpha@...rceware.org
Cc: lwn@....net, akpm@...ux-foundation.org, torvalds@...ux-foundation.org
Subject: [ANNOUNCE] The Linux Test Project has been released for JANUARY 2025

Good news everyone,

the Linux Test Project test suite stable release for *January 2025* has been
released.

Since the last release 236 patches by 25 authors were merged.

Patch review is what most of the projects struggle with and LTP is no
different. If you can spare some effort helping with the patch review it
is more than welcomed.

NOTABLE CHANGES
===============

* New tests

  - madvise12 Tests that MADV_GUARD_INSTALL is causing SIGSEGV on access.
  - fsplough A test that checks data integrity between reads and writes for a file.
  - landlock08 Test for landlock bind()/connect().
  - hugemmap34 Tests that kernel handles properly when stack grows into a
               hugepage segment.
  - rt_sigqueueinfo02 Tests for rt_sigqueueinfo() errors.

  - listmount04 Tests for listmout() errors.
  - listmount03 Test for EPERM on inaccesible mount point.
  - listmount02 Test for group mount IDs.
  - listmount01 Test for LSMT_ROOT.

  - statmount08 Test for EPERM on inaccesible mount point.
  - statmount07 Tests for statmount() errors.
  - statmount06 Test for STATMOUNT_FS_TYPE.
  - statmount05 Test for STATMOUNT_VFS_ROOT and STATMOUNT_MNT_POINT.
  - statmount04 Test for STATMOUNT_PROPAGATE_FROM.
  - statmount03 Test for STATMOUNT_MNT_BASIC.
  - statmount02 Test for STATMOUNT_MNT_BASIC.
  - statmount01 Test for statmount() without any flags.

  - ioctl_ficlone01 Basic test for FICLONE ioctl().
  - ioctl_ficlone02 Test for EOPNOTSUPP for usupported FS.
  - ioctl_ficlone03 Tests for FICLONE errors.

  - ioctl_ficlonerange01 Basic test for FICLONERANGE ioctl().
  - ioctl_ficlonerange02 Tests for FICLONERANGE errors.

* Increased coverage

  - getrandom05 Tests the getrandom() syscall along with the VDSO implementation.
  - landlock02 Adds landlock network coverage.

* The failure hits (possible missing kernel patches) are now disabled until the
  test library finishes intialization. This is because if we fail to set up the
  test environment we haven't had a chance to reproduce the bug.

* The test library now supports per filesystem mkfs options, mount flags and
  min_kver. This is immediatelly used by FICLONE and FICLONERANGE tests since
  the support for different filesystems was added into different kernel versions.

* Rewritten tests

  - both pty01 and ptem01 test were cleaned up and split into several tests
  - vma05.sh is a first test rewritten to the new shell test library
  - process_madvise01 now runs in memory cgroup, where we can properly control
                      memory pressure.
  - fanotify10 Now drops cache three times to make sure inode is evicted, if
               the test stil fails in certain setups, please let us know.


* Removed tests

  - logrotate_tests.sh Since logrotate has it's own testsuite it's pointless to
                       keep the broken LTP test.

* Changes in test runtime and timeout handling
  - the runtime and timeout values are now tracked separately
  - runtime is now the time limit for a loop in the main test function
  - timeout is now an safety upper limit for the test execution
  - both values are per test iteration (e.g. for a single filesystem)
  - the LTP_TIMEOUT_MUL now multiplies the safety limit
  - the LTP_RUNTIME_MUL now multiplies for how long certain test will run
  - selected (debug) kernel CONFIG_ options, if enabled now, multiply the
    test timeouts
  - many testcases that run >= 1s on a slow reference hardware (RPi zero) were
    annotated with a proper timeout
  - generally the timeout handling should just work fine (tm) without any
    user adjustenments

* Couple of fixes were applied to the test metadata extractor
  so the data in ltp.json file are now more useful

* The syscall number fallback definitions are now automatically generated from
  kernel sources.

* 20 testcases were converted to the new test library

+ The usual amount of fixes and cleanups


NOTABLE CHANGES IN NETWORK TESTS
================================
brought to you by Petr Vorel

* New nfs10.sh test data integrity over NFS (uses fsplough)
* Removed old ftp01.sh


DOWNLOAD AND LINKS
==================

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20250130

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://linux-test-project.readthedocs.io/en/latest/developers/test_case_tutorial.html

And our library API documentation at:

https://linux-test-project.readthedocs.io/en/latest/developers/api_c_tests.html

Patches, new tests, bugs, comments or questions should go to to our mailing
list at ltp@...ts.linux.it.

CREDITS
=======

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20240930..

    61  Petr Vorel <pvorel@...e.cz>
    59  Andrea Cervesato <andrea.cervesato@...e.com>
    29  Cyril Hrubis <chrubis@...e.cz>
    18  Xinjian Ma (Fujitsu) <maxj.fnst@...itsu.com>
    12  Li Wang <liwang@...hat.com>
    11  Martin Doucha <mdoucha@...e.cz>
     8  Jan Stancek <jstancek@...hat.com>
     6  Ricardo B. Marliere <rbm@...e.com>
     5  Wei Gao <wegao@...e.com>
     3  Attila Fazekas <afazekas@...hat.com>
     3  David Hildenbrand <david@...hat.com>
     3  lufei <lufei@...ontech.com>
     2  Avinesh Kumar <akumar@...e.de>
     2  Edward Liaw <edliaw@...gle.com>
     2  Li Zhijian <lizhijian@...itsu.com>
     2  Ma Xinjian via ltp <ltp@...ts.linux.it>
     2  Po-Hsu Lin <po-hsu.lin@...onical.com>
     1  Alessandro Carminati <acarmina@...hat.com>
     1  Ian Whitfield <ian.whitfield@...onical.com>
     1  Khem Raj <raj.khem@...il.com>
     1  Nathaniel Manista <nathaniel@...gle.com>
     1  Samir Mulani <samir@...ux.vnet.ibm.com>
     1  Sven Schnelle <svens@...ux.ibm.com>
     1  Xiubo Li <xiubli@...hat.com>
     1  Zizhi Wo <wozizhi@...wei.com>


And also thanks to patch reviewers:

git log 20240930.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

    107 Petr Vorel <pvorel@...e.cz>
     86 Cyril Hrubis <chrubis@...e.cz>
     31 Li Wang <liwang@...hat.com>
     12 Andrea Cervesato <andrea.cervesato@...e.com>
     11 Wei Gao <wegao@...e.com>
      9 Jan Stancek <jstancek@...hat.com>
      7 Avinesh Kumar <akumar@...e.de>
      3 Po-Hsu Lin <po-hsu.lin@...onical.com>
      2 Martin Doucha <mdoucha@...e.cz>
      2 Jan Kara <jack@...e.cz>
      1 Mimi Zohar <zohar@...ux.ibm.com>
      1 Chuck Lever <chuck.lever@...cle.com>
-- 
Cyril Hrubis
chrubis@...e.cz

Powered by blists - more mailing lists