Message-ID: <20230929095144.GD364346@pevik>
Date:   Fri, 29 Sep 2023 11:51:44 +0200
From:   Petr Vorel <pvorel@...e.cz>
To:     ltp@...ts.linux.it, linux-kernel@...r.kernel.org,
        libc-alpha@...rceware.org
Cc:     lwn@....net, akpm@...ux-foundation.org,
        torvalds@...ux-foundation.org, Cyril Hrubis <chrubis@...e.cz>
Subject: The Linux Test Project has been released for SEPTEMBER 2023

Good news everyone,

the Linux Test Project test suite stable release for *September 2023* has been
released.

Since the last release 250 patches by 34 authors were merged, 14 authors were new.

Patch review is what most of the projects struggle with and LTP is no
different. If you can spare some effort helping with the patch review is more
than welcomed.

The release notes were prepared by Cyril Hrubis.

NOTABLE CHANGES
===============

* New tests
  - epoll_wait07 for EPOLLONESHOT
  - epoll_wait06 for EPOLLET
  - epoll_wait05 for EPOLLRDHUP
  - process_madvise01 for MADV_PAGEOUT
  - faccessat201 basic faccessat2() test
  - faccessat202 checks that the syscall fails correctly
  - tcindex01 aka CVE-2023-1829
  - mremap06 reproducer for
    7e7757876f25 ("mm/mremap: fix vm_pgoff in vma_merge() case 3")
  - starvation a simple test case for sched starvation
    https://lwn.net/ml/linux-kernel/9fd2c37a05713c206dcbd5866f67ce779f315e9e.camel@gmx.de/
  - pipe14 for end-of-file (read() returns 0) in a case the write end is closed
  - statx12 basic test for STATX_ATTR_MOUNT_ROOT
  - kvm_svm03 KVM test for CPU lockup through malicous SVM guest
  - kvm_svm02 test that KVM correctly intercepts VMSAVE and VMLOAD instructions
              in a nested virtual machine aka CVE-2021-3656
  - statx11 a basic test for STATX_DIOALIGN on block device
  - statx10 a basic test for STATX_DIOALIGN on regular file

* Increased coverage
  - fanotify13 added test variant for overalfs upper fs
  - mmap05 increased coverage for EINVAL
  - mmap06 increased coverage for EACCES
  - bind03 now includes regression test for
    c0c3b8d380a8 ("unix_bind_bsd(): unlink if we fail after successful mknod")
  - stack_clash added test for mmap() minding gap

* ebizzy benchmark counter increment races and overflows were fixed

* A few more testcases were converted to guarded buffers
  that is data passed by pointer to kernel are immediatelly
  following a PROT_NONE page and followed by canaries
  to catch off-by-one errors

* Tests that modprobe kernel modules are now skipped when secure boot is
  enabled on x86 and ppc64le

* ioprio tests now use IOPRIO_PRIO_NUM instead of hardcoded value
  to check for prio range

* 35 testcases were converted to the new test library
  - we finally got rid of the old and messy libclone library

+ The usual amount of fixes and cleanups

KIRK (previously RUNLTP-NG)
===========================

* The new runltp-ng version is now called kirk
  - The name was changed since kirk now supports different testsuites as well
  - Apart from the name changes the internals were rewritten and cleaned up
  - Prototype for parallel testruns is included as well
  - https://github.com/linux-test-project/kirk/#readme

* There is now experimental LTX support implemented
  - Beware this is _VERY EXPERIMENTAL_ at the moment
  - LTX is tiny binary that runs on system under test
  - LTX communicates with kirk over serial using messages packed in msgpack
  - LTX is going to be locked in memory and executed with realtime priority
  - LTX allows advanced features such as running tests in parallel
  - https://github.com/linux-test-project/ltx

REMOVED TESTS
=============

* mmap07 (included in mmap06)
* setgroups04 (included in setgroups03)

DOWNLOAD AND LINKS
==================

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/YYYYMMDD

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines

https://github.com/linux-test-project/ltp/wiki/C-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API

https://github.com/linux-test-project/ltp/wiki/Shell-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial

https://github.com/linux-test-project/ltp/wiki/Build-System

Patches, new tests, bugs, comments or questions should go to to our mailing
list at ltp@...ts.linux.it.

CREDITS
=======

Many thanks to the people contributing to this release:

$ git shortlog -s -e -n 20230516..
    71	Petr Vorel <pvorel@...e.cz>
    32	Yang Xu <xuyang2018.jy@...itsu.com>
    26	Avinesh Kumar <akumar@...e.de>
    22	Andrea Cervesato <andrea.cervesato@...e.com>
    22	Martin Doucha <mdoucha@...e.cz>
    13	Cyril Hrubis <chrubis@...e.cz>
    13	Li Wang <liwang@...hat.com>
     6	Wei Gao <wegao@...e.com>
     5	Souta Kawahara <souta.kawahara@...aclelinux.com>
     4	Amir Goldstein <amir73il@...il.com>
     4	Marius Kittler <mkittler@...e.de>
     3	Richard Palethorpe <rpalethorpe@...e.com>
     3	Ci Zhou <zhouci@...jie.com.cn>
     2	Damien Le Moal <dlemoal@...nel.org>
     2	Jan Kara <jack@...e.cz>
     2	Konstantin Khorenko <khorenko@...tuozzo.com>
     2	Min Li <limin154@...wei.com>
     2	Murphy Zhou <jencce.kernel@...il.com>
     2	Vishal Chourasia <vishalc@...ux.ibm.com>
     1	Ashwin Dayanand Kamat <kashwindayan@...are.com>
     1	Duncan.chu <wqhaicyj@....com>
     1	Dylan Jhong <dylan@...estech.com>
     1	Edward Liaw <edliaw@...gle.com>
     1	Hongchen Zhang <zhanghongchen@...ngson.cn>
     1	Jeff Layton <jlayton@...nel.org>
     1	Leo Yu-Chi Liang <ycliang@...estech.com>
     1	Nageswara R Sastry <rnsastry@...ux.ibm.com>
     1	Randolph <randolph@...estech.com>
     1	Rick Edgecombe <rick.p.edgecombe@...el.com>
     1	Shizhao Chen <shichen@...hat.com>
     1	Takuya Wakazono <pastalian46@...il.com>
     1	Zachary Leaf <zachary.leaf@....com>
     1	Li Qiang <liqiang64@...wei.com>
     1	Ioannis Bonatakis <ybonatakis@...e.com>

And also thanks to patch reviewers:

$ git log 20230516.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r
    104 Cyril Hrubis <chrubis@...e.cz>
     66 Petr Vorel <pvorel@...e.cz>
     46 Li Wang <liwang@...hat.com>
     15 Martin Doucha <mdoucha@...e.cz>
     14 Avinesh Kumar <akumar@...e.de>
     14 Richard Palethorpe <rpalethorpe@...e.com>
      8 Xiao Yang <yangx.jy@...itsu.com>
      3 Niklas Cassel <niklas.cassel@....com>
      3 Marius Kittler <mkittler@...e.de>
      3 Damien Le Moal <dlemoal@...nel.org>
      2 Srikar Dronamraju <srikar@...ux.vnet.ibm.com>
      2 Shrikanth Hegde <sshegde@...ux.vnet.ibm.com>
      2 Linus Walleij <linus.walleij@...aro.org>
      2 Amir Goldstein <amir73il@...il.com>
      1 Yang Xu <xuyang2018.jy@...itsu.com>
      1 Vlastimil Babka <vbabka@...e.cz>
      1 Murphy Zhou <jencce.kernel@...il.com>
      1 Jeff Moyer <jmoyer@...hat.com>
      1 Andrea Cervesato <andrea.cervesato@...e.com>

Powered by blists - more mailing lists