Message-ID: <20200120163933.GA7391@rei>
Date:   Mon, 20 Jan 2020 17:39:33 +0100
From:   Cyril Hrubis <chrubis@...e.cz>
To:     ltp@...ts.linux.it, linux-kernel@...r.kernel.org,
        libc-alpha@...rceware.org
Cc:     lwn@....net, akpm@...ux-foundation.org,
        torvalds@...ux-foundation.org
Subject: [ANNOUNCE] The Linux Test Project has been released for JANUARY 2020

Good news everyone,

the Linux Test Project test suite stable release for *January 2020* has been
released.

Since the last release 195 patches by 31 authors were merged.

NOTABLE CHANGES
===============

* New tests
  - vmsplice03 (splicing pipe to user memory)
  - prctl08, prctl09 (PR_{SET,GET}_TIMERSLACK)

* New regression tests
  - bpf_prog03

* Increased coverage
  - quotactl tests were rewritten and coverage was increased

* Additional 19 tests were converted to the new test library

* Removed tests
  - TI-RPC authdes related tests (authdes is disabled by default since libtirpc 1.2.5)
  - openposix/pi_test*
  - ext4 features tests
    (the interesting bits are being moved to xfstests
     https://patchwork.kernel.org/patch/11290345/)

* Our Travis now includes native ppc64le and s390x builds

* Improved musl support, build with musl in Travis CI using Alpine Linux
  (broken tests are documented in Travis build script travis/alpine.sh)

* Regression tests now print possibly missing kernel commits:

    --------------------------------------------------------------------------
    snd_timer01.c:134: FAIL: kernel seems vulnerable

    HINT: You _MAY_ be missing kernel fixes, see:

    https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=d11662f4f798
    https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=ba3021b2c79b

    HINT: You _MAY_ be vulnerable to CVE(s), see:

    https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2017-1000380

    Summary:
    passed   0
    failed   1
    skipped  0
    warnings 0
    --------------------------------------------------------------------------

+ The usual amount of fixes and cleanups.


METADATA EXTRACTION & TEST CATALOGUE
====================================

There is an ongoing experiment that attempts to extract metadata[1] from the
testcases, we also have a proof of concept web page that renders the json
metadata into a browseable test documentation[2]. There is not much there yet,
but we are hoping, among other things, to build a nice, searchable and
browseable test catalogue based on these efforts.

[1] https://github.com/metan-ucw/ltp/tree/master/docparse
[2] http://metan.ucw.cz/outgoing/metadata.html
    http://metan.ucw.cz/outgoing/metadata.html?test=abort01
    http://metan.ucw.cz/outgoing/metadata.html?test=pcrypt_aead01


NOTABLE CHANGES IN NETWORK TESTS
================================
brought to you by Petr Vorel

* iptables: add new test for iptables-translate and nft, add IPv6 support
* route: rewrite route change destination, gateway and interface tests into new API


DOWNLOAD AND LINKS
==================

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20190930

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial
https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines
https://github.com/linux-test-project/ltp/wiki/BuildSystem

Patches, new tests, bugs, comments or questions should go to to our mailing
list at ltp@...ts.linux.it.


CREDITS
=======

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20190930..
    45  Petr Vorel <pvorel@...e.cz>
    22  Jan Stancek <jstancek@...hat.com>
    22  Yang Xu <xuyang2018.jy@...fujitsu.com>
    13  Cyril Hrubis <chrubis@...e.cz>
    13  Petr Vorel <petr.vorel@...il.com>
    11  Li Wang <liwang@...hat.com>
    10  Joerg Vehlow <joerg.vehlow@...-tech.de>
    10  Martin Doucha <mdoucha@...e.cz>
     7  Alexey Kodanev <alexey.kodanev@...cle.com>
     6  Clemens Famulla-Conrad <cfamullaconrad@...e.de>
     5  Xiao Yang <ice_yangxiao@....com>
     3  Feiyu Zhu <zhufy.jy@...fujitsu.com>
     2  Jorik Cronenberg <jcronenberg@...e.de>
     2  Pengfei Xu <pengfei.xu@...el.com>
     2  Ping Fang <pifang@...hat.com>
     2  Richard Palethorpe <rpalethorpe@...e.com>
     1  Cai Zhenglong <caizhenglong_cm@...pin.com>
     1  Dylan Chung <dylan@...estech.com>
     1  Eric Lin <tesheng@...estech.com>
     1  Fabrice Fontaine <fontaine.fabrice@...il.com>
     1  He Zhe <zhe.he@...driver.com>
     1  Ivan Hu <ivan.hu@...onical.com>
     1  Ma Feng <mafeng.ma@...wei.com>
     1  Mathias Fiedler <mathias.fiedler@...-tech.de>
     1  Rachel Sibley <rasibley@...hat.com>
     1  Song Jian <songjian15@...wei.com>
     1  Sultan Alsawaf <sultan@...neltoast.com>
     1  Xiang Li <lixian@....qualcomm.com>
     1  Yi Zhao <yi.zhao@...driver.com>
     1  Yongxin Liu <yongxin.liu@...driver.com>
     1  Zou Wei <zou_wei@...wei.com>


And also thanks to patch reviewers:

git log 20190930.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r
     76 Cyril Hrubis <chrubis@...e.cz>
     46 Petr Vorel <pvorel@...e.cz>
     28 Li Wang <liwang@...hat.com>
     19 Jan Stancek <jstancek@...hat.com>
      9 Alexey Kodanev <alexey.kodanev@...cle.com>
      5 Clemens Famulla-Conrad <cfamullaconrad@...e.de>
      4 Richard Palethorpe <rpalethorpe@...e.com>
      3 Yang Xu <xuyang2018.jy@...fujitsu.com>
      1 Thadeu Lima de Souza Cascardo <cascardo@...onical.com>
      1 Sumit Garg <sumit.garg@...aro.org>
      1 Steve Dickson <steved@...hat.com>
      1 Petr Vorel <petr.vorel@...il.com>
      1 Joerg Vehlow <joerg.vehlow@...-tech.de>
      1 Amir Goldstein <amir73il@...il.com>

-- 
Cyril Hrubis
chrubis@...e.cz

Powered by blists - more mailing lists