Message-ID: <20180515141217.GA23351@rei>
Date:   Tue, 15 May 2018 16:12:18 +0200
From:   Cyril Hrubis <chrubis@...e.cz>
To:     ltp@...ts.linux.it, linux-kernel@...r.kernel.org,
        libc-alpha@...rceware.org
Cc:     lwn@....net, akpm@...ux-foundation.org,
        torvalds@...ux-foundation.org
Subject: [LTP] [ANNOUNCE] The Linux Test Project has been released for MAY
 2018

Good news everyone,

the Linux Test Project test suite stable release for *May 2018* has been
released.

Since the last release 297 patches by 38 authors were merged.

NOTABLE CHANGES
===============

 * New testcases:

   - two inotify regression tests for:
     764baba80168 ("ovl: hash non-dir by lower inode for fsnotify")
     31747eda41ef ("ovl: hash directory inodes for fsnotify")

   - sysclt01 a regression test for:
     5ccba44ba118 ("sched/sysctl: Check user input value of sysctl_sched_time_avg")

   - CVE regression tests for:
     * CVE-2017-17053 - ccd5b3235180 ("x86/mm: Fix use-after-free of ldt_struct")
     * CVE-2017-16939 - 1137b5e2529a ("ipsec: Fix aborted xfrm policy dump crash")
     * CVE-2015-3290  - 9b6e6a8334d5 ("x86/nmi/64: Switch stacks on userspace NMI entry")
     * CVE-2017-17052 - 2b7e8665b4ff ("fork: fix incorrect fput of ->exe_file causing use-after-free")
     * CVE-2017-17807 - 4dca6ea1d943 ("KEYS: add missing permission check for request_key() destination")

   - read_all

     Test that aims to stress test /proc, /sys, and safe subset of /dev
     filesystems by reading by reading each readable file using several
     threads.

   - The pwritev03 and preadv03 tests with O_DIRECT executed on all supported filesystems.
     (https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines#2214-testing-with-a-block-device)

   - Pids controller tests fixed a race that made them fail sporadically and
     the the coverage was increased.

   - pwrite03, write02

     Write syscall tests for special case with NULL buffer and len 0
     where the call is expected to return 0 i.e. success.

 * Removed outdated and broken tests
   - sssd daemon test
   - mail command test
   - ht_interrupt -- hyperthreading interrupt balancing test

 * 54 testcases were cleaned up and converted to the new test library

 * The syscalls testrun has been speeded up by about a minute which is 5% of the runtime.

 * Several Android fixes have been applied.

 * New macro for automatic retry with exponential backoff has been added to the
   test library, which should replace all the ad-hoc retry loops we do have all
   around the codebase.

 * IMA (Integrity Measurement Architecture) tests
   - Were rewritten to use new API, updated, and various bugs has been fixed.
   - The most important changes:
     * Avoid running on tmpfs ima_measurements.sh and ima_violations.sh
     * ima_measurements.sh: support new IMA measurement templates, support testing
       most of IMA supported hash algorithms, fix & update iversion check
     * tpm.sh: replace ima_measure with evmctl (external)
     * ima_policy.sh: improve check of policy writability
     * ima_boot_aggregate: fixing event size for modern BIOS

     Many thanks to Mimi Zohar for her review and testing of IMA test cases.

  + The usual number of fixes and cleanups all over the place

NETWORK TESTS
=============

 Changelog for network tests brought to you by Peter Vorel.

 * New testcases:
   - for IP_BIND_ADDRESS_NO_PORT, DCCP and UDP ipsec and for UDPLITE protocol
   - regression test sctp_big_chunk aka CVE-2018-5803
   - netstress gained support for IP_BIND_ADDRESS_NO_PORT, SO_ZEROCOPY flags
     and UDPLITE protocol
   - Use libtirpc for all RPC tests

  * Test cases rewritten into new shell API:
    - interface and multicast tests cases
    - in6_02

  * Removed tests cases
    - route{4,6}-ifdown

  + Various fixes and doc cleanups


TODO LIST AND ISSUE TRACKER
===========================

Just recently we started to maintain a LTP TODO list in the form GitHub issues,
so far there is very coarse list of missing, mostly syscall, coverage:

https://github.com/linux-test-project/ltp/labels/missing%20coverage

Which I suppose will expand quite a bit soon.

And also nearly empty list of reproducers:

https://github.com/linux-test-project/ltp/labels/reproducer

Which I'm about to feed with a list of CVE reproducers I have, that
can be converted into regression testcases.

Lastly but not least I would like to ask everyone to contribute to that list.

DOWNLOAD AND LINKS
==================

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20180515

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial
https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines
https://github.com/linux-test-project/ltp/wiki/BuildSystem

Patches, new tests, bugs, comments or questions should go to to our mailing
list at ltp@...ts.linux.it.

CREDITS
=======

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20180118..
    76  Petr Vorel <pvorel@...e.cz>
    38  Cyril Hrubis <chrubis@...e.cz>
    37  Michael Moese <mmoese@...e.de>
    30  Alexey Kodanev <alexey.kodanev@...cle.com>
    21  Xiao Yang <yangx.jy@...fujitsu.com>
    12  yang xu <xuyang.jy@...fujitsu.com>
     9  Yixin Zhang <yixin.zhang@...el.com>
     7  Jinhui Huang <huangjh.jy@...fujitsu.com>
     7  Richard Palethorpe <rpalethorpe@...e.com>
     6  Jan Stancek <jstancek@...hat.com>
     6  Li Wang <liwang@...hat.com>
     5  Amir Goldstein <amir73il@...il.com>
     4  Carlo Marcelo Arenas Belon <carenas@...il.com>
     4  Stanislav Kholmanskikh <stanislav.kholmanskikh@...cle.com>
     3  Petr Vorel <petr.vorel@...il.com>
     3  Steve Muckle <smuckle.linux@...il.com>
     2  Anders Roxell <anders.roxell@...aro.org>
     2  Eric Biggers <ebiggers@...gle.com>
     2  Khem Raj <raj.khem@...il.com>
     2  Sandeep Patil <sspatil@...gle.com>
     2  Sebastian Chlad <schlad@...e.de>
     2  xiao yang <yangx.jy@...fujitsu.com>
     1  Christian Lanig <clanig@...e.com>
     1  Dmitry Safonov <dima@...sta.com>
     1  Erick Reyes <erickreyes@...gle.com>
     1  Greg Hackmann <ghackmann@...gle.com>
     1  Harish <harish@...ux.vnet.ibm.com>
     1  Hoang Van Tuyen <tuyen.hoangvan@...hiba-tsdv.com>
     1  Hridya Valsaraju <hridya@...gle.com>
     1  Joe Konno <joe.konno@...el.com>
     1  Lars Persson <larper@...s.com>
     1  Lianwen Sun <sunlw.fnst@...fujitsu.com>
     1  Pavel Boldin <pboldin@...udlinux.com>
     1  Qiao Zhao <qiaozqjhsy@...il.com>
     1  Xiong Zhou <xzhou@...hat.com>
     1  Yang Pengfei <yangpengfei4@...wei.com>
     1  akodanev <akodanev@...il.com>
     1  xie hui <xieh.jy@...fujitsu.com>
     1  yosun <yosun@...e.com>

And also thanks to patch reviewers:

git log 20180118.. | grep -Ei '(reviewed|acked)-by:' | \
    sed 's/.*by: //' | sort | uniq -c | sort -n -r
     34 Cyril Hrubis <chrubis@...e.cz>
     15 Petr Vorel <pvorel@...e.cz>
     15 Alexey Kodanev <alexey.kodanev@...cle.com>
     11 Jan Stancek <jstancek@...hat.com>
      7 Richard Palethorpe <rpalethorpe@...e.de>
      4 Li Wang <liwang@...hat.com>
      3 Mimi Zohar <zohar@...ux.vnet.ibm.com>
      2 Petr Vorel <petr.vorel@...il.com>
      2 James Morris <james.l.morris@...cle.com>
      1 yang xu <xuyang.jy@...fujitsu.com>
      1 Xiao Yang <yangx.jy@...fujitsu.com>

-- 
Cyril Hrubis
chrubis@...e.cz

Powered by blists - more mailing lists