linux-kernel - [ANNOUNCE] trace-cmd 3.0

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [day] [month] [year] [list]

Message-ID: <20220310164422.41c57c7c@gandalf.local.home>
Date:   Thu, 10 Mar 2022 16:44:22 -0500
From:   Steven Rostedt <rostedt@...dmis.org>
To:     LKML <linux-kernel@...r.kernel.org>,
        linux-rt-users <linux-rt-users@...r.kernel.org>,
        "linux-trace-users@...r.kernel.org" 
        <linux-trace-users@...r.kernel.org>,
        Linux Trace Devel <linux-trace-devel@...r.kernel.org>
Cc:     Namhyung Kim <namhyung@...nel.org>,
        Masami Hiramatsu <mhiramat@...nel.org>,
        Yordan Karadzhov <y.karadz@...il.com>,
        Tzvetomir Stoyanov <tz.stoyanov@...il.com>,
        Arnaldo Carvalho de Melo <acme@...hat.com>,
        Jiri Olsa <jolsa@...hat.com>,
        Changbin Du <changbin.du@...il.com>,
        Patrick McLean <chutzpah@...too.org>,
        Josh Boyer <jwboyer@...oraproject.org>,
        Clark Williams <williams@...hat.com>,
        Daniel Bristot de Oliveira <bristot@...hat.com>,
        Juri Lelli <juri.lelli@...hat.com>,
        John Kacur <jkacur@...hat.com>, Tony Jones <tonyj@...e.de>,
        Tom Zanussi <zanussi@...nel.org>,
        Jonathan Corbet <corbet@....net>,
        Daniel Wagner <wagi@...om.org>,
        Johannes Berg <johannes@...solutions.net>,
        Josef Bacik <jbacik@...com>, troyengel@...il.com,
        Behan Webster <behanw@...verseincode.com>,
        Sebastian Andrzej Siewior <bigeasy@...utronix.de>
Subject: [ANNOUNCE] trace-cmd 3.0

[ Resending without corrupted email headers ]

I'm happy to announce that after over a year, we finally are able to
release trace-cmd version 3.0!

The two biggest changes:

1) Updated trace.dat to version 7 (not compatible with older versions of
   trace-cmd). But now supports compression.

2) Better synchronization between host and guest kernel tracing.


Features and user visible updates since 2.9:

- Relies on upstream repos for libtraceevent and libtracefs:
    * Removed libtraceevent code (Upstream minimum version 1.5)
    * Removed libtracefs code (Upstream minimum version 1.3)

- KernelShark is no longer installed in the trace-cmd repo.

- Some perf support

- trace-cmd dump updates:
   * Display the clock used in the file

- New trace-cmd clock: tsc2nsec to use the tsc clock in the ring buffer but
  to display it as nanoseconds. Requires architecture support, but trace-cmd
  list -C will show if it supported or not.

- New option --raw-ts for trace-cmd report to show raw timestamps without any
  modifications.

- New timestamp synchronization between host and guests.
   * P2P : timing back and forth of host and guest
   * KVM : queries the kernel for the multiplier, offset and shift for exact
           synchronization of host and guest timestamps.

- tracecmd_warning() API for writing error messages in libtracecmd library.

- Better bash tab completion.

- Plugins now go into /usr/[local/]lib/trace-cmd instead of traceevent
  directory.

- New option --full for trace-cmd list to show "print fmt" of event formats
  specified by -e <event> -F

- trace-cmd list now shows ftrace events as well as events that can be
  enabled.

- Supports non qemu VM host/guest tracing.

- New option --align-ts for trace-cmd report that will make the timestamps of
  all events a delta from the first event. (0.000003 instead of 16292.633984)

- New option -V for trace-cmd report to change verbosity.

- New option --verbose for a bunch of commands to trace-cmd.

- New option --poll for trace-cmd record to poll which makes trace-cmd check
  the buffers with O_NONBLOCK instead of relying on IPIs to wake it up. This
  reduces latency on recording tasks that trace-cmd is not running on.

- trace.dat output has been updated to Version 7 (incompatible with older
  trace-cmd, but trace-cmd convert can convert back to version 6, with
  possible lost of features).
   * The file is broken up into sections (defined as options) just like an ELF
     file.
   * Allows for sections to be compressed.
      .  Supports zlib compression
      .  Supports ZSTD compression
   * Will allow for new types of data to be added
      . Target for perf data to be included (still in development)

- New command: trace-cmd convert, to convert between trace-cmd 7 and 6 files.