linux-kernel - Re: [PATCH v2] perf script/python: add new compaction-times script

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <20150820194242.GD3154@kernel.org>
Date:	Thu, 20 Aug 2015 16:42:42 -0300
From:	Arnaldo Carvalho de Melo <acme@...nel.org>
To:	Vlastimil Babka <vbabka@...e.cz>
Cc:	Tony Jones <tonyj@...e.com>, linux-kernel@...r.kernel.org,
	linux-perf-users@...r.kernel.org, Mel Gorman <mgorman@...e.com>
Subject: Re: [PATCH v2] perf script/python: add new compaction-times script

Em Thu, Aug 20, 2015 at 11:33:24AM +0200, Vlastimil Babka escreveu:
> On 08/17/2015 09:48 PM, Tony Jones wrote:
> >This patch creates a new script (compaction-times) to report time
> >spent in mm compaction. It is possible to report times in nanoseconds
> >(default) or microseconds (-u). The option -p will break down results
> >by process id, -pv will further decompose by each compaction entry/exit.
> >For each compaction entry/exit what is reported is controlled by the
> >options -t (report only timing), -m (report migration stats), -ms
> >(report migration scanner stats) and -fs (report free scanner stats).
> >The default is to report all.  Entries may be further filtered by pid,
> >pid-range or comm (regex).
> >
> >The script is useful when analysing workloads that compact memory. The
> >most common example will be THP allocations on systems with a lot of
> >uptime that has fragmented memory. This is an example of using the script
> >to analyse a thpscale from mmtests which deliberately fragments memory
> >and allocates THP in 4 separate threads
> >
> >     # Recording step, one of the following;
> >     $ perf record -e 'compaction:mm_compaction_*' ./workload
> >     $ perf script record compaction-times
> >
> >     # Reporting: basic
> >     total: 2444505743ns migration: moved=357738 failed=39275
> >     free_scanner: scanned=2705578 isolated=387875
> >     migration_scanner: scanned=414426 isolated=397013
> >
> >     # Reporting: Per task stall times
> >     $ perf script report compaction-times -- -t -p
> >     total: 2444505743ns
> >     6384[thpscale]: 740800017ns
> >     6385[thpscale]: 274119512ns
> >     6386[thpscale]: 832961337ns
> >     6383[thpscale]: 596624877ns
> >
> >     # Reporting: Per-compaction attempts for task 6385
> >     $ perf script report compaction-times -- -m -pv 6385
> >     total: 274119512ns migration: moved=14893 failed=24285
> >     6385[thpscale]: 274119512ns migration: moved=14893 failed=24285
> >     6385[thpscale].1: 3033277ns migration: moved=511 failed=1
> >     6385[thpscale].2: 9592094ns migration: moved=1524 failed=12
> >     6385[thpscale].3: 2495587ns migration: moved=512 failed=0
> >     6385[thpscale].4: 2561766ns migration: moved=512 failed=0
> >     6385[thpscale].5: 2523521ns migration: moved=512 failed=0
> >     ..... output continues ...
> >
> >Changes since v1:
> >- report stats for isolate_migratepages and isolate_freepages
> >   (Vlastimil Babka)
> >- refactor code to achieve above
> >- add help text
> >- output to stdout/stderr explicitly
> >
> >Signed-off-by: Tony Jones <tonyj@...e.com>
> >Cc: Mel Gorman <mgorman@...e.com>
> >Cc: Vlastimil Babka <vbabka@...e.cz>
> 
> Acked-by: Vlastimil Babka <vbabka@...e.cz>
> 
> Works for me, thanks. I'll leave it to perf experts to judge if the options
> and output formatting matches what's common for perf scripts.

Well, we don't have any firm set standard for outputting from scripts,
so if you did it inspired by existing scripts outputs, probably that is
good enough, having someone testing it is a plus, and in these cases, if
the "works for me" means you actually tested it, can we replace the
"Acked-by" with a "Tested-by"?

Ingo, others, comments on formatting?

- Arnaldo
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/