linux-kernel - Re: bisected: futex regression >= 3.14 - was - Slowdown due to threads bouncing between HT cores

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [day] [month] [year] [list]

Message-ID: <1414404302.5564.70.camel@marge.simpson.net>
Date:	Mon, 27 Oct 2014 11:05:02 +0100
From:	Mike Galbraith <umgwanakikbuti@...il.com>
To:	"Steinar H. Gunderson" <sgunderson@...foot.com>
Cc:	Thomas Gleixner <tglx@...utronix.de>,
	Linus Torvalds <torvalds@...ux-foundation.org>,
	Linux Kernel Mailing List <linux-kernel@...r.kernel.org>,
	Peter Zijlstra <peterz@...radead.org>
Subject: Re: bisected: futex regression >= 3.14 - was - Slowdown due to
 threads bouncing between HT cores

On Sun, 2014-10-26 at 15:11 +0100, Steinar H. Gunderson wrote: 
> I'm maybe a bit surprised nobody else can
> reproduce my issue;

I tried again this morning, and failed again this morning.

>From notes...

box = 2 socket, 14 cores/socket +ht, kernel = v3.18-rc2

stockfish 28 threads
nps 30511800 time 150120
nps 31337817 time 197553
nps 30675979 time 183005
nps 30706678 time 205037
nps 33389720 time 319808 (note massive runtime (ms) variance)
avg 30046381      211104

Adds perturbation source - ring-test -t 56 -w 1 -s 1 -p
(pipe ring, work 1ms, sleep 1ms, thread 0-55 pinned to cpu 0-55)

One ring did nada, bump to 5 concurrent rings.

nps 29443509 time 177969
nps 28713560 time 159663
nps 30628452 time 192714
nps 28834888 time 151611
nps 32611498 time 387760

Hm, still nada, try _10_.

nps 29998092 time 164625
nps 31142316 time 178655

Heh, 10 rings of pokers, still nada, try heavier tbench.

...

4 tbench pairs - 4 full cpus worth of competition
nps 27157639 time 144184
nps 26511984 time 143998
nps 28408851 time 182903
nps 28501510 time 157897
nps 28357045 time 172855
avg 27787405      160367 (avg runtime drops?.. shrug)

Ah, finally a nps delta.. but nothing unexpected.

vs zero competition, average nps is 0.924

4 cpus shared ~= stockfish runs on 26 cpus, 26/28 = 0.928

Test session summary: the sun moved westward.

--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/