lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [<thread-prev] [day] [month] [year] [list]
Message-ID: <bc3fcce37ca80eb5972a56185fcb499872781700.camel@falix.de>
Date: Wed, 06 Nov 2024 08:17:55 +0100
From: Felix Braun <f.braun@...ix.de>
To: Heiner Kallweit <hkallweit1@...il.com>, nic_swsd@...ltek.com
Cc: netdev@...r.kernel.org
Subject: Re: r8169: regression in connection speed with kernels 6.2+
 (interrupt coalescing)


On 05.11.2024 22:28 +0100 Heiner Kallweit wrote:
> On 05.11.2024 20:57, Felix Braun wrote:
> > 
> > Measuring the performance with iperf3 I still see a difference in throughput
by
> > a factor of 3:
> > 
> > WITH napi_defer_hard_irqs=0
> > ===========================
> > [  5] local 2001:a61:11c6:9501:982a:b19f:94fc:71d1 port 41716 connected to
> > 2001:a61:11c6:9501:97a8:b80a:4317:435e port 5201
> > [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
> > [  5]   0.00-1.00   sec   112 MBytes   941 Mbits/sec    0    315 KBytes
> > [  5]   1.00-2.00   sec   110 MBytes   927 Mbits/sec    0    340 KBytes
> > [  5]   2.00-3.00   sec   111 MBytes   930 Mbits/sec    0    372 KBytes
> > [  5]   3.00-4.00   sec   111 MBytes   930 Mbits/sec    0    372 KBytes
> > [  5]   4.00-5.00   sec   110 MBytes   926 Mbits/sec    0    372 KBytes
> > [  5]   5.00-6.00   sec   111 MBytes   929 Mbits/sec    0    372 KBytes
> > [  5]   6.00-7.00   sec   110 MBytes   924 Mbits/sec    0    372 KBytes
> > [  5]   7.00-8.00   sec   111 MBytes   932 Mbits/sec    0    372 KBytes
> > [  5]   8.00-9.00   sec   110 MBytes   924 Mbits/sec    0    372 KBytes
> > [  5]   9.00-10.00  sec   111 MBytes   928 Mbits/sec    0    372 KBytes
> > - - - - - - - - - - - - - - - - - - - - - - - - -
> > [ ID] Interval           Transfer     Bitrate         Retr
> > [  5]   0.00-10.00  sec  1.08 GBytes   929 Mbits/sec    0             sender
> > [  5]   0.00-10.00  sec  1.08 GBytes   928 Mbits/sec                 
receiver
> > 
> > WITH napi_defer_hard_irqs=1
> > ===========================
> > Connecting to host leporello, port 5201
> > [  5] local 2001:a61:11c6:9501:982a:b19f:94fc:71d1 port 42338 connected to
> > 2001:a61:11c6:9501:97a8:b80a:4317:435e port 5201
> > [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
> > [  5]   0.00-1.00   sec  37.0 MBytes   310 Mbits/sec    0    806 KBytes
> > [  5]   1.00-2.00   sec  35.0 MBytes   294 Mbits/sec    0    806 KBytes
> > [  5]   2.00-3.00   sec  35.1 MBytes   294 Mbits/sec    0    806 KBytes
> > [  5]   3.00-4.00   sec  35.0 MBytes   294 Mbits/sec    0    806 KBytes
> > [  5]   4.00-5.00   sec  35.2 MBytes   296 Mbits/sec    0    806 KBytes
> > [  5]   5.00-6.00   sec  35.0 MBytes   294 Mbits/sec    0    806 KBytes
> > [  5]   6.00-7.00   sec  34.9 MBytes   293 Mbits/sec    0    806 KBytes
> > [  5]   7.00-8.00   sec  34.9 MBytes   293 Mbits/sec    0    806 KBytes
> > [  5]   8.00-9.00   sec  35.0 MBytes   294 Mbits/sec    0    806 KBytes
> > [  5]   9.00-10.00  sec  35.2 MBytes   295 Mbits/sec    0    806 KBytes
> > - - - - - - - - - - - - - - - - - - - - - - - - -
> > [ ID] Interval           Transfer     Bitrate         Retr
> > [  5]   0.00-10.00  sec   352 MBytes   296 Mbits/sec    0             sender
> > [  5]   0.00-10.02  sec   349 MBytes   292 Mbits/sec                 
receiver
> >
> 
> Could you please test also in the other direction (with option -R)?
> 
WITH napi_defer_hard_irqs=0
===========================
Connecting to host leporello, port 5201
[  5] local 2001:a61:11db:401:95c6:dca7:5be7:e7f0 port 33400 connected to
2001:a61:11db:401:f969:3328:8a89:ebd2 port 5201
[  7] local 2001:a61:11db:401:95c6:dca7:5be7:e7f0 port 33414 connected to
2001:a61:11db:401:f969:3328:8a89:ebd2 port 5201
[ ID][Role] Interval           Transfer     Bitrate         Retr  Cwnd
[  5][TX-C]   0.00-1.00   sec   112 MBytes   939 Mbits/sec    0    409 KBytes
[  7][RX-C]   0.00-1.00   sec   107 MBytes   893 Mbits/sec
[  5][TX-C]   1.00-2.00   sec   110 MBytes   921 Mbits/sec    0    430 KBytes
[  7][RX-C]   1.00-2.00   sec   107 MBytes   896 Mbits/sec
[  5][TX-C]   2.00-3.00   sec   110 MBytes   925 Mbits/sec    0    430 KBytes
[  7][RX-C]   2.00-3.00   sec   106 MBytes   892 Mbits/sec
[  5][TX-C]   3.00-4.00   sec   110 MBytes   925 Mbits/sec    0    430 KBytes
[  7][RX-C]   3.00-4.00   sec   107 MBytes   898 Mbits/sec
[  5][TX-C]   4.00-5.00   sec   110 MBytes   925 Mbits/sec    0    430 KBytes
[  7][RX-C]   4.00-5.00   sec   106 MBytes   892 Mbits/sec
[  5][TX-C]   5.00-6.00   sec   110 MBytes   924 Mbits/sec    0    430 KBytes
[  7][RX-C]   5.00-6.00   sec   107 MBytes   895 Mbits/sec
[  5][TX-C]   6.00-7.00   sec   110 MBytes   926 Mbits/sec    0    430 KBytes
[  7][RX-C]   6.00-7.00   sec   106 MBytes   892 Mbits/sec
[  5][TX-C]   7.00-8.00   sec   110 MBytes   923 Mbits/sec    0    430 KBytes
[  7][RX-C]   7.00-8.00   sec   107 MBytes   894 Mbits/sec
[  5][TX-C]   8.00-9.00   sec   111 MBytes   930 Mbits/sec    0    430 KBytes
[  7][RX-C]   8.00-9.00   sec   107 MBytes   895 Mbits/sec
[  5][TX-C]   9.00-10.00  sec   111 MBytes   932 Mbits/sec    0    526 KBytes
[  7][RX-C]   9.00-10.00  sec   107 MBytes   895 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID][Role] Interval           Transfer     Bitrate         Retr
[  5][TX-C]   0.00-10.00  sec  1.08 GBytes   928 Mbits/sec    0            
sender
[  5][TX-C]   0.00-10.00  sec  1.08 GBytes   925 Mbits/sec                 
receiver
[  7][RX-C]   0.00-10.00  sec  1.04 GBytes   895 Mbits/sec    0            
sender
[  7][RX-C]   0.00-10.00  sec  1.04 GBytes   894 Mbits/sec                 
receiver

WITH napi_defer_hard_irqs=1
===========================
Connecting to host leporello, port 5201
[  5] local 2001:a61:11db:401:95c6:dca7:5be7:e7f0 port 50504 connected to
2001:a61:11db:401:f969:3328:8a89:ebd2 port 5201
[  7] local 2001:a61:11db:401:95c6:dca7:5be7:e7f0 port 50514 connected to
2001:a61:11db:401:f969:3328:8a89:ebd2 port 5201
[ ID][Role] Interval           Transfer     Bitrate         Retr  Cwnd
[  5][TX-C]   0.00-1.00   sec  36.8 MBytes   308 Mbits/sec    0    989 KBytes
[  7][RX-C]   0.00-1.00   sec  12.0 MBytes   101 Mbits/sec
[  5][TX-C]   1.00-2.00   sec  34.6 MBytes   290 Mbits/sec    0    989 KBytes
[  7][RX-C]   1.00-2.00   sec  12.6 MBytes   106 Mbits/sec
[  5][TX-C]   2.00-3.00   sec  33.1 MBytes   278 Mbits/sec    0    989 KBytes
[  7][RX-C]   2.00-3.00   sec  12.0 MBytes   101 Mbits/sec
[  5][TX-C]   3.00-4.00   sec  36.1 MBytes   303 Mbits/sec    0    989 KBytes
[  7][RX-C]   3.00-4.00   sec  12.5 MBytes   105 Mbits/sec
[  5][TX-C]   4.00-5.00   sec  34.6 MBytes   290 Mbits/sec    0    989 KBytes
[  7][RX-C]   4.00-5.00   sec  12.1 MBytes   102 Mbits/sec
[  5][TX-C]   5.00-6.00   sec  34.6 MBytes   290 Mbits/sec    0    989 KBytes
[  7][RX-C]   5.00-6.00   sec  12.1 MBytes   102 Mbits/sec
[  5][TX-C]   6.00-7.00   sec  34.6 MBytes   290 Mbits/sec    0    989 KBytes
[  7][RX-C]   6.00-7.00   sec  11.9 MBytes  99.6 Mbits/sec
[  5][TX-C]   7.00-8.00   sec  34.8 MBytes   292 Mbits/sec    0    989 KBytes
[  7][RX-C]   7.00-8.00   sec  12.0 MBytes   101 Mbits/sec
[  5][TX-C]   8.00-9.00   sec  34.6 MBytes   290 Mbits/sec    0    989 KBytes
[  7][RX-C]   8.00-9.00   sec  11.9 MBytes  99.6 Mbits/sec
[  5][TX-C]   9.00-10.00  sec  33.6 MBytes   282 Mbits/sec    0    989 KBytes
[  7][RX-C]   9.00-10.00  sec  12.0 MBytes   101 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID][Role] Interval           Transfer     Bitrate         Retr
[  5][TX-C]   0.00-10.00  sec   348 MBytes   291 Mbits/sec    0            
sender
[  5][TX-C]   0.00-10.01  sec   345 MBytes   289 Mbits/sec                 
receiver
[  7][RX-C]   0.00-10.00  sec   122 MBytes   103 Mbits/sec    0            
sender
[  7][RX-C]   0.00-10.01  sec   121 MBytes   102 Mbits/sec                 
receiver

BTW the problematic machine is called leporello and it was the iperf _server_ in
all cases. The terminology in the iperf output is from the perspective of the
client machine. So leporello's transmit performance suffers almost 9-fold with
interrupt coalescing (the drop I had been measuring with my GUI tests), while
its receive performance "only" drops 3-fold.

Regarding ASPM I've now tried all possible settings in my BIOS. I can still not
make the warning go away. The above measurements are with ASPM disabled in my
BIOS.

Regards
Felix

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ