[<prev] [next>] [<thread-prev] [day] [month] [year] [list]
Message-ID: <bc3fcce37ca80eb5972a56185fcb499872781700.camel@falix.de>
Date: Wed, 06 Nov 2024 08:17:55 +0100
From: Felix Braun <f.braun@...ix.de>
To: Heiner Kallweit <hkallweit1@...il.com>, nic_swsd@...ltek.com
Cc: netdev@...r.kernel.org
Subject: Re: r8169: regression in connection speed with kernels 6.2+
(interrupt coalescing)
On 05.11.2024 22:28 +0100 Heiner Kallweit wrote:
> On 05.11.2024 20:57, Felix Braun wrote:
> >
> > Measuring the performance with iperf3 I still see a difference in throughput
by
> > a factor of 3:
> >
> > WITH napi_defer_hard_irqs=0
> > ===========================
> > [ 5] local 2001:a61:11c6:9501:982a:b19f:94fc:71d1 port 41716 connected to
> > 2001:a61:11c6:9501:97a8:b80a:4317:435e port 5201
> > [ ID] Interval Transfer Bitrate Retr Cwnd
> > [ 5] 0.00-1.00 sec 112 MBytes 941 Mbits/sec 0 315 KBytes
> > [ 5] 1.00-2.00 sec 110 MBytes 927 Mbits/sec 0 340 KBytes
> > [ 5] 2.00-3.00 sec 111 MBytes 930 Mbits/sec 0 372 KBytes
> > [ 5] 3.00-4.00 sec 111 MBytes 930 Mbits/sec 0 372 KBytes
> > [ 5] 4.00-5.00 sec 110 MBytes 926 Mbits/sec 0 372 KBytes
> > [ 5] 5.00-6.00 sec 111 MBytes 929 Mbits/sec 0 372 KBytes
> > [ 5] 6.00-7.00 sec 110 MBytes 924 Mbits/sec 0 372 KBytes
> > [ 5] 7.00-8.00 sec 111 MBytes 932 Mbits/sec 0 372 KBytes
> > [ 5] 8.00-9.00 sec 110 MBytes 924 Mbits/sec 0 372 KBytes
> > [ 5] 9.00-10.00 sec 111 MBytes 928 Mbits/sec 0 372 KBytes
> > - - - - - - - - - - - - - - - - - - - - - - - - -
> > [ ID] Interval Transfer Bitrate Retr
> > [ 5] 0.00-10.00 sec 1.08 GBytes 929 Mbits/sec 0 sender
> > [ 5] 0.00-10.00 sec 1.08 GBytes 928 Mbits/sec
receiver
> >
> > WITH napi_defer_hard_irqs=1
> > ===========================
> > Connecting to host leporello, port 5201
> > [ 5] local 2001:a61:11c6:9501:982a:b19f:94fc:71d1 port 42338 connected to
> > 2001:a61:11c6:9501:97a8:b80a:4317:435e port 5201
> > [ ID] Interval Transfer Bitrate Retr Cwnd
> > [ 5] 0.00-1.00 sec 37.0 MBytes 310 Mbits/sec 0 806 KBytes
> > [ 5] 1.00-2.00 sec 35.0 MBytes 294 Mbits/sec 0 806 KBytes
> > [ 5] 2.00-3.00 sec 35.1 MBytes 294 Mbits/sec 0 806 KBytes
> > [ 5] 3.00-4.00 sec 35.0 MBytes 294 Mbits/sec 0 806 KBytes
> > [ 5] 4.00-5.00 sec 35.2 MBytes 296 Mbits/sec 0 806 KBytes
> > [ 5] 5.00-6.00 sec 35.0 MBytes 294 Mbits/sec 0 806 KBytes
> > [ 5] 6.00-7.00 sec 34.9 MBytes 293 Mbits/sec 0 806 KBytes
> > [ 5] 7.00-8.00 sec 34.9 MBytes 293 Mbits/sec 0 806 KBytes
> > [ 5] 8.00-9.00 sec 35.0 MBytes 294 Mbits/sec 0 806 KBytes
> > [ 5] 9.00-10.00 sec 35.2 MBytes 295 Mbits/sec 0 806 KBytes
> > - - - - - - - - - - - - - - - - - - - - - - - - -
> > [ ID] Interval Transfer Bitrate Retr
> > [ 5] 0.00-10.00 sec 352 MBytes 296 Mbits/sec 0 sender
> > [ 5] 0.00-10.02 sec 349 MBytes 292 Mbits/sec
receiver
> >
>
> Could you please test also in the other direction (with option -R)?
>
WITH napi_defer_hard_irqs=0
===========================
Connecting to host leporello, port 5201
[ 5] local 2001:a61:11db:401:95c6:dca7:5be7:e7f0 port 33400 connected to
2001:a61:11db:401:f969:3328:8a89:ebd2 port 5201
[ 7] local 2001:a61:11db:401:95c6:dca7:5be7:e7f0 port 33414 connected to
2001:a61:11db:401:f969:3328:8a89:ebd2 port 5201
[ ID][Role] Interval Transfer Bitrate Retr Cwnd
[ 5][TX-C] 0.00-1.00 sec 112 MBytes 939 Mbits/sec 0 409 KBytes
[ 7][RX-C] 0.00-1.00 sec 107 MBytes 893 Mbits/sec
[ 5][TX-C] 1.00-2.00 sec 110 MBytes 921 Mbits/sec 0 430 KBytes
[ 7][RX-C] 1.00-2.00 sec 107 MBytes 896 Mbits/sec
[ 5][TX-C] 2.00-3.00 sec 110 MBytes 925 Mbits/sec 0 430 KBytes
[ 7][RX-C] 2.00-3.00 sec 106 MBytes 892 Mbits/sec
[ 5][TX-C] 3.00-4.00 sec 110 MBytes 925 Mbits/sec 0 430 KBytes
[ 7][RX-C] 3.00-4.00 sec 107 MBytes 898 Mbits/sec
[ 5][TX-C] 4.00-5.00 sec 110 MBytes 925 Mbits/sec 0 430 KBytes
[ 7][RX-C] 4.00-5.00 sec 106 MBytes 892 Mbits/sec
[ 5][TX-C] 5.00-6.00 sec 110 MBytes 924 Mbits/sec 0 430 KBytes
[ 7][RX-C] 5.00-6.00 sec 107 MBytes 895 Mbits/sec
[ 5][TX-C] 6.00-7.00 sec 110 MBytes 926 Mbits/sec 0 430 KBytes
[ 7][RX-C] 6.00-7.00 sec 106 MBytes 892 Mbits/sec
[ 5][TX-C] 7.00-8.00 sec 110 MBytes 923 Mbits/sec 0 430 KBytes
[ 7][RX-C] 7.00-8.00 sec 107 MBytes 894 Mbits/sec
[ 5][TX-C] 8.00-9.00 sec 111 MBytes 930 Mbits/sec 0 430 KBytes
[ 7][RX-C] 8.00-9.00 sec 107 MBytes 895 Mbits/sec
[ 5][TX-C] 9.00-10.00 sec 111 MBytes 932 Mbits/sec 0 526 KBytes
[ 7][RX-C] 9.00-10.00 sec 107 MBytes 895 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID][Role] Interval Transfer Bitrate Retr
[ 5][TX-C] 0.00-10.00 sec 1.08 GBytes 928 Mbits/sec 0
sender
[ 5][TX-C] 0.00-10.00 sec 1.08 GBytes 925 Mbits/sec
receiver
[ 7][RX-C] 0.00-10.00 sec 1.04 GBytes 895 Mbits/sec 0
sender
[ 7][RX-C] 0.00-10.00 sec 1.04 GBytes 894 Mbits/sec
receiver
WITH napi_defer_hard_irqs=1
===========================
Connecting to host leporello, port 5201
[ 5] local 2001:a61:11db:401:95c6:dca7:5be7:e7f0 port 50504 connected to
2001:a61:11db:401:f969:3328:8a89:ebd2 port 5201
[ 7] local 2001:a61:11db:401:95c6:dca7:5be7:e7f0 port 50514 connected to
2001:a61:11db:401:f969:3328:8a89:ebd2 port 5201
[ ID][Role] Interval Transfer Bitrate Retr Cwnd
[ 5][TX-C] 0.00-1.00 sec 36.8 MBytes 308 Mbits/sec 0 989 KBytes
[ 7][RX-C] 0.00-1.00 sec 12.0 MBytes 101 Mbits/sec
[ 5][TX-C] 1.00-2.00 sec 34.6 MBytes 290 Mbits/sec 0 989 KBytes
[ 7][RX-C] 1.00-2.00 sec 12.6 MBytes 106 Mbits/sec
[ 5][TX-C] 2.00-3.00 sec 33.1 MBytes 278 Mbits/sec 0 989 KBytes
[ 7][RX-C] 2.00-3.00 sec 12.0 MBytes 101 Mbits/sec
[ 5][TX-C] 3.00-4.00 sec 36.1 MBytes 303 Mbits/sec 0 989 KBytes
[ 7][RX-C] 3.00-4.00 sec 12.5 MBytes 105 Mbits/sec
[ 5][TX-C] 4.00-5.00 sec 34.6 MBytes 290 Mbits/sec 0 989 KBytes
[ 7][RX-C] 4.00-5.00 sec 12.1 MBytes 102 Mbits/sec
[ 5][TX-C] 5.00-6.00 sec 34.6 MBytes 290 Mbits/sec 0 989 KBytes
[ 7][RX-C] 5.00-6.00 sec 12.1 MBytes 102 Mbits/sec
[ 5][TX-C] 6.00-7.00 sec 34.6 MBytes 290 Mbits/sec 0 989 KBytes
[ 7][RX-C] 6.00-7.00 sec 11.9 MBytes 99.6 Mbits/sec
[ 5][TX-C] 7.00-8.00 sec 34.8 MBytes 292 Mbits/sec 0 989 KBytes
[ 7][RX-C] 7.00-8.00 sec 12.0 MBytes 101 Mbits/sec
[ 5][TX-C] 8.00-9.00 sec 34.6 MBytes 290 Mbits/sec 0 989 KBytes
[ 7][RX-C] 8.00-9.00 sec 11.9 MBytes 99.6 Mbits/sec
[ 5][TX-C] 9.00-10.00 sec 33.6 MBytes 282 Mbits/sec 0 989 KBytes
[ 7][RX-C] 9.00-10.00 sec 12.0 MBytes 101 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID][Role] Interval Transfer Bitrate Retr
[ 5][TX-C] 0.00-10.00 sec 348 MBytes 291 Mbits/sec 0
sender
[ 5][TX-C] 0.00-10.01 sec 345 MBytes 289 Mbits/sec
receiver
[ 7][RX-C] 0.00-10.00 sec 122 MBytes 103 Mbits/sec 0
sender
[ 7][RX-C] 0.00-10.01 sec 121 MBytes 102 Mbits/sec
receiver
BTW the problematic machine is called leporello and it was the iperf _server_ in
all cases. The terminology in the iperf output is from the perspective of the
client machine. So leporello's transmit performance suffers almost 9-fold with
interrupt coalescing (the drop I had been measuring with my GUI tests), while
its receive performance "only" drops 3-fold.
Regarding ASPM I've now tried all possible settings in my BIOS. I can still not
make the warning go away. The above measurements are with ASPM disabled in my
BIOS.
Regards
Felix
Powered by blists - more mailing lists