[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-ID: <a77cd4ee-fb4d-aa7e-f0b0-8795534f2acd@suse.de>
Date: Thu, 13 Jul 2023 12:16:13 +0200
From: Hannes Reinecke <hare@...e.de>
To: Sagi Grimberg <sagi@...mberg.me>,
"linux-nvme@...ts.infradead.org" <linux-nvme@...ts.infradead.org>,
Jakub Kicinski <kuba@...nel.org>,
"open list:NETWORKING [GENERAL]" <netdev@...r.kernel.org>
Subject: Re: nvme-tls and TCP window full
On 7/13/23 12:11, Sagi Grimberg wrote:
>
>>> skbs are unrelated to the TCP window. They relate to the socket send
>>> buffer. skbs left dangling would cause server side to run out of memory,
>>> not for the TCP window to close. The two are completely unrelated.
>>
>> Ouch.
>> Wasn't me, in the end:
>>
>> diff --git a/net/tls/tls_strp.c b/net/tls/tls_strp.c
>> index f37f4a0fcd3c..ca1e0e198ceb 100644
>> --- a/net/tls/tls_strp.c
>> +++ b/net/tls/tls_strp.c
>> @@ -369,7 +369,6 @@ static int tls_strp_copyin(read_descriptor_t
>> *desc, struct sk_buff *in_skb,
>>
>> static int tls_strp_read_copyin(struct tls_strparser *strp)
>> {
>> - struct socket *sock = strp->sk->sk_socket;
>> read_descriptor_t desc;
>>
>> desc.arg.data = strp;
>> @@ -377,7 +376,7 @@ static int tls_strp_read_copyin(struct
>> tls_strparser *strp)
>> desc.count = 1; /* give more than one skb per call */
>>
>> /* sk should be locked here, so okay to do read_sock */
>> - sock->ops->read_sock(strp->sk, &desc, tls_strp_copyin);
>> + tcp_read_sock(strp->sk, &desc, tls_strp_copyin);
>>
>> return desc.error;
>> }
>>
>> Otherwise we'd enter a recursion calling ->read_sock(), which will
>> redirect to tls_sw_read_sock(), calling tls_strp_check_rcv(), calling
>> ->read_sock() ...
>
> Is this new? How did this pop up just now?
>
It's not new; this has been in there since ages immemorial.
It just got uncovered as yours truly was brave enough to implement
->read_sock() for TLS ...
>> It got covered up with the tls_rx_reader_lock() Jakub put in, so I
>> really only noticed it when instrumenting that one.
>
> So without it, you get two contexts reading from the socket?
> Not sure how this works, but obviously wrong...
>
Oh, no. Without it you get a loop, eventually resulting in a stack overflow.
>> And my reading seems that the current in-kernel TLS implementation
>> assumes TCP as the underlying transport anyway, so no harm done.
>> Jakub?
>
> While it is correct that the assumption for tcp only, I think the
> right thing to do would be to store the original read_sock and call
> that...
Ah, sure. Or that.
Cheers,
Hannes
Powered by blists - more mailing lists