| lists.openwall.net | lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC | |
|
Open Source and information security mailing list archives
| ||
|
Message-ID: <325042e323b3667d541793c7cde77194a6bb52e5.camel@oracle.com>
Date: Wed, 5 Mar 2025 00:39:05 +0000
From: Allison Henderson <allison.henderson@...cle.com>
To: "dan.carpenter@...aro.org" <dan.carpenter@...aro.org>,
"netdev@...r.kernel.org" <netdev@...r.kernel.org>,
"oe-kbuild@...ts.linux.dev" <oe-kbuild@...ts.linux.dev>
CC: "lkp@...el.com" <lkp@...el.com>,
"oe-kbuild-all@...ts.linux.dev"
<oe-kbuild-all@...ts.linux.dev>
Subject: Re: [PATCH 5/6] net/rds: rds_tcp_accept_one ought to not discard
messages
On Tue, 2025-03-04 at 13:28 +0300, Dan Carpenter wrote:
> Hi,
>
> kernel test robot noticed the following build warnings:
>
> https://urldefense.com/v3/__https://git-scm.com/docs/git-format-patch*_base_tree_information__;Iw!!ACWV5N9M2RV99hQ!KxXf0dDbI8bmxH2KHU1J7gopr6EmtIqkgdl5UKsE1BS29rZeqrqJGWZJPQxyKauzGVdgxG8sw0TgBbaK6hO2wPnB5xus5w$ ]
>
> url: https://urldefense.com/v3/__https://github.com/intel-lab-lkp/linux/commits/allison-henderson-oracle-com/net-rds-Avoid-queuing-superfluous-send-and-recv-work/20250227-123038__;!!ACWV5N9M2RV99hQ!KxXf0dDbI8bmxH2KHU1J7gopr6EmtIqkgdl5UKsE1BS29rZeqrqJGWZJPQxyKauzGVdgxG8sw0TgBbaK6hO2wPlkiiOVHg$
> base: net/main
> patch link: https://urldefense.com/v3/__https://lore.kernel.org/r/20250227042638.82553-6-allison.henderson*40oracle.com__;JQ!!ACWV5N9M2RV99hQ!KxXf0dDbI8bmxH2KHU1J7gopr6EmtIqkgdl5UKsE1BS29rZeqrqJGWZJPQxyKauzGVdgxG8sw0TgBbaK6hO2wPl-4cL2HA$
> patch subject: [PATCH 5/6] net/rds: rds_tcp_accept_one ought to not discard messages
> config: x86_64-randconfig-161-20250304 (https://urldefense.com/v3/__https://download.01.org/0day-ci/archive/20250304/202503041749.YwkRic8W-lkp@intel.com/config__;!!ACWV5N9M2RV99hQ!KxXf0dDbI8bmxH2KHU1J7gopr6EmtIqkgdl5UKsE1BS29rZeqrqJGWZJPQxyKauzGVdgxG8sw0TgBbaK6hO2wPko9q8sNw$ )
> compiler: clang version 19.1.7 (https://urldefense.com/v3/__https://github.com/llvm/llvm-project__;!!ACWV5N9M2RV99hQ!KxXf0dDbI8bmxH2KHU1J7gopr6EmtIqkgdl5UKsE1BS29rZeqrqJGWZJPQxyKauzGVdgxG8sw0TgBbaK6hO2wPlPIG0jYA$ cd708029e0b2869e80abe31ddb175f7c35361f90)
>
> If you fix the issue in a separate patch/commit (i.e. not just a new version of
> the same patch/commit), kindly add following tags
> > Reported-by: kernel test robot <lkp@...el.com>
> > Reported-by: Dan Carpenter <dan.carpenter@...aro.org>
> > Closes: https://urldefense.com/v3/__https://lore.kernel.org/r/202503041749.YwkRic8W-lkp@intel.com/__;!!ACWV5N9M2RV99hQ!KxXf0dDbI8bmxH2KHU1J7gopr6EmtIqkgdl5UKsE1BS29rZeqrqJGWZJPQxyKauzGVdgxG8sw0TgBbaK6hO2wPnrmKrVLA$
>
> smatch warnings:
> net/rds/tcp_listen.c:295 rds_tcp_accept_one() warn: inconsistent returns '&rtn->rds_tcp_accept_lock'.
>
> vim +/new_sock +156 net/rds/tcp_listen.c
>
> 112b9a7a012048 Gerd Rausch 2025-02-26 109 int rds_tcp_accept_one(struct rds_tcp_net *rtn)
> 70041088e3b976 Andy Grover 2009-08-21 110 {
> 112b9a7a012048 Gerd Rausch 2025-02-26 111 struct socket *listen_sock = rtn->rds_tcp_listen_sock;
> 70041088e3b976 Andy Grover 2009-08-21 112 struct socket *new_sock = NULL;
> 70041088e3b976 Andy Grover 2009-08-21 113 struct rds_connection *conn;
> 70041088e3b976 Andy Grover 2009-08-21 114 int ret;
> 70041088e3b976 Andy Grover 2009-08-21 115 struct inet_sock *inet;
> bd7c5f983f3185 Sowmini Varadhan 2016-05-02 116 struct rds_tcp_connection *rs_tcp = NULL;
> bd7c5f983f3185 Sowmini Varadhan 2016-05-02 117 int conn_state;
> ea3b1ea5393087 Sowmini Varadhan 2016-06-30 118 struct rds_conn_path *cp;
> 1e2b44e78eead7 Ka-Cheong Poon 2018-07-23 119 struct in6_addr *my_addr, *peer_addr;
> 92ef0fd55ac80d Jens Axboe 2024-05-09 120 struct proto_accept_arg arg = {
> 92ef0fd55ac80d Jens Axboe 2024-05-09 121 .flags = O_NONBLOCK,
> 92ef0fd55ac80d Jens Axboe 2024-05-09 122 .kern = true,
> 92ef0fd55ac80d Jens Axboe 2024-05-09 123 };
> e65d4d96334e3f Ka-Cheong Poon 2018-07-30 124 #if !IS_ENABLED(CONFIG_IPV6)
> e65d4d96334e3f Ka-Cheong Poon 2018-07-30 125 struct in6_addr saddr, daddr;
> e65d4d96334e3f Ka-Cheong Poon 2018-07-30 126 #endif
> e65d4d96334e3f Ka-Cheong Poon 2018-07-30 127 int dev_if = 0;
> 70041088e3b976 Andy Grover 2009-08-21 128
> 112b9a7a012048 Gerd Rausch 2025-02-26 129 mutex_lock(&rtn->rds_tcp_accept_lock);
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
>
> 112b9a7a012048 Gerd Rausch 2025-02-26 130
> 112b9a7a012048 Gerd Rausch 2025-02-26 131 if (!listen_sock)
> 37e14f4fe2991f Sowmini Varadhan 2016-05-18 132 return -ENETUNREACH;
> ^^^^^^^^^^^^^^^^^^^^
> Do this before taking the lock?
Yep, I think you're right. Will fix. Thank you!
Allison
>
> 37e14f4fe2991f Sowmini Varadhan 2016-05-18 133
> 112b9a7a012048 Gerd Rausch 2025-02-26 134 new_sock = rtn->rds_tcp_accepted_sock;
> 112b9a7a012048 Gerd Rausch 2025-02-26 135 rtn->rds_tcp_accepted_sock = NULL;
> 112b9a7a012048 Gerd Rausch 2025-02-26 136
> 112b9a7a012048 Gerd Rausch 2025-02-26 @137 if (!new_sock) {
> 112b9a7a012048 Gerd Rausch 2025-02-26 138 ret = sock_create_lite(listen_sock->sk->sk_family,
> 112b9a7a012048 Gerd Rausch 2025-02-26 139 listen_sock->sk->sk_type,
> 112b9a7a012048 Gerd Rausch 2025-02-26 140 listen_sock->sk->sk_protocol,
> d5a8ac28a7ff2f Sowmini Varadhan 2015-08-05 141 &new_sock);
> 70041088e3b976 Andy Grover 2009-08-21 142 if (ret)
> 70041088e3b976 Andy Grover 2009-08-21 143 goto out;
> 70041088e3b976 Andy Grover 2009-08-21 144
> 112b9a7a012048 Gerd Rausch 2025-02-26 145 ret = listen_sock->ops->accept(listen_sock, new_sock, &arg);
> 70041088e3b976 Andy Grover 2009-08-21 146 if (ret < 0)
> 70041088e3b976 Andy Grover 2009-08-21 147 goto out;
> 70041088e3b976 Andy Grover 2009-08-21 148
> 84eef2b2187ed7 Ka-Cheong Poon 2018-03-01 149 /* sock_create_lite() does not get a hold on the owner module so we
> 84eef2b2187ed7 Ka-Cheong Poon 2018-03-01 150 * need to do it here. Note that sock_release() uses sock->ops to
> 84eef2b2187ed7 Ka-Cheong Poon 2018-03-01 151 * determine if it needs to decrement the reference count. So set
> 84eef2b2187ed7 Ka-Cheong Poon 2018-03-01 152 * sock->ops after calling accept() in case that fails. And there's
> 84eef2b2187ed7 Ka-Cheong Poon 2018-03-01 153 * no need to do try_module_get() as the listener should have a hold
> 84eef2b2187ed7 Ka-Cheong Poon 2018-03-01 154 * already.
> 84eef2b2187ed7 Ka-Cheong Poon 2018-03-01 155 */
> 112b9a7a012048 Gerd Rausch 2025-02-26 @156 new_sock->ops = listen_sock->ops;
> 84eef2b2187ed7 Ka-Cheong Poon 2018-03-01 157 __module_get(new_sock->ops->owner);
> 84eef2b2187ed7 Ka-Cheong Poon 2018-03-01 158
> 480aeb9639d6a0 Christoph Hellwig 2020-05-28 159 rds_tcp_keepalive(new_sock);
> 6997fbd7a3dafa Tetsuo Handa 2022-05-05 160 if (!rds_tcp_tune(new_sock)) {
> 6997fbd7a3dafa Tetsuo Handa 2022-05-05 161 ret = -EINVAL;
> 6997fbd7a3dafa Tetsuo Handa 2022-05-05 162 goto out;
> 6997fbd7a3dafa Tetsuo Handa 2022-05-05 163 }
> 70041088e3b976 Andy Grover 2009-08-21 164
> 70041088e3b976 Andy Grover 2009-08-21 165 inet = inet_sk(new_sock->sk);
> 112b9a7a012048 Gerd Rausch 2025-02-26 166 }
> 70041088e3b976 Andy Grover 2009-08-21 167
> e65d4d96334e3f Ka-Cheong Poon 2018-07-30 168 #if IS_ENABLED(CONFIG_IPV6)
> 1e2b44e78eead7 Ka-Cheong Poon 2018-07-23 169 my_addr = &new_sock->sk->sk_v6_rcv_saddr;
> 1e2b44e78eead7 Ka-Cheong Poon 2018-07-23 170 peer_addr = &new_sock->sk->sk_v6_daddr;
> e65d4d96334e3f Ka-Cheong Poon 2018-07-30 171 #else
> e65d4d96334e3f Ka-Cheong Poon 2018-07-30 172 ipv6_addr_set_v4mapped(inet->inet_saddr, &saddr);
> e65d4d96334e3f Ka-Cheong Poon 2018-07-30 173 ipv6_addr_set_v4mapped(inet->inet_daddr, &daddr);
> e65d4d96334e3f Ka-Cheong Poon 2018-07-30 174 my_addr = &saddr;
> e65d4d96334e3f Ka-Cheong Poon 2018-07-30 175 peer_addr = &daddr;
> e65d4d96334e3f Ka-Cheong Poon 2018-07-30 176 #endif
> e65d4d96334e3f Ka-Cheong Poon 2018-07-30 177 rdsdebug("accepted family %d tcp %pI6c:%u -> %pI6c:%u\n",
> 112b9a7a012048 Gerd Rausch 2025-02-26 178 listen_sock->sk->sk_family,
> 1e2b44e78eead7 Ka-Cheong Poon 2018-07-23 179 my_addr, ntohs(inet->inet_sport),
> 1e2b44e78eead7 Ka-Cheong Poon 2018-07-23 180 peer_addr, ntohs(inet->inet_dport));
> 70041088e3b976 Andy Grover 2009-08-21 181
> e65d4d96334e3f Ka-Cheong Poon 2018-07-30 182 #if IS_ENABLED(CONFIG_IPV6)
> 1e2b44e78eead7 Ka-Cheong Poon 2018-07-23 183 /* sk_bound_dev_if is not set if the peer address is not link local
> 1e2b44e78eead7 Ka-Cheong Poon 2018-07-23 184 * address. In this case, it happens that mcast_oif is set. So
> 1e2b44e78eead7 Ka-Cheong Poon 2018-07-23 185 * just use it.
> 1e2b44e78eead7 Ka-Cheong Poon 2018-07-23 186 */
> 1e2b44e78eead7 Ka-Cheong Poon 2018-07-23 187 if ((ipv6_addr_type(my_addr) & IPV6_ADDR_LINKLOCAL) &&
> 1e2b44e78eead7 Ka-Cheong Poon 2018-07-23 188 !(ipv6_addr_type(peer_addr) & IPV6_ADDR_LINKLOCAL)) {
> 1e2b44e78eead7 Ka-Cheong Poon 2018-07-23 189 struct ipv6_pinfo *inet6;
> 1e2b44e78eead7 Ka-Cheong Poon 2018-07-23 190
> 1e2b44e78eead7 Ka-Cheong Poon 2018-07-23 191 inet6 = inet6_sk(new_sock->sk);
> d2f011a0bf28c0 Eric Dumazet 2023-12-08 192 dev_if = READ_ONCE(inet6->mcast_oif);
> 1e2b44e78eead7 Ka-Cheong Poon 2018-07-23 193 } else {
> 1e2b44e78eead7 Ka-Cheong Poon 2018-07-23 194 dev_if = new_sock->sk->sk_bound_dev_if;
> 1e2b44e78eead7 Ka-Cheong Poon 2018-07-23 195 }
> e65d4d96334e3f Ka-Cheong Poon 2018-07-30 196 #endif
> e65d4d96334e3f Ka-Cheong Poon 2018-07-30 197
> 112b9a7a012048 Gerd Rausch 2025-02-26 198 if (!rds_tcp_laddr_check(sock_net(listen_sock->sk), peer_addr, dev_if)) {
> aced3ce57cd37b Rao Shoaib 2021-05-21 199 /* local address connection is only allowed via loopback */
> aced3ce57cd37b Rao Shoaib 2021-05-21 200 ret = -EOPNOTSUPP;
> aced3ce57cd37b Rao Shoaib 2021-05-21 201 goto out;
> aced3ce57cd37b Rao Shoaib 2021-05-21 202 }
> aced3ce57cd37b Rao Shoaib 2021-05-21 203
> 112b9a7a012048 Gerd Rausch 2025-02-26 204 conn = rds_conn_create(sock_net(listen_sock->sk),
> e65d4d96334e3f Ka-Cheong Poon 2018-07-30 205 my_addr, peer_addr,
> 3eb450367d0823 Santosh Shilimkar 2018-10-23 206 &rds_tcp_transport, 0, GFP_KERNEL, dev_if);
> eee2fa6ab32251 Ka-Cheong Poon 2018-07-23 207
> 70041088e3b976 Andy Grover 2009-08-21 208 if (IS_ERR(conn)) {
> 70041088e3b976 Andy Grover 2009-08-21 209 ret = PTR_ERR(conn);
> 70041088e3b976 Andy Grover 2009-08-21 210 goto out;
> 70041088e3b976 Andy Grover 2009-08-21 211 }
> f711a6ae062cae Sowmini Varadhan 2015-05-05 212 /* An incoming SYN request came in, and TCP just accepted it.
> f711a6ae062cae Sowmini Varadhan 2015-05-05 213 *
> f711a6ae062cae Sowmini Varadhan 2015-05-05 214 * If the client reboots, this conn will need to be cleaned up.
> f711a6ae062cae Sowmini Varadhan 2015-05-05 215 * rds_tcp_state_change() will do that cleanup
> f711a6ae062cae Sowmini Varadhan 2015-05-05 216 */
> 112b9a7a012048 Gerd Rausch 2025-02-26 217 if (rds_addr_cmp(&conn->c_faddr, &conn->c_laddr) < 0) {
> 112b9a7a012048 Gerd Rausch 2025-02-26 218 /* Try to obtain a free connection slot.
> 112b9a7a012048 Gerd Rausch 2025-02-26 219 * If unsuccessful, we need to preserve "new_sock"
> 112b9a7a012048 Gerd Rausch 2025-02-26 220 * that we just accepted, since its "sk_receive_queue"
> 112b9a7a012048 Gerd Rausch 2025-02-26 221 * may contain messages already that have been acknowledged
> 112b9a7a012048 Gerd Rausch 2025-02-26 222 * to and discarded by the sender.
> 112b9a7a012048 Gerd Rausch 2025-02-26 223 * We must not throw those away!
> 112b9a7a012048 Gerd Rausch 2025-02-26 224 */
> 5916e2c1554f3e Sowmini Varadhan 2016-07-14 225 rs_tcp = rds_tcp_accept_one_path(conn);
> 112b9a7a012048 Gerd Rausch 2025-02-26 226 if (!rs_tcp) {
> 112b9a7a012048 Gerd Rausch 2025-02-26 227 /* It's okay to stash "new_sock", since
> 112b9a7a012048 Gerd Rausch 2025-02-26 228 * "rds_tcp_conn_slots_available" triggers "rds_tcp_accept_one"
> 112b9a7a012048 Gerd Rausch 2025-02-26 229 * again as soon as one of the connection slots
> 112b9a7a012048 Gerd Rausch 2025-02-26 230 * becomes available again
> 112b9a7a012048 Gerd Rausch 2025-02-26 231 */
> 112b9a7a012048 Gerd Rausch 2025-02-26 232 rtn->rds_tcp_accepted_sock = new_sock;
> 112b9a7a012048 Gerd Rausch 2025-02-26 233 new_sock = NULL;
> 112b9a7a012048 Gerd Rausch 2025-02-26 234 ret = -ENOBUFS;
> 112b9a7a012048 Gerd Rausch 2025-02-26 235 goto out;
> 112b9a7a012048 Gerd Rausch 2025-02-26 236 }
> 112b9a7a012048 Gerd Rausch 2025-02-26 237 } else {
> 112b9a7a012048 Gerd Rausch 2025-02-26 238 /* This connection request came from a peer with
> 112b9a7a012048 Gerd Rausch 2025-02-26 239 * a larger address.
> 112b9a7a012048 Gerd Rausch 2025-02-26 240 * Function "rds_tcp_state_change" makes sure
> 112b9a7a012048 Gerd Rausch 2025-02-26 241 * that the connection doesn't transition
> 112b9a7a012048 Gerd Rausch 2025-02-26 242 * to state "RDS_CONN_UP", and therefore
> 112b9a7a012048 Gerd Rausch 2025-02-26 243 * we should not have received any messages
> 112b9a7a012048 Gerd Rausch 2025-02-26 244 * on this socket yet.
> 112b9a7a012048 Gerd Rausch 2025-02-26 245 * This is the only case where it's okay to
> 112b9a7a012048 Gerd Rausch 2025-02-26 246 * not dequeue messages from "sk_receive_queue".
> 112b9a7a012048 Gerd Rausch 2025-02-26 247 */
> 112b9a7a012048 Gerd Rausch 2025-02-26 248 if (conn->c_npaths <= 1)
> 112b9a7a012048 Gerd Rausch 2025-02-26 249 rds_conn_path_connect_if_down(&conn->c_path[0]);
> 112b9a7a012048 Gerd Rausch 2025-02-26 250 rs_tcp = NULL;
> 5916e2c1554f3e Sowmini Varadhan 2016-07-14 251 goto rst_nsk;
> 112b9a7a012048 Gerd Rausch 2025-02-26 252 }
> 112b9a7a012048 Gerd Rausch 2025-02-26 253
> 02105b2ccdd634 Sowmini Varadhan 2016-06-30 254 mutex_lock(&rs_tcp->t_conn_path_lock);
> 5916e2c1554f3e Sowmini Varadhan 2016-07-14 255 cp = rs_tcp->t_cpath;
> 5916e2c1554f3e Sowmini Varadhan 2016-07-14 256 conn_state = rds_conn_path_state(cp);
> 1a0e100fb2c966 Sowmini Varadhan 2016-11-16 257 WARN_ON(conn_state == RDS_CONN_UP);
> 112b9a7a012048 Gerd Rausch 2025-02-26 258 if (conn_state != RDS_CONN_CONNECTING && conn_state != RDS_CONN_ERROR) {
> 112b9a7a012048 Gerd Rausch 2025-02-26 259 rds_conn_path_drop(cp, 0);
> bd7c5f983f3185 Sowmini Varadhan 2016-05-02 260 goto rst_nsk;
> 112b9a7a012048 Gerd Rausch 2025-02-26 261 }
> eb192840266fab Sowmini Varadhan 2016-05-02 262 if (rs_tcp->t_sock) {
> 41500c3e2a19ff Sowmini Varadhan 2017-06-15 263 /* Duelling SYN has been handled in rds_tcp_accept_one() */
> ea3b1ea5393087 Sowmini Varadhan 2016-06-30 264 rds_tcp_reset_callbacks(new_sock, cp);
> 9c79440e2c5e25 Sowmini Varadhan 2016-06-04 265 /* rds_connect_path_complete() marks RDS_CONN_UP */
> ea3b1ea5393087 Sowmini Varadhan 2016-06-30 266 rds_connect_path_complete(cp, RDS_CONN_RESETTING);
> 335b48d980f631 Sowmini Varadhan 2016-06-04 267 } else {
> ea3b1ea5393087 Sowmini Varadhan 2016-06-30 268 rds_tcp_set_callbacks(new_sock, cp);
> ea3b1ea5393087 Sowmini Varadhan 2016-06-30 269 rds_connect_path_complete(cp, RDS_CONN_CONNECTING);
> e70845e6ecd132 Ka-Cheong Poon 2025-02-26 270 wake_up(&cp->cp_up_waitq);
> 335b48d980f631 Sowmini Varadhan 2016-06-04 271 }
> 70041088e3b976 Andy Grover 2009-08-21 272 new_sock = NULL;
> 70041088e3b976 Andy Grover 2009-08-21 273 ret = 0;
> 69b92b5b741984 Sowmini Varadhan 2017-06-21 274 if (conn->c_npaths == 0)
> 69b92b5b741984 Sowmini Varadhan 2017-06-21 275 rds_send_ping(cp->cp_conn, cp->cp_index);
> bd7c5f983f3185 Sowmini Varadhan 2016-05-02 276 goto out;
> bd7c5f983f3185 Sowmini Varadhan 2016-05-02 277 rst_nsk:
> 10beea7d7408d0 Sowmini Varadhan 2017-06-15 278 /* reset the newly returned accept sock and bail.
> 10beea7d7408d0 Sowmini Varadhan 2017-06-15 279 * It is safe to set linger on new_sock because the RDS connection
> 10beea7d7408d0 Sowmini Varadhan 2017-06-15 280 * has not been brought up on new_sock, so no RDS-level data could
> 10beea7d7408d0 Sowmini Varadhan 2017-06-15 281 * be pending on it. By setting linger, we achieve the side-effect
> 10beea7d7408d0 Sowmini Varadhan 2017-06-15 282 * of avoiding TIME_WAIT state on new_sock.
> 10beea7d7408d0 Sowmini Varadhan 2017-06-15 283 */
> c433594c07457d Christoph Hellwig 2020-05-28 284 sock_no_linger(new_sock->sk);
> 335b48d980f631 Sowmini Varadhan 2016-06-04 285 kernel_sock_shutdown(new_sock, SHUT_RDWR);
> bd7c5f983f3185 Sowmini Varadhan 2016-05-02 286 ret = 0;
> 70041088e3b976 Andy Grover 2009-08-21 287 out:
> bd7c5f983f3185 Sowmini Varadhan 2016-05-02 288 if (rs_tcp)
> 02105b2ccdd634 Sowmini Varadhan 2016-06-30 289 mutex_unlock(&rs_tcp->t_conn_path_lock);
> 70041088e3b976 Andy Grover 2009-08-21 290 if (new_sock)
> 70041088e3b976 Andy Grover 2009-08-21 291 sock_release(new_sock);
> 112b9a7a012048 Gerd Rausch 2025-02-26 292
> 112b9a7a012048 Gerd Rausch 2025-02-26 293 mutex_unlock(&rtn->rds_tcp_accept_lock);
> 112b9a7a012048 Gerd Rausch 2025-02-26 294
> 70041088e3b976 Andy Grover 2009-08-21 @295 return ret;
> 70041088e3b976 Andy Grover 2009-08-21 296 }
>
Powered by blists - more mailing lists