netdev - Re: ipvsadm: One-packet scheduling with UDP service is unstable

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <alpine.LFD.2.00.1308221558160.2993@ja.ssi.bg>
Date:	Thu, 22 Aug 2013 17:14:02 +0300 (EEST)
From:	Julian Anastasov <ja@....bg>
To:	Drunkard Zhang <gongfan193@...il.com>
cc:	Wensong Zhang <wensong@...ux-vs.org>,
	Simon Horman <horms@...ge.net.au>,
	Pablo Neira Ayuso <pablo@...filter.org>,
	Patrick McHardy <kaber@...sh.net>,
	Jozsef Kadlecsik <kadlec@...ckhole.kfki.hu>,
	"David S. Miller" <davem@...emloft.net>, netdev@...r.kernel.org,
	lvs-devel@...r.kernel.org, netfilter-devel@...r.kernel.org,
	netfilter@...r.kernel.org, coreteam@...filter.org,
	linux-kernel <linux-kernel@...r.kernel.org>
Subject: Re: ipvsadm: One-packet scheduling with UDP service is unstable


	Hello,

On Thu, 22 Aug 2013, Drunkard Zhang wrote:

> 2013/8/22 Julian Anastasov <ja@....bg>:
> >
> >         No kernel options should be related to OPS. I assume
> > you are not using the SH scheduler. Make sure the OPS mode
> > is properly applied to the virtual service, check for "ops"
> > in the configuration:
> >
> > cat /proc/net/ip_vs
> 
> Still no lucky here, ops is set in running config, but it's not like
> that in real world.
> 
> vs3 ~ # cat /proc/net/ip_vs
> IP Virtual Server version 1.2.1 (size=1024)
> Prot LocalAddress:Port Scheduler Flags
>   -> RemoteAddress:Port Forward Weight ActiveConn InActConn
> UDP  96A46478:0202 wrr ops

>   -> 96A46450:0202      Route   25     0          1

	The OPS connections are accounted in InActConn
for a very short period, they live up to 1 jiffie, eg. 10ms.
Also, WRR should be reliable for OPS while other
schedulers (eg. *LC) are not suitable.

> And the traffic routed to each realserver didn't following weight I
> set, it's routed pretty much one to one. I got 17 udp sources sending
> to 16 different realservers, the others are bonding to another VIP.
> 
> Prot LocalAddress:Port                 CPS    InPPS   OutPPS    InBPS   OutBPS
>   -> RemoteAddress:Port
> UDP  x.x.x.120:514                 0    67622        0 12339373        0
>   -> x.x.x.65:514                  0       29        0     2895        0
>   -> x.x.x.66:514                  0      225        0    21850        0

	Do you see the same problem with ipvsadm -Ln --stats ?
ipvsadm -Z may be needed to zero the stats after restoring all
rules. "Conns" counter in stats should be according to WRR
weights, it shows the scheduler decisions.

	In your rates listing CPS 0 is confusing, even for OPS.
Is it from the new ipvsadm?

Regards

--
Julian Anastasov <ja@....bg>
--
To unsubscribe from this list: send the line "unsubscribe netdev" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html