netdev - Re: [Pv-drivers] rps and pvdrivers

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <1283608311.3402.30.camel@edumazet-laptop>
Date:	Sat, 04 Sep 2010 15:51:51 +0200
From:	Eric Dumazet <eric.dumazet@...il.com>
To:	Chetan Loke <chetanloke@...il.com>
Cc:	Bhavesh Davda <bhavesh@...are.com>,
	"netdev@...r.kernel.org" <netdev@...r.kernel.org>,
	"pv-drivers@...are.com" <pv-drivers@...are.com>,
	"therbert@...gle.com" <therbert@...gle.com>
Subject: Re: [Pv-drivers] rps and pvdrivers

Le samedi 04 septembre 2010 à 09:38 -0400, Chetan Loke a écrit :

> I see. Ok then that's whats happening. I guess I will have to look at
> the napi/ksoftirq/rps block in detail to understand this. But I would
> think that even w/o the rps settings I should still get the same
> numbers as compared to non-rps case, correct?
> 
> On a VM(virtual machine) using a 1G vNIC I can capture ~250K
> pkts/sec(even higher in some cases). But I can't go beyond 100K
> pkts/sec on a 10G vNIC because ksoftirqd consumes 1-cpu 100% of the
> time. That's why I thought of switching to the 2.6.35 kernel to see if
> I could scale on 10G.
> 
> It's possible that a VM cannot handle that much load. So I tried
> sending only 10% of line-rate(10G) which is 1G. It still doesn't work.
> I still can't capture that many pkts.

If packets have same rxhash, (same src IP, dst IP, src port, dst port),
they are directed on a single CPU, and this might explain you cannot
handle the load, RPS or not.

cat /proc/net/softnet_stat

RPS is good to handle multiple flows, because it can distribute load on
several cpus. But with a single flow, I guess it might be not that
useful.



--
To unsubscribe from this list: send the line "unsubscribe netdev" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html