lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  PHC 
Open Source and information security mailing list archives
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Date:	Fri, 1 May 2009 12:20:12 +0200 (CEST)
From:	Jesper Dangaard Brouer <>
To:	Andrew Dickinson <>
Cc:	netdev <>
Subject: Re: tx queue hashing hot-spots and poor performance (multiq, ixgbe)

Interesting thread Andrew.  I'm also doing some 10G routing performance 
testing, but using Sun Neptune (niu) and SMC's 10G XFP (sfc) NICs.

I'm using pktgen for testing, but it sounds interesting that you got a 
Ixia testing equipment, nice.

On Wed, 29 Apr 2009, Andrew Dickinson wrote:

> I'm trying to evaluate a new system for routing performance for some
> custom packet modification that we do.  To start, I'm trying to get a
> high-water mark of routing performance without our custom cruft in the
> middle.  The hardware setup is a dual-package Nehalem box (X5550,
> Hyper-Threading disabled) with a dual 10G intel card (pci-id:
> 8086:10fb).  Because this NIC is freakishly new, I'm running the
> latest torvalds kernel in order to get the ixgbe driver to identify it
> (<sigh>).

Is that the Intel 82599 10GbE chip?
Where did you get/buy that NIC?

> Interrupts...
> I've disabled irqbalance and I'm explicitly pinning interrupts, one
> per core, as follows:

I'm doing the same...
I find that keeping the RX and TX queue pinned to the same CPU, is 
essential, together with patch that control the mapping between RX and TX 
queues.  But with Eric's patch it looks like I can drop my own patch :-)

If I don't do RX to TX mapping, then Oprofile shows that we use too much 
time freeing the skb's, naturally due to cache bounces.

> -bash-3.2# for x in 57 65; do for i in `seq 0 7`; do echo $i | awk
> '{printf("%X", (2^$1));}' > /proc/irq/$(($i + $x))/smp_affinity; done;
> done

Keep up the good work!

   Jesper Brouer

MSc. Master of Computer Science
Dept. of Computer Science, University of Copenhagen
Author of
To unsubscribe from this list: send the line "unsubscribe netdev" in
the body of a message to
More majordomo info at

Powered by blists - more mailing lists