Re: Linux kernel - 5.4.0+ (net-next from 27.11.2019) routing/network performance
From: David Ahern <hidden>
Date: 2019-12-01 16:06:02
On 11/29/19 4:00 PM, Paweł Staszewski wrote:
As always - each year i need to summarize network performance for routing applications like linux router on native Linux kernel (without xdp/dpdk/vpp etc) :)
Do you keep past profiles? How does this profile (and traffic rates) compare to older kernels - e.g., 5.0 or 4.19?
HW setup: Server (Supermicro SYS-1019P-WTR) 1x Intel 6146 2x Mellanox connect-x 5 (100G) (installed in two different x16 pcie gen3.1 slots) 6x 8GB DDR4 2666 (it really matters cause 100G is about 12.5GB/s of memory bandwidth one direction) And here it is: perf top at 72Gbit.s RX and 72Gbit/s TX (at same time) PerfTop: 91202 irqs/sec kernel:99.7% exact: 100.0% [4000Hz cycles:ppp], (all, 24 CPUs) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 7.56% [kernel] [k] __dev_queue_xmit 5.27% [kernel] [k] build_skb 4.41% [kernel] [k] rr_transmit 4.17% [kernel] [k] fib_table_lookup 3.83% [kernel] [k] mlx5e_skb_from_cqe_mpwrq_linear 3.30% [kernel] [k] mlx5e_sq_xmit 3.14% [kernel] [k] __netif_receive_skb_core 2.48% [kernel] [k] netif_skb_features 2.36% [kernel] [k] _raw_spin_trylock 2.27% [kernel] [k] dev_hard_start_xmit