Commit 7d52fe2e authored by Magnus Karlsson's avatar Magnus Karlsson Committed by Tony Nguyen
Browse files

ixgbe: optimize for XDP_REDIRECT in xsk path 



Optimize ixgbe_run_xdp_zc() for the XDP program verdict being
XDP_REDIRECT in the xsk zero-copy path. This path is only used when
having AF_XDP zero-copy on and in that case most packets will be
directed to user space. This provides a little under 100k extra
packets in throughput on my server when running l2fwd in xdpsock.

Signed-off-by: default avatarMagnus Karlsson <magnus.karlsson@intel.com>
Tested-by: default avatarVishakha Jambekar <vishakha.jambekar@intel.com>
Signed-off-by: default avatarTony Nguyen <anthony.l.nguyen@intel.com>
parent 346497c7

drivers/net/ethernet/intel/ixgbe/ixgbe_xsk.c

+7 −4
Original line number Diff line number Diff line
@@ -104,6 +104,13 @@ static int ixgbe_run_xdp_zc(struct ixgbe_adapter *adapter, 
	xdp_prog = READ_ONCE(rx_ring->xdp_prog);

	act = bpf_prog_run_xdp(xdp_prog, xdp);



	if (likely(act == XDP_REDIRECT)) {

		err = xdp_do_redirect(rx_ring->netdev, xdp, xdp_prog);

		result = !err ? IXGBE_XDP_REDIR : IXGBE_XDP_CONSUMED;

		rcu_read_unlock();

		return result;

	}



	switch (act) {

	case XDP_PASS:

		break;
@@ -115,10 +122,6 @@ static int ixgbe_run_xdp_zc(struct ixgbe_adapter *adapter, 
		}

		result = ixgbe_xmit_xdp_ring(adapter, xdpf);

		break;

	case XDP_REDIRECT:

		err = xdp_do_redirect(rx_ring->netdev, xdp, xdp_prog);

		result = !err ? IXGBE_XDP_REDIR : IXGBE_XDP_CONSUMED;

		break;

	default:

		bpf_warn_invalid_xdp_action(act);

		fallthrough;