Revert "usb: xhci: expand the scope of XHCI_VLI_SS_BULK_OUT_BUG"

This reverts commit 40686d87.

See: https://github.com/raspberrypi/linux/issues/4930



Signed-off-by: Phil Elwell <phil@raspberrypi.com>