ionic: clean irq affinity on queue deinit

Add a little more cleanup when tearing down the queues.

Fixes: 1d062b7b

 ("ionic: Add basic adminq support")
Signed-off-by: Shannon Nelson <snelson@pensando.io>
Signed-off-by: David S. Miller <davem@davemloft.net>