nd-ndisc: don't fail if src address is unset

This happens when running our test-suite over a socketpair,
so don't fall over in that case.

Fixes issue #1952.