Revert "ipv4: restore rt->fi for reference counting"

This reverts commit 82486aa6.

As implemented, this causes dangling netdevice refs.

Reported-by: Eric Dumazet <eric.dumazet@gmail.com>
Signed-off-by: David S. Miller <davem@davemloft.net>