portable: create/remove the 'attached' unit file directory when we can

Let's not litter the system with this unit directory unnecessarily, and
let's try to create/remove it when necessary.