Capture stderr/stdout for closing before configuring logging (#52289)

We replace the System.out and System.err objects with redirects to our
log file, but never ensure they are closed. This commit closes each
stream just before replacing it.