core: when saving timer unit time values, store them in raw µs

Let's simplify things a bit, and make sure we don't lose accuracy.