Revert "[modules] Do not cache invalid state for modules that we attempted to load."

As per comment on https://reviews.llvm.org/D72860, it is suggested to
revert this change in the meantime, since it has introduced regression.

This reverts commit 83f4c3af.