Same problem here. This is with leaving the lens and adapter on the body too. I'm not changing lenses or anything. If I shut off the camera for an extended amount of time, the camera will either not boot at all or come up in a half-baked state where I can't do anything. Only removing the battery and reloading it solves the problem.
If I shut off and on quickly (like during a shooting session), there's no problem. It's only after an extended period of time...as if the adapter or camera goes to sleep and doesn't resume properly. I have the Mark IV.