Engine off - no vibration - altimeter sticks.
So what do they do during the IFR cert? Shake the plane around?

I have no idea. As I said, I do not fly power. Is shutting down an
engine (or all engines) in flight required as a part of any
certification?

Bartek