In the MineRLNavigateDense-v0 environment, even if I don’t perform any action, the compassAngle keeps changing. Have a look in the next example, where I don’t perform any action (my action is to stay in the same place and don’t rotate my camera) and the compassAnge changes from 64 to 94!
The compass observation in Minecraft has momentum and starts at a fixed point. So even if you stand still there could still be some oscillation of the compass direction!