This is a pretty neat concept. You could use gravity vectors based on distance from the nearest planet and break them down into X and Y components with sin/cos to handle pulling you around. That’ll smoothen things up. Of course it’ll take some fine tuning but it would work