Env.step() slowly with xvfb-run

Are you running env.render()?