Speed of training


Perhaps it’s because I’m used to the OpenAI Gym environments which are more simple than this environment, but training is slow-going; I seem to be able to achieve around 9K training episodes per day on a Ryzen 7 CPU. Is that similar to what others are getting? Is there any way to speed it up…?