[Admin Note] Evaluation Failing on the Last Episode

We have seen many evaluations fail on the last episode with an errror : “Evaluation Error : Unable to orchestrate evaluation. Core services failed to start”.
And that has been fixed in this commit : https://github.com/Unity-Technologies/obstacle-tower-env/commit/888b3707284ac79b0995cd3dc333a44bd3d56993

But until thats included in the next release, a solution to get your agents through the evaluation is to add an infinite sleep at the end of your agent code :

import time
while True:
  time.sleep(10)
1 Like