Evaluate rollouts timed out

NeurIPS 2021 - The NetHack Challenge
#1

I got a timeout on “Evaluate Rollouts” step. I’m not sure what the step is exactly doing, but I guess it doesn’t involve running the agent. If that’s the case, can you increase time limit for this step?

What does this step do and why does it take so long? Some of our episodes are quite long (>100k steps), maybe that’s the reason?

img
img762×434 35.1 KB

1 Like
#2

The advice I’ve seen on Discord is to comment on the issue directly. The aicrowd admins responded to us there when we had an issue

2 Likes
#3

Admins responded to me that the video recording timed out and they will release a fix for it soon.

#4

Glad to hear it. That was a great couple of scores!