Evaluate rollouts timed out

I got a timeout on “Evaluate Rollouts” step. I’m not sure what the step is exactly doing, but I guess it doesn’t involve running the agent. If that’s the case, can you increase time limit for this step?

What does this step do and why does it take so long? Some of our episodes are quite long (>100k steps), maybe that’s the reason?

1 Like

The advice I’ve seen on Discord is to comment on the issue directly. The aicrowd admins responded to us there when we had an issue

2 Likes

Admins responded to me that the video recording timed out and they will release a fix for it soon.

Glad to hear it. That was a great couple of scores!