I think the submissions are not working.
This means that your submission is in the queue and hasn’t started yet. There all like 100 submissions to evaluate before yours.
Yes, but it’s supposed to be evaluated before deadline…
@fersebasIn You can submit till the deadline. The evaluations need to complete before the deadline. The leaderboard would keep updating until all the evaluations are finished.
We are also working to ramp up the number of parallel evaluations we do.
Will all scores be fixed after the deadline? How will submissions that have not been fully evaluated due to lack of resources be handled?
The evaluations typically pause when the infra resources are unavailable and continue later. The scores would be updated on the leaderboard as soon as the evaluation finishes.
In case your submission fails due to any transient errors, we will re-evaluate them from our side.