Jobs 289837 and 289855 terminated without throwing any errors, but were marked as failed.
Would it be possible to re-execute them?
Additional Note：
I assumed that each team is allowed up to 10 submissions per task per week — is that correct?
Some teams appear to have successfully submitted more than 10 times.
Hi,
From the logs, it seems that both failed because you returned None on some questions, leading to a failure. However, it can be caused by some more subtle errors (which I am not sure of).
2025-06-18 14:27:26.258
File "/home/aicrowd/starter_kit/local_evaluation.py", line 575, in truncate_agent_responses
2025-06-18 14:27:26.258
encodings = self.tokenizer.encode_batch(agent_responses)
2025-06-18 14:27:26.258
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-06-18 14:27:26.258
TypeError: argument 'input': 'NoneType' object cannot be converted to 'Sequence'
Regarding the second question, we have added an additional 10 failed submissions per week. For example, if a team have submitted 10 failed ones and 5 successful ones, they can still submit 5.
@yilun_jin8
Since the only difference is in the parameters and other successful runs have the same setup, it should work.
Would it be possible to have it re-executed?
289872
289871
289855
289837
We have also encountered the same issue. When only replacing the model weights, some submissions suddenly stall for a long time and then fail due to returning a None value.
@yilun_jin8
Would it be possible to rerun this task?
As it may affect our final submission, we would greatly appreciate your response on this matter.
Hello @miyaken
We are re-evaluating 289871 as it seems to have failed to start the evaluation.
The rest unfortunately failed due to timeout errors. So, we won’t be able to re-evaluate them.