By looking a lot of submission getting failed, we tried to look into every issue and there were some common mistakes by participants while making the notebook submission -
The markdown text such as Install packages, Define Preprocessing code, Prediction phase is used by our evaluation server to identify the part of notebook run as per the rules of the challenge. These should not be removed or altered.
Evaluation timed out. View the submission for more details.
This is due to your submission taking too much time to make predictions, make sure your code doesn’t take more than 15 minutes to make predictions.
Inference failed. View the submission for more details.
There can be many reasons for this error, but as far as we saw in this challenge, this error mainly comes up due to participants uploading too big submission files, which filled up memory completely in our evaluation systems and caused the error. While we have increased the memory on our systems, make sure your submission never goes above 500 MB.
“FileNotFoundError: [Errno 2] No such file or directory: ‘submission/assets’”
It’s because the
submission.zipdidn’t contain the assets folder in the
And in many other cases, the zipped file uploaded contained another folder and inside that folder contained the actual submission files. Something like this -
submission.zip └── submission ├── submission.csv └── original_notebook.ipynb
which causes the issue. Make sure you zip the directory in the correct way.
If you are using Colab, you probably won’t need to zip folder as
aicrowd-clitakes care of that
In case you face any other issue, please feel free to reach out to us and we will be happy to help