Build image failed with message "pod deleted during operation"

Music Demixing Challenge ISMIR 2021
#1

The image builds successfully for the previous few submissions. But after I change to another computer for submission, the image build failed with the message “pod deleted during operation”. The Docker build log is as follows:

indent preformatted text by 4 spaces
===================
{"message":"page not found"}
{"message":"page not found"}
[Repo2Docker] Looking for repo2docker_config in /
Picked Local content provider.
Using local repo /src.
...
...
# Specify the default command to run
CMD ["jupyter", "notebook", "--ip", "0.0.0.0"]

Using PythonBuildPack builder
Killed
{"message":"page not found"}
{"message":"page not found"}
[Repo2Docker] Looking for repo2docker_config in /
Picked Local content provider.
Using local repo /src.

I would be appreciated it if someone can help me out.

#2

Hi @HaoheLiu,

Thanks for raising it up, the submissions should have been automatically requeued in this scenario.
We will be adding retry for this error on our side.

Meanwhile, your submissions #140634 is requeued manually right now, so it can continue w/o above error.

1 Like
#3

Thanks @shivam for your help!

But after I submit once again. The same error occurs. Could you please inform us how long would it take for the system to recover?

#4

Hi @HaoheLiu,

Sorry about that.
I might have misjudged the root cause in that case.

I am debugging your docker build and will update shortly.

1 Like
#5

Hi @HaoheLiu,

Just an update, it is happening because your repository has 9GB of models which is causing this error.

We will reply back with recommendations or increase the maximum repository size support for this challenge shortly.

1 Like