Submission stuck at 9% evaluation

vishleshak · June 9, 2021, 1:02pm

My submission is stuck at 9% evaluation. Do I need to submit it again?

shivam · June 9, 2021, 2:21pm

No, the submission has failed.

You can view the logs by clicking logs link in your GitLab issue page:

In your case, it is failing on:

TimeoutError: [Errno 110] Connection timed out

During the evaluations, you do not have access to the internet, due to which downloading failed as visible from your traceback.

You need to save the models using LFS in your GitLab repository for making the submission.

I think you are trying to submission ScaledMixturePredictor baselines but it also have UMXPredictor uncommented in predict.py causing this error to happen. (I have changed it now in starter kit, so future participants don’t face it unless they enable those baselines)

You can either comment the UMXPredictor in your predict.py or add the models it need using steps:

github.com

AIcrowd/music-demixing-challenge-starter-kit/blob/master/test_umx.py#L3


#!/usr/bin/env python
#
# This file uses openunmix for music demixing.
# It is one of official baseline for Music Demixing challenge.
#
# NOTE: openunmix need checkpoints to be submitted along with your code.
#
# Making submission using openunmix:
# 1. Change the model in `predict.py` to UMXPredictor.
# 2. Run this file locally with `python test_umx.py`.
# 3. Submit your code using git-lfs
#    #> git lfs install
#    #> git lfs track "*.pth"