Negative score for baseline submission

Music Demixing Challenge ISMIR 2021
#1

Hello! My baseline submissions give negative SDR scores, however, audio files shown in the issue on GitLab are fine. Locally SDR score is right. The same thing happened with my teammate with a different baseline. The only error in logs we noticed is json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0) after clicking “Generate predictions”.

This error happened at /home/aicrowd/evaluator/music_demixing.py, line 45, in __init__ dataset_env = json.loads(os.getenv("DATASET_ENV", "{}").encode().decode('unicode-escape'))

Here is the discussed submission: https://gitlab.aicrowd.com/Piteryo/music-demixing-challenge/-/issues/2
https://www.aicrowd.com/challenges/music-demixing-challenge-ismir-2021/submissions/146007

What are we doing wrong?
Thank you!

#2

Hi @Piteryo,

It was a bug on our part. In our recent changes, we were doing the wrong dependency resolution, causing CopyPredictor to run instead of DemucsPredictor for above submission.

You can view your submission status for updated scores.