Submission throws 500 Error

SnakeCLEF2021 - Snake Species Identification Chall
#1

I tried submitting the CSV file, it threw 500 Error.

Then, when I reloaded, there are 4 submissions done, can you please check the issue?
I am also not able to see my evaluation score.

Few things, I would like to know about the evaluation script:

  • There are a few images that are corrupted, do we need to include that in the submission file?
  • Does the order of the columns have to be the same as the ones given in the sample submission file?

Thanks!

1 Like
#2

Yup, I have similar problems. The workaround is simply resubmitting, however now it doesn’t work anymore that only works occasionally. Submissions that somewhy get marked as “ready” will freeze and never display any error message nor score. Given that there is less than 48 hours to the end of round 1, this is pretty important.

  • “There are a few images that are corrupted, do we need to include that in the submission file?” Yes, otherwise the submission is not accepted.
  • “Does the order of the columns have to be the same as the ones given in the sample submission file?” Both columns and rows can be permuted.
#3

I want to add explanation for the first question.
For each corrupted image, if the sum of your scores is larger than 1.0001 (or perhaps 1.00001 or something), the server will raise an error.
I use np.ones(45)/45 for corrupted images.

#4

Thanks @kristjan_kongas & @mnaoya.

I will add the corrupted files and try resubmitting.