I have submitted many time, but nothing happened

NeurIPS 2019 : Disentanglement Challenge
#1

I have submitted many time, but nothing happened…
are there any wrong ?

#2

Looks like you already figured out how to make submissions!

:wink:

Best of luck! :smiley:

#3

I have been also struggling with getting at least the base code submitted and evaluated. The image gets built but it always fails during evaluation. I have modified the run.sh file and added execution permissions (which apparently was one of the issues) but I am still not able to get results. What could be another possible source of error?

#4

@lapr_hanabi: Looking at your failure logs, it seems you are not including torch as a dependency. Please follow the instructions here to specify your software runtime correctly.

#5

Thank you very much for your help. Now I am having successful submissions :smile:

1 Like
#6

I was able to do the base code submission, but how do I submit a trained model? I updated the run.sh file, but I don’t see the error logs in the issue tracker.

edit: I actually misunderstood the competition… so the actual submission evaluation involves, training on a new dataset from scratch, then evaluating… and there is a time limit of 8 hours for both training and evaluation to be done on the submission server.

#7

I am having again now problems with submissions. I am making changes to my repository with new commits but they don’t trigger new evaluations. I am not sure what could be wrong. I had previously a long training that was stuck for one day which should have exhausted the computation time limit.

edit: Nevermind, I was doing things wrong.

#8

Your tags name should begin with submission- for it to be considered by the evaluator as a valid submission. This was an unsaid rule from the beginning, but has only now been enforced.

1 Like