I noticed that the final score becomes 0.0 even if the detailed scores that can be seen on the “View” page do not average to 0.0. As far as I can see, this is due to the fact that, if one of the three scores is 0, then the average is not considered and instead the final score is 0.
Is it correct?
Dear mrrobot,
no, the score is the average of the three scores.
Some submissions have a 0 score because they are “debug” submissions where only a few trials of 2D goals are run and then the score is automatically set to 0.
See more about debug submissions at https://github.com/AIcrowd/neurips_goal_real_robots_starter_kit