Is the final average ranking base on the current leader board?

If so, however, the leader board will only be updated when the factorVAE metric is better than the last time. As a result, it is unfair in a case that if the other metric in a submission is better than the last time but the factorVAE metric is just slightly worse.

1 Like

@Jie-Qiao: Yes, currently the leaderboard is sorted based on factorVAE, but we are soon adding the proper ranking as described in the rules.
The final prizes etc are determined based on the average rank of a submission across all the metrics.