Submitting in debug mode sets leaderboard score to 0

#1

Currently, if you submit in debug mode your leaderboard score becomes 0. Is this intended?

#2

Yes. Also note that debug runs are done with different seeds than final evaluation.

More information here: Announcement: Debug your submissions

1 Like