Completely agree.
-
Scoring the submission with the best partial score would be absurd, because teams have no control over designating what they think should be scored and can be penalized for an early attempted that happened to be good on the public leaderboard.
-
Taking the best one out of anything ever submitted of course just encourages an absurd shotgun approach.
-
Taking the last one submitted or the best one out of the last 5 or 10 submitted might be reasonable.
It would be really good to know what will be done and to know that it is some sensible approach.