Hi, @yilun_jin thanks a lot for organizing this amazing competition. We really appreciate this chance and the wonderful journey you provide. However, we have a concern regarding the rerun in the final evaluation.
In this discussion page: Note for our final evaluation, we notice that rerun behavior may potentially cause unfairness.
First, all teams experienced submission failures before the end, and network issues were the same for all teams. Participants should consider the impact of network issues in advance because the competition has already provided ample time for participants to experiment to mitigate the impact of network issues.
Second, most of the teams followed the regulations and filled in the IDs for final scoring before the deadline, which means their score was fixed. In contrast, the teams requesting reruns did not submit their IDs, giving them ample room for improvement.
Based on this, we hope the organizers will carefully consider the rerun measure and inform all participants through an official announcement. If reruns are allowed, all participating teams should be notified that they can rerun failed submissions and be given additional time to reorganize their sheets. If reruns are not allowed, we suggest clarifying the current situation in discussions and all reruns after 10th July, 2024 23:55 UTC should not be considered for the final evaluation.