First of all, let me thank you for your patience related to the disabled testing service. Yesterday, we provided a private test set to the AICrowd team, and we believe that the service will be available shortly.
As there is a significant delay in the “release”, we will increase the number of submissions available per day up to 10. To minimize the min-maxing related issues, results will be calculated just on a fraction (80-90%) of the test set. As a result, the final performance might be a bit different. In the end, you should be able to specify which submissions that you want to compete with.
Just a few reminders:
- Usage of any additional data is against the rules.
- Please avoid any HW hungry techniques like ensembling. Your submissions might take long and could be suspended.
- We would like to see a single model submission as there is a potential to use it in a real application potentially embedded in the device.
On behalf of the organizers,