Test data "release" and testing period specification

Dear All,

First of all, let me thank you for your patience related to the disabled testing service. Yesterday, we provided a private test set to the AICrowd team, and we believe that the service will be available shortly.

As there is a significant delay in the “release”, we will increase the number of submissions available per day up to 10. To minimize the min-maxing related issues, results will be calculated just on a fraction (80-90%) of the test set. As a result, the final performance might be a bit different. In the end, you should be able to specify which submissions that you want to compete with.

Just a few reminders:

  • Usage of any additional data is against the rules.
  • Please avoid any HW hungry techniques like ensembling. Your submissions might take long and could be suspended.
  • We would like to see a single model submission as there is a potential to use it in a real application potentially embedded in the device.

On behalf of the organizers,
Lukas Picek

3 Likes