When I first started working on this challenge I spent a lot more time trying to get the submissions working without errors than I did on training the models. Much of this time was spent trying to debug the building and execution of the Docker containers.
To avoid this problem I have created two Docker images for mmdetection :
- skooch/mmdet-aicrowd - contains PyTorch 1.2, CUDA 10.0, and mmdet v1.0rc1
- skooch/mmdet-aicrowd-latest - contains PyTorch 1.6, CUDA 10.1, and the latest version of mmdet
If you are using mmdetection, you can build your containers from these images and your submissions will run faster (since the images are already built) and hopefully your submissions will fail less.