Hi Everyone,
After analyzing some of the submissions from the simulator and the real-world track, I get the insight that most of the submissions are struggling on the real track due to the differences we have on the real track vs the simulator. Namely the walls and the extra artifacts at the place we are running the simulations.
I want to share a few ideas that may improve your solutions, do try them out if you think they are helpful.
-
Train the neural network on a crop of the lower center portion of the image instead of the entire image, such that only most of the road is visible and not the artifacts at the top part of the image.
-
Train the neural net with random boxes augmented into the images (or any other augmentations) - If using on policy methods like PPO, this generally works well when doing only in the training phase and not during experience collection.
-
Apply some smoothening on the agent’s actions during inference. So that a sudden change in the action is not incorporated easily.
-
Try out your models on the video that was shared and the videos on the leaderboard to check where they go wrong. The preprocessing is a simple downscaling by 4x and grayscale conversion.
image[50:]might be a good starting point but you can try out different values. -
Try some hybrid computer vision methods.
If you have other ideas on what we can share to help with your real track submissions, do let us know.
All the best! Happy Deepracing.