We’re now deep in analysis mode and are in the process of making sure everyone’s models are counted in the final leaderboard. Bear with us and stay tuned
A bonus round while you wait
While you are waiting for the town hall we’ve opened up the challenge for a bonus round. Features of the bonus round:
Removal of Age and Age of License variables
New RMSE leaderboard
Profit leaderboard after the townhall (March 21)
How do I play in the bonus round?
You can play in the bonus round exactly as you would normally, except note that the RMSE and final dataset do not contain the following 4 columns (you can also re-download the training data for this purpose):
drv_age1
drv_age2
drv_age_lic1
drv_age_lic2
When does it launch?
It is open now, the leaderboard deadline is Saturday March 20 10PM UTC.
Does the bonus RMSE use years 1-4? Evaluated the same way that the original RMSE worked? Are we supposed to put in a pricing strategy with these submissions? How does the profit round work? I feel like we need a little more information here .
In short, everything is going to happen in exactly the same way as the final profit leaderboard, except the dataset will not include the 4 columns listed.
So:
The RMSE leaderboard is computed in exactly the same way as before on years 1-4
Yes, you should place a pricing strategy as before
The profit round will be on the same final year 5 test set excluding those 4 listed columns.
You should be able to pick actually, I can see the page is offline, so please continue making submissions and once it’s back online I will let you know.
In the meanwhile if you will not be around to pick the submission you want later, then please just send me a PM with the submission ID and I’ll make sure that’s the one that is picked