Last week, we asked you, our community, how we can increase engagement in the competitionā¦and we received a resounding response on some key ideas.
I am thrilled to share that we are incorporating more and more of your feedback, and today, we are announcing 2 major updates. (stay tuned as more updates will be coming soon)
- Capping of claims at ā¬50K. We have implemented market-wide excess-of-loss re-insurance for claims above ā¬50,000. We are effectively capping any claims above ā¬50K at ā¬50K.
- Tripling leaderboard market size. We are increasing the weekly leaderboard size from 6K to 18K rows
These updates are already applied to the week 6 leaderboard
Why capping claims at ā¬50K?
In the real world reinsurance is optional and companies can negotiate the price and buy it. One among many reasons for this is to protect insurers (thatās you) from extreme claims.
What is an extreme claim? Different firms assess this differently but one common strategy is by looking at your revenue. If your company had a revenue of ā¬1B and one claim cost ā¬50M, then 5% of your revenue went to one claim. That is an extreme claim and this % is called a Combined Ratio for those familiar with the terminology, simplified here for our markets.
What we are doing here is to introduce a re-insurance cover that protects against:
- Claims above 2% of the total market revenue of each leaderboard (in reality this number is closer to 1%)
- Claims above 1% of the total market revenue for the final evaluation leaderboard.
ā¬50K corresponds to these values in our markets
To put your mind at ease, this only affects a handful of claims dataset-wide.
Why more data?
There are two key reasons for doing this:
- It further enhances the effect of re-insurance when each model has more revenue by being able to win more policies.
- A larger dataset is more representative of the final leaderboard in terms of size.
How does it affect the challenge?
- Your feedback. The reinsurance combined with larger markets will lead to less market volatility and less of the lottery effect in your feedback so that one claim does not completely wipe your profits away.
- The training profit. As with a real insurance company, you would account for capping of claims in your pricing and claim estimation, therefore we are applying the same rule to the training data. That means we will check the training profit rule with the ā¬50K cap in place. You can download the data from the resource tab on the challenge page if you wish.
- The RMSE leaderboard. This will be updated and all submissions re-run. Expect your score to go down, but your leaderboard position to remain (roughly) unchanged. This is because these handful of claims are largely unpredictable and likely affect everyone in the same why, by inflating their RMSE scores.
Lastly, as always we have new feedback cooking up for you, so stay tuned this week
I hope this will help you improve your strategies and not worry about rolling the dice in the markets.
Well, worry a little less
Good luck in the markets!
Ali, The pricing game team