If I changed the ratio of positive and negative labels in my public notebook
I got 0.616 LB.
Enjoy !!!
PS: I am unable to re-upload the notebook but you just take the one above and replace
nb_neg = nb_pos
in the cell 15 by
nb_neg = nb_pos * 2
you would got the same score.
I just read that notebook and though hmm… I wonder what would happen if we played with those scaling values. Glad you tried it and that it worked so well!
There definitely seems like some dark ‘magic’ in this kind of problem. Maybe there is some formal theory, but when I used to do code review for another competition platform there was a lot of ‘artisanal hand-crafted tweaks’ where folks just randomly transformed probabilities or sampling fractions until things did well on the leaderboard