Random variable(s)

Hello @demarsylvain,
TLDR: My experiments were somewhat different than yours but the conclusion is similar that data contains some noise/random variables which plays a big role in predictions.
I first tried with raw features and minimal pre-processing, then with heavy feature engineering (around 8-10 features were added), and finally experimented with removing unnecessary features. The results were shockingly similar and unintuitive to me. My raw features model performs almost similar to the heavy feature engineered model and minimal features model. The same data with slight changes leads to a drastic difference in log loss (kinda butterfly effect), therefore I think it’s the case of random variable majorly impacting the results. I hope this helps.

2 Likes