Using the validation dataset

[stefanos_fafalios]

Hello,

I came upon a notebook which used the validation dataset along with the validation_ground_truth file, for early stopping the training of their algorithm. Are we allowed to use the validation dataset for training?

And since this might lead to overfitting issues, will our final scores (after the competition is over) be evaluated in a third dataset?

[ashivani]

Hi @stefanos_fafalios.

Yes, you can use the validation data for training. The final leaderboard will be based on the 40% of the hidden test set whose score are not available hence the chances of over fitting are quite less.

[mohamed_chahhou]

In other discussions, it was said that the final score is based on the current 60% + the hidden 40%. And now, you say it’s only based on the hidden 40% !!
So which one is correct?
Thanks

[siddharth]

@mohamed_chahhou host has changed the scoring rule, you can check this thread.

Welcome to the ADDI Alzheimer's Detection Challenge!

Hi All Keeping all the queries and concerns raised by the participants in mind, we have concluded that only 40% of the private data, whose score is not visible on the leaderboard, will be used for the final ranking. Thank you all for raising the concern and helping us improve