About the dataset

[liberifatali]

While trying to find approaches for this problem, I encountered a dataset online.

After training the model on this extra dataset, I make the submission; the MAE is 0.0 and F! is 1.0 as in here:
https://www.aicrowd.com/challenges/aicrowd-blitz-2/problems/chess/submissions/73209
https://www.aicrowd.com/challenges/aicrowd-blitz-2/problems/chess/submissions/73222

Does the rule allow this? @mohanty
If this is the case that the rule does not allow, could you help to remove my above 2 submissions?

Furthermore, I think we should make clear about this public dataset. So all participants can start with equal data.

[ashivani]

Hey,
No, any use of external datasets is not allowed for training and testing purpose. We have mentioned it in the rules in the Disqualification section point 3. But, yeah I understand we should highlight it more. Thanks for bringing it to our notice.

I will delete the submission. You can refer to this if you want to know more on why we are using these toy problems and if external dataset is used, the person will not be eligible for prizes.

Use of external data

I was wondering if the usage of external data is allowed for this challenge (and the other challenges of the Blitz as well) If I were to find the annotated dataset online, it would be fairly easy to overfit the test set and get 100% F1 score using it, although not very interesting… Would something like this be allowed? Or does this qualify as “unfair activities”?

Regards
Ayush

[liberifatali]

Thanks for the reply.

I make another submission without external data. However, the leaderboard doesn’t seem to be updated:
https://www.aicrowd.com/challenges/aicrowd-blitz-2/problems/chess/submissions/73348

Is it ok to make submission now? @ashivani