About the dataset

CHESS
#1

While trying to find approaches for this problem, I encountered a dataset online.

After training the model on this extra dataset, I make the submission; the MAE is 0.0 and F! is 1.0 as in here:
https://www.aicrowd.com/challenges/aicrowd-blitz-2/problems/chess/submissions/73209
https://www.aicrowd.com/challenges/aicrowd-blitz-2/problems/chess/submissions/73222

Does the rule allow this? @mohanty
If this is the case that the rule does not allow, could you help to remove my above 2 submissions?

Furthermore, I think we should make clear about this public dataset. So all participants can start with equal data.

#2

Hey,
No, any use of external datasets is not allowed for training and testing purpose. We have mentioned it in the rules in the Disqualification section point 3. But, yeah I understand we should highlight it more. Thanks for bringing it to our notice.

I will delete the submission. You can refer to this if you want to know more on why we are using these toy problems and if external dataset is used, the person will not be eligible for prizes.

Regards
Ayush

1 Like
#3

Thanks for the reply.

I make another submission without external data. However, the leaderboard doesn’t seem to be updated:
https://www.aicrowd.com/challenges/aicrowd-blitz-2/problems/chess/submissions/73348

Is it ok to make submission now? @ashivani

1 Like