Thank you very much for your hard-working Shivam!
It is just a personal opinion, but I think there are still many people who submit models trained with extra datasets to leaderboard A.
Hi @woosung_choi, yes, I agree that there are still a few submissions on wrong leaderboard.
The flow depends on self-declaration and participants can end up marking external_dataset_used as false instead of true by mistake.
We are reaching out to participants so they can provide us submission IDs for older submissions with the wrong tag, and for having the correct tag in newer submissions.
And +1 for demux-extra thing, it belongs to Leaderboard B.