Some competitors are very high score in public leaderboard.
e.g. single-source augmented 1st is Accuracy 1.00, it’s means all correct.
Is dataset included open datasets in public leaderboard dataset?
if open dataset included in leaderboard public, Round 1 is data finding competition.
Hi tereka,
We are aware of this submission. The high scores are a result of prompt injection attacks, instead of data leakage.
We are actively discussing with the Meta team on how to eliminate such attempts, either via added clarifications to the rules and/or technical methods However, the organizing team reserves the right to disqualify submissions that are clearly trying to exploit a loophole, or are not aligned with the spirit of the competition, and we will check all code before final winner announcements to invalidate all such attempts.
Hi yilun.
thank you for response. I understand this situation.
so I hope to be clear rule by organizer and check outputs in round1 and more.
I hope the competition will be even more interesting!