Hello Participants,
Please select Submission IDs for the private leaderboard evaluation.
Deadline for Form Submission :
20th June 2024, 23:59 UTC
Individual Participants :
Please submit the form only once. If multiple entries are made, we will consider your last form entry.
Teams :
If multiple team members submit the form, we will consider the Team Organizer’s last form entry as the final one.
Submit your form here: Meta Challenge Form
All the best,
Meta Comprehensive RAG Benchmark Challenge Team
You can select 2 submission IDs for each task in the form.
Can we submit the same submissions for all 3 tasks? The aicrowd.json
might be the same but the code is able to deal with all three task setting.
1 Like
Yes, if your code is addressing all three tasks you can submit the same IDs for the 3 tasks.
Can we confirm which are our final submissions in the google forms after June 20th e.g (June 21st some time when online evaluation finished). It is because some people want to select their final solution based on the round 2 score. Besides the current evaluation system is stuck as a lot of people are submitting to the evaluation system.
2 Likes
same question. I submitted my solution about 8 hours ago, but I can’t see the hope that the evaluation ends before deadline.
1 Like
vk11
June 21, 2024, 3:24am
#9
@snehananavati Can the Submission IDs selection deadline be pushed back? Because so many submissions are waiting for evaluation then, we couldn’t select the appropriate submissions as final submissions.
1 Like
Yes, we have extended the deadline till June 22nd 12:00 UTC (noon).
Hello all,
We are extending the submission selection form deadline to June 22nd, 12:00 UTC (noon). Participants can select either the top 2 submissions on the leaderboard or the last 2 submissions they submitted before the new deadline.
Please note, that all submissions on the form must be eligible for the respective track. For instance, you cannot indicate a submission for Track-1 as your intended submission for Track-2 unless it is already on the leaderboard of Track-2.
Please follow the gu…
Has the Winner Notification already been sent? @snehananavati
The winners are not announced yet. You will receive an email about the winner announcement once the due diligence is completed.