🚨 Submission Selection Deadline: 23rd June 2025, 12:00 UTC (noon)

Meta CRAG - MM Challenge 2025
#1

Hello everyone, and thanks again for participating in the Meta CRAG-MM Challenge 2025.

We’re now collecting final submission selections for each track. Please fill out the form here:
:point_right: https://forms.gle/51qr1ngiqagKaMQ4A

Please note:

  • You may select up to two submissions per team per track
  • Submissions must be eligible for the respective track (i.e. already on the leaderboard for that track)
  • If more than two submissions are listed, we’ll use the last two
  • If no form is submitted, we’ll default to your top two leaderboard submissions

:bust_in_silhouette: Individuals: Please fill out the form only once. If submitted multiple times, we’ll use the latest entry
:busts_in_silhouette: Teams: If multiple team members submit, the Team Organizer’s latest entry will be used

— Meta CRAG-MM Challenge Team

#2

How to solve the situation where the Submission #289819 score has been given, but the status is still in submitted? And the given score is not update on the leaderboard… AIcrowd | Multi-turn QA | Submissions #289819

#3

@aicrowd_team @yilun_jin8 Can you see this post for me? I think these two submissions have some system problems and need to be reruned.

#4

Hi. When we select two, what do you do with the two? Will you human evaluate both of the two and pick the one that has the best score? (i.e. of the two selected per task, which one of the two will eventually be used as our team’s final submission per task?)

1 Like
#5

I think it now shows ‘graded’?