|
💬 Welcome to the Meta CRAG - MM Challenge 2025!
|
|
2
|
1190
|
April 1, 2025
|
|
📢 Submit Your Technical Report and Poster by July 25 **Submission Link Updated**
|
|
7
|
273
|
July 23, 2025
|
|
Are queries verified to be answerable?
|
|
4
|
404
|
May 14, 2025
|
|
Final Evaluation Process & Team Scores
|
|
7
|
308
|
July 17, 2025
|
|
🏆 Meta CRAG Challenge 2025 Winners Announcement
|
|
12
|
929
|
July 15, 2025
|
|
Can non-winners also have a chance to submit paper
|
|
2
|
186
|
July 14, 2025
|
|
Any updates on the results?
|
|
3
|
280
|
July 7, 2025
|
|
When will we know the results of the manual evaluation?
|
|
1
|
210
|
July 3, 2025
|
|
🚨 Submission Selection Deadline: 23rd June 2025, 12:00 UTC (noon)
|
|
9
|
472
|
June 30, 2025
|
|
Request for investigation into the cause of the error
|
|
2
|
148
|
June 23, 2025
|
|
Why submission #289987 still failed in generate predictions？although it was re-evaluating this submission
|
|
0
|
167
|
June 22, 2025
|
|
What are the submission time and rules for manual review?
|
|
1
|
161
|
June 20, 2025
|
|
Should 20 teams be selected for each track or 20 teams be chosen based on the overall track ranking?
|
|
1
|
158
|
June 20, 2025
|
|
Submission Status Change From "Generating" to "Prepare Generate" and Stuck
|
|
6
|
221
|
June 20, 2025
|
|
Regarding the re-execution of 289837 and 289855
|
|
5
|
197
|
June 20, 2025
|
|
Why did 289384, 289471 faild?
|
|
2
|
155
|
June 20, 2025
|
|
The submission status changed from "Generating" to "Generated" and was scored midway
|
|
1
|
131
|
June 18, 2025
|
|
Why Submission #289819 is finished but the score not update on LeaderBoard?
|
|
2
|
247
|
June 19, 2025
|
|
Why submission-289987 in single source falied and the score of 289589 in multi-turn-qa has been rated but it still shows "submitted"
|
|
0
|
162
|
June 19, 2025
|
|
Why submission #289711 failed and #289713 stuck and failed? can you retry this?
|
|
0
|
131
|
June 18, 2025
|
|
Why submission #289097 #289035 #289096 failed?
|
|
1
|
116
|
June 18, 2025
|
|
Why submission #289148 failed
|
|
1
|
114
|
June 18, 2025
|
|
Why Submission #289091񆥀 Failed?
|
|
1
|
102
|
June 18, 2025
|
|
Important Update on Missing/Refusal Rate
|
|
13
|
668
|
June 18, 2025
|
|
Regarding human evaluation tendencies
|
|
1
|
170
|
June 17, 2025
|
|
Submissions stucks
|
|
5
|
236
|
June 17, 2025
|
|
Why did 289428 failed?
|
|
1
|
129
|
June 17, 2025
|
|
Submission #289285 graded but show submitted
|
|
0
|
146
|
June 17, 2025
|
|
Why submission #289017 failed
|
|
1
|
115
|
June 16, 2025
|
|
Why did Submission #288785 fail?
|
|
2
|
125
|
June 16, 2025
|