Hello,
The rules for Phase 2 of the Meta CRAG-MM Challenge 2025 have been updated. To continue participating and submitting entries, you must re-accept the updated rules.
Please visit the challenge page and click “Participate” to re-accept the rules:
https://www.aicrowd.com/challenges/meta-crag-mm-challenge-2025
Summary of Changes:
- Team registration extended to 1 June 2025
- Phase 2 submission deadline extended to 14 June 2025
- Submission limit: 10 submissions per week per track
-
10-second timeout per turn strictly enforced
(first-token grace period removed; any turn exceeding the limit causes the entire submission to fail)
Batch mode timeout = batch size × 10 seconds - Validation and public test datasets will remain publicly accessible post-competition
- Non-LLaMA models <1.6B parameters are permitted
- Human evaluation considers full responses; auto-evaluation scores only the first 75 BPE tokens
- Egocentric image evaluation now uses low resolution (960×1280); standard image resolution is unchanged
Please make sure to re-accept the rules as soon as possible to ensure uninterrupted access to submissions for Phase 2.
Thank you for being part of the challenge. We look forward to your submissions in this next phase.
All The Best
Team CRAG-MM