We are constantly trying to improve this challenge for you and would appreciate any feedback you might have! 
Please reply to this thread with your suggestions and feedback on making the challenge better for you!
All The Best!
Dear Organizers,
Currently, when we make a submission, we can only see whether it has failed, but no useful error information is provided. I noticed that on the current leaderboard, no one has achieved a score greater than 0, and many participants are struggling due to the lack of error details. Could you please look into resolving this issue?
Dear CRAG-MM Challenge Organizing Committee,
I hope this message finds you well.
I am writing to report an issue I encountered today while managing my team for the CRAG-MM Challenge. According to the Official Rules, the team freeze deadline is clearly stated as May 21, 2025. However, when I attempted to invite a new member to our team today, the “Invite Member” button was disabled and a message appeared stating:
“The team’s challenge has team-freeze in effect.”
This appears to contradict the official schedule, as we are still well ahead of the May 21 deadline. I kindly ask for your assistance in resolving this issue so that we can invite the intended team member before the official freeze date.
Thank you very much for your time and support. Please let me know if any further information is needed from my side.
Best regards,
bunnyveil
Team: LLM_Vagetable_Chicken_team
People with a Mac are excluded from the challenge because of the fixed, incompatible tensorflow versions in requirements.txt.
This is already addressed in the upcoming release of the starter kit. We will post an announcement as soon as it’s ready.
One thing that I think could improve the community is adding a rating for users similar to what Kaggle doe, based on the challenges participation. It would also be helpful to categorize the problems and assign ratings to them as well.
The huggingface dataset crag-mm-2025/crag-mm-single-turn-public:v0.1.1 (link) has duplicated domain {2: "plants and gardening", 4: "plants and gardening "}. The label text only differs in one space char. It is a potential data quality issue.