|
Should 20 teams be selected for each track or 20 teams be chosen based on the overall track ranking?
|
|
1
|
723
|
June 20, 2025
|
|
Submission Status Change From "Generating" to "Prepare Generate" and Stuck
|
|
6
|
1091
|
June 20, 2025
|
|
Regarding the re-execution of 289837 and 289855
|
|
5
|
1016
|
June 20, 2025
|
|
Why did 289384, 289471 faild?
|
|
2
|
915
|
June 20, 2025
|
|
The submission status changed from "Generating" to "Generated" and was scored midway
|
|
0
|
737
|
June 18, 2025
|
|
Why Submission #289819 is finished but the score not update on LeaderBoard?
|
|
2
|
1075
|
June 19, 2025
|
|
Why submission-289987 in single source falied and the score of 289589 in multi-turn-qa has been rated but it still shows "submitted"
|
|
0
|
611
|
June 19, 2025
|
|
Why submission #289711 failed and #289713 stuck and failed? can you retry this?
|
|
0
|
768
|
June 18, 2025
|
|
Access to the OPEN_AI or GPU resource
|
|
1
|
624
|
June 18, 2025
|
|
[number of submissions per day and reset time]
|
|
1
|
785
|
June 18, 2025
|
|
Why submission #289097 #289035 #289096 failed?
|
|
1
|
556
|
June 18, 2025
|
|
Why submission #289148 failed
|
|
1
|
589
|
June 18, 2025
|
|
Why Submission #289091񆥀 Failed?
|
|
1
|
560
|
June 18, 2025
|
|
Important Update on Missing/Refusal Rate
|
|
13
|
1787
|
June 18, 2025
|
|
Regarding human evaluation tendencies
|
|
1
|
598
|
June 17, 2025
|
|
Submissions stucks
|
|
5
|
1036
|
June 17, 2025
|
|
Unable to find the ssh key
|
|
1
|
594
|
June 17, 2025
|
|
Why did 289428 failed?
|
|
1
|
895
|
June 17, 2025
|
|
Submission #289285 graded but show submitted
|
|
0
|
504
|
June 17, 2025
|
|
Why submission #289017 failed
|
|
1
|
537
|
June 16, 2025
|
|
Why did Submission #288785 fail?
|
|
2
|
781
|
June 16, 2025
|
|
Why Submission #288794 is failed?
|
|
1
|
520
|
June 16, 2025
|
|
Why Submission #288767 failed?
|
|
1
|
750
|
June 16, 2025
|
|
Why #288766 is failed?
|
|
2
|
586
|
June 16, 2025
|
|
Why did Submission 288711 failed?
|
|
1
|
514
|
June 16, 2025
|
|
Why did submission #288643 failed？
|
|
1
|
475
|
June 15, 2025
|
|
Regarding the Inability to Use Multi-Image Reasoning Due to vLLM Version Limitations
|
|
1
|
1104
|
June 14, 2025
|
|
Why did Submission 288508?
|
|
1
|
643
|
June 14, 2025
|
|
chromadb.errors.InvalidArgumentError: dimension of 1024, got 384
|
|
3
|
1771
|
June 14, 2025
|
|
Why the result of Submission #288336 is not reflected in leaderboard?
|
|
0
|
458
|
June 14, 2025
|