Are these evaluation qa values present in qa.json correct?
|
|
1
|
71
|
April 17, 2024
|
Some issues about time limit
|
|
2
|
29
|
April 17, 2024
|
Submission failure with empty logs
|
|
0
|
19
|
April 17, 2024
|
Tentative Challenge Winners
|
|
1
|
34
|
April 17, 2024
|
Evaluation process hang
|
|
0
|
18
|
April 17, 2024
|
The maximum number of players per team.
|
|
1
|
54
|
April 17, 2024
|
Can we assume the same websites in both the test and training datasets?
|
|
1
|
37
|
April 17, 2024
|
Confusion about using other LLMs
|
|
1
|
45
|
April 16, 2024
|
ModuleNotFoundError: No module named 'aicrowd_gym'
|
|
1
|
99
|
April 16, 2024
|
Are the four models are competing and ranked in the same track?
|
|
1
|
35
|
April 16, 2024
|
Do I need to complete all three tasks?
|
|
2
|
89
|
April 16, 2024
|
Pretrained LLM
|
|
1
|
82
|
April 15, 2024
|
Can we use other LLM at training stage?
|
|
4
|
330
|
April 15, 2024
|
We Cannot View Submissions
|
|
2
|
56
|
April 15, 2024
|
Docker build failed
|
|
2
|
47
|
April 15, 2024
|
About 'System Logs Comprehensive Rag Task: Inference failed'
|
|
1
|
41
|
April 15, 2024
|
Submission error
|
|
0
|
74
|
April 13, 2024
|
Issues about submission LFS file issues
|
|
0
|
71
|
April 13, 2024
|
What Does 2 Submission Per Week Mean?
|
|
1
|
59
|
April 13, 2024
|
Why Doesn't Leaderboard Show Ranking Score?
|
|
2
|
177
|
April 12, 2024
|
Function calling arguments in local_evaluation.py is mismatching with dummy_model's interface
|
|
3
|
158
|
April 12, 2024
|
Top teams solutions
|
|
2
|
111
|
April 12, 2024
|
AIcrowd Submission automatically runs again
|
|
2
|
78
|
April 12, 2024
|
Unable to create notebook
|
|
0
|
31
|
April 11, 2024
|
Error building the docker image
|
|
1
|
121
|
April 11, 2024
|
About the 'search results' type
|
|
1
|
68
|
April 11, 2024
|
Is there any evaluation on data quality yet?
|
|
1
|
109
|
April 11, 2024
|
Is there a baseline score for reference?
|
|
2
|
122
|
April 11, 2024
|
Total submission times?
|
|
2
|
100
|
April 11, 2024
|
Will the Mock API data evolve?
|
|
1
|
70
|
April 10, 2024
|