|
I wonder if predictive timeouts are common
|
|
9
|
210
|
May 2, 2024
|
|
Where are the JSON FIles for the challenges?
|
|
1
|
14
|
May 6, 2024
|
|
Can vLLM be supported?
|
|
0
|
9
|
May 6, 2024
|
|
What does `split` field mean?
|
|
3
|
159
|
May 6, 2024
|
|
The team's challenge has team-freeze in effect
|
|
2
|
44
|
May 6, 2024
|
|
Can mock api cover all types of questions as in formal evaluation environment?
|
|
1
|
40
|
May 6, 2024
|
|
The node was low on resource: ephemeral-storage
|
|
0
|
16
|
May 6, 2024
|
|
Model’s input
|
|
1
|
33
|
May 6, 2024
|
|
When will the submission limit be reset?
|
|
0
|
32
|
May 5, 2024
|
|
Can we have multi GPU submission example?
|
|
0
|
25
|
May 5, 2024
|
|
Submission stuck!
|
|
1
|
208
|
May 5, 2024
|
|
Timeout problem
|
|
1
|
36
|
May 4, 2024
|
|
Bug in mockapi
|
|
0
|
39
|
May 4, 2024
|
|
Is the limit on the times of submission canceled?
|
|
1
|
40
|
May 4, 2024
|
|
Are we allowed to use LLama 3?
|
|
2
|
257
|
May 3, 2024
|
|
How to make submissions?
|
|
3
|
79
|
May 3, 2024
|
|
Problems with API on billboard queries
|
|
1
|
116
|
May 3, 2024
|
|
Do we need extend lfs quota by ourselves?
|
|
1
|
37
|
May 2, 2024
|
|
Is there possible bug in using gpt4 as the metric mechanism?
|
|
1
|
74
|
May 3, 2024
|
|
Do I need to set up my own openai key when uploading evaluations
|
|
3
|
132
|
May 2, 2024
|
|
Leaderboard not updated
|
|
0
|
69
|
May 2, 2024
|
|
How to install local llm model
|
|
0
|
42
|
May 2, 2024
|
|
Evaluating with 70b size model
|
|
0
|
54
|
May 2, 2024
|
|
Submit error git clone?
|
|
2
|
68
|
May 2, 2024
|
|
Can we use huggingface to upload our model weight？
|
|
0
|
50
|
May 2, 2024
|
|
Submission for a long time it still on step one
|
|
0
|
64
|
May 2, 2024
|
|
Another Frozen Evaluation
|
|
0
|
48
|
May 2, 2024
|
|
Gitlab Dev Ops issue
|
|
0
|
39
|
May 1, 2024
|
|
Our Evaluation is Frozen
|
|
2
|
63
|
May 1, 2024
|
|
📹 Office Hour #2 Recording
|
|
2
|
73
|
May 1, 2024
|