|
I wonder if predictive timeouts are common
|
|
8
|
850
|
April 2, 2024
|
|
Where are the JSON FIles for the challenges?
|
|
1
|
246
|
May 6, 2024
|
|
Can mock api cover all types of questions as in formal evaluation environment?
|
|
1
|
284
|
May 6, 2024
|
|
Model’s input
|
|
1
|
350
|
May 6, 2024
|
|
Can we have multi GPU submission example?
|
|
0
|
288
|
May 5, 2024
|
|
Submission stuck!
|
|
1
|
1033
|
May 5, 2024
|
|
Timeout problem
|
|
1
|
307
|
May 4, 2024
|
|
Is the limit on the times of submission canceled?
|
|
1
|
300
|
May 4, 2024
|
|
Are we allowed to use LLama 3?
|
|
2
|
847
|
May 3, 2024
|
|
How to make submissions?
|
|
3
|
397
|
May 3, 2024
|
|
Problems with API on billboard queries
|
|
1
|
503
|
May 3, 2024
|
|
Do we need extend lfs quota by ourselves?
|
|
1
|
311
|
May 2, 2024
|
|
Leaderboard not updated
|
|
0
|
314
|
May 2, 2024
|
|
How to install local llm model
|
|
0
|
370
|
May 2, 2024
|
|
Evaluating with 70b size model
|
|
0
|
308
|
May 2, 2024
|
|
Submit error git clone?
|
|
2
|
373
|
May 2, 2024
|
|
Submission for a long time it still on step one
|
|
0
|
455
|
May 2, 2024
|
|
Another Frozen Evaluation
|
|
0
|
444
|
May 2, 2024
|
|
Gitlab Dev Ops issue
|
|
0
|
337
|
May 1, 2024
|
|
Our Evaluation is Frozen
|
|
2
|
421
|
May 1, 2024
|
|
📹 Office Hour #2 Recording
|
|
2
|
438
|
May 1, 2024
|
|
Phase 1 has released the dataset , and how to appy a cut-off to limit Phase 2?
|
|
0
|
607
|
May 1, 2024
|
|
Are we going to release all the test data as benchmark once the challenge is concluded?
|
|
2
|
424
|
May 1, 2024
|
|
Why i can't download the dataset
|
|
2
|
295
|
April 30, 2024
|
|
Couldn't connect to gitlab
|
|
1
|
492
|
April 30, 2024
|
|
Update ssh key after the maintenance
|
|
0
|
348
|
April 29, 2024
|
|
Submit error
|
|
1
|
642
|
April 29, 2024
|
|
RuntimeError: Found no NVIDIA driver on your system
|
|
1
|
889
|
April 29, 2024
|
|
End evaluation manually
|
|
1
|
243
|
April 29, 2024
|
|
📹 Office Hour #1 Recording
|
|
0
|
380
|
April 25, 2024
|