|
Does the evaluation support async await calls?
|
|
0
|
462
|
May 25, 2024
|
|
The openai interface cannot be used during evaluation? Why?
|
|
1
|
937
|
May 25, 2024
|
|
Inference failed without any useful message in debug-logs
|
|
8
|
926
|
May 24, 2024
|
|
Are LLama models of unsloth allowed？
|
|
0
|
566
|
May 24, 2024
|
|
Inference failed with vLLM Error: "Too large swap space"
|
|
2
|
4955
|
May 22, 2024
|
|
Failed inference
|
|
3
|
618
|
May 21, 2024
|
|
Couldn't instantiate the backend tokenizer
|
|
1
|
733
|
May 21, 2024
|
|
Data Quality Collection V2, Task-1
|
|
12
|
932
|
May 21, 2024
|
|
Evaluation succeeded but the results are not on the lead board
|
|
2
|
798
|
May 20, 2024
|
|
About Test Set Leakage in Round 1
|
|
3
|
1082
|
May 20, 2024
|
|
The evaluation was successful but is still in the submitted state
|
|
0
|
457
|
May 19, 2024
|
|
Inference failed without reporting logs, why is this?
|
|
0
|
360
|
May 18, 2024
|
|
Added tag with "submission-v" prefix but no evaluation issue created
|
|
7
|
677
|
May 18, 2024
|
|
Submissions not launched
|
|
0
|
310
|
May 17, 2024
|
|
Expect to return a message that stating whether it was a timeout problem
|
|
0
|
457
|
May 17, 2024
|
|
Is it allowed to have some modifications in local_evaluation.py?
|
|
3
|
385
|
May 17, 2024
|
|
Data Quality Collection V3 - Task1
|
|
0
|
354
|
May 17, 2024
|
|
Submission budget
|
|
0
|
471
|
May 17, 2024
|
|
Couldn't instantiate the backend tokenizer
|
|
0
|
276
|
May 17, 2024
|
|
Why am I not qualified for this round.
|
|
4
|
670
|
May 16, 2024
|
|
The node was low on resource: ephemeral-storage
|
|
3
|
958
|
May 15, 2024
|
|
The error of have not qualified for this round
|
|
2
|
359
|
May 15, 2024
|
|
Why am I not eligible to participate?
|
|
10
|
1326
|
May 15, 2024
|
|
📢 Announcements: Phase 1 Extension, New Private Test Set, Batch Prediction Interface, and Updated Baselines
|
|
5
|
1618
|
May 15, 2024
|
|
Is it allowed to build Ollama docker to run different model?
|
|
1
|
620
|
May 15, 2024
|
|
CUDA out of memory issue
|
|
2
|
824
|
May 15, 2024
|
|
Do I need to set up my own openai key when uploading evaluations
|
|
5
|
665
|
May 14, 2024
|
|
How to use mock api in task #2 submission?
|
|
1
|
440
|
May 14, 2024
|
|
What does `split` field mean?
|
|
8
|
1414
|
May 13, 2024
|
|
What are the criteria to select the teams for phase 2?
|
|
1
|
612
|
May 13, 2024
|