|
Does the evaluation support async await calls?
|
|
0
|
459
|
May 25, 2024
|
|
The openai interface cannot be used during evaluation? Why?
|
|
1
|
930
|
May 25, 2024
|
|
Inference failed without any useful message in debug-logs
|
|
8
|
924
|
May 24, 2024
|
|
Are LLama models of unsloth allowed？
|
|
0
|
561
|
May 24, 2024
|
|
Inference failed with vLLM Error: "Too large swap space"
|
|
2
|
4867
|
May 22, 2024
|
|
Failed inference
|
|
3
|
616
|
May 21, 2024
|
|
Couldn't instantiate the backend tokenizer
|
|
1
|
723
|
May 21, 2024
|
|
Data Quality Collection V2, Task-1
|
|
12
|
928
|
May 21, 2024
|
|
Evaluation succeeded but the results are not on the lead board
|
|
2
|
796
|
May 20, 2024
|
|
About Test Set Leakage in Round 1
|
|
3
|
1078
|
May 20, 2024
|
|
The evaluation was successful but is still in the submitted state
|
|
0
|
453
|
May 19, 2024
|
|
Inference failed without reporting logs, why is this?
|
|
0
|
358
|
May 18, 2024
|
|
Added tag with "submission-v" prefix but no evaluation issue created
|
|
7
|
672
|
May 18, 2024
|
|
Submissions not launched
|
|
0
|
309
|
May 17, 2024
|
|
Expect to return a message that stating whether it was a timeout problem
|
|
0
|
454
|
May 17, 2024
|
|
Is it allowed to have some modifications in local_evaluation.py?
|
|
3
|
385
|
May 17, 2024
|
|
Data Quality Collection V3 - Task1
|
|
0
|
353
|
May 17, 2024
|
|
Submission budget
|
|
0
|
470
|
May 17, 2024
|
|
Couldn't instantiate the backend tokenizer
|
|
0
|
273
|
May 17, 2024
|
|
Why am I not qualified for this round.
|
|
4
|
668
|
May 16, 2024
|
|
The node was low on resource: ephemeral-storage
|
|
3
|
953
|
May 15, 2024
|
|
The error of have not qualified for this round
|
|
2
|
358
|
May 15, 2024
|
|
Why am I not eligible to participate?
|
|
10
|
1311
|
May 15, 2024
|
|
📢 Announcements: Phase 1 Extension, New Private Test Set, Batch Prediction Interface, and Updated Baselines
|
|
5
|
1603
|
May 15, 2024
|
|
Is it allowed to build Ollama docker to run different model?
|
|
1
|
619
|
May 15, 2024
|
|
CUDA out of memory issue
|
|
2
|
812
|
May 15, 2024
|
|
Do I need to set up my own openai key when uploading evaluations
|
|
5
|
662
|
May 14, 2024
|
|
How to use mock api in task #2 submission?
|
|
1
|
435
|
May 14, 2024
|
|
What does `split` field mean?
|
|
8
|
1405
|
May 13, 2024
|
|
What are the criteria to select the teams for phase 2?
|
|
1
|
606
|
May 13, 2024
|