|
Does the evaluation support async await calls?
|
|
0
|
493
|
May 25, 2024
|
|
The openai interface cannot be used during evaluation? Why?
|
|
1
|
972
|
May 25, 2024
|
|
Inference failed without any useful message in debug-logs
|
|
8
|
969
|
May 24, 2024
|
|
Are LLama models of unsloth allowed？
|
|
0
|
603
|
May 24, 2024
|
|
Inference failed with vLLM Error: "Too large swap space"
|
|
2
|
5576
|
May 22, 2024
|
|
Failed inference
|
|
3
|
653
|
May 21, 2024
|
|
Couldn't instantiate the backend tokenizer
|
|
1
|
780
|
May 21, 2024
|
|
Data Quality Collection V2, Task-1
|
|
12
|
982
|
May 21, 2024
|
|
Evaluation succeeded but the results are not on the lead board
|
|
2
|
828
|
May 20, 2024
|
|
About Test Set Leakage in Round 1
|
|
3
|
1141
|
May 20, 2024
|
|
The evaluation was successful but is still in the submitted state
|
|
0
|
480
|
May 19, 2024
|
|
Inference failed without reporting logs, why is this?
|
|
0
|
382
|
May 18, 2024
|
|
Added tag with "submission-v" prefix but no evaluation issue created
|
|
7
|
720
|
May 18, 2024
|
|
Submissions not launched
|
|
0
|
329
|
May 17, 2024
|
|
Expect to return a message that stating whether it was a timeout problem
|
|
0
|
492
|
May 17, 2024
|
|
Is it allowed to have some modifications in local_evaluation.py?
|
|
3
|
403
|
May 17, 2024
|
|
Data Quality Collection V3 - Task1
|
|
0
|
386
|
May 17, 2024
|
|
Submission budget
|
|
0
|
492
|
May 17, 2024
|
|
Couldn't instantiate the backend tokenizer
|
|
0
|
297
|
May 17, 2024
|
|
Why am I not qualified for this round.
|
|
4
|
711
|
May 16, 2024
|
|
The node was low on resource: ephemeral-storage
|
|
3
|
1001
|
May 15, 2024
|
|
The error of have not qualified for this round
|
|
2
|
390
|
May 15, 2024
|
|
Why am I not eligible to participate?
|
|
10
|
1388
|
May 15, 2024
|
|
📢 Announcements: Phase 1 Extension, New Private Test Set, Batch Prediction Interface, and Updated Baselines
|
|
5
|
1706
|
May 15, 2024
|
|
Is it allowed to build Ollama docker to run different model?
|
|
1
|
654
|
May 15, 2024
|
|
CUDA out of memory issue
|
|
2
|
873
|
May 15, 2024
|
|
Do I need to set up my own openai key when uploading evaluations
|
|
5
|
714
|
May 14, 2024
|
|
How to use mock api in task #2 submission?
|
|
1
|
480
|
May 14, 2024
|
|
What does `split` field mean?
|
|
8
|
1481
|
May 13, 2024
|
|
What are the criteria to select the teams for phase 2?
|
|
1
|
637
|
May 13, 2024
|