The openai interface cannot be used during evaluation? Why?
|
|
1
|
788
|
May 25, 2024
|
Inference failed without any useful message in debug-logs
|
|
8
|
820
|
May 24, 2024
|
Are LLama models of unsloth allowed?
|
|
0
|
452
|
May 24, 2024
|
Inference failed with vLLM Error: "Too large swap space"
|
|
2
|
3813
|
May 22, 2024
|
Failed inference
|
|
3
|
544
|
May 21, 2024
|
Couldn't instantiate the backend tokenizer
|
|
1
|
576
|
May 21, 2024
|
Data Quality Collection V2, Task-1
|
|
12
|
802
|
May 21, 2024
|
Evaluation succeeded but the results are not on the lead board
|
|
2
|
698
|
May 20, 2024
|
About Test Set Leakage in Round 1
|
|
3
|
892
|
May 20, 2024
|
The evaluation was successful but is still in the submitted state
|
|
0
|
386
|
May 19, 2024
|
Inference failed without reporting logs, why is this?
|
|
0
|
300
|
May 18, 2024
|
Added tag with "submission-v" prefix but no evaluation issue created
|
|
7
|
525
|
May 18, 2024
|
Submissions not launched
|
|
0
|
261
|
May 17, 2024
|
Expect to return a message that stating whether it was a timeout problem
|
|
0
|
376
|
May 17, 2024
|
Is it allowed to have some modifications in local_evaluation.py?
|
|
3
|
336
|
May 17, 2024
|
Data Quality Collection V3 - Task1
|
|
0
|
290
|
May 17, 2024
|
Submission budget
|
|
0
|
371
|
May 17, 2024
|
Couldn't instantiate the backend tokenizer
|
|
0
|
221
|
May 17, 2024
|
Why am I not qualified for this round.
|
|
4
|
572
|
May 16, 2024
|
The node was low on resource: ephemeral-storage
|
|
3
|
792
|
May 15, 2024
|
The error of have not qualified for this round
|
|
2
|
298
|
May 15, 2024
|
Why am I not eligible to participate?
|
|
10
|
1004
|
May 15, 2024
|
📢 Announcements: Phase 1 Extension, New Private Test Set, Batch Prediction Interface, and Updated Baselines
|
|
5
|
1375
|
May 15, 2024
|
Is it allowed to build Ollama docker to run different model?
|
|
1
|
506
|
May 15, 2024
|
CUDA out of memory issue
|
|
2
|
619
|
May 15, 2024
|
Do I need to set up my own openai key when uploading evaluations
|
|
5
|
570
|
May 14, 2024
|
How to use mock api in task #2 submission?
|
|
1
|
366
|
May 14, 2024
|
What does `split` field mean?
|
|
8
|
1194
|
May 13, 2024
|
What are the criteria to select the teams for phase 2?
|
|
1
|
506
|
May 13, 2024
|
Do I need to launch the Mock API server when submit to Task-2?
|
|
1
|
440
|
May 13, 2024
|