The openai interface cannot be used during evaluation? Why?
|
|
1
|
737
|
May 25, 2024
|
Inference failed without any useful message in debug-logs
|
|
8
|
744
|
May 24, 2024
|
Are LLama models of unsloth allowed?
|
|
0
|
399
|
May 24, 2024
|
Inference failed with vLLM Error: "Too large swap space"
|
|
2
|
3097
|
May 22, 2024
|
Failed inference
|
|
3
|
505
|
May 21, 2024
|
Couldn't instantiate the backend tokenizer
|
|
1
|
524
|
May 21, 2024
|
Data Quality Collection V2, Task-1
|
|
12
|
737
|
May 21, 2024
|
Evaluation succeeded but the results are not on the lead board
|
|
2
|
654
|
May 20, 2024
|
About Test Set Leakage in Round 1
|
|
3
|
805
|
May 20, 2024
|
The evaluation was successful but is still in the submitted state
|
|
0
|
350
|
May 19, 2024
|
Inference failed without reporting logs, why is this?
|
|
0
|
271
|
May 18, 2024
|
Added tag with "submission-v" prefix but no evaluation issue created
|
|
7
|
476
|
May 18, 2024
|
Submissions not launched
|
|
0
|
233
|
May 17, 2024
|
Expect to return a message that stating whether it was a timeout problem
|
|
0
|
335
|
May 17, 2024
|
Is it allowed to have some modifications in local_evaluation.py?
|
|
3
|
298
|
May 17, 2024
|
Data Quality Collection V3 - Task1
|
|
0
|
255
|
May 17, 2024
|
Submission budget
|
|
0
|
338
|
May 17, 2024
|
Couldn't instantiate the backend tokenizer
|
|
0
|
194
|
May 17, 2024
|
Why am I not qualified for this round.
|
|
4
|
508
|
May 16, 2024
|
The node was low on resource: ephemeral-storage
|
|
3
|
720
|
May 15, 2024
|
The error of have not qualified for this round
|
|
2
|
266
|
May 15, 2024
|
Why am I not eligible to participate?
|
|
10
|
893
|
May 15, 2024
|
📢 Announcements: Phase 1 Extension, New Private Test Set, Batch Prediction Interface, and Updated Baselines
|
|
5
|
1266
|
May 15, 2024
|
Is it allowed to build Ollama docker to run different model?
|
|
1
|
464
|
May 15, 2024
|
CUDA out of memory issue
|
|
2
|
571
|
May 15, 2024
|
Do I need to set up my own openai key when uploading evaluations
|
|
5
|
521
|
May 14, 2024
|
How to use mock api in task #2 submission?
|
|
1
|
336
|
May 14, 2024
|
What does `split` field mean?
|
|
8
|
1103
|
May 13, 2024
|
What are the criteria to select the teams for phase 2?
|
|
1
|
451
|
May 13, 2024
|
Do I need to launch the Mock API server when submit to Task-2?
|
|
1
|
395
|
May 13, 2024
|