| 
            
            
            
            
              Is it allowed to have some modifications in local_evaluation.py?
            
            
           | 
          
              
                 
              
              
                 
              
              
                 
              
           | 
          
            3
           | 
          
            355
           | 
          
            May 17, 2024
           | 
        
        
          | 
            
            
            
            
              Data Quality Collection V3 - Task1
            
            
           | 
          
              
                 
              
           | 
          
            0
           | 
          
            310
           | 
          
            May 17, 2024
           | 
        
        
          | 
            
            
            
            
              Submission budget
            
            
           | 
          
              
                 
              
           | 
          
            0
           | 
          
            426
           | 
          
            May 17, 2024
           | 
        
        
          | 
            
            
              
            
            
              Couldn't instantiate the backend tokenizer
            
            
           | 
          
              
                 
              
           | 
          
            0
           | 
          
            242
           | 
          
            May 17, 2024
           | 
        
        
          | 
            
            
            
            
              Submission issues
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            2
           | 
          
            340
           | 
          
            May 17, 2024
           | 
        
        
          | 
            
            
            
            
              Need help for evaluation timeout
            
            
           | 
          
              
                 
              
           | 
          
            1
           | 
          
            318
           | 
          
            May 16, 2024
           | 
        
        
          | 
            
            
            
            
              Why am I not qualified for this round.
            
            
           | 
          
              
                 
              
              
                 
              
              
                 
              
           | 
          
            4
           | 
          
            609
           | 
          
            May 16, 2024
           | 
        
        
          | 
            
            
            
            
              A few questions regarding my Docker image construction
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            3
           | 
          
            747
           | 
          
            May 15, 2024
           | 
        
        
          | 
            
            
            
            
              What is the GPU driver version on AWS g5.2xlarge node for GPU track?
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            1
           | 
          
            1081
           | 
          
            May 15, 2024
           | 
        
        
          | 
            
            
              
            
            
              The node was low on resource: ephemeral-storage
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            3
           | 
          
            858
           | 
          
            May 15, 2024
           | 
        
        
          | 
            
            
            
            
              The error of have not qualified for this round
            
            
           | 
          
              
                 
              
           | 
          
            2
           | 
          
            323
           | 
          
            May 15, 2024
           | 
        
        
          | 
            
            
              
            
            
              I am trying to use flash-attn, but it is encounter problem in docker run pip install
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            1
           | 
          
            2353
           | 
          
            May 15, 2024
           | 
        
        
          | 
            
            
            
            
              I am trying to use flash-attn, but it is hard to install through requirements, how to use --no-build-isolation in requirements.txt?
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            3
           | 
          
            21096
           | 
          
            April 25, 2024
           | 
        
        
          | 
            
            
            
            
              Why am I not eligible to participate?
            
            
           | 
          
              
                 
              
              
                 
              
              
                 
              
              
                 
              
              
                 
              
           | 
          
            10
           | 
          
            1102
           | 
          
            May 15, 2024
           | 
        
        
          | 
            
            
            
            
              📢 Announcements: Phase 1 Extension, New Private Test Set, Batch Prediction Interface, and Updated Baselines
            
            
           | 
          
              
                 
              
              
                 
              
              
                 
              
           | 
          
            5
           | 
          
            1478
           | 
          
            May 15, 2024
           | 
        
        
          | 
            
            
            
            
              Is it allowed to build Ollama docker to run different model?
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            1
           | 
          
            561
           | 
          
            May 15, 2024
           | 
        
        
          | 
            
            
            
            
              Any help for Malformed JSON provided in aicrowd.json error?
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            2
           | 
          
            302
           | 
          
            May 15, 2024
           | 
        
        
          | 
            
            
              
            
            
              How to download for huggingface LLM pretrained model
            
            
           | 
          
              
                 
              
              
                 
              
              
                 
              
           | 
          
            5
           | 
          
            1111
           | 
          
            May 15, 2024
           | 
        
        
          | 
            
            
            
            
              CUDA out of memory issue
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            2
           | 
          
            718
           | 
          
            May 15, 2024
           | 
        
        
          | 
            
            
              
            
            
              Do I need to set up my own openai key when uploading evaluations
            
            
           | 
          
              
                 
              
              
                 
              
              
                 
              
              
                 
              
           | 
          
            5
           | 
          
            600
           | 
          
            May 14, 2024
           | 
        
        
          | 
            
            
            
            
              CS233-2024-FashionMNIST
            
            
           | 
          
              
                 
              
           | 
          
            0
           | 
          
            506
           | 
          
            May 14, 2024
           | 
        
        
          | 
            
            
            
            
              How to use mock api in task #2 submission?
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            1
           | 
          
            388
           | 
          
            May 14, 2024
           | 
        
        
          | 
            
            
            
            
              What does `split` field mean?
            
            
           | 
          
              
                 
              
              
                 
              
              
                 
              
              
                 
              
              
                 
              
           | 
          
            8
           | 
          
            1267
           | 
          
            May 13, 2024
           | 
        
        
          | 
            
            
            
            
              What are the criteria to select the teams for phase 2?
            
            
           | 
          
              
                 
              
           | 
          
            1
           | 
          
            552
           | 
          
            May 13, 2024
           | 
        
        
          | 
            
            
            
            
              Do I need to launch the Mock API server when submit to Task-2?
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            1
           | 
          
            480
           | 
          
            May 13, 2024
           | 
        
        
          | 
            
            
            
            
              Bug in mockapi
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            1
           | 
          
            718
           | 
          
            May 13, 2024
           | 
        
        
          | 
            
            
            
            
              Docker run error
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            1
           | 
          
            315
           | 
          
            May 13, 2024
           | 
        
        
          | 
            
            
              
            
            
              Why did I get an evaluation failure even after evaluation stage successfully done?
            
            
           | 
          
              
                 
              
           | 
          
            0
           | 
          
            316
           | 
          
            May 12, 2024
           | 
        
        
          | 
            
            
            
            
              Why did my submission fail?
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            3
           | 
          
            475
           | 
          
            May 11, 2024
           | 
        
        
          | 
            
            
            
            
              Regarding to maxiumn number tokens of response for llama 3
            
            
           | 
          
              
                 
              
              
                 
              
              
                 
              
           | 
          
            3
           | 
          
            5133
           | 
          
            May 11, 2024
           |