| 
            
            
            
            
              Submission Budget
            
            
           | 
          
              
                 
              
           | 
          
            0
           | 
          
            530
           | 
          
            May 10, 2024
           | 
        
        
          | 
            
            
            
            
              Our submission to track 1 is Frozen
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            4
           | 
          
            1088
           | 
          
            May 10, 2024
           | 
        
        
          | 
            
            
            
            
              Import Error In Log, but Actually Installed Successfully in Log, and run successfully in local testing
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            1
           | 
          
            1362
           | 
          
            May 10, 2024
           | 
        
        
          | 
            
            
            
            
              Can we use non-commercial models?
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            1
           | 
          
            344
           | 
          
            May 10, 2024
           | 
        
        
          | 
            
            
            
            
              Failed submission (failed to download aicrowd_gym)
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            1
           | 
          
            558
           | 
          
            May 9, 2024
           | 
        
        
          | 
            
            
            
            
              I do not see issues getting created
            
            
           | 
          
              
                 
              
              
                 
              
              
                 
              
           | 
          
            4
           | 
          
            429
           | 
          
            May 9, 2024
           | 
        
        
          | 
            
            
            
            
              Is there a problem parsing web pages in the dataset?
            
            
           | 
          
              
                 
              
           | 
          
            0
           | 
          
            305
           | 
          
            May 9, 2024
           | 
        
        
          | 
            
            
            
            
              Confused about the failure
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            4
           | 
          
            407
           | 
          
            May 9, 2024
           | 
        
        
          | 
            
            
            
            
              Can vLLM be supported?
            
            
           | 
          
              
                 
              
              
                 
              
              
                 
              
           | 
          
            2
           | 
          
            516
           | 
          
            May 9, 2024
           | 
        
        
          | 
            
            
              
            
            
              Evaluation succeeded but can't find the submission score
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            2
           | 
          
            478
           | 
          
            May 9, 2024
           | 
        
        
          | 
            
            
            
            
              No submission slots remaining even though there is
            
            
           | 
          
              
                 
              
           | 
          
            0
           | 
          
            323
           | 
          
            May 8, 2024
           | 
        
        
          | 
            
            
            
            
              Is ChatGPT allowed for processing my model?
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            1
           | 
          
            275
           | 
          
            May 8, 2024
           | 
        
        
          | 
            
            
            
            
              How can I delete my LFS?
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            2
           | 
          
            667
           | 
          
            May 8, 2024
           | 
        
        
          | 
            
            
              
            
            
              Failed during evaluation
            
            
           | 
          
              
                 
              
              
                 
              
              
                 
              
              
                 
              
           | 
          
            4
           | 
          
            617
           | 
          
            May 8, 2024
           | 
        
        
          | 
            
            
            
            
              Usage of GGUF and finetuned LLaMA Models
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            1
           | 
          
            1804
           | 
          
            May 7, 2024
           | 
        
        
          | 
            
            
            
            
              When will the submission limit be reset?
            
            
           | 
          
              
                 
              
              
                 
              
              
                 
              
           | 
          
            3
           | 
          
            574
           | 
          
            May 8, 2024
           | 
        
        
          | 
            
            
            
            
              Requirements for submitting project architecture
            
            
           | 
          
              
                 
              
           | 
          
            0
           | 
          
            308
           | 
          
            May 7, 2024
           | 
        
        
          | 
            
            
              
            
            
              Unable to use Flash attention 1
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            1
           | 
          
            651
           | 
          
            May 7, 2024
           | 
        
        
          | 
            
            
              
            
            
              The team's challenge has team-freeze in effect
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            3
           | 
          
            508
           | 
          
            May 7, 2024
           | 
        
        
          | 
            
            
            
            
              Writing the Model
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            1
           | 
          
            343
           | 
          
            May 7, 2024
           | 
        
        
          | 
            
            
            
            
              Is anyone using Colab for this competition?
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            1
           | 
          
            530
           | 
          
            May 7, 2024
           | 
        
        
          | 
            
            
              
            
            
              Can we use huggingface to upload our model weight?
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            1
           | 
          
            787
           | 
          
            May 7, 2024
           | 
        
        
          | 
            
            
            
            
              Is there possible bug in using gpt4 as the metric mechanism?
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            2
           | 
          
            526
           | 
          
            May 7, 2024
           | 
        
        
          | 
            
            
            
            
              Error generating predictions
            
            
           | 
          
              
                 
              
           | 
          
            0
           | 
          
            622
           | 
          
            May 6, 2024
           | 
        
        
          | 
            
            
            
            
              Second round?
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            1
           | 
          
            784
           | 
          
            May 6, 2024
           | 
        
        
          | 
            
            
            
            
              I wonder if predictive timeouts are common
            
            
           | 
          
              
                 
              
              
                 
              
              
                 
              
           | 
          
            8
           | 
          
            1024
           | 
          
            April 2, 2024
           | 
        
        
          | 
            
            
            
            
              Where are the JSON FIles for the challenges?
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            1
           | 
          
            298
           | 
          
            May 6, 2024
           | 
        
        
          | 
            
            
            
            
              Can mock api cover all types of questions as in formal evaluation environment?
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            1
           | 
          
            332
           | 
          
            May 6, 2024
           | 
        
        
          | 
            
            
            
            
              Model’s input
            
            
           | 
          
              
                 
              
              
                 
              
           | 
          
            1
           | 
          
            449
           | 
          
            May 6, 2024
           | 
        
        
          | 
            
            
            
            
              Can we have multi GPU submission example?
            
            
           | 
          
              
                 
              
           | 
          
            0
           | 
          
            366
           | 
          
            May 5, 2024
           |