Hello everyone,
The challenge deadline has been extended to February 8 (to accommodate recent server downtime). Please make your final submissions by then, and start preparing your final evaluation package now. Each team may submit one final submission per track, and the final agent must be runnable with the Orak framework and compatible with 4 games.
Please ensure all eligible entries are submitted with a complete final submission package. All previously shared requirements still apply, including:
- Model artifacts and documentation
- Runnable agent code
- A 2-page design and training PDF
- Reproducibility artifacts
- Evaluation summaries plus required metadata
Please refer to the full list over here.
How to share your artifacts
Models:
Models must be shared as gated Hugging Face repositories and you must grant access to:
- AIcrowd HF account: aicrowd (AIcrowd SA)
- Krafton evaluation HF user: orak-krafton-eval (Howon Lee)
Gated model setup instructions:
Code:
The remaining code should be shared via a private repository on https://gitlab.aicrowd.com, with appropriate access provided for the organisers. Please grant GitLab access to: @aicrowd (AIcrowd · GitLab) & @orak-krafton-eval (orak-krafton-eval · GitLab)
Track 1 model size clarification
As clarified before, 8B models are allowed even if the actual parameter count slightly exceeds 8B (for example, Llama-3.1-8B). If you use multiple models that share identical base weights, the shared base weights should be counted once, and any adapter or LoRA parameters should be counted separately.
All the best,
Team AIcrowd