There are some inconsistencies in the official info for the Orak Game Agent Challenge 2025, and I thought it might be causing confusion for others too.
Here’s what I’ve found:
- SLM Size Update
- The SLM size has been updated to below 10B, but the overview page still says 8B.
- Overview Page: Orak Game Agent Challenge 2025
- Rule Page: Challenge Rules
- SF3 Removal
- SF3 has been removed from the competition, but the rule page still mentions it.
- Pokémon Evaluation Criteria
- The overview page says the evaluation is based on the Orak benchmark (12 flag points), but the starter kit’s README mentions only 7 flag points.
- Starter Kit README: Pokémon Evaluation
These discrepancies are a bit frustrating and could lead to misunderstandings.
It’d be great if the contest owner could align these details to keep things clear for everyone.