Need to Update Content Information

Orak Game Agent Challenge
#1

There are some inconsistencies in the official info for the Orak Game Agent Challenge 2025, and I thought it might be causing confusion for others too.

Here’s what I’ve found:

  1. SLM Size Update
  • The SLM size has been updated to below 10B, but the overview page still says 8B.
  • Overview Page: Orak Game Agent Challenge 2025
  • Rule Page: Challenge Rules
  1. SF3 Removal
  • SF3 has been removed from the competition, but the rule page still mentions it.
  1. Pokémon Evaluation Criteria
  • The overview page says the evaluation is based on the Orak benchmark (12 flag points), but the starter kit’s README mentions only 7 flag points.
  • Starter Kit README: Pokémon Evaluation

These discrepancies are a bit frustrating and could lead to misunderstandings.
It’d be great if the contest owner could align these details to keep things clear for everyone.

2 Likes
#2

Hi @RickySong,

Details on the parameter limits are explained here: https://discourse.aicrowd.com/t/clarification-on-track-1-8b-parameter-limit/17615

Also, the update about excluding Street Fighter has already been shared on the challenge page, the community forum, and in the email newsletter, so participants don’t carry any confusion.

Hope this clears it up.