Pokemon map is broken?

Orak Game Agent Challenge
#1

It seems that after the recent evals update, the map is broken both in local and remote modes. Most of the cells are ‘?’. I think before the update, it wasn’t the case.

From the logs:
Map on Screen:\n( 2, 0): ?\t( 3, 0): ?\t( 4, 0): ?\t( 5, 0): ?\t( 6, 0): ?\t( 7, 0): ?\t\n( 2, 1): ?\t( 3, 1): ?\t( 4, 1): ?\t( 5, 1): ?\t( 6, 1): ?\t( 7, 1): ?\t\n( 2, 2): ?\t( 3, 2): ?\t( 4, 2): ?\t( 5, 2): ?\t( 6, 2): ?\t( 7, 2): ?\t\n( 2, 3): ?\t( 3, 3): ?\t( 4, 3): ?\t( 5, 3): ?\t( 6, 3): ?\t( 7, 3): ?\t\n( 2, 4): ?\t( 3, 4): ?\t( 4, 4): ?\t( 5, 4): OBJ_1_1\t( 6, 4): ?\t( 7, 4): ?\t\n( 2, 5): ?\t( 3, 5): ?\t( 4, 5): ?\t( 5, 5): ?\t( 6, 5): ?\t( 7, 5): ?\t\n( 2, 6): ?\t( 3, 6): ?\t( 4, 6): ?\t( 5, 6): ?\t( 6, 6): ?\t( 7, 6): ?

#2

@ilya_gusev is there a particular submission you are referring to that I can check?

We didn’t change anything specific to pokemon and wouldn’t expect this change. Maybe the game hasn’t started yet? The game ROM we received from Krafton team starts at the menu screen and the “Map on Screen” wouldn’t be defined for that screen.

Is there something I can cross check on the server logs or can you give the exact steps to replicate this issue so that we can pass this to Krafton team?

#3

This submission, for instance: AIcrowd | Orak Game Agent Challenge 2025 | Submissions #304644

The game clearly started, the menu and initial dialog were passed. The location is RedsHouse1f. From what I can see, one of the problems might be that in the “map_names.json” it is “RedsHouse1F”, not “RedsHouse1f” (with capital F).

The bigger problem in the code is the fact that “pokemon_tools.py” or “pokemon_tools_mcp.py” are not used anywhere at all. Including the “process_state_tool” function that is supposed to replace “?” when the tile is explored. Another side effect of that is that advanced tools (such as “move_to”) are not callable.

#4

The map names are simply passed into the path names, so it will not cause a problem when loading the map modules unless your system distinguishes between upper and lower case alphabets.
If there is a warning saying ‘[WARN] Map module not found: {path}’ anywhere in the logs, please let us know so we can update the json files regarding this case.

We are aware of the pokemon_tools calling issue and looking into it. Updates will be made asap.