Submissions stuck at "Compiling model for Neuron"

Global Chess Challenge 2025
,
#1

Issue
My submissions are getting stuck at “Compiling model for Neuron - Hold tight, this will just take a moment” for 1.5+ hours without completing.

Timeline

  • 2 days ago: Submissions worked fine.
  • Today: Multiple submissions stuck at Neuron compilation step

What Changed
I noticed AIcrowd added new Neuron documentation on Dec 18 with the --neuron.model-type flag. My earlier successful submissions didn’t use any Neuron flags.

What I’ve Tried

  1. Recent submissions with --neuron.model-type llama - stuck
  2. Submissions with --vllm.max-model-len 2048 - also stuck
  3. Submission WITHOUT neuron flags (testing if old approach still works) - stuck

Model Details

  • Model: Llama-based
  • Architecture: meta-llama/Llama-3.2-8B-Instruct base
  • Repo tag: main
  • Prompt template: Custom Jinja template (chess.jinja)

Questions :

  1. Did something change in the evaluation infrastructure around Dec 18?
  2. Should we use --neuron.model-type or avoid it?
  3. Are other participants experiencing similar Neuron compilation hangs?

Any guidance would be appreciated!