Z. Dogus Ozel’s Phase 2 algorithmic-contribution write-up. It corresponds to #337205 only.
- Score. 1.50329e-9 adjusted (final-layer MSE 1.262e-8 at a FLOP fraction of 0.119).
- Grader run. flopscope 0.12.3 grader, 0 failed MLPs, wall max 105.5 s, residual max 0.365 s.
- Nomination. Nominated for the private re-evaluation together with its parent #337177 (1.50288e-9). #337177 is 0.03% lower on the 50 public MLPs; #337205 is 0.098% better on 200 local MLPs (SE 0.029).
Write-up (PDF, 29 pages: main text 16 plus a one-page LLM-use section):
WhiteBox_Paper_v4.1_337205_2026-10-24.pdf (938.1 KB)
What it is. Layer-by-layer cumulant propagation through all 16 layers, with no sampling, built on ARC’s factorised K=3 method (Wu et al. 2026). Per layer the chain carries:
- the mean and the full covariance;
- the third cumulant as low-rank “hub/leg” sources, one born per layer;
- the fourth cumulant as one scalar plus per-neuron diagonals.
The ReLU step uses Hermite/Price pair terms and an Edgeworth mean.
What I claim, narrowly (each item is measured in the PDF)
- Sphere frame (C1).
- Positive homogeneity lets the chain run on a spherical input. The sphere’s fourth cumulant, −6/(n+2), is exactly representable in the chain’s own isotropic κ₄ form.
- The result is an exact radial Rao–Blackwellisation of every layer: 2 lines of code, 0 FLOPs, MSE ×0.967 with the corrector off.
- il.miscusi independently reported the spherical input on a lean chain (18248). Ours adds the exact κ₄ seed and the corrector-target rescaling.
- Age-structured factored κ₃ (C2). One hub/leg source per layer and exact (2,1)-slice extraction. Sources that reach age 7 are joined into one rank-256 basis by an exact, column-weighted truncated SVD.
- Zero-matmul closure diagrams (C3).
- These are folded into existing factors, so they need no extra matrix products.
- New in this version: excess-kurtosis rows of the (3,1) slice. The diagonal kurtosis the chain already carries enters κ₄(a,a,a,b) on the triple index.
- With a knob retune and a fitted counter-term (QB3), these give −0.30% (SE 0.07) against our previous named file on the real chain.
- Exact symmetry as a diagnostic (C7).
- We measure the Ward defect of our ReLU layer map against the exact scale symmetry. It sits in K₂₁ and grows with depth, but on the support the chain actually carries it is only 3.8%.
- None of the exact completions of the closure we screened passed its gate; most were worse, by ×1.05–×9.
- Our hypothesis, labelled as such: the tuned closure is calibrated against its own defect.
- Measured error anatomy of #337205 (C4). Measured against Monte-Carlo oracles with 8×10⁶ samples, noise-corrected. Each ratio is the final MSE when that object is made exact:
- 96–99% of the covariance residual is the scale mode, which the chain removes on purpose;
- an exact carried mean at layers 8–13 leaves ×0.39 of the final MSE;
- the non-scale covariance leaves ×0.59;
- an exact diagonal variance makes it worse (×1.06–1.15 per layer, ×1.30 for the whole state);
- the only directional lever left, the non-smooth part of the (3,1) slice, is reborn every layer, and no cheap carried state reproduces it.
Engineering, reported separately so it can be discounted
- Fast-matmul engine built from metered flopscope operations: Strassen–Winograd, the Karstadt–Schwartz basis and Smirnov ⟨3,3,6;40⟩. It gives ×0.50, with vs without (60/60 MLPs, measured on the previous named file).
- Wall guard with a residual-time rule.
- Learned additive mean corrector, refit end to end on-policy.
- Billing disclosure: the 0.12.3 truncated-SVD repricing and our own guard bug.
Negative results. The appendix condenses about 200 closed lines, among them:
- about 25 further (3,1) structures;
- exact-mode completions;
- κ₅/κ₆ at the readout (×1.005);
- DPST ⟨4,4,4;48⟩;
- hub retirement;
- four rounds of frontier-model proposals (QB3, derived from one of them, is the exception).
LLM use (also §10 of the PDF)
- Who did what. The author worked with Claude agents (Opus 5.5 coordinator, Fable 5.1 sub-agents). The agents wrote the code, ran the experiments and drafted the write-up under the author’s direction. The author set the direction, selected the ideas and approved every submission.
- LLM-originated ideas.
_XSH, QB3 and the C7 closed forms; §10 labels them. The sphere frame (C1) is the author’s idea; its derivation and first measurements came from a 09-25 design round led by a Fable agent. - Free-model swarm. Idea generation was also delegated, through opencode with all tools disabled, to a swarm of 13 free-tier OpenRouter/OpenCode-Zen models.
- It made 7,027 calls on 10-07…14.
- All but 569 stayed inside the providers’ free quotas. The 569 were paid DeepSeek-flash triage calls on 10-07, made until a small prepaid balance ran out.
- A guard process stopped the swarm if any session streamed from a model that was neither free nor on the allowlist of capped paid models. It never fired.
- Paid models. Used only in short, capped rounds: GPT-6, Gemini 4, Muse, Grok 4.7, Kimi K3, Qwen 3.8, DeepSeek V4, Claude Opus 5.5 (critic and synthesiser) and Claude Fable 5.1.
- Outcome, stated plainly. No idea from the free swarm survived code-level screening. About 40 frontier proposals were tested by 10-17, followed by four more rounds on 10-19/20; three proposals shipped in total.
- Validation. Every idea, derivation and number was validated by measurement. Explanations we did not derive ourselves are marked as interpretations.
On the cost question from the “Good game well played” thread
- Setup. This result came from the author working with Claude agents under one Claude Max subscription, plus a free-model swarm and a few capped paid rounds for idea generation.
- Out-of-pocket cost. Phase 2 (about one month) cost about USD 290:
- one month of Claude Max (20x), USD 200. It ran the Claude agents, and its included API credits covered the Anthropic API calls;
- about USD 90 of API usage, from the provider balances: OpenRouter USD 82, DeepSeek USD 8.
- My view. A cheap, tiered setup is enough for idea generation, as long as a measurement gate decides what survives: one coordinator writing briefs, free models generating and critiquing, and paid models used only for targeted questions.
Credits
- il.miscusi’s coherent scale-mode extraction (18248): adopted; the recipe is theirs.
- @Artyom_Mazur (Artyom Kuznetsov), young-κ₄ tree (18249): tested, not shipped.
- Nurlan’s (3,1) law (18252): motivated our row term.
- hyojun (18255): motivated two checks.
- 504aldo (18218) and LordProcciuto (e30_a): prior chains we compare against.
- ARC’s paper and code.
My repository is private. Every number in the PDF carries a source tag that maps to a file in it. It is available to ARC on request, and I will release it with the code if a prize requires it.
Thanks to ARC and AIcrowd for running the challenge.