|
Has anyone else noticed that the 50 leaderboard MLPs are unusually easy / low-variance?
|
|
2
|
115
|
August 10, 2026
|
|
Phase 1 nomination interface and the Aug 17 write-up — where do they live?
|
|
1
|
308
|
August 10, 2026
|
|
Phase 1 submission #327268 — infrastructure watchdog after 85/100, request requeue
|
|
0
|
33
|
August 10, 2026
|
|
Rules clarification needed on compute budget exceedance
|
|
3
|
357
|
August 10, 2026
|
|
Phase 1 submission selection & Phase 2 Launch date
|
|
2
|
110
|
August 10, 2026
|
|
Request to extend the deadline of Phase 1
|
|
10
|
1086
|
August 9, 2026
|
|
Phase 1 update: flopscope v0.10.0, cost-model fixes, residual-time safeguards, and updated deadlines
|
|
8
|
1001
|
August 8, 2026
|
|
[flopscope 0.10.0] ALL of `flopscope.stats` silently promotes float32 to float64, doubling the bill downstream
|
|
1
|
404
|
August 7, 2026
|
|
[flopscope] budget_summary_dict() cost grows with process history — silently inflates residual and can cost the 0.1 multiplier floor
|
|
1
|
546
|
August 7, 2026
|
|
Recommendation: restoring the estimation framing (neutralizing the wall-time compute channel)
|
|
1
|
594
|
August 7, 2026
|
|
Potential flopscope accounting bypass bug
|
|
3
|
914
|
August 7, 2026
|
|
How exactly is phase 1 submission validation going to work?
|
|
1
|
261
|
August 7, 2026
|
|
A bet on a floor, filed before the reveal
|
|
4
|
823
|
August 7, 2026
|
|
Will the private re-evaluation verify instrumented share?
|
|
1
|
376
|
August 5, 2026
|
|
Grading queue backlog since the v0.10.0 rollout
|
|
2
|
274
|
August 4, 2026
|
|
Phase 1 write-up: Stabilizing cumulant propagation at depth 32 — a trajectory-calibrated moment chain, with an error budget (submission #314695)
|
|
1
|
1118
|
August 4, 2026
|
|
Rules clarification: are operations on the NumPy-backed arrays reachable through flopscope.numpy inside the intended accounting boundary?
|
|
5
|
632
|
August 3, 2026
|
|
Phase 1 final evaluation question: Overfitting to public instances
|
|
3
|
662
|
August 3, 2026
|
|
Urgent: submission limit is rolling 24h, not the published UTC-day reset
|
|
1
|
313
|
July 31, 2026
|
|
Phase I Submission: Structure-Aware Estimation for Random ReLU MLPs
|
|
0
|
847
|
July 27, 2026
|
|
Smoke wall time limit is different from evaluation limit?
|
|
0
|
304
|
July 26, 2026
|
|
Cost-model question: releasing temporaries of counted ops is charged to residual — and a request to expose out= on fnp.matmul
|
|
0
|
440
|
July 26, 2026
|
|
There is a bug in flopscope.numpy.linalg.solve that undercounts batched right-hand sides
|
|
5
|
836
|
July 25, 2026
|
|
Submissions score 50/50 with 0 failures but flagged "Evaluation could not complete"
|
|
1
|
440
|
July 23, 2026
|
|
[whest run] Residual Wall Time in the budget-breakdown panel reads ~39,807 s under --runner subprocess
|
|
0
|
389
|
July 23, 2026
|
|
Phase 1 write-up: A variance/bias budget for deep white-box mean estimation (submission 317660)
|
|
0
|
1219
|
July 21, 2026
|
|
Flopscope v0.8.0 Release Candidate Available!
|
|
12
|
1959
|
July 20, 2026
|
|
📹 Townhall Summary & Recording
|
|
0
|
1044
|
July 17, 2026
|
|
[flopscope] Bug report: empty contractions receive negative FLOP charges (budget increases)
|
|
1
|
545
|
July 17, 2026
|
|
Live Q&A with ARC Organisers | Join the Townhall on July 6
|
|
3
|
903
|
July 16, 2026
|