|
Has anyone else noticed that the 50 leaderboard MLPs are unusually easy / low-variance?
|
|
4
|
131
|
August 10, 2026
|
|
Phase 1 update: flopscope v0.10.0, cost-model fixes, residual-time safeguards, and updated deadlines
|
|
9
|
1016
|
August 10, 2026
|
|
[whest run] Residual Wall Time in the budget-breakdown panel reads ~39,807 s under --runner subprocess
|
|
1
|
394
|
August 10, 2026
|
|
Cost-model question: releasing temporaries of counted ops is charged to residual — and a request to expose out= on fnp.matmul
|
|
1
|
446
|
August 10, 2026
|
|
Smoke wall time limit is different from evaluation limit?
|
|
1
|
307
|
August 10, 2026
|
|
Phase 1 nomination interface and the Aug 17 write-up — where do they live?
|
|
1
|
315
|
August 10, 2026
|
|
Phase 1 submission #327268 — infrastructure watchdog after 85/100, request requeue
|
|
0
|
39
|
August 10, 2026
|
|
Rules clarification needed on compute budget exceedance
|
|
3
|
361
|
August 10, 2026
|
|
Phase 1 submission selection & Phase 2 Launch date
|
|
2
|
121
|
August 10, 2026
|
|
Request to extend the deadline of Phase 1
|
|
10
|
1090
|
August 9, 2026
|
|
[flopscope 0.10.0] ALL of `flopscope.stats` silently promotes float32 to float64, doubling the bill downstream
|
|
1
|
406
|
August 7, 2026
|
|
[flopscope] budget_summary_dict() cost grows with process history — silently inflates residual and can cost the 0.1 multiplier floor
|
|
1
|
546
|
August 7, 2026
|
|
Recommendation: restoring the estimation framing (neutralizing the wall-time compute channel)
|
|
1
|
596
|
August 7, 2026
|
|
Potential flopscope accounting bypass bug
|
|
3
|
916
|
August 7, 2026
|
|
How exactly is phase 1 submission validation going to work?
|
|
1
|
267
|
August 7, 2026
|
|
A bet on a floor, filed before the reveal
|
|
4
|
827
|
August 7, 2026
|
|
Will the private re-evaluation verify instrumented share?
|
|
1
|
377
|
August 5, 2026
|
|
Grading queue backlog since the v0.10.0 rollout
|
|
2
|
276
|
August 4, 2026
|
|
Phase 1 write-up: Stabilizing cumulant propagation at depth 32 — a trajectory-calibrated moment chain, with an error budget (submission #314695)
|
|
1
|
1120
|
August 4, 2026
|
|
Rules clarification: are operations on the NumPy-backed arrays reachable through flopscope.numpy inside the intended accounting boundary?
|
|
5
|
636
|
August 3, 2026
|
|
Phase 1 final evaluation question: Overfitting to public instances
|
|
3
|
668
|
August 3, 2026
|
|
Urgent: submission limit is rolling 24h, not the published UTC-day reset
|
|
1
|
313
|
July 31, 2026
|
|
Phase I Submission: Structure-Aware Estimation for Random ReLU MLPs
|
|
0
|
850
|
July 27, 2026
|
|
There is a bug in flopscope.numpy.linalg.solve that undercounts batched right-hand sides
|
|
5
|
837
|
July 25, 2026
|
|
Submissions score 50/50 with 0 failures but flagged "Evaluation could not complete"
|
|
1
|
441
|
July 23, 2026
|
|
Phase 1 write-up: A variance/bias budget for deep white-box mean estimation (submission 317660)
|
|
0
|
1223
|
July 21, 2026
|
|
Flopscope v0.8.0 Release Candidate Available!
|
|
12
|
1959
|
July 20, 2026
|
|
📹 Townhall Summary & Recording
|
|
0
|
1047
|
July 17, 2026
|
|
[flopscope] Bug report: empty contractions receive negative FLOP charges (budget increases)
|
|
1
|
546
|
July 17, 2026
|
|
Live Q&A with ARC Organisers | Join the Townhall on July 6
|
|
3
|
905
|
July 16, 2026
|