I’ve noticed a few submissions on the LB with mean per-MLP compute utilization above 100%. I expected this to trigger the zero-prediction fallback for at least some MLPs, but all public MLPs have similar low final-layer MSEs for those submissions. The adjusted score also appears to use just the uncapped compute multiplier.
Is utilization above 100% intended to be allowed with a proportional score penalty, or should the zero-prediction fallback apply? Could the organizers or anyone please clarify this rule, or correct me if I’m mistaken?