Chapter 054 / 4
Pretraining Objectives & Scaling Laws
Implement an IsoFLOP analysis: from loss curves at several fixed-FLOP budgets, extract the
Super-hard
Implement an IsoFLOP analysis: from loss curves at several fixed-FLOP budgets, extract the compute-optimal frontier and fit , .
Target interface
synth_isoflop(C, Ns, coeffs=(1.69, 406.4, 410.7, 0.34, 0.28), noise=0.0, rng=None)Implement the function/class skeleton in the editor. Any correct approach is accepted.
Hints0 / 2
Reference solution
Your own code stays in the editor.