Implement an IsoFLOP analysis: from loss curves at several fixed-FLOP budgets, extract the

Pretraining Objectives & Scaling Laws4 / 4

Chapter 054 / 4

Pretraining Objectives & Scaling Laws

Implement an IsoFLOP analysis: from loss curves at several fixed-FLOP budgets, extract the

Super-hard

Implement an IsoFLOP analysis: from loss curves at several fixed-FLOP budgets, extract the compute-optimal frontier and fit N(C)N^{\star}(C), D(C)D^{\star}(C).

Target interface
synth_isoflop(C, Ns, coeffs=(1.69, 406.4, 410.7, 0.34, 0.28), noise=0.0, rng=None)

Implement the function/class skeleton in the editor. Any correct approach is accepted.

Hints0 / 2
Reference solution
Your own code stays in the editor.