Implement a cosine LR schedule with linear warmup as a callable

Medium

Optimization & Training Dynamics2 / 5

Chapter 072 / 5

Optimization & Training Dynamics

Implement a cosine LR schedule with linear warmup as a callable

Medium

Target interface

cosine_with_warmup(peak_lr, warmup_steps, total_steps, min_lr=0.0)

Implement the function/class skeleton in the editor. Any correct approach is accepted.

Hints0 / 2

Reference solution

Your own code stays in the editor.

solution.pyPython

Local draft

import math

def cosine_with_warmup(peak_lr, warmup_steps, total_steps, min_lr=0.0):
    raise NotImplementedError

⌘/Ctrl↵to submit

AI review

No review yet

Submit your solution for a verdict, a score out of 100 and concrete feedback. Any correct approach passes.

Chapter 072 / 5

Optimization & Training Dynamics

Implement a cosine LR schedule with linear warmup as a callable

Medium

Target interface

cosine_with_warmup(peak_lr, warmup_steps, total_steps, min_lr=0.0)

Implement the function/class skeleton in the editor. Any correct approach is accepted.

Hints0 / 2

Reference solution

Your own code stays in the editor.