Medium

Implement a cosine LR schedule with linear warmup as a callable

Optimization & Training Dynamics · Problem 2 of 5

Chapter 05Optimization & Training Dynamics

Implement a cosine LR schedule with linear warmup as a callable

MediumProblem 2 / 5

Implement a cosine LR schedule with linear warmup as a callable.

Implement the function/class skeleton in the editor. Any correct approach is accepted.

Hints