Implement AdamW from scratch in numpy for one parameter tensor

Optimization & Training Dynamics1 / 5

Chapter 071 / 5

Optimization & Training Dynamics

Implement AdamW from scratch in numpy for one parameter tensor

Easy
Target interface
class AdamW

Implement the function/class skeleton in the editor. Any correct approach is accepted.

Hints0 / 2
Reference solution
Your own code stays in the editor.