Optimization and Training Dynamics1 / 5
Optimization and Training Dynamics
class AdamWComplete the starter code in the editor. Any correct approach is accepted.
import numpy as np
class AdamW:
def __init__(self, shape, lr=0.001, betas=(0.9, 0.999), eps=1e-08, weight_decay=0.01):
raise NotImplementedError
def step(self, theta, grad):
raise NotImplementedError⌘/Ctrl↵to submit
Submit your solution for a score and feedback on correctness, edge cases, and clarity. Any correct approach is accepted.
Optimization and Training Dynamics
class AdamWComplete the starter code in the editor. Any correct approach is accepted.