Transformer Architecture Internals · Problem 2 of 7
Implement RMSNorm from scratch in PyTorch.
Implement the function/class skeleton in the editor. Any correct approach is accepted.
import torch
import torch.nn as nn
class RMSNorm(nn.Module):
def __init__(self, d, eps=1e-06):
raise NotImplementedError
def forward(self, x):
raise NotImplementedErrorReady when you are
Submit your solution and a structured review appears here — verdict, score, and concrete feedback. Any correct approach passes.
Implement RMSNorm from scratch in PyTorch.
Implement the function/class skeleton in the editor. Any correct approach is accepted.