Transformer Architecture Internals4 / 7
Transformer Architecture Internals
build_rope_cache(seq, head_dim, base=10000.0, device='cpu')Implement the function/class skeleton in the editor. Any correct approach is accepted.
import torch
def build_rope_cache(seq, head_dim, base=10000.0, device='cpu'):
raise NotImplementedError
def rotate_half(x):
raise NotImplementedError
def apply_rope(x, cos, sin):
raise NotImplementedError⌘/Ctrl↵to submit
No review yet
Submit your solution for a verdict, a score out of 100 and concrete feedback. Any correct approach passes.
Transformer Architecture Internals
build_rope_cache(seq, head_dim, base=10000.0, device='cpu')Implement the function/class skeleton in the editor. Any correct approach is accepted.