Mixture-of-Experts Models1 / 4
Mixture-of-Experts Models
class TopKRouterComplete the starter code in the editor. Any correct approach is accepted.
import torch
import torch.nn as nn
import torch.nn.functional as F
class TopKRouter(nn.Module):
def __init__(self, d_model: int, n_experts: int, k: int):
raise NotImplementedError
def forward(self, x):
raise NotImplementedError⌘/Ctrl↵to submit
Submit your solution for a score and feedback on correctness, edge cases, and clarity. Any correct approach is accepted.
Mixture-of-Experts Models
class TopKRouterComplete the starter code in the editor. Any correct approach is accepted.