Multimodal & Vision-Language Models2 / 3
Multimodal & Vision-Language Models
Implement a projection adapter and interleave imagetext embeddings into one sequence with correct attention masking.
class ProjectorImplement the function/class skeleton in the editor. Any correct approach is accepted.
import torch
import torch.nn as nn
class Projector(nn.Module):
def __init__(self, d_v, d_model):
raise NotImplementedError
def forward(self, x):
raise NotImplementedError
def interleave(text_embeds, text_mask, img_embeds, image_token_pos):
raise NotImplementedError⌘/Ctrl↵to submit
No review yet
Submit your solution for a verdict, a score out of 100 and concrete feedback. Any correct approach passes.
Multimodal & Vision-Language Models
Implement a projection adapter and interleave imagetext embeddings into one sequence with correct attention masking.
class ProjectorImplement the function/class skeleton in the editor. Any correct approach is accepted.