Tokenization & Embeddings2 / 4
Tokenization & Embeddings
get_pair_counts(words)Implement the function/class skeleton in the editor. Any correct approach is accepted.
from collections import Counter
def get_pair_counts(words):
raise NotImplementedError
def merge_pair(words, pair):
raise NotImplementedError
def train_bpe(corpus, num_merges):
raise NotImplementedError⌘/Ctrl↵to submit
No review yet
Submit your solution for a verdict, a score out of 100 and concrete feedback. Any correct approach passes.
Tokenization & Embeddings
get_pair_counts(words)Implement the function/class skeleton in the editor. Any correct approach is accepted.