Tokenization and Embeddings2 / 4
Tokenization and Embeddings
get_pair_counts(words)Complete the starter code in the editor. Any correct approach is accepted.
from collections import Counter
def get_pair_counts(words):
raise NotImplementedError
def merge_pair(words, pair):
raise NotImplementedError
def train_bpe(corpus, num_merges):
raise NotImplementedError⌘/Ctrl↵to submit
Submit your solution for a score and feedback on correctness, edge cases, and clarity. Any correct approach is accepted.
Tokenization and Embeddings
get_pair_counts(words)Complete the starter code in the editor. Any correct approach is accepted.