Build a dataset-audit tool that flags duplicated prompts, suspicious templates, tool-call

Super-hard

Instruction Tuning & Efficient Fine-Tuning6 / 6

Chapter 116 / 6

Instruction Tuning & Efficient Fine-Tuning

Build a dataset-audit tool that flags duplicated prompts, suspicious templates, tool-call

Super-hard

Build a dataset-audit tool that flags duplicated prompts, suspicious templates, tool-call leakage, and evaluation-set contamination.

Target interface

_norm(t)

Complete the starter code in the editor. Any correct approach is accepted.

Hints0 / 2

Reference solution

Your own code stays in the editor.

solution.pyPython

Local draft

import hashlib, re
from collections import Counter

def _norm(t):
    raise NotImplementedError

def _hash(t):
    raise NotImplementedError

def audit(dataset, eval_prompts):
    raise NotImplementedError

Local draft

⌘/Ctrl↵to submit

AI review

Ready when you are

Submit your solution for a score and feedback on correctness, edge cases, and clarity. Any correct approach is accepted.

Chapter 116 / 6

Instruction Tuning & Efficient Fine-Tuning

Build a dataset-audit tool that flags duplicated prompts, suspicious templates, tool-call

Super-hard

Build a dataset-audit tool that flags duplicated prompts, suspicious templates, tool-call leakage, and evaluation-set contamination.

Target interface

_norm(t)

Complete the starter code in the editor. Any correct approach is accepted.

Hints0 / 2

Reference solution

Your own code stays in the editor.