data-quality
Everything on Ground Truth tagged “data-quality” — 2 items.
Benchmark contamination: when the test is already in the training data Lesson
Benchmark contamination is what happens when the questions used to evaluate a model were in the data used to train it, turning a test of reasoning into a test of memory and inflating scores in ways that are hard to detect after the fact.
GPTurk Tool
EPFL's released code for detecting language-model-assisted submissions in crowd work, combining keystroke logging with a synthetic-versus-real text classifier. Practical for anyone buying human-labeled data who needs to check whether the labels were actually written by people rather than pasted from a chatbot.