training-data
Stack Overflow took 1,490 questions in July News
Stack Overflow received 1,490 new questions in July 2026, down from 6,414 in July 2025 and 176,610 in July 2014 -- a 118-fold collapse in the public programming corpus that trained today's coding models.
A Munich Court Found Suno's Models Memorised Six Songs News
The Regional Court of Munich I largely granted GEMA's claims against Suno, holding that six well-known works were reproducibly stored in Suno's models and could be extracted through simple prompts, and assigning responsibility to Suno rather than its users.
Data poisoning and backdoors: attacking a model through what it eats Lesson
Data poisoning is an attack that corrupts a model by tampering with its training data rather than its code, and a backdoor is the sharpest form: a model that behaves perfectly until it sees a secret trigger. Anthropic and the UK AI Safety Institute found in 2025 that just 250 poisoned documents compromised models from 600 million to 13 billion parameters alike, which means scale does not dilute the threat.
Google loses its DMCA claim against a search scraper News
A federal judge dismissed both of Google's copyright anti-circumvention claims against SerpApi, ruling that a general anti-bot wall around non-copyrightable search results cannot be treated as a copyright access control.
Leaked Suno code names YouTube, Deezer, Genius and podcast RSS feeds as collection sources News
A hack of AI music generator Suno exposed source-code files and comments naming YouTube Music, Deezer, Genius, stock libraries and podcast RSS feeds as data collection targets, the most specific provenance evidence yet in the music industry's copyright fight.
Training data deduplication: why the same text twice makes a model worse Lesson
Deduplication is the process of finding and removing repeated or near-repeated documents from a training corpus, and it reliably makes language models better, cheaper, and safer - the same text seen many times gets memorised rather than learned from.
Hugging Face ships The Stack v3, and this time the code is actually in the box News
Hugging Face released The Stack v3, a code dataset of roughly 4.9 trillion tokens across 173 million repositories with source text embedded inline, ending the v2 arrangement where researchers had to fetch the actual file contents themselves.
This model's job is to make better training data for other models News
DataClaw0 turns the grind of cleaning and labeling training data into a learned skill -- a small model that refines raw, messy multimodal streams into dense, purpose-built lessons.
Synthetic Data: When AI Makes Its Own Training Material Lesson
The internet is running out of fresh text to train on, so the most advanced models increasingly learn from data that other AI made or shaped. Here is how that works, why it helps, and how it can quietly poison a model.
An open project publishes the recipe for training capable AI agents News
OpenThoughts-Agent releases its full data-curation pipeline, dataset, and experiments -- showing that what an agent learns from matters more than raw size, and letting anyone reproduce it.
The Stack v3 Tool
Hugging Face's code corpus, now with source text embedded inline rather than behind identifiers. A 15.9 TB deduplicated, PII-redacted training split of roughly 4.9 trillion tokens, plus a 113.7 TB unfiltered bucket for teams that want to build their own mix.