text-to-speech
Tencent open-sources AuK, a speech model you direct with written instructions News
Tencent released AuK under an MIT licence, a 1.5-billion-parameter speech model that handles voice cloning, audio editing, enhancement and source separation through a single plain-language instruction interface, shipping as a 6.8 GB download with a distilled four-step variant alongside it.
Neural text-to-speech: how a model turns writing into a voice Lesson
Neural text-to-speech converts written text into audio in three stages - working out the sounds, deciding how long each one lasts, and generating the actual waveform - and the last stage, the vocoder, is where most of the model's size and difficulty hides.
A complete text-to-speech system now fits in 9.4 million parameters News
Inflect-Micro-v2 packs an entire English speech synthesis stack, including the waveform decoder, into 9,356,513 parameters that run locally with no external vocoder or API.
speech-to-speech Tool
Hugging Face's modular local voice-agent pipeline - voice detection, speech recognition, a language model and text-to-speech chained together, with an OpenAI Realtime-compatible websocket so existing clients can point at it.
Inflect-Micro-v2 Tool
A complete English speech synthesis stack in 9,356,513 parameters, waveform decoder included, producing 24 kHz mono audio locally with no external vocoder or API. One fixed synthetic male voice, no cloning, flatter prosody than large systems - but it runs anywhere.
AuK Tool
Tencent's 1.5B open-weights speech model, MIT-licensed, that clones voices, edits recordings, cleans up audio and separates speakers through a single plain-language instruction interface. About 6.8 GB to download, with a four-step distilled variant for faster generation and a hosted demo to try first.