audio
MiniMax put its video-with-sound model on Hugging Face News
MiniMax released the weights for H3, a multimodal generation model that produces video with native stereo audio, two weeks after promising them at launch, and it has already been downloaded more than two million times.
Full-Duplex Speech Models: Listening and Talking at the Same Time Lesson
A full-duplex speech model processes incoming audio while it is generating outgoing audio, which removes the turn detector that decides when you have stopped speaking and makes interruption, backchannels, and overlap possible.
Vector Quantization: Turning Continuous Data Into a Vocabulary Lesson
Vector quantization forces a neural network's continuous internal representations to snap to a finite set of learned reference vectors, converting images, audio, or video into sequences of discrete symbols that a language model can predict just like words.
Neural text-to-speech: how a model turns writing into a voice Lesson
Neural text-to-speech converts written text into audio in three stages - working out the sounds, deciding how long each one lasts, and generating the actual waveform - and the last stage, the vocoder, is where most of the model's size and difficulty hides.
How AI Turns Speech Into Text Lesson
Automatic speech recognition (ASR) converts spoken audio into written text by breaking sound into tiny slices, encoding them into features a model understands, and decoding those into words -- and its accuracy is measured by word error rate, the fraction of words it gets wrong.
MiniMax-H3 Tool
Open weights for MiniMax's omni-modal model that generates four to fifteen second video with native stereo audio. The locally deployable base runs at 768p through diffusers or SGLang; the prompt-interpretation and 2K regeneration stages stay behind MiniMax's API, and the licence excludes the US, EU, UK, and South Korea.
MiniMax Music 3.0 Tool
Production music model that takes a creative concept and optional lyrics and composes, arranges, performs and produces a complete song in a single generation, with instrumental-only support. Callable through MiniMax's platform API as model music-3.0, with open weights also published.
MiniMax Music 3 Tool
Open-weight model that generates complete five-minute songs with vocals in 32 kHz stereo from lyrics plus a structured style description. Runs via SGLang-Omni, Diffusers, or ComfyUI. Commercial use allowed with on-screen attribution; written permission required above $20M revenue.
FLUX 3 (early access) Tool
Black Forest Labs' unified generation model, producing video up to 20 seconds with native synchronized audio from text, image, video or keyframe inputs. Video is behind an early-access request today; image access is promised in the following weeks and open weights are deferred.