diffusion
One checkpoint turns a compatible video model into a 4D world builder News
Researchers skipped the pixels entirely, feeding a video model's final internal representation straight into a 4D decoder, and got a single checkpoint that works unchanged across multiple video generators after training on about a thousand clips.
LTX-2.5 ships open weights and a chart that races its own hardware News
Lightricks released LTX-2.5 with downloadable weights, free commercial use under $10M in revenue, and a rebuilt generation stack whose new diffusion decoder spends rendering compute where the scene is complex.
Autoencoders and VAEs: teaching a model to compress the world Lesson
An autoencoder is a network trained to squeeze data through a narrow bottleneck and rebuild it, and a variational autoencoder makes that bottleneck a smooth space of probabilities you can sample from, which is why nearly every modern image and video generator does its work inside one.
Seven new papers cannot agree what a world model is made of News
PhiZero compresses video into a learned alphabet of state transitions, but six competing late-July papers argue the substrate should instead be executable simulator code, explicit game state, paired re-renderings, distribution coverage, architecture, or action intent.
Training on the best of K guesses is a third scaling axis alongside parameters and data News
A paper from UIUC and Harvard shows that generating several candidate outputs per training example and learning only from the closest match improves sample efficiency 6.2-fold, and that the benefit grows rather than shrinks as models and datasets get bigger.
Classifier-Free Guidance Lesson
Classifier-free guidance is the knob that makes image and video models actually follow your prompt: it runs the model twice - once with your prompt, once without - and pushes the output along the difference.
Vidu S1 generates video you can steer with your voice in real time News
A new paper introduces Vidu S1, a video model that generates interactive 540p video at up to 42 frames per second on consumer GPUs and lets users reshape the scene on the fly with voice commands, without the drift that usually breaks long AI video.
Diffusion models: how AI turns noise into images and video Lesson
Diffusion models generate images and video by starting from pure random noise and removing it step by step until a coherent picture emerges -- the technique behind Stable Diffusion, Sora, and interactive video systems like Vidu S1.
Flow matching: how AI learns to turn noise into a picture Lesson
Flow matching teaches an AI to generate images by learning a smooth flow that carries random noise, step by step, into a realistic picture -- a cleaner, faster successor to diffusion that powers modern image models like FLUX.
A training-free trick makes AI image generation up to 10x faster News
MrFlow speeds up diffusion image models like FLUX by generating a rough image at low resolution, sharpening it with a fast GAN, and refining details at full resolution -- reaching roughly 10x end-to-end speedup with almost no quality loss and no retraining.
Qwen used human-feedback training to make its image AI follow directions better News
A new recipe applies the same reinforcement-learning approach that polished chatbots to an image generator, then merges separate skill models into one - improving how faithfully it follows prompts and edits.
This AI predicts how objects move by tracking shapes, not pixels News
PhysiFormer forecasts physical motion as real 3D meshes in space - and recovers rigidity and momentum without anyone hand-coding the laws of physics.
NVIDIA shrinks video generation down to real time News
A new NVIDIA recipe distills slow video-generating AI into a fast version that can stream frames live and react to your actions.
A language model that doesn't write left to right News
iLLaDA is an 8-billion-parameter model that generates text by refining a blurry whole rather than one word at a time, and it's catching up to the mainstream.
Two labs race to make AI write whole paragraphs at once instead of word by word News
Diffusion text models generate in parallel blocks rather than left to right; Google's open DiffusionGemma and Inception's Mercury 2 are now in a head-to-head over speed.
An image generator that catches and corrects its own errors mid-draw News
Image-generating models often quietly break the very rule they were told to follow. A new method trains them to notice that error as they work and steer back on target.
AI builds a single 3D object that shows two different things from two angles News
A new training-free method generates 3D visual illusions — one sculpture that reads as completely different objects depending on where you stand — in minutes instead of hours.
What are diffusion language models? Lesson
Most AI writes one word at a time and can never go back. Diffusion language models start from noise and clarify it iteratively — and some versions can revise any word at any step. A growing alternative to the standard left-to-right approach.
An AI that could rewrite its own words — and gained nothing from it News
A different style of text AI can go back and change any word at any point as it writes. Given that power, it didn't actually produce better writing. A clean negative result.
WorldDiT Tool
Four released checkpoints plus self-contained inference and evaluation code for a sub-billion-parameter diffusion transformer that emits continuous robot action chunks while predicting future camera-frame pixels as auxiliary training signal. The visual prediction head is dropped at deployment. Tested across four LIBERO simulation suites; the model card notes its cross-paper comparison mixes published protocols.
Vidu (Vidu S1 Stream Model) Tool
A working AI video generator with text-to-video, image-to-video, and reference-to-video modes; the new S1 Stream Model targets real-time, interactive, voice-steerable video at up to 42 FPS/540p on consumer GPUs. Free credits to try, paid plans for more.
Mercury 2 (Inception Labs) Tool
An API-only diffusion language model pitched on raw speed, claiming to out-pace open diffusion models on tokens-per-second for latency-sensitive generation.
LTX-2.5 Tool
Lightricks' open-weight video foundation model, shipped 11 August with a new diffusion decoder, native multishot generation, 4K HDR and automatic clip-length prediction. Runs locally on 16GB of VRAM, or through a per-second API. Free for commercial use below $10M annual revenue.
LLaDA / iLLaDA Tool
An openly released diffusion language model (weights and code) that generates text by refining a whole passage at once rather than one word at a time, useful for experimenting with non-autoregressive generation and infilling.
DiffusionGemma Tool
Google's open-weight text-diffusion model that generates text in parallel blocks instead of one token at a time; Apache-2.0, runnable locally, with community tooling already shipping.