world-models
The open world model ships inference and keeps the training code News
AlayaWorld released inference code and pretrained weights for an interactive world model with long-horizon memory, but the training code is still an unchecked box, the license is a community license, and running it requires a gated Google model plus a ByteDance depth model.
A closed-loop benchmark caught nine world models forgetting the room News
A new benchmark replaced scripted evaluation with an AI agent pursuing long-horizon goals inside generated worlds, and found that all nine leading world models lose spatial consistency and forget what happened out of frame.
One checkpoint turns a compatible video model into a 4D world builder News
Researchers skipped the pixels entirely, feeding a video model's final internal representation straight into a 4D decoder, and got a single checkpoint that works unchanged across multiple video generators after training on about a thousand clips.
NeRF and Gaussian splatting: turning photographs into a scene you can move through Lesson
NeRF and Gaussian splatting both turn a set of ordinary photographs into a three-dimensional scene viewable from angles no camera ever occupied, one by training a small neural network and the other by fitting millions of translucent blobs.
Robot Policies That Predict the Touch Before They Make It News
Two matched robotics releases from NeoteAI and Fudan give manipulation policies a sense of touch that anticipates contact rather than reporting it, winning all nine real-robot tasks in the authors' benchmark against strong vision-only baselines.
Vector Quantization: Turning Continuous Data Into a Vocabulary Lesson
Vector quantization forces a neural network's continuous internal representations to snap to a finite set of learned reference vectors, converting images, audio, or video into sequences of discrete symbols that a language model can predict just like words.
Seven new papers cannot agree what a world model is made of News
PhiZero compresses video into a learned alphabet of state transitions, but six competing late-July papers argue the substrate should instead be executable simulator code, explicit game state, paired re-renderings, distribution coverage, architecture, or action intent.
Black Forest Labs launches FLUX 3 -- image, video, audio, and a robot that never renders the video News
Black Forest Labs announced FLUX 3 on July 23 as a unified image, video and audio model with 20-second video and native audio, available only in early access, with open weights deferred to a later Dev release.
A Wave of AI World Models Landed, and the Useful One Keeps the Real Game Engine News
Several AI world models hit Hugging Face this week, and the most commercially credible restyles a real game engine's frames in real time rather than trying to generate the game itself.
Tencent's Open Robot Model Plans by Imagining the Scene It Wants to Create News
Tencent released RxBrain, an open ~6.2B robot model that interleaves text reasoning with generated goal images, betting that a robot needs an explicit picture of the world it is trying to build.
Two New Papers Split World Models Into Simulators and Streamers News
A pair of papers argues the field of interactive video AI is forking: one track pushes world models toward game-engine-like simulators with explicit state, the other reframes video as a persistent world plus a stream of events for real-time interaction.
New world models generate depth and motion, not just video, to train robots News
A cluster of world-model papers led by RynnWorld-4D shows AI generating synchronized color, depth, and motion instead of flat video, so robots can practice manipulation inside a generated world and turn predictions directly into actions.
'World model' was too vague, so researchers wrote a 58-page definition News
With 'world model' stretched to mean everything from video generators to robot simulators, a 58-page technical report set out to pin down a single scientific definition - as a wave of new papers pushed the field from world-models-as-pretty-video toward world-models-as-working-tools.
Orca proposes a single 'world latent space' to replace next-token, next-frame, and next-action prediction News
Researchers introduced Orca, a world foundation model that learns one unified latent space from multimodal signals and predicts the next world state rather than the next token or frame, outperforming similar-sized specialists on text, image, and action tasks.
NVIDIA's new method stops AI dream-worlds from breaking the laws of physics News
PhysisForcing trains video-generating world models to keep objects solid and interactions believable, raising how often a robot's imagined plan actually works.
A robot AI that adapts to a moved camera by wiggling, not retraining News
A new method lets robot policies figure out a changed setup from a few seconds of self-directed fiddling, so they keep working when the camera or robot body changes - with no retraining.
This AI predicts how objects move by tracking shapes, not pixels News
PhysiFormer forecasts physical motion as real 3D meshes in space - and recovers rigidity and momentum without anyone hand-coding the laws of physics.
An AI's hallucinations turned out to be a map with blank spots News
Researchers showed that when a world-model AI imagines impossible futures, it's usually in places it barely saw in training - and that you can predict and fix those blind spots cheaply.
NVIDIA shrinks video generation down to real time News
A new NVIDIA recipe distills slow video-generating AI into a fast version that can stream frames live and react to your actions.
Alibaba's new models let AI agents practice in a world they imagine News
Qwen-AgentWorld trains a model to simulate the environment an agent acts in, then uses that simulation as a cheap, controllable place to learn -- reporting gains beyond training in the real thing.
AI Agents Are Learning to Build the Worlds They Train In News
Three new open research projects point the same way: instead of only learning what to do, agents are learning to simulate the environment itself, so they can practice in their own imagination.
Robots may not need to picture the future as video to act on it News
Generating a full imagined video of what comes next is expensive. A new method skips it — pulling a robot's next move straight from the inner workings of an image-editing model.
AI 'world models' have short-term memory — they forget what's off-screen News
A sweeping study of dozens of AI video-prediction systems finds they don't truly remember the world; when something leaves the frame, they quietly reinvent it the next time you look.
A world model that thinks in loops instead of stacking layers News
Instead of building an ever-deeper neural network to simulate the future, a new design re-runs one small block over and over — doing comparable work with a fraction of the size.
What are world models? Lesson
A world model is an AI system's internal understanding of how an environment works — not just what it sees right now, but what will happen after an action, and what would have happened differently. Central to planning, robotics, and the next generation of physical AI.
Turn the camera away, and the AI's world freezes News
A new benchmark tests whether video AI systems can track what happens to parts of a scene the camera isn't currently showing. Across 23 models, the answer is mostly no — and making the models larger made the problem worse, not better.
Turn around, and the world disappears News
AI video models that are supposed to "understand" a 3D scene only remember what's on screen — pan away and back, and things have reset. Bigger models are worse at it.
Do robots even need to imagine the movie? News
The common belief is that a robot needs to imagine a video of what happens next to plan. A new method says no — imagine a single still frame, and don't even fully draw it.
WorldDiT Tool
Four released checkpoints plus self-contained inference and evaluation code for a sub-billion-parameter diffusion transformer that emits continuous robot action chunks while predicting future camera-frame pixels as auxiliary training signal. The visual prediction head is dropped at deployment. Tested across four LIBERO simulation suites; the model card notes its cross-paper comparison mixes published protocols.
Wan Streamer v0.3 Tool
Streaming audio-visual interaction model that treats a video as a persistent world plus a time-varying event stream, running full-duplex real-time conversation at 640x368 / 25fps with roughly 550ms total interaction latency.
RxBrain (Hy-Embodied-RxBrain-1.0) Tool
Tencent's ~6.2B embodied model that interleaves text reasoning with generated goal images to plan robot tasks. Weights and inference code released under Apache-2.0.
Qwen-AgentWorld Tool
Alibaba's open language world model that simulates agent environments -- browser, terminal, phone, coding workspace and more -- so other agents can be trained inside the simulation. Released with open weights and code in two sizes.
Marble Tool
World Labs' commercial multimodal world model that turns a text prompt, image, video or spatial sketch into an explorable, editable 3D environment, exportable as Gaussian splats and collision meshes. Freemium with paid tiers.
Cosmos3-Edge Tool
NVIDIA's compact 4-billion-parameter physical-AI model generates text autoregressively while producing image, video, audio and action-trajectory outputs through a diffusion tower, sized for local robotics, autonomous-vehicle and smart-infrastructure workloads. NVIDIA warns it is not physically accurate simulation or safety-certified reasoning.
AlayaWorld Tool
Inference code and pretrained weights for an autoregressive world model with real-time camera control, prompt switching and long-horizon memory consistency, using an explicit 3D cache for spatial recall plus a compressed frame-history embedding. Training code is not included and the weights ship under a community license.