Ground Truth.
AI, checked against the source.

News · 2026-07-09

LaMem-VLA gives robots a memory so they stop forgetting the task

A new robotics framework called LaMem-VLA attacks one of the most stubborn weaknesses in today's robot policies: they forget. Most vision-language-action models treat each moment independently, with no memory of what they did seconds ago, which makes long, multi-step tasks fall apart. LaMem-VLA gives the robot a working memory by compressing its past experience into compact 'latent memory tokens' and weaving them into its current reasoning.

Key facts

The problem has a technical name: the Markovian assumption, or as the authors put it, "temporal short-horizon bias." A Markovian policy assumes the present observation contains everything needed to choose the next action -- fine for reacting to a single object in front of the gripper, disastrous for a task like "unpack the box, then flatten it, then put it in the recycling." By step three, a memoryless robot has no representation of steps one and two. It is, effectively, a goldfish: competent moment to moment, lost across time.

LaMem-VLA's fix is a pipeline of four cooperating parts. The Curator organizes the robot's history into short-term and long-term memory "vaults." The Seeker queries those vaults using multimodal cognition, deciding what past experience is relevant right now. The Condenser reconstructs the retrieved evidence into compact latent tokens -- dense numerical summaries rather than raw replayed frames. And the Weaver injects those memory tokens directly into the current observation-and-instruction sequence the policy is reasoning over. The result is that the robot's decision at any moment is informed by a compressed, queryable record of what it has already seen and done.

The analogy is the difference between a worker with amnesia and one keeping a running notebook. The amnesiac worker re-derives everything from the scene in front of them every second; the notebook-keeper glances at a few relevant past notes and acts with continuity. Crucially, LaMem-VLA does not store the full video of everything -- that would be far too much to reason over -- but a distilled latent summary, the way you remember the gist of a conversation rather than every word. This mirrors ideas in our lessons on agent memory and the KV cache, which is the closest analog inside a language model.

Why it matters: long-horizon manipulation -- the kind of multi-step physical work that would make home and warehouse robots actually useful -- is exactly where current policies break, and it breaks largely because they cannot remember. Reframing memory as retrievable latent tokens woven into the policy's live reasoning is a concrete, architecturally clean attack on that failure, and it pairs with a broader research thread this year showing that robot policies forget the basics and lose track of the world when they look away. The honest caveat: this is a research paper, and manipulation results in a benchmark or lab setting are a long way from robust performance in a messy real kitchen. Latent memory that helps on curated long-horizon tasks still has to survive the friction, clutter, and surprises of the physical world before it changes what robots can do.


Primary source, verified: read the paper → (arXiv 2607.07608)

Key questions

What problem does LaMem-VLA solve?

It addresses 'temporal short-horizon bias' in robot policies, the Markovian assumption that the robot only needs to see the current moment, which makes them fail at long tasks that require remembering earlier steps.

How does LaMem-VLA remember?

It reconstructs past experience into compact 'latent memory tokens' and injects them directly into the robot's current observation and instruction sequence, using four components it calls the Curator, Seeker, Condenser, and Weaver.

Why is memory hard for robots?

Most vision-language-action models are effectively memoryless, treating each frame independently, so a task like 'put away the groceries you just took out' has no representation of what was already done.
Cite this

APA

Ground Truth. (2026, July 9). LaMem-VLA gives robots a memory so they stop forgetting the task. Ground Truth. https://groundtruth.day/news/lamem-vla-cures-robot-goldfish-memory.html

BibTeX

@misc{groundtruth:lamem-vla-cures-robot-goldfish-memory,
  title  = {LaMem-VLA gives robots a memory so they stop forgetting the task},
  author = {{Ground Truth}},
  year   = {2026},
  month  = {jul},
  url    = {https://groundtruth.day/news/lamem-vla-cures-robot-goldfish-memory.html}
}

Topics: robotics · vision-language-action · memory · long-horizon

Comments are replies to this story on Bluesky — reply with any Bluesky account to join in.