Ground Truth.
AI, checked against the source.

AI papers — 2026-05-15

Every paper on Hugging Face's Daily Papers list, most-upvoted first — each linked to arXiv, with a plain-English summary and a technical breakdown underneath.Both are AI-written — the summary from the authors' abstract, the breakdown from the paper's full text — and are not individually fact-checked by us. The paper itself is the source.
← 2026-05-142026-05-152026-05-18 →
Jump to one of 53 papers
  1. Achieving Gold-Medal-Level Olympiad Reasoning via Simple and Unified Scaling
  2. Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generation
  3. Self-Distilled Agentic Reinforcement Learning
  4. MemLens: Benchmarking Multimodal Long-Term Memory in Large Vision-Language Models
  5. SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer
  6. MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory
  7. Darwin Family: MRI-Trust-Weighted Evolutionary Merging for Training-Free Scaling of Language-Model Reasoning
  8. Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems
  9. WildClawBench: A Benchmark for Real-World, Long-Horizon Agent Evaluation
  10. STALE: Can LLM Agents Know When Their Memories Are No Longer Valid?
  11. Warp-as-History: Generalizable Camera-Controlled Video Generation from One Training Video
  12. RouteProfile: Elucidating the Design Space of LLM Profiles for Routing
  13. PREPING: Building Agent Memory without Tasks
  14. VGGT-Edit: Feed-forward Native 3D Scene Editing with Residual Field Prediction
  15. EvolveMem: Self-Evolving Memory Architecture via AutoResearch for LLM Agents
  16. Long Context Pre-Training with Lighthouse Attention
  17. Realiz3D: 3D Generation Made Photorealistic via Domain-Aware Learning
  18. ATLAS: Agentic or Latent Visual Reasoning? One Word is Enough for Both
  19. FrontierSmith: Synthesizing Open-Ended Coding Problems at Scale
  20. Learning to Communicate Locally for Large-Scale Multi-Agent Pathfinding
  21. DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Models
  22. IntentVLA: Short-Horizon Intent Modeling for Aliased Robot Manipulation
  23. Orchard: An Open-Source Agentic Modeling Framework
  24. PanoWorld: Towards Spatial Supersensing in 360° Panorama World
  25. ViMU: Benchmarking Video Metaphorical Understanding
  26. Forcing-KV: Hybrid KV Cache Compression for Efficient Autoregressive Video Diffusion Models
  27. RAVEN: Real-time Autoregressive Video Extrapolation with Consistency-model GRPO
  28. Does Synthetic Layered Design Data Benefit Layered Design Decomposition?
  29. CurveBench: A Benchmark for Exact Topological Reasoning over Nested Jordan Curves
  30. BOOKMARKS: Efficient Active Storyline Memory for Role-playing
  31. WildTableBench: Benchmarking Multimodal Foundation Models on Table Understanding In the Wild
  32. Learning to Build the Environment: Self-Evolving Reasoning RL via Verifiable Environment Synthesis
  33. PhyMotion: Structured 3D Motion Reward for Physics-Grounded Human Video Generation
  34. PRISM: Prior Rectification and Uncertainty-Aware Structure Modeling for Diffusion-Based Text Image Super-Resolution
  35. Aligning Latent Geometry for Spherical Flow Matching in Image Generation
  36. Sat3DGen: Comprehensive Street-Level 3D Scene Generation from Single Satellite Image
  37. FutureSim: Replaying World Events to Evaluate Adaptive Agents
  38. Adaptive Teacher Exposure for Self-Distillation in LLM Reasoning
  39. Dynamic Latent Routing
  40. Boosting Omni-Modal Language Models: Staged Post-Training with Visually Debiased Evaluation
  41. Topology-Preserving Neural Operator Learning via Hodge Decomposition
  42. RewardHarness: Self-Evolving Agentic Post-Training
  43. Unlocking Complex Visual Generation via Closed-Loop Verified Reasoning
  44. LLM-based Detection of Manipulative Political Narratives
  45. Ideology Prediction of German Political Texts
  46. Boosting Reinforcement Learning with Verifiable Rewards via Randomly Selected Few-Shot Guidance
  47. BEAM: Binary Expert Activation Masking for Dynamic Routing in MoE
  48. LiSA: Lifelong Safety Adaptation via Conservative Policy Induction
  49. Nexus: An Agentic Framework for Time Series Forecasting
  50. Quantitative Video World Model Evaluation for Geometric-Consistency
  51. SPIN: Structural LLM Planning via Iterative Navigation for Industrial Tasks
  52. PreScam: A Benchmark for Predicting Scam Progression from Early Conversations
  53. Overcoming Dynamics-Blindness: Training-Free Pace-and-Path Correction for VLA Models

Achieving Gold-Medal-Level Olympiad Reasoning via Simple and Unified Scaling →

arXiv 2605.13301 · ▲ 138 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Current reasoning models cannot reliably solve gold-medal-level International Mathematical Olympiad (IMO) and International Physics Olympiad (IPhO) problems, even at large parameter counts, due to insufficient training recipes for long-horizon proof-search and verification.

Method: The paper introduces SU-01, built on a P1-30B-A3B mixture-of-experts backbone, trained in three stages. (1) Supervised fine-tuning on ~338K trajectories (<8K tokens each, 4 epochs) drawn from AoPS, DeepMath, NaturalReasoning, and coding datasets, ordered by a "reverse-perplexity curriculum" that prioritizes high-perplexity examples. (2) Two-level RL over 200 steps: coarse RL (96 steps, GSPO algorithm, 8,967 answer-checkable problems) followed by refined proof-level RL (104 steps) using a DeepSeekMath-V2 generative reward model, self-refinement prompts, and experience replay on 16,287 problems; max response length 160K tokens. (3) Test-time scaling via multi-round solve-verify-refine loops with structured bug reports, enabling trajectories exceeding 100K tokens.

Key results:

  • IMO 2025: 21 pts (direct) → 35 pts with TTS (gold line: 35)
  • USAMO 2026: 15 pts (direct) → 35 pts with TTS (gold line: 25; matches top human among 340 competitors)
  • AIME 2025: 94.6%
  • AIME 2026: 93.3%
  • IPhO 2024: 23.5 → 25.3 pts (gold line: 20.8)
  • IPhO 2025: 20.3 → 21.7 pts (gold line: 19.7)
  • IMO-ProofBench basic: 91.0% | advanced: 49.5%
  • FrontierScience-Research (physics/chemistry/biology): 11.7%

Why it matters / caveats: Demonstrates that a 30B model with the right training recipe can match top-human olympiad performance, contradicting assumptions that gold-medal reasoning requires very large parameter counts. Limitations include the high inference cost of 100K+ token reasoning chains, brittleness on structural constraint problems (e.g., IMO 2025 P6), and low absolute scores on out-of-distribution research-level science tasks.

Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generation →

arXiv 2605.15141 · ▲ 83 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Existing few-step autoregressive video diffusion methods are limited by coarse chunk-wise granularity and high first-frame latency, making real-time interactive generation impractical.

Method: Causal Forcing++ applies causal consistency distillation (causal CD) to distill bidirectional base diffusion models into frame-wise autoregressive students operating in 1–2 sampling steps. Rather than precomputing full PF-ODE trajectories, it obtains supervision from single online teacher ODE steps between adjacent timesteps. This causal CD initialization bootstraps the few-step student, reducing training cost and enabling frame-by-frame streaming with low latency. The approach is evaluated under frame-wise 2-step settings compared to the 4-step chunk-wise Causal Forcing baseline.

Key results:

  • VBench Total: +0.1 over 4-step chunk-wise baseline
  • VBench Quality: +0.3 over 4-step chunk-wise baseline
  • VisionReward: +0.335 over 4-step chunk-wise baseline
  • First-frame latency: 50% reduction vs. chunk-wise baseline
  • Stage 2 training cost: ~4× reduction vs. chunk-wise baseline

Why it matters / caveats: Enables streaming, low-latency video generation suitable for real-time interactive applications by reducing both inference steps and first-frame latency simultaneously. Quality-speed tradeoffs are inherent to distillation; the work is evaluated primarily against the prior Causal Forcing baseline rather than a broad set of competing methods.

Self-Distilled Agentic Reinforcement Learning →

arXiv 2605.15155 · ▲ 79 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Token-level teacher guidance (On-Policy Self-Distillation, OPSD) becomes unstable when naively combined with trajectory-level RL (GRPO) in multi-turn LLM agents due to compounding instability and imperfect skill retrieval, while RL alone provides only coarse supervision for long-horizon tasks.

Method: SDAR (Self-Distilled Agentic Reinforcement Learning) treats on-policy self-distillation as a gated auxiliary objective alongside RL as the primary backbone. Sigmoid gates map detached token-level teacher signals, strengthening positive-gap tokens and softly attenuating negative teacher rejections, thus stabilizing the combined optimization. The method is tested on Qwen2.5 and Qwen3 model families across ALFWorld, WebShop, and Search-QA benchmarks.

Key results:

  • ALFWorld: +9.4% over GRPO baseline
  • WebShop (accuracy): +10.2% over GRPO baseline
  • Search-QA: +7.0% over GRPO baseline

Why it matters / caveats: SDAR addresses a concrete failure mode when combining token-level distillation with RL in agentic settings and shows consistent gains across three interactive benchmarks. Evaluation is limited to Qwen model families and only three benchmarks, leaving open questions about generalization to other architectures and task domains.

MemLens: Benchmarking Multimodal Long-Term Memory in Large Vision-Language Models →

arXiv 2605.14906 · ▲ 68 on Hugging Face · HF page · PDF

Technical breakdown

Problem: No existing benchmark systematically evaluates whether large vision-language models (LVLMs) can maintain and retrieve multimodal memory across long, multi-session conversations requiring visual evidence.

Method: MemLens is a benchmark of 789 questions spanning five memory abilities — information extraction, multi-session reasoning, temporal reasoning, knowledge update, and answer refusal — evaluated across four standard context lengths (32K–256K tokens) using cross-modal token-counting. The study evaluates 27 LVLMs and 7 memory-augmented agents. No new model or training procedure is proposed; the contribution is the evaluation suite and analysis.

Key results:

  • Frontier LVLMs drop to below 2% accuracy on questions whose evidence includes images when image inputs are ablated (80.4% of questions are image-dependent)
  • Multi-session reasoning performance: most systems below 30%
  • Long-context LVLMs degrade as conversation length grows; memory agents maintain length stability but lose visual fidelity

Why it matters / caveats: Identifies that neither long-context LVLMs nor memory-augmented agents alone solve multimodal long-term memory tasks, motivating hybrid architectures combining long-context attention with structured multimodal retrieval. The paper is marked as work in progress.

SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer →

arXiv 2605.15178 · ▲ 66 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Generating high-fidelity, minute-scale videos with precise 6-DoF camera control on a single GPU is infeasible with existing transformer-based diffusion models due to quadratic attention complexity over long sequences.

Method: SANA-WM is a 2.6B-parameter world model using a Hybrid Linear Diffusion Transformer with three main components: (1) frame-wise Gated DeltaNet (GDN) combined with softmax attention for memory-efficient long-context modeling; (2) a Dual-Branch Camera Control module for 6-DoF trajectory adherence; (3) a Two-Stage Generation Pipeline with a long-video refiner. Camera poses are extracted from ~213K public video clips via a Robust Annotation Pipeline providing metric-scale 6-DoF labels. Training ran for 15 days on 64 H100 GPUs.

Key results:

  • Generates 60-second 720p video clips on a single GPU
  • Distilled variant processes 60-second clips in 34 seconds on RTX 5090 with NVFP4 quantization
  • 36× higher throughput for scalable world modeling vs. prior baselines

Why it matters / caveats: Shows that hybrid linear attention can scale world modeling to minute-length video at practical inference cost on consumer hardware. Evaluation is against open-source baselines only, and reported throughput improvements lack a stated benchmark protocol.

MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory →

arXiv 2605.15128 · ▲ 53 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Existing multimodal agent memory evaluations can be solved using captions alone without preserving fine-grained visual evidence, masking fundamental failures in visual memory retention and state-change reasoning.

Method: MemEye is an evaluation framework assessing memory along two axes: (a) visual granularity (scene-level to pixel-level) and (b) evidence usage (single-evidence retrieval to evolutionary synthesis across multiple observations). The benchmark covers 8 life-scenario tasks with ablation-driven validation gates that check answerability, shortcut resistance, visual necessity, and reasoning structure. Evaluations cover 13 memory methods across 4 VLM backbones.

Key results:

  • Current architectures "still struggle to preserve fine-grained visual details and reason about state changes over time" (specific accuracy numbers not stated in abstract)

Why it matters / caveats: Addresses a critical evaluation shortcut in prior work by requiring visual necessity as a condition for correct answers. The absence of concrete quantitative baselines in available content limits assessment of the magnitude of identified failures; full results appear in the paper body.

Darwin Family: MRI-Trust-Weighted Evolutionary Merging for Training-Free Scaling of Language-Model Reasoning →

arXiv 2605.14386 · ▲ 50 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Improving LLM reasoning performance typically requires expensive gradient-based post-training, but it is unclear whether weight-space recombination of existing models can match or exceed trained baselines without any additional training.

Method: Darwin Family uses gradient-free evolutionary weight-space merging with three components: (1) a 14-dimensional adaptive merge genome encoding component-level and block-level recombination parameters; (2) MRI-Trust Fusion, which combines diagnostic layer-importance signals (MRI) with evolutionary search via a learnable trust parameter; (3) an Architecture Mapper enabling cross-architecture merging between Transformer and Mamba-based model families. The framework scales from 4B to 35B parameters and supports recursive multi-generation evolution.

Key results:

  • Darwin-27B-Opus: 86.9% on GPQA Diamond (ranked #6 among 1,252 evaluated models)
  • Consistent improvement over foundation models from 4B to 35B parameter scale
  • Outperforms fully trained foundation models without gradient-based training

Why it matters / caveats: Provides a training-free path to reasoning improvement that avoids costly post-training pipelines, with cross-architecture merging enabling model family diversity. Limitations include unclear computational cost of the evolutionary search, no reported results on non-reasoning benchmarks, and absence of failure case analysis.

Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems →

arXiv 2605.14892 · ▲ 44 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Errors propagate across agents and interaction rounds in multi-agent LLM systems, producing failures that are difficult to diagnose, and existing research treats individual agent capability, multi-agent coordination, failure attribution, and self-improvement as disconnected research areas.

Method: This is a survey paper that proposes the LIFE progression framework: Lay capability foundation → Integrate agents through collaboration → Find faults through attribution → Evolve through autonomous self-improvement. The paper synthesizes existing literature across these four stages and identifies open challenges at their boundaries. No new models, datasets, or training objectives are introduced.

Key results:

  • Not stated (survey paper with no empirical benchmarks)

Why it matters / caveats: Provides a unified conceptual framework connecting four previously siloed research directions in multi-agent LLM systems, identifying where capability gaps compound across stages. As a survey, the LIFE framework itself is not empirically validated, and the paper proposes future research directions without demonstrated solutions.

WildClawBench: A Benchmark for Real-World, Long-Horizon Agent Evaluation →

arXiv 2605.10912 · ▲ 40 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Current agent benchmarks rely on synthetic environments and short tasks, leaving it unknown whether frontier AI agents can complete realistic, long-duration work in actual deployment runtimes.

Method: WildClawBench comprises 60 bilingual, multimodal tasks across six categories, executed inside reproducible Docker containers using real tools (not mocked services) within native CLI agent harnesses — OpenClaw, Claude Code, Codex, and Hermes Agent. Tasks are graded via a hybrid evaluation scheme combining deterministic rule-based checks, environment-state auditing, and LLM/VLM judgment for semantic verification. 19 frontier models are evaluated.

Key results:

  • Average task duration: ~8 minutes of wall-clock time and over 20 tool calls per task
  • Claude Opus 4.7 (best model): 62.2% overall under OpenClaw harness
  • All other models: below 60%
  • Harness switching alone changes performance by up to ±18 percentage points across models

Why it matters / caveats: Demonstrates that long-horizon, native-runtime agent evaluation remains far from solved for current frontier models, with the best system solving only ~62% of tasks. A key finding is that the choice of harness independently drives performance swings of up to 18 points, suggesting that current agent benchmarks may conflate model capability with scaffold design.

STALE: Can LLM Agents Know When Their Memories Are No Longer Valid? →

arXiv 2605.06527 · ▲ 39 on Hugging Face · HF page · PDF

Technical breakdown

Problem: LLM agents cannot reliably detect when stored memories become invalid through implicit conflicts — situations where new evidence contradicts earlier beliefs without explicit negation — causing them to act on stale information.

Method: STALE is a benchmark of 400 expert-validated conflict scenarios (1,200 evaluation queries) covering over 100 everyday topics with contexts up to 150K tokens. Three probing dimensions test: State Resolution (detecting outdated beliefs), Premise Resistance (rejecting queries with false presuppositions), and Implicit Policy Adaptation (applying updated states to behavior). The paper also presents CUPMem, a prototype system using structured state consolidation and propagation-aware search to strengthen memory validity tracking.

Key results:

  • Best evaluated model overall accuracy: 55.2%
  • Benchmark: 400 scenarios, 1,200 evaluation queries, 100+ everyday topics, up to 150K-token contexts

Why it matters / caveats: Exposes a concrete failure mode in agentic memory: models retrieve updated evidence but fail to act on it consistently, particularly when state changes should invalidate related downstream memories. CUPMem is presented as a direction rather than a fully deployed solution.

Warp-as-History: Generalizable Camera-Controlled Video Generation from One Training Video →

arXiv 2605.15182 · ▲ 36 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Existing camera-controlled video generation methods require either large-scale camera-annotated training datasets or costly test-time optimization to follow specified camera trajectories.

Method: The approach converts target camera trajectories into "camera-warped pseudo-history" frames fed through a pretrained video model's (Helios, a distilled inference checkpoint) native history-conditioning pathway — without adding new camera encoders or control branches. Scene geometry is reconstructed via the Pi3X model and projected to target cameras; warped tokens receive the same RoPE positional embeddings as corresponding denoising targets (target-frame alignment); invisible/invalid warp tokens are dropped before transformer processing (visible-token selection). Optional LoRA finetuning (rank 32, α=32) is applied on the lowest-resolution stage for 1,000 iterations using a single camera-annotated video.

Key results:

  • WorldScore Camera Control (zero-shot frozen): 26.42
  • WorldScore Camera Control (one-shot LoRA): 62.00
  • WorldScore Subjective Quality (one-shot): 54.83 vs. 47.37 (text-only baseline)
  • DAVIS R-Err: 2.97 | T-Err: 0.0942 | FID: 68.18 | FVD: 57.95 | DOVER: 0.448
  • RE10K R-Err: 1.28 | T-Err: 0.0454 | FID: 22.11 | FVD: 17.92 | DOVER: 0.442

Why it matters / caveats: Demonstrates that pretrained history-conditioned video models contain latent camera-following capability; one-shot LoRA finetuning on a single annotated video matches methods trained on 78K–90K videos. Limitations: inherits geometry/disocclusion errors from Pi3X reconstruction; adds ~7.8 s per 33-frame chunk; bounded by the backbone's ability to complete disoccluded regions.

RouteProfile: Elucidating the Design Space of LLM Profiles for Routing →

arXiv 2605.00180 · ▲ 28 on Hugging Face · HF page · PDF

Technical breakdown

Problem: LLM routing systems conflate router mechanism design with profile design, making it unclear how the construction and representation of LLM capability profiles independently affects routing performance.

Method: RouteProfile constructs heterogeneous interaction graphs from 15 datasets (knowledge, reasoning, math, coding tasks) with five node types (model, family, domain, task, query) across 8 candidate LLMs (3B–176B parameters). Profile design is varied along four axes: organizational form (flat vs. structured GNN), representation type (text vs. dense embeddings), aggregation depth (K∈{0,1,2,3,4} GNN hops via HANConv), and learning configuration (training-free vs. trainable with masked reconstruction). Evaluation spans three routers—SimRouter, MLPRouter, and GraphRouter—on 12 downstream datasets.

Key results:

  • Flat text (K=0): SimRouter 0.554, MLP 0.613, GraphRouter 0.539
  • Structured text (K=4, training-free): 0.580, 0.624, 0.610
  • Structured embeddings (K=3, trainable): 0.611, 0.613, 0.604
  • Cold-start (new LLM generalization): trainable structured embeddings up to 0.547; flat profiles yield near-zero cold-start performance

Why it matters / caveats: Establishes that routing gains originate substantially from profile design rather than router mechanism choice, enabling fairer comparison across routing systems. Trainable configurations show over-smoothing degradation at higher aggregation depths; cold-start evaluation covers only one new model.

PREPING: Building Agent Memory without Tasks →

arXiv 2605.13880 · ▲ 25 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Agents deployed to new environments face a cold-start gap because memory construction depends on human-defined or deployment-time tasks that do not exist before initial deployment.

Method: PREPING uses three LLM components in an iterative loop (10 iterations × 10 tasks = 100 total synthetic tasks): a Proposer conditioned on proposer memory and environment documentation generates synthetic tasks; a Solver (DeepSeek-V3.2) executes them in the target environment; a Validator filters trajectories by feasibility score (score of 5/5 required for admission). Two asymmetric memory states are maintained — proposer memory (updated from all trajectories) and solver memory (only validator-approved trajectories, converted to procedural bullets via ACE's reflector-curator pipeline). Evaluated on AppWorld, BFCL v3, and MCP-Universe.

Key results:

  • AppWorld Test-Normal TGC: 83.7% (vs. base 69.6%; ACE-Online 80.4%)
  • AppWorld Test-Normal SGC: 70.2%
  • BFCL v3 Base success rate: 65.2% (vs. base 43.7%; ACE-Online 62.3%)
  • MCP-Universe average: 37.5% (vs. base 32.1%, +5.4 pts)
  • Deployment cost vs. ACE-Online: 2.99× lower on AppWorld, 2.23× lower on BFCL v3

Why it matters / caveats: Enables agents to build procedural memory through self-generated practice without target-task examples, substantially reducing real-world deployment costs. Effectiveness assumes sufficiently detailed API/tool documentation; environments with poorly specified preconditions may perform worse.

VGGT-Edit: Feed-forward Native 3D Scene Editing with Residual Field Prediction →

arXiv 2605.15186 · ▲ 23 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Existing 3D scene editing methods use 2D-lifting strategies — editing individual views separately then reconstructing — which produce blurry textures and geometrically inconsistent results across viewpoints.

Method: VGGT-Edit builds on a frozen VGGT feed-forward reconstruction backbone and adds three components: (1) depth-synchronized text injection fusing OpenCLIP text embeddings into transformer decoder layers synchronized with the backbone's pose-injection blocks; (2) view-aware importance weighting via an MLP predicting per-view normalized weights from visible mask area, boundary ratio, and confidence scores; (3) a residual field prediction head outputting dense displacement ΔP, with edited geometry = P_base + ΔP ⊙ M. Training uses five loss terms: masked scale alignment, edit reconstruction (L₁), preservation, normal consistency, and residual regularization (L₂). DeltaScene training dataset: 95,000 pairs from Replica, ScanNet, and ScanNet++.

Key results:

  • DeltaScene CLIP Score: 30.2 (vs. best baseline Edit3r: 28.9)
  • DeltaScene C-FID: 122.4 (vs. Edit3r: 130.8; lower is better)
  • DeltaScene C-KID: 0.048 (vs. Edit3r: 0.92; lower is better)
  • Inference time: ~5 s (vs. Edit3r: ~10 s; EditSplat: ~600 s)

Why it matters / caveats: Achieves 100–120× faster 3D editing than optimization-based methods while maintaining multi-view consistency through native 3D prediction. Evaluation is limited to the DeltaScene benchmark; generalization to unposed or highly complex real-world scenes is untested.

EvolveMem: Self-Evolving Memory Architecture via AutoResearch for LLM Agents →

arXiv 2605.13941 · ▲ 21 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Existing LLM agent memory systems evolve only stored content while keeping retrieval infrastructure frozen, making them progressively suboptimal as memory scales and question types diversify.

Method: EvolveMem combines: (a) a structured memory store with typed units (episodic, semantic, preference, etc.) using sliding-window extraction; (b) a multi-view retriever fusing BM25, semantic similarity (BAAI/bge-base-en-v1.5 embeddings), and structured-metadata signals via weighted-sum/RRF fusion, with optional entity-swap and query decomposition; (c) an LLM-powered diagnosis module that reads per-question failure logs, identifies root causes, and proposes adjustments to retrieval budgets, fusion modes, weights, and answer styles — validated by a guarded meta-analyzer with automatic revert-on-regression (threshold τrev=0.01) and explore-on-stagnation safeguards. Up to 7 evolution rounds per configuration.

Key results:

  • LoCoMo overall F1: 0.543 (vs. SimpleMem baseline 0.432; +25.7% relative)
  • LoCoMo vs. minimal baseline: +78.0% relative (0.305 → 0.543)
  • MemBench overall accuracy (GPT-4o): 67.9% (+18.9% relative over strongest baseline)
  • MemBench overall accuracy (GPT-5.1): 71.4%
  • Cross-benchmark transfer: LoCoMo-evolved config reaches 54.3% on MemBench zero-shot; continued evolution reaches 79.2%

Why it matters / caveats: First framework to autonomously evolve retrieval infrastructure (not just content) through closed-loop diagnosis. Positive cross-benchmark transfer suggests universal retrieval principles. Computational overhead is significant (~25–35 min per sample); MemBench Robustness remains weak (50–62.5%), indicating content gaps cannot be fixed by configuration changes alone.

Long Context Pre-Training with Lighthouse Attention →

arXiv 2605.06554 · ▲ 21 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Scaled dot-product attention's quadratic time and memory complexity bottlenecks transformer pretraining at extreme sequence lengths (e.g., 98K–1M tokens).

Method: Lighthouse Attention is a training-only hierarchical sparse attention mechanism. It builds an L-level pyramid by symmetrically mean-pooling Q, K, V by factor p at each level; scores pyramid entries with parameter-free ℓ2 norms via max-pooling; selects top-k entries using a chunked-bitonic kernel; gathers them into a dense sub-sequence; and runs stock FlashAttention on this sub-sequence. A two-stage training recipe trains with Lighthouse for the majority of steps, then resumes with dense SDPA for final steps to recover full model quality. Experiments use a 530M-parameter Llama-3 on C4 at 98,304-token context for 16,000 optimizer steps (~50B tokens).

Key results:

  • Final loss (10k Lighthouse + 6k SDPA steps): 0.6980 vs. dense SDPA baseline 0.7237
  • Forward pass latency at 512K context: 21× faster than cuDNN SDPA
  • Forward + backward latency at 512K context: 17.3× faster
  • Throughput (98K context): 84–126K tokens/sec/GPU vs. ~46K for dense SDPA
  • Total wall-clock training time: 22.5–27.0 h vs. 37.9 h (1.4–1.69× speedup)
  • NIAH mean retrieval (best config k=2048 dilated): 0.76 vs. 0.72 dense baseline

Why it matters / caveats: Demonstrates that brief dense SDPA resumption recovers full dense model quality after sparse training, resolving the key correctness concern for sparse training methods. Enables 1M-token pretraining on 32 GPUs. Limitation: symmetric Q/K/V pooling is incompatible with autoregressive decoding, requiring the dense-resumption step for inference-ready checkpoints.

Realiz3D: 3D Generation Made Photorealistic via Domain-Aware Learning →

arXiv 2605.13852 · ▲ 21 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Fine-tuning diffusion models on synthetic 3D renders causes "domain leakage," where the model learns spurious associations between geometric control signals and synthetic visual appearance, degrading photorealism.

Method: Realiz3D adds lightweight low-rank residual adapters (Domain Shifters, rank r=8) to a Diffusion Transformer (DiT) backbone: X̃ = X + W_left × W_right × e_domain. Training proceeds in two stages: Stage 1 freezes the DiT and trains Domain Shifters on mixed real/synthetic data without control signals to separate domain identity from controls; Stage 2 fine-tunes the DiT with Representation Binding — stochastically freezing early blocks (τ_B=40% of total blocks) and probabilistically reassigning early blocks to synthetic domain mode (p_B=0.1) during real-data training. Training uses 120K synthetic 3D assets at V=4 orthogonal views with normal/position maps.

Key results:

  • Multiview Texturing 3D Consistency: PSNR 24.78, SSIM 0.9153, LPIPS 0.0865
  • Multiview Texturing Real-World Realism: FID_I 200.24, KID_I 0.0291 (best among tested methods)
  • Text-to-Multiview 3D Consistency: PSNR 19.02, SSIM 0.8631, LPIPS 0.1075
  • Text-to-Multiview Real-World Realism: FID_I 196.01, KID_I 0.0171

Why it matters / caveats: Decoupling visual domain from geometric control via lightweight adapters enables photorealistic 3D-consistent generation without sacrificing control precision. Limitations: small gap in 3D consistency vs. synthetic-only baseline (24.78 vs. 25.76 PSNR); lighting bias in the base model causes inconsistent appearance across views.

ATLAS: Agentic or Latent Visual Reasoning? One Word is Enough for Both →

arXiv 2605.15198 · HF page · PDF

Technical breakdown

Problem: Visual reasoning tasks requiring intermediate visual states face a trilemma: unified image generation is computationally expensive, agentic methods incur external execution latency, and latent methods generalize poorly across tasks.

Method: ATLAS represents five visual operations (<|Manip|>, <|Shape|>, <|Line|>, <|Arrow|>, <|Text|>) as discrete functional tokens within the standard vocabulary of Qwen2.5-VL-7B, requiring no architectural modifications. Training uses two stages: Stage 1 SFT on ATLAS-178K (138K examples from V-Interaction-400K plus 40K perception data); Stage 2 RL using Latent-Anchored GRPO (LA-GRPO), which adds a token-level auxiliary loss anchoring functional tokens to stabilize gradient updates that are otherwise diluted by sparse activation (~2.3% of ~203 tokens per response). RL training data: We-Math 2.0, MMK12, ThinkLite.

Key results:

  • BLINK: ATLAS_SFT 46.0% → ATLAS_LA-GRPO 51.3%
  • WeMath: ATLAS_SFT 28.9% → ATLAS_LA-GRPO 45.0%
  • V* benchmark: ATLAS_SFT 77.5% → ATLAS_LA-GRPO 75.4% (GRPO slightly better at 77.9%)
  • Efficiency vs. V-Thinker: 4.90× fewer tokens; latency 18.83 s → 3.80 s; peak memory 2.55 GB → 1.43 GB

Why it matters / caveats: Bridges agentic and latent visual reasoning within a single autoregressive sequence by treating visual operations as vocabulary tokens. LA-GRPO addresses the sparse-token gradient dilution problem specific to functional tokens. However, closed-source models substantially outperform ATLAS (e.g., Gemini-2.5-Pro: 90.2% on WeMath), and LA-GRPO underperforms standard GRPO on V*.

FrontierSmith: Synthesizing Open-Ended Coding Problems at Scale →

arXiv 2605.14445 · HF page · PDF

Technical breakdown

Problem: LLMs struggle with open-ended coding problems (those lacking known optimal solutions), largely because open-ended training problems are scarce and expensive to construct manually.

Method: FrontierSmith mutates closed-ended competitive programming problems into open-ended variants by changing optimization goals, restricting outputs, or generalizing inputs. Candidates pass a coarse LLM-as-judge check, then are ranked by an "idea divergence" metric comparing solution strategies via LLM and execution-based score similarity. Test cases and verifiers are generated by separate agents using cross-validation. GPT-5.4 Thinking performs mutation; Claude Sonnet 4.6 samples solutions, generates tests, and verifies. Models (Qwen3.5-9B and Qwen3.5-27B) are trained with GRPO on the synthesized problems.

Key results:

  • FrontierCS, Qwen3.5-9B: 10.62 Avg@5 (vs. 11.17 human-curated; +8.82 vs. no-synthesis baseline)
  • FrontierCS, Qwen3.5-27B: 19.82 Avg@5 (vs. 13.98 human-curated; +12.12 vs. baseline)
  • ALE-bench Elo, Qwen3.5-9B: 633.58 (+306.36 vs. baseline of 558.49)
  • ALE-bench Elo, Qwen3.5-27B: 661.64 (+309.12 vs. baseline of 543.80)

Why it matters / caveats: Shows that closed-ended competitive programming problems can automatically seed open-ended synthesis at scale, matching or exceeding human-curated training data quality. Limited to self-contained algorithmic problems; agentic multi-turn RL is not explored.

Learning to Communicate Locally for Large-Scale Multi-Agent Pathfinding →

arXiv 2605.07637 · HF page · PDF

Technical breakdown

Problem: Decentralized multi-agent pathfinding solvers must coordinate hundreds to thousands of agents in shared environments, but communication-based approaches typically break scalability.

Method: LC-MAPF frames MAPF as a Dec-POMDP solved by a 3-million-parameter Transformer with: an encoder tokenizing local observations (up to 256 tokens per agent); an information bottleneck producing compact 32-token latent states; a multi-round communication module (4 rounds of message passing between neighbors within a 5-cell radius, up to 13 agents); and a decoder fusing latent states with neighbor messages via cross-attention. Architecture uses RMSNorm, SwiGLU, QK-normalization, and differential attention. Training uses imitation learning from 750 million observation-action pairs generated by the LaCAM* centralized solver; dataset: 23.5M samples from POGEMA benchmark subsets.

Key results:

  • POGEMA Mazes (64 agents) success rate: LC-MAPF 0.87±0.06 vs. MAPF-GPT-85M 0.79±0.08
  • POGEMA Warehouse (192 agents) success rate: 0.938±0.043 (4 communication rounds)
  • Communication ablation: 1 round → 0% success on Warehouse; 4 rounds optimal
  • Scalability: linear scaling maintained at 5,000 agents (0.65 seconds/step)
  • Robustness: 1.00 success rate on Random maps (32 agents) with 50% message failure

Why it matters / caveats: Demonstrates that unsupervised learned multi-round communication enables better coordination than single-message approaches while preserving decentralized scalability. Requires training data from a centralized solver (LaCAM*); limited to 13-agent communication neighborhoods; performance degrades with >50% message failures at scale.

DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Models →

arXiv 2605.15055 · HF page · PDF

Technical breakdown

Problem: Multi-task reinforcement learning for diffusion models causes cross-task interference when optimizing jointly, and cascade approaches lead to catastrophic forgetting.

Method: DiffusionOPD adapts Online Policy Distillation (OPD) from discrete token settings to continuous-state Markov processes. Task-specific teacher models are trained independently, then distilled into a unified student model along the student's own rollout trajectories. The framework derives a closed-form per-step KL objective that unifies both stochastic SDE and deterministic ODE refinement via mean-matching, replacing PPO-style policy gradients with an analytic gradient estimator for lower variance.

Key results:

  • Surpasses multi-reward RL and cascade RL baselines on all evaluated benchmarks (specific dataset names and numerical values not stated in abstract)

Why it matters / caveats: Provides a principled, unified training objective for multi-task text-to-image diffusion optimization that avoids joint-optimization interference and catastrophic forgetting. Specific dataset names, model names, and numerical results are not surfaced in the abstract.

IntentVLA: Short-Horizon Intent Modeling for Aliased Robot Manipulation →

arXiv 2605.14712 · HF page · PDF

Technical breakdown

Problem: In robot imitation learning, identical visual-language observations can map to different action chunks because demonstrators act with different short-horizon intents, causing inter-chunk conflicts and unstable execution during replanning.

Method: IntentVLA encodes recent visual observation history into a compact short-horizon intent representation that conditions action chunk generation, addressing observation aliasing under partial observability. The framework is evaluated on four benchmarks: AliasBench (12 tasks on RoboTwin2, purpose-built to isolate aliasing), SimplerEnv, LIBERO, and RoboCasa.

Key results:

  • AliasBench, SimplerEnv, LIBERO, RoboCasa: outperforms strong VLA baselines on rollout stability (specific success rates not stated in available text)

Why it matters / caveats: Addresses a practically important failure mode in robot learning — execution instability arising from multimodal action distributions under partial observability. AliasBench is a reusable community resource for studying aliasing. Specific numerical results were not surfaced from available content.

Orchard: An Open-Source Agentic Modeling Framework →

arXiv 2605.15040 · HF page · PDF

Technical breakdown

Problem: Open-source agent frameworks emphasize orchestration and evaluation but lack scalable training infrastructure, while high-performing systems depend on proprietary codebases and models.

Method: Orchard provides: (1) Orchard Env, a lightweight environment service with reusable primitives for sandbox lifecycle management; (2) Orchard-SWE, a software engineering agent trained on Qwen3-30B-A3B-Thinking using 107K trajectories distilled from MiniMax-M2.5 and Qwen3.5-397B, with credit-assignment SFT and Balanced Adaptive Rollout RL; (3) Orchard-GUI, a 4B vision-language agent trained on 0.4K distilled trajectories and 2.2K open-ended tasks; (4) Orchard-Claw, a personal assistant agent trained on 0.2K synthetic tasks.

Key results:

  • SWE-bench Verified (after SFT): 64.3%; (after SFT+RL): 67.5%
  • WebVoyager: 74.1%
  • Online-Mind2Web: 67.0%
  • DeepShop: 64.0%
  • Claw-Eval (pass@3): 59.6%; (with ZeroClaw harness): 73.9%

Why it matters / caveats: Demonstrates that a harness-agnostic, open-source environment enables reusable agent data pipelines and competitive training across coding, GUI, and personal assistant domains. Results are state-of-the-art for open-source models at comparable parameter counts but remain competitive with rather than surpassing proprietary systems.

PanoWorld: Towards Spatial Supersensing in 360° Panorama World →

arXiv 2605.13169 · HF page · PDF

Technical breakdown

Problem: Multimodal language models fail at spatial understanding in panoramic images because they decompose 360° scenes into multiple perspective views, discarding the spherical geometry of equirectangular projection (ERP).

Method: PanoWorld introduces Spherical Spatial Cross-Attention, which injects spherical geometric priors directly into the visual attention stream of a multimodal language model. A large-scale metadata pipeline converts equirectangular panoramas into geometry-aware, language-grounded, and depth-aware supervision for instruction tuning. The system targets four spatial reasoning capabilities: semantic anchoring, spherical localization, reference-frame transformation, and depth-aware 3D spatial reasoning. Evaluation uses PanoSpace-Bench, H* Bench, and the R2R-CE Val-Unseen split.

Key results:

  • PanoSpace-Bench, H* Bench, R2R-CE Val-Unseen: substantially outperforms prior baselines (specific scores not stated in abstract)

Why it matters / caveats: Addresses a genuine gap in panoramic scene understanding with a geometry-aware attention mechanism that could benefit embodied navigation and 360° video analysis. Specific numerical results were not surfaced in the abstract.

ViMU: Benchmarking Video Metaphorical Understanding →

arXiv 2605.14607 · HF page · PDF

Technical breakdown

Problem: Video understanding models are evaluated on literal visual perception but lack systematic benchmarks for interpreting metaphorical, ironic, and socially embedded meaning in video content.

Method: ViMU is a benchmark of 2,000 video clips drawn from diverse online sources, assessing whether video-language models can interpret implicit and metaphorical content. It includes both multiple-choice questions and open-ended generation tasks requiring metaphor explanation. Models evaluated include GPT-4V, Qwen-VL variants, Gemma, and SEED-1.5. Inter-annotator agreement: Cohen's Kappa ~0.72–0.78, annotator agreement rate ~85%.

Key results:

  • Multiple-choice accuracy (across evaluated models): approximately 45–75% range
  • Human performance established as upper bound
  • BLEU/METEOR scores reported for open-ended tasks (exact values not stated)

Why it matters / caveats: Establishes a much-needed evaluation framework for implicit video meaning, particularly relevant given cultural variation in metaphor interpretation. The benchmark is a diagnostic resource rather than a training study; exact per-model scores were not fully surfaced from available content.

Forcing-KV: Hybrid KV Cache Compression for Efficient Autoregressive Video Diffusion Models →

arXiv 2605.09681 · HF page · PDF

Technical breakdown

Problem: Autoregressive video diffusion models accumulate redundant key-value caches across historical frames, causing prohibitive attention complexity and memory overhead that limits real-time scalability.

Method: Forcing-KV empirically analyzes head-wise functional specialization in attention layers and partitions heads into two types: static heads (handling frame transitions and intra-frame fidelity) and dynamic heads (handling inter-frame motion and temporal consistency). Static heads receive structured static pruning; dynamic heads receive segment-wise similarity-based dynamic pruning. The method is evaluated on two AR video diffusion models: LongLive and Self Forcing.

Key results:

  • Generation speed: over 29 FPS on single NVIDIA H200
  • KV cache memory reduction: 30%
  • Speedup at 480P on LongLive: 1.35×; on Self Forcing: 1.50×
  • Speedup at 1080P: 2.82×

Why it matters / caveats: Demonstrates practical real-time video generation at high resolution with meaningful memory savings and no stated quality degradation. Evaluation is limited to two AR video diffusion architectures at specific resolutions, so generalization to other architectures is unverified.

RAVEN: Real-time Autoregressive Video Extrapolation with Consistency-model GRPO →

arXiv 2605.15190 · HF page · PDF

Technical breakdown

Problem: Causal autoregressive video diffusion models suffer a training-inference distribution mismatch that degrades generation quality over extended time horizons during real-time streaming.

Method: RAVEN addresses the distribution mismatch through two mechanisms: (1) a training framework that repacks each self-rollout into an interleaved sequence of clean historical endpoints and noisy denoising states, bridging the gap between teacher-forced training and autoregressive inference; (2) Consistency-model Group Relative Policy Optimization (CM-GRPO), which reformulates a consistency sampling step as a conditional Gaussian transition and applies online RL directly to this kernel instead of relying on Euler-Maruyama auxiliary processes used in standard diffusion GRPO.

Key results:

  • Surpasses recent causal video distillation baselines on quality, semantic, and dynamic degree evaluations (specific FVD/FID/PSNR values not stated in abstract)

Why it matters / caveats: CM-GRPO provides a principled RL training signal tailored to consistency models for video generation, potentially applicable beyond video extrapolation. The abstract does not report specific numerical benchmarks, making direct quantitative comparison to prior work difficult without accessing the full paper.

Does Synthetic Layered Design Data Benefit Layered Design Decomposition? →

arXiv 2605.15167 · HF page · PDF

Technical breakdown

Problem: Graphic design decomposition — breaking layered designs into individually editable components — is hindered by scarce proprietary training datasets and limited synthetic data approaches.

Method: The authors construct SynLayers, a purely synthetic dataset generated using vision-language models for textual supervision and automated bounding box annotation. Training builds on the CLD (Compositional Layered Design) baseline framework. Dataset scale is varied to identify saturation points, and layer-count distribution is explicitly balanced.

Key results:

  • SynLayers (fully synthetic) outperforms real-image PrismLayersPro dataset
  • Performance saturates at approximately 50K samples
  • Balanced layer-count distribution achieved through synthetic generation

Why it matters / caveats: Establishes that synthetic data can replace proprietary assets for layered design decomposition. The approach does not model complex inter-layer compositional relationships, and the 50K saturation point suggests diminishing returns beyond that scale. Exact metric names and numerical scores were not available in the accessible content.

CurveBench: A Benchmark for Exact Topological Reasoning over Nested Jordan Curves →

arXiv 2605.14068 · HF page · PDF

Technical breakdown

Problem: It is unknown whether vision-language models can perform exact topological reasoning — specifically, recovering the full containment hierarchy of nested Jordan curves from images.

Method: CurveBench is a 756-image diagnostic benchmark across five difficulty configurations: easy, polygonal, topographic-inspired, maze-like, and dense counting. Models must output a rooted tree encoding region containment relations. Evaluated models include Gemini 3.1 Pro, GPT-4, Claude Opus 4.5, and Qwen3-VL-8B. Qwen3-VL-8B is also fine-tuned using RLVR-style training on the benchmark data.

Key results:

  • Gemini 3.1 Pro on CurveBench-Easy: 71.1%; on CurveBench-Hard: 19.1%
  • Qwen3-VL-8B baseline on Easy: 2.8%; RLVR fine-tuned: 33.3%
  • GPT-4 on CurveBench: 5.4%

Why it matters / caveats: The large performance gap between easy and hard configurations (71.1% vs. 19.1% for the best model) shows that exact topology-aware visual reasoning is far from solved. Fine-tuning helps substantially but still leaves a large gap to human-level performance.

BOOKMARKS: Efficient Active Storyline Memory for Role-playing →

arXiv 2605.14169 · HF page · PDF

Technical breakdown

Problem: Role-playing agents require long-horizon memory consistency, but summarization-based memory systems lose important detail during compression, degrading character coherence over extended interactions.

Method: BOOKMARKS implements a search-based memory system where each memory unit ("bookmark") is a question-answer pair anchored to a specific storyline point. For each task, the system actively searches for and selects relevant bookmarks — or initializes new ones — then synchronizes and updates them as the story progresses. Three search types are supported: concept search, behavior search, and state search. Evaluated across 85 characters drawn from 16 artifacts.

Key results:

  • Significantly outperforms all RPA memory baselines across 85 characters and 16 artifacts with reduced token consumption (specific numerical scores not stated in available content)

Why it matters / caveats: The QA-pair anchor design avoids unnecessary recomputation through passive bookmark updating. The evaluation spans a diverse set of characters and source artifacts, suggesting broad applicability. Specific numerical scores and computational cost breakdowns were not surfaced from available content.

WildTableBench: Benchmarking Multimodal Foundation Models on Table Understanding In the Wild →

arXiv 2605.01018 · HF page · PDF

Technical breakdown

Problem: Existing table-understanding benchmarks use clean, digitally-rendered tables and fail to evaluate multimodal models on the visually complex, layout-diverse tables found in real-world settings.

Method: WildTableBench is a QA benchmark of 402 in-the-wild table images collected from online forums and websites, paired with 928 manually annotated questions spanning 17 subtypes across 5 categories (structural perception, numerical reasoning, and others). 21 frontier proprietary and open-source multimodal foundation models were evaluated using exact-match and partial-credit scoring.

Key results:

  • Only 1 out of 21 evaluated models exceeded 50% overall accuracy
  • Remaining 20 models scored between 4.1% and 49.9% accuracy
  • Benchmark scale: 402 images, 928 annotated questions, 17 question subtypes

Why it matters / caveats: Exposes persistent failures in structural perception and numerical reasoning across all frontier multimodal models, suggesting standard clean-table benchmarks significantly overstate real-world capability. The abstract does not break down per-model or per-subtype scores.

Learning to Build the Environment: Self-Evolving Reasoning RL via Verifiable Environment Synthesis →

arXiv 2605.14392 · HF page · PDF

Technical breakdown

Problem: Reinforcement learning for LLM reasoning stagnates when training environments are fixed, because models quickly saturate the difficulty of hand-crafted or statically sampled tasks.

Method: EvoEnv is a single-policy generator-solver framework in which the same model (tested on Qwen3-4B-Thinking) both synthesizes new Python-executable reasoning environments and solves them via RLVR. Environment generation starts from 10 seed tasks and applies a staged validation pipeline: semantic self-review, solver-relative difficulty calibration (environments must be solvable but not trivial for the current policy), and novelty checks. The key design insight is solve-verify asymmetry: environments are algorithmically hard to reason about but trivially checkable as code.

Key results:

  • Qwen3-4B-Thinking average reasoning score: 72.4 → 74.8 (+2.4 pts, +3.3% relative) vs. baseline RLVR on fixed public data
  • Outperforms both fixed public-data RLVR and fixed hand-crafted environment RLVR baselines

Why it matters / caveats: Reframes LLM self-improvement as environment construction rather than data generation, producing reusable executable objects that maintain a persistent difficulty gap. The paper is a work-in-progress tech report; improvements are modest in absolute terms, and only a single model architecture was evaluated.

PhyMotion: Structured 3D Motion Reward for Physics-Grounded Human Video Generation →

arXiv 2605.14269 · HF page · PDF

Technical breakdown

Problem: Existing video reward models rely on 2D perceptual signals and cannot reliably evaluate human motion realism, assigning high scores to physically implausible body movements.

Method: PhyMotion recovers SMPL body meshes from generated video frames, retargets them into a MuJoCo physics simulator, and evaluates motion along three structured dimensions: kinematic plausibility, contact/balance consistency, and dynamic feasibility. Each dimension yields a continuous, interpretable reward signal. This structured 3D physics reward is then used to fine-tune video diffusion models via RL-based optimization.

Key results:

  • Human evaluation (Elo): +68 Elo gain in motion realism under blind pairwise comparison after RL optimization
  • Reward correlation: stronger correlation with human judgments than existing 2D reward formulations
  • Compatible with both autoregressive and bidirectional video generation architectures

Why it matters / caveats: Provides an interpretable, physics-grounded reward signal that guides video generation toward biomechanically valid human motion. The reliance on SMPL mesh recovery and MuJoCo retargeting introduces failure modes when mesh extraction is inaccurate (e.g., occlusions, non-standard body proportions).

PRISM: Prior Rectification and Uncertainty-Aware Structure Modeling for Diffusion-Based Text Image Super-Resolution →

arXiv 2605.13027 · HF page · PDF

Technical breakdown

Problem: Text image super-resolution under severe degradation requires preserving stroke topology and character identity, but unreliable text priors extracted from low-quality inputs and ambiguous stroke boundaries make this extremely difficult for diffusion-based methods.

Method: PRISM is a single-step diffusion-based restoration framework with two components. (1) Flow-Matching Prior Rectification (FMPR): constructs a privileged training-time prior from paired low/high-quality latents and uses flow matching to transport degraded embeddings toward a restoration-oriented prior space. (2) Structure-guided Uncertainty-aware Residual Encoder (SURE): predicts uncertainty-aware structural residuals to selectively incorporate reliable local boundary evidence while suppressing ambiguous stroke cues. The single-step inference design targets millisecond-level latency.

Key results:

  • State-of-the-art on text image super-resolution benchmarks (specific metric values not stated in abstract)
  • Millisecond-level inference latency (single-step diffusion)

Why it matters / caveats: Addresses the distinct requirement of text SR — topological accuracy over visual plausibility — through explicit uncertainty modeling and flow-matching-based prior correction. No concrete benchmark scores are available from the abstract.

Aligning Latent Geometry for Spherical Flow Matching in Image Generation →

arXiv 2605.15193 · HF page · PDF

Technical breakdown

Problem: Euclidean linear interpolation paths in latent flow matching create suboptimal transport trajectories because both Gaussian noise and VAE latents concentrate on spherical shells, leaving the paths curved rather than geodesic in the intrinsic data geometry.

Method: The approach decomposes latent tokens into radial and angular components, projects data latents to a fixed token radius, uses radial projection of Gaussian noise as a spherical prior, and replaces linear interpolation with spherical linear interpolation (slerp) so that geodesic paths remain on the sphere at every timestep. The decoder is fine-tuned with the encoder frozen to accommodate the re-projected latents. No auxiliary encoder or representation-alignment objective is required.

Key results:

  • Consistently improves class-conditional ImageNet-256 FID across multiple image tokenizers (specific FID values not reported in abstract)

Why it matters / caveats: Demonstrates that perceptual/semantic content in latent representations is carried predominantly by direction rather than magnitude, motivating a geometry-aware flow formulation. The paper does not specify which tokenizers were tested or report numerical FID deltas in the abstract.

Sat3DGen: Comprehensive Street-Level 3D Scene Generation from Single Satellite Image →

arXiv 2605.14984 · HF page · PDF

Technical breakdown

Problem: Generating photorealistic street-level 3D scenes from a single satellite image is stymied by the extreme viewpoint gap and sparse supervision, causing existing methods to trade off geometric accuracy against visual diversity.

Method: Sat3DGen adopts a geometry-first methodology that integrates geometric constraints into a feed-forward image-to-3D framework jointly learning geometry and texture. A perspective-view training strategy bridges the satellite-to-street viewpoint gap. Evaluation uses the VIGOR-OOD dataset paired with high-resolution Digital Surface Model (DSM) data.

Key results:

  • Geometric RMSE (VIGOR-OOD): 6.76 m → 5.20 m (vs. prior best)
  • FID: ~40 → 19 (vs. Sat2Density++ baseline)

Why it matters / caveats: The geometry-first design enables downstream photorealistic rendering, multi-camera video generation, and unsupervised DSM estimation. Generalization beyond the VIGOR-OOD satellite imagery domain and to more complex urban geometries is not established.

FutureSim: Replaying World Events to Evaluate Adaptive Agents →

arXiv 2605.15188 · HF page · PDF

Technical breakdown

Problem: Current AI agent benchmarks use static tests and cannot measure whether agents improve by learning from information encountered over extended time periods in dynamic, open-ended environments.

Method: FutureSim is a benchmark that replays real-world events in chronological order, presenting frontier agents with news articles and questions about events that occurred beyond their training knowledge cutoff. Agents forecast world events across a simulated three-month window (January–March 2026), interact with the event stream, and are evaluated using accuracy and Brier skill scores. Agents are tested in their native operational frameworks without special adaptation.

Key results:

  • Best agent accuracy: 25%
  • Many agents achieve a Brier skill score worse than making no prediction at all (below the no-information baseline)
  • Evaluation window: 3 months (January–March 2026)

Why it matters / caveats: Reveals that frontier agents fail at long-horizon test-time adaptation, uncertainty-calibrated forecasting, and reasoning about novel events — capabilities needed for real-world deployment. The evaluation is constrained to a single three-month window, and real-world event occurrence makes the benchmark difficult to reproduce or extend.

Adaptive Teacher Exposure for Self-Distillation in LLM Reasoning →

arXiv 2605.11458 · HF page · PDF

Technical breakdown

Problem: In on-policy self-distillation for LLM reasoning, the teacher model always observes the full reference reasoning chain, creating a mismatch where token-level targets exceed the student's current learning capacity and slow improvement.

Method: ATESD (Adaptive Teacher Exposure for Self-Distillation) introduces a lightweight Beta-policy controller conditioned on training-state statistics that learns the teacher's exposure ratio as a trainable variable rather than a fixed hyperparameter. The controller is optimized with a discounted learning-progress reward scoring each exposure decision by its downstream effect on student improvement. One exposure ratio is sampled per short window of student updates. Experiments use Qwen3 models at 1.7B, 4B, and 8B parameters.

Key results:

  • AIME 2024: +0.95 Average@12 over OPSD baseline
  • AIME 2025: +2.05 Average@12 over OPSD baseline
  • HMMT 2025: +2.33 Average@12 over OPSD baseline

Why it matters / caveats: Identifies teacher-side exposure mismatch as an underexplored design variable in self-distillation, providing a principled adaptive curriculum. Results are limited to mathematical reasoning tasks, code is not yet released, and the Beta-policy controller adds training complexity.

Dynamic Latent Routing →

arXiv 2605.14323 · HF page · PDF

Technical breakdown

Problem: Standard supervised fine-tuning applies uniform computation to all tokens and reasoning steps, failing to allocate resources according to the varying difficulty of sub-problems within a task.

Method: Dynamic Latent Routing (DLR) is a post-training method that jointly learns discrete latent codes, routing policies, and model parameters in a single training stage motivated by General Dijkstra Search (GDS), which enables composition of intermediate optimal sub-policies across time-varying reward functions. The routing mechanism learns distinct causal roles for different latent codes, directing tokens through structured computational paths. Experiments span four datasets and six model sizes.

Key results:

  • Low-data fine-tuning: +6.6 pp mean gain over SFT across 4 datasets and 6 models
  • Matches or outperforms SFT across all evaluated dataset/model combinations
  • Prior discrete-latent baselines consistently underperform SFT; DLR is the first to exceed it

Why it matters / caveats: Demonstrates that dynamic latent routing can learn structured, interpretable reasoning behaviors through a single-stage training procedure. Generalization beyond low-data fine-tuning regimes is unclear, and the specific datasets and model families are not named in the abstract.

Boosting Omni-Modal Language Models: Staged Post-Training with Visually Debiased Evaluation →

arXiv 2605.12034 · HF page · PDF

Technical breakdown

Problem: Omni-modal (audio-visual-language) benchmarks contain visual shortcuts — queries answerable from images alone — that inflate apparent multi-modal performance and obscure genuine audio-visual-language integration failures.

Method: The authors audit 9 omni-modal benchmarks via visual-only probing, identifying and removing shortcut queries to produce OmniClean (8,551 retained queries from 16,968 audited). They then apply OmniBoost, a three-stage post-training recipe on Qwen2.5-Omni-3B: (1) mixed bi-modal supervised fine-tuning (SFT), (2) mixed-modality reinforcement learning with verifiable rewards (RLVR), and (3) SFT on self-distilled data from the trained model.

Key results:

  • OmniClean benchmark: Qwen2.5-Omni-3B with OmniBoost reaches performance comparable to Qwen3-Omni-30B-A3B-Instruct (~10× larger model)
  • Audited 16,968 queries across 9 benchmarks; retained 8,551 after debiasing

Why it matters / caveats: Shows that prior omni-modal benchmark scores are inflated by visual leakage, and that a 3B model can match a 30B model when trained on genuinely multi-modal signal and evaluated on debiased benchmarks. Per-benchmark scores and the self-distillation stage's isolated contribution are not reported in the abstract.

Topology-Preserving Neural Operator Learning via Hodge Decomposition →

arXiv 2605.13834 · HF page · PDF

Technical breakdown

Problem: Learning solution operators for physical field equations while preserving topological properties is impeded by spectral interference that prevents accurate learning of certain degrees of freedom.

Method: The paper proposes a Hybrid Eulerian-Lagrangian architecture incorporating Hodge Spectral Duality (HSD) as an algebraic-level inductive bias. Discrete differential forms capture topology-dominated components while an orthogonal auxiliary ambient space represents complex local dynamics. The decomposition is grounded in Hodge theory and operator splitting, applied at the operator level rather than the network level.

Key results:

  • Not stated (abstract only states "superior accuracy and efficiency on geometric graphs with enhanced fidelity to physical invariants")

Why it matters / caveats: Using Hodge decomposition to isolate learnable from topologically constrained components is a principled approach to improving neural operators on mesh-based physics problems. No concrete benchmark numbers are provided in the available abstract.

RewardHarness: Self-Evolving Agentic Post-Training →

arXiv 2605.08703 · HF page · PDF

Technical breakdown

Problem: Reward models for evaluating instruction-guided image edits require large-scale preference annotations, whereas humans can infer evaluation criteria from far fewer examples.

Method: RewardHarness frames reward modeling as context evolution rather than weight optimization. An Orchestrator selects relevant tools and skills from a maintained library; a frozen Sub-Agent constructs reasoning chains for preference judgments. The library is refined by comparing predictions against ground-truth preferences without additional human annotation, using only 100 preference demonstrations. The system uses GRPO fine-tuning when deployed as a training reward signal.

Key results:

  • EditReward benchmark (accuracy): 47.4% average using only 0.05% of preference data
  • EditReward vs. GPT-5: +5.3 points
  • ImgEdit-Bench score (as GRPO reward signal): 3.52

Why it matters / caveats: Demonstrates that an agentic, data-efficient approach using 100 demonstrations can outperform a much larger fully-supervised model (GPT-5) on image-editing evaluation. Failure modes, computational cost, and generalization beyond image editing are not discussed.

Unlocking Complex Visual Generation via Closed-Loop Verified Reasoning →

arXiv 2605.14876 · HF page · PDF

Technical breakdown

Problem: Text-to-image models relying on single-step generation struggle with complex semantics, while multi-step approaches suffer from unverified hallucinations, optimization instabilities, and high inference latency.

Method: The CLVR (Closed-Loop Visual Reasoning) framework couples visual-language logical planning with pixel-level diffusion using an automated data engine with step-level visual verification. Proxy Prompt Reinforcement Learning (PPRL) resolves long-context optimization by distilling multimodal histories into explicit reward signals. Delta-Space Weight Merge (DSWM) fuses alignment weights with distillation priors, achieving 4 Neural Function Evaluations (NFEs) without expensive re-distillation.

Key results:

  • Not stated (abstract states CLVR "outperforms existing open-source baselines across multiple benchmarks and approaches the performance of proprietary commercial models")

Why it matters / caveats: Introduces test-time scaling for complex visual generation by combining planning, verification, and efficient weight merging. No concrete benchmark numbers are provided in the abstract, limiting direct comparison with prior work.

LLM-based Detection of Manipulative Political Narratives →

arXiv 2605.14354 · HF page · PDF

Technical breakdown

Problem: Distinguishing manipulative political narratives from legitimate political criticism in social media at scale, while also identifying previously unknown narrative patterns, is an unsolved challenge.

Method: The pipeline applies few-shot prompt filtering using documented campaign narratives to classify posts as manipulative, followed by UMAP dimensionality reduction and HDBSCAN unsupervised clustering to group posts by latent narrative structure. LLM-based cluster interpretation then labels each discovered narrative. The method is applied to over 1.2 million social media posts.

Key results:

  • Distinct manipulative narrative clusters identified: 41

Why it matters / caveats: Enables scalable, category-agnostic discovery of manipulation campaigns without predefined taxonomies. Validation metrics (precision, recall, F1) and human evaluation results are not reported, and no comparison to baseline detection methods is provided.

Ideology Prediction of German Political Texts →

arXiv 2605.14352 · HF page · PDF

Technical breakdown

Problem: Automatically classifying German political texts along a continuous left-to-right ideological spectrum requires models that generalize across diverse text types (parliamentary speech, social media, news, policy tools).

Method: Thirteen transformer models are evaluated using four corpora: annotated Bundestag plenary notes, Wahl-O-Mat decision tool data, 33 newspapers with identified political orientations, and 535,200 tweets from 597 Bundestag members. Political orientation is projected onto a normalized scalar d in [-1, 1]. Training and testing use separate corpora to reduce overfitting. Models evaluated include DeBERTa-large and Gemma2-2B among others.

Key results:

  • DeBERTa-large (in-domain): F1 = 0.844
  • DeBERTa-large (Twitter out-of-domain): Accuracy = 0.864
  • Gemma2-2B (newspaper out-of-domain): MAE = 0.172

Why it matters / caveats: Demonstrates that transformers can recognize political framing in German news at a level matching public opinion polls. Authors note that domain-specific training data can be as influential as model size, and discuss limitations in bias measurement robustness.

Boosting Reinforcement Learning with Verifiable Rewards via Randomly Selected Few-Shot Guidance →

arXiv 2605.15012 · HF page · PDF

Technical breakdown

Problem: Reinforcement Learning with Verifiable Rewards (RLVR) lacks sample efficiency on difficult problems where generating correct rollouts is rare, and existing demonstration-guided approaches require extensive data acquisition.

Method: FEST (FEw-ShoT demonstration-guided RLVR) combines three components: a supervised signal from 128 randomly selected demonstrations drawn from an SFT dataset, an on-policy RL signal, and decaying weights applied to few-shot SFT data across training epochs to mitigate overfitting. The method targets chain-of-thought reasoning on math and coding tasks.

Key results:

  • Not stated (abstract claims FEST "outperforms baselines with magnitudes less SFT data, even matching their performance with full dataset" across multiple benchmarks)

Why it matters / caveats: Shows that 128 demonstration examples can match full-dataset RLVR performance, substantially reducing annotation costs for LLM training. Specific numbers for individual benchmarks are not provided in the abstract.

BEAM: Binary Expert Activation Masking for Dynamic Routing in MoE →

arXiv 2605.14438 · HF page · PDF

Technical breakdown

Problem: Standard Mixture-of-Experts models use fixed Top-K routing, causing redundant computation and suboptimal inference latency, while existing acceleration methods require costly retraining or suffer significant performance drops.

Method: BEAM learns token-adaptive expert selection through trainable binary masks paired with a straight-through estimator and an auxiliary regularization loss. Inference is accelerated by a custom CUDA kernel integrated with vLLM. No architectural changes or full retraining are required.

Key results:

  • Model performance retention: >98% of original performance
  • MoE layer FLOPs reduction: up to 85%
  • Decoding speedup: up to 2.5×
  • Throughput improvement: 1.4×

Why it matters / caveats: Provides a plug-and-play path to dramatically reduced MoE inference costs without retraining. The abstract does not name specific baseline models, does not compare against other acceleration methods, and omits discussion of memory overhead or task-specific performance variation.

LiSA: Lifelong Safety Adaptation via Conservative Policy Induction →

arXiv 2605.14454 · HF page · PDF

Technical breakdown

Problem: AI agents accessing private data, calling tools, and executing workflows face safety failures that depend on local policies and privacy norms that cannot be pre-specified, and must adapt from sparse and noisy deployment feedback without repeated fine-tuning.

Method: LiSA is a conservative policy induction framework that improves a fixed base guardrail through structured memory. It converts safety failures into reusable policy abstractions, adds conflict-aware local rules to prevent overgeneralization in mixed-label scenarios, and applies evidence-aware confidence gating via a posterior lower bound for scaled memory reuse. Evaluated on PrivacyLens+, ConFaide+, and AgentHarm datasets.

Key results:

  • Consistently outperforms strong memory-based baselines under sparse feedback on PrivacyLens+, ConFaide+, and AgentHarm (specific numeric values not stated in abstract)
  • Robustness maintained at 20% label-flip rate

Why it matters / caveats: Addresses the practical deployment gap where guardrails cannot be repeatedly fine-tuned in production. The conservative policy approach reduces dangerous overgeneralization from noisy signals. Limitations include dependence on base guardrail quality and reliance on user-reported failures as the learning signal.

Nexus: An Agentic Framework for Time Series Forecasting →

arXiv 2605.14389 · HF page · PDF

Technical breakdown

Problem: Time series forecasting requires reasoning with unstructured contextual data such as news and events alongside numerical patterns, but existing methods treat the two modalities separately, degrading performance on event-driven series.

Method: Nexus is a multi-agent framework that decomposes prediction into stages isolating macro-level and micro-level temporal fluctuations, then integrates contextual information before synthesizing a final forecast. LLMs handle contextual reasoning while separate agents adapt to seasonal and event-driven signals. Evaluated on Zillow real estate metrics and volatile stock market equities using data strictly after LLM knowledge cutoffs.

Key results:

  • Consistently matches or outperforms state-of-the-art Time Series Foundation Models (TSFMs) and strong LLM baselines on Zillow and stock benchmarks (specific numeric values not stated in abstract)

Why it matters / caveats: Demonstrates that LLMs have stronger intrinsic forecasting ability than previously recognized when numerical and contextual reasoning are properly staged. The framework produces interpretable reasoning traces. Detailed numeric comparisons are not provided in the abstract.

Quantitative Video World Model Evaluation for Geometric-Consistency →

arXiv 2605.15185 · HF page · PDF

Technical breakdown

Problem: Evaluating whether generative video models produce physically plausible 3D structure and motion is difficult because existing pipelines rely on subjective human judgment rather than quantitative geometric assessment.

Method: The authors introduce PDI-Bench (Perspective Distortion Index benchmark), which obtains object-centric observations via SAM 2 (segmentation), MegaSaM and CoTracker3 (point tracking), then lifts observations to 3D via monocular reconstruction. Projective-geometry residuals are computed across three failure dimensions: scale-depth alignment, 3D motion consistency, and 3D structural rigidity. Evaluation uses PDI-Dataset with diverse scenarios stressing geometric constraints.

Key results:

  • Not stated (abstract states "PDI reveals consistent geometry-specific failure modes that are not captured by common perceptual metrics")

Why it matters / caveats: PDI provides diagnostic signals for progress toward physically grounded video generation, filling a gap where standard perceptual metrics miss 3D-geometric failures. The framework depends on upstream tools (SAM 2, MegaSaM, CoTracker3) whose errors can propagate through the pipeline.

SPIN: Structural LLM Planning via Iterative Navigation for Industrial Tasks →

arXiv 2605.14051 · HF page · PDF

Technical breakdown

Problem: Industrial LLM planning systems generate structurally invalid or excessively long workflows (DAGs), causing task failures and unnecessary API costs.

Method: SPIN combines validated Directed Acyclic Graph (DAG) planning with prefix-based execution control. DAG validity is enforced via _validate_plan_text and repair prompting. Incremental DAG prefix evaluation terminates execution as soon as the current prefix sufficiently answers a query. Evaluated on AssetOpsBench (261 scenarios) and MCP Bench using GPT OSS1 and Llama 4 Maverick.

Key results:

  • AssetOpsBench — Executed tasks: reduced from 1,061 to 623
  • AssetOpsBench — Accomplished metric: improved from 0.638 to 0.706
  • AssetOpsBench — Tool calls per run: reduced from 11.81 to 6.82

Why it matters / caveats: Directly reduces real industrial API costs and improves task completion rates through structural plan enforcement and early stopping. The approach requires well-structured tool environments supporting DAG contracts; generalization beyond the two tested benchmarks is not discussed.

PreScam: A Benchmark for Predicting Scam Progression from Early Conversations →

arXiv 2605.12243 · HF page · PDF

Technical breakdown

Problem: Language models' ability to predict how real-world conversational scams progress through multi-turn exchanges — where scammers gradually manipulate victims using evolving psychological techniques — has not been systematically benchmarked.

Method: PreScam is constructed by filtering and structuring 177,989 raw scam reports into 11,573 conversational scam instances spanning 20 scam categories from user-submitted reports. Each instance is hierarchically organized according to a proposed scam kill chain with turn-level annotations for scammer psychological actions and victim responses. Two tasks are benchmarked: real-time termination prediction and scammer action prediction. Both supervised encoders and zero-shot LLMs are evaluated.

Key results:

  • Supervised encoders substantially outperform zero-shot LLMs on real-time termination prediction (specific values not stated)
  • Scammer action prediction: only moderately successful even for strong LLMs (specific values not stated)
  • Dataset: 11,573 instances, 20 scam categories, sourced from 177,989 raw reports

Why it matters / caveats: Provides the first structured benchmark for scam progression modeling, critical for real-time fraud detection systems. Current models still struggle to track escalating risk and manipulation dynamics across conversation turns.

Overcoming Dynamics-Blindness: Training-Free Pace-and-Path Correction for VLA Models →

arXiv 2605.11459 · HF page · PDF

Technical breakdown

Problem: Vision-Language-Action models trained on single-frame observations cannot perceive temporal dynamics, causing severe performance degradation in non-stationary environments even when dynamic training data is included.

Method: Pace-and-Path Correction is a training-free, closed-form inference operator wrapping chunked-action VLA models. A quadratic cost function is minimized jointly and decomposes orthogonally into two channels: pace (compressing action execution along the planned direction) and path (applying an orthogonal spatial offset). This absorbs perceived environment dynamics within action chunk windows without modifying VLA weights or requiring any retraining.

Key results:

  • MoveBench (dynamic-only environments): +28.8% absolute improvement over foundational VLA models
  • MoveBench (static-dynamic mixed environments): +25.9% absolute improvement over foundational VLA models
  • Outperforms state-of-the-art training-free wrappers and dynamic-adaptive methods

Why it matters / caveats: Addresses a fundamental architectural blind spot in prevalent VLA systems with no retraining or latency overhead. Evaluation is conducted exclusively on MoveBench, a diagnostic benchmark isolating motion as a controlled variable, which may limit claims of generalizability to real-world robotics tasks with multiple interacting factors.

End of digest — 53 papers from HuggingFace daily papers 2026-05-15

← 2026-05-142026-05-152026-05-18 →