Ground Truth.
AI, checked against the source.

AI papers — 2026-05-26

Every paper on Hugging Face's Daily Papers list, most-upvoted first — each linked to arXiv, with a plain-English summary and a technical breakdown underneath.Both are AI-written — the summary from the authors' abstract, the breakdown from the paper's full text — and are not individually fact-checked by us. The paper itself is the source.
← 2026-05-232026-05-262026-05-27 →
Jump to one of 16 papers
  1. DVAO: Dynamic Variance-adaptive Advantage Optimization for Multi-reward Reinforcement Learning
  2. Macaron-A2UI: A Model for Generative UI in Personal Agents
  3. WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation
  4. Foundation Protocol: A Coordination Layer for Agentic Society
  5. TriSplat: Simulation-Ready Feed-Forward 3D Scene Reconstruction
  6. ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learning
  7. Toward Native Multimodal Modeling: A Roadmap
  8. AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery
  9. QUEST: Training Frontier Deep Research Agents with Fully Synthetic Tasks
  10. ThriftAttention: Selective Mixed Precision for Long-Context FP4 Attention
  11. Your Embedding Model is SMARTer Than You Think
  12. Pantheon360: Taming Digital Twin Generation via 3D-Aware 360° Video Diffusion
  13. ControlLight: Towards Controllable, Consistent, and Generalizable Low-Light Enhancement
  14. On-Policy Adversarial Flow Distillation for Autoregressive Video Generation
  15. Anticipate and Learn: Unleashing Idle-Time Compute in Proactive Agents
  16. Claw-Anything: Benchmarking Always-On Personal Assistants with Broader Access to User's Digital World

DVAO: Dynamic Variance-adaptive Advantage Optimization for Multi-reward Reinforcement Learning →

arXiv 2605.25604 · ▲ 113 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Standard reward scalarization in Group Relative Policy Optimization (GRPO) causes training instability and ignores inter-objective correlations when applied to multi-reward reinforcement learning for LLM alignment.

Method: DVAO dynamically adjusts per-objective combination weights based on empirical reward variance computed within each rollout group, prioritizing objectives with stronger learning signals and suppressing noisy ones. The approach provides mathematical guarantees for bounded advantage magnitudes and introduces self-adaptive cross-objective regularization layered on top of GRPO. Models trained include Qwen3-4B-Base, Qwen3-8B-Base (mathematical reasoning) and Qwen2.5-3B-Instruct, Qwen2.5-7B-Instruct (tool use).

Key results:

  • Qwen3-4B-Base: AIME-2024 16.87%, AIME-2025 13.54%, MATH500 81.36%, OlympiadBench 45.63%, AMC23 53.53% (avg 42.19% accuracy; 99.91% length compliance)
  • Qwen3-8B-Base: AIME-2024 21.87%, AIME-2025 18.33%, MATH500 86.10%, OlympiadBench 50.62%, AMC23 60.54% (avg 47.49% accuracy; 99.92% length compliance)
  • Qwen2.5-7B-Instruct on tool-use: Live 79.68%, Non-Live 87.06%, Multi-Turn 22.25% (avg 63.00% accuracy; 79.21% format compliance)
  • Achieves a superior multi-objective Pareto frontier vs. baseline scalarization methods

Why it matters / caveats: DVAO directly addresses a practical bottleneck in multi-objective RLHF pipelines where naively combining rewards degrades training. The evaluations cover both reasoning and tool-use tasks, but multi-turn tool use accuracy remains low (22.25%), suggesting that domain is still challenging regardless of the optimization method.

Macaron-A2UI: A Model for Generative UI in Personal Agents →

arXiv 2605.24830 · ▲ 58 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Static plain-text chat is becoming a bottleneck for personal agents handling complex multi-goal tasks that require information collection, preference refinement, and structured confirmation.

Method: Macaron-A2UI is trained to generate natural language interleaved with lightweight, executable UI actions (for information collection, preference refinement, confirmation, and multi-goal organization) using a large-scale generative UI corpus built from diverse dialogue sources. Training uses LoRA-based supervised fine-tuning followed by reward-driven reinforcement learning. Three model sizes were trained: 30B, 235B, and 754B parameters. The A2UI-Bench benchmark was introduced for controlled evaluation.

Key results:

  • Best model achieves 75.6 overall score on A2UI-Bench without explicit schema hints
  • Surpasses the strongest full-schema frontier baseline on A2UI-Bench
  • Models, benchmark, and evaluation protocol are publicly released

Why it matters / caveats: Generative UI for agents is an underexplored modality that could meaningfully improve human-AI interaction richness beyond text; the release of A2UI-Bench enables future benchmarking. The very large model sizes (up to 754B) may limit practical deployment for many users.

WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation →

arXiv 2605.25874 · ▲ 55 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Existing evaluations for interactive video world models lack multi-turn, multi-dimension assessment that covers video quality, setting adherence, interaction adherence, consistency, and physical compliance simultaneously.

Method: WBench provides 289 test cases with 1,058 interaction turns spanning four interaction types (navigation, subject action, event editing, perspective switching) in both first-person (62%) and third-person (38%) perspectives. Evaluation uses 22 automatic sub-metrics combining specialist vision models with large multimodal models, validated against human judgments via Spearman correlation. For navigation, the benchmark unifies text, 6-DoF pose, and discrete-action control to enable cross-model comparison. Twenty state-of-the-art models are evaluated.

Key results:

  • Navigation: best model HY-World 1.5 scores 87.5/100; text-driven average 67.6/100
  • Consistency: LingBot-World leads at 89.9/100 overall (spatial consistency 92.7/100); overall average 83.1/100
  • Physical compliance: Wan 2.7 leads at 71.8/100; action-conditioned average 61.7/100
  • Human alignment: all 10 evaluation aspects achieve Spearman ρ ≥ 0.94; four reach ρ = 1.00
  • No single model performs strongly across all five dimensions

Why it matters / caveats: WBench exposes that current world models trade off between quality dimensions, providing a diagnostic tool for targeted improvement. Coverage is limited to the 20 models tested and may not generalize to future architectures.

Foundation Protocol: A Coordination Layer for Agentic Society →

arXiv 2605.23218 · ▲ 53 on Hugging Face · HF page · PDF

Technical breakdown

Problem: There is no unified coordination layer enabling heterogeneous AI agents, tools, resources, humans, and institutions to form reliable relationships, exchange value, and operate with provenance and accountability at scale.

Method: Foundation Protocol (FP) is a graph-first coordination layer that unifies heterogeneous entity types (agents, tools, resources, humans, institutions, organizations) in a single framework. It supports multi-party organization, event-based collaboration, economic primitives for metering and settlement, and treats policy, provenance, and audit as first-class concerns. FP is designed to wrap existing protocols incrementally rather than replace them, maintaining composability.

Key results:

  • Not stated

Why it matters / caveats: FP targets a genuine gap in multi-agent infrastructure: the lack of a standard for inter-agent economic and accountability relationships. As a protocol proposal rather than an empirical system, its real-world impact depends on adoption, and no implementation or benchmark evaluation is presented.

TriSplat: Simulation-Ready Feed-Forward 3D Scene Reconstruction →

arXiv 2605.26115 · ▲ 32 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Existing feed-forward Gaussian splatting methods require expensive post-processing pipelines to convert reconstructions into simulation-ready meshes compatible with physics engines and standard rendering pipelines.

Method: TriSplat represents scenes with oriented triangle primitives instead of Gaussians and directly exports meshes from a single forward pass. It predicts local 3D point maps from input images, computes geometry normals from those point maps, refines them with an image-conditioned normal head, and converts them into stable local frames for triangle orientation. Training uses a mono-normal bootstrap schedule, plus opacity and blur scheduling for progressive surface sharpening. Evaluated on RealEstate10K (RE10K) and DL3DV datasets.

Key results:

  • DL3DV surface quality: Chamfer Distance 0.613 vs. YoNoSplat 0.920; F1 Score 0.287 vs. YoNoSplat 0.106
  • RE10K mesh rendering: PSNR 24.69 dB (+2.75 dB over YoNoSplat's 21.94 dB); SSIM 0.798; LPIPS 0.269
  • Zero-shot ScanNet (trained on RE10K): absolute relative depth error 0.188 (best); normal accuracy (<30°) 71.708% vs. YoNoSplat 41.047%
  • Time-to-mesh on single H100: 0.57 s (6 views), 1.23 s (24 views); 33× faster than fastest Gaussian baseline at 6 views

Why it matters / caveats: Eliminating post-processing for simulation-ready meshes is practically significant for robotics, gaming, and digital twins. The 33× speed advantage is measured against Gaussian baselines specifically for mesh extraction, not novel-view rendering quality where Gaussians remain competitive.

ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learning →

arXiv 2605.20342 · ▲ 28 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Sequential tool-calling in video understanding agents causes error propagation, high latency, and context loss; naive parallel tool use via RL fails because pretrained tool priors simultaneously enable exploration and destabilize structural formatting.

Method: ParaVT is a multi-agent end-to-end RL framework that dispatches multiple time-window video crops to parallel tool calls simultaneously. It trains using PARA-GRPO, which augments standard GRPO with two mechanisms: targeted format rewards applied at structural-token positions, and per-prompt frame-budget randomization. The base model is Qwen3-VL; training and evaluation span six long-video understanding benchmarks.

Key results:

  • +7.9% average improvement over Qwen3-VL baseline across six long-video understanding benchmarks
  • Format compliance increased from 0.13 to 0.64 during PARA-GRPO training

Why it matters / caveats: Parallel video tool use is a practical efficiency gain for long-video reasoning agents, and the Tool Prior Paradox diagnosis is a useful conceptual contribution. The reported +7.9% improvement is an average across six benchmarks; per-benchmark breakdown was not available from the abstract.

Toward Native Multimodal Modeling: A Roadmap →

arXiv 2605.25343 · ▲ 24 on Hugging Face · HF page · PDF

Technical breakdown

Problem: There is no systematic framework distinguishing architecturally "native" multimodal models from conventional ones, nor a comprehensive guide covering data, training, inference, and evaluation for building such systems.

Method: The paper formalizes the concept of architectural nativity for multimodal models, distinguishing mid-fusion and early-fusion from conventional late-fusion approaches. It categorizes existing models into three types: Multi-to-Text (comprehension), Multi-to-Target (generation), and Multi-to-Multi (unified symmetric input/output). The roadmap covers the full pipeline—architectural coordination, data curation, training recipes, inference and deployment strategies, and evaluation frameworks—all within a unified transformer paradigm. The paper is 52 pages with ~300 references.

Key results:

  • Not stated (roadmap/survey paper with no empirical experiments)

Why it matters / caveats: A well-structured taxonomy and roadmap for native multimodal modeling can guide future research and standardize terminology across an otherwise fragmented field. As a conceptual survey rather than an experimental paper, findings are organizational rather than empirical.

AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery →

arXiv 2605.23204 · ▲ 21 on Hugging Face · HF page · PDF

Technical breakdown

Problem: AI-powered scientific research automation lacks systematic analysis of its capabilities and limitations across the full research workflow, from literature grounding to hypothesis generation, experimentation, validation, and reporting.

Method: The paper surveys the developmental spectrum of AI research systems from prompt-assisted "Vibe Research" to autonomous AI-led pipelines. It organizes the field around five workflow conditions: literature and research grounding, hypothesis formation and planning, experimentation and tool use, feedback/validation/review, and reporting and knowledge communication. Systems analyzed include AI scientist systems, mixed-initiative co-research frameworks, benchmarks, domain deployments, and open-source infrastructures. Five evaluation dimensions are proposed: novelty, validity, impact, reliability, and provenance.

Key results:

  • Not stated (survey paper)

Why it matters / caveats: The paper's conclusion that AutoResearch autonomy is domain-conditioned—more credible in structured, executable, and rapidly verifiable settings—is a practically important framing for deploying AI in science. Current limitations identified include evidence preservation, reproducibility, weak-direction rejection, and accountable scientific closure.

QUEST: Training Frontier Deep Research Agents with Fully Synthetic Tasks →

arXiv 2605.24218 · ▲ 19 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Training open-weight models to perform long-horizon deep research tasks (fact seeking, citation grounding, report synthesis) at frontier quality requires expensive human annotation or proprietary data.

Method: QUEST is a family of open-weight models (2B to 35B parameters) trained with a three-stage recipe: mid-training, supervised fine-tuning, and reinforcement learning. Training data is generated by a fully synthetic pipeline using unified rubric trees that produce tasks with verifiable rewards across different task types, requiring no human annotation. A built-in context management mechanism handles long-horizon reasoning across extended search sessions. All model weights, training data, and scripts are released publicly.

Key results:

  • Trained on only 8,000 synthesized tasks
  • Approaches or surpasses frontier closed-source agents across 8 deep research benchmarks
  • Achieves best overall performance among recent open-weight agents
  • (Specific per-benchmark scores not available; paper marked as work in progress)

Why it matters / caveats: Achieving near-frontier deep research performance with only 8,000 synthetic training examples is a strong data efficiency result, and full open-source release accelerates community research. As a work-in-progress paper, final benchmark numbers may change and some claims should be treated as preliminary.

ThriftAttention: Selective Mixed Precision for Long-Context FP4 Attention →

arXiv 2605.23081 · ▲ 18 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Block-scaled FP4 quantization of attention on Blackwell GPUs causes significant quality degradation in long-context settings because quantization error concentrates in the most important query-key interactions.

Method: ThriftAttention is a two-stage mixed-precision attention variant. In stage one, a lightweight heuristic identifies a small number of critical query-key block pairs (the highest-importance interactions) for FP16 computation. In stage two, selected blocks are computed in FP16 and all remaining blocks in FP4; both paths are merged via online softmax into a single output. The approach requires no model retraining and is applied at inference time on top of existing Blackwell GPU FP4 attention kernels.

Key results:

  • Computing only 5% of query-key blocks in FP16 recovers on average 89.1% of the FP4-to-FP16 quality gap across long-context benchmarks and model families
  • Quality advantage grows with increasing sequence length

Why it matters / caveats: ThriftAttention offers near-FP16 quality at FP4 efficiency for long-context inference with minimal overhead, which is practically important as context windows grow. The method is specific to Blackwell GPUs with block-scaled FP4 attention and may require adaptation for other hardware or quantization schemes.

Your Embedding Model is SMARTer Than You Think →

arXiv 2605.24938 · ▲ 17 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Single-vector embedding models discard fine-grained local evidence critical for dense retrieval by compressing token sequences into one global representation, while multi-vector approaches require dedicated training.

Method: SMART (framework name) demonstrates that contrastive training on pooled embeddings implicitly shapes the retrieval geometry in preceding hidden states via gradient flow. At inference, SMART applies late-interaction scoring over frozen hidden states of standard single-vector models as a plug-and-play upgrade requiring no retraining. An optional lightweight adapter post-training step provides additional gains. Evaluated on MMEB-V2 and Visual Document Retrieval (VDRv1, VDRv2) benchmarks.

Key results:

  • VLM2Vec-V2.0 on MMEB-V2: +2.54 pp improvement (64.50% → 67.04%)
  • Qwen3-VL-Embedding-2B on MMEB-V2: +0.90 pp (74.87% → 75.77%)
  • Qwen3-VL-Embedding-8B on MMEB-V2: +0.51 pp (78.83% → 79.34%)
  • With adapter post-training, Qwen3-VL-Embedding-2B surpasses jina-embeddings-v4 (80.91%) with only 1 hour 50 minutes of training
  • Local evidence toy benchmark: single-vector baseline 31.9%, late-interaction alone 56.8%
  • Adapter training ~20% faster than traditional multi-vector training (9.5 h vs 12 h) while approaching equivalent performance

Why it matters / caveats: SMART offers a zero-cost inference-time upgrade to existing deployed embedding models, which is practically significant. The gains diminish at larger model scales (0.51 pp for the 8B model), suggesting diminishing returns as base model quality increases.

Pantheon360: Taming Digital Twin Generation via 3D-Aware 360° Video Diffusion →

arXiv 2605.25449 · ▲ 15 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Perspective video generators have limited field of view, requiring lengthy camera trajectories that introduce geometric inconsistencies when generating full digital twin environments.

Method: Pantheon360 generates 360° panoramic videos from sparse inputs using a diffusion model guided by an explicit 3D Cache reconstructed from the input. The 3D Cache serves as a geometric scaffold for any user-defined camera path, enforcing global geometric consistency. The diffusion model then focuses on photorealistic texture refinement on top of this scaffold. Accepted at CVPR 2026.

Key results:

  • Web360 (single 360° view-to-video): FVD 356.151, SSIM 0.746, PSNR 22.838 dB, LPIPS 0.065, MET3R 0.2840 (vs. best baseline GEN3C: FVD 380.080, SSIM 0.583, PSNR 20.730, LPIPS 0.145)
  • Habitat (sparse 360° views-to-video): FVD 450.696, SSIM 0.756, PSNR 20.392 dB, LPIPS 0.091, MET3R 0.3026 (vs. GEN3C: FVD 511.039, SSIM 0.481, PSNR 17.307)
  • Ablation on Google Street View: dual-anchor variant with latent fusion achieves PSNR 28.95

Why it matters / caveats: Reliable 360° scene generation with geometric coherence is a key capability for simulation and digital twin applications. The method's reliance on a pre-reconstructed 3D Cache means it requires sufficient input coverage; performance with very sparse or low-quality inputs is not characterized.

ControlLight: Towards Controllable, Consistent, and Generalizable Low-Light Enhancement →

arXiv 2605.25569 · ▲ 12 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Existing low-light enhancement methods lack continuous, user-controllable illumination strength while maintaining visual consistency across enhancement levels and generalizing to real-world degradations.

Method: ControlLight trains a flow-matching diffusion model on a large-scale dataset of real-world degraded images annotated with continuous illumination-strength labels. A misalignment-aware weighted flow matching loss is introduced to preserve structural consistency across different enhancement strengths. The framework is evaluated on paired benchmarks (LOL-v1, LWSR) and real-world datasets (DICM, LIME, RealIR-Bench) using perceptual quality metrics (CLIP-IQA, MANIQA, MUSIQ, NIQE) rather than PSNR/SSIM.

Key results:

  • LOL-v1 MUSIQ: 70.20; LWSR MUSIQ: 68.39
  • RealIR-Bench: CLIP-IQA 0.550, MANIQA 0.491, MUSIQ 67.96
  • Controllability on RealIR-Bench: δsmooth 0.2195, CLIP-Dir 0.9138 (substantially outperforms CLE Diffusion and ConceptSlider)
  • Ablation: weighted flow matching loss improves LI-LPIPS from 0.2237 to 0.2148

Why it matters / caveats: Continuous illumination control is a practically useful feature for photography and surveillance applications. The deliberate de-emphasis of PSNR/SSIM metrics in favor of perceptual quality scores makes direct comparison to prior PSNR-focused methods non-trivial.

On-Policy Adversarial Flow Distillation for Autoregressive Video Generation →

arXiv 2605.26105 · ▲ 12 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Distilling strong black-box teacher video generators into causal autoregressive student models is difficult because students must learn from their own rollout distribution while teachers differ in architecture, precluding direct score or latent access.

Method: Adversarial Flow Distillation (AFD) queries both teacher and student on identical prompts, trains a prompt-paired Bradley-Terry discriminator to identify performance gaps, derives on-policy advantage signals from discriminator outputs, and applies forward-process flow-matching updates to the student's denoised states. The method requires only clean teacher output videos and student rollouts—no teacher scores or internal latents. Evaluated on two causal autoregressive student families: Self-Forcing and Causal-Forcing.

Key results:

  • Self-Forcing + AFD: VBench Physics Total 87.55 (vs. GAN 83.83, DMD 81.88, SFT 58.69); General Total 60.83; Motion Quality 0.605; Physical Consistency 4.20
  • Causal-Forcing + AFD: VBench Physics Total 88.52 (vs. GAN 83.07, DMD 82.52, SFT 76.24); General Total 59.83; Motion Quality 0.661; Physical Consistency 4.24
  • Best Physics VBench Total across both student architectures while preserving general video quality

Why it matters / caveats: AFD enables black-box teacher distillation for streaming/interactive video generation, which is practically significant given that the best video generators are proprietary. The general video quality metric (59–61) is noticeably lower than physics quality (87–89), suggesting a quality tradeoff that practitioners should consider.

Anticipate and Learn: Unleashing Idle-Time Compute in Proactive Agents →

arXiv 2605.25971 · ▲ 11 on Hugging Face · HF page · PDF

Technical breakdown

Problem: AI agents are purely reactive, wasting idle time between user interactions that could be used to anticipate and pre-fetch information for likely upcoming user needs.

Method: ProAct is a proactive agent architecture that analyzes dialogue history with persistent memory to predict future user needs and iteratively acquires relevant information before being asked. ProActEval is a new benchmark of 200 scenarios across 40 domains with predictable need chains and diverse user cognitive profiles, designed to assess proactive capability. The architecture is evaluated on MemBench for memory performance alongside ProActEval.

Key results:

  • 14.8% reduction in required interaction turns for task completion
  • 11.7% decrease in user effort
  • 28.1% reduction in hallucination rates
  • State-of-the-art reflective accuracy on MemBench

Why it matters / caveats: Idle-time compute for proactive information gathering is a straightforward but underexplored way to improve agent efficiency and reduce hallucinations. The 200-scenario ProActEval benchmark is relatively small, and results are measured against the agent's own baseline rather than a wide set of competing proactive systems.

Claw-Anything: Benchmarking Always-On Personal Assistants with Broader Access to User's Digital World →

arXiv 2605.26086 · ▲ 11 on Hugging Face · HF page · PDF

Technical breakdown

Problem: Existing agent benchmarks evaluate over narrow data slices and short activity histories, failing to capture the complexity of always-on personal assistants that must reason across months of activity, interdependent backend services, and integrated GUI/CLI interaction.

Method: Claw-Anything simulates months of realistic user activity with irrelevant events and conflicting signals across three expanded context dimensions: extended activity histories, interdependent backend services, and integrated GUI/CLI interaction across devices. Evaluation uses multi-round event injection to produce complex world states requiring noise-robust, context-sensitive reasoning and proactive assistance. An automated data-generation pipeline produces 2,000 training environments.

Key results:

  • GPT-5.5 achieves 34.5% pass@1 on the benchmark, indicating substantial gaps in current agent capabilities
  • Training on the generated pipeline data improved the base model by 23.7%

Why it matters / caveats: The low 34.5% score for GPT-5.5 highlights that always-on personal assistance over broad digital context remains far from solved, making this benchmark a useful long-term research target. The 23.7% improvement from synthetic training data suggests the benchmark's data pipeline is also useful for training, not just evaluation.

← 2026-05-232026-05-262026-05-27 →