AI papers — 2026-07-10
Jump to one of 20 papers
- Vidu S1: A Real-Time Interactive Video Generation Model
- Why Can't I Open My Drawer? Mitigating Object-Driven Shortcuts in Zero-Shot Compositional Action Recognition
- Video-Oasis: Rethinking Evaluation of Video Understanding
- UniClawBench: A Universal Benchmark for Proactive Agents on Real-World Tasks
- Ideas Have Genomes: Benchmarking Scientific Lineage Reasoning and Lineage-Grounded Idea Generation
- LongE2V: Long-Horizon Event-based Video Reconstruction, Prediction, and Frame Interpolation with Video Diffusion Models
- Enhancing In-context Panoramic Generation via Geometric-aware Pretraining
- CineMobile: On-Device Image-to-Video Diffusion for Cinematic Camera Motion Generation
- OpenCoF: Learning to Reason Through Video Generation
- Jet-Long: Efficient Long-Context Extension with Dynamic Bifocal RoPE
- Linear Attention Architectures: Mechanisms, Trade-offs, and Cross-Layer Routing
- Flash-BoN: Instant Drafts for Inference-Time Scaling in Diffusion Models
- A Quantized Native Runtime for On-Device Semantic Audio Generation
- DrugGen 2: A disease-aware language model for enhancing drug discovery
- UP: Unbounded Positive Asymmetric Optimization for Breaking the Exploration-Stability Dilemma
- PhyMRI-SR: Toward Physics-Aware MRI Image Super-Resolution
- CausalDS: Benchmarking Causal Reasoning in Data-Science Agents
- ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generation
- A Sparse and Truncated State Vector Simulator for Peaked Circuits
- Can Dialects Be Steered Like Languages? Sparse Neurons and Distributed Directions in Arabic LLMs
Vidu S1: A Real-Time Interactive Video Generation Model →
Technical breakdown
Problem: Existing video generation models follow an offline, one-shot paradigm that forces users to wait minutes for a complete video with no ability to interject, which is unsuitable for interactive use cases like live avatars, virtual hosts, or conversational agents.
Method: Vidu S1 is a streaming video-audio diffusion model trained in three stages: (1) a bidirectional teacher trained on full video-audio joint latent sequences, (2) a causal teacher initialized from the bidirectional model and adapted to autoregressive generation via a hybrid Teacher-Forcing/Diffusion-Forcing strategy, and (3) distillation into a few-step generator using Distribution Matching Distillation (DMD) regularized with Phased Consistency Models (PCM) to prevent mode collapse. At inference, it uses sliding-window decoding with a persistent reference context (sink token/frame), RoPE repositioning, and a stage-aware "TwinCache" (separate noisy and clean history caches) for stable long-horizon streaming, accelerated by TurboDiffusion/TurboServe infrastructure (SageAttention, per-block W8A8 quantized GEMM, kernel fusion, CUDA graphs, Ulysses-style context parallelism).
Key results:
- Achieves 540p (960x540) video generation at 42 FPS on RTX 5090 GPUs, exceeding the 30 FPS real-time threshold.
- On HDTF benchmark, best scores among compared methods: CSIM 0.9192, Sync-D 7.847, DOVER 0.5660, versus e.g. Kling Avatar 2.0 (CSIM 0.8688, Sync-D 8.158) and HeyGen (CSIM 0.9191, Sync-D 8.037).
- On the introduced Vidu-StreamBench (500 samples), human preference tests show Vidu S1 preferred 56% overall vs HeyGen, 46% vs LemonSlice, 48% vs Kling Avatar 2.0, and 100% preference on "subject controllability" vs both HeyGen and LemonSlice.
Why it matters / caveats: Demonstrates that real-time, speech-controlled, indefinite-duration avatar video generation is feasible on a single consumer GPU, combining modeling advances with a dedicated inference/serving stack; however, evaluation relies partly on an in-house, non-public benchmark (Vidu-StreamBench) and pairwise human preference against commercial systems rather than fully independent third-party evaluation.
Why Can't I Open My Drawer? Mitigating Object-Driven Shortcuts in Zero-Shot Compositional Action Recognition →
Technical breakdown
Problem: In Zero-Shot Compositional Action Recognition (ZS-CAR), models tend to predict verbs based on shortcuts tied to the recognized object (object-driven shortcuts) rather than genuine temporal evidence, hurting generalization to unseen verb-object compositions.
Method: The authors introduce two diagnostic metrics, False Seen Prediction (FSP) and False Co-occurrence Prediction (FCP), plus a Compositional Gap (ΔCG), to quantify shortcut reliance in existing models (e.g., C2C) using CLIP and InternVideo2 backbones. They then propose RCORE (Robust COmpositional REpresentations), consisting of: (1) Co-occurrence Prior Regularization (CPR), which synthesizes new compositions by injecting an object cue from another video into high-motion regions of a source video (soft-labeled), applies a margin-based loss against frequent seen "hard negative" compositions, and uses batch-adaptive label-space expansion; and (2) Temporal Order Regularization for Composition (TORC), which penalizes cosine similarity between forward and time-reversed verb features and maximizes entropy of verb predictions on temporally shuffled input. Backbones are tuned with AIM (for CLIP) or LoRA (for InternVideo2). The authors also introduce a new benchmark, EK100-com, repurposed from EPIC-KITCHENS-100.
Key results:
- On Sth-com (open-world, unbiased protocol), RCORE improves verb@unseen-comp by 4.6 points and unseen composition accuracy by 3.8 points over C2C with CLIP backbone (and 3.4/4.5 points with InternVideo2).
- On EK100-com, RCORE improves unseen composition accuracy by 6.9 points (CLIP) and 7.0 points (InternVideo2) over C2C.
- RCORE yields a positive Compositional Gap (ΔCG) on unseen compositions (e.g., +0.66 CLIP, +0.95 InternVideo2 on Sth-com), whereas all baselines remain negative.
- Ablations show combining CPR+TORC gives the largest gains (+5.0 points unseen composition accuracy, +2.7 H.M. over baseline); penalizing only "frequent hard negatives" in CPR gives the best trade-off (H.M. 37.7%).
Why it matters / caveats: Provides a systematic diagnostic framework and a training-time fix for a specific failure mode in compositional video action recognition, showing that even strong video-pretrained backbones (InternVideo2) still exhibit significant shortcut behavior; gains involve seen-accuracy trade-offs (e.g., CPR alone reduces seen accuracy by 4.2 points), and results are limited to two datasets and two backbone families.
Video-Oasis: Rethinking Evaluation of Video Understanding →
Technical breakdown
Problem: It is difficult to tell whether Video-LLM benchmark performance reflects genuine visual/temporal understanding or is inflated by shortcuts solvable via linguistic priors, audio transcripts, or single-frame/static cues.
Method: Video-Oasis is a diagnostic suite with three components applied to 14 existing video benchmarks: (1) visual-dependency tests (Blind, Audio-transcript, Caption-Summary inputs in place of video), (2) temporal-dependency tests (Center-Frame only, Frame Shuffling, Bag-of-Frames via frozen CLIP-style encoders), and (3) ambiguity verification (Consistency, Redundancy, Sensitivity checks) using human-in-the-loop inspection. Shortcut samples are identified via cross-model consensus (Eagle2.5, Qwen2.5-VL/Qwen3-VL, VideoAuto-R1, etc.) at varying agreement thresholds, and the surviving "video-native" samples are categorized into five challenge types (Fine-Grained Perception, Spatial World Understanding, Temporal Dynamics & Tracking, Causality & Logical Reasoning, Global Narrative) using an LLM-ensemble annotation pipeline (Gemini-2.5-Pro plus a 5-model consensus).
Key results:
- 55% of samples across 14 benchmarks are solvable without visual input or temporal context (average 92.7% under relaxed consensus threshold c≥1); random-chance baseline is 25.6%, but shortcut tests achieve 30-50% accuracy.
- After filtering, 11,033 QA pairs remain out of an original 24,416 (a 55% reduction), spanning 4,938 unique videos.
- On the distilled video-native challenge set, most open-source Video-LLMs score near chance (e.g., Qwen2.5-VL 29.2%, Video-R1 26.3%), while the best model, Gemini-2.5-Pro, reaches only 46.7% overall; the best agentic method (STAR w/ GPT-5-mini) reaches 39.5%.
- Oracle temporal grounding boosts accuracy on Video-Oasis-distilled samples from 35.0% to 50.8%, versus only 78.0% to 80.8% on shortcut samples, showing grounding matters far more for genuine video-native tasks.
- Long-context SFT (Eagle2.5) raises overall accuracy from 29.2% to 34.5% without RLVR; RLVR with grounding rewards (VideoAuto-R1) gives larger gains specifically on Global Narrative (21.2%→28.6%).
Why it matters / caveats: Shows that reported gains on many video understanding benchmarks may be substantially inflated by shortcut-solvable samples, and that even frontier proprietary models remain close to chance on genuine spatio-temporal reasoning; the benchmark filtering and categorization rely on LLM-based automated pipelines (validated partly by human agreement, e.g. 76% correlation rate and manual review of ambiguous cases).
UniClawBench: A Universal Benchmark for Proactive Agents on Real-World Tasks →
Technical breakdown
Problem: Existing agent benchmarks rely on sandboxed environments, single-turn evaluation, and scenario-based task taxonomies that conflate different model capabilities, making it hard to diagnose why proactive (24/7 personal-assistant-style) agents fail on real-world tasks.
Method: UniClawBench comprises 400 bilingual (English/Chinese) manually constructed tasks across five capability dimensions (Skill Usage, Exploration, Long-Context Reasoning, Multimodal Understanding, Cross-Platform Coordination), executed in live Docker containers with real browsers, GUI apps, and file systems rather than static sandboxes. It introduces a three-role closed-loop evaluation strategy: an Executor agent performs the task in the real environment; a hidden Supervisor agent scores trajectories and artifacts against fine-grained, weighted checkpoint rubrics (never exposed to the executor) and issues pass/fail/continue verdicts; a User Simulator agent (also LLM-based) gives natural multi-turn feedback based only on the visible trajectory and a coarse progress signal (an "information firewall" prevents rubric leakage). Ten models (e.g., GPT-5.4, Claude Opus-4.8, Kimi-2.6, Gemini-3.1-Pro) are evaluated under the OpenClaw framework, and three representative models are additionally compared across OpenClaw, EDICT, and Nanobot agent frameworks.
Key results:
- All 10 evaluated models score below 50% overall Pass Rate; the best, Claude Opus-4.8, reaches 0.475 PR (0.702 AS) overall, and GPT-5.4 reaches 0.407 PR.
- Models perform relatively well on Skill Usage and Exploration (e.g., Claude Opus-4.8: 0.550 and 0.825 PR) but much worse on Long Context, Multimodal, and Cross-Platform (Claude Opus-4.8: 0.438, 0.175, 0.388 PR respectively).
- Framework choice matters: GPT-5.4's overall PR drops from 0.407 (OpenClaw) to 0.338 (EDICT) to 0.290 (Nanobot); Claude Opus-4.8 stays fairly stable across frameworks (0.475/0.415/0.385).
- Automatic pass/fail judgments agree with human majority vote 92.0% of the time; the automatic Average Score correlates with human scores at Pearson r=0.71, Spearman ρ=0.68.
- A "halfway failure" phenomenon is observed: high intermediate checkpoint scores but low final pass rates across most models, indicating agents make partial progress but fail to complete tasks reliably.
Why it matters / caveats: Demonstrates that framework/scaffolding design can influence real-world agentic task performance as much as or more than the underlying model, and that even top proprietary models remain far from reliable on realistic multi-step, multimodal, cross-platform tasks; the automated supervisor/user-simulator pipeline (built on GPT-5.4-based Codex agents) is validated against only 50 human-reviewed trajectories.
Ideas Have Genomes: Benchmarking Scientific Lineage Reasoning and Lineage-Grounded Idea Generation →
Technical breakdown
Problem: Existing benchmarks for AI research assistants evaluate retrieval quality, factuality, novelty, or workflow competence, but do not test whether a proposed research idea genuinely inherits the correct mechanism and repairs the correct limitation from prior work (as opposed to being merely topically related).
Method: The paper introduces the IdeaGene framework, representing each paper/proposal as a set of typed, evidence-grounded "Idea Genome" objects (role types: niche, mechanism, observation, limitation, delta, claim), aligned across predecessor/successor pairs via "GenomeDiff" records that classify relations (Inherited, Mutated, Lost, Novel, External) into six evolutionary dynamics (Mutation, Adaptive Radiation, Hybridization, Speciation, Niche Competition, Isolation), constructed via LLM-assisted extraction plus expert audit (50 graduate annotators). This is instantiated as IdeaGene-Bench (IG-Bench) with two evaluations: IG-Exam, a closed-form test (42 task types, 1,029 instances across 4 capability axes: Genome Abstraction, Inheritance Tracing, Evolutionary Reasoning, Lineage Verification) scored by exact match; and IG-Arena, an open-ended generation test scored by a Population-Evolution Score (PES) — a judge-panel-rated (3 model judges) average of Heredity, Variation, and Selection under three information settings (Question-only, Library, Lineage). 14 LLM-based scientists (8 direct LLMs, 2 research agents, 4 CLI harnesses) are evaluated.
Key results:
- On IG-Exam, the best system (GPT-5.5 + Claude Code) reaches only 27.3% exact accuracy; direct LLMs top out around 23.1% (GPT-5.5).
- Accuracy degrades from T1 Genome Abstraction (best 34.4%) to T2 Inheritance Tracing (best 37.9%) to T3 Evolutionary Reasoning (best 25.3%) to T4 Lineage Verification (best 17.4%).
- In IG-Arena, PES gains from Question-only to Lineage context vary widely by system (median +4.4, ranging from +1.8 for CoI-Agent to +9.9 for MiniMax), and the gain is driven almost entirely by the Heredity dimension (61.9 for Question|Mutation vs 84.2 for Lineage|Hybrid), while Variation and Selection stay roughly constant (~79.7–84.7).
- PES and ELO rankings diverge (Spearman ρ=0.82), with inter-judge agreement Krippendorff's α=0.74 and 80% human-judge concordance.
- Inter-annotator agreement on dynamics labels is 84.7% before adjudication; CLI harnesses substantially improve T2 Inheritance Tracing (e.g., GPT-5.5: 25.7%→37.9% with Claude Code) but show little to no gain (or a decrease) on T4 Lineage Verification.
Why it matters / caveats: Reveals a "compositional bottleneck" where current auto-research systems can retrieve relevant literature and sound plausible but fail to consistently identify the correct parent mechanism, verify lineage claims, or preserve heredity in generated proposals, suggesting a need for dedicated compositional verification modules rather than better retrieval alone; the six evolutionary dynamics are explicitly stated by the authors to be operational categories, not an exhaustive theory of scientific development.
LongE2V: Long-Horizon Event-based Video Reconstruction, Prediction, and Frame Interpolation with Video Diffusion Models →
Technical breakdown
Problem: Recovering high-fidelity, temporally stable video from sparse, intensity-free event-camera streams is ill-posed, and existing methods are both task-specific (separate models for reconstruction, prediction, interpolation) and prone to either regression-to-the-mean blur or long-term error accumulation/drift.
Method: LongE2V fine-tunes the pre-trained video diffusion model CogVideoX I2V (3D VAE with 4x temporal/8x spatial compression, DiT denoiser) to jointly perform event-based reconstruction, prediction, and frame interpolation by conditioning on event voxel grids (B=3 temporal bins) concatenated with context/first-frame latents. It introduces Autoregressive Unrolling (iteratively substituting the model's own predictions for ground-truth context frames during fine-tuning) plus Adaptive Context Switching (attention-based decision to retain or refresh context, threshold τ=0.05) to curb drift, and Reencoding Alignment with Cross Residual Correction (decode-flip-reencode plus residual cross-injection) to fix latent-space misalignment during zero-shot interpolation. Training uses LoRA (r=64) on DiT blocks plus full fine-tuning of an expanded first projection layer, on the BS-ERGB dataset, generating 49-frame 720x480 chunks with a 20-frame context window.
Key results:
- Reconstruction on HQF: LPIPS 0.240 vs. 0.257 (HyperE2VID, prior best), PSNR 16.45/SSIM 0.603.
- Prediction on ECD: PSNR 24.40 vs. 20.33 (VDM-EVFI), LPIPS 0.110 vs. 0.244; on MVSEC PSNR 18.18 vs 15.46.
- Zero-shot interpolation (31-frame skips) on HQF: LPIPS 0.105 vs. 0.166 (supervised CBMNet-Large), PSNR 25.39 vs 24.55, despite the model never being trained for interpolation.
- Ablation on HQF reconstruction: removing pretrained diffusion prior collapses PSNR to 10.26; full method reaches PSNR 16.45/LPIPS 0.240, each component (context, AR unrolling, adaptive context switch) contributing incremental gains.
Why it matters / caveats: A single fine-tuned video diffusion backbone can unify three previously separate event-vision tasks and generalize zero-shot to interpolation, suggesting event streams are an efficient structural condition for diffusion priors; however gains rely on real-world benchmarks of limited size (BS-ERGB, ECD, MVSEC, HQF) and computational cost of diffusion inference is not discussed.
Enhancing In-context Panoramic Generation via Geometric-aware Pretraining →
Technical breakdown
Problem: Equirectangular panorama generation and in-context editing suffer from latitude-dependent distortion and poor geometric/boundary consistency, and there is a lack of large-scale, high-quality paired data for in-context panoramic tasks (style transfer, inpainting, outpainting, editing).
Method: Canvas360 is a two-stage Flow Transformer (built on FLUX.1-dev, fine-tuned via LoRA) framework: Stage 1 pretrains on 100K RGB-depth panorama pairs (depth from DAP) using parallel depth generation (RGB and depth token sequences concatenated with a 3D RoPE positional offset per modality) plus a similarity loss regularizer (squared correlation between RGB/depth predicted velocity fields) to prevent modality collapse, and velocity circular padding (synchronizing ghost-column features/target velocities across the 0/360-degree seam) for spherical boundary consistency. Stage 2 discards depth and fine-tunes a unified in-context model on the released Canvas360Dataset (900K samples: 250K outpainting, 250K inpainting, 200K style transfer, 200K editing, generated via FLUX.2-dev, Qwen3-VL-30B-A3B-Instruct captioning, Florence2/GroundingDino grounding, and NanoBanana refinement) using token-level concatenation of target and context latents with positional offsets.
Key results:
- Text-to-panorama vs. DiT360 and others: best FAED (2.33 vs. 2.91 for DiT360), best IS (1.76), best QA-aesthetic (4.20) and NIQE (3.70); ranks second on FID (44.17 vs. 42.88 DiT360).
- User study (71 participants, 10 images): highest preference on Boundary Continuity (31.1%), Panorama Awareness (34.1%), and Overall Quality (35.9%) versus Matrix-3D, HunyuanWorld, DiT360.
- Ablation of parallel depth generation on FAED: baseline 5.37 to +depth image 4.74, +position offset 4.81, +Lsim 4.93 (full pipeline improves training stability/robustness though not monotonic on every single metric).
- Dataset scale: 100K seed RGB-depth panoramas + 900K in-context samples = 1M total, described as the most comprehensive in-context panorama dataset to date.
Why it matters / caveats: Demonstrates that transferring spherical depth priors from pretraining to appearance-only fine-tuning improves geometric consistency in downstream in-context editing without needing explicit geometric supervision at fine-tuning time; the approach still trails DiT360 on plain FID/FIDpole/FIDequ and BRISQUE, indicating tradeoffs between panorama-specific fidelity and generic image-quality metrics.
CineMobile: On-Device Image-to-Video Diffusion for Cinematic Camera Motion Generation →
Technical breakdown
Problem: DiT-based video diffusion models (e.g., Wan2.1-I2V-14B, 240s for a 49-frame 832x480 video at 40 steps) are too large and slow for on-device generation of cinematic camera effects (bullet time, dolly zoom, slow motion) on mobile phones.
Method: CineMobile combines three stages on a Wan2.1-v1.1-Fun-I2V (1.5B) base with effect-specific LoRA modules: (1) structured depth pruning extending PPCL (Pluggable Pruning with Contiguous Layer Distillation) — detecting redundant contiguous transformer-block intervals via residual linear probes and CKA similarity, then replacing each span with a single trainable surrogate block distilled from the frozen base model, yielding a 27-layer, 1.2B-parameter student; (2) two-stage step distillation — supervised fine-tuning warm-up (flow-matching objective on dense-model and teacher cinematic-effect videos) followed by adversarial distillation adapted from AdvDMD (DMD loss + GAN discriminator + GRPO reward on discriminator scores) to produce a 4-step generator; (3) hybrid post-training quantization (FP8 weights for attention/embedding projections, 4-bit weights for FFN linear layers, 16-bit activations) to shrink memory footprint below 1GB. The Wan2.1-I2V-14B teacher with effect-specific LoRAs supplies training targets.
Key results:
- 40.11x faster DiT denoising and 71.89x lower DiT-FLOPs vs. the Wan2.1-14B teacher; per-step denoising latency of 0.6s on H200 GPU and 20.02s on MediaTek Dimensity 8400 Ultimate 5G, with peak memory 1.8GB.
- VBench total scores: bullet time 88.35 vs teacher's 89.27, dolly zoom 89.30 vs 89.96, slow motion 88.05 vs 88.51 (gaps of 0.92/0.66/0.46) despite using only 10% of parameters and 20% of denoising steps.
- GRPO ablation on bullet time: +0.52 total-score improvement for base model, +0.47 for CineMobile, mainly from aesthetic and imaging quality metrics.
- Vs. FILM on 20x slow-motion synthesis (first/last frame only): PSNR improves from 30.57dB to 35.68dB and SSIM from 0.713 to 0.858.
- Human evaluation on bullet time (50 samples, 10 participants) vs. Kling/Hailuo/Vidu: CineMobile achieves the strongest score on camera control.
Why it matters / caveats: Shows a practical joint recipe (pruning + step distillation + quantization) can bring DiT video generation to real phone hardware with competitive VBench scores for structured camera-motion tasks; results are scoped to three specific cinematic effects and portrait-centric data (PPR10K, Pexels/Pixabay), so generality to arbitrary I2V prompts is untested.
OpenCoF: Learning to Reason Through Video Generation →
Technical breakdown
Problem: Video generation models are trained on general video corpora and lack diverse, dedicated supervision for "Chain-of-Frame" (CoF) reasoning — using temporally evolving frames as a reasoning medium — and existing reasoning-oriented video efforts are narrow, task-specific, and rarely test generalization to independent external benchmarks.
Method: The authors build OpenCoF-17K, 17,312 videos (480p, 15fps, 81 frames) across 11 task families (chess, Sudoku, 2D geometry, dot-to-dot, tangram puzzle, cube folding, 3D polycube rotation, physics motion, maze, embodied manipulation, VBVR with 30 subtasks) curated via four pipelines: instance-based rendering, expert-guided rendering, procedural scene synthesis, and external video repurposing (VR-Bench, VBVR, BridgeData V2). They LoRA-fine-tune Wan2.2-I2V-A14B on this dataset to obtain Wan-CoF (data-only stage), then explore two reasoning-token designs on the same backbone: Visual Reasoning Tokens (Nr learnable tokens prepended to the visual latent sequence, interacting bidirectionally via self-attention, discarded after the final DiT block) and Textual Reasoning Tokens (Nt learnable tokens prepended to the text-conditioning sequence, feeding cross-attention as extra key/value context), yielding Wan-CoFvt and Wan-CoFtt.
Key results:
- Wan-CoF vs. Wan2.2-I2V-A14B baseline: MME-CoF Overall 1.00 to 1.30 (+0.30), Gen-ViRe average 0.304 to 0.391 (+0.087), VIPER POC 3.3 to 7.5 (+4.2), RULER-Bench overall 55.8 to 56.8 (+1.0).
- On MME-CoF, Wan-CoF (1.30) surpasses HunyuanVideo-I2V (0.98) and Wan2.2-TI2V-5B (0.72), approaching closed-source Seedance-1.0-Pro (1.48).
- Wan-CoFvt and Wan-CoFtt further improve over Wan-CoF on every benchmark's headline metric; Wan-CoFvt leads on Gen-ViRe (0.441) and RULER-Bench (59.6), Wan-CoFtt leads on MME-CoF (1.35) and VIPER (8.8).
- Out-of-distribution transfer: physics-motion training correlates with +5.5 on VIPER Physics; structured-grid tasks correlate with +0.147 on Gen-ViRe Algorithmic & Logical and +6.9 on RULER-Bench Game split.
Why it matters / caveats: Demonstrates that diverse temporal supervision alone (without architectural changes) meaningfully improves reasoning-oriented video generation and transfers to external benchmarks rather than overfitting; explicit reasoning tokens give further, complementary gains (vt for persistent/global planning, tt for prompt-level priors) as confirmed by attention analysis across depth, denoising step, space and time. Absolute scores (e.g., VIPER POC of 7.5-8.8) remain far below closed-source frontier models like Sora-2, indicating substantial headroom remains.
Jet-Long: Efficient Long-Context Extension with Dynamic Bifocal RoPE →
Technical breakdown
Problem: Zero-shot context-extension methods for RoPE-based LLMs fix a single rescaling factor up front, forcing a tradeoff where aggressive factors hurt short-context fidelity and conservative ones fail at long context.
Method: Jet-Long is a tuning-free bifocal attention scheme combining a local RoPE-faithful window of size w0 with a remote window whose position mapping f(x) = floor(x/G) uses a discrete group size G = max(1, ceil(L/w_pretrained)) that grows dynamically with the current sequence length L, aliasing remote positions exactly onto the model's pretrained rotation grid (rather than continuous frequency interpolation as in YaRN/DNTK). To avoid rewriting the KV cache when G changes, it applies an on-the-fly RoPE correction rotation (offsets Δq, Δk derived from f) directly to queries/cached keys at decode time, and computes exact distance-based routing during prefill via an inclusion-exclusion combination of three FlashAttention calls (local, full-remote, local-with-remote-rotation) stabilized with LogSumExp, fused into a single CuTe kernel. Evaluated on Qwen3-1.7B/4B/8B-Base (32K native window, extended to 128K) and the hybrid Jet-Nemotron-2B/4B architecture, with w0=2048 as the sole hyperparameter.
Key results:
- RULER (avg over 13 tasks, 7 lengths 4K-128K): Jet-Long beats the strongest baseline by +4.79/+2.18/+2.03 pp at 1.7B/4B/8B (Jet-Long avg 81.23 vs. best baseline Self-Extend 77.80).
- PG-19 perplexity at 128K: base model collapses to 71.00/104.66/79.37 (1.7B/4B/8B) while Jet-Long stays at 11.41/9.62/8.51, lowest among all methods tested.
- Applied to hybrid Jet-Nemotron architecture at 128K: RULER accuracy improves from 8.54 to 33.78 (+25.24pp) at 2B and 5.65 to 33.14 (+27.49pp) at 4B, with no retraining.
- Ablation (aliasing vs. frequency interpolation) on Qwen3-1.7B: aliasing wins by 6.99pp at 64K and 4.30pp at 128K.
- Inference: fused CuTe kernel reaches 1.28-1.39x FlashAttention-2 prefill throughput past 32K (approaching Hopper-only FlashAttention-4's 1.53x) and incurs ≤4% generation overhead at every length, versus 0.14-0.34x for an unfused/naive multi-launch implementation.
- w0 hyperparameter sweep: any w0 in {512,1024,2048,4096} stays within 2pp of per-length best and 1pp of per-model average, while w0=0 collapses RULER to near-zero.
Why it matters / caveats: Shows that adapting the RoPE rescaling factor dynamically to sequence length, combined with a KV-cache-preserving kernel implementation, can extend context 4x (32K to 128K) with accuracy gains over fixed-factor baselines (YaRN, DNTK, DCA, Self-Extend) at essentially no inference cost. The method targets only the position-out-of-distribution failure mode and requires a softmax-with-RoPE base architecture; it does not address the complementary attention-diffusion/lost-in-the-middle failure mode, and evaluation is limited to Qwen3 and Jet-Nemotron families up to 128K.
Linear Attention Architectures: Mechanisms, Trade-offs, and Cross-Layer Routing →
Technical breakdown
Problem: Softmax attention's quadratic cost limits training and inference at long context, and it is unclear how the growing family of DeltaNet-style linear-attention variants trade off expressivity, throughput, and depth-wise information sharing under matched conditions.
Method: The authors express softmax attention, DeltaNet, Gated DeltaNet, Kimi Delta Attention, and Gated DeltaNet-2 in a unified recurrent-memory notation (shared write residual, decay/erase/write gates) and train 350M-parameter decoder-only LMs on FineWeb-Edu with the LLaMA2 tokenizer for 15B tokens, comparing AdamW vs. Muon and hybrid (2:1 linear-to-softmax) vs. pure stacks, plus larger DeltaNet runs at 1.3B/40B and 3B/60B tokens. They also introduce Cross-Layer Value Routing (CLVR), which projects each routing-capable layer's delta-rule write value through a zero-initialized projection into the shared residual stream, contrasted against the value-target-injection baseline Cross-Layer Error Residuals (CLER).
Key results:
- Kimi Delta Attention with Muon in a hybrid stack reaches the best 350M/15B-token final validation loss (2.273), vs. 2.299 for DeltaNet+Muon hybrid and 2.433 for the fastest pure Gated DeltaNet+AdamW run (100% relative speed).
- At 32k sequence length, iteration time is 3.37s (softmax), 1.56s (Gated DeltaNet hybrid), 0.96s (pure Gated DeltaNet) — pure recurrent stacks grow only ~1.1x from 4k to 32k vs. ~2.9x for softmax.
- CLER (value-target injection) does not improve over baselines (e.g., AdamW CLER-DeltaNet is +0.019 worse); CLVR (hidden-stream value routing) lowers final validation loss by 0.0103–0.0119 at 350M/1B tokens and by 0.0016–0.0059 at 350M/15B and 1.3B/40B scales, consistently better than routing the error (CLER-H).
- At 3B parameters/60B tokens, DeltaNet hybrid runs reach a final loss of 1.955 at both 3e-4 and 1.5e-4 learning rates, vs. 2.332 at 5e-4, underscoring strong learning-rate sensitivity.
Why it matters / caveats: The paper reframes architecture choice as a multi-objective trade-off (loss vs. throughput vs. context scaling) rather than a single ranking, and shows a lightweight, linear-time cross-layer routing signal (the write value, not the delta-rule error) gives a small but consistent gain. All comparisons are single-run (no seed averaging), so small differences are treated cautiously by the authors themselves.
Flash-BoN: Instant Drafts for Inference-Time Scaling in Diffusion Models →
Technical breakdown
Problem: Prior inference-time scaling methods for text-to-image diffusion compare approaches using number-of-function-evaluations (NFEs), which ignores verifier overhead and distorts efficiency rankings, so it's unclear what actually works best under a real wall-clock compute budget.
Method: Flash-BoN generates a large pool of cheap "draft" candidates using a jointly-optimized configuration ϕ* combining three acceleration knobs — early timestep stopping, layer skipping, and Taylor-expansion activation proxies — selected once per model via dual-annealing black-box optimization against LPIPS similarity on a 120-prompt calibration set; it then applies a multi-stage Elo-based verification (pointwise pruning, sparse adjacent pairwise comparisons, dense pairwise tournament) to pick the best draft, which is refined with full-quality denoising from its cached latent. It is evaluated against BoN, Breadth/Depth-First Search, and Zeroth-Order Search on Wan2.1 1.3B, Wan2.1 14B, and FLUX.1-dev across GenAI-Bench, GenEval, and UniGenBench.
Key results:
- Flash-BoN leads in every model–benchmark combination (Table 1 normalized AUC/Time), with gains growing at scale (+8% AUC on larger models like Wan2.1 14B and FLUX.1-dev vs. BoN).
- Combining Flash drafts with Reflection-Tuning improves AUC from 0.46 to 0.62 (+16%); combining with BFS improves AUC from 0.49 to 0.55 (+6%).
- Candidate-pool diversity (Vendi Score) correlates with final quality at Pearson r=0.75 across methods and models.
- Flash-Flow-GRPO (RL post-training using draft-guided rollout selection: 16 cheap drafts scored, top-6/bottom-2 kept for gradient computation) matches baseline Flow-GRPO's final performance (0.699 vs. 0.692) at step 60 — roughly 10x fewer gradient steps to converge.
- Verifier/evaluator choice matters: ImageReward shows 270% relative improvement when used as both verifier and evaluator (likely reward over-optimization), vs. 26–40% for VQAScore/HPSv3.
Why it matters / caveats: The result suggests compute is often better spent on broader exploration (more cheap drafts) than repeated intermediate verification, challenging the guided-search paradigm; but the authors caution that using the same model as both verifier and evaluator can inflate apparent gains by exploiting the model's own biases, and the method has only been validated on image (not yet video) generation.
A Quantized Native Runtime for On-Device Semantic Audio Generation →
Technical breakdown
Problem: Open-weight text-to-music diffusion models are strong enough to be useful on-device but their reference implementations assume a heavyweight Python/PyTorch stack and a discrete GPU, making them impractical for edge/embedded semantic-audio deployment.
Method: The authors build aria, a dependency-free ~7.7k-line C/CUDA runtime implementing the full Stable Audio 3 (SA3) pipeline — T5Gemma text encoder, DiT denoiser (small-music: 20 blocks, d_model=1024; medium: 24 blocks, d_model=1536, ~1.2B parameters), and SAME audio autoencoder — with weight storage from fp16 down to 8-bit/4-bit integers (releasing full-precision weights once compressed) and an optional W8A8 8-bit-arithmetic mode on GPU tensor cores/ARM. Because the runtime owns every intermediate tensor, it also implements in-graph activation steering (difference-in-means direction vectors injected additively at the DiT residual stream, latent, or text conditioning), evaluated on a "sonic seasoning" taste-steering case study (five basic tastes) against a multi-oracle protocol (wav2taste target, CLAP cross-check, FAD, drift) and a per-axis LoRA baseline.
Key results:
- Cold start is about 7x faster than the official PyTorch implementation (1.6–2.9s vs. 11.6–22.2s); warm generation is roughly at parity or slightly faster (0.13s vs. 0.146s small-music; 0.37s vs. 0.443s medium).
- 8-bit quantization (q8, W8A8) stays within fp16 re-seed noise floors on all three fidelity checks (ΔCLAP, FAD, Δtaste) while cutting GPU VRAM ~21% and Raspberry Pi memory from 1.9GB to 0.84GB; W8A8 is the fastest GPU mode (0.10s warm).
- 4-bit crosses fidelity floors (up to 5x the ΔCLAP floor) but enables the 1.2B medium model to run CPU-only on an 8GB Raspberry Pi 5 (~200s, 0.9GB resident, 3.6GB peak).
- The taste-steering case study finds genuine, oracle-confirmed control only for 3 of 5 taste axes (sweet, sour, bitter) within a narrow strength window (e.g., sour genuine at α=0.1 with Δwav2taste=+0.42, but degrades by α=0.15+ as CLAP flips negative and FAD explodes); steering beats a rank-8 LoRA baseline which never reaches a CLAP-positive operating point.
Why it matters / caveats: Demonstrates that state-of-the-art latent-diffusion audio generation can be deployed without a datacenter serving stack, with quantization essentially "free" at 8-bit; the steering case study's central caution is that a learned oracle used as an optimization target becomes unreliable once pushed too hard, so any steering evaluation needs independent, non-optimized quality checks. No human listening study has yet been done to externally validate the automatic oracles.
DrugGen 2: A disease-aware language model for enhancing drug discovery →
Technical breakdown
Problem: Existing generative drug-design models condition on target proteins or general molecular properties but ignore disease context, even though the same protein target can behave differently — and require different therapeutic molecules — across disease states.
Method: DrugGen-2 fine-tunes DrugGPT (a pretrained GPT-2 variant for ligand generation) on a curated dataset of approved drug–target–disease triples built from DrugBank, DisGeNET, and ChEMBL (1,634 drugs, 2,093 target proteins, 608 MeSH disease terms, 13,908 MeSH-sequence-SMILES training strings), using a two-step recipe: supervised fine-tuning (10 epochs, LR 5e-4, batch size 8, AdamW) followed by 10 epochs of Group Relative Policy Optimization (GRPO) with reward functions for chemical validity, novelty vs. approved drugs, batch diversity, and predicted binding affinity via the PLAPT deep-learning model. It takes a disease MeSH DAG plus a target amino-acid sequence as input and outputs SMILES, evaluated against DrugGPT and DrugGen baselines on five diabetic-nephropathy-associated targets (ACE, PPARγ, NOS3, PAI-1, TGF-β1) identified via DisGeNET/DrugTar.
Key results:
- DrugGen-2 generates 409–444 unique molecules out of 500 attempts across targets/MeSH configurations, vs. 50 (41–87) for DrugGen and 219 (217–254) for DrugGPT (χ²=88.80, P<10⁻⁹).
- Near-perfect validity: median 99–100 valid molecules out of 100 generated per target.
- Higher structural similarity to approved drugs (median 0.70 across MeSH categories) vs. DrugGPT (0.30) and DrugGen (0.64) (P<10⁻²⁰⁴).
- Higher predicted binding affinity (PLAPT), medians 9.26–9.97 for DrugGen-2 vs. 5.86–6.22 (DrugGPT) and 7.15–8.49 (DrugGen), significant across all five targets (e.g., ACE ε²=0.49, P<10⁻⁵⁹).
- Docking (GLIDE XP) on ACE found three DrugGen-2-generated ligands with stronger predicted binding than reference drug Enalapril (docking scores −9.917, −9.485, −9.367 vs. −8.283 for Enalapril); no PPARγ candidate beat Rosiglitazone or Balsalazide, though some showed unique pharmacophoric interactions.
Why it matters / caveats: Suggests disease-context conditioning materially improves molecule generation quality (diversity, drug-likeness, predicted affinity) over target-only baselines, relevant to both de novo design and drug repurposing. The authors note this is purely in silico (PLAPT/docking predictions only, no wet-lab validation), sequences are truncated to 768 tokens (potentially losing distal allosteric information), and the novelty reward is binary and may undervalue subtle innovations.
UP: Unbounded Positive Asymmetric Optimization for Breaking the Exploration-Stability Dilemma →
Technical breakdown
Problem: RL algorithms for LLM reasoning that rely on importance sampling (GRPO, DAPO, GSPO) face an "exploration-stability dilemma": unclipped IS causes catastrophic gradient explosion on rare high-reward trajectories, but the clipping used to prevent this structurally stifles exploration by prematurely zeroing the gradient for correct, low-confidence reasoning paths.
Method: The authors formalize "Probability Capacity (Cap)" — the maximum allowable probability change for a token before clipping truncates the gradient — and show it is linearly bounded by the old policy π_old for positive-advantage tokens (e.g., at π_old=0.01 with ε_high=0.28, the max probability increase is only 0.0028). They propose Unbounded Positive Asymmetric Optimization (UP), which for positive-advantage (correct) rollouts replaces the importance-sampling ratio's denominator with a stop-gradient-anchored self-ratio sg(π_θ), making the objective's gradient mathematically equivalent to unclipped REINFORCE (removing the π_old-induced Cap entirely), while retaining standard clipping/KL safeguards for negative-advantage (incorrect) rollouts. This asymmetric design is instantiated as UP-DAPO, UP-GRPO (token-level), and UP-GSPO (sequence-level), tested on Qwen3-14B-Base, Qwen3-8B, Qwen3-30B-A3B-Base (MoE), and Qwen3-VL-8B-Instruct (vision-language) using the verl framework with vLLM rollouts.
Key results:
- UP-DAPO on Qwen3-14B-Base reaches peak Avg@32 of 51.15 on AIME24 vs. DAPO's 47.71, and Maj@32 of 60.88 vs. 58.36; Best@32 of 81.79 vs. 80.49.
- A naive ablation that just sets ε_high=∞ in standard DAPO (without the stop-gradient self-anchor) causes gradient norm to explode to 10¹³ and training instability beyond 80 steps — confirming the stop-gradient mechanism, not merely unbounded clipping, is what enables safe exploration.
- Against eleven RL baselines (GRPO, Dr.GRPO, CISPO, DPPO, GMPO, GSPO, SAPO, REINFORCE++, RLOO, W-REINFORCE, ASPO) trained on MATH (Levels 3-5) with Qwen3-8B, UP-GRPO achieves the best average Pass@1 across five benchmarks (61.31%) vs. the next-best GSPO (60.15%), including 41.04% on AIME24, 88.40% on MATH500, and 31.25% on Minerva.
- UP-GSPO on the Qwen3-30B-A3B-Base MoE model reaches peak Avg@32 of 55.73% vs. GSPO's 52.71% (+3.02%), with near-identical KL divergence to the baseline; UP-GRPO on the Qwen3-VL-8B-Instruct vision-language model on Geometry3K reaches 62.60% accuracy vs. GRPO's 59.30% (+3.30%), also without added instability.
Why it matters / caveats: UP is presented as a plug-and-play, universal modification applicable across token-level and sequence-level RL objectives, model architectures (dense, MoE, vision-language), and modalities, consistently raising entropy/exploration during training while keeping gradient norm and KL divergence comparable to or lower than baselines. A control experiment confirms the asymmetry is structurally necessary: applying the unbounded update symmetrically to both correct and incorrect rollouts causes immediate catastrophic instability within 25 training steps.
PhyMRI-SR: Toward Physics-Aware MRI Image Super-Resolution →
Technical breakdown
Problem: Existing MRI super-resolution methods treat the task as a deterministic mapping from a fixed low-resolution scan to a fixed high-resolution target, ignoring that MRI resolution and SNR are physically coupled so the "given" low-resolution input may not even be the optimal starting point.
Method: The authors adapt 2D Gaussian Splatting (2D GS) to MRI as a coordinate-based, resolution-agnostic rendering framework, adding three components: (1) a prior-aware Gaussian representation combining an Anatomical Structure Prior (segmentation-guided, tissue-weighted primitive density for GM/WM/CSF) with an Imaging System Prior (an MRI-specific covariance dictionary of 1,001 kernels built from 4,241 5T slices); (2) physics-constrained signal modeling that predicts proton density ρ and effective relaxation rate R2 per Gaussian primitive and computes intensity via S ≈ ρ·e^(-R2) rather than regressing pixel values directly; (3) a MAML-based meta-learning scheme pretrained on simulated 64mT data (from IXI 3T ground truth) and adapted to a small real paired 64mT–3T dataset (Leiden University Medical Center, 11 subjects) and a self-collected 3T–5T dataset (United Imaging scanners, 10 healthy subjects, IRB-approved). Backbone is SwinIR + 2D U-Net segmentator, trained with L1/gradient/frequency losses.
Key results:
- On the FastMRI benchmark, the method reaches 34.26 dB PSNR / 0.962 SSIM at 4×, 32.20 dB / 0.946 at 5×, and 30.06 dB / 0.917 at 6.4×, beating the next-best method (MS-PRDDiff) by 1.45 dB PSNR at 4×.
- On the real paired 64mT–3T dataset, the method achieves 26.85 dB PSNR vs. 20.28 dB (LIIF), 20.09 dB (LTE), and 19.97 dB (Pixel-to-Gaussian) — over 6.5 dB improvement.
- On the simulated IXI dataset, the optimal input resolution is ×0.7 (not ×1.0), giving PSNR 28.10 dB / SSIM 0.9234, supporting the paper's central resolution-SNR trade-off hypothesis.
- Ablations show physics-constrained modeling is the largest single contributor (SSIM drops from 0.85 to 0.55 without it).
Why it matters / caveats: The work reframes MRI SR as an acquisition-aware reconstruction problem rather than pure image upscaling, which could improve accessibility of ultra-low-field (64mT) MRI systems; however, gains rely on a physics approximation (T2-weighted spin-echo signal model) and a proprietary simulation/degradation pipeline, and real-world validation is limited to 11 subjects for one paired dataset.
CausalDS: Benchmarking Causal Reasoning in Data-Science Agents →
Technical breakdown
Problem: Existing benchmarks either test symbolic causal reasoning without realistic data analysis, or test data-science coding without a principled causal data-generating structure, leaving it unclear whether LLM agents can jointly perform causal reasoning, statistical estimation, uncertainty quantification, and abstention over real-looking, file-backed observational data.
Method: CausalDS generates fully synthetic "scenes," each built from a sampled DAG (from a motif catalog — chain, fork, confounding, collider, IV, front-door, etc., with anchor-based grafting for complexity) instantiated as a structural causal model with typed continuous/binary mechanism profiles; observational data is simulated and optionally corrupted through an "observation layer" that replaces conceptual variables with bundles of noisy measurements (clean/proxy/proxy_hard variants) while preserving identifiability. Abstract nodes are mapped to domain variables (partly seeded from CauseNet) and verbalized into audited natural-language stories via a mapper-auditor-verifier LLM pipeline. Tasks span Pearl's three rungs (association/prediction, identification/effect estimation, counterfactual/mediation) with deterministic scoring including abstention as a first-class outcome; agents are evaluated with mini-swe-agent in a sandboxed Docker environment across 953 scenes (100-scene "realistic" exam used for headline results).
Key results:
- On the realistic exam, Claude Opus 4.8 achieves the best CausalDSScore (0.278) with 82.4% Pass Rate, 100% content-pass rate, and best SNR (0.566); GPT-5.5 ties on Pass Rate (82.4%) but ranks 5th on CausalDSScore due to poorly calibrated intervals (SNR 1.324).
- Empirical coverage of nominal 95% ATE confidence intervals collapses to 20.0%–71.4% across models (vs. nominal 95%), showing systematic overconfidence.
- Abstention pass rate (recognizing non-identifiable estimands) ranges from 18.8% (Gemma 4 26B) to 75.0% (GPT-5.5), while raw content-correctness is uniformly high (81–100%) — abstention, not reasoning, is the main discriminator.
- Token usage spans a 21× range (12.9k/task for GPT-5.5 to 266.4k/task for Kimi K2.6); pass@3 (3 restarts) reaches 91.2% for Kimi K2.6 vs. 67.6% at pass@1, showing substantial run-to-run instability concentrated in abstention decisions and interval estimates.
Why it matters / caveats: The benchmark isolates that "knowing when not to answer" is a separate, harder capability than symbolic causal reasoning or estimation, which current LLMs (especially open-weight ones) systematically lack; the authors' own ablation shows a weaker open-weight model (Qwen) is measurably more susceptible to being misled by realistic-sounding narrative "lures" than the strongest model, validating the benchmark's synthetic design against the "causal parrot" failure mode.
ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generation →
Technical breakdown
Problem: Offline motion generation models (diffusion, masked transformers) give precise text and kinematic control but are too slow for interactive applications, while existing online/autoregressive motion generators sacrifice controllability or have context windows too short to handle complex text semantics and long-horizon kinematic goals.
Method: ARDY combines a hybrid motion representation — an explicit global root feature (position, heading) concatenated with a compact latent body embedding from a learned tokenizer (FSQ-based, 8-layer causal-attention transformer encoder/decoder, patch size 4 frames) — with an autoregressive two-stage transformer denoiser (root transformer then body transformer, ~156M parameters, 8 layers/8 heads/1024 dim each) that predicts clean root motion first and conditions body-token prediction on it, interleaved across diffusion steps. It supports variable-length history context (up to 8s) and both in-window and long-horizon (out-of-window) spatial goal constraints (root waypoints/trajectories, full-body keyframes, sparse joint positions/rotations) injected via masked overwriting, trained on the proprietary ~700-hour Bones Rigplay dataset and evaluated on HumanML3D, using DDPM training with combined hybrid/decoded/goal/FK-consistency losses and classifier-free guidance.
Key results:
- The 4-step diffusion model achieves an average generation latency of 33 ms (10-step model: 63 ms) on an RTX 4090, enabling real-time interactive use.
- On HumanML3D against the offline SOTA MaskControl (no test-time optimization), ARDY achieves lower joint control error (4.15 cm vs. 46.18 cm) and lower foot-skating (6.28% vs. 7.27%) at comparable R-precision (0.729 vs. 0.760) with much lower latency (0.15s vs 0.46s).
- Against the autoregressive baseline DiP, ARDY has much lower joint error on out-of-horizon goals (2.92 cm vs. 17.64 cm) and better FID (0.100 vs. 1.453), demonstrating long-horizon planning that DiP cannot achieve.
- In a 240-pairwise human perceptual study, ARDY is preferred over DiP 65.8% (motion quality), 67.5% (semantic alignment), and 64.6% (goal accuracy) of the time.
- Ablations show the hybrid representation, global-to-local root conversion in the tokenizer decoder, and the two-stage denoiser design each contribute measurably (e.g., removing hybrid representation raises FID from 0.027 to 0.065 and joint-position error from 0.025m to 0.130m).
Why it matters / caveats: ARDY is presented as the first method to combine real-time generation, online text prompting, and long-horizon kinematic control natively (Table 1 comparison), without requiring test-time optimization or auxiliary RL policies used by prior work; the authors note it is purely kinematic (no physics awareness), so foot skating/jitter artifacts persist, and history is handled by storing all past frames rather than a more efficient memory mechanism.
A Sparse and Truncated State Vector Simulator for Peaked Circuits →
Technical breakdown
Problem: Peaked quantum circuits are designed to have a sharp output-probability peak on a target bit string, and the goal is to classically identify that bit string, but exact dense or sparse state-vector simulation becomes intractable as the number of nonzero amplitude terms grows exponentially with circuit depth/entanglement.
Method: The paper introduces an open-source sparse and truncated state-vector simulator that stores only nonzero amplitudes and applies two truncation strategies — top-k (hard limit on number of terms) and p-mass (threshold on cumulative retained probability mass), with p-mass applied first if both are specified. All state evolution (gate application, collision handling via vectorized segmented sums) and truncation (sorting by amplitude magnitude) are implemented as vectorized array operations with nearly identical CPU and GPU (128-bit complex, 64-bit float/int) backends, and a sparsity-aware gate-reordering plus gate-fusion strategy delays exponential term growth during simulation of BlueQubit's "sharp peak" benchmark circuit (44 qubits, ring connectivity, 580 instructions).
Key results:
- The correct output bit string for the sharp peak circuit is found using fewer than 2^5 terms.
- Simulation time scales linearly with k (top-k truncation) across multiple orders of magnitude (2^12 to 2^28), with the GPU backend about an order of magnitude faster than CPU at large k.
- Under p-mass truncation, a threshold of 99.9% probability mass causes the number of terms to grow past 2^28, while 90–99% keeps terms comparatively contained.
- As the p-mass threshold approaches 100%, the number of retained terms rises steeply toward 2^n, illustrating the fundamental limit of the truncation approach.
Why it matters / caveats: The method offers a practical, hardware-accelerated trade-off between fidelity and memory/runtime for peaked-circuit simulation, but the authors explicitly caution that a circuit can be crafted to spread probability mass over an enormous number of basis states even while maintaining a single sharp peak, which would defeat any truncation-based approach — so results are circuit-dependent rather than universally guaranteed.
Can Dialects Be Steered Like Languages? Sparse Neurons and Distributed Directions in Arabic LLMs →
Technical breakdown
Problem: Arabic LLMs are trained on data dominated by Modern Standard Arabic (MSA) and default to MSA-like outputs even when prompted in a dialect, and it is unknown whether dialect-specific features are encoded as isolated, steerable neurons (like distinct languages) or are diffusely entangled across representation space given the high lexical/syntactic overlap between Arabic varieties.
Method: The authors test two inference-time, weight-frozen interventions on ALLaM-7B-Instruct-preview and Fanar-1-9B-Instruct: (1) neuron-based steering, using a LAPE-style entropy score to identify sparse MLP neurons selectively active for a given dialect (top-n% activation probability, bottom-m% LAPE score) and multiplicatively rescaling their activations (amplify target-dialect neurons by α, optionally suppress MSA/competitor neurons by γ/γ_comp) during decoding; (2) vector steering, extracting a dialect-direction vector as the mean difference between response-token hidden states for parallel dialect vs. MSA sentence pairs from the MADAR corpus (12,000 pairs each for Cairo/Rabat/Beirut/Doha, 2,000 for Riyadh/Aleppo) at a chosen layer, then injecting it into the residual stream via a forward hook during generation. Evaluation combines Gemini-2.5-Flash LLM-as-a-judge scoring (dialect authenticity, coherence, fluency, MSA formality), the AL-QASIDA ADI2 automatic metric, and human evaluation by 8 Arabic annotators.
Key results:
- Dialect-associated neurons concentrate in late layers: layers 29–31 account for 69.5% of ALLaM's dialect-neuron records, and layers 37–41 account for 50.6% in Fanar.
- Cross-dialect neuron-set Jaccard overlap is low for MSA-vs-dialect pairs (avg. 0.09 in ALLaM, 0.14 in Fanar) but much higher between dialects (0.40–0.55), indicating dialects share internal structure while separating from MSA.
- In mono-dialect judge-average scores, vector steering matches or surpasses explicit prompting on Egyptian and Moroccan Arabic for both models (e.g., ALLaM Egyptian: 4.712 vector vs. 4.677 explicit vs. 3.978 unsteered); neuron steering improves ADI2 over baseline but shows no consistent LLM-judge gains.
- When prompts are written in MSA (MSA-prompt setting), neuron steering fails entirely (ADI2 reaches 0, dialect authenticity collapses to minimum), while vector steering still produces dialect signal across all six target dialects, showing it can override the input's linguistic register.
- A residual-subspace coverage analysis shows LAPE-selected neurons (under 1% of MLP dimensions) capture only a partial, non-trivial projection of the full vector-steering direction, explaining why neuron steering is less reliable than vector steering.
Why it matters / caveats: This is presented as the first study showing Arabic dialects are causally steerable within LLMs via both sparse neurons and distributed directions, suggesting dialect information is neither fully localized nor fully diffuse; however, experiments are limited to two Arabic-centric LLMs and a handful of dialects (mainly Egyptian/Moroccan for ablations), and automatic/LLM-judge metrics may not fully capture sociolinguistic authenticity, as the authors themselves note.