inference-optimization
Everything on Ground Truth tagged “inference-optimization” — 2 items.
LatentMAS Tool
A training-free framework for multi-agent collaboration that passes last-layer hidden states and cached internal state between agents instead of text messages, reporting 70.8 to 83.7 percent fewer output tokens and roughly four times faster end-to-end inference. Already has an extension ecosystem including science, retrieval and hybrid variants.
ComfyUI-SolAttn-H3 Tool
A ComfyUI custom node that wires NVIDIA's training-free Sol-Attn sparse attention into the native MiniMax-H3 video path using public ModelPatcher APIs, so it drops in without modifying any ComfyUI core files. Keeps a prefix sink exact and sparsifies the remaining attention via a tunable threshold, with the gain growing as sequence length grows.