vision-language-models
A video model counted events correctly two-tenths of one percent of the time News
Asked to count simple events in short synthetic clips, Google's Gemini 3.6 Flash got the final count right 0.2 percent of the time in the hardest setting and recovered only 18 percent of the events that actually occurred.
Asked to sit in a chair it can see, the best AI model misses five times out of seven News
A new benchmark decouples motor control from decision-making and asks nine frontier vision-language models to find an object, walk to it and sit on it - the best completes 16.8% of episodes, and perception is not the problem.
Microsoft lets the video codec pick which pixels the model sees News
Microsoft's Mage-VL reuses a video file's own compression decisions to choose which image patches a vision model processes, cutting visual tokens by over 75% and reporting up to a 3.5x speedup over uniform frame sampling.
New tests show vision-language models still can't reliably see the fine details News
Two 2026 benchmarks argue that high vision-language-model scores are partly a mirage: a 'gated scoring' test that fails a model outright when it misses an essential fact exposes an 8% perception gap between open and proprietary models, while a second method fixes brittleness by handing precise localization to a specialized tool.
Why AI Vision Benchmarks Reward Getting Close Instead of Getting It Right News
A new evaluation method argues standard image benchmarks hide model failures by averaging all details equally, and it exposes an 8-point perception gap between open and proprietary models that looser scoring conceals.