on-device-ai
Cactus Ships a Phone-Sized Model That Knows When to Ask the Cloud, With a TLS Footgun News
Cactus released a Gemma-4 model with a tiny probe that scores how likely its own answer is wrong and routes uncertain queries to the cloud, but the cloud path ships full conversations and disables TLS verification by default.
Apple's on-device SpeechAnalyzer beats Whisper Small using about a third of the compute News
Apple's new on-device SpeechAnalyzer API cut errors roughly fourfold versus its legacy recognizer and outperformed OpenAI's Whisper Small while using about a third of the compute, in an English-only single-vendor benchmark.
This method compiles plain English into a tiny model that rivals a 32B giant News
A new paper, Program-as-Weights, uses a 4B compiler to turn natural-language specs into small neural adapters that let a 0.6B model match a 32B model on fuzzy tasks, running at about 30 tokens per second on a laptop.
Apple SpeechAnalyzer Tool
Apple's on-device speech-to-text API that cut errors roughly fourfold over the legacy recognizer and beat Whisper Small using about a third of the compute - private, local transcription with no cloud round-trip.