Cactus Whistle: 17 MB Speech-to-Text, Tested in French
I ran Cactus Whistle, a 16.9 MB open speech-to-text model, on Québec French, accented English and noise. Here is what it got wrong.
Read the full story →Latest
LiteLLM Budget Limits: max_budget Needs Postgres
A LiteLLM budget cap does nothing without a database. I tested v1.104.0, then set up per-agent keys and a team spend limit in ten minutes.
Vectorless RAG: Reasoning Over a Tree, Not Cosine Search
Vectorless RAG swaps embeddings for a table-of-contents tree the LLM walks. What PageIndex does well, what a query costs, and who should…
MoE Expert Offloading: 125B on a 12GB GPU, With Catches
MoE expert offloading lets a 12GB GPU run a 125B model, but only for one user at a time. What Strata's numbers…
Why I’m Betting on a Minimal Agent Harness
Pi 1.0's own release notes claim a 40% prompt-token cut from Codemode. Here's the arithmetic I'd run before trusting a minimal agent…
Open-weight decision models: Clef vs Strands Decider
Clef and Strands Decider 2B are open-weight decision models that return a calibrated score, not text. Here's what shipped and why it…
The Hidden Risk of Letting AI Manage Ad Campaigns
MCP's own specs disagree on whether it is stateful. Neither defines a record of what changed in your ad account — and…