Infra
-
DeepInfer Inference Engine: What DeepSeek Left Out
The DeepInfer inference engine is DeepSeek's open-source Apache-2.0 serving code. What the README gives you, what it leaves out, and what I would steal.
-
WebMCP: I Tested Chrome’s Tool API for Browser Agents
WebMCP lets a web page hand tools to a browser agent. I ran it in Chromium 153, hit one real bug, and sketched a half-day Trellis experiment.
-
Codebase Port Cost: What ts-rust Really Took
ts-rust ported the TypeScript compiler to Rust with agents. I ran it and read its own numbers: the codebase port cost $24k after a $400k stall.
-
LiteLLM Budget Limits: max_budget Needs Postgres
A LiteLLM budget cap does nothing without a database. I tested v1.104.0, then set up per-agent keys and a team spend limit in ten minutes.
-
Packaging Beats Peak Performance
Packaging beats peak performance: why open-source models stall at the doorstep There’s a pattern I keep seeing: an engineering team furiously trains a model, they throw the weights…