Section
Models inside products: evaluation, retrieval, latency and the bill at the end of the month.
2 articles
AI Development10 min read
Most agent failures are not reasoning failures. They are interface failures — a tool whose name is ambiguous, whose arguments are guessable, or whose errors say nothing about what to do next.
AI Development10 min read
The per-token price is the number everyone quotes and the smallest part of the bill. Four other costs decide whether a feature is viable, and three of them are yours rather than the provider's.