AI & Engineering · 10 min
Your Evals Have No Tests
A green eval suite isn't evidence your agent works — it's the absence of evidence. Mutation testing shows you exactly how blind your evals really are.
Tag
3 posts
A green eval suite isn't evidence your agent works — it's the absence of evidence. Mutation testing shows you exactly how blind your evals really are.
Shipping production AI isn't about model benchmarks; it's the reliability, retries, fallbacks, observability, and cost discipline that keep LLM systems alive.
Reliable agents come from control, not capability. Cap turns and time, push predictable steps into a state machine, and keep a human on the irreversible ones.