AI System Architecture25 min
Evaluating AI Systems
Build a versioned evaluation set and a regression gate that can reveal where a system starts to fail.
Huang Tzu Lin
5 posts
Build a versioned evaluation set and a regression gate that can reveal where a system starts to fail.
Bound a tool loop, distinguish failure from uncertainty, and recover without duplicating external effects.
Bring evidence, state, approvals, and recovery together in an inspectable travel-planning system.
Give conversation context, task state, evidence, and durable records clear owners and lifetimes.
Design stage contracts that catch malformed data, unsupported interpretations, and broken business rules.