Day 56: Why evaluating the model is not enough
Why evaluating agents means measuring the whole workflow users experience.
Jul 18, 20263 min read
Command Palette
Search for a command to run...
#ai-evaluation
Articles tagged with #ai-evaluation
Day 55: Why observability is not optional for AI systems
Why production AI needs traces across prompts, context, retrieval, tools, costs, and decisions.
Jul 18, 20263 min read
Day 48: Why AI debate needs a reliable judge
Why AI debate is only useful when the judge has reliable criteria.
Jul 11, 20263 min read
Day 36: Why reflection should change the next action
Why reflection is valuable only when it decides whether to revise, retry, escalate, or stop.
Jun 27, 20263 min read
Day 30: Why RAG must be evaluated in parts
Why RAG evaluation has to measure retrieval, grounding, generation, and citations separately.
Jun 21, 20263 min read
Day 29: Why reflection only matters when tied to evidence
Why reflection only helps when it checks the answer against evidence and changes behavior.
Jun 20, 20263 min read