An illustration of a generator agent and a skeptical evaluator agent facing each other across a phase gate, with a sprint contract between them
Back to blog
Premium
AI AgentsAgentic HarnessVerification

Verification & Control: Why Agents Can't Grade Their Own Homework

Sascha KieferAI & Agents

Part four of our agentic-harness series covers what keeps an agent honest. Self-evaluation fails systematically, so good harnesses separate the generator from a skeptical evaluator, agree a sprint contract before any code is written, and enforce hard thresholds at a phase gate - plus the guardrails that make dangerous actions impossible.

This is part four of our five-part series on agentic harnesses. We've built up what a harness is, the loop and tools that let an agent act, and context management that keeps it coherent. Now the part that keeps it honest: verification and control.

The Core Failure: Agents Praise Themselves

Ask an agent to grade its own work and it will almost always call the work great, even when a human can see it's mediocre. This isn't a quirk; it's systematic. Anthropic's work on long-running agents found that naive single-agent setups fall short on complex tasks for two reasons: models lose coherence as the window fills (which context management addresses), and they are unreliable judges of their own output.

Agents reliably praise their own work, but an external evaluator can be tuned for skepticism and given concrete grading criteria.

That last sentence is the whole solution.

Premium article

Read the full article

Enter your email and we'll send you a link to the complete article — it's free.