Markdown source

How should coding agents be evaluated before production use?

Context

Coding agents need evaluation gates before they can safely change code, trigger workflows, or influence production systems.

Working Answer

This page is a first-pass research question, not a final recommendation. Use the linked evidence to refine the answer as more exact session recordings, transcripts, and reviewed slide readings become available.

Evidence

• agent evaluations — Topic synthesis
• coding agents — Topic synthesis
• software factories — Topic synthesis
• claude agent sdk — Tool inventory
• arize — Tool inventory
• braintrust — Tool inventory
• 2026 06 29 laurie voss from vibes to production evaluating and shipping ai agents that work 101 — Official schedule
• 2026 06 30 philipp schmid don t ship skills without evals — Official schedule
• youtube Xfl50508LZM slides — Slide/OCR evidence
• youtube bk0TmxoZlUY slides — Slide/OCR evidence

Next Questions

• Extract specific claims from the linked source pages.
• Separate official schedule evidence from supporting YouTube, transcript, and OCR evidence.
• Convert stable answers into playbooks, harnesses, or evaluations where appropriate.