Research briefing with Brian Houck: Measuring AI agents and revisiting the Core 4

July 24
46 mins

View Transcript

Episode Description

AI coding agents are changing how software gets built, but they're also forcing organizations to rethink how engineering effectiveness is measured. Traditional developer experience metrics were designed for humans, not AI agents, so how should engineering leaders adapt?

In this webinar, Justin Reock, Deputy CTO at DX, is joined by Brian Houck, Distinguished Scientist at DX and co-author of the SPACE framework, to explore the emerging field of agent experience and how it builds on developer experience rather than replacing it. They discuss how organizations can prepare for AI-assisted software development, how the DX Core 4 applies in the age of AI, why metrics like token usage and PR throughput don't tell the whole story, and the growing importance of documentation. They also examine the impact AI-driven pressure is having on burnout and cognitive overload.

Throughout the conversation, they share practical guidance for building engineering organizations where both developers and AI agents can do their best work.


Where to find Brian Houck: 

• LinkedIn: https://www.linkedin.com/in/brianhouck


Where to find Justin Reock:

• LinkedIn: ⁠https://www.linkedin.com/in/justinreock⁠


In this episode, we cover:

(00:00) Intro

(01:26) Justin’s new role at DX

(03:53) What agent experience is and why engineering leaders should care

(08:55) How to improve agent experience at the platform level

(11:25) How agent experience and developer experience influence each other

(14:41) Preparing engineering teams for agentic work

(21:38) Why the DX Core 4 still matters in the age of AI

(27:23) What PR throughput actually measures 

(32:47) The limits of token metrics

(37:10) What the data shows about documentation and developer experience

(39:32) Improving documentation for AI agents

(40:43) AI-washing, burnout, and cognitive overload

(45:35) Brian's upcoming research on agent experience


Referenced:

DX Core 4 Productivity Framework

The SPACE of AI | Queue

Sara Chizari on LinkedIn

The Middle Loop - Annie Vella

gastownhall/gastown: Gas Town - multi-agent workspace manager · GitHub

DORA, SPACE, and DevEx: Which framework should you use?

AI Impact Report: Q1 2026

AI-authored code has nearly doubled, but so has PR size 

EngThrive: Make It Fast and Easy to Do Great Work: Building a durable model for outcome-oriented engineering measurement

Google's Project Aristotle - Psychological Safety 

Zapier

See all episodes