Andrew and Justin discuss the Hugging Face breach, which saw an unreleased OpenAI model find its way into the company's systems during internal testing. They also discuss the launch of Opus 5, the ongoing progress made by Chinese models, and the crunch for compute as 10GW data center plans start to make some motion. Plus, a tribute to the late John C. Dvorak.

The Attention Mechanism is now available in video! Check it out here.

Chapters

00:00 - Intro

01:23 - Hugging Face

15:45 - Chinese Models

26:01 - Opus 5

36:11 - 10GW Data Centers

52:29 - RIP John C. Dvorak

Hosted on Acast. See acast.com/privacy for more information.