FinOps in Action

·E79

Is Your AI Spend Actually Paying Off | Ep # 79

July 30
23 mins

Episode Description

This episode of FinOps in Action pulls together voices from across the industry, including Pathik Sharma of Google Cloud, Emily Cornock, Kevin Mueller, Zach Johnson, Henrique, Shailaja Beeram, Marit Hughes, and Oliver Milke, all wrestling with the same question: how do you actually manage the cost of AI. Two years ago the idea of "AI for FinOps" got brushed off as premature. Now it sits in the top three priorities in the FinOps Foundation's own survey data, and for good reason. The guests dig into why AI spend is accelerating faster than cloud ever did, why most companies still cannot prove ROI on it, and what it actually looks like to build guardrails without slowing teams down. It is a rapid fire look at where FinOps practice is headed as AI stops being a side experiment and starts becoming the biggest line item on the P&L.


Here’s what we talked about:

  • Treat your AI investment like a science experiment. Control your variables, change one thing at a time, and always tie spend back to a measurable business outcome, not just a feeling that things are getting more productive.
  • Token cost is only the tip of the iceberg. Storage, the adaptive storage layer, GPU and TPU compute, and platform hosting all add up, so don't let your team optimize the visible 20% while ignoring the rest.
  • Not all AI actions carry the same risk, so treat them differently. Let AI handle low stakes, non disruptive work like cost allocation labeling on its own, but keep a human in the loop for anything disruptive, like rightsizing a Kubernetes workload during Black Friday.
  • Don't let analysis paralysis become your default setting. Make your best reasonable estimate on AI spend, document your assumptions, and move forward instead of letting fear triple your forecasts.
  • Shift FinOps further left than you think you need to. Get engineering and product involved in AI cost conversations early, because the goal is not command and control, it's giving teams the data to make good decisions themselves.

Chapters:

00:00 Welcome to FinOps

00:18 AI Meets FinOps

01:12 Spend Growth Shock

01:40 Tech Pace Explosion

02:28 Making AI Serious

02:52 FinOps DNA for AI

03:29 ROI Reality Check

04:26 Experiment With Controls

05:06 Claims AI Success Story

06:49 Unit Economics Mindset

07:37 Measure Value and Impact

09:27 Enable Not Control

10:19 Link Tools to Outcomes

11:04 Orchestrators Change Costs

11:48 Guardrails and Fact Checks

13:12 Copilot Dashboards to Agents

14:20 Safe Automation Actions

17:16 Managing AI Spend Layers


 🎧 Subscribe for more FinOps leadership conversations → https://www.finopsinaction.com/ 

Quote of the Show:

  • "Think about AI as that eager intern. It can do the work, but you also need to trust, verify, and wait for the manager to give you a nod." – Pathik Sharma

Connect with the Guest’s:

Ways to Tune In:

See all episodes