How do you test something that can behave differently every single time?

In this episode, we speak with Amitha Pulijala, Chief Product Officer, and Christoph Börner, VP of Engineering, both at Cyara, about one of the most pressing challenges in conversational AI today. The shift from deterministic, scripted IVRs to generative AI agents is changing how conversational systems are built and tested.

The episode covers how Cyara approaches testing in a non-deterministic world, including using AI agents to test AI agents, and why traditional ideas like test coverage no longer apply in the same way.

Christoph and Amitha share what they are seeing across Cyara’s clients and the wider industry. The discussion unpacks what AI trust means in practice. We talk about hallucinations, model drift, factual accuracy, bias and regulatory compliance.

We explore the economics of generative AI. The cost of running it at scale in production and in testing, and how organisations are rethinking where large language models are necessary versus where smaller, domain-specific models are more effective.

The discussion also highlights how failure can scale in AI systems, where a single bad response can affect thousands of customers.

Get a free pass to Cyara’s Xchange 2026 in Dallas, TX, using code VUX: https://cyara.com/event/xchange-2026

Find out more about Cyara: https://cyara.com

Follow Amitha on LinkedIn: https://www.linkedin.com/in/amitha

Follow Christoph on LinkedIn: https://www.linkedin.com/in/christoph-b%C3%B6rner-7721ab147

Follow Kane on LinkedIn: https://www.linkedin.com/in/kanesimms

Subscribe to VUX World: https://vuxworld.typeform.com/to/Qlo5aaeW

Subscribe to The AI Ultimatum Substack: https://open.substack.com/pub/kanesimms

Hosted on Acast. See acast.com/privacy for more information.