One Self-Written Page Is Enough to Collapse an AI Search Answer

Source: RAG Collapse: LLM Responses Collapse When Retrieved Documents Are Self-Authored

Paper was published on August 22, 2026

This episode was AI-generated on August 25, 2026. The script was written by an AI language model and the host voices were synthesized by Eleven Labs. The producer is not affiliated with Anthropic or Eleven Labs.

A search-enabled model doesn't prefer AI-written pages — it prefers pages written from its own previous answer, by nearly three to one, even among sources it just graded flawless. Slip one such page into a pool of five to ten real references and almost a quarter of questions collapse to a single frozen answer, with no retraining and no weight ever changing. This episode walks through the experiment, the causal test that kills the boring explanations, and why AI-content detectors are the wrong tool for the problem.

Key Takeaways

• Why this isn't model collapse: no weights are retrained — the loop closes inside a single query, on the few thousand words that make it into the context window
• The contamination threshold that reframes the risk: one self-authored page out of five to ten collapses 22.8% of entity questions, versus 28.7% when every reference is replaced
• How the authors killed the two obvious explanations — AI-detector-flagged originals got 9.4% citations vs 7.4% for human-written, and among references the model itself rated flawless, its own writing still won 38.2% to 13.3%
• The finding underneath everything: retrieval-augmented generation is a sharpening operation, not a mirror — an entity in five of ten sources appears in essentially all ten responses
• Where the paper can't go: the authors admit they can't distinguish stylistic self-preference from a content match between the source and the answer the model was already about to write
• Why filtering AI-generated content is the wrong mitigation, and why a human-written article based on a model's answer would carry no detectable fingerprint at all

• 00:00 — It likes its own writing, not AI writing
  The cold open lays out the citation gap that anchors the whole episode, plus the fact that roughly four in ten pages ChatGPT cites are already classified as AI-generated.
• 01:18 — Why retraining has nothing to do with it
  Tyler raises the known model-collapse result and the loaded-die analogy, and Cassidy explains why this failure runs on a timescale of minutes rather than years.
• 03:03 — Ten different answers become one answer
  The Twitch streamer experiment: how the loop is closed with an expanded article, and what the distribution looks like after five rounds across 1,528 simulations.
• 05:54 — One page does what ten pages do
  The result that changes the risk model — a single self-authored reference collapses nearly as many questions as replacing the entire pool.
• 07:58 — Two boring explanations, both killed
  The GPTZero split, the restriction to references the model itself rated five out of five, and the regression that isolates self-authorship from measured quality.
• 12:12 — The photocopier with the contrast cranked up
  The least-discussed finding: retrieval amplifies pluralities into unanimity, which is the ratchet that lets one page do so much damage.
• 13:53 — How much of this should you believe?
  Cassidy lists the four ways the authors handicapped themselves, then Tyler pushes on scope and on whether 'self-bias' is vanity or just a very precise relevance match.
• 16:55 — The article no detector will ever flag
  Why provenance of the idea, not AI-ness of the text, is the real variable — and what that means for anyone building retrieval over their own model-touched corpus.

Recommended Reading

• AI models collapse when trained on recursively generated data — The Nature paper Tyler names by author in the episode — the training-pipeline version of collapse (and the fair-die metaphor) that this work deliberately contrasts with an inference-time loop where no weights move.
• LLM Evaluators Recognize and Favor Their Own Generations — The self-recognition/self-preference result the paper leans on to explain why its own writing gets cited three-to-one, and the natural next stop if you share Tyler's doubt about style versus content-match.
• Self-Consuming Generative Models Go MAD — An alternative framing of the same feedback loop in image generation, including the crucial variant the episode flags as missing: what happens when fresh human data keeps entering the pool rather than only the model's own echoes.
• Lost in the Middle: How Language Models Use Long Contexts — Evidence that the retrieval step is already a biased, non-faithful filter on what's in the context window — useful background for the episode's central claim that RAG sharpens rather than mirrors its sources.