FDA Is Asking the Right AI Question: Who Watches the Model After Approval?

FDA has opened public feedback on how to regulate generative AI-enabled medical devices. For oncology, this is not a theoretical digital-health debate. AI is already moving toward radiology, pathology, triage, trial matching and patient-facing tools.

September 4, 2026
Editorial
Generative AI is entering medical devices, but oncology needs regulation that can track performance, bias and safety after deployment.[everything possible] / Shutterstock.com

IPM Take

This is the AI regulation story oncology should care about. A model that changes, hallucinates, drifts or performs differently across patient groups cannot be treated like a static medical device. Cancer systems need premarket evidence, postmarket monitoring, human accountability and transparency before generative AI becomes embedded in diagnosis, referral and treatment decisions.

Executive Summary

FDA issued a discussion paper on regulatory considerations for generative AI-enabled medical devices and requested public feedback by 19 October 2026 under docket FDA-2026-N-7874. The agency is asking for input on risk assessment, premarket evaluation, postmarket monitoring and related issues. The paper is for discussion and does not establish new requirements, but it signals that FDA is actively considering how to regulate devices whose outputs may vary and whose performance may change over time.

Why it matters

  • Patients / advocates: AI tools used in cancer care must be safe, transparent and tested across real patient populations.
  • Clinicians: If AI supports diagnosis, triage or decision-making, clinicians need to know when to trust it and when to override it.
  • Diagnostics / pathology: Oncology AI will be judged on performance across tissue, imaging, biomarkers, ethnicity, age and centre-level variation.
  • Regulators: Static approval models are poorly suited to adaptive or generative systems that may evolve after deployment.

The most important AI question is not whether the model looks impressive in a demo.

It is what happens after it enters care.

FDA’s discussion paper on generative AI-enabled medical devices is important because it moves the conversation beyond hype. Generative AI tools can produce variable outputs, respond differently to similar prompts, and change through updates or deployment conditions. That makes them different from traditional locked devices and different from many earlier software tools.

For oncology, this is not abstract.

AI is already being pushed into radiology, pathology, risk prediction, molecular interpretation, patient communication, trial matching and clinical workflow. In each of those areas, a confident wrong answer can do damage. A missed lesion, a misread pathology report, a biased triage suggestion, or a hallucinated patient instruction is not a software inconvenience. It is a safety issue.

The right regulatory focus is lifecycle control. Premarket evidence matters, but it is not enough. Postmarket monitoring matters. Drift detection matters. Real-world performance across populations matters. Clear responsibility matters when a clinician, hospital, vendor and model all sit inside the same decision chain.

The oncology field should also be honest about equity. AI tools trained on narrow data can fail quietly in the patients least represented in development datasets. If regulators do not require evidence on subgroup performance, cancer systems may automate the same inequalities they claim to solve.

This discussion paper is not final guidance. It is not a new rule. But it asks the right question: how do you regulate a tool that may not behave the same way tomorrow as it did yesterday?

Oncology should answer loudly.

Source & Evidence