TL;DR
Utah has become the first US state to let an AI chatbot, Doctronic, renew prescriptions without a doctor, via a regulatory sandbox that waives licensing laws. The state’s medical licensing board, blindsided by the January launch, called in April for the pilot to be halted over safety risks, but the state refused. The case exposes a federal-state regulatory vacuum around AI in medicine.
Utah has quietly become the first US state to let an AI chatbot renew prescriptions without a doctor, according to the Associated Press. The programme, run by a company called Doctronic, launched in January and has set off a fierce medical debate.
Residents can skip the doctor’s office and refill prescriptions online through the chatbot. It asks about their medication and history, checks a national pharmacy database, and either renews the script or escalates to a human doctor.
The launch was possible only through a “regulatory sandbox” that lets Utah officials waive laws for promising AI. State and federal rules otherwise restrict prescribing to licensed medical professionals.
“We have crossed a threshold in terms of giving something that is not human a medical license, whether or not we want to call it that,” the University of Pennsylvania’s Dr Eric Bressman told the AP. He and others say they are not opposed to AI prescribing, but want it held to standards as rigorous as those for human doctors.
The board that got left out
Utah’s medical licensing board says it only learned of the programme when the January launch made the news. In an April letter, 11 members called for the pilot to be halted, citing the risks of auto-renewing drugs with side effects or interactions.
“We were essentially told: ‘Yes this is going on. And no, you don’t have a say in it’,” said Dr Alan Smith, a family physician who chairs the board but spoke for himself.
The state declined to suspend it, noting human doctors still review every refill in this first phase.
The programme is currently overseen by a five-member board of AI specialists, none of them doctors. Doctronic expects to move to fully automated refills soon.
Smith warns the risks are real, pointing out that Doctronic’s roughly 190 refillable medications include blood thinners, which turn dangerous if a patient develops internal bleeding. The American Medical Association has echoed the concern that “prescription renewals aren’t routine checkboxes”.
A regulatory vacuum by design
The case exposes a jurisdictional tangle, since medical technology is regulated federally while medical professionals are overseen by states. Doctronic frames its AI as part of state-regulated medical practice, though some experts argue it has crossed into FDA territory.
The company would not say whether it has sought FDA permission. The agency told the AP it has authorised no AI chatbots but wants to encourage innovation, a hands-off posture that fits a broader loosening of oversight on AI health tools.
Critics see history rhyming, with Bressman comparing the moment to the haphazard medicine of the early 20th century, before boards and benchmarks existed. The template for licensing AI medical services in other states comes from the Cicero Institute, a pro-AI think tank founded by Palantir co-founder Joe Lonsdale.
The stakes are not abstract, as safety researchers have warned that medical chatbots can sound authoritative while dispensing dangerous advice. Others caution that removing humans from care can undermine the very outcomes it promises.
Rivals are scrambling to map those failure modes too. Meta went as far as posing as teenagers to test how competing chatbots handle sensitive topics.
Doctronic plans peer-reviewed studies later this year, though its only published paper so far was written by its own scientists and not independently reviewed. As one Utah law professor put it, companies risk letting the technology race beyond the evidence, and betraying public trust in the process.
