Death By 1,000 Clicks: Where Electronic Health Records Went Wrong
The pain radiated from the top of Annette Monachelli’s head, and it got worse when she changed positions. It didn’t feel like her usual migraine. The 47-year-old Vermont attorney turned innkeeper visited her local doctor at the Stowe Family Practice twice about the problem in late November 2012, but got little relief.
Two months later, Monachelli was dead of a brain aneurysm, a condition that, despite the symptoms and the appointments, had never been tested for or diagnosed until she turned up in the emergency room days before her death.
Monachelli’s husband sued Stowe, the federally qualified health center the physician worked for. Owen Foster, a newly hired assistant U.S. attorney with the District of Vermont, was assigned to defend the government. Though it looked to be a standard medical malpractice case, Foster was on the cusp of discovering something much bigger — what his boss, U.S. Attorney Christina Nolan, calls the “frontier of health care fraud” — and prosecuting a first-of-its-kind case that landed the largest-ever financial recovery in Vermont’s history.
Foster began with Monachelli’s medical records, which offered a puzzle. Her doctor had considered the possibility of an aneurysm and, to rule it out, had ordered a head scan through the clinic’s software system, the government alleged in court filings. The test, in theory, would have caught the bleeding in Monachelli’s brain. But the order never made it to the lab; it had never been transmitted.
The software in question was an electronic health records system, or EHR, made by eClinicalWorks (eCW), one of the leading sellers of record-keeping software for physicians in America, currently used by 850,000 health professionals in the U.S. It didn’t take long for Foster to assemble a dossier of troubling reports — Better Business Bureau complaints, issues flagged on an eCW user board, and legal cases filed around the country — suggesting the company’s technology didn’t work quite the way it said it did.
Until this point, Foster, like most Americans, knew next to nothing about electronic medical records, but he was quickly amassing clues that eCW’s software had major problems — some of which put patients, like Annette Monachelli, at risk.
Damning evidence came from a whistleblower claim filed in 2011 against the company. Brendan Delaney, a British cop turned EHR expert, was hired in 2010 by New York City to work on the eCW implementation at Rikers Island, a jail complex that then had more than 100,000 inmates. But soon after he was hired, Delaney noticed scores of troubling problems with the system, which became the basis for his lawsuit. The patient medication lists weren’t reliable; prescribed drugs would not show up, while discontinued drugs would appear as current, according to the complaint. The EHR would sometimes display one patient’s medication profile accompanied by the physician’s note for a different patient, making it easy to misdiagnose or prescribe a drug to the wrong individual. Prescriptions, some 30,000 of them in 2010, lacked proper start and stop dates, introducing the opportunity for under- or overmedication. The eCW system did not reliably track lab results, concluded Delaney, who tallied 1,884 tests for which they had never gotten outcomes.
The District of Vermont launched an official federal investigation in 2015.
[protected-iframe id="6ecbeb88b6e290afd1f6b6c34a180915-7618883-99279322" info="//players.brightcove.net/1875348214/default_default/index.html?videoId=6015060967001" width="100%" height="435" webkitallowfullscreen="" mozallowfullscreen="" allowfullscreen=""]
The eCW spaghetti code was so buggy that when one glitch got fixed, another would develop, the government found. The user interface offered a few ways to order a lab test or diagnostic image, for example, but not all of them seemed to function. The software would detect and warn users of dangerous drug interactions, but unbeknownst to physicians, the alerts stopped if the drug order was customized. “It would be like if I was driving with the radio on and the windshield wipers going and when I hit the turn signal, the brakes suddenly didn’t work,” said Foster.
The eCW system also failed to use the standard drug codes and, in some instances, lab and diagnosis codes as well, the government alleged.
[khn_slabs slabs="929806"]
The case never got to a jury. In May 2017, eCW paid a $155 million settlement to the government over alleged “false claims” and kickbacks — one physician made tens of thousands of dollars — to clients who promoted its product. Despite the record settlement, the company denied wrongdoing; eCW did not respond to numerous requests for comment.
If there is a kicker to this tale, it is this: The U.S. government bankrolled the adoption of this software — and continues to pay for it. Or we should say: You do.
Which brings us to the strange, sad, and aggravating story that unfolds below. It is not about one lawsuit or a piece of sloppy technology. Rather, it’s about a trouble-prone industry that intersects, in the most personal way, with every one of our lives. It’s about a $3.7 trillion health care system idling at the crossroads of progress. And it’s about a slew of unintended consequences — the surprising casualties of a big idea whose time had seemingly come.
The Virtual Magic Bullet
Electronic health records were supposed to do a lot: make medicine safer, bring higher-quality care, empower patients, and yes, even save money. Boosters heralded an age when researchers could harness the big data within to reveal the most effective treatments for disease and sharply reduce medical errors. Patients, in turn, would have truly portable health records, being able to share their medical histories in a flash with doctors and hospitals anywhere in the country — essential when life-and-death decisions are being made in the ER.
But 10 years after President Barack Obama signed a law to accelerate the digitization of medical records — with the federal government, so far, sinking $36 billion into the effort — America has little to show for its investment. KHN and Fortune spoke with more than 100 physicians, patients, IT experts and administrators, health policy leaders, attorneys, top government officials and representatives at more than a half-dozen EHR vendors, including the CEOs of two of the companies. The interviews reveal a tragic missed opportunity: Rather than an electronic ecosystem of information, the nation’s thousands of EHRs largely remain a sprawling, disconnected patchwork. Moreover, the effort has handcuffed health providers to technology they mostly can’t stand and has enriched and empowered the $13-billion-a-year industry that sells it.
By one measure, certainly, the effort has achieved what it set out to do: Today, 96 percent of hospitals have adopted EHRs, up from just 9 percent in 2008. But on most other counts, the newly installed technology has fallen well short. Physicians complain about clumsy, unintuitive systems and the number of hours spent clicking, typing and trying to navigate them — which is more than the hours they spend with patients. Unlike, say, with the global network of ATMs, the proprietary EHR systems made by more than 700 vendors routinely don’t talk to one another, meaning that doctors still resort to transferring medical data via fax and CD-ROM. Patients, meanwhile, still struggle to access their own records — and, sometimes, just plain can’t.
[caption id="attachment_928360" align="alignright" width="500"] (Nicolas Rapp/Fortune)[/caption]
Instead of reducing costs, many say, EHRs, which were originally optimized for billing rather than for patient care, have instead made it easier to engage in “upcoding” or bill inflation (though some say the systems also make such fraud easier to catch).
More gravely still, a months-long joint investigation by KHN and Fortune has found that instead of streamlining medicine, the government’s EHR initiative has created a host of largely unacknowledged patient safety risks. Our investigation found that alarming reports of patient deaths, serious injuries and near misses — thousands of them — tied to software glitches, user errors or other flaws have piled up, largely unseen, in various government-funded and private repositories.
Compounding the problem are entrenched secrecy policies that continue to keep software failures out of public view. EHR vendors often impose contractual “gag clauses” that discourage buyers from speaking out about safety issues and disastrous software installations — though some customers have taken to the courts to air their grievances. Plaintiffs, moreover, say hospitals often fight to withhold records from injured patients or their families. Indeed, two doctors who spoke candidly about the problems they faced with EHRs later asked that their names not be used, adding that they were forbidden by their health care organizations to talk. Says Assistant U.S. Attorney Foster, the EHR vendors “are protected by a shield of silence.”
Though the software has reduced some types of clinical mistakes common in the era of handwritten notes, Raj Ratwani, a researcher at MedStar Health in Washington, D.C., has documented new patterns of medical errors tied to EHRs that he believes are both perilous and preventable. “The fact that we’re not able to broadcast that nationally and solve these issues immediately, and that another patient somewhere else may be harmed by the very same issue — that just can’t happen,” he said.
David Blumenthal, who, as Obama’s national coordinator for health information technology, was one of the architects of the EHR initiative, acknowledged to KHN and Fortune that electronic health records “have not fulfilled their potential. I think few would argue they have.”
The former president has likewise singled out the effort as one of his most disappointing, bemoaning in a January 2017 interview with Vox “the fact that there are still just mountains of paperwork … and the doctors still have to input stuff, and the nurses are spending all their time on all this administrative work. We put a big slug of money into trying to encourage everyone to digitalize, to catch up with the rest of the world … that’s been harder than we expected.”
Seema Verma, the current chief of the Centers for Medicare & Medicaid Services (CMS), which oversees the EHR effort today, shudders at the billions of dollars spent building software that doesn’t share data — an electronic bridge to nowhere. “Providers developed their own systems that may or may not even have worked well for them,” she told KHN and Fortune in an interview last month, “but we didn’t think about how all these systems connect with one another. That was the real missing piece.”
Perhaps none of the initiative’s former boosters is quite as frustrated as former Vice President Joe Biden. At a 2017 meeting with health care leaders in Washington, he railed against the infuriating challenge of getting his son Beau’s medical records from one hospital to another. “I was stunned when my son for a year was battling stage 4 glioblastoma,” said Biden. “I couldn’t get his records. I’m the vice president of the United States of America. … It was an absolute nightmare. It was ridiculous, absolutely ridiculous, that we’re in that circumstance.”
[khn_slabs slabs="790331" view="inline"]
A Bridge To Nowhere
As Biden would tell you, the original concept was a smart one. The wave of digitization had swept up virtually every industry, bringing both disruption and, in most cases, greater efficiency. And perhaps none of these industries was more deserving of digital liberation than medicine, where life-measuring and potentially lifesaving data was locked away in paper crypts — stack upon stack of file folders at doctors’ offices across the country.
Stowed in steel cabinets, the records were next to useless. Nobody — particularly at the dawn of the age of the iPhone — thought it was a good idea to leave them that way. The problem, say critics, was in the way that policymakers set about to transform them.
“Every single idea was well-meaning and potentially of societal benefit, but the combined burden of all of them hitting clinicians simultaneously made office practice basically impossible,” said John Halamka, chief information officer at Beth Israel Deaconess Medical Center, who served on the EHR standards committees under both George W. Bush and Barack Obama. “In America, we have 11 minutes to see a patient, and, you know, you’re going to be empathetic, make eye contact, enter about 100 pieces of data, and never commit malpractice. It’s not possible!”
KHN and Fortune examined more than two dozen medical negligence cases that have alleged that EHRs either contributed to injuries, had been improperly altered, or were withheld from patients to conceal substandard care. In such cases, the suits typically settle prior to trial with strict confidentiality pledges, so it’s often not possible to determine the merits of the allegations. EHR vendors also frequently have contract stipulations, known as “hold harmless clauses,” that protect them from liability if hospitals are later sued for medical errors — even if they relate to an issue with the technology.
But lawsuits, like that filed by Fabian Ronisky, which do emerge from this veil, are quite telling.
Ronisky, according to his complaint, arrived by ambulance at Providence Saint John’s Health Center in Santa Monica on the afternoon of March 2, 2015. For two days, the young lawyer had been suffering from severe headaches while a disorienting fever left him struggling to tell the 911 operator his address.
Suspecting meningitis, a doctor at the hospital performed a spinal tap, and the next day an infectious disease specialist typed in an order for a critical lab test — a check of the spinal fluid for viruses, including herpes simplex — into the hospital’s EHR.
The multimillion-dollar system, manufactured by Epic Systems Corp. and considered by some to be the Cadillac of medical software, had been installed at the hospital about four months earlier. Although the order appeared on Epic’s screen, it was not sent to the lab. It turned out, Epic’s software didn’t fully “interface” with the lab’s software, according to a lawsuit Ronisky filed in February 2017 in Los Angeles County Superior Court. His results and diagnosis were delayed — by days, he claimed — during which time he suffered irreversible brain damage from herpes encephalitis. The suit alleged the mishap delayed doctors from giving Ronisky a drug called acyclovir that might have minimized damage to his brain.
[protected-iframe id="cbd0851f7d91e8949a19695bd0b3c1a9-7618883-99279322" info="//players.brightcove.net/1875348214/default_default/index.html?videoId=6015020339001" width="100%" height="435" webkitallowfullscreen="" mozallowfullscreen="" allowfullscreen=""]
Epic denied any liability or defects in its software; the company said the doctor failed to push the right button to send the order and that the hospital, not Epic, had configured the interface with the lab. Epic, among the nation’s largest manufacturers of computerized health records and the leading provider to most of America’s most elite medical centers, quietly paid $1 million to settle the suit in July 2018, according to court records. The hospital and two doctors paid a total of $7.5 million, and a case against a third doctor is pending trial. Ronisky, 34, who is fighting to rebuild his life, declined to comment.
Incidents like that which happened to Ronisky — or to Annette Monachelli, for that matter — are surprisingly common, data show. And the back-and-forth about where the fault lies in such cases is actually part of the problem: The systems are often so confusing (and training on them seldom sufficient) that errors frequently fall into a nether zone of responsibility. It can be hard to tell where human error begins and the technological shortcomings end.
EHRs promised to put all of a patient’s records in one place, but often that’s the problem. Critical or time-sensitive information routinely gets buried in an endless scroll of data, where in the rush of medical decision-making — and amid the maze of pulldown menus — it can be missed.
Thirteen-year-old Brooke Dilliplaine, who was severely allergic to dairy, was given a probiotic containing milk. The two doses sent her into “complete respiratory distress” and resulted in a collapsed lung, according to a lawsuit filed by her mother. Rory Staunton, 12, scraped his arm in gym class and then died of sepsis after ER doctors discharged the boy on the basis of lab results in the EHR that weren’t complete. And then there’s the case of Thomas Eric Duncan. The 42-year-old man was sent home in 2014 from a Dallas hospital infected with Ebola virus. Though a nurse had entered in the EHR his recent travel to Liberia, where an Ebola epidemic was then in full swing, the doctor never saw it. Duncan died a week later.
[caption id="attachment_927864" align="aligncenter" width="1350"] Bobby and Tara Dilliplaine hold a photo of daughter Brooke, who suffered complications when she was given medication she was allergic to. (She later died of causes unrelated to the EHR issue.)[/caption]
Many such cases end up in court. Typically, doctors and nurses blame faulty technology in the medical-records systems. The EHR vendors blame human error. And meanwhile, the cases mount.
Quantros, a private health care analytics firm, said it has logged 18,000 EHR-related safety events from 2007 through 2018, 3 percent of which resulted in patient harm, including seven deaths — a figure that a Quantros director said is “drastically underreported.”
A 2016 study by The Leapfrog Group, a patient-safety watchdog based in Washington, D.C., found that the medication-ordering function of hospital EHRs — a feature required by the government for certification but often configured differently in each system — failed to flag potentially harmful drug orders in 39 percent of cases in a test simulation. In 13 percent of those cases, the mistake could have been fatal.
The Pew Charitable Trusts has, for the past few years, run an EHR safety project, taking aim at issues like usability and patient matching — the process of linking the correct medical record to the correct patient — a seemingly basic task at which the systems, even when made by the same EHR vendor, often fail. At some institutions, according to Pew, such matching was accurate only 50 percent of the time. Patients have discovered mistakes as well: A January survey by the Kaiser Family Foundation found that 1 in 5 patients spotted an error in their electronic medical records. (Kaiser Health News is an editorially independent program of the foundation.)
[caption id="attachment_928362" align="alignright" width="500"] (Nicolas Rapp/Fortune)[/caption]
The Joint Commission, which certifies hospitals, has sounded alarms about a number of issues, including false alarms — which account for between 85 and 99 percent of EHR and medical device alerts. (One study by researchers at Oregon Health & Science University estimated that the average clinician working in the intensive care unit may be exposed to up to 7,000 passive alerts per day.) Such over-warning can be dangerous. From 2014 to 2018, the commission tallied 170 mostly voluntary reports of patient harm related to alarm management and alert fatigue — the phenomenon in which health workers, so overloaded with unnecessary warnings, ignore the occasional meaningful one. Of those 170 incidents, 101 resulted in patient deaths.
The Pennsylvania Patient Safety Authority, an independent state agency that collects information about adverse events and incidents, counted 775 “laboratory-test problems” related to health IT from January 2016 to December 2017.
To be sure, medical errors happened en masse in the age of paper medicine, when hospital staffers misinterpreted a physician’s scrawl or read the wrong chart to deadly consequence, for instance. But what is perhaps telling is how many doctors today opt for manual workarounds to their EHRs. Aaron Zachary Hettinger, an emergency medicine physician with MedStar Health in Washington, D.C., said that when he and fellow clinicians need to share critical patient information, they write it on a whiteboard or on a paper towel and leave it on their colleagues’ computer keyboards.
While the Food and Drug Administration doesn’t mandate reporting of EHR safety events — as it does for regulated medical devices — concerned posts have nonetheless proliferated in the FDA MAUDE database of adverse events, which now serves as an ad hoc bulletin board of warnings about the various systems.
Further complicating the picture is that health providers nearly always tailor their one-size-fits-all EHR systems to their own specifications. Such customization makes every one unique and often hard to compare with others — which, in turn, makes the source of mistakes difficult to determine.
[caption id="attachment_927889" align="alignright" width="500"] (Nicolas Rapp/Fortune)[/caption]
Dr. Martin Makary, a surgical oncologist at Johns Hopkins and the co-author of a much-cited 2016 study that identified medical errors as the third-leading cause of death in America, credits EHRs for some safety improvements — including recent changes that have helped put electronic brakes on the opioid epidemic. But, he said, “we’ve swapped one set of problems for another. We used to struggle with handwriting and missing information. We now struggle with a lack of visual cues to know we’re writing and ordering on the correct patient.”
Dr. Joseph Schneider, a pediatrician at UT Southwestern Medical Center, compares the transition we’ve made, from paper records to electronic ones, to moving from horses to automobiles. But in this analogy, he added, “our cars have advanced to about the 1960s. They still don’t have seat belts or air bags.”
Schneider recalled one episode when his colleagues couldn’t understand why chunks of their notes would inexplicably disappear. They figured out the problem weeks later after intense study: Physicians had been inputting squiggly brackets — {} — the use of which, unbeknownst to even vendor representatives, deleted the text between them. (The EHR maker initially blamed the doctors, said Schneider.)
A broad coalition of actors, from National Nurses United to the Texas Medical Association to leaders within the FDA, has long called for oversight on electronic-record safety issues. Among the most outspoken is Ratwani, who directs MedStar Health’s National Center on Human Factors in Healthcare, a 30-person institute focused on optimizing the safety and usability of medical technology. Ratwani spent his early career in the defense industry, studying things like the intuitiveness of information displays. When he got to MedStar in 2012, he was stunned by “the types of [digital] interfaces being used” in health care, he said.
[caption id="attachment_927915" align="aligncenter" width="1350"] MedStar’s Raj Ratwani (standing) studies eye-tracking with Dr. Zach Hettinger to see how doctors interact with EHRs.[/caption]
In a study published last year in the journal Health Affairs, Ratwani and colleagues studied medication errors at three pediatric hospitals from 2012 to 2017. They discovered that 3,243 of them were owing in part to EHR “usability issues.” Roughly 1 in 5 of these could have resulted in patient harm, the researchers found. “Poor interface design and poor implementations can lead to errors and sometimes death, and that is just unbelievably bad as well as completely fixable,” he said. “We should not have patients harmed this way.”
Using eye-tracking technology, Ratwani has demonstrated on video just how easy it is to make mistakes when performing basic tasks on the nation’s two leading EHR systems. When emergency room doctors went to order Tylenol, for example, they saw a drop-down menu listing 86 options, many of which were irrelevant for the specified patient. They had to read the list carefully, so as not to click the wrong dosage or form — though many do that too: In roughly 1 out of 1,000 orders, physicians accidentally select the suppository (designated “PR”) rather than the tablet dose (“OR”), according to one estimate. That’s not an error that will harm a patient — though other medication mix-ups can and do.
Earlier this year, MedStar’s human-factors center launched a website and public awareness campaign with the American Medical Association to draw attention to such rampant mistakes — they use the letters “EHR” as an initialism for “Errors Happen Regularly” — and to petition Congress for action. Ratwani is pushing for a central database to track such errors and adverse events.
Others have turned to social media to vent. Dr. Mark Friedberg, a health-policy researcher with the Rand Corp. who is also a practicing primary care physician, champions the Twitter hashtag #EHRbuglist to encourage fellow health care workers to air their pain points. And last month, a scathing Epic parody account cropped up on Twitter, earning more than 8,000 followers in its first five days. Its maiden tweet, written in the mock voice of an Epic overlord, read: “I once saw a doctor make eye contact with a patient. This horror must stop.”
As much as EHR systems are blamed for sins of commission, it is often the sins of omission that trip up users even more.
Consider the case of Lynne Chauvin, who worked as a medical assistant at Ochsner Health System, in Louisiana. In a still-pending 2015 lawsuit, Chauvin alleges that Epic’s software failed to fire a critical medication warning; Chauvin suffered from conditions that heightened her risk for blood clots, and though that history was documented in her records, she was treated with drugs that restricted blood flow after a heart procedure at the hospital. She developed gangrene, which led to the amputation of her lower legs and forearm. (Ochsner Health System said that while it cannot comment on ongoing litigation, it “remains committed to patient safety which we strongly believe is optimized through the use of electronic health record technology.” Epic declined to comment.)
Echoing the complaints of many doctors, the suit argues that Epic software “is extremely complicated to view and understand,” owing to “significant repetition of data.” Chauvin said that her medical bills have topped $1 million and that she is permanently disabled. Her husband, Richard, has become her primary caregiver and had to retire early from his job with the city of Kenner to care for his wife, according to the suit. Each party declined to comment.
An Epidemic Of Burnout
The numbing repetition, the box-ticking and the endless searching on pulldown menus are all part of what Ratwani called the “cognitive burden” that’s wearing out today’s physicians and driving increasing numbers into early retirement.
In recent years, “physician burnout” has skyrocketed to the top of the agenda in medicine. A 2018 Merritt Hawkins survey found a staggering 78 percent of doctors suffered symptoms of burnout, and in January the Harvard School of Public Health and other institutions deemed it a “public health crisis.”
One of the co-authors of the Harvard study, Ashish Jha, pinned much of the blame on “the growth in poorly designed digital health records … that [have] required that physicians spend more and more time on tasks that don’t directly benefit patients.”
Few would deny that the swift digitization of America’s medical system has been transformative. With EHRs now nearly universal, the face and feel of medicine has changed. The doctor is now typing away, making more eye contact with the computer screen, perhaps, than with the patient. Patients don’t like that dynamic; for doctors, whose days increasingly begin and end with such fleeting encounters, the effect can be downright deadening.
“You’re sitting in front of a patient, and there are so many things you have to do, and you only have so much time to do it in — seven to 11 minutes, probably — so when do you really listen?” asked John-Henry Pfifferling, a medical anthropologist who counsels physicians suffering from burnout. “If you go into medicine because you care about interacting, and then you’re just a tool, it’s dehumanizing,” said Pfifferling, who has seen many physicians leave medicine over the shift to electronic records. “It’s a disaster,” he said.
[protected-iframe id="27fbdbb5fbb078b31261586cdd81762c-7618883-99279322" info="//players.brightcove.net/1875348214/default_default/index.html?videoId=6015697021001" width="100%" height="435" webkitallowfullscreen="" mozallowfullscreen="" allowfullscreen=""]
Beyond complicating the physician-patient relationship, EHRs have in some ways made practicing medicine harder, said Dr. Hal Baker, a physician and the chief information officer at WellSpan, a Pennsylvania hospital system. “Physicians have to cognitively switch between focusing on the record and focusing on the patient,” he said. He points out how unusual — and potentially dangerous — this is: “Texting while you’re driving is not a good idea. And I have yet to see the CEO who, while running a board meeting, takes minutes, and certainly I’ve never heard of a judge who, during the trial, would also be the court stenographer. But in medicine … we’ve asked the physician to move from writing in pen to [entering a computer] record, and it’s a pretty complicated interface.”
Even if docs may be at the keyboard during visits, they report having to spend hours more outside that time — at lunch, late at night — in order to finish notes and keep up with electronic paperwork (sending referrals, corresponding with patients, resolving coding issues). That’s right. EHRs didn’t take away paperwork; the systems just moved it online. And there’s a lot of it: 44 percent of the roughly six hours a physician spends on the EHR each day is focused on clerical and administrative tasks, like billing and coding, according to a 2017 Annals of Family Medicine study.
For all that so-called pajama time — the average physician logs 1.4 hours per day on the EHR after work — they don’t get a cent.
Many doctors do recognize the value in the technology: 60 percent of participants in Stanford Medicine’s 2018 National Physician Poll said EHRs had led to improved patient care. At the same time, about as many (59 percent) said EHRs needed a “complete overhaul” and that the systems had detracted from their professional satisfaction (54 percent) as well as from their clinical effectiveness (49 percent).
In preliminary studies, Ratwani has found that doctors have a typical physiological reaction to using an EHR: stress. When he and his team shadow clinicians on the job, they use a range of sensors to monitor the doctors’ heart rate and other vital signs over the course of their shift. The physicians’ heart rates will spike — as high as 160 beats per minute — on two sorts of occasions: when they are interacting with patients and when they’re using the EHR.
“Everything is so cumbersome,” said Dr. Karla Dick, a family medicine physician in Arlington, Texas. “It’s slow compared to a paper chart. You’re having to click and zoom in and zoom out to look for stuff.” With all the zooming in and out, she explained, it’s easy to end up in the wrong record. “I can’t tell you how many times I’ve had to cancel an order because I was in the wrong chart.”
Among the daily frustrations for one emergency room physician in Rhode Island is ordering ibuprofen, a seemingly simple task that now requires many rounds of mouse clicking. Every time she prescribes the basic painkiller for a female patient, whether that patient is 9 or 68 years old, the prescription is blocked by a pop-up alert warning her that it may be dangerous to give the drug to a pregnant woman. The physician, whose institution does not allow her to comment on the systems, must then override the warning with yet more clicks. “That’s just the tiniest tip of the iceberg,” she said.
What worries the doctor most is the ease with which diligent, well-meaning physicians can make serious medical errors. She noted that the average ER doc will make 4,000 mouse clicks over the course of a shift, and that the odds of doing anything 4,000 times without an error is small. “The interfaces are just so confusing and clunky,” she added. “They invite error … it’s not a negligence issue. This is a poor tool issue.”
Many of the EHR makers acknowledge physician burnout is real and say they’re doing what they can to lessen the burden and enhance user experience. Dr. Sam Butler, a pulmonary critical care specialist who started working at Epic in 2001, leads those efforts at the Wisconsin-based company. When doctors get more than 100 messages per week in their in-basket (akin to an email inbox), there’s a higher likelihood of burnout. Butler’s team has also analyzed doctors’ electronic notes — they’re twice as long as they were nine years ago, and three to four times as long as notes in the rest of the world. He said Epic uses such insights to improve the client experience. But coming up with fixes is difficult because doctors “have different viewpoints on everything,” he said. (KHN and Fortune made multiple requests to interview Epic CEO Judy Faulkner, but the company declined to make her available. In a trade interview in February, however, Faulkner said that EHRs were unfairly blamed for physician burnout and cited a study suggesting that there’s little correlation between burnout and EHR satisfaction. Executives at other vendors noted that they’re aware of usability issues and that they’re working on addressing them.)
“It’s not that we’re a bunch of Luddites who don’t know how to use technology,” said the Rhode Island ER doctor. “I have an iPhone and a computer and they work the way they’re supposed to work, and then we’re given these incredibly cumbersome and error-prone tools. This is something the government mandated. There really wasn’t the time to let the cream rise to the top; everyone had to jump in and pick something that worked and spend tens of millions of dollars on a system that is slowly killing us.”
$36 Billion And Change
The effort to digitize America’s health records got its biggest push in a very low moment: the financial crisis of 2008. In early December of that year, Obama, barely four weeks after his election, pitched an ambitious economic recovery plan. “We will make sure that every doctor’s office and hospital in this country is using cutting-edge technology and electronic medical records so that we can cut red tape, prevent medical mistakes and help save billions of dollars each year,” he said in a radio address.
The idea had already been a fashionable one in Washington. Former House Speaker Newt Gingrich was fond of saying it was easier to track a FedEx package than one’s medical records. Obama’s predecessor, President George W. Bush, had also pursued the idea of wiring up the country’s health system. He didn’t commit much money, but Bush did create an agency to do the job: the Office of the National Coordinator (ONC).
In the depths of recession, the EHR conceit looked like a shovel-ready project that only the paper lobby could hate. In February 2009, legislators passed the HITECH Act, which carved out a hefty chunk of the massive stimulus package for health information technology. The goal was not just to get hospitals and doctors to buy EHRs, but rather to get them using them in a way that would drive better care. So lawmakers devised a carrot-and-stick approach: Physicians would qualify for federal subsidies (a sum of up to nearly $64,000 over a period of years) only if they were “meaningful users” of a government-certified system. Vendors, for their part, had to develop systems that met the government’s requirements.
[caption id="attachment_927866" align="aligncenter" width="1350"] Vice President Joe Biden watches President Barack Obama sign the American Recovery and Reinvestment Act in February 2009, which included a stimulus for electronic health records.[/caption]
They didn’t have much time, though. The need to stimulate the economy, which meant getting providers to adopt EHRs quickly, “presented a tremendous conundrum,” said Farzad Mostashari, who joined the ONC as deputy director in 2009 and became its leader in 2011: The ideal — creating a useful, interoperable, nationwide records system — was “utterly infeasible to get to in a short time frame.”
That didn’t stop the federal planners from pursuing their grand ambitions. Everyone had big ideas for the EHRs. The FDA wanted the systems to track unique device identifiers for medical implants, the Centers for Disease Control and Prevention wanted them to support disease surveillance, CMS wanted them to include quality metrics and so on. “We had all the right ideas that were discussed and hashed out by the committee,” said Mostashari, “but they were all of the right ideas.”
Not everyone agreed, though, that they were the right ideas. Before long, “meaningful use” became pejorative shorthand to many for a burdensome government program — making doctors do things like check a box indicating a patient’s smoking status each and every visit.
The EHR vendor community, then a scrappy $2 billion industry, griped at the litany of requirements but stood to gain so much from the government’s $36 billion injection that it jumped in line. As Rusty Frantz, CEO of EHR vendor NextGen Healthcare, put it: “The industry was like, ‘I’ve got this check dangling in front of me, and I have to check these boxes to get there, and so I’m going to do that.’”
Halamka, who was an enthusiastic backer of the initiative in both the Bush and Obama administrations, blames the pressure for a speedy launch as much as the excessive wish list. “To go from a regulation to a highly usable product that is in the hands of doctors in 18 months, that’s too fast,” he said. “It’s like asking nine women to have a baby in a month.”
Several of those who worked on the project admit the rollout was not as easy or seamless as they’d anticipated, but they contend that was never the point. Aneesh Chopra, appointed by Obama in 2009 as the nation’s first chief technology officer, called the spending a “down payment” on a vision to fundamentally change American medicine — creating a digital infrastructure to support new ways to pay for health services based on their quality and outcomes.
Dr. Bob Kocher, a physician and star investor with venture capital firm Venrock, who served in the Obama administration from 2009 to 2011 as a health and economic policy adviser, not only defends the rollout then but also disputes the notion that the government initiative has been a failure at all. “EHRs have totally lived up to the hype and expectations,” he said, emphasizing that they also serve as a technology foundation to support innovation on everything from patients accessing their medical records on a smartphone to AI-driven medical sleuthing. Others note the systems’ value in aggregating medical data in ways that were never possible with paper — helping, for example, to figure out that contaminated water was poisoning children in Flint, Mich.
But Rusty Frantz heard a far different message about EHRs — and, more important, it was coming from his own customers.
The Stanford-trained engineer, who in 2015 became CEO of NextGen, a $500-million-a-year EHR heavyweight in the physician-office market, learned the hard way about how his product was being viewed. As he stood at the podium at his first meeting with thousands of NextGen customers at Las Vegas’ Mandalay Bay Resort, just four months after getting the job, he told KHN and Fortune, “People were lining up at the microphones to yell at us: ‘We weren’t delivering stable software! The executive team was inaccessible! The service experience was terrible!’ ” (He now refers to the event as “Festivus: the airing of the grievances.”)
Frantz had bounced around the health care industry for much of his career, and from the nearby perch of a medical device company, he watched the EHR incentive bonanza with a mix of envy and slack-jawed awe. “The industry was moving along in a natural Darwinist way, and then along came the stimulus,” said Frantz, who blames the government’s ham-handed approach to regulation. “The software got slammed in, and the software wasn’t implemented in a way that supported care,” he said. “It was installed in a way that supported stimulus. This company, we were complicit in it, too.”
Even that may be a generous description. KHN and Fortune found a trail of lawsuits against the company, stretching from White Sulphur Springs, Mont., to Neillsville, Wis. Mary Rutan Hospital in Bellefontaine, Ohio, sued NextGen (formerly called Quality Systems) in federal court in 2013, arguing that it experienced hundreds of problems with the “materially defective” software the company had installed in 2011.
A consultant hired by the hospital to evaluate the NextGen system, whose 60-page report was submitted to the court, identified “many functional defects” that he said rendered the software “unfit for its intended purpose.” Some patient information was not accurately recorded, which had the potential, the consultant wrote, “to create major patient care risk which could lead to, at a minimum, inconvenience, and at worst, malpractice or even death.” Glitches at Mary Rutan included incidents in which the software would apparently change a patient’s gender at random or lose a doctor’s observations after an exam, the consultant reported. The company, he found, sometimes took months to address issues: One IT ticket, which related to a physician’s notes inexplicably deleting themselves, reportedly took 10 months to resolve. (The consultant also noted that similar problems appeared to be occurring at as many as a dozen other hospitals that had installed NextGen software.)
The Ohio hospital, which paid more than $1.5 million for its EHR system, claimed breach of contract. NextGen responded that it disputed the claims made in the lawsuit and that the matter was resolved in 2015 “with no findings of fact by a court related to the allegations.” The hospital declined to comment.
At the time, as it has been since then, NextGen’s software was certified by the government as meeting the requirements of the stimulus program. By 2016, NextGen had more than 19,000 customers who had received federal subsidies.
[caption id="attachment_927872" align="alignright" width="500"] (Nicolas Rapp/Fortune)[/caption]
NextGen was subpoenaed by the Department of Justice in December 2017, months after becoming the subject of a federal investigation led by the District of Vermont. Frantz tells KHN and Fortune that NextGen is cooperating with the investigation. “This company was not dishonest, but it was not effective four years ago,” he said. Frantz also emphasized that NextGen has “rapidly evolved” during his tenure, earning five industry awards since 2017, and that customers have “responded very positively.”
Glen Tullman, who until 2012 led Allscripts, another leading EHR vendor that benefited royally from the stimulus and that has been sued by numerous unhappy customers, admitted that the industry’s race to market took priority over all else.
“It was a big distraction. That was an unintended consequence of that,” Tullman said. “All the companies were saying, This is a one-time opportunity to expand our share, focus everything there, and then we’ll go back and fix it.” The Justice Department has opened a civil investigation into the company, Securities and Exchange Commission filings show. Allscripts said in an email that it cannot comment on an ongoing investigation, but that the civil investigations by the Department of Justice relate to businesses it acquired after the investigations were opened.
Much of the marketing mayhem occurred because federal officials imposed few controls over firms scrambling to cash in on the stimulus. It was a gold rush — and any system, it seemed, could be marketed as “federally approved.” Doctors could shop for bargain-price software packages at Costco and Walmart’s Sam’s Club — where eClinicalWorks sold a “turnkey” system for $11,925 — and cash in on the government’s adoption incentives.
The top-shelf vendors in 2009 crisscrossed the country on a “stimulus tour” like rock groups, gigging at some 30 cities, where they offered doctors who showed up to hear the pitch “a customized analysis” of how much money they could earn off the government incentives. Following the same playbook used by pharmaceutical companies, EHR sellers courted doctors at fancy dinners in ritzy hotels. One enterprising software firm advertised a “cash for clunkers” deal that paid $3,000 to doctors willing to trade in their current records system for a new one. Athenahealth held “invitation only” dinners at luxury hotels to advise doctors, among other things, how to use the stimulus to get paid more and capture available incentives. Allscripts offered a no-money-down purchase plan to help doctors “maximize the return on your EHR investment.” (An Athenahealth spokesperson said the company’s “dinners were educational in nature and aimed at helping physicians navigate the government program.” Allscripts did not respond directly to questions about its marketing practices, but said it “is proud of the software and services [it provides] to hundreds of thousands of caregivers across the globe.”)
EHRs were supposed to reduce health care costs, at least in part by preventing duplicative tests. But as the federal government opened the stimulus tap, many raised doubts about the promised savings. Advocates bandied about a figure of $80 billion in cost savings even as congressional auditors were debunking it. While the jury’s still out, there’s growing suspicion the digital revolution may potentially raise health care costs by encouraging overbilling and new strains of fraud and abuse.
In September 2012, following press reports suggesting that some doctors and hospitals were using the new technology to improperly boost their fees, a practice known as “upcoding,” then-Health and Human Services chief Kathleen Sebelius and Attorney General Eric Holder warned the industry not to try to “game the system.”
There’s also growing evidence that some doctors and health systems may have overstated their use of the new technology to secure stimulus funds, a potentially enormous fraud against Medicare and Medicaid that likely will take many years to unravel. In June 2017, the HHS inspector general estimated that Medicare officials made more than $729 million in subsidy payments to hospitals and doctors that didn’t deserve them.
Individual states, which administer the Medicaid portion of the program, haven’t fared much better. Audits have uncovered overpayments in 14 of 17 state programs reviewed, totaling more than $66 million, according to inspector general reports.
Last month, Sen. Chuck Grassley, an Iowa Republican who chairs the Senate Finance Committee, sharply criticized CMS for recovering only a tiny fraction of these bogus payments, or what he termed a “spit in the ocean.”
EHR vendors have also been accused of egregious and patient-endangering acts of fraud as they raced to cash in on the stimulus money grab. In addition to the U.S. government’s $155 million False Claims Act settlement with eClinicalWorks noted above, the federal government has reached a second settlement over similar charges against another large vendor, Tampa-based Greenway Health. In February, that company settled with the government for just over $57 million without denying or admitting wrongdoing. “These are cases of corporate greed, companies that prioritized profits over everything else,” said Christina Nolan, the U.S. attorney for the District of Vermont, whose office led the cases. (In a response, Greenway Health did not address the charges or the settlement but said it was “committing itself to being the standard-bearer for quality, compliance, and transparency.”)
Tower Of Babel
In early 2017, Seema Verma, then the country’s newly appointed CMS administrator, went on a listening tour. She visited doctors around the country, at big urban practices and tiny rural clinics, and from those front-line physicians she consistently heard one thing: They hated their electronic health records. “Physician burnout is real,” she told KHN and Fortune. The doctors spoke of the difficulty in getting information from other systems and providers, and they complained about the government’s reporting requirements, which they perceived as burdensome and not meaningful.
What she heard then became suddenly personal one summer day in 2017, when her husband, himself a physician, collapsed in the airport on his way home to Indianapolis after a family vacation. For a frantic few hours, the CMS administrator fielded phone calls from first responders and physicians — Did she know his medical history? Did she have information that could save his life? — and made calls to his doctors in Indiana, scrambling to piece together his record, which should have been there in one piece. Her husband survived the episode, but it laid bare the dysfunction and danger inherent in the existing health information ecosystem.
[caption id="attachment_927916" align="aligncenter" width="1350"] Seema Verma, the administrator of the Centers for Medicare & Medicaid Services, is taking on health “information blockers,” gag clauses and more.[/caption]
The notion that one EHR should talk to another was a key part of the original vision for the HITECH Act, with the government calling for systems to be eventually interoperable.
What the framers of that vision didn’t count on were the business incentives working against it. A free exchange of information means that patients can be treated anywhere. And though they may not admit it, many health providers are loath to lose their patients to a competing doctor’s office or hospital. There’s a term for that lost revenue: “leakage.” And keeping a tight hold on patients’ medical records is one way to prevent it.
There’s a ton of proprietary value in that data, said Blumenthal, who now heads the Commonwealth Fund, a philanthropy that does health research. Asking hospitals to give it up is “like asking Amazon to share their data with Walmart,” he said.
Blumenthal acknowledged that he failed to grasp these perverse business dynamics and foresee what a challenge getting the systems to talk to one another would be. He added that forcing interoperability goals early on, when 90 percent of the nation’s providers still didn’t have systems or data to exchange, seemed unrealistic. “We had an expression: They had to operate before they could interoperate,” he said.
[protected-iframe id="1727500ba2f388d0223e5b560097ff12-7618883-99279322" info="//players.brightcove.net/1875348214/default_default/index.html?videoId=6015703839001" width="100%" height="435" webkitallowfullscreen="" mozallowfullscreen="" allowfullscreen=""]
In the absence of true incentives for systems to communicate, the industry limped along; some providers wired up directly to other select providers or through regional exchanges, but the efforts were spotty. A Cerner-backed interoperability network called CommonWell formed in 2013, but some companies, including dominant Epic, didn’t join. (“Initially, Epic was neither invited nor allowed to join,” said Sumit Rana, senior vice president of R&D at Epic. Jitin Asnaani, executive director of CommonWell countered, “We made repeated invitations to every major EHR … and numerous public and private invitations to Epic.”)
Epic then supported a separate effort to do much the same.
Last spring, Verma attempted to kick-start the sharing effort and later pledged a war on “information blocking,” threatening penalties for bad actors. She has promised to reduce the documentation burden on physicians and end the gag clauses that protect the EHR industry. Regarding the first effort at least, “there was consensus that this needed to happen and that it would take the government to push this forward,” she said. In one sign of progress last summer, the dueling sharing initiatives of Epic and Cerner, the two largest players in the industry, began to share with each other — though the effort is fledgling.
When it comes to patients, though, the real sharing too often stops. Despite federal requirements that providers give patients their medical records in a timely fashion, in their chosen format and at low cost (the government recommends a flat fee of $6.50 or less), patients struggle mightily to get them. A 2017 study by researchers at Yale found that of America’s 83 top-rated hospitals, only 53 percent offer forms that provide patients with the option to receive their entire medical record. Fewer than half would share records via email. One hospital charged more than $500 to release them.
Sometimes the mere effort to access records leads to court. Jennifer De Angelis, a Tulsa attorney, has frequently sparred with hospitals over releasing her clients’ records. She said they either attempt to charge huge sums for them or force her to obtain a court order before releasing them. De Angelis added that she sometimes suspects the records have been overwritten to cover up medical mistakes.
Consider the case of 5-year-old Uriah R. Roach, who fractured and cut his finger on Oct. 2, 2014, when it was accidentally slammed in a door at school. Five days later, an operation to repair the damage went awry, and he suffered permanent brain damage, apparently owing to an anesthesia problem. The Epic electronic medical file had been accessed more than 76,000 times during the 22 days the boy was in the hospital, and a lawsuit brought by his parents contended that numerous entries had been “corrected, altered, modified and possibly deleted after an unexpected outcome during the induction of anesthesia.” The hospital denied wrongdoing. The case settled in November 2016, and the terms are confidential.
More than a dozen other attorneys interviewed cited similar problems, especially with gaining access to computerized “audit trails.” In several cases, court records show, government lawyers resisted turning over electronic files from federally run hospitals. That happened to Russell Uselton, an Oklahoma lawyer who represented a pregnant teen admitted to the Choctaw Nation Health Care Center in Talihina, Okla. Shelby Carshall, 18, was more than 40 weeks pregnant at the time. Doctors failed to perform a cesarean section, and her baby was born brain-damaged as a result, she alleged in a lawsuit filed in 2017 against the U.S. government. The baby began having seizures at 10 hours old and will “likely never walk, talk, eat, or otherwise live normally,” according to pleadings in the suit. Though the federal government requires hospitals to produce electronic health records to patients and their families, Uselton had to obtain a court order to get the baby’s complete medical files. Government lawyers denied any negligence in the case, which is pending.
“They try to hide anything from you that they can hide from you,” said Uselton. “They make it extremely difficult to get records, so expensive and hard that most lawyers can’t take it on,” he said.
Nor, it seems, can high-ranking federal officials. When Seema Verma’s husband was discharged from the hospital after his summer health scare, he was handed a few papers and a CD-ROM containing some medical images — but missing key tests and monitoring data. Said Verma, “We left that hospital and we still don’t have his information today.” That was nearly two years ago.
Here is the link:
https://khn.org/news/death-by-a-thousand-clicks/view/republish/
David.
This provides an extraordinary insight into the history, status quo and troubled development of the EHR in the US. It makes for compelling reading.
ReplyDeletehttps://khn.org/news/death-by-a-thousand-clicks/view/republish/
This article serves to brightly illuminate the ADHA's claims and aspirations for the My Health Record.
It is clear what went wrong in the US over the last decade; so too in Australia.
The use of IT in health absolutely requires high quality implementations to be safe, as loss or distortion of information has potentially very serious consequences for patients and owing largely to the complete lack of any thread of respect for this by any national eHealth body over the last 20 years we have a situation where electronic health in Australia, and clearly the US, represents a real danger to patient safety.
ReplyDeleteThe problem, which I am still somewhat incredulous about, is that the ADHA, and NEHTA before them do not have enough technical understanding to even realize this. In the end technical errors (non compliance with standards) in messages, and the presentation of the data in those messages represents a huge danger to patient safety. The "Ban the Fax" movement, without ensuring the electronic alternative is safe and reliable, is naive and dangerous.
I have spent significant time trying to push a compliance agenda with various national bodies, including several versions of NEHTA and ADHA and have a huge number of examples of potentially serious non-compliance issues, but none of the people in control appear to understand the issues, or choose to ignore them. The ADHA have reached the point that they are a public nuisance and every $ they are given can only make health safety worse.
While we insist that drugs and devices are tested (and that is hardly flawless), we allow untested, hacked together software to handle, and often mishandle critical medical data in a completely unregulated way while the ADHA keeps singing "Ban the fax" and I am sure spends more on PR than any compliance activity.
From CCA to CCD - https://myhealthrecorddeveloper.digitalhealth.gov.au/resources/test-and-go-live/introduction-to-test-and-go-live
ReplyDeleteSelf-Assessment
The Agency no longer observes software to check for conformance requirements. Instead, you must declare conformance by submitting a My Health Record system Conformance Vendor Declaration Form and Instructions which are included in the welcome pack.
The My Health Record System Operator will monitor documents uploaded to the My Health Record system and may contact you as part of its program to monitor conformance.
Please note:
When the Agency issues a new version of specifications, developers who have implemented an earlier version will need to upgrade to the new version within a specified timeframe, typically two years from the release of the new version.
When you implement the new version of specifications, you will need to complete the My Health Record system Conformance Vendor Declaration Form and Instructions confirming the software meets all the conformance requirements, and submit it to the My Health Record System Operator.
Andrew, I hope you have (or will make) made a submission to the ANAO.
ReplyDeleteAs a medical practitioner and someone who has been intimately involved in this whole sorry mess, albeit largely ignored, your views should carry great weight.
You would be doing everyone a great favour if you did make a submission.
Hi Andrew, hoping you might assist. Does the Conformance, Compliance and Accreditation (CCA) Governance Group still operate to your knowledge? I have searched but do not seem to be able to find it under ADHA, even the developer website is silent of testing and conformance.
ReplyDeleteI was hoping that this group existing and enables through the CCA framework the following
Deliver appropriate clinical safety outcomes
Mitigate clinical safety risk
Improve efficiencies
Rationalise costs
Deliver value to stakeholders
Anyone else know? I believe FHIR takes or is trying to take a more autonomous approach but it has been a while since I looked.
The only conformance activity I have seen is around MyHR and HI service. There is nothing around all the messaging that forms the backbone of the real eHealth system that operates today, with millions of HL7v2 messages being exchanged daily.
ReplyDeleteI will remain Anon in protest and will remain so while the CEO, COO and the CMO exist I their roles at ADHA. THe damage they are doing and have done is criminal IMHO. THe sooner they are gone and others are allowed back the better.
ReplyDeleteAnyway in answer to the question regarding CCA:
A few years ago, I believe commissioned by NEHTA and to be implemented by ADHA a review of the CCA model was undertaken. Driven in part by vendors complaining that conformance was to difficult and onerous. The chosen model going forward was to be ‘Industry Enabled Conformance’
This model (as you can imagine) aligned most favourably with feedback received during the various stakeholder interviews and with the then CCA Governance Group and was positioned (if implemented as prescribed and in totality) as the next logical progression for the CCA scheme.
1. Under this model, the National Entity (NEHTA-to-ADHA) would remain as the body responsible for developing conformance specifications and implementation guides.
2. Conformance testing to be carried out by vendors, who would be required to attest that appropriate testing activities have been successfully undertaken and that software conforms to the relevant conformance specifications dictated by the National Entity (ADHA).
3. Conformance specifications that present a high security, privacy and/or clinical safety risk wold be evaluated and may be required to submit to testing and verification by an accredited third-party laboratory.
4. Vendors/jurisdictions were also to be subject to being required to periodically attest (e.g. annually) that appropriate development lifecycle practices are implemented and are periodically reviewed, and that conformance previously achieved has not been negatively impacted by further software enhancements.
A formal specification conformance breach/incident management programme was to be established in order to uncover and record non-conformant or non-compliant products or systems that a vendor had attested were conformant/compliant.
• In these cases, an independent review or audit of development practices and previous attestations may be instigated by ADHA (depending on the criticality of the conformance breach identified).
• Where deemed appropriate by the CCA Governance Group, a range of enforcement measures may be required.
• Enforcement measures recommended by the CCA Governance Group were to include limiting access to specific centralised eHealth repositories or services (i.e. HI and MHR)
• CCA testing was to be carried out (including testing observation and verification) and provided by an independent NATA accredited lab, and where appropriate, communication to the market (Transparency and Trust).
This model to work was based on a set of agreed assumptions that through ADHA tight integration with the overall eHealth Systems Development Lifecycle and in particular the need for CCA to be an integral component of the specification, standards and conformance guide development process and not be seen as simply a point-in-time and isolated conformance control.
Rather the future state CCA model must (to be successful) play an active role in improving the quality and safety outcomes of Digital Health systems. This will require the CCA model to tightly integrate with the early development activities to help identify potential issues and omissions in specifications and standards that may lead to ineffective CCA testing.
So recent events have demonstrated that the ADHA is not even subjecting itself to CCA or any real form of testing.
Thanks Anon, I can see why it was swept under the carpet, can't see Timmy and Co wanting any effort to get in the way of a good story. We can let the sector continue unabated, but as Andrew points out, clinical software should be subject to the same level of excellence as is required by other aspects of healthcare. Even medical devices broke away from ISO9001 because that standard did not address quality to a high enough bar.
ReplyDeletePerhaps a new industry group could be formed - Making Software Independent of Assurance
@2:02PM. I do not believe 1,3 and 4 exist, as for 2 I am sure you can fax your results somewhere but want than means who knows? I get a sense Tim is happy to licence anyone to operate if they can say superkelseyopendataforsale.
ReplyDeleteNice overview of what was suppose to happen and could of happened if we had selected someone upto the task.
> clinical software should be subject to the same level of excellence as is required by other aspects of healthcare
ReplyDeleteAs far as I can tell, the quality clinical software *is* a direct reflection of the quality of clinical data and process. And the interoperability of clinical software is also a direct reflection of the quality of clinical transfer processes.
Andrew McIntyre: if you're right about the dismal quality of messaging (and I think you are) why don't we just solve it? why just carp on about the government as if we can can't fix anything without hand-holding? If we can't, maybe it's ust not a problem the clinical profession really cares about?
I wonder if you can do it without government handholding. The government is a provider of clinical software (MyHR) and supports an increasing number of app developers to interface with their system. You have to include them and they will be a difficult beast to coax in any direction other than their own. MHR has cost us the independence Government once had, legislation, standards investments, funding etc.. are all going to suffer a natural bias towards achieving the departments systems goals whatever they are.
ReplyDeleteSo sure you might come up with a fix but who will enforce it? Who will create a level playing field to enable resilient business models to formulate?
Hard to run a three legged race when you have one broken leg and another suffering sever cramp
> Andrew McIntyre: if you're right about the dismal quality of messaging (and I think you are) why don't we just solve it?
ReplyDeleteIts all about the quality of the messages, and we try and influence that as much as we can. In the past the standard was "It works in Medical Director so its correct" and at least that has gone. We do make new players pass basic tests like escaping reserved characters, but there is a distinct lack of care factor because everyone is keen to get to market, or has the market and thinks they are correct.
The solution is a requirement for proper testing that is non-negotiable. I have no doubt that vendors would resist that as in many cases the errors point to low level problems in their handling of data and display rules and fixing that would require some significant re-engineering of the code base. This clearly needs to be done, but is not a shiny new feature they can sell. If there is a problem with display the users usually shoot the messenger/sender and not their vendor anyway, so they are not held responsible.
We need governance, as a player in the market and can provide encouragement and tools to make that possible, but can't make that mandatory. How would you suggest I fix it myself?
> How would you suggest I fix it myself?
ReplyDeleteNote that I said 'how would we fix it' not 'how would you fix it'. I wish MSIA would take it up as a minimum requirement - I wrote the profile & the rules for MSIA based on the discussion we had as a group a few years ago.
But the real leverage is actually in the hands of the people who spend the money, who purchase. Why is conformant messaging not a minimum professional standard for accreditation? (but that brings me back to my other point: the state of clinical software is something that purchasers of clinical software chose because they bought it)
I guess the bottom line is that the benefits are too diffuse and abstract for any particular party to buy into doing anything about it. It's one reason I/we invested so deeply in the FHIR validation stack - to reduce the cost and increase the benefits of validation testing. In the next few years we'll find out whether it's going to make any difference or now
The problem with the users/buyers of the software applying pressure is that they have to understand the issues and they do not.
ReplyDeleteThe ADHA and their medical advisers don't understand the issues either. We have a failure of generic management to actually understand what they are managing, and that's a pretty good way to burn through $2 Billion without achieving anything positive, and in fact push things in a negative direction.
One of the issues with MSIA is that many of the heads of companies are non technical so even making the point at a MSIA meeting would be difficult. I would certainly include compliance as a core part of FHIR but complexity and costs of compliance can only be moved around and not eliminated and without good governance bad FHIR could escape and become a "raging fire".
Somehow planes(only up to a point given 737 issues), cars, electrical appliances, drugs etc have not escaped governance, but clinical software can be released without a single test of safety? Its the era of generic clueless management in the public service that has allowed with to happen. People are killed one at a time rather than a plane load at a time, so its not as newsworthy, and its much harder to connect cause and effect, but I am sure many deaths could have been prevented with better software. The ADHA/NEHTA are responsible for these preventable deaths.
So many important and difficult issues have been raised in this thread by Andrew and Grahame which cannot be resolved in this forum and, for many reasons they can't be resolved by government, the ADHA or even the MSIA; certainly not easily.
ReplyDeleteA new way of thinking is required, but despite saying this now for over a decade those who should be in a position to explore and tread that path have avoided doing so. I think the reason is because they don't understand the problem and they are conflicted and threatened by entertaining the possibility of introducing 'new' thinking.
To choose one of the many excellent points raised in this thread I turn to Andrew's comment; "maybe it's just not a problem the clinical profession really cares about?"
I think some parts of the clinical profession do really care about the problem but from that perspective the profession perceives (for many reasons) there is not much that the profession can do about it the responsibility) thus it is left to others to fix.
I'm in agreement with both Grahame and Andrew, especially when it comes to money.
ReplyDeleteADHA and myhr have nothing to do with getting better health outcomes. The government spends its money and hopes to get something back, but fails.
The original business case, which still has not seen the light of day, had claims of financial benefit just as did the business case for opt-out. Unsubstantiated, but included and not criticised by the hard nosed but otherwise ignorant (of healthcare) economists in Treasury and Finance.
GPs do not see any financial benefit to outweigh the costs and risks.
Patients are being asked to do something that might have some sort of abstract benefit mostly to others.
The States are generally ignoring the myhr and are doing their own thing, they cerainly are not spending significant sums on the myhr.
One good thing about the opt-out process is that it has raised the profile of health records. What it hasn't done is convinced lots of people that it is a good idea.
In the polls I've seen, GPs still seem to be 70% against it.
This weekend's Pulse+IT newsletter has this amazing quote:
"Our poll last week asked: do you have confidence in ADHA's management of MyHR? Nope. 22 per cent said they did but 78 per cent were firmly in the negative."
Tim is pushing a piece of wet string up a big hill. He might be fooling his political masters, or they might be fooling him, but the money pit that is myhr cannot keep getting deeper.
"the money pit that is myhr cannot keep getting deeper"
ReplyDeleteOh yes it can. Both the Liberal and Labor parties are so exposed (responsible for) pushing the My Health Record that neither dare discontinue it, which leaves them with only one alternate option - keep throwing more money at it.
Catherine King, likely to be the next Health Minister, has made it clear she strongly supports the concept of the My Health Record and like all politicians she only has a superficial understanding of what it is about and no understanding of the complexities of the problem(s) to be solved.
It was first introduced on Rudd's watch and has been hand-balled down the line ever since by the government of the day. It is likely to receive another significant funding boost in the forthcoming election.
It is just too hard and too embarrassing for the Health Minister or the government to say no, cancel the project, for fear of a major political backlash. In effect both parties have wedged each other. In chess we call it stalemate.
Andrew said:
ReplyDeleteSomehow planes (only up to a point given 737 issues)...
This is from slashdot
https://news.slashdot.org/story/19/03/22/0534204/crashed-boeing-planes-lacked-safety-features-that-company-sold-only-as-extras
"The recent Boeing 737 MAX crashes involving an Ethiopian Airlines flight and a Lion Air flight may have been a result of two missing safety features that Boeing charged airlines extra for.
The New York Times reports that many low-cost carriers like Indonesia's Lion Air opted not to buy them so they could save money, even though some of these systems are fundamental to the plane's operations. "Now, in the wake of the two deadly crashes involving the same jet model, Boeing will make one of those safety features standard as part of a fix to get the planes in the air again," the report says. From the report:
It is not yet known what caused the crashes of Ethiopian Airlines Flight 302 on March 10 and Lion Air Flight 610 five months earlier, both after erratic takeoffs.
But investigators are looking at whether a new software system added to avoid stalls in Boeing's 737 Max series may have been partly to blame. Faulty data from sensors on the Lion Air plane may have caused the system, known as MCAS, to malfunction, authorities investigating that crash suspect."
There are reports that pilots were aware of the problem and had said so to NASA, who independently collects such things. Engineers were aware of the problem and had worked on fixes. Their concerns were ignored.
What was the highest priority? Money.
BTW across all the millions of flights by American airliners, there was exactly one passenger death from 2010 to 2019.
The FAA Rigorously Tested the Boeing 737’s Software
https://www.theatlantic.com/technology/archive/2019/03/boeing-737-max-8-safe-how-faa-tested-its-software/584848/
Provided money doesn't get in the way, the system works and it works a lot better than does the non-system that medical software is subjected to.
"Provided money doesn't get in the way, the system works and it works a lot better than does the non-system that medical software is subjected to."
ReplyDeleteThis is the key point, there is absolutely no governance of any medical software in this country. Lets just take that in, virtually every pathology and radiology test in Australia is delivered electronically and there are no requirements for senders and receivers to do any testing of their software whatsoever. If Boeing said, Umm, actually we never tested the software there would be an uproar, but you have no assurance that any medical communication on millions of patients, so of whom have life threatening problems, are actually being displayed correctly or even seen by the person they need to be seen by. This is after 2 decades of "National eHealth Authority" musings, having spent $2 Billion of tax payers dollars. I mean that's just an reasonable oversight right?
Did we recall Atul Gawande's Why Doctor's Hate Their Computers when reading about Boeing's troubles? Today's Boeing Was ‘Go, Go, Go’ to Beat Airbus With the 737 Max will sharpen the point.
ReplyDeleteIt may turn out that the new anti-stall software in the 737 Max tried to override a pilot's primal instinct that operates instantly that something "goes wrong" - fly the plane manually until control is regained. That first move on the yoke is accompanied by the instinctive disengagement of auto-pilot. If that procedure did not also disengage MCAS, then Boeing should have been flashing that warning loud and clear, and with specific redirection to switch off MCAS.
The message is clear, that if rushing for whatever reason to complete means over-riding the cautions from the design experts, then someone should have the guts to take all the downstream consequences on their own heads, even if that means a long prison sentence.
We all pay for surgeons, especially, to "do" stuff with their hands as well as with their heads. Impositions on their time without giving them immediate positive feedback for completing an on-screen task will inevitably lead to degradation of quality.
Gawande's final point - We can retune and streamline our systems, but we won’t find a magical sweet spot between competing imperatives - surely must carry weight as a design prerogative for IT systems in health. Although, the essential difference between aviation and surgery is that "going wrong" never kills the surgeon.
All very poetic and noble of you all. However, I doubt the Government or other will let thing happen without their involvement. There be good and glory in them data mines and to hell with the traditional owners of the data.
ReplyDelete@6:12 PM. 100% correct, the Government will not allow things to progress, they are far too entrenched. Best that can be done is work out how to get as much as you can while you can.
ReplyDeleteThe PCEHR/MYHR has successfully been delivered, you might find it can now be dissolved or changed. No one wanted the failure on their resume. That challenge has been removed.
Unless Kelsey cannot be kept on a tight leash then those resumes are at risk.
@8:06 PM "The PCEHR/MYHR has successfully been delivered". Rubbish. The PCEHR/MYHR has not been delivered.
ReplyDeleteThe only thing that has been delivered is a registration, referred to as a My Health Record, for every Australian. To suggest anything more is blatant stupidity.
A registration alone is of no value to anyone, not even government. They already have all that information on the MBS.
So what value is there to anyone, including government, in having a duplicate MBS database?
Deliverance @ 10:50 AM is in the eye of the beholder. @8:06 is probably not wrong if you take it in the context of how the bureaucrats operate their career ambitions. Where is the evidence? Start with the withdrawing of direct funding for specialists and aged care hooking into the xHR Dropbox
ReplyDeleteI do not disagree with you and the whole thing has been a shambles under ADHA.
The ADHA must be up to something I received calls from two different Agencies today on the hunt for a conformance lead and a ‘digital’ health architect. Thank you but no thanks, hard enough getting work without that stain on your resume.
ReplyDeleteyou mean this:
ReplyDeletehttps://www.seek.com.au/job/38651851?type=standout&searchrequesttoken=def618c6-5e78-4dff-826f-8ba9deb665e7
and this:
https://www.seek.com.au/job/38648822?type=standout&searchrequesttoken=f8ad9a22-b728-445b-b0d3-308176c21809
Yes they sound like them. I did not ask if they were simple internal roles going through a process or why the roles were formed. We got to ADHA and I turned off.
ReplyDeleteThese are ‘apply direct’ seek adverts, would seem strange then recruitment agencies would contact you?
ReplyDeleteOrganisation typically take this approach when it is an internal appointment and they are just going through a process. It is seen as a cost effective way of manipulating the open and transparent system.
@5:26 PM ADHA wants to employ a LEAD ARCHITECT. Let's look at this more closely.
ReplyDelete1. Who were the last three Lead Architects?
2. When did they start and when did they finish?
3. Has ADHA had stability in this position?
4. Did each Lead Architect follow the same path as their predecessor or did each change the organisations direction?
5. Why is the remunneration package such a paltry amount of money?
6. Does the remmuneration reflect te importance of the job? or
7. Does it suggest that the ADHA sees this as a fairly straightforward role, call it a walk in the park (cemetry)?
8. Will the Auditor-General scrutinise past and present Lead Architects roles and effectiveness?
Just a minor point, this is an architect for their Terminology Service, a colllection of CISRO tools and AWS Infrastruture. Not watering down the importance of this work (that seems to never reach completition) but it is not a lead architect directing and influencing digital health architecture. A lot of position titles get over/mis- used.
ReplyDeleteThe remuneration is a reflection of the wage bands of the APS, the states are no better.
That makes sense, ramp up medicine and standardise toward SNOMED CT and AMT, using the new partnership with pharmacy to remove waste from the value chain. GP’s are an unnecessary cost (waste) in the eyes of beancounters. Replace them with direct supply relationship with the pharmacy. It is the same thing you see in automation happen at supermarkets and Mac Donald’s.
ReplyDeleteI am not saying this is good, just an observation
"Replace them with direct supply relationship with the pharmacy."
ReplyDeleteThat's pretty much as it is today.
If you have a test that shows you have high cholesterol, what does your doctor do?
She prescribes a statin.
Will a statin cure you of clogged arteries or other problems you may have? No.
So why does the doctor prescribe a statin?
This tells you why:
Statins lower heart attack, stroke risk in people at average risk
https://www.heart.org/en/news/2018/05/01/statins-lower-heart-attack-stroke-risk-in-people-at-average-risk
Look carefully at the infographic titled Better Together. Usually this sort of graphic is in an article that claims something like "taking a statin reduces your risk of having a heart attack by 24%. Taking a statin and a blood pressure-lowering medicine reduces the risk by 28%.
Sounds impressive, but actually isn't.
Another way of looking at the data in that infographic is to say that out of 1000 people with average risk of a heart attack 950 will not have a heart attack. (The placebo bar).
Of those who take a statin and a blood pressure-lowering medicine, 36 will have a heart attack.
Taking a statin and a blood pressure-lowering medicine has helped 14 people out of 1000. They didn't help 914 people - 50 didn't have a heart attach and 36 did.
This might nor be a problem except for two things.
1. Statins cost money (although if you are big pharam - it's not a problem)
2. Statins have side effects. Out of the 1000 people most will get no benefit but will be at risk of potential harm or discomofort.
Why am I having a rant today.
Because of reports like this:
"What’s the future of Australia’s healthcare sector?"
https://www.themandarin.com.au/105460-the-future-of-health-2/
It is full of hyperbole like
"The Fourth Industrial Revolution is a term that refers to the start of the next era of extraordinary change. This will see the adoption and application of emerging new technologies and platforms to integrate data, build insights, and offer new experiences for customers and service providers across all industries. "
The article points to two Delloites reports full of stuff that has been said over and over again for years. Here's an infamous RAND article from 2005:
"Can Electronic Medical Record Systems Transform Health Care? Potential Health Benefits, Savings, And Costs"
http://content.healthaffairs.org/content/24/5/1103.long
which used almost exactly the same language justifying the adoption of new technology. It made the claim:
"The adoption of interoperable EMR systems could produce efficiency and safety savings of $142-$371 billion."
I contacted the RAND corp some time ago and asked if they had ever done a study that looked at why the prediction in that article had failed to materialise?
The answer was "No. Nobody has paid us to do one". What a surprise. What technology vendor would want to kill the golden goose.
There is nothing in the Delloite Reports that answers the question: "What is being done to address the appalling inefficiencies and risks of current approaches to clinical medicine?
All we get are the same old promises of potential benefits by adopting new technology. These are the sorts of reports that technologists, ADHA and the government read and believe.
It's all a cargo cult - use technology like all those other industries and we will get the same results.
BTW, if LinkedIn is to be believed, the author of the Delloite reports, Dr Stephanie Allen, has a PhD in Criminology. Her first degree was in Politics and Sociology.
Tim Kelsey did History, Greg Hunt is a Lawyer.
Can we detect a pattern here?
"Can we detect a pattern here"?
ReplyDeleteI've noticed they each pontificate about the health system as if they know a lot about it, yet none of them have any experience in health. Seems like they have a close connection with 'oxymorons'.
Interesting paragraph in the last section of Delloite's Australian report
ReplyDeleteConsistent with their experiences in other industries, informed and empowered consumers will expect healthcare solutions to be coordinated, convenient, customised, and accessible. My Health Record goes some way to providing the platform to achieve this. However, integrating health and other lifestyle data and providing this in real time for consumers to act upon is where the future is heading. This will require further exploration of open data, cyber security, and privacy.
"My Health Record goes some way to providing the platform to achieve this"
That's a quadraduple whammy. Some way, only a platform, it doesn't integrate data and isn't real-time.
She may be a criminologist but she recognises a lemon when she sees one.
If you believe in correlation, My Health Record has caused a massive rise in obesity, it certainly hasn't reduced it.
ReplyDeletehttps://www.smh.com.au/national/that-was-the-most-heartbreaking-part-australia-s-obesity-epidemic-out-of-control-20190326-p517l5.html
Australia’s obesity epidemic is accelerating at an alarming rate, with almost one million more people becoming obese in the past three years alone, a major report warns.
An estimated 900,000 Australians joined the obesity ranks since 2014-2015, national data shows. Almost one-third of adults are now obese and one-quarter of children are obese or overweight.
Would seem the My Health Record has caused a collapse in emergency room capacity rather than the promised benefits.
ReplyDeletehttps://www.news.com.au/national/breaking-news/qld-public-hospital-beds-at-capacity/news-story/71ea3a5bec938e5ab3f1941b099d6413
Add the costs for PCEHR/MHR, all the EHR, PAC, iEMR, MAD etc.. across all states and territories and I am confident you could build some pretty efficient new patientcare facilities, a secure eFax network to connect them all and still have change left over for a couple of web conferencing suits and additional flying doctor planes.
the benefits of my health record in an emergency situation are immeasurable. (i.e.zero)
ReplyDeleteWell that is not much use then. If it cannot be measured it cannot manipulated. ADHA Operating Principle 2 (AOP-02)
ReplyDelete