Quote Of The Year

Timeless Quotes - Sadly The Late Paul Shetler - "Its not Your Health Record it's a Government Record Of Your Health Information"

or

H. L. Mencken - "For every complex problem there is an answer that is clear, simple, and wrong."

Saturday, August 26, 2006

Interactive Electronic Decision Support Benefits - Keys to the Literature

As a follow-up to the material presented last week it seemed to me it would be useful to provide some references and abstracts from the current literature to confirm my views regarding the importance of interactive clinical decision support.

A very useful slightly earlier review by Professor Enrico Coiera, that is readily available on the web, can be found at the following URL.

http://www.coiera.com/aimd.htm

Four key recent references are as follows:
Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success
Kensaku Kawamoto , Caitlin A Houlihan , E Andrew Balas , David F Lobach
Objective: To identify features of clinical decision support systems critical for improving clinical practice.
Design: Systematic review of randomised controlled trials.
Data sources: Literature searches via Medline, CINAHL, and the Cochrane Controlled Trials Register up to 2003; and searches of reference lists of included studies and relevant reviews.
Study selection Studies had to evaluate the ability of decision support systems to improve clinical practice.
Data extraction: Studies were assessed for statistically and clinically significant improvement in clinical practice and for the presence of 15 decision support system features whose importance had been repeatedly suggested in the literature.
Results: Seventy studies were included. Decision support systems significantly improved clinical practice in 68% of trials. Univariate analyses revealed that, for five of the system features, interventions possessing the feature were significantly more likely to improve clinical practice than interventions lacking the feature. Multiple logistic regression analysis identified four features as independent predictors of improved clinical practice: automatic provision of decision support as part of clinician workflow (P<0.00001), provision of recommendations rather than just assessments (P=0.0187), provision of decision support at the time and location of decision making (P=0.0263), and computer based decision support (P=0.0294). Of 32 systems possessing all four features, 30 (94%) significantly improved clinical practice. Furthermore, direct experimental justification was found for providing periodic performance feedback, sharing recommendations with patients, and requesting documentation of reasons for not following recommendations.
Conclusions: Several features were closely correlated with decision support systems' ability to improve patient care significantly. Clinicians and other stakeholders should implement clinical decision support systems that incorporate these features whenever feasible and appropriate.

Source:
http://bmj.bmjjournals.com/cgi/content/abstract/bmj.38398.500764.8Fv1
BMJ, doi:10.1136/bmj.38398.500764.8F (published 14 March 2005)

Effects of Computerized Clinical Decision Support Systems on Practitioner Performance and Patient Outcomes
A Systematic Review
Amit X. Garg, MD; Neill K. J. Adhikari, MD; Heather McDonald, MSc; M. Patricia Rosas-Arellano, MD, PhD; P. J. Devereaux, MD; Joseph Beyene, PhD; Justina Sam, BHSc; R. Brian Haynes, MD, PhD
JAMA. 2005;293:1223-1238.

Context: Developers of health care software have attributed improvements in patient care to these applications. As with any health care intervention, such claims require confirmation in clinical trials.
Objectives: To review controlled trials assessing the effects of computerized clinical decision support systems (CDSSs) and to identify study characteristics predicting benefit.
Data Sources: We updated our earlier reviews by searching the MEDLINE, EMBASE, Cochrane Library, Inspec, and ISI databases and consulting reference lists through September 2004. Authors of 64 primary studies confirmed data or provided additional information.
Study Selection We included randomized and nonrandomized controlled trials that evaluated the effect of a CDSS compared with care provided without a CDSS on practitioner performance or patient outcomes.
Data Extraction: Teams of 2 reviewers independently abstracted data on methods, setting, CDSS and patient characteristics, and outcomes.
Data Synthesis One hundred studies met our inclusion criteria. The number and methodologic quality of studies improved over time. The CDSS improved practitioner performance in 62 (64%) of the 97 studies assessing this outcome, including 4 (40%) of 10 diagnostic systems, 16 (76%) of 21 reminder systems, 23 (62%) of 37 disease management systems, and 19 (66%) of 29 drug-dosing or prescribing systems. Fifty-two trials assessed 1 or more patient outcomes, of which 7 trials (13%) reported improvements. Improved practitioner performance was associated with CDSSs that automatically prompted users compared with requiring users to activate the system (success in 73% of trials vs 47%; P = .02) and studies in which the authors also developed the CDSS software compared with studies in which the authors were not the developers (74% success vs 28%; respectively, P = .001).
Conclusions: Many CDSSs improve practitioner performance. To date, the effects on patient outcomes remain understudied and, when studied, inconsistent.

Source:
http://jama.ama-assn.org/cgi/content/abstract/293/10/1223

Systematic Review: Impact of Health Information Technology on Quality, Efficiency, and Costs of Medical Care
Basit Chaudhry, MD; Jerome Wang, MD; Shinyi Wu, PhD; Margaret Maglione, MPP; Walter Mojica, MD; Elizabeth Roth, MA; Sally C. Morton, PhD; and Paul G. Shekelle, MD, PhD

16 May 2006 | Volume 144 Issue 10 | Pages 742-752
Background: Experts consider health information technology key to improving efficiency and quality of health care.
Purpose: To systematically review evidence on the effect of health information technology on quality, efficiency, and costs of health care.
Data Sources: The authors systematically searched the English-language literature indexed in MEDLINE (1995 to January 2004), the Cochrane Central Register of Controlled Trials, the Cochrane Database of Abstracts of Reviews of Effects, and the Periodical Abstracts Database. We also added studies identified by experts up to April 2005.
Study Selection: Descriptive and comparative studies and systematic reviews of health information technology.
Data Extraction: Two reviewers independently extracted information on system capabilities, design, effects on quality, system acquisition, implementation context, and costs.
Data Synthesis: 257 studies met the inclusion criteria. Most studies addressed decision support systems or electronic health records. Approximately 25% of the studies were from 4 academic institutions that implemented internally developed systems; only 9 studies evaluated multifunctional, commercially developed systems. Three major benefits on quality were demonstrated: increased adherence to guideline-based care, enhanced surveillance and monitoring, and decreased medication errors. The primary domain of improvement was preventive health. The major efficiency benefit shown was decreased utilization of care. Data on another efficiency measure, time utilization, were mixed. Empirical cost data were limited.
Limitations: Available quantitative research was limited and was done by a small number of institutions. Systems were heterogeneous and sometimes incompletely described. Available financial and contextual data were limited.
Conclusions: Four benchmark institutions have demonstrated the efficacy of health information technologies in improving quality and efficiency. Whether and how other institutions can achieve similar benefits, and at what costs, are unclear.

Source:
http://www.annals.org/cgi/content/short/144/10/742

Costs and Benefits of Health Information Technology.
Shekelle PG, Morton SC, Keeler EB.
Evidence Report/Technology Assessment No. 132. (Prepared by the Southern California Evidence-based Practice Center under Contract No. 290-02-0003.) AHRQ Publication No. 06-E006. Rockville, MD: Agency for Healthcare Research and Quality. April 2006.

Abstract

Objectives: An evidence report was prepared to assess the evidence base regarding benefits and costs of health information technology (HIT) systems, that is, the value of discrete HIT functions and systems in various healthcare settings, particularly those providing pediatric care.

Data Sources: PubMed®, the Cochrane Controlled Clinical Trials Register, and the Cochrane Database of Reviews of Effectiveness (DARE) were electronically searched for articles published since 1995. Several reports prepared by private industry were also reviewed.
Review Methods: Of 855 studies screened, 256 were included in the final analyses. These included systematic reviews, meta-analyses, studies that tested a hypothesis, and predictive analyses. Each article was reviewed independently by two reviewers; disagreement was resolved by consensus.

Results: Of the 256 studies, 156 concerned decision support, 84 assessed the electronic medical record, and 30 were about computerized physician order entry (categories are not mutually exclusive). One hundred twenty four of the studies assessed the effect of the HIT system in the outpatient or ambulatory setting; 82 assessed its use in the hospital or inpatient setting. Ninety seven studies used a randomized design. There were 11 other controlled clinical trials, 33 studies using a pre-post design, and 20 studies using a time series. Another 17 were case studies with a concurrent control. Of the 211 hypothesis-testing studies, 82 contained at least some cost data.

We identified no study or collection of studies, outside of those from a handful of HIT leaders, that would allow a reader to make a determination about the generalizable knowledge of the study’s reported benefit. Beside these studies from HIT leaders, no other research assessed HIT systems that had comprehensive functionality and included data on costs, relevant information on organizational context and process change, and data on implementation.

A small body of literature supports a role for HIT in improving the quality of pediatric care. Insufficient data were available on the costs or cost-effectiveness of implementing such systems.
The ability of Electronic Health Records (EHRs) to improve the quality of care in ambulatory care settings was demonstrated in a small series of studies conducted at four sites (three U.S. medical centers and one in the Netherlands). The studies demonstrated improvements in provider performance when clinical information management and decision support tools were made available within an EHR system, particularly when the EHRs had the capacity to store data with high fidelity, to make those data readily accessible, and to help translate them into context specific information that can empower providers in their work.

Despite the heterogeneity in the analytic methods used, all cost-benefit analyses predicted substantial savings from EHR (and health care information exchange and interoperability) implementation: The quantifiable benefits are projected to outweigh the investment costs.

However, the predicted time needed to break even varied from three to as many as 13 years.
Conclusions: HIT has the potential to enable a dramatic transformation in the delivery of health care, making it safer, more effective, and more efficient. Some organizations have already realized major gains through the implementation of multifunctional, interoperable HIT systems built around an EHR. However, widespread implementation of HIT has been limited by a lack of generalizable knowledge about what types of HIT and implementation methods will improve care and manage costs for specific health organizations. The reporting of HIT development and implementation requires fuller descriptions of both the intervention and the organizational/economic environment in which it is implemented.

Note: This abstract is for the full report, which was summarised in the Annals of Internal Medicine article above which was published at close to the same time.

Source:
http://www.ahrq.gov/downloads/pub/evidence/pdf/hitsyscosts/hitsys.pdf

Taken together these review provide compelling evidence for the key importance of interactive CDS

Note: a Google search for (benefits "clinical decision support") yields 158,000 English language pages. That of itself says something!

David.

No comments: