The following was published a day or so ago in the British Medical Journal.
Research
Adoption and non-adoption of a shared electronic summary record in England: a mixed-method case study
Trisha Greenhalgh, director1, Katja Stramer, senior research fellow2, Tanja Bratan, research fellow2, Emma Byrne, research fellow3, Jill Russell, senior lecturer2, Henry W W Potts, lecturer3
1 Healthcare Innovation and Policy Unit, Centre for Health Sciences, Barts and The London School of Medicine and Dentistry, London E1 2AD, 2 Division of Medical Education, University College London, 3 Centre for Health Informatics and Multiprofessional Education, University College London
Objective To evaluate a national programme to develop and implement centrally stored electronic summaries of patients’ medical records.
Design Mixed-method, multilevel case study.
Setting English National Health Service 2007-10. The summary care record (SCR) was introduced as part of the National Programme for Information Technology. This evaluation of the SCR considered it in the context of national policy and its frontline implementation and use in three districts.
Participants and methods Quantitative data (cumulative records created nationally plus a dataset of 416 325 encounters in participating primary care out-of-hours and walk-in centres) were analysed statistically. Qualitative data (140 interviews including policy makers, managers, clinicians, and software suppliers; 2000 pages of ethnographic field notes including observation of 214 clinical consultations; and 3000 pages of documents) were analysed thematically and interpretively.
Results Creating individual SCRs and supporting their adoption and use was a complex, technically challenging, and labour intensive process that occurred more slowly than planned. By early 2010, 1.5 million such records had been created. In participating primary care out-of-hours and walk-in centres, an SCR was accessed in 4% of all encounters and in 21% of encounters where one was available; these figures were rising in some but not all sites. The main determinant of SCR access was the identity of the clinician: individual clinicians accessed available SCRs between 0 and 84% of the time. When accessed, an SCR seemed to support better quality care and increase clinician confidence in some encounters. There was no direct evidence of improved safety, but findings were consistent with a rare but important positive impact on preventing medication errors. SCRs sometimes contained incomplete or inaccurate data, but clinicians drew judiciously on these data along with other sources. SCR use was not associated with shorter consultations or reduction in onward referral. Successful introduction of SCRs depended on interaction between multiple stakeholders from different worlds (clinical, political, technical, commercial) with different values, priorities, and ways of working. The programme’s fortunes seemed to turn on the ability of change agents to bridge these different institutional worlds, align their conflicting logics, and mobilise implementation effort.
Conclusions Benefits of centrally stored electronic summary records seem more subtle and contingent than many stakeholders anticipated, and clinicians may not access them. Complex interdependencies, inherent tensions, and high implementation workload should be expected when they are introduced on a national scale.
The full paper and extras can be accessed from this link.
Some early commentary is available here:
Hell-ish
16 Jun 2010
UCL has spent three years evaluating the Summary Care Record and has now issued a 234 page report on the subject. Fiona Barr reads how ‘The Devil’s in the Detail’ of this huge, but apparently disappointing, undertaking.
Long awaited and much anticipated, the final report of UCL’s independent evaluation of the Summary Care Record has just been published.
Just a look at the title – ‘The Devil’s in the Detail’ – tells you a lot of what the researchers want you to know. This is a complex issue with no simple outcomes or pat answers.
Nevertheless, the report’s discovery that there have been only modest benefits from the SCR and really no benefits from HealthSpace might lead to questions about why the two schemes should not be scrapped.
A key caveat – tucked away in a line at the beginning of the report – is that the evaluation was carried out at a time when few SCRs existed and the functionality of HealthSpace was much less than its creators hoped it would be.
This may enable those in favour of the projects to argue that the long term benefits have yet to appear - although, conversely, the argument that benefits will only come once a scheme becomes universally adopted has its own flaws.
Those in favour could also argue that emergency summary record systems have already been delivered elsewhere in the UK; so why should England not follow suit?
Although it is promising to consider the evaluation’s findings, the Department of Health sounds as if it has already made up its mind, and that the SCR programme will continue. A future for a functionally rich HealthSpace is harder to envisage.
However, if the DH decides its £1m investment in the evaluation is worth considering in detail, its final report has a wealth of information on what progress has been made so far and what it implies for the steps that will need to be taken in the future.
Lots more here:
The message for Australia, NEHTA and DoHA is crystal clear. Shared care summary records are a very difficult undertaking in a range of dimensions that far exceed the technical.
These conclusions say it all:
“Conclusions Benefits of centrally stored electronic summary records seem more subtle and contingent than many stakeholders anticipated, and clinicians may not access them. Complex interdependencies, inherent tensions, and high implementation workload should be expected when they are introduced on a national scale.”
If there is even the slightest pursuit of truth and honesty existing within NEHTA and DoHA they need to bring the full report to Government’s attention with their plans as to how they will overcome the issues identified in the UK.
To do less would just be dishonest. Australia must not replicate the mistakes made in England and the way to do that is to learn very carefully from their experience. No centralised system should be contemplated without good answers to all the issues raised in this evaluation.
The evaluation full report is available here:
Mandatory weekend reading!
(And before anyone feels the need to tell me about them, yes, I am aware of some simpler models that are apparently working better – but still with significant issues – in Scotland and Wales).
David.
This is a major paper, and its results should be read by all interested in national ehealth.
ReplyDeleteYes the BMJ paper is long, and the full report even longer. But here is the summary point everyone needs to know:
"an SCR was accessed in 4% of all [primary care]
encounters and in 21% of encounters where one was available"
In other words, the summary record has a limited (but no doubt important) use case. It is not of universal (or even near universal) benefit.
If the SCR is understood to be only 1 e-health service amongst many, not the overall goal of any national service, and if it is built because it is the highest priority service, well and good. But too often the thinking seems to be
1 - We need a national EHR
2 - That's too hard and risky and expensive so
3 - Lets start smaller
4 - Hey how about a summary EHR? That seems like a mini EHR and I'm sure we can do that ...
5 - We need a national summary EHR
There are many other e-health services that we could implement nationally, and some of them are bound to have a higher ROI and higher clinical utility. Amongst my list there are; electronic discharge summaries, e-prescribing, test results (order and receive), and HIE (sharing access to records across the silos).
In fact, the list was part of the first COAG business case. If we get a national HIE like system out of the current system, that supports some of those services, brilliant. If the thinking collapses to just delivering an SCR, then this paper is an alarm bell to those doing the planning ... time to look at that old COAG document again.
The sad part is that we have standards in place to achieve all those base level services.
ReplyDeleteThe quality and compliance is often low and as a result the interoperability poor.
There is no incentive by large vendors to achieve interoperability as they can demonstrate their own products interoperating using proprietary messages and use that to try and capture more of the market. It is rare to be able to get a complaint HL7 message out of a pms system in Australia!! They of course can send to other instance of their system.
eHealth is a stack of functionality and the prizes only come from the top levels of the stack. We are seeing attempts to build the top layers without any effort to make sure the supporting layers work.
Its like complaining the web site is not working when you have failed to plug in the network cable. I am sure ISP support sees this problem frequently. The wonder of the internet is built on physical cables, low level protocols, http, html and javascript standards etc etc. It only in the last 5 years, with the compliance of browsers wrt html, CSS and javascript standards improving that we have seen the appearance of rich internet applications.
In order to encourage the appearance of rich eHealth applications we need compliance with HL7 standards and solid PKI infrastructure etc etc. There is no way the HL7 v2 infrastructure is going away any time soon and the best option is to make that solid and complaint. That would then enable messaging interoperability and we could make a start on semantics. After this is in place then we could create person controlled records that worked.
To ignore the low levels of the eHealth stack suggests a basic lack of understanding of the problem space. This is not "sexy" to government, but continual failure is the price we continue to pay for management by people who are out of their depth.
Andrew, never was a truer word writ: "but continual failure is the price we continue to pay for management by people who are out of their depth".
ReplyDelete