Usability of electronic health record systems in UK EDs

Implementation of major trauma app: usability and data completeness

BACKGROUND

The current UK standard for major trauma patients is to record notes in a paper trauma booklet. Through an innovative collaboration between a major trauma centre and a digital transformation industry partner, a TraumaApp was developed. Electronic notes have been shown to have fewer errors, granular data collection and enable time stamped contemporaneous record keeping. Implementation of digital clinical records presents a challenge within the context of trauma multidisciplinary trauma resuscitation. Data can be easily accessible and shared for quality improvement, audit and research purposes. This study compared paper and electronic notes for completeness and for acceptability data following the implementation of the TraumaApp.

METHODS

Trauma team members who performed scribe function attended training for the newly launched TraumaApp. Two staff members acted as scribe, using either the paper trauma booklet or TraumaApp, and attended major trauma calls. A framework for comparison of paper and electronic notes was created and used for a retrospective review of major trauma patients' notes. Statistical analysis was performed using a two-tailed t-test. Staff using the TraumaApp completed a System Usability Score questionnaire.

RESULTS

There was a total of 37 data points for collection per case. The mean numbers collected were paper notes 24.1 of 37 (65.1%) and electronic notes, 25.7 of 37 (69.5%). There was no statistical significance between the completeness of paper and electronic notes. The mean System Usability Score was 68.4.

DISCUSSION

Recording accurate patient information during a major trauma call can be challenging and the role of the scribe to accurately record events is critical for immediate and future care. There was no statistically significant difference in completeness of paper and electronic notes, however the mean System Usability Score was 68.4, which is greater than the internationally validated standard of acceptable usability.

CONCLUSION

It is feasible to introduce digital data collection tools enabling accurate record keeping during trauma resuscitation and improve information sharing between clinicians.

Beyond empathy training for practitioners: Cultivating empathic healthcare systems and leadership

Empathic care benefits patients and practitioners, and empathy training for practitioners can enhance empathy. However, practitioners do not operate in a vacuum. For empathy to thrive, healthcare consultations must be situated in a nurturing milieu, guided by empathic, compassionate leaders. Empathy will be suppressed, or even reversed if practitioners are burned out and working in an unpleasant, under-resourced environment with increasingly poorly served and dissatisfied patients. Efforts to enhance empathy must therefore go beyond training practitioners to address system-level factors that foster empathy. These include patient education, cultivating empathic leadership, customer service training for reception staff, valuing cleaning and all ancillary staff, creating healing spaces, and using appropriate, efficiency saving technology to reduce the administrative burden on healthcare practitioners. We divide these elements into environmental factors, organisational factors, job factors, and individual characteristics.

Evaluation of usability and user feedback to guide telepharmacy application development in Indonesia: a mixed-methods study

BACKGROUND

In Indonesia, the adoption of telepharmacy was propelled by the COVID-19 pandemic, prompting the need for a user-friendly application to support both the general population and pharmacists in accessing healthcare services. Therefore, this study aimed to evaluate usability and user feedback of a pioneering telepharmacy application known as Tanya Obat (translating to "Ask about Medications") in Indonesia, from the perspectives of the general population and pharmacists.

METHODS

A mixed-methods sequential study was conducted with the early-stage Tanya Obat application in Bandung City. Participants, including the general population and pharmacists, were instructed to use the application for a week. Questionnaires for the general population and pharmacists were distributed from March to May and February to June 2023, respectively. The System Usability Scale questionnaire was adopted to describe usability of the developed application. Further exploration of the quantitative results required collecting open-ended feedback to assess the impressions of the participants, difficulties encountered, and desired features for enhanced user-friendliness. The collected statements were summarized and clustered using thematic analysis. Subsequently, the association between the characteristics of participants and perceived usability was determined with the Chi-square test.

RESULT

A total of 176 participants, comprising 100 individuals from the general population and 76 pharmacists, engaged in this study. In terms of usability, the questionnaire showed that Tanya Obat application was on the borderline of acceptability, with mean scores of 63.4 and 64.1 from the general population and pharmacists, respectively. Additionally, open-ended feedback targeted at achieving a more compelling user experience was categorized into two themes, including concerns regarding the functionality of certain features and recommendations for improved visual aesthetics and bug fixes. No significant associations were observed between the characteristics of participants and perceived usability (p-value > 0.05).

CONCLUSION

The results showed that the perceived usability of Tanya Obat developed for telepharmacy was below average. Therefore, feature optimizations should be performed to facilitate usability of this application in Indonesia.

Introducing a digital emergency obstetric and newborn care register for indoor obstetric patient management: An implementation research in selected public health care facilities of Bangladesh

Background

Digital health records have emerged as vital tools for improving health care delivery and patient data management. Acknowledging the gaps in data recording by a paper-based register, the emergency obstetric and newborn care (EmONC) register used in the labour ward was digitised. In this study, we aimed to assess the implementation outcome of the digital register in selected public health care facilities in Bangladesh.

Methods

Extensive collaboration with stakeholders facilitated the development of an android-based electronic register from the paper-based register in the labour rooms of the selected district and sub-district level public health facilities of Bangladesh. We conducted a study to assess the implementation outcome of introducing the digital EmONC register in the labour ward.

Results

The digital register demonstrated high usability with a score of 83.7 according to the system usability scale, and health care providers found it highly acceptable, with an average score exceeding 95% using the technology acceptance model. The adoption rate reached an impressive 98% (95% confidence interval (CI) = 98-99), and fidelity stood at 90% (95% CI = 88-91) in the digital register, encompassing more than 80% of data elements. Notably, fidelity increased significantly over the implementation period of six months. The digital system proved a high utility rate of 89% (95% CI = 88-91), and all outcome variables exceeded the predefined benchmark.

Conclusions

The implementation outcome assessment underscores the potential of the digital register to enhance maternal and newborn health care in Bangladesh. Its user-friendliness, improved data completeness, and high adoption rates indicate its capacity to streamline health care data management and improve the quality of care.

A Call to Reconsider a Nationwide Electronic Health Record System: Correcting the Failures of the National Program for IT

The National Programme for IT (NPfIT) was launched in 2005 to implement 7 nationwide IT services across the National Health Service (NHS). Despite the success of many of these designated “deliverables,” the establishment of a single nationwide electronic health record (EHR) system never fully materialized. As a result, NHS medical records are now stored using a diverse array of alternate EHR systems, which frequently restricts health care practitioners from accessing extensive portions of their patients’ notes. This not only limits their ability to make well-informed clinical decisions but also impacts the quality of care they are able to provide. This article assesses the medical, economic, and bureaucratic implications of an NHS-wide EHR system. Additionally, it explores how the shortcomings of the NPfIT should be addressed when attempting to introduce such a system in the future.

Design, development, implementation, and evaluation of a severe drug-drug interaction alert system in the ICU: An analysis of acceptance and override rates

BACKGROUND AND OBJECTIVE

The override rate of Drug-Drug Interaction Alerts (DDIA) in Intensive Care Units (ICUs) is very high. Therefore, this study aimed to design, develop, implement, and evaluate a severe Drug-Drug Alert System (DDIAS) in a system of ICUs and measure the override rate of this system.

METHODS

This is a cross-sectional study that details the design, development, implementation, and evaluation of a DDIAS for severe interactions into a Computerized Provider Order Entry (CPOE) system in the ICUs of Nemazee general teaching hospitals in 2021. The patients exposed to the volume of DDIAS, acceptance and overridden of DDIAS, and usability of DDIAS have been collected. The study was approved by the local Institutional Review Board (IRB) and; the ethics committee of Shiraz University of Medical Science on date: 2019-11-23 (Approval ID: IR.SUMS.REC.1398.1046).

RESULTS

The knowledge base of the DDIAS contains 9,809 severe potential drug-drug interactions (pDDIs). A total of 2672 medications were prescribed in the population study. The volume and acceptance rate for the DDIAS were 81 % and 97.5 %, respectively. The override rate was 2.5 %. The mean System Usability Scale (SUS) score of the DDIAS was 75.

CONCLUSION

This study demonstrates that implementing high-risk DDIAS at the point of prescribing in ICUs improves adherence to alerts. In addition, the usability of the DDIAS was reasonable. Further studies are needed to investigate the establishment of severe DDIAS and measure the prescribers' response to DDIAS on a larger scale.

Perceptions of chief clinical information officers on the state of electronic health records systems interoperability in NHS England: a qualitative interview study

BACKGROUND

In the era of electronic health records (EHR), the ability to share clinical data is a key facilitator of healthcare delivery. Since the introduction of EHRs, this aspect has been extensively studied from the perspective of healthcare providers. Less often explored are the day-to-day challenges surrounding the procurement, deployment, maintenance, and use of interoperable EHR systems, from the perspective of healthcare administrators, such as chief clinical information officers (CCIOs).

OBJECTIVE

Our study aims to capture the perceptions of CCIOs on the current state of EHR interoperability in the NHS, its impact on patient safety, the perceived facilitators and barriers to improving EHR interoperability, and what the future of EHR development in the NHS may entail.

METHODS

Semi-structured interviews were conducted between November 2020 - October 2021. Convenience sampling was employed to recruit NHS England CCIOs. Interviews were digitally recorded and transcribed verbatim. A thematic analysis was performed by two independent researchers to identify emerging themes.

RESULTS

Fifteen CCIOs participated in the study. Participants reported that limited EHR interoperability contributed to the inability to easily access and transfer data into a unified source, thus resulting in data fragmentation. The resulting lack of clarity on patients' health status negatively impacts patient safety through suboptimal care coordination, duplication of efforts, and more defensive practice. Facilitators to improving interoperability included the recognition of the need by clinicians, patient expectations, and the inherent centralised nature of the NHS. Barriers included systems usability difficulties, and institutional, data management, and financial-related challenges. Looking ahead, participants acknowledged that realising that vision across the NHS would require a renewed focus on mandating data standards, user-centred design, greater patient involvement, and encouraging inter-organisational collaboration.

CONCLUSION

Tackling poor interoperability will require solutions both at the technical level and in the wider policy context. This will involve demanding interoperability functionalities from the outset in procurement contracts, fostering greater inter-organisation cooperation on implementation strategies, and encouraging systems vendors to prioritise interoperability in their products. Only by comprehensively addressing these challenges would the full potential promised by the use of fully interoperable EHRs be realised.

Evaluating the costs and consequences of computerized clinical decision support systems in hospitals: a scoping review and recommendations for future practice

OBJECTIVE

Sustainable investment in computerized decision support systems (CDSS) requires robust evaluation of their economic impacts compared with current clinical workflows. We reviewed current approaches used to evaluate the costs and consequences of CDSS in hospital settings and presented recommendations to improve the generalizability of future evaluations.

MATERIALS AND METHODS

A scoping review of peer-reviewed research articles published since 2010. Searches were completed in the PubMed, Ovid Medline, Embase, and Scopus databases (last searched February 14, 2023). All studies reported the costs and consequences of a CDSS-based intervention compared with current hospital workflows. Findings were summarized using narrative synthesis. Individual studies were further appraised against the Consolidated Health Economic Evaluation and Reporting (CHEERS) 2022 checklist.

RESULTS

Twenty-nine studies published since 2010 were included. Studies evaluated CDSS for adverse event surveillance (5 studies), antimicrobial stewardship (4 studies), blood product management (8 studies), laboratory testing (7 studies), and medication safety (5 studies). All studies evaluated costs from a hospital perspective but varied based on the valuation of resources affected by CDSS implementation, and the measurement of consequences. We recommend future studies follow guidance from the CHEERS checklist; use study designs that adjust for confounders; consider both the costs of CDSS implementation and adherence; evaluate consequences that are directly or indirectly affected by CDSS-initiated behavior change; examine the impacts of uncertainty and differences in outcomes across patient subgroups.

DISCUSSION AND CONCLUSION

Improving consistency in the conduct and reporting of evaluations will enable detailed comparisons between promising initiatives, and their subsequent uptake by decision-makers.

The digital future of nursing: making sense of taxonomies and key concepts

Digital technology is becoming increasingly common in routine nursing practice. The adoption of digital technologies such as video calling, and other digital communication, has been hastened by the recent COVID-19 pandemic. Use of these technologies has the potential to revolutionise nursing practice, leading to potentially more accurate patient assessment, monitoring processes and improved safety in clinical areas. This article outlines key concepts related to the digitalisation of health care and the implications for nursing practice. The aim of this article is to encourage nurses to consider the implications, opportunities and challenges associated with the move towards digitalisation and advances in technology. Specifically, this means understanding key digital developments and innovations associated with healthcare provision and appreciating the implications of digitalisation for the future of nursing practice.

Development and implementation experience of a learning healthcare system for facility based newborn care in low resource settings: The Neotree

Introduction

Improving peri- and postnatal facility-based care in low-resource settings (LRS) could save over 6000 babies' lives per day. Most of the annual 2.4 million neonatal deaths and 2 million stillbirths occur in healthcare facilities in LRS and are preventable through the implementation of cost-effective, simple, evidence-based interventions. However, their implementation is challenging in healthcare systems where one in four babies admitted to neonatal units die. In high-resource settings healthcare systems strengthening is increasingly delivered via learning healthcare systems to optimise care quality, but this approach is rare in LRS.

Methods

Since 2014 we have worked in Bangladesh, Malawi, Zimbabwe, and the UK to co-develop and pilot the Neotree system: an android application with accompanying data visualisation, linkage, and export. Its low-cost hardware and state-of-the-art software are used to support healthcare professionals to improve postnatal care at the bedside and to provide insights into population health trends. Here we summarise the formative conceptualisation, development, and preliminary implementation experience of the Neotree.

Results

Data thus far from ~18 000 babies, 400 healthcare professionals in four hospitals (two in Zimbabwe, two in Malawi) show high acceptability, feasibility, usability, and improvements in healthcare professionals' ability to deliver newborn care. The data also highlight gaps in knowledge in newborn care and quality improvement. Implementation has been resilient and informative during external crises, for example, coronavirus disease 2019 (COVID-19) pandemic. We have demonstrated evidence of improvements in clinical care and use of data for Quality Improvement (QI) projects.

Conclusion

Human-centred digital development of a QI system for newborn care has demonstrated the potential of a sustainable learning healthcare system to improve newborn care and outcomes in LRS. Pilot implementation evaluation is ongoing in three of the four aforementioned hospitals (two in Zimbabwe and one in Malawi) and a larger scale clinical cost effectiveness trial is planned.

Expert consultation using the on-line Delphi method for the revision of syndromic groups compiled from emergency data (SOS Médecins and OSCOUR®) in France

Background

Consultation data from emergency general practitioners known as SOS Médecins and emergency departments (ED) from OSCOUR® network to the French syndromic surveillance system SurSaUD® (Surveillance sanitaire des urgences et décès). These data are aggregated and monitored on a daily basis through groupings of one or more medical symptoms or diagnoses (“syndromic groups” (SG)).

The objective of this study was to evaluate, revise and enrich the composition of SGs through a consensus of experts who contributed or have experience in syndromic surveillance.

Methods

Three rounds of a Delphi survey were organised, involving 15 volunteers from SOS Médecins and 64 ED physicians in the OSCOUR® network as well as 8 international epidemiologists. Thirty-four SOS Médecins and 40 OSCOUR® SGs covering major medical specialities were put to the experts, along with their diagnostic codes and their surveillance objectives. In each round, the experts could retain or reject the codes according to the surveillance objective. The panel could also put forward new diagnostic codes in the 1st round, included in subsequent rounds. Consensus was reached for a code if 80% of participants had chosen to keep it, or less than 20% to reject it.

Results

A total of 12 SOS Médecins doctors (80%), 30 ED doctors (47%) and 4 international experts (50%) participated in the three rounds. All of the SGs presented to the panel included 102 initial diagnostic codes and 73 additional codes for SOS Médecins, 272 initial diagnostic codes and 204 additional codes for OSCOUR®. At the end of the 3 rounds, 14 SOS Médecins (40%) and 11 OSCOUR® (28%) SGs achieved a consensus to maintain all of their diagnostic codes. Among these, indicators of winter seasonal surveillance (bronchiolitis and gastroenteritis) were included.

Conclusion

This study involved a panel of national experts with international representation and a good level of involvement throughout the survey. In the absence of a standard definition, the Delphi method has been shown to be useful in defining and validating syndromic surveillance indicators.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-022-14157-x.

Usability-Focused Development and Usage of NeoTree-Beta, an App for Newborn Care in a Low-Resource Neonatal Unit, Malawi

Background

Neonatal mortality is high in low-resource settings. NeoTree is a digital intervention for neonatal healthcare professionals (HCPs) aiming to achieve data-driven quality improvement and improved neonatal survival in low-resource hospitals. Optimising usability with end-users could help digital health interventions succeed beyond pilot stages in low-resource settings. Usability is the quality of a user's experience when interacting with an intervention, encompassing their effectiveness, efficiency, and overall satisfaction.

Objective

To evaluate the usability and usage of NeoTree beta-app and conduct Agile usability-focused intervention development.

Method

A real-world pilot of NeoTree beta-app was conducted over 6 months at Kamuzu Central Hospital neonatal unit, Malawi. Prior to deployment, think-aloud interviews were conducted to guide nurses through the app whilst voicing their thoughts aloud (n = 6). System Usability Scale (SUS) scores were collected before the implementation of NeoTree into usual clinical care and 6 months after implementation (n = 8 and 8). During the pilot, real-world user-feedback and user-data were gathered. Feedback notes were subjected to thematic analysis within an Agile “product backlog.” For usage, number of users, user-cadre, proportion of admissions/outcomes recorded digitally, and median app-completion times were calculated.

Results

Twelve overarching usability themes generated 57 app adjustments, 39 (68%) from think aloud analysis and 18 (32%) from the real-world testing. A total of 21 usability themes/issues with corresponding app features were produced and added to the app. Six themes relating to data collection included exhaustiveness of data schema, prevention of errors, ease of progression, efficiency of data entry using shortcuts, navigation of user interface (UI), and relevancy of content. Six themes relating to the clinical care included cohesion with ward process, embedded education, locally coherent language, adaptability of user-interface to available resources, and printout design to facilitate handover. SUS scores were above average (88.1 and 89.4 at 1 and 6 months, respectively). Ninety-three different HCPs of 5 cadres, recorded 1,323 admissions and 1,197 outcomes over 6 months. NeoTree achieved 100% digital coverage of sick neonates admitted. Median completion times were 16 and 8 min for admissions and outcomes, respectively.

Conclusions

This study demonstrates optimisation of a digital health app in a low-resource setting and could inform other similar usability studies apps in similar settings.

Translation and Cross-Cultural Adaptation of the System Usability Scale to Brazilian Portuguese

Objective: To adapt culturally the System Usability Scale to Brazilian Portuguese and assess its internal consistency and structural construct validity. Materials and methods: This methodological study of a measurement instrument’s cultural adaptation included the initial translation, the translations’ synthesis, the back-translation, the evaluation by a committee of eight experts, testinh with a sample of 100 students, who evaluated the usability of the WhatsApp application, and the evaluation of structural construct validity by exploratory factor analysis. Results: The judges validated the Brazilian version of the System Usability Scale in the second round. It was revealed that, following the structural construct validation, the version had a unidimensional structure and an acceptable level of reliability (Cronbach’s alpha of 0.76). Besides, in the usability test, no suggestions for change were made. Conclusions: It is worth noting that the Brazilian version of this scale was semantically, idiomatically, conceptually, and culturally equivalent to the original English version and showed adequate reliability and structural construct validity.

Evaluation of the clinical application effect of eSource record tools for clinical research

Background

Electronic sources (eSources) can improve data quality and reduce clinical trial costs. Our team has developed an innovative eSource record (ESR) system in China. This study aims to evaluate the efficiency, quality, and system performance of the ESR system in data collection and data transcription.

Methods

The study used time efficiency and data transcription accuracy indicators to compare the eSource and non-eSource data collection workflows in a real-world study (RWS). The two processes are traditional data collection and manual transcription (the non-eSource method) and the ESR-based source data collection and electronic transmission (the eSource method). Through the system usability scale (SUS) and other characteristic evaluation scales (system security, system compatibility, record quality), the participants’ experience of using ESR was evaluated.

Results

In terms of the source data collection (the total time required for writing electronic medical records (EMRs)), the ESR system can reduce the time required by 39% on average compared to the EMR system. In terms of data transcription (electronic case report form (eCRF) filling and verification), the ESR can reduce the time required by 80% compared to the non-eSource method (difference: 223 ± 21 s). The ESR accuracy in filling the eCRF field is 96.92%. The SUS score of ESR is 66.9 ± 16.7, which is at the D level and thus very close to the acceptable margin, indicating that optimization work is needed.

Conclusions

This preliminary evaluation shows that in the clinical medical environment, the ESR-based eSource method can improve the efficiency of source data collection and reduce the workload required to complete data transcription.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12911-022-01824-7.

Usability of novel major TraumaApp for digital data collection

Background

Delivery of major trauma care is complex and often fast paced. Clear and comprehensive documentation is paramount to support effective communication during complex clinical care episodes, and to allow collection of data for audit, research and continuous improvement. Clinical events are typically recorded on paper-based records that are developed for individual centres or systems. As one of the priorities laid out by the Scottish Trauma Network project was to develop an electronic data collection system, the TraumaApp was created as a data collection tool for major trauma that could be adopted worldwide.

Methods

The study was performed as a service evaluation based at the Queen Elizabeth University Hospital Emergency Department. Fifty staff members were recruited in pairs and listened to five paired major trauma standby and handover recordings. Participants were randomised to input data to the TraumaApp and one into the existing paper proforma. The time taken to input data add into was measured, along with time for clarifications and any errors made. Those using the app completed a System Usability Score.

Results

No statistically significant difference was demonstrated between times taken for data entry for the digital and paper documentation, apart from the Case 5 Handover (p < 0.05). Case 1 showed a significantly higher time for clarifications and number of errors with digital data collection (p = 0.01 and p = 1.79E-05 respectively). There were no other differences between data for the app and the proforma. The mean System Usability score for this cohort was 75 out of 100, with a standard deviation of 17 (rounded to nearest integer).

Conclusion

Digital real-time recording of clinical events using a tool such as the TraumaApp is comparable to completion of paper proforma. The System Usability Score for the TraumaApp was above the internationally validated standard of acceptable usability. There was no evidence of improvement in use over time or familiarity, most likely due to the brevity of the assessments and the refined user interface. This would benefit from further research, exploring data completeness and a potential mixed methods approach to explore training requirements for use of the TraumaApp.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12873-022-00578-9.

Estimating redundancy in clinical text

The current mode of use of Electronic Health Records (EHR) elicits text redundancy. Clinicians often populate new documents by duplicating existing notes, then updating accordingly. Data duplication can lead to propagation of errors, inconsistencies and misreporting of care. Therefore, measures to quantify information redundancy play an essential role in evaluating innovations that operate on clinical narratives. This work is a quantitative examination of information redundancy in EHR notes. We present and evaluate two methods to measure redundancy: an information-theoretic approach and a lexicosyntactic and semantic model. Our first measure trains large Transformer-based language models using clinical text from a large openly available US-based ICU dataset and a large multi-site UK based Hospital. By comparing the information-theoretic efficient encoding of clinical text against open-domain corpora, we find that clinical text is ∼1.5× to ∼3× less efficient than open-domain corpora at conveying information. Our second measure, evaluates automated summarisation metrics Rouge and BERTScore to evaluate successive note pairs demonstrating lexicosyntactic and semantic redundancy, with averages from ∼43 to ∼65%.

Implementation of a Real-Time Medication Intake Monitoring Technology Intervention in Community Pharmacy Settings: A Mixed-Method Pilot Study

Innovative dispensing products offering real-time medication intake monitoring are being developed to address medication non-adherence. However, implementation of these interventions within the workflow of a community pharmacy is unknown. The purpose of this study was to explore factors affecting implementation of a real-time adherence-monitoring, multidose-dispensing system in community pharmacies. A mixed-method study was conducted with pharmacy staff, who packaged and dispensed medications in smart multidose packages and monitored real-time medication intake via web-portal. Pharmacy staff participated in semi-structured interviews. The Technology Acceptance Model, Theory of Planned Behaviour and Capability, Opportunity, Motivation, Behaviour Model informed the interview guide. Interview transcripts were analyzed thematically and findings were mapped back to the frameworks. The usability was assessed by the System Usability Scale (SUS). Three pharmacists and one pharmacy assistant with a mean of 19 years of practice were interviewed. Three themes and 12 subthemes were generated. Themes included: pharmacy workflow factors, integration factors, and pharmacist-perceived patient factors. The mean SUS was found to be 80.63. Products with real-time adherence monitoring capabilities are valued by pharmacists. A careful assessment of infrastructure—including pharmacy workload, manpower and financial resources—is imperative for successful implementation of such interventions in a community pharmacy setting.

Usability of electronic health record systems in UK EDs

BACKGROUND

The large volume of patients, rapid staff turnover and high work pressure mean that the usability of all systems within the ED is important. The transition to electronic health records (EHRs) has brought many benefits to emergency care but imposes a significant burden on staff to enter data. Poor usability has a direct consequence and opportunity cost in staff time and resources that could otherwise be employed in patient care. This research measures the usability of EHR systems in UK EDs using a validated assessment tool.

METHODS

This was a survey completed by members and fellows of the Royal College of Emergency Medicine conducted during summer 2019. The primary outcome was the System Usability Scale Score, which ranges from 0 (worst) to 100 (best). Scores were compared with an internationally recognised measure of acceptable usability of 68. Results were analysed by EHR system, country, healthcare organisation and physician grade. Only EHR systems with at least 20 responses were analysed.

RESULTS

There were 1663 responses from a total population of 8794 (19%) representing 192 healthcare organisations (mainly UK NHS), and 25 EHR systems. Fifteen EHR systems had at least 20 responses and were included in the analysis. No EHR system achieved a median usability score that met the industry standard of acceptable usability.The median usability score was 53 (IQR 35-68). Individual EHR systems' scores ranged from 35 (IQR 26-53) to 65 (IQR 44-80).

CONCLUSION

In this survey, no UK ED EHR system met the internationally validated standard of acceptable usability for information technology.