Unexpected increased mortality after implementation of a commercially sold computerized physician order entry system

Clinical decision support systems for maternity care: a systematic review and meta-analysis

Background

The use of Clinical Decision Support Systems (CDSS) is increasing throughout healthcare and may be able to improve safety and outcomes in maternity care, but maternity care has key differences to other disciplines that complicate the use of CDSS. We aimed to identify evaluated CDSS and synthesise evidence of their impact on maternity care.

Methods

We conducted a systematic review for articles published before 24th May 2024 that described i) CDSS that ii) investigated the impact of their use iii) in maternity settings. Medline, CINAHL, CENTRAL and HMIC were searched for articles relating to evaluations of CDSS in maternity settings, with forward- and backward-citation tracing conducted for included articles. Risk of bias was assessed using the Mixed Methods Assessment Tool, and CDSS were described according to the clinical problem, purpose, design, and technical environment. Quantitative results from articles reporting appropriate data were meta-analysed to estimate odds of a CDSS achieving its desired outcome using a multi-level random effects model, first by individual CDSS and then across all CDSS. PROSPERO ID: CRD42022348157.

Findings

We screened 12,039 papers and included 87 articles describing 47 unique CDSS. 24 articles (28%) described randomised controlled trials, 30 (34%) described non-randomised interventional studies, 10 (11%) described mixed methods studies, 10 (11%) described qualitative studies, 7 (8%) described quantitative descriptive studies, and 7 (8%) described economic evaluations. 49 (56%) were in High-Income Countries and 38 (44%) in Low- and Middle-Income countries, with no CDSS trialled in both income categories. Meta-analysis of 35 included studies found an odds ratio for improved outcomes of 1.69 (95% confidence interval 1.24-2.30). There was substantial variation in effects, aims, CDSS types, context, study designs, and outcomes.

Interpretation

Most CDSS evaluations showed improvements in outcomes, but there was heterogeneity in all aspects of design and evaluation of systems. CDSS are increasingly important in delivering healthcare, and Electronic Health Records and mHealth will increase their availability, but traditional epidemiological methods may be limited in guiding design and demonstrating effectiveness due to rapid CDSS development lifecycles and the complex systems in which they are embedded. Development methods that are attentive to context, such as Human Centred Design, will help to meet this need.

Funding

None.

Effect of electronic records on mortality among patients in hospital and primary healthcare settings: a systematic review and meta-analyses

Background

Electronic medical records or electronic health records, collectively called electronic records, have significantly transformed the healthcare system and service provision in our world. Despite a number of primary studies on the subject, reports are inconsistent and contradictory about the effects of electronic records on mortality. Therefore, this review examined the effect of electronic records on mortality.

Methods

The review followed the Preferred Reporting Items for Systematic Reviews and Meta-analyses 2020 guideline. Six databases: PubMed, EMBASE, Scopus, CINAHL, Cochrane Library, and Google Scholar, were searched from February 20 to October 25, 2023. Studies that assessed the effect of electronic records on mortality and were published between 1998 and 2022 were included. Joanna Briggs Institute quality appraisal tool was used to assess the methodological quality of the studies. Narrative synthesis was performed to identify patterns across studies. Meta-analysis was conducted using fixed effect and random-effects models to estimate the pooled effect of electronic records on mortality. Funnel plot and Egger's regression test were used to assess for publication bias.

Results

Fifty-four papers were found eligible for the systematic review, of which 42 were included in the meta-analyses. Of the 32 studies that assessed the effect of electronic health record on mortality, eight (25.00%) reported a statistically significant reduction in mortality, 22 (68.75%) did not show a statistically significant difference, and two (6.25%) studies reported an increased risk of mortality. Similarly, among the 22 studies that determined the effect of electronic medical record on mortality, 12 (54.55%) reported a statistically significant reduction in mortality, and ten (45.45%) studies didn't show a statistically significant difference. The fixed effect and random effects on mortality were OR = 0.95 (95% CI: 0.93-0.97) and OR = 0.94 (95% CI: 0.89-0.99), respectively. The associated I-squared was 61.5%. Statistical tests indicated that there was no significant publication bias among the studies included in the meta-analysis.

Conclusion

Despite some heterogeneity among the studies, the review indicated that the implementation of electronic records in inpatient, specialized and intensive care units, and primary healthcare facilities seems to result in a statistically significant reduction in mortality. Maturity level and specific features may have played important roles.

Systematic Review Registration

PROSPERO (CRD42023437257).

The Bibliometric and Visualized Analysis of Research for Hospital Medication Management Based on the Web of Science Database

Objective

Identify the collaborations between authors, countries, and institutions, respectively, and explore the hot issues and prospects for research on hospital medication management.

Materials and Methods

Publications on hospital medication management were retrieved from the Web of Science Core Collection. Bibliometric analyses were performed using CiteSpace 6.1.R3, HistCite 2.1, and VOSviewer 1.6.16. The network maps were created between authors, countries institutions, and keywords.

Results

A total of 18,723 articles related to hospital medication management studies were identified. Rapid growth in the number of publications since 2017. The high papers were published in AM J HEALTH-SYST PH, while JAMA-J AM MED ASSOC was the most co-cited journal. Manias E and WHO ranked first in the author and cited author. There were active collaborations among the top authors. Bates DW was the key author in this field. The authors have active collaborations in adverse drug events, acute coronary syndrome, in-hospital major bleeding, and so on. The US was the leading contributor in this field. The UK, Australia, and China are also very active. Active cooperation between countries and between institutions was observed. The main hot topics included matters related to outcome indicators, hospital pharmacy service behaviors, and medication use in pain management. More recent keywords focus on chronic disease medication management and clinical medication management.

Conclusion

Hospital medication management studies have significantly increased after 2017. There was active cooperation between authors, countries, and institutions. The application of hospital medication management in the emergency department and the relationship between medication management and medication adherence are current research hotspots. In addition, with the continuous progress of society, chronic diseases have become an important factor affecting people's health, and medication management is becoming more and more subdivided, so the direction of chronic disease medication management as well as precise medication may become the development direction of future research.

Retrospective analysis of the human-centered design process used to develop a clinical decision support in the emergency department: PE Dx Study Part 2

With the growing implementation and use of health IT such as Clinical Decision Support (CDS), there is increasing attention on the potential negative impact of these technologies on patients (e.g., medication errors) and clinicians (e.g., increased workload, decreased job satisfaction, burnout). Human-Centered Design (HCD) and Human Factors (HF) principles are recommended to improve the usability of health IT and reduce its negative impact on patients and clinicians; however, challenges persist. The objective of this study is to understand how an HCD process influences the usability of health IT. We conducted a systematic retrospective analysis of the HCD process used in the design of a CDS for pulmonary embolism diagnosis in the emergency department (ED). Guided by the usability outcomes (e.g., barriers and facilitators) of the CDS use "in the wild" (see Part 1 of this research in the accompanying manuscript), we performed deductive content analysis of 17 documents (e.g., design session transcripts) produced during the HCD process. We describe if and how the design team considered the barriers and facilitators during the HCD process. We identified 7 design outcomes of the HCD process, for instance designing a workaround and making a design change to the CDS. We identify gaps in the current HCD process and demonstrate the need for a continuous health IT design process.

Clinical relevance of potential self-medication drug interactions in antineoplastic and immune-modulating therapy among online pharmacy customers

Background

Modern oral antineoplastic and immune-modulating drugs offer an array of therapeutic advantages, and yet pose challenges in daily use for patients, physicians and pharmacists. In contrast to intravenous administration, these drugs are not subject to direct medical control. Recently, we have seen a huge rise in sales of non-prescription over-the-counter (OTC) medicines via the internet without any advice from a healthcare professional.

Objectives

The aim of this study was to investigate whether the risk of known potential drug-drug interactions between modern oral antineoplastic and immune-modulating drugs and OTC drugs differs between sales in traditional community pharmacies versus online pharmacies.

Design

Real-life sales data from community and online pharmacies were used as basis for the analysis.

Methods

We determined the most frequently purchased antineoplastic and immune-modulating drug-substances in 14 local community pharmacies within the Munich area, Germany and identified the OTC substance groups that could potentially cause interactions with oncological therapies. Using sales data from 11 local community pharmacies and three online pharmacies, we investigated whether OTC purchases differed between the two sales channels.

Results

We identified 10 relevant OTC substance classes and detected significant variations in patients' preferred sales channels between the drug classes. Certain OTC drugs, which seem to be bought more often over the internet, pose risks during antineoplastic and immune-modulating therapy.

Conclusion

Patients should therefore be proactively made aware of the corresponding risks in order not to jeopardize the activity of the antineoplastic and immune-modulating drugs and thus the success of their therapy.

Guidelines on human factors in critical situations 2023

OBJECTIVE

To provide guidelines to define the place of human factors in the management of critical situations in anaesthesia and critical care.

DESIGN

A committee of nineteen experts from the SFAR and GFHS learned societies was set up. A policy of declaration of links of interest was applied and respected throughout the guideline-producing process. Likewise, the committee did not benefit from any funding from a company marketing a health product (drug or medical device). The committee followed the GRADE® method (Grading of Recommendations Assessment, Development and Evaluation) to assess the quality of the evidence on which the recommendations were based.

METHODS

We aimed to formulate recommendations according to the GRADE® methodology for four different fields: 1/ communication, 2/ organisation, 3/ working environment and 4/ training. Each question was formulated according to the PICO format (Patients, Intervention, Comparison, Outcome). The literature review and recommendations were formulated according to the GRADE® methodology.

RESULTS

The experts' synthesis work and application of the GRADE® method resulted in 21 recommendations. Since the GRADE® method could not be applied in its entirety to all the questions, the guidelines used the SFAR "Recommendations for Professional Practice" A means of secured communication (RPP) format and the recommendations were formulated as expert opinions.

CONCLUSION

Based on strong agreement between experts, we were able to produce 21 recommendations to guide human factors in critical situations.

Association between Electronic Health Record Implementations and Hospital-Acquired Conditions in Pediatric Hospitals

BACKGROUND

Implementing an electronic health record (EHR) is one of the most disruptive operational tasks a health system can undergo. Despite anecdotal reports of adverse events around the time of EHR implementations, there is limited corroborating research, particularly in pediatrics. We utilized data from Solutions for Patient Safety (SPS), a network of 145+ children's hospitals that share data and protocols to reduce harm in pediatric care delivery, to study the impact of EHR implementations on patient safety.

OBJECTIVE

Determine if there is an association between the time immediately surrounding an EHR implementation and hospital-acquired conditions (HACs) rates in pediatrics.

METHODS

A survey of information technology leaders at pediatric institutions identified EHR implementations occurring between 2012 and 2022. This list was cross-referenced with the SPS database to create an anonymized dataset of 27 sites comprising monthly HAC and care bundle compliance rates in the 7 months preceding and succeeding the transition. Six HACs were analyzed: central-line associated bloodstream infection (CLABSI), catheter-associated urinary tract infection (CAUTI), adverse drug events, surgical site infections (SSIs), pressure injuries (PIs), and falls, in addition to four associated care bundle compliance rates: CLABSI and CAUTI maintenance bundles, SSI bundle, and PI bundle. To determine if there was a statistically significant association with EHR implementation, the observation period was divided into three eras: "before" (months -7 to -3), "during" (months -2 to +2), and "after" go-live (months +3 to +7). Average monthly HAC and bundle compliance rates were calculated across eras. Paired t-tests were performed to compare rates between the eras.

RESULTS

No statistically significant increase in HAC rates or decrease in bundle compliance rates was observed across the EHR implementation eras.

CONCLUSION

This multisite study detected no significant increase in HACs and no decrease in preventive care bundle compliance in the months surrounding an EHR implementation.

Leveraging real-world data to improve cochlear implant outcomes: Is the data available?

OBJECTIVES

A small but persistent proportion of individuals do not gain the expected benefit from cochlear implants(CI). A step-change in the understanding of factors affecting outcomes could come through data science. This study evaluates clinical data capture to assess the quality and utility of CI user's health records for data science, by assessing the recording of otitis media. Otitis media was selected as it is associated with the development of sensorineural hearing loss and may affect cochlear implant outcomes.

METHODS

A retrospective service improvement project evaluating the medical records of 594 people with a CI under the care of the University of Southampton Auditory Implant Service between 2014 and 2020.

RESULTS

The clinical records are suitable for data science research. Of the cohort studied 20% of Adults and more than 40% of the paediatric cases have a history of middle ear inflammation.

DISCUSSION

Data science has potential to improve cochlear implant outcomes and improve understanding of the mechanisms underlying poor performance, through retrospective secondary analysis of real-world data.

CONCLUSION

Implant centres and the British Cochlear Implant Group National Hearing Implant Registry are urged to consider the importance of consistently and accurate recording of patient data over time for each CI user. Data where links to hearing loss have been identified, such as middle ear inflammation, may be particularly valuable in future analyses and to inform clinical trials.

Reducing Medication Errors in Children's Hospitals

OBJECTIVES

Knowledge of the prevalence and characteristics of medication errors in pediatric and neonatal patients is limited. This study aimed to evaluate the incidence and medication error characteristics in a pediatric hospital over 5 years and to determine whether serial error prevention programs to optimize a computerized physician order entry (CPOE) system reduce error incidence.

METHODS

We retrospectively reviewed medication errors documented between January 2015 and December 2019.

RESULTS

A total of 2,591,596 prescriptions were checked, and 255 errors were identified. Wrong dose prescriptions constituted the most common errors (56.9%). Medications with the highest rate of errors were antibiotics/antiviral drugs (36.9%). Oral route medications comprised the highest portion (60.8%), followed by intravenous ones (28.6%). The most common stage for medication errors was physician ordering (93.3%). Junior residents were responsible for most errors (45.9%). Most errors occurred in the pediatric ward (53.7%). In total, 221 (86.7%) errors were near misses. Only 4 errors (1.6%) were considered significant and required active monitoring or intervention. Type of error, stage of error, staff composition, and severity level of errors were significantly related to the number of errors in different years. There was a statistically significant decrease in errors per 100,000 prescriptions across different years after optimizing the CPOE system.

CONCLUSIONS

The incidence of medication errors decreased with extensive use of the CPOE system. Continuous application of the CPOE optimization program can effectively reduce medication errors. Further incorporation of pediatric-specific decision-making and support tools and error prevention measures into CPOE systems is needed.

Computer clinical decision support that automates personalized clinical care: a challenging but needed healthcare delivery strategy

How to deliver best care in various clinical settings remains a vexing problem. All pertinent healthcare-related questions have not, cannot, and will not be addressable with costly time- and resource-consuming controlled clinical trials. At present, evidence-based guidelines can address only a small fraction of the types of care that clinicians deliver. Furthermore, underserved areas rarely can access state-of-the-art evidence-based guidelines in real-time, and often lack the wherewithal to implement advanced guidelines. Care providers in such settings frequently do not have sufficient training to undertake advanced guideline implementation. Nevertheless, in advanced modern healthcare delivery environments, use of eActions (validated clinical decision support systems) could help overcome the cognitive limitations of overburdened clinicians. Widespread use of eActions will require surmounting current healthcare technical and cultural barriers and installing clinical evidence/data curation systems. The authors expect that increased numbers of evidence-based guidelines will result from future comparative effectiveness clinical research carried out during routine healthcare delivery within learning healthcare systems.

Evidence synthesis, digital scribes, and translational challenges for artificial intelligence in healthcare

Healthcare has well-known challenges with safety, quality, and effectiveness, and many see artificial intelligence (AI) as essential to any solution. Emerging applications include the automated synthesis of best-practice research evidence including systematic reviews, which would ultimately see all clinical trial data published in a computational form for immediate synthesis. Digital scribes embed themselves in the process of care to detect, record, and summarize events and conversations for the electronic record. However, three persistent translational challenges must be addressed before AI is widely deployed. First, little effort is spent replicating AI trials, exposing patients to risks of methodological error and biases. Next, there is little reporting of patient harms from trials. Finally, AI built using machine learning may perform less effectively in different clinical settings.

Empowerment for the Digital Transformation: Results of a Structured Blended-Learning On-the-Job Training for Practicing Physicians in Germany

(1) Background: Practicing physicians have not been in the focus of structured qualifications in basic digital competences so far. However, they are the current gatekeepers to implement digital technologies and need empowerment to proactively take part in the ongoing digital transformation process. The present study investigates if a structured blended-learning training for practicing physicians in Germany enhances both physicians' knowledge about central aspects of the digital transformation (including awareness of personal possibilities to act) and their attitudes towards a more digitally empowered mindset. (2) Methods: Participants (n = 32) self-assessed their knowledge (19 items, 10-point Likert-scale) and attitudes (6 items, 5-point Likert-scale) towards the digital transformation at the beginning and at the end of the training. MANCOVAs were conducted. (3) Results: Participants reported an increase in every knowledge domain, representing large effects (Hedges' g 1.06 to 2.82). Attitudes were partly shifted towards a more empowered mindset with decreased insecurity towards technological, legal, and ethical aspects of the digital transformation (Hedges' g -0.82 to -1.40). However, preparedness for the digital transformation remained low. (4) Conclusions: Generally, the hypotheses were confirmed. The presented on-the-job training had the desired effects on practicing physicians' knowledge and attitudes. Nevertheless, additional empowerment and support are essential.

The Reduction in Medical Errors on Implementing an Intensive Care Information System in a Setting Where a Hospital Electronic Medical Record System is Already in Use: Retrospective Analysis

Background

Although the various advantages of clinical information systems in intensive care units (ICUs), such as intensive care information systems (ICISs), have been reported, their role in preventing medical errors remains unclear.

Objective

This study aimed to investigate the changes in the incidence and type of errors in the ICU before and after ICIS implementation in a setting where a hospital electronic medical record system is already in use.

Methods

An ICIS was introduced to the general ICU of a university hospital. After a step-by-step implementation lasting 3 months, the ICIS was used for all patients starting from April 2019. We performed a retrospective analysis of the errors in the ICU during the 6-month period before and after ICIS implementation by using data from an incident reporting system, and the number, incidence rate, type, and patient outcome level of errors were determined.

Results

From April 2018 to September 2018, 755 patients were admitted to the ICU, and 719 patients were admitted from April 2019 to September 2019. The number of errors was 153 in the 2018 study period and 71 in the 2019 study period. The error incidence rates in 2018 and 2019 were 54.1 (95% CI 45.9-63.4) and 27.3 (95% CI 21.3-34.4) events per 1000 patient-days, respectively (P<.001). During both periods, there were no significant changes in the composition of the types of errors (P=.16), and the most common type of error was medication error.

Conclusions

ICIS implementation was temporally associated with a 50% reduction in the number and incidence rate of errors in the ICU. Although the most common type of error was medication error in both study periods, ICIS implementation significantly reduced the number and incidence rate of medication errors.

Trial Registration

University Hospital Medical Information Network Clinical Trials Registry UMIN000041471; https://center6.umin.ac.jp/cgi-open-bin/ctr_e/ctr_view.cgi?recptno=R000047345

Development and validation of outcome prediction models for acute kidney injury patients undergoing continuous renal replacement therapy

Object

This study aimed to develop and validate a set of practical predictive tools that reliably estimate the 28-day prognosis of acute kidney injury patients undergoing continuous renal replacement therapy.

Methods

The clinical data of acute kidney injury patients undergoing continuous renal replacement therapy were extracted from the Medical Information Mart for Intensive Care IV database with structured query language and used as the development cohort. An all-subset regression was used for the model screening. Predictive models were constructed via a logistic regression, and external validation of the models was performed using independent external data.

Results

Clinical prediction models were developed with clinical data from 1,148 patients and validated with data from 121 patients. The predictive model based on seven predictors (age, vasopressor use, red cell volume distribution width, lactate, white blood cell count, platelet count, and phosphate) exhibited good predictive performance, as indicated by a C-index of 0.812 in the development cohort, 0.811 in the internal validation cohort and 0.768 in the external validation cohort.

Conclusions

The model reliably predicted the 28-day prognosis of acute kidney injury patients undergoing continuous renal replacement therapy. The predictive items are readily available, and the web-based prognostic calculator (https://libo220284.shinyapps.io/DynNomapp/) can be used as an adjunctive tool to support the management of patients.

Applying requisite imagination to safeguard electronic health record transitions

Over the next decade, many health care organizations (HCOs) will transition from one electronic health record (EHR) to another; some forced by hospital acquisition and others by choice in search of better EHRs. Herein, we apply principles of Requisite Imagination, or the ability to imagine key aspects of the future one is planning, to offer 6 recommendations on how to proactively safeguard these transitions. First, HCOs should implement a proactive leadership structure that values communication. Second, HCOs should implement proactive risk assessment and testing processes. Third, HCOs should anticipate and reduce unwarranted variation in their EHR and clinical processes. Fourth, HCOs should establish a culture of conscious inquiry with routine system monitoring. Fifth, HCOs should foresee and reduce information access problems. Sixth, HCOs should support their workforce through difficult EHR transitions. Proactive approaches using Requisite Imagination principles outlined here can help ensure safe, effective, and economically sound EHR transitions.

Registered Nurses' and Medical Doctors' Experiences of Patient Safety in Health Information Exchange During Interorganizational Care Transitions: A Qualitative Review

OBJECTIVE

This systematic review aimed to identify, critically appraise, and synthesize the best available literature on registered nurses' and medical doctors' experiences of patient safety in health information exchange (HIE) during interorganizational care transitions.

METHODS

The review was conducted according to the JBI methodology for systematic reviews of qualitative evidence. A total of 5 multidisciplinary databases were searched from January 2010 to September 2020 to identify qualitative or mixed methods studies. The qualitative findings were pooled using JBI SUMARI with the meta-aggregation approach.

RESULTS

The final review included 6 original studies. The 53 distinct findings were aggregated into 9 categories, which were further merged into 3 synthesized findings: (1) HIE efficiency and accuracy support patient safety during interorganizational care transitions; (2) inaccuracies in content and structure, along with poor HIE usability, jeopardize patient safety during interorganizational care transitions; and (3) health care professionals' (HCP) actions in HIE are associated with patient safety during interorganizational care transitions.

CONCLUSIONS

The results of this review identified several advantages of HIE, namely, improvements in patient safety based on reduced human error. Nevertheless, a lack of usability and functionality can amplify the effects of human error and increase the risk of adverse events. In addition, HCPs' individual actions in HIE were found to influence patient safety. Hence, the cognitive and sociotechnical perspectives of work related to HIE should be studied. In addition, HCPs' experiences of each stage of HIE deployment should be clarified to ensure a high standard of patient safety. Registration: PROSPERO CRD42020220631, registered on November 13, 2020.

Quality and Safety Outcomes of a Hospital Merger Following a Full Integration at a Safety Net Hospital

IMPORTANCE

Hospital consolidations have been shown not to improve quality on average.

OBJECTIVE

To assess a full-integration approach to hospital mergers based on quality metrics in a safety net hospital acquired by an urban academic health system.

DESIGN, SETTING, AND PARTICIPANTS

This quality improvement study analyzed outcomes for all nonpsychiatric, nonrehabilitation, non-newborn patients discharged between September 1, 2010, and August 31, 2019, at a US safety net hospital that was acquired by an urban academic health system in January 2016. Interrupted time series and statistical process control analyses were used to assess the main outcomes and measures. Data sources included the hospital's electronic health record, Centers for Medicare & Medicaid Services Hospital Compare, and nursing quality reports.

EXPOSURES

A full-integration approach to the merger that included: (1) early administrative and clinical leadership integration with the academic health system; (2) rapid transition to the academic health system electronic health record; (3) local ownership of quality metrics; (4) system-level goals with real-time actionable analytics through combined dashboards; and (5) implementation of value-based and other analytic-driven interventions.

MAIN OUTCOMES AND MEASURES

The primary outcome was in-hospital mortality. Secondary outcomes included 30-day readmission, patient experience, and hospital-acquired conditions.

RESULTS

The 122 348 patients in the premerger (September 2010 through August 2016) and the 58 904 patients in the postmerger (September 2016 through August 2019) periods had a mean (SD) age of 55.5 (22.0) years; the total sample of 181 252 patients included 112 191 women (61.9%), the payor mix was majority governmental (144 375 patients [79.7%]), and most admissions were emergent (121 469 patients [67.0%]). There was a 0.71% (95% CI, 0.57%-0.86%) absolute (27% relative) reduction in the crude mortality rate and 0.95% (95% CI, 0.83%-1.12%) absolute (33% relative) in the adjusted rate by the end of the 3-year intervention period. There was no significant improvement in readmission rates after accounting for baseline trends. There were fewer central line infections per 1000 catheter days, fewer catheter-associated urinary tract infections per 1000 discharges, and a higher likelihood of patients recommending the hospital or ranking it 9 or 10.

CONCLUSIONS AND RELEVANCE

In this quality improvement study, a hospital merger with a full-integration approach to consolidation was found to be associated with improvement in quality outcomes.

Description of a clinical decision support tool with integrated dose calculator for paediatrics

Medication errors, especially dosing errors are a leading cause of preventable harm in paediatric patients. The paediatric patient population is particularly vulnerable to dosing errors due to immaturity of metabolising organs and developmental changes. Moreover, the lack of clinical trial data or suitable drug forms, and the need for weight-based dosing, does not simplify drug dosing in paediatric or neonatal patients. Consequently, paediatric pharmacotherapy often requires unlicensed and off-label use including manipulation of adult dosage forms. In practice, this results in the need to calculate individual dosages which in turn increases the likelihood of dosing errors. In the age of digitalisation, clinical decision support (CDS) tools can support healthcare professionals in their daily work. CDS tools are currently amongst the gold standards in reducing preventable errors. In this publication, we describe the development and core functionalities of the CDS tool PEDeDose, a Class IIa medical device software certified according to the European Medical Device Regulation. The CDS tool provides a drug dosing formulary with an integrated calculator to determine individual dosages for paediatric, neonatal, and preterm patients. Even a technical interface is part of the CDS tool to facilitate integration into primary systems. This enables the support of the paediatrician directly during the prescribing process without changing the user interface.Conclusion: PEDeDose is a state-of-the-art CDS tool for individualised paediatric drug dosing that includes a certified calculator. What is Known: • Dosing errors are the most common type of medication errors in paediatric patients. • Clinical decision support tools can reduce medication errors effectively. Integration into the practitioner's workflow improves usability and user acceptance. What is New: • A clinical decision support tool with a certified integrated dosing calculator for paediatric drug dosing. • The tool was designed to facilitate integration into clinical information systems to directly support the prescribing process. Any clinical information system available can interoperate with the PEDeDose web service.

Association of time of first corticosteroid treatment with bronchopulmonary dysplasia in preterm infants

OBJECTIVE

To evaluate the association between the time of first systemic corticosteroid initiation and bronchopulmonary dysplasia (BPD) in preterm infants.

STUDY DESIGN

A multi-center retrospective cohort study from January 2010 to December 2016 using the Children's Hospitals Neonatal Database and Pediatric Health Information System database was conducted. The study population included preterm infants <32 weeks' gestation treated with systemic corticosteroids after 7 days of age and before 34 weeks' postmenstrual age. Stepwise multivariable logistic regression was used to assess the association between timing of corticosteroid initiation and the development of Grade 2 or 3 BPD as defined by the 2019 Neonatal Research Network criteria.

RESULTS

We identified 598 corticosteroid-treated infants (median gestational age 25 weeks, median birth weight 760 g). Of these, 47% (280 of 598) were first treated at 8-21 days, 25% (148 of 598) were first treated at 22-35 days, 14% (86 of 598) were first treated at 36-49 days, and 14% (84 of 598) were first treated at >50 days. Infants first treated at 36-49 days (aOR 2.0, 95% CI 1.1-3.7) and >50 days (aOR 1.9, 95% CI 1.04-3.3) had higher independent odds of developing Grade 2 or 3 BPD when compared to infants treated at 8-21 days after adjusting for birth characteristics, admission characteristics, center, and co-morbidities.

CONCLUSIONS

Among preterm infants treated with systemic corticosteroids in routine clinical practice, later initiation of treatment was associated with a higher likelihood to develop Grade 2 or 3 BPD when compared to earlier treatment.

Replication studies in the clinical decision support literature-frequency, fidelity, and impact

OBJECTIVE

To assess the frequency, fidelity, and impact of replication studies in the clinical decision support system (CDSS) literature.

MATERIALS AND METHODS

A PRISMA-compliant review identified CDSS replications across 28 health and biomedical informatics journals. Included articles were assessed for fidelity to the original study using 5 categories: Identical, Substitutable, In-class, Augmented, and Out-of-class; and 7 IMPISCO domains: Investigators (I), Method (M), Population (P), Intervention (I), Setting (S), Comparator (C), and Outcome (O). A fidelity score and heat map were generated using the ratings.

RESULTS

From 4063 publications matching search criteria for CDSS research, only 12/4063 (0.3%) were ultimately identified as replications. Six articles replicated but could not reproduce the results of the Han et al (2005) CPOE study showing mortality increase and, over time, changed from truth testing to generalizing this result. Other replications successfully tested variants of CDSS technology (2/12) or validated measurement instruments (4/12).

DISCUSSION

A replication rate of 3 in a thousand studies is low even by the low rates in other disciplines. Several new reporting methods were developed for this study, including the IMPISCO framework, fidelity scores, and fidelity heat maps. A reporting structure for clearly identifying replication research is also proposed.

CONCLUSION

There is an urgent need to better characterize which core CDSS principles require replication, identify past replication data, and conduct missing replication studies. Attention to replication should improve the efficiency and effectiveness of CDSS research and avoiding potentially harmful trial and error technology deployment.

Persisting workarounds in Electronic Health Record System use: types, risks and benefits

Background

Electronic Health Records (EHRs) are now widely used to create a single, shared, and reliable source of patient data throughout healthcare organizations. However, health professionals continue to experience mismatches between their working practices and what the EHR allows or directs them to do. Health professionals adopt working practices other than those imposed by the EHR to overcome such mismatches, known as workarounds. Our study aims to inductively develop a typology of enduring EHR workarounds and explore their consequences by answering the question: What types of EHR workarounds persist, and what are the user-perceived consequences?

Methods

This single case study was conducted within the Internal Medicine department of a Dutch hospital that had implemented an organization-wide, commercial EHR system over two years ago. Data were collected through observations of six EHR users (see Additional file 1, observation scheme) and 17 semi-structured interviews with physicians, nurses, administrators, and EHR support staff members. Documents were analysed to contextualize these data (see Additional file 2, interview protocol).

Results

Through a qualitative analysis, 11 workarounds were identified, predominantly performed by physicians. These workarounds are categorized into three types either performed while working with the system (in-system workflow sequence workarounds and in-system data entry workarounds) or bypassing the system (out-system workarounds). While these workarounds seem to offer short-term benefits for the performer, they often create threats for the user, the patient, the overall healthcare organization, and the system.

Conclusion

This study increases our understanding of the enduring phenomenon of working around Electronic Health Records by presenting a typology of those workarounds that persist after adoption and by reflecting on the user-perceived risks and benefits. The typology helps EHR users and their managers to identify enduring types of workarounds and differentiate between the harmful and less harmful ones. This distinction can inform their decisions to discourage or obviate the need for certain workarounds, while legitimating others.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12911-021-01548-0.

Technostress Among Health Professionals - A Multilevel Model and Group Comparisons between Settings and Professions

OBJECTIVE

Health organizations increasingly digitize. However, studies reveal contradictory findings regarding the impact of healthcare information technology on health professionals. Therefore, the aim of this study is to describe the prevalence of technostress among health professionals and elaborate on the influencing factors.

PARTICIPANTS

A secondary analysis was conducted utilizing cross-sectional data from the study, "Work-related stress among health professionals in Switzerland", which included 8,112 health professionals from 163 health organizations in Switzerland.

METHODS

ANOVA for group comparisons followed by post-hoc analyses, along with a Multilevel Model to identify influencing factors for technostress ranging from "0" (never/almost never) to "100" (always), were conducted.

RESULTS

Health professionals experienced moderate technostress (mean 39.06, SD 32.54). Technostress differed between settings (p <.001) and health professions (p < .001). The model explains 18.1% of the variance with fixed effects, or 24.7% of the variance with fixed and random effects. Being a physician (β = 12.96), a nurse (β = 6.49), or the presence of an effort-reward-imbalance, increased technostress most (β = 6.11). A professional with no professional qualification (β = -7.94) showed the most reduction.

CONCLUSION

Health professionals experience moderate technostress. However, decision-makers should consider the cognitive and social aspects surrounding digitalization, to reach a beneficial and sustainable level of usage.

Using a Semi-Structured Qualitative Interview to Evaluate Pediatric Interns' Use of the Electronic Medical Record in a Simulated Setting

Introduction

Effective use of electronic medical record (EMR) is paramount to delivering safe and effective care. Current EMR education is inadequate, with literature showing frequent deficiencies in skills needed to obtain and interpret data. This study aims to evaluate pediatric interns' perception of EMR inclusion in scenario-based simulation training.

Methods

A total of 13 pediatric interns participated in an EMR-enhanced, multidisciplinary simulation of a pediatric patient with septic shock during the 2019-2020 academic year. Following the simulation, the interns participated in a semi-structured interview to evaluate the experience of having the EMR incorporated into the simulation and what benefits it offers.

Results

Of the 13 interns, 12 (92%) felt that incorporating the EMR into the simulation increased the realism of the scenario. All (100%) interns reported that EMR inclusion led to increased learning about the EMR, including gaining or re-learning skills needed to access or interpret electronic clinical data. Participants felt that EMR inclusion in the simulation provided valuable learning opportunities not present in traditional EMR education.

Conclusions

Integrating the EMR into simulation is viewed positively by pediatric interns, is perceived to improve simulation realism, and helps teach important EMR skills. EMR training would benefit from incorporation into scenario-based simulations.

Improving Clinician Decisions and Communication in Critical Care Using Novel Information Technology

INTRODUCTION

The electronic medical record (EMR) is presumed to support clinician decisions by documenting and retrieving patient information. Research shows that the EMR variably affects patient care and clinical decision making. The way information is presented likely has a significant impact on this variability. Well-designed representations of salient information can make a task easier by integrating information in useful patterns that clinicians use to make improved clinical judgments and decisions. Using Cognitive Systems Engineering methods, our research team developed a novel health information technology (NHIT) that interfaces with the EMR to display salient clinical information and enabled communication with a dedicated text-messaging feature. The software allows clinicians to customize displays according to their role and information needs. Here we present results of usability and validation assessments of the NHIT.

MATERIALS AND METHODS

Our subjects were physicians, nurses, respiratory therapists, and physician trainees. Two arms of this study were conducted, a usability assessment and then a validation assessment. The usability assessment was a computer-based simulation using deceased patient data. After a brief five-minute orientation, the usability assessment measured individual clinician performance of typical tasks in two clinical scenarios using the NHIT. The clinical scenarios included patient admission to the unit and patient readiness for surgery. We evaluated clinician perspective about the NHIT after completing tasks using 7-point Likert scale surveys. In the usability assessment, the primary outcome was participant perceptions about the system's ease of use compared to the legacy system.A subsequent cross-over, validation assessment compared performance of two clinical teams during simulated care scenarios: one using only the legacy IT system and one using the NHIT in addition to the legacy IT system. We oriented both teams to the NHIT during a 1-hour session on the night before the first scenario. Scenarios were conducted using high-fidelity simulation in a real burn intensive care unit room. We used observations, task completion times, semi-structured interviews, and surveys to compare user decisions and perceptions about their performance. The primary outcome for the validation assessment was time to reach accurate (correct) decision points.

RESULTS

During the usability assessment, clinicians were able to complete all tasks requested. Clinicians reported the NHIT was easier to use and the novel information display allowed for easier data interpretation compared to subject recollection of the legacy EMR.In the validation assessment, a more junior team of clinicians using the NHIT arrived at accurate diagnoses and decision points at similar times as a more experienced team. Both teams noted improved communication between team members when using the NHIT and overall rated the NHIT as easier to use than the legacy EMR, especially with respect to finding information.

CONCLUSIONS

The primary findings of these assessments are that clinicians found the NHIT easy to use despite minimal training and experience and that it did not degrade clinician efficiency or decision-making accuracy. These findings are in contrast to common user experiences when introduced to new EMRs in clinical practice.

Usability of electronic health record systems in UK EDs

BACKGROUND

The large volume of patients, rapid staff turnover and high work pressure mean that the usability of all systems within the ED is important. The transition to electronic health records (EHRs) has brought many benefits to emergency care but imposes a significant burden on staff to enter data. Poor usability has a direct consequence and opportunity cost in staff time and resources that could otherwise be employed in patient care. This research measures the usability of EHR systems in UK EDs using a validated assessment tool.

METHODS

This was a survey completed by members and fellows of the Royal College of Emergency Medicine conducted during summer 2019. The primary outcome was the System Usability Scale Score, which ranges from 0 (worst) to 100 (best). Scores were compared with an internationally recognised measure of acceptable usability of 68. Results were analysed by EHR system, country, healthcare organisation and physician grade. Only EHR systems with at least 20 responses were analysed.

RESULTS

There were 1663 responses from a total population of 8794 (19%) representing 192 healthcare organisations (mainly UK NHS), and 25 EHR systems. Fifteen EHR systems had at least 20 responses and were included in the analysis. No EHR system achieved a median usability score that met the industry standard of acceptable usability.The median usability score was 53 (IQR 35-68). Individual EHR systems' scores ranged from 35 (IQR 26-53) to 65 (IQR 44-80).

CONCLUSION

In this survey, no UK ED EHR system met the internationally validated standard of acceptable usability for information technology.

Medication safety alert fatigue may be reduced via interaction design and clinical role tailoring: a systematic review

OBJECTIVE

Alert fatigue limits the effectiveness of medication safety alerts, a type of computerized clinical decision support (CDS). Researchers have suggested alternative interactive designs, as well as tailoring alerts to clinical roles. As examples, alerts may be tiered to convey risk, and certain alerts may be sent to pharmacists. We aimed to evaluate which variants elicit less alert fatigue.

MATERIALS AND METHODS

We searched for articles published between 2007 and 2017 using the PubMed, Embase, CINAHL, and Cochrane databases. We included articles documenting peer-reviewed empirical research that described the interactive design of a CDS system, to which clinical role it was presented, and how often prescribers accepted the resultant advice. Next, we compared the acceptance rates of conventional CDS-presenting prescribers with interruptive modal dialogs (ie, "pop-ups")-with alternative designs, such as role-tailored alerts.

RESULTS

Of 1011 articles returned by the search, we included 39. We found different methods for measuring acceptance rates; these produced incomparable results. The most common type of CDS-in which modals interrupted prescribers-was accepted the least often. Tiering by risk, providing shortcuts for common corrections, requiring a reason to override, and tailoring CDS to match the roles of pharmacists and prescribers were the most common alternatives. Only 1 alternative appeared to increase prescriber acceptance: role tailoring. Possible reasons include the importance of etiquette in delivering advice, the cognitive benefits of delegation, and the difficulties of computing "relevance."

CONCLUSIONS

Alert fatigue may be mitigated by redesigning the interactive behavior of CDS and tailoring CDS to clinical roles. Further research is needed to develop alternative designs, and to standardize measurement methods to enable meta-analyses.

The impact of health information technology on prescribing errors in hospitals: a systematic review and behaviour change technique analysis

BACKGROUND

Health information technology (HIT) is known to reduce prescribing errors but may also cause new types of technology-generated errors (TGE) related to data entry, duplicate prescribing, and prescriber alert fatigue. It is unclear which component behaviour change techniques (BCTs) contribute to the effectiveness of prescribing HIT implementations and optimisation. This study aimed to (i) quantitatively assess the HIT that reduces prescribing errors in hospitals and (ii) identify the BCTs associated with effective interventions.

METHODS

Articles were identified using CINAHL, EMBASE, MEDLINE, and Web of Science to May 2020. Eligible studies compared prescribing HIT with paper-order entry and examined prescribing error rates. Studies were excluded if prescribing error rates could not be extracted, if HIT use was non-compulsory or designed for one class of medication. The Newcastle-Ottawa scale was used to assess study quality. The review was reported in accordance with the PRISMA and SWiM guidelines. Odds ratios (OR) with 95% confidence intervals (CI) were calculated across the studies. Descriptive statistics were used to summarise effect estimates. Two researchers examined studies for BCTs using a validated taxonomy. Effectiveness ratios (ER) were used to determine the potential impact of individual BCTs.

RESULTS

Thirty-five studies of variable risk of bias and limited intervention reporting were included. TGE were identified in 31 studies. Compared with paper-order entry, prescribing HIT of varying sophistication was associated with decreased rates of prescribing errors (median OR 0.24, IQR 0.03-0.57). Ten BCTs were present in at least two successful interventions and may be effective components of prescribing HIT implementation and optimisation including prescriber involvement in system design, clinical colleagues as trainers, modification of HIT in response to feedback, direct observation of prescriber workflow, monitoring of electronic orders to detect errors, and system alerts that prompt the prescriber.

CONCLUSIONS

Prescribing HIT is associated with a reduction in prescribing errors in a variety of hospital settings. Poor reporting of intervention delivery and content limited the BCT analysis. More detailed reporting may have identified additional effective intervention components. Effective BCTs may be considered in the design and development of prescribing HIT and in the reporting and evaluation of future studies in this area.

Direct Observational Study of Interfaced Smart-Pumps in Pediatric Intensive Care

BACKGROUND

Processes for delivery of high-risk infusions in pediatric intensive care units (PICUs) are complex. Standard concentration infusions (SCIs), smart-pumps, and electronic prescribing are recommended medication error reduction strategies. Implementation rates in Europe lag behind those in the United States. Since 2012, the PICU of an Irish tertiary pediatric hospital has been using a smart-pump SCI library, interfaced with electronic infusion orders (Philips ICCA). The incidence of infusion errors is unknown.

OBJECTIVES

To determine the frequency, severity, and distribution of smart-pump infusion errors in PICUs.

METHODS

Programmed infusions were directly observed at the bedside. Parameters were compared against medication orders and autodocumented infusion data. Identified deviations were categorized as medication errors or discrepancies. Error rates (%) were calculated as infusions with errors and errors per opportunities for error (OEs). Predefined definitions, multidisciplinary consensus and grading processes were employed.

RESULTS

A total of 1,023 infusions for 175 patients were directly observed over 27 days between February and September 2017. The drug library accommodated 96.5% of infusions. Compliance with the drug library was 98.9%. A total of 133 infusions had ≥1 error (13.0%); a further 58 (5.7%) had ≥1 discrepancy. From a total of 4,997 OEs, 153 errors (3.1%) and 107 discrepancies (2.1%) were observed. Undocumented bolus doses were most commonly identified (n = 81); this was the only deviation in 36.1% (n = 69) of infusions. Programming errors were rare (0.32% OE). Errors were minor, with just one requiring minimal intervention to prevent harm.

CONCLUSION

The error rates identified are low compared with similar studies, highlighting the benefits of smart-pumps and autodocumented infusion data in PICUs. A range of quality improvement opportunities has been identified.

How Should Clinicians' Performance Be Assessed When Health Care Organizations Implement Behavioral Architecture That Generates Negative Consequences?

Behavioral interventions have been shown to have powerful effects on human behavior both outside of and within the context of health care. As organizations increasingly adopt behavioral architecture, care must be taken to consider its potential negative consequences. An evidenced-based approach is best, whereby interventions that might have a significant deleterious effect on patients' health outcomes are first tested and rigorously evaluated before being systematically rolled out. In the case of clinical decision support, brief and thorough instructions should be provided for use. Physician performance when using these systems is best measured relatively, in the context of peers with similar training. Responsibility for errors must be shared with clinical team members and system designers.

Rapid sequence induction traceability in an ICU dedicated patient data management system: a multicentric retrospective study

PURPOSE

Patient data management systems (PDMS) are widely used in intensive care units (ICUs) to improve care traceability. Verbal orders are still used for prescriptions requiring immediate execution but should be subsequently recorded in the system. We assessed the rapid sequence induction (RSI) traceability for endotracheal intubation in an ICU dedicated PDMS.

MATERIALS AND METHODS

A retrospective study was conducted on anonymous databases in 21 ICUs. Endotracheal tube insertions performed during one year were compared to the number of RSI registered in the PDMS.

RESULTS

We listed 5516 endotracheal tube insertions. A suxamethonium injection was registered in 829 cases and a rocuronium administration in 909 cases. The RSI traceability rate in the overall cohort was 31.5% and was greater in the units where nurses were allowed to record a drug administration before the computerized physician order entry.

CONCLUSIONS

PDMS are supposed to improve prescription completeness and traceability, but our study suggests an opposite result. A co-responsibility policy between physicians and nurses should be promoted to improve care traceability. PDMS ergonomic improvements and enhanced integration in clinical workflow might also result in better compliance with documentation requirements. In each centre, indicators of PDMS correct use should be defined and periodically monitored.

Prevalence of Medication Errors Among Paediatric Inpatients: Systematic Review and Meta-Analysis

INTRODUCTION

The risk of medication errors is high in paediatric inpatient settings. However, estimates of the prevalence of medication errors have not accounted for heterogeneity across studies in error identification methods and definitions, nor contextual differences across wards and the use of electronic or paper medication charts.

OBJECTIVE

Our aim was to conduct a systematic review and meta-analysis to provide separate estimates of the prevalence of medication errors among paediatric inpatients, depending on hospital ward and the use of electronic or paper medication charts, that address differences in error identification methods and definitions.

METHODS

We systematically searched five databases to identify studies published between January 2000 and December 2018 that assessed medication error rates by medication chart audit, direct observation or a combination of methods.

RESULTS

We identified 71 studies, 19 involved paediatric wards using electronic charts. Most studies assessed prescribing errors with few studies assessing administration errors. Estimates varied by ward type. Studies of paediatric wards using electronic charts generally reported a reduced error prevalence compared to those using paper, although there were some inconsistencies. Error detection methods impacted the rate of administration errors in studies of multiple wards, however, no other difference was found. Definition of medication error did not have a consistent impact on reported error rates.

CONCLUSIONS

Medication errors are a frequent occurrence in paediatric inpatient settings, particularly in intensive care wards and emergency departments. Hospitals using electronic charts tended to have a lower rate of medication errors compared to those using paper charts. Future research employing controlled designs is needed to determine the true impact of electronic charts and other interventions on medication errors and associated harm among hospitalized children.

Risk Factors for Electronic Prescription Errors in Pediatric Intensive Care Patients

OBJECTIVES

To assess risk factors for electronic prescription errors in a PICU.

DESIGN

A database of electronic prescriptions issued by a computerized physician order entry with clinical decision support system was analyzed to identify risk factors for prescription errors.

MEASUREMENTS AND MAIN RESULTS

Of 6,250 prescriptions, 101 were associated with errors (1.6%). The error rate was twice as high in patients older than 12 years than in patients children 6-12 and 0-6 years old (2.4% vs 1.3% and 1.2%, respectively, p < 0.05). Compared with patients without errors, patients with errors had a significantly higher score on the Pediatric Index of Mortality 2 (-3.7 vs -4.5; p = 0.05), longer PICU stay (6 vs 3.1 d; p < 0.0001), and higher number of prescriptions per patient (40.8 vs. 15.7; p < 0.0001). In addition, patients with errors were more likely to have a neurologic main admission diagnosis (p = 0.008) and less likely to have a cardiologic diagnosis (p = 0.03) than patients without errors.

CONCLUSIONS

Our findings suggest that older patient age and greater disease severity are risk factors for electronic prescription errors.

Effects of CPOE-based medication ordering on outcomes: an overview of systematic reviews

BACKGROUND

Computerised provider order entry (CPOE) systems are widely used in clinical settings for the electronic ordering of medications, laboratory tests and radiological therapies. However, evidence regarding effects of CPOE-based medication ordering on clinical and safety outcomes is mixed. We conducted an overview of systematic reviews (SRs) to characterise the cumulative effects of CPOE use for medication ordering in clinical settings.

METHODS

MEDLINE, EMBASE, CINAHL and the Cochrane Library were searched to identify published SRs from inception to 12 February 2018. SRs investigating the effects of the use of CPOE for medication ordering were included. Two reviewers independently extracted data and assessed the methodological quality of included SRs.

RESULTS

Seven SRs covering 118 primary studies were included for review. Pooled studies from the SRs in inpatient settings showed that CPOE use resulted in statistically significant decreases in medication errors and adverse drug events (ADEs); however, there was considerable variation in the magnitude of their relative risk reduction (54%-92% for errors, 35%-53% for ADEs). There was no significant relative risk reduction on hospital mortality or length of stay. Bibliographic analysis showed limited overlap (24%) among studies included across all SRs.

CONCLUSION

SRs on CPOEs included predominantly non-randomised controlled trials and observational studies with varying foci. SRs predominantly focused on inpatient settings and often lacked comparison groups; SRs used inconsistent definitions of outcomes, lacked descriptions regarding the effects on patient harm and did not differentiate among the levels of available decision support. With five of the seven SRs having low to moderate quality, findings from the SRs must be interpreted with caution. We discuss potential directions for future primary studies and SRs of CPOE.

The influence of peer beliefs on nurses' use of new health information technology: A social network analysis

Implementation of health information technology fails at an alarming rate because intended users often choose not to use it. Implementation theory and frameworks suggest that social networks may influence individuals' use, but empirical study remains limited. Furthermore, neither theory nor research has identified whose beliefs within the network matter most for implementation. We examine the relationship between an individual's system use and the beliefs of his or her peers. We assess the relationship for two peer groups: the entire group of peers and the subset that shares the individual's beliefs about the system. We used data collected from an academic hospital in the United States that had recently implemented a bar code medication administration system, a technology meant to increase medication safety. We administered a survey to nurses (N = 207) in six clinical units approximately 3-5 months (April-June 2013) after the "go-live" of the system to identify peer groups and beliefs about system usefulness. We calculated mean peer belief for the entire peer group and sharedness of belief using a homophily measure. From the hospital's electronic health record system, we obtained nurses' system use during the 3-month data collection period. We used multivariable linear regression to examine relationships. We found no effect of mean peer beliefs on individual system use. However, sharedness of belief about usefulness was positively associated with individual system use. Individuals' own positive belief was only associated with greater system use when shared with peers. Our findings indicate a significant role of social networks in implementation, and specifically that shared beliefs between an individual and his or her peer network may be critical to implementation success, more so than the beliefs across the entire peer group. Reinforcement by the social network appears to dictate whether individuals' own beliefs translate into system use.

Data Model Requirements for a Digital Cognitive Aid for Anesthesia to Support Intraoperative Crisis Management

Objective  The aim of this study is to define data model requirements supporting the development of a digital cognitive aid (CA) for intraoperative crisis management in anesthesia, including medical emergency text modules (text elements) and branches or loops within emergency instructions (control structures) as well as their properties, data types, and value ranges.

Methods  The analysis process comprised three steps: reviewing the structure of paper-based CAs to identify common text elements and control structures, identifying requirements derived from content, design, and purpose of a digital CA, and validating requirements by loading exemplary emergency checklist data into the resulting prototype data model.

Results  The analysis of paper-based CAs identified 19 general text elements and two control structures. Aggregating these elements and analyzing the content, design and purpose of a digital CA revealed 20 relevant data model requirements. These included checklist tags to enable different search options, structured checklist action steps (items) in groups and subgroups, and additional information on each item. Checklist and Item were identified as two main classes of the prototype data model. A data object built according to this model was successfully integrated into a digital CA prototype.

Conclusion  To enable consistent design and interactivity with the content, presentation of critical medical information in a digital CA for crisis management requires a uniform structure. So far it has not been investigated which requirements need to be met by a data model for this purpose. The results of this study define the requirements and structure that enable the presentation of critical medical information. Further research is needed to develop a comprehensive data model for a digital CA for crisis management in anesthesia, including supplementation of requirements resulting from simulation studies and feasibility analyses regarding existing data models. This model may also be a useful template for developing data models for CAs in other medical domains.

Mapping the prevalence and nature of drug related problems among hospitalised children in the United Kingdom: a systematic review

BACKGROUND

Problems arising from medicines usage are recognised as a key patient safety issue. Children are a particular concern, given that they are more likely than adults to experience medication-related harm. While previous reviews have provided an estimate of prevalence in this population, these predate recent developments in the delivery of paediatric care. Hence, there is a need for an updated, focussed and critical review of the prevalence and nature of drug-related problems in hospitalised children in the UK, in order to support the development and targeting of interventions to improve medication safety.

METHODS

Nine electronic databases (Medline, Embase, CINAHL, PsychInfo, IPA, Scopus, HMIC, BNI, The Cochrane library and clinical trial databases) were searched from January 1999 to April 2019. Studies were included if they were based in the UK, reported on the frequency of adverse drug reactions (ADRs), adverse drug events (ADEs) or medication errors (MEs) affecting hospitalised children. Quality appraisal of the studies was also conducted.

RESULTS

In all, 26 studies were included. There were no studies which specifically reported prevalence of adverse drug events. Two adverse drug reaction studies reported a median prevalence of 25.6% of patients (IQR 21.8-29.9); 79.2% of reactions warranted withdrawal of medication. Sixteen studies reported on prescribing errors (median prevalence 6.5%; IQR 4.7-13.3); of which, the median rate of dose prescribing errors was 11.1% (IQR 2.9-13). Ten studies reported on administration errors with a median prevalence of 16.3% (IQR 6.4-23). Administration technique errors represented 53% (IQR 52.7-67.4) of these errors. Errors detected during medicines reconciliation at hospital admission affected 43% of patients, 23% (Range 20.1-46) of prescribed medication; 70.3% (Range 50-78) were classified as potentially harmful. Medication errors detected during reconciliation on discharge from hospital affected 33% of patients and 19.7% of medicines, with 22% considered potentially harmful. No studies examined the prevalence of monitoring or dispensing errors.

CONCLUSIONS

Children are commonly affected by drug-related problems throughout their hospital journey. Given the high prevalence and risk of patient harm,, there is a need for a deeper theoretical understanding of paediatric medication systems to enable more effective interventions to be developed to improve patient safety.

Tracking resident pre-rounding electronic health record usage

PURPOSE

Residents collect information from the electronic health record (EHR) to present during rounds, but this crucial process is understudied. The purpose of this paper is to examine the feasibility of utilizing an EHR embedded time-tracking software to quantify resident pre-round EHR activity and how patient acuity impacts this activity.

DESIGN/METHODOLOGY/APPROACH

This was a retrospective observational study that quantified resident EHR activities (total time spent, tasks performed and patient encounters accessed) during pre-rounds on their pediatric intensive care unit rotation between May 2016 and December 2016. Patient encounters were reviewed to determine resident ownership and critical care resources provided.

FINDINGS

Allo 21 eligible participants were included. In total, 907 patient encounters were included to evaluate patient acuity impact. EHR usage per patient encounter (median in minutes (25th, 75th percentile)) was significantly affected by the critical care resources utilized. Total EHR time: both ventilator and vasoactive support (10.54 (6.68, 17.19)); neither ventilator nor vasoactive support (8.23 (5.07, 12.72)); invasive/noninvasive ventilator support (8.74 (5.69, 13.2)); and vasoactive support (10.37 (7.72, 11.65)), p<0.001. Chart review, order entry and documentation EHR times demonstrated similar trends.

PRACTICAL IMPLICATIONS

Residents spend more time utilizing the EHR to collect data on patients who require significant critical care resources. This information can be useful to determine optimal resident to patient workload. Future research is required to assess this EHR tool's ability to contribute to physician workflow study.

ORIGINALITY/VALUE

EHR embedded time-tracking software can offer insights into resident workflow.