Primary care practitioners' views on test result management in EHR-enabled health systems: a national survey

Reducing the Risk of Delayed Colorectal Cancer Diagnoses Through an Ambulatory Safety Net Collaborative

BACKGROUND

An estimated 12 million adults in the United States experience delayed diagnoses and other diagnostic errors annually. Ambulatory safety nets (ASNs) are an intervention to reduce delayed diagnoses by identifying patients with abnormal results overdue for follow-up using registries, workflow redesign, and patient navigation. The authors sought to co-design a collaborative and implement colorectal cancer (CRC) ASNs across various health care settings.

METHODS

A working group was convened to co-design implementation guidance, measures, and the collaborative model. Collaborative sites were recruited through a medical professional liability insurance program and chose to begin with developing an ASN for positive at-home CRC screening or overdue surveillance colonoscopy. The 18-month Breakthrough Series Collaborative ran from January 2022 to July 2023, with sites continuing to collect data while sustaining their ASNs. Data were collected from sites monthly on patients in the ASN, including the proportion that was successfully contacted, scheduled, and completed a follow-up colonoscopy.

RESULTS

Six sites participated; four had an operational ASN at the end of the Breakthrough Series, with the remaining sites launching three months later. From October 2022 through February 2024, the Collaborative ASNs collectively identified 5,165 patients from the registry as needing outreach. Among patients needing outreach, 3,555 (68.8%) were successfully contacted, 2,060 (39.9%) were scheduled for a colonoscopy, and 1,504 (29.1%) completed their colonoscopy.

CONCLUSION

The Collaborative successfully identified patients with previously abnormal CRC screening and facilitated completion of follow-up testing. The CRC ASN Implementation Guide offers a comprehensive road map for health care leaders interested in implementing CRC ASNs.

Electronic safety-netting tool features considered important by UK general practice staff: an interview and Delphi consensus study

BACKGROUND

The potential of the electronic health record to support safety netting has been recognised and a number of electronic safety-netting (E-SN) tools developed.

AIM

To establish the most important features of E-SN tools.

DESIGN & SETTING

User-experience interviews followed by a Delphi study in a primary care setting in the UK.

METHOD

The user-experience interviews were carried out remotely with primary care staff who had trialled the EMIS E-SN toolkit for suspected cancer. An electronic modified Delphi approach was used, with primary care staff involved in safety netting in any capacity, to measure consensus on tool features.

RESULTS

Thirteen user-experience interviews were carried out and features of E-SN tools seen as important formed the majority of the features included in the Delphi study. Three rounds of Delphi survey were administered. Sixteen responders (64%) completed all three rounds, and 28 out of 44 (64%) features reached consensus. Primary care staff preferred tools that were general in scope.

CONCLUSION

Primary care staff indicated that tools that were not specific to cancer or any other disease, and had features that promoted their flexible, efficient, and integrated use, were important. However, when the important features were discussed with the patient and public involvement (PPI) group, they expressed disappointment that features they believed would make E-SN tools robust and provide a safety net that is difficult to fall through did not reach consensus. The successful adoption of E-SN tools will rely on an evidence base of their effectiveness. Efforts should be made to assess the impact of these tools on patient outcomes.

Using an electronic safety netting tool designed to improve safety with respect to cancer referral in primary care: a qualitative service evaluation using rapid appraisal methods

BACKGROUND

This evaluation assesses the impact of an electronic safety netting software (E-SN) package, C the Signs, in primary care services across five boroughs in North East London (NEL).

AIM

This study evaluates the use of E-SN software in primary care, examining its benefits and barriers, safety implications, and overall impact on individual and practice usage.

DESIGN AND SETTING

The study is based on semi-structured interviews with 21 clinical and non-clinical members of staff from all primary care services using the software in NEL.

METHOD

Semi-structured interviews were conducted to gather data on individual use of the software, safety implications and practice use of features such as the monitoring dashboard. Data were analysed using a rapid qualitative methodology.

RESULTS

Two approaches to E-SN software adoption were reported: whole practice adoption and self-directed use. Practices benefitted from shared responsibility for safety netting and using software to track patients' progress in secondary care. Adoption was affected by information technology and administrative resources. Decision-support tools were used infrequently due to a lack of appreciation for their benefits. Selective adoption of different E-SN functions restricted its potential impact on early diagnosis.

CONCLUSION

The use of E-SN software in primary care services in NEL varied among participants. While some found it to be beneficial, others were sceptical of its impact on clinical decision-making. Nonetheless, the software was found to be effective in managing referral processes and tracking patients' progress in other points of care.

Preventing lost-to-follow up diagnostic imaging in ambulatory care: evaluation of an electronic notification tool

OBJECTIVE

Missed or cancelled imaging tests may be invisible to the ordering clinician and result in diagnostic delay. We developed an outpatient results notification tool (ORNT) to alert physicians of patients' missed radiology studies.

DESIGN

Randomised controlled evaluation of a quality improvement intervention.

SETTING

23 primary care and subspecialty ambulatory clinics at an urban academic medical centre.

PARTICIPANTS

276 physicians randomised to intervention or usual care.

MAIN OUTCOME MEASURE

90-day test completion of missed imaging tests.

RESULTS

We included 3675 radiology tests in our analysis: 1769 ordered in the intervention group and 1906 in the usual care group. A higher per cent of studies were completed for intervention compared with usual care groups in CT (20.7% vs 15.3%, p=0.06), general radiology (19.6% vs 12.0%, p=0.02) and, in aggregate, across all modalities (18.1% vs 16.1%, p=0.03). In the multivariable regression model adjusting for sex, age and insurance type and accounting for clustering with random effects at the level of the physician, the intervention group had a 36% greater odds of test completion than the usual care group (OR: 1.36 (1.097-1.682), p=0.005). In the Cox regression model, patients in the intervention group were 1.32 times more likely to complete their test in a timely fashion (HR: 1.32 (1.10-1.58), p=0.003).

CONCLUSIONS

An electronic alert that notified the responsible clinician of a missed imaging test ordered in an ambulatory clinic reduced the number of incomplete tests at 90 days. Further study of the obstacles to completing recommended diagnostic testing may allow for the development of better tools to support busy clinicians and their patients and reduce the risk of diagnostic delays.

Physicians' Perspectives on a Multi-Dimensional Model for the Roles of Electronic Health Records in Approaching a Proper Differential Diagnosis

Many healthcare organizations have adopted Electronic Health Records (EHRs) to improve the quality of care and help physicians make proper clinical decisions. The vital roles of EHRs can support the accuracy of diagnosis, suggest, and rationalize the provided care to patients. This study aims to understand the roles of EHRs in approaching proper differential diagnosis and optimizing patient safety. This study utilized a cross-sectional survey-based descriptive research design to assess physicians' perceptions of the roles of EHRs on diagnosis quality and safety. Physicians working in tertiary hospitals in Saudi Arabia were surveyed. Three hundred and fifty-one participants were included in the study, of which 61% were male. The main participants were family/general practice (22%), medicine, general (14%), and OB/GYN (12%). Overall, 66% of the participants ranked themselves as IT competent, most of the participants underwent IT self-guided learning, and 65% of the participants always used the system. The results generally reveal positive physicians' perceptions toward the roles of the EHR system on diagnosis quality and safety. There was a statistically significant relationship between user characteristics and the roles of the EHR by enhancing access to care, patient-physician encounter, clinical reasoning, diagnostic testing and consultation, follow-up, and diagnostic safety functionality. The study participants demonstrate positive perceptions of physicians toward the roles of the EHR system in approaching differential diagnosis. Yet, areas of improvement in the design and using EHRs are emphasized.

Electronic Health Records' Support for Primary Care Physicians' Situation Awareness: A Metanarrative Review

OBJECTIVE

Situation awareness (SA) refers to people's perception and understanding of their dynamic environment. In primary care, reduced SA among physicians increases errors in clinical decision-making and, correspondingly, patients' risk of experiencing adverse outcomes. Our objective was to understand the extent to which electronic health records (EHRs) support primary care physicians (PCPs)' SA during clinical decision-making.

METHOD

We conducted a metanarrative review of papers in selected academic databases, including CINAHL and MEDLINE. Eligible studies included original peer-reviewed research published between January 2012 and August 2020 on PCP-EHR interactions. We iteratively queried, screened, and summarized literature focused on EHRs supporting PCPs' clinical decision-making and care management for adults. Then, we mapped findings to an established SA framework to classify external factors (individual, task, and system) affecting PCPs' levels of SA (1-Perception, 2-Comprehension, and 3-Projection) and identified SA barriers.

RESULTS

From 1504 articles identified, we included and synthesized 19 studies. Study designs were largely noninterventional. Studies described EHR workflow misalignments, usability issues, and communication challenges. EHR information, including lab results and care plans, was characterized as incomplete, untimely, or irrelevant. Unmet information needs made it difficult for PCPs to obtain even basic SA, Level 1 SA. Prevalent barriers to PCPs developing SA with EHRs were errant mental models, attentional tunneling, and data overload.

CONCLUSION

Based on our review, EHRs do not support the development of higher levels of SA among PCPs. Review findings suggest SA-oriented design processes for health information technology could improve PCPs' SA, satisfaction, and decision-making.

Electronic Co-design (ECO-design) Workshop for Increasing Clinician Participation in the Design of Health Services Interventions: Participatory Design Approach

BACKGROUND

Participation from clinician stakeholders can improve the design and implementation of health care interventions. Participatory design methods, especially co-design methods, comprise stakeholder-led design activities that are time-consuming. Competing work demands and increasing workloads make clinicians' commitments to typical participatory methods even harder. The COVID-19 pandemic further exacerbated barriers to clinician participation in such interventions.

OBJECTIVE

The aim of this study was to explore a web-based participatory design approach to conduct economical, electronic co-design (ECO-design) workshops with primary care clinicians.

METHODS

We adapted traditional in-person co-design workshops to web-based delivery and adapted co-design workshop series to fit within a single 1-hour session. We applied the ECO-design workshop approach to codevelop feedback interventions regarding abnormal test result follow-up in primary care. We conducted ECO-design workshops with primary care clinicians at a medical center in Southern Texas, using videoconferencing software. Each workshop focused on one of three types of feedback interventions: conversation guide, email template, and dashboard prototype. We paired electronic materials and software features to facilitate participant interactions, prototyping, and data collection. The workshop protocol included four main activities: problem identification, solution generation, prototyping, and debriefing. Two facilitators were assigned to each workshop and one researcher resolved technical problems. After the workshops, our research team met to debrief and evaluate workshops.

RESULTS

A total of 28 primary care clinicians participated in our ECO-design workshops. We completed 4 parallel workshops, each with 5-10 participants. We conducted traditional analyses and generated a clinician persona (ie, representative description) and user interface prototypes. We also formulated recommendations for future ECO-design workshop recruitment, technology, facilitation, and data collection. Overall, our adapted workshops successfully enabled primary care clinicians to participate without increasing their workload, even during a pandemic.

CONCLUSIONS

ECO-design workshops are viable, economical alternatives to traditional approaches. This approach fills a need for efficient methods to involve busy clinicians in the design of health care interventions.

Translating Data Analytics Into Improved Spine Surgery Outcomes: A Roadmap for Biomedical Informatics Research in 2021

STUDY DESIGN

Narrative review.

OBJECTIVES

There is growing interest in the use of biomedical informatics and data analytics tools in spine surgery. Yet despite the rapid growth in research on these topics, few analytic tools have been implemented in routine spine practice. The purpose of this review is to provide a health information technology (HIT) roadmap to help translate data assets and analytics tools into measurable advances in spine surgical care.

METHODS

We conducted a narrative review of PubMed and Google Scholar to identify publications discussing data assets, analytical approaches, and implementation strategies relevant to spine surgery practice.

RESULTS

A variety of data assets are available for spine research, ranging from commonly used datasets, such as administrative billing data, to emerging resources, such as mobile health and biobanks. Both regression and machine learning techniques are valuable for analyzing these assets, and researchers should recognize the particular strengths and weaknesses of each approach. Few studies have focused on the implementation of HIT, and a variety of methods exist to help translate analytic tools into clinically useful interventions. Finally, a number of HIT-related challenges must be recognized and addressed, including stakeholder acceptance, regulatory oversight, and ethical considerations.

CONCLUSIONS

Biomedical informatics has the potential to support the development of new HIT that can improve spine surgery quality and outcomes. By understanding the development life-cycle that includes identifying an appropriate data asset, selecting an analytic approach, and leveraging an effective implementation strategy, spine researchers can translate this potential into measurable advances in patient care.

The person-based development and realist evaluation of a summary report for GP consultations

Background

Use of telephone, video and e-consultations is increasing. These can make consultations more transactional. This study aimed to develop a complex intervention to address patients’ concerns more comprehensively in general practice and test the feasibility of this in a cluster-randomised framework.

The complex intervention used two technologies: a patient-completed pre-consultation form used at consultation opening and a doctor-provided summary report provided at consultation closure. This paper reports on the development and realist evaluation of the summary report.

Methods

A person-based approach was used to develop the summary report. An electronic protocol was designed to automatically generate the report after GPs complete a clinical template in the patient record. This was tested with 45 patients in 3 rounds each, with iterative adjustments made based on feedback after each round. Subsequently, an intervention incorporating the pre-consultation form with the summary report was then tested in a cluster-randomised framework with 30 patients per practice in six practices: four randomised to intervention, and two to control. An embedded realist evaluation was carried out. The main feasibility study results are reported elsewhere.

Results

Conclusions

The person-based approach was successful. The summary report creates clarity, empowerment and reassurance in certain consultations and patients. As it takes a few minutes per patient, GPs prefer to select patients who will benefit most.

Why Test Results Are Still Getting "Lost" to Follow-up: a Qualitative Study of Implementation Gaps

BACKGROUND

Lack of timely follow-up of abnormal test results is common and has been implicated in missed or delayed diagnosis, resulting in potential for patient harm.

OBJECTIVE

As part of a larger project to implement change strategies to improve follow-up of diagnostic test results, this study sought to identify specifically where implementation gaps exist, as well as possible solutions identified by front-line staff.

DESIGN

We used a semi-structured interview guide to collect qualitative data from Veterans Affairs (VA) facility staff who had experience with test results management and patient safety.

SETTING

Twelve VA facilities across the USA.

PARTICIPANTS

Facility staff members (n = 27), including clinicians, lab and imaging professionals, nursing staff, patient safety professionals, and leadership.

APPROACH

We conducted a content analysis of interview transcripts to identify perceived barriers and high-risk areas for effective test result management, as well as recommendations for improvement.

RESULTS

We identified seven themes to guide further development of interventions to improve test result follow-up. Themes related to trainees, incidental findings, tracking systems for electronic health record notifications, outdated contact information, referrals, backup or covering providers, and responsibility for test results pending at discharge. Participants provided recommendations for improvement within each theme.

CONCLUSIONS

Perceived barriers and recommendations for improving test result follow-up often reflected previously known problems and their corresponding solutions, which have not been consistently implemented in practice. Better policy solutions and improvement methods, such as quality improvement collaboratives, may bridge the implementation gaps between knowledge and practice.

Reporting and Perceptions of Breast Arterial Calcification on Mammography: A Survey of ACR Radiologists

RATIONALE AND OBJECTIVES

The ACR Breast Commission conducted a member survey to evaluate current practices of reporting breast arterial calcification (BAC) on mammography and to determine perceptions about the value of BAC communication and follow-up recommendations among radiologists.

MATERIALS AND METHODS

In September 2020, an 18-item online survey was emailed to radiologist members of the American College of Radiology (ACR). Questions included radiologist demographics, current BAC reporting practices, follow-up recommendations, and perceptions about BAC. Five-point Likert scales were used and multivariate analysis was performed.

RESULTS

Of 598 completed survey responses, up to 87% (522/598) of ACR radiologist members include BAC in mammogram reports. However, only 41% (212/522) of respondents report BAC 'always' or 'most of the time'. Radiologist factors significantly associated with BAC reporting include years in practice and fellowship training with those in practice longer more likely to report BAC (OR 1.10, 95% CI, [1.01-1.20], p = 0.023) and those with fellowship training less likely to report BAC (OR 0.63, 95% CI, [0.42-0.94], p = 0.024). When BAC is reported, 69% (360/522) simply indicate the presence of BAC, 23% (121/522) provide a subjective grading of BAC burden, and 1% (6/522) calculate a BAC score. Among the radiologists reporting BAC, 58% (301/522) make no subsequent recommendations, while the remainder recommend primary care follow-up (39%; 204/522), cardiology evaluation (13%; 68/522), and/or coronary calcium scoring CT (11%; 59/522). Overall, there was agreement from 66% (392/598) of respondents that BAC is a cardiovascular risk factor. However, there was no consensus on whether patients and/or providers should be informed about BAC or whether reporting of BAC should become a standardized practice in breast imaging. Older and more experienced radiologists are more likely to agree that BAC is a cardiovascular risk factor (p = 0.022), providers should be informed about BAC (p = 0.002 and 0.006), BAC reporting should be a standardized practice (p = 0.004 and 0.001), and feel more comfortable informing patients about BAC (p = 0.001 and 0.003).

CONCLUSION

Radiologists' reporting practices and perceptions regarding BAC are not homogeneous. Although many radiologists report BAC to varying degrees, it is not routinely reported or recommended for follow-up in mammogram reports. Experienced radiologists are more likely to include and value BAC in their breast imaging practice.

Physician Stress During Electronic Health Record Inbox Work: In Situ Measurement With Wearable Sensors

Background

Increased work through electronic health record (EHR) messaging is frequently cited as a factor of physician burnout. However, studies to date have relied on anecdotal or self-reported measures, which limit the ability to match EHR use patterns with continuous stress patterns throughout the day.

Objective

The aim of this study is to collect EHR use and physiologic stress data through unobtrusive means that provide objective and continuous measures, cluster distinct patterns of EHR inbox work, identify physicians’ daily physiologic stress patterns, and evaluate the association between EHR inbox work patterns and physician physiologic stress.

Methods

Physicians were recruited from 5 medical centers. Participants (N=47) were given wrist-worn devices (Garmin Vivosmart 3) with heart rate sensors to wear for 7 days. The devices measured physiological stress throughout the day based on heart rate variability (HRV). Perceived stress was also measured with self-reports through experience sampling and a one-time survey. From the EHR system logs, the time attributed to different activities was quantified. By using a clustering algorithm, distinct inbox work patterns were identified and their associated stress measures were compared. The effects of EHR use on physician stress were examined using a generalized linear mixed effects model.

Results

Physicians spent an average of 1.08 hours doing EHR inbox work out of an average total EHR time of 3.5 hours. Patient messages accounted for most of the inbox work time (mean 37%, SD 11%). A total of 3 patterns of inbox work emerged: inbox work mostly outside work hours, inbox work mostly during work hours, and inbox work extending after hours that were mostly contiguous to work hours. Across these 3 groups, physiologic stress patterns showed 3 periods in which stress increased: in the first hour of work, early in the afternoon, and in the evening. Physicians in group 1 had the longest average stress duration during work hours (80 out of 243 min of valid HRV data; P=.02), as measured by physiological sensors. Inbox work duration, the rate of EHR window switching (moving from one screen to another), the proportion of inbox work done outside of work hours, inbox work batching, and the day of the week were each independently associated with daily stress duration (marginal R²=15%). Individual-level random effects were significant and explained most of the variation in stress (conditional R²=98%).

Conclusions

This study is among the first to demonstrate associations between electronic inbox work and physiological stress. We identified 3 potentially modifiable factors associated with stress: EHR window switching, inbox work duration, and inbox work outside work hours. Organizations seeking to reduce physician stress may consider system-based changes to reduce EHR window switching or inbox work duration or the incorporation of inbox management time into work hours.

Delayed or failure to follow-up abnormal breast cancer screening mammograms in primary care: a systematic review

Background

Successful breast cancer screening relies on timely follow-up of abnormal mammograms. Delayed or failure to follow-up abnormal mammograms undermines the potential benefits of screening and is associated with poorer outcomes. However, a comprehensive review of inadequate follow-up of abnormal mammograms in primary care has not previously been reported in the literature. This review could identify modifiable factors that influence follow-up, which if addressed, may lead to improved follow-up and patient outcomes.

Methods

A systematic literature review to determine the extent of inadequate follow-up of abnormal screening mammograms in primary care and identify factors impacting on follow-up was conducted. Relevant studies published between 1 January, 1990 and 29 October, 2020 were identified by searching MEDLINE®, Embase, CINAHL® and Cochrane Library, including reference and citation checking. Joanna Briggs Institute Critical Appraisal Checklists were used to assess the risk of bias of included studies according to study design.

Results

Eighteen publications reporting on 17 studies met inclusion criteria; 16 quantitative and two qualitative studies. All studies were conducted in the United States, except one study from the Netherlands. Failure to follow-up abnormal screening mammograms within 3 and at 6 months ranged from 7.2–33% and 27.3–71.6%, respectively. Women of ethnic minority and lower education attainment were more likely to have inadequate follow-up. Factors influencing follow-up included physician-patient miscommunication, information overload created by automated alerts, the absence of adequate retrieval systems to access patient’s results and a lack of coordination of patient records. Logistical barriers to follow-up included inconvenient clinic hours and inconsistent primary care providers. Patient navigation and case management with increased patient education and counselling by physicians was demonstrated to improve follow-up.

Conclusions

Follow-up of abnormal mammograms in primary care is suboptimal. However, interventions addressing amendable factors that negatively impact on follow-up have the potential to improve follow-up, especially for populations of women at risk of inadequate follow-up.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12885-021-08100-3.

The impact of health information technology on the management and follow-up of test results - a systematic review

OBJECTIVE

To investigate the impact of health information technology (IT) systems on clinicians' work practices and patient engagement in the management and follow-up of test results.

MATERIALS AND METHODS

A search for studies reporting health IT systems and clinician test results management was conducted in the following databases: MEDLINE, EMBASE, CINAHL, Web of Science, ScienceDirect, ProQuest, and Scopus from January 1999 to June 2018. Test results follow-up was defined as provider follow-up of results for tests that were sent to the laboratory and radiology services for processing or analysis.

RESULTS

There are some findings from controlled studies showing that health IT can improve the proportion of tests followed-up (15 percentage point change) and increase physician awareness of test results that require action (24-28 percentage point change). Taken as whole, however, the evidence of the impact of health IT on test result management and follow-up is not strong.

DISCUSSION

The development of safe and effective test results management IT systems should pivot on several axes. These axes include 1) patient-centerd engagement (involving shared, timely, and meaningful information); 2) diagnostic processes (that involve the integration of multiple people and different clinical settings across the health care spectrum); and 3) organizational communications (the myriad of multi- transactional processes requiring feedback, iteration, and confirmation) that contribute to the patient care process.

CONCLUSION

Existing evidence indicates that health IT in and of itself does not (and most likely cannot) provide a complete solution to issues related to test results management and follow-up.

Organizational characteristics and perceptions of clinical event notification services in healthcare settings: a study of health information exchange

OBJECTIVE

Event notification systems are an approach to health information exchange (HIE) that notifies end-users of patient interactions with the healthcare system through real-time automated alerts. We examined associations between organizational capabilities and perceptions of event notification system use.

MATERIALS AND METHODS

We surveyed representatives (n = 196) from healthcare organizations (n = 96) that subscribed to 1 of 3 Health Information Organizations' event notification services in New York City (response rate = 27%). The survey was conducted in Fall 2017 and Winter 2018. Surveys measured respondent characteristics, perceived organizational capabilities, event notification use, care coordination, and care quality. Exploratory factor analysis was used to identify relevant independent and dependent variables. We examined the relationship between organizational capabilities, care coordination, and care quality using multilevel linear regression models with random effects.

RESULTS

Respondents indicated that the majority of their organizations provided follow-up care for emergency department visits (66%) and hospital admissions (73%). Perceptions of care coordination were an estimated 57.5% (β = 0.575; P < 0.001) higher among respondents who reported event notifications fit within their organization's existing workflows. Perceptions of care quality were 46.5% (β = 0.465; P < 0.001) higher among respondents who indicated event notifications fit within existing workflows and 23.8% (β = 0.238; P < 0.01) higher where respondents reported having supportive policies and procedures for timely response and coordination of event notifications.

DISCUSSION AND CONCLUSION

Healthcare organizations with specific workflow processes and positive perceptions of fit are more likely to use event notification services to improve care coordination and care quality. In addition, event notification capacity and patient consent procedures influence how end-users perceive event notification services.

CASNET2: evaluation of an electronic safety netting cancer toolkit for the primary care electronic health record: protocol for a pragmatic stepped-wedge RCT

INTRODUCTION

Safety-netting in primary care is the best practice in cancer diagnosis, ensuring that patients are followed up until symptoms are explained or have resolved. Currently, clinicians use haphazard manual solutions. The ubiquitous use of electronic health records provides an opportunity to standardise safety-netting practices.A new electronic safety-netting toolkit has been introduced to provide systematic ways to track and follow up patients. We will evaluate the effectiveness of this toolkit, which is embedded in a major primary care clinical system in England:Egerton Medical Information System(EMIS)-Web.

METHODS AND ANALYSIS

We will conduct a stepped-wedge cluster RCT in 60 general practices within the RCGP Research and Surveillance Centre (RSC) network. Groups of 10 practices will be randomised into the active phase at 2-monthly intervals over 12 months. All practices will be activated for at least 2 months. The primary outcome is the primary care interval measured as days between the first recorded symptom of cancer (within the year prior to diagnosis) and the subsequent referral to secondary care. Other outcomes include referrals rates and rates of direct access cancer investigation.Analysis of the clustered stepped-wedge design will model associations using a fixed effect for intervention condition of the cluster at each time step, a fixed effect for time and other covariates, and then include a random effect for practice and for patient to account for correlation between observations from the same centre and from the same participant.

ETHICS AND DISSEMINATION

Ethical approval has been obtained from the North West-Greater Manchester West National Health Service Research Ethics Committee (REC Reference 19/NW/0692). Results will be disseminated in peer-reviewed journals and conferences, and sent to participating practices. They will be published on the University of Oxford Nuffield Department of Primary Care and RCGP RSC websites.

TRIAL REGISTRATION NUMBER

ISRCTN15913081; Pre-results.

Electronic health record usage among nurse practitioners, physician assistants, and junior residents

BACKGROUND

Studies demonstrate significant electronic health record (EHR) use by junior residents; however, few studies have investigated this for nurse practitioners and physician assistants (NPs/PAs).

PURPOSE

The aim of this study was to quantify the time spent on the EHR by NPs/PAs and junior residents.

METHODS

Electronic health record usage data were collected from April 2015 through April 2016. Monthly EHR usage was compared between NPs/PAs and postgraduate second and third year residents. Further subgroup analysis of NPs/PAs and residents from surgical or nonsurgical fields was conducted.

RESULTS

Data for 22 NPs/PAs (16 surgical and six nonsurgical) and 125 residents (31 surgical and 94 nonsurgical) were analyzed. Nurse practitioners/physician assistants opened fewer charts per day (4.9 ± 1.5 vs. 5.4 ± 3.1), placed more orders per month, and spent more daily time on the EHR (176.5 ± 51.7 minutes vs. 152.3 ± 71.9 minutes; p < .0001). Compared with residents, NPs/PAs spent more time per patient in all categories (chart review, documentation, order entry) and in total time per patient chart (all p < .05). Comparing surgical NPs/PAs to surgical residents, findings were similar with fewer charts per day, more total daily EHR time, and more EHR time per patient in every tracked category (all p < .05).

IMPLICATIONS FOR PRACTICE

This is the first study to quantify time on the EHR for NPs/PAs. Nurse practitioners/physician assistants spent more time on the EHR than residents, and this is accentuated with surgical NPs/PAs. Electronic health record utilization appears more burdensome for NPs/PAs; however, the reason for this is unclear and highlights the need for targeted interventions.

Using Clinical Simulations to Train Healthcare Professionals to Use Electronic Health Records: A Literature Review

Unintended consequences are adverse events directly related to information technology and may result from inappropriate use of electronic health records by healthcare professionals. Electronic health record competency training has historically used didactic lectures with hands-on experience in a live classroom, and this method fails to teach learners proficiency because the sociotechnical factors that are present in real-world settings are excluded. Additionally, on-the-job training to gain competency can impair patient safety because it distracts clinicians from patient care activities. Clinical simulation-based electronic health record training allows learners to acquire technical and nontechnical skills in a safe environment that will not compromise patient safety. The purpose of this literature review was to summarize the current state-of-the-science on the use of clinical simulations to train healthcare professionals to use electronic health records. The benefits of using simulation-based training that incorporates an organization's contextual factors include improvement of interdisciplinary team communication, clinical performance, clinician-patient-technology communication skills, and recognition of patient safety issues. Design considerations for electronic health record training using clinical simulations involve establishing course objectives, identifying outcome measures, establishing content requirements of both the clinical simulation and electronic health record, and providing adequate debriefing.

Assessment of Health Information Technology-Related Outpatient Diagnostic Delays in the US Veterans Affairs Health Care System: A Qualitative Study of Aggregated Root Cause Analysis Data

IMPORTANCE

Diagnostic delay in the outpatient setting is an emerging safety priority that health information technology (HIT) should help address. However, diagnostic delays have persisted, and new safety concerns associated with the use of HIT have emerged.

OBJECTIVE

To analyze HIT-related outpatient diagnostic delays within a large, integrated health care system.

DESIGN, SETTING, AND PARTICIPANTS

This cohort study involved qualitative content analysis of safety concerns identified in aggregated root cause analysis (RCA) data related to HIT and outpatient diagnostic delays. The setting was the US Department of Veterans Affairs using all RCAs submitted to the Veterans Affairs (VA) National Center for Patient Safety from January 1, 2013, to July 31, 2018.

MAIN OUTCOMES AND MEASURES

Common themes associated with the role of HIT-related safety concerns were identified and categorized according to the Health IT Safety framework for measuring, monitoring, and improving HIT safety. This framework includes 3 related domains (ie, safe HIT, safe use of HIT, and using HIT to improve safety) situated within an 8-dimensional sociotechnical model accounting for interacting technical and nontechnical variables associated with safety. Hence, themes identified enhanced understanding of the sociotechnical context and domain of HIT safety involved.

RESULTS

Of 214 RCAs categorized by the terms delay and outpatient submitted during the study period, 88 were identified as involving diagnostic delays and HIT, from which 172 unique HIT-related safety concerns were extracted (mean [SD], 1.97 [1.53] per RCA). Most safety concerns (82.6% [142 of 172]) involved problems with safe use of HIT, predominantly sociotechnical factors associated with people, workflow and communication, and a poorly designed human-computer interface. Fewer safety concerns involved problems with safe HIT (14.5% [25 of 172]) or using HIT to improve safety (0.3% [5 of 172]). The following 5 key high-risk areas for diagnostic delays emerged: managing electronic health record inbox notifications and communication, clinicians gathering key diagnostic information, technical problems, data entry problems, and failure of a system to track test results.

CONCLUSIONS AND RELEVANCE

This qualitative study of a national RCA data set suggests that interventions to reduce outpatient diagnostic delays could aim to improve test result management, interoperability, data visualization, and order entry, as well as to decrease information overload.

Patient Safety Culture, Health Information Technology Implementation, and Medical Office Problems That Could Lead to Diagnostic Error

BACKGROUND

Diagnostic errors may cause harm to patients by preventing or delaying appropriate treatment or by leading to unnecessary or harmful treatment.

OBJECTIVES

The aim of the study was to investigate the relationship between patient safety culture, health information technology (IT) implementation, and the frequency of problems that could lead to diagnostic errors in the medical office setting, such as unavailable test results, unavailable medical records, or unpursued abnormal results.

METHODS

We used survey data from 925 medical offices nationwide that voluntarily submitted results to the 2012 Agency for Healthcare Research and Quality Medical Office Surveys on Patient Safety Culture database. At the office level, we ran a multivariate regression model to estimate the effect of culture on problem frequency while controlling for office-reported implementation levels of health IT, office characteristics such as the number of locations, and survey characteristics such as the percent of respondents that were physicians.

RESULTS

The most frequent problem was "results from a lab or imaging test were not available when needed"; across 925 offices, the average was 15% reporting that it happened daily or weekly. Higher overall culture scores were significantly associated with fewer occurrences of each problem assessed. Compared with offices with completed health IT implementation, offices in the process of health IT implementation had higher frequency of problems.

CONCLUSIONS

This study offers insight into how patient safety culture and health IT implementation in medical offices can influence the frequency of breakdowns in processes of care, thereby identifying potential vulnerabilities that can increase diagnostic errors.

Project RedDE: Cluster Randomized Trial to Reduce Missed or Delayed Abnormal Laboratory Value Actions

Supplemental Digital Content is available in the text.

Failure of timely abnormal laboratory result follow-up is relatively common and may lead to harm. This study hypothesized that a quality improvement collaborative (QIC) could reduce the frequency of missed or delayed action on abnormal laboratory values.

Signed, Sealed, Delivered: Increasing Patient Notification of Test Results in an Internal Medicine Resident Continuity Clinic

OBJECTIVES

Informing patients of their test results is an important patient safety issue, yet many physicians perform dismally in this regard. Residents often face additional barriers to communicating test results to patients. We wanted to determine whether streamlining the notification process, communicating expectations, and having residents audit their performance would increase result notification rates.

METHODS

We used a quasi-experimental design, and a single-group before-and-after intervention. Our multifold intervention consisted of development and standardization of a notification process in the electronic medical record, an education component, and a self-audit component. During a 15-minute session, we educated residents on the use of the new process. We also restated expectations regarding notifying patients of their results. Residents audited their own charts for a period before the intervention and during a second, postintervention period. An independent review of notification rates took place simultaneously as well as during an additional period several months later.

RESULTS

In total, 87 residents were eligible for participation. All 87 completed the project, giving a 100% participation rate. Resident-reported laboratory test notification rates increased from 16% to 91%; other test result rates increased from 33% to 84%. The three independent reviews showed laboratory test notification rates increased from 18.5% to 71.7% to 87.1%, and notification of other test results increased from 23.5% to 66.7% to 91.7%.

CONCLUSIONS

Baseline rates of notification for diagnostic tests results were low, but streamlining the notification process, clearly stating expectations for using it, and using resident self-audit can improve notification rates.

Practicing Clinicians' Recommendations to Reduce Burden from the Electronic Health Record Inbox: a Mixed-Methods Study

BACKGROUND

Workload from electronic health record (EHR) inbox notifications leads to information overload and contributes to job dissatisfaction and physician burnout. Better understanding of physicians' inbox requirements and workflows could optimize inbox designs, enhance efficiency, and reduce safety risks from information overload.

DESIGN

We conducted a mixed-methods study to identify strategies to enhance EHR inbox design and workflow. First, we performed a secondary analysis of national survey data of all Department of Veterans Affairs (VA) primary care practitioners (PCP) to identify major themes in responses to a free-text question soliciting suggestions to improve EHR inbox design and workflows. We then conducted expert interviews of clinicians at five health care systems (1 VA and 4 non-VA settings using 4 different EHRs) to understand existing optimal strategies to improve efficiency and situational awareness related to EHR inbox use. Themes from survey data were cross-validated with interview findings.

RESULTS

We analyzed responses from 2104 PCPs who completed the free-text inbox question (of 5001 PCPs who responded to survey) and used an inductive approach to identify five themes: (1) Inbox notification content should be actionable for patient care and relevant to recipient clinician, (2) Inboxes should reduce risk of losing messages, (3) Inbox functionality should be optimized to improve efficiency of processing notifications, (4) Team support should be leveraged to help with EHR inbox notification burden, (5) Sufficient time should be provided to all clinicians to process EHR inbox notifications. We subsequently interviewed 15 VA and non-VA clinicians and identified 11 unique strategies, each corresponding directly with one of these five themes.

CONCLUSION

Feedback from practicing end-user clinicians provides robust evidence to improve content and design of the EHR inbox and related clinical workflows and organizational policies. Several strategies we identified could improve clinicians' EHR efficiency and satisfaction as well as empower them to work with their local administrators, health IT personnel, and EHR developers to improve these systems.

Association of the Usability of Electronic Health Records With Cognitive Workload and Performance Levels Among Physicians

IMPORTANCE

Current electronic health record (EHR) user interfaces are suboptimally designed and may be associated with excess cognitive workload and poor performance.

OBJECTIVE

To assess the association between the usability of an EHR system for the management of abnormal test results and physicians' cognitive workload and performance levels.

DESIGN, SETTING, AND PARTICIPANTS

This quality improvement study was conducted in a simulated EHR environment. From April 1, 2016, to December 23, 2016, residents and fellows from a large academic institution were enrolled and allocated to use either a baseline EHR (n = 20) or an enhanced EHR (n = 18). Data analyses were conducted from January 9, 2017, to March 30, 2018.

INTERVENTIONS

The EHR with enhanced usability segregated in a dedicated folder previously identified critical test results for patients who did not appear for a scheduled follow-up evaluation and provided policy-based decision support instructions for next steps. The baseline EHR displayed all patients with abnormal or critical test results in a general folder and provided no decision support instructions for next steps.

MAIN OUTCOMES AND MEASURES

Cognitive workload was quantified subjectively using NASA-Task Load Index and physiologically using blink rates. Performance was quantified according to the percentage of appropriately managed abnormal test results.

RESULTS

Of the 38 participants, 25 (66%) were female. The 20 participants allocated to the baseline EHR compared with the 18 allocated to the enhanced EHR demonstrated statistically significantly higher cognitive workload as quantified by blink rate (mean [SD] blinks per minute, 16 [9] vs 24 [7]; blink rate, -8 [95% CI, -13 to -2]; P = .01). The baseline group showed statistically significantly poorer performance compared with the enhanced group who appropriately managed 16% more abnormal test results (mean [SD] performance, 68% [19%] vs 98% [18%]; performance rate, -30% [95% CI, -40% to -20%]; P < .001).

CONCLUSIONS AND RELEVANCE

Relatively basic usability enhancements to the EHR system appear to be associated with better physician cognitive workload and performance; this finding suggests that next-generation systems should strip away non-value-added EHR interactions, which may help physicians eliminate the need to develop their own suboptimal workflows.

A Review of Measuring the Cognitive Workload of Electronic Health Records

The To Err Is Human report stated that 98 000 patients die yearly because of medical errors, and that medication errors kill more people than workplace injuries. The inadequate design and utilization of the electronic health record have been identified as major contributing factors to medical errors. Increased cognitive workload of clinicians has consistently been linked to the occurrence of medical errors. The purpose of this article was to synthesize the current state of the science on measuring clinicians' cognitive workload associated with using electronic health records in order to inform evidence-based guidelines. The major considerations identified in the literature involve the use of psychometric instruments, using efficiency as a proxy for cognitive workload, and eye tracking. The National Aeronautics and Space Administration Task Load Index was the most used psychometric instrument, but reliability measures were not reported. It is important to evaluate reliability of psychometric instruments because the consistency of the instrument can change when administered to different populations. Efficiency is an observable measure defined by the total time to complete a task and the total number of physical interactions with the user interface. Efficiency can allow the use of statistical modeling, but it does not directly evaluate the mental activity associated with using an electronic health record interface. Eye tracking has been used extensively in the literature to measure cognitive workload via changes in pupil size related to mental activity, but it is not often used to measure the cognitive workload associated with using the electronic health record. Eye tracking is very useful for continuous monitoring of cognitive workload.

Impact of a national QI programme on reducing electronic health record notifications to clinicians

BACKGROUND

Emerging evidence suggests electronic health record (EHR)-related information overload is a risk to patient safety. In the US Department of Veterans Affairs (VA), EHR-based 'inbox' notifications originally intended for communicating important clinical information are now cited by 70% of primary care practitioners (PCPs) to be of unmanageable volume. We evaluated the impact of a national, multicomponent, quality improvement (QI) programme to reduce low-value EHR notifications.

METHODS

The programme involved three steps: (1) accessing daily PCP notification load data at all 148 facilities operated nationally by the VA; (2) standardising and restricting mandatory notification types at all facilities to a recommended list; and (3) hands-on training for all PCPs on customising and processing notifications more effectively. Designated leaders at each of VA's 18 regional networks led programme implementation using a nationally developed toolkit. Each network supervised technical requirements and data collection, ensuring consistency. Coaching calls and emails allowed the national team to address implementation challenges and monitor effects. We analysed notification load and mandatory notifications preintervention (March 2017) and immediately postintervention (June-July 2017) to assess programme impact.

RESULTS

Median number of mandatory notification types at each facility decreased significantly from 15 (IQR: 13-19) to 10 (IQR: 10-11) preintervention to postintervention, respectively (P<0.001). Mean daily notifications per PCP decreased significantly from 128 (SEM=4) to 116 (SEM=4; P<0.001). Heterogeneity in implementation across sites led to differences in observed programme impact, including potentially beneficial carryover effects.

CONCLUSIONS

Based on prior estimates on time to process notifications, a national QI programme potentially saved 1.5 hours per week per PCP to enable higher value work. The number of daily notifications remained high, suggesting the need for additional multifaceted interventions and protected clinical time to help manage them. Nevertheless, our project suggests feasibility of using large-scale 'de-implementation' interventions to reduce unintended safety or efficiency consequences of well-intended electronic communication systems.

Toward safer health care: a review strategy of FDA medical device adverse event database to identify and categorize health information technology related events

Introduction

Health information technology (HIT) is intended to provide safer and better care to patients. However, poorly designed or implemented HIT poses a key risk to patient safety. It is essential for healthcare providers and researchers to investigate the HIT-related events. Unfortunately, the lack of HIT-related event databases in the community hinders the analysis and management of HIT-related events.

Objectives

Develop a standardized process for identifying HIT-related events from a Federal Drug Administration (FDA) database in order to create an HIT exclusive database for analysis and learning.

Methods

The FDA Manufacturer and User Facility Device Experience (MAUDE) database, containing over 7-million reports about medical device malfunctions and problems leading to serious injury or death, was considered as a potential resource to identify HIT-related events. We developed a strategy of identifying and categorizing HIT-related events from the FDA reports through the application of a keyword filter and standardized expert review. Ten percent identified reports were reviewed to measure the consistency among experts and to initialize a database for HIT-related events.

Results

With the proposed strategy, we initialized an HIT-related event database with over 3500 reports, and updated the estimation of the HIT-related event proportion in the FDA MAUDE database to 0.46∼0.69%, up to 50,000 HIT-related events.

Conclusion

The proposed strategy for HIT-related event identification holds promise in aiding the understanding, characterization, discovery, and reporting of HIT-related events toward improved patient safety. The analysis of contributing factors under the 8-dimensional sociotechnical model shows that hardware and software, clinical content, and human-computer interface were identified more frequently than the other dimensions.

Responsibility for follow-up during the diagnostic process in primary care: a secondary analysis of International Cancer Benchmarking Partnership data

BACKGROUND

It is unclear to what extent primary care practitioners (PCPs) should retain responsibility for follow-up to ensure that patients are monitored until their symptoms or signs are explained.

AIM

To explore the extent to which PCPs retain responsibility for diagnostic follow-up actions across 11 international jurisdictions.

DESIGN AND SETTING

A secondary analysis of survey data from the International Cancer Benchmarking Partnership.

METHOD

The authors counted the proportion of 2879 PCPs who retained responsibility for each area of follow-up (appointments, test results, and non-attenders). Proportions were weighted by the sample size of each jurisdiction. Pooled estimates were obtained using a random-effects model, and UK estimates were compared with non-UK ones. Free-text responses were analysed to contextualise quantitative findings using a modified grounded theory approach.

RESULTS

PCPs varied in their retention of responsibility for follow-up from 19% to 97% across jurisdictions and area of follow-up. Test reconciliation was inadequate in most jurisdictions. Significantly fewer UK PCPs retained responsibility for test result communication (73% versus 85%, P = 0.04) and non-attender follow-up (78% versus 93%, P<0.01) compared with non-UK PCPs. PCPs have developed bespoke, inconsistent solutions to follow-up. In cases of greatest concern, 'double safety netting' is described, where both patient and PCP retain responsibility.

CONCLUSION

The degree to which PCPs retain responsibility for follow-up is dependent on their level of concern about the patient and their primary care system's properties. Integrated systems to support follow-up are at present underutilised, and research into their development, uptake, and effectiveness seems warranted.

A Systematic Review of Interventions to Follow-Up Test Results Pending at Discharge

BACKGROUND

Patients are frequently discharged from the hospital before all test results have been finalized. Thirty to 40% of tests pending at discharge (TPADs) return potentially actionable results that could necessitate change in the patients' management, often unbeknownst to their physicians. Delayed follow-up of TPADs can lead to patient harm. We sought to synthesize the existing literature on interventions intended to improve the management of TPADs, including interventions designed to enhance documentation of TPADs, increase physician awareness when TPAD results finalize post-discharge, decrease adverse events related to missed TPADs, and increase physician satisfaction with TPAD management.

METHODS

We searched Medline, EMBASE, CINAHL, Cochrane Database of Systematic Reviews, Cochrane Database of Controlled Clinical Trials and Medline (January 1, 2000-November 10, 2016) for randomized controlled trials and prospective, controlled observational studies that evaluated interventions to improve follow-up of TPADs for adult patients discharged from acute care hospitals or emergency department settings. From each study we extracted characteristics of the intervention being evaluated and its impact on TPAD management.

RESULTS

Nine studies met the criteria for inclusion. Six studies evaluated electronic discharge summary templates with a designated field for documenting TPADs, and three of six of these studies reported a significant improvement in documentation of TPADs in discharge summaries in pre- and post-intervention analysis. One study reported that auditing discharge summaries and providing feedback to physicians were associated with improved TPAD documentation in discharge summaries. Two studies found that email alerts when TPADs were finalized improved physicians' awareness of the results and documentation of their follow-up actions. Of the four studies that assessed patient morbidity, two showed a positive effect; however, none specifically measured the impact of their interventions on downstream patient harm due to delayed follow-up of TPADs. Three studies surveyed physicians' attitudes towards the interventions, of which two studies reported improved physician satisfaction with TPAD management with the implementation of an enhanced discharge template and a notification system when TPADs finalize.

DISCUSSION

Discharge summary templates, educational interventions for discharging physicians, and email alerts when TPAD results are finalized show promise in improving management of TPADs. Given the complexity of the processes necessary to ensure follow-up of TPADs, rigorous evaluations of multifaceted interventions (e.g., improved discharge documentation of TPADs combined with email alerts when results become available) is needed.

Using Natural Language Processing to Extract Abnormal Results From Cancer Screening Reports

OBJECTIVES

Numerous studies show that follow-up of abnormal cancer screening results, such as mammography and Papanicolaou (Pap) smears, is frequently not performed in a timely manner. A contributing factor is that abnormal results may go unrecognized because they are buried in free-text documents in electronic medical records (EMRs), and, as a result, patients are lost to follow-up. By identifying abnormal results from free-text reports in EMRs and generating alerts to clinicians, natural language processing (NLP) technology has the potential for improving patient care. The goal of the current study was to evaluate the performance of NLP software for extracting abnormal results from free-text mammography and Pap smear reports stored in an EMR.

METHODS

A sample of 421 and 500 free-text mammography and Pap reports, respectively, were manually reviewed by a physician, and the results were categorized for each report. We tested the performance of NLP to extract results from the reports. The 2 assessments (criterion standard versus NLP) were compared to determine the precision, recall, and accuracy of NLP.

RESULTS

When NLP was compared with manual review for mammography reports, the results were as follows: precision, 98% (96%-99%); recall, 100% (98%-100%); and accuracy, 98% (96%-99%). For Pap smear reports, the precision, recall, and accuracy of NLP were all 100%.

CONCLUSIONS

Our study developed NLP models that accurately extract abnormal results from mammography and Pap smear reports. Plans include using NLP technology to generate real-time alerts and reminders for providers to facilitate timely follow-up of abnormal results.

Primary Care Providers' Opening of Time-Sensitive Alerts Sent to Commercial Electronic Health Record InBaskets

BACKGROUND

Time-sensitive alerts are among the many types of clinical notifications delivered to physicians' secure InBaskets within commercial electronic health records (EHRs). A delayed alert review can impact patient safety and compromise care.

OBJECTIVE

To characterize factors associated with opening of non-interruptive time-sensitive alerts delivered into primary care provider (PCP) InBaskets.

DESIGN AND PARTICIPANTS

We analyzed data for 799 automated alerts. Alerts highlighted actionable medication concerns for older patients post-hospital discharge (2010-2011). These were study-generated alerts sent 3 days post-discharge to InBaskets for 75 PCPs across a multisite healthcare system, and represent a subset of all urgent InBasket notifications.

MAIN MEASURES

Using EHR access and audit logs to track alert opening, we performed bivariate and multivariate analyses calculating associations between patient characteristics, provider characteristics, contextual factors at the time of alert delivery (number of InBasket notifications, weekday), and alert opening within 24 h.

KEY RESULTS

At the time of alert delivery, the PCPs had a median of 69 InBasket notifications and had received a median of 379.8 notifications (IQR 295.0, 492.0) over the prior 7 days. Of the 799 alerts, 47.1% were opened within 24 h. Patients with longer hospital stays (>4 days) were marginally more likely to have alerts opened (OR 1.48 [95% CI 1.00-2.19]). Alerts delivered to PCPs whose InBaskets had a higher number of notifications at the time of alert delivery were significantly less likely to be opened within 24 h (top quartile >157 notifications: OR 0.34 [95% CI 0.18-0.61]; reference bottom quartile ≤42). Alerts delivered on Saturdays were also less likely to be opened within 24 h (OR 0.18 [CI 0.08-0.39]).

CONCLUSIONS

The number of total InBasket notifications and weekend delivery may impact the opening of time-sensitive EHR alerts. Further study is needed to support safe and effective approaches to care team management of InBasket notifications.

Veterans Affairs Primary Care Provider Perceptions of Insomnia Treatment

STUDY OBJECTIVES

Insomnia is a widespread issue among United States adults and rates of insomnia among veterans are even higher than the general population. Prior research examining primary care provider (PCP) perspectives on insomnia treatment found that: sleep hygiene and pharmacotherapy are the primary treatments offered; PCPs tend to focus on perceived causes of insomnia rather than the insomnia itself; and neither patients nor providers are satisfied with insomnia treatment options. Although insomnia complaints are typically first reported to primary care providers, little research has focused on perspectives regarding insomnia treatment among PCPs working in the largest integrated health care system in the United States-the Veterans Affairs (VA) health care system. This study was conducted to examine VA PCP perceptions of the availability of insomnia treatments, identify specific strategies offered by PCPs, and examine perceptions regarding the importance of treating insomnia and the role of comorbid conditions.

METHODS

A survey was conducted within the VA health care system. Primary care providers completed surveys electronically.

RESULTS

A high percentage of veterans (modal response = 20% to 39%) seen in VA primary care settings report an insomnia complaint to their provider. Almost half of respondents do not consistently document insomnia in the medical record (46% endorsed "sometimes," "rarely," or "never"). PCPs routinely advise sleep hygiene recommendations for insomnia (ie, avoid stimulants before bedtime [84.3%], and keep the bedroom environment quiet and dark and comfortable [68.6%]) and many are uncertain if cognitive behavioral therapy for insomnia is available at their facility (43.1%).

CONCLUSIONS

Findings point to the need for systems-level changes within health care systems, including the adoption of evidence-based clinical practice standards for insomnia and PCP education about the processes that maintain insomnia.

COMMENTARY

A commentary on this article appears in this issue on page 937.

Electronic Health Record Alert-Related Workload as a Predictor of Burnout in Primary Care Providers

BACKGROUND

Electronic health records (EHRs) have been shown to increase physician workload. One EHR feature that contributes to increased workload is asynchronous alerts (also known as inbox notifications) related to test results, referral responses, medication refill requests, and messages from physicians and other health care professionals. This alert-related workload results in negative cognitive outcomes, but its effect on affective outcomes, such as burnout, has been understudied.

OBJECTIVES

To examine EHR alert-related workload (both objective and subjective) as a predictor of burnout in primary care providers (PCPs), in order to ultimately inform interventions aimed at reducing burnout due to alert workload.

METHODS

A cross-sectional questionnaire and focus group of 16 PCPs at a large medical center in the southern United States.

RESULTS

Subjective, but not objective, alert workload was related to two of the three dimensions of burnout, including physical fatigue (p = 0.02) and cognitive weariness (p = 0.04), when controlling for organizational tenure. To reduce alert workload and subsequent burnout, participants indicated a desire to have protected time for alert management, fewer unnecessary alerts, and improvements to the EHR system.

CONCLUSIONS

Burnout associated with alert workload may be in part due to subjective differences at an individual level, and not solely a function of the objective work environment. This suggests the need for both individual and organizational-level interventions to improve alert workload and subsequent burnout. Additional research should confirm these findings in larger, more representative samples.

Improving Timely Resident Follow-Up and Communication of Results in Ambulatory Clinics Utilizing a Web-Based Audit and Feedback Module

BACKGROUND

Failure to follow up and communicate test results to patients in outpatient settings may lead to diagnostic and therapeutic delays. Residents are less likely than attending physicians to report results to patients, and may face additional barriers to reporting, given competing clinical responsibilities.

OBJECTIVE

This study aimed to improve the rates of communicating test results to patients in resident ambulatory clinics.

METHODS

We performed an internal medicine, residency-wide, pre- and postintervention, quality improvement project using audit and feedback. Residents performed audits of ambulatory patients requiring laboratory or radiologic testing by means of a shared online interface. The intervention consisted of an educational module viewed with initial audits, development of a personalized improvement plan after Phase 1, and repeated real-time feedback of individual relative performance compared at clinic and program levels. Outcomes included results communicated within 14 days and prespecified "significant" results communicated within 72 hours.

RESULTS

A total of 76 of 86 eligible residents (88%) reviewed 1713 individual ambulatory patients' charts in Phase 1, and 73 residents (85%) reviewed 1509 charts in Phase 2. Follow-up rates were higher in Phase 2 than Phase 1 for communicating results within 14 days and significant results within 72 hours (85% versus 78%, P < .001; and 82% versus 70%, P = .002, respectively). Communication of "significant" results was more likely to occur via telephone, compared with communication of nonsignificant results.

CONCLUSIONS

Participation in a shared audit and feedback quality improvement project can improve rates of resident follow-up and communication of results, although communication gaps remained.

Application of Electronic Algorithms to Improve Diagnostic Evaluation for Bladder Cancer

BACKGROUND

Strategies to ensure timely diagnostic evaluation of hematuria are needed to reduce delays in bladder cancer diagnosis.

OBJECTIVE

To evaluate the performance of electronic trigger algorithms to detect delays in hematuria follow-up.

METHODS

We developed a computerized trigger to detect delayed follow-up action on a urinalysis result with high-grade hematuria (>50 red blood cells/high powered field). The trigger scanned clinical data within a Department of Veterans Affairs (VA) national data repository to identify all patient records with hematuria, then excluded those where follow-up was unnecessary (e.g., terminal illness) or where typical follow-up action was detected (e.g., cystoscopy). We manually reviewed a randomly-selected sample of flagged records to confirm delays. We performed a similar analysis of records with hematuria that were marked as not delayed (non-triggered). We used review findings to calculate trigger performance.

RESULTS

Of 310,331 patients seen between 1/1/2012-12/31/2014, the trigger identified 5,857 patients who experienced high-grade hematuria, of which 495 experienced a delay. On manual review of 400 randomly-selected triggered records and 100 non-triggered records, the trigger achieved positive and negative predictive values of 58% and 97%, respectively.

CONCLUSIONS

Triggers offer a promising method to detect delays in care of patients with high-grade hematuria and warrant further evaluation in clinical practice as a means to reduce delays in bladder cancer diagnosis.

New Unintended Adverse Consequences of Electronic Health Records

Although the health information technology industry has made considerable progress in the design, development, implementation, and use of electronic health records (EHRs), the lofty expectations of the early pioneers have not been met. In 2006, the Provider Order Entry Team at Oregon Health & Science University described a set of unintended adverse consequences (UACs), or unpredictable, emergent problems associated with computer-based provider order entry implementation, use, and maintenance. Many of these originally identified UACs have not been completely addressed or alleviated, some have evolved over time, and some new ones have emerged as EHRs became more widely available. The rapid increase in the adoption of EHRs, coupled with the changes in the types and attitudes of clinical users, has led to several new UACs, specifically: complete clinical information unavailable at the point of care; lack of innovations to improve system usability leading to frustrating user experiences; inadvertent disclosure of large amounts of patient-specific information; increased focus on computer-based quality measurement negatively affecting clinical workflows and patient-provider interactions; information overload from marginally useful computer-generated data; and a decline in the development and use of internally-developed EHRs. While each of these new UACs poses significant challenges to EHR developers and users alike, they also offer many opportunities. The challenge for clinical informatics researchers is to continue to refine our current systems while exploring new methods of overcoming these challenges and developing innovations to improve EHR interoperability, usability, security, functionality, clinical quality measurement, and information summarization and display.

Workarounds and Test Results Follow-up in Electronic Health Record-Based Primary Care

BACKGROUND

Electronic health records (EHRs) have potential to facilitate reliable communication and follow-up of test results. However, limitations in EHR functionality remain, leading practitioners to use workarounds while managing test results. Workarounds can lead to patient safety concerns and signify indications as to how to build better EHR systems that meet provider needs.

OBJECTIVE

To understand why primary care practitioners (PCPs) use workarounds to manage test results by analyzing data from a previously conducted national cross-sectional survey on test result management.

METHODS

We conducted a secondary data analysis of quantitative and qualitative data from a national survey of PCPs practicing in the Department of Veterans Affairs (VA) and explored the use of workarounds in test results management. We used multivariate logistic regression analysis to examine the association between key sociotechnical factors that could affect test results follow-up (e.g., both technology-related and those unrelated to technology, such as organizational support for patient notification) and workaround use. We conducted a qualitative content analysis of free text survey data to examine reasons for use of workarounds.

RESULTS

Of 2554 survey respondents, 1104 (43%) reported using workarounds related to test results management. Of these 1028 (93%) described the type of workaround they were using; 719 (70%) reported paper-based methods, while 230 (22%) used a combination of paper- and computer-based workarounds. Primary care practitioners who self-reported limited administrative support to help them notify patients of test results or described an instance where they personally (or a colleague) missed results, were more likely to use workarounds (p=0.02 and p=0.001, respectively). Qualitative analysis identified three main reasons for workaround use: 1) as a memory aid, 2) for improved efficiency and 3) for facilitating internal and external care coordination.

CONCLUSION

Workarounds to manage EHR-based test results are common, and their use results from unmet provider information management needs. Future EHRs and the respective work systems around them need to evolve to meet these needs.

Health information exchange in the wild: the association between organizational capability and perceived utility of clinical event notifications in ambulatory and community care

OBJECTIVE

Event notifications are real-time, electronic, automatic alerts to providers of their patients' health care encounters at other facilities. Our objective was to examine the effects of organizational capability and related social/organizational issues upon users' perceptions of the impact of event notifications on quality, efficiency, and satisfaction.

MATERIALS AND METHODS

We surveyed representatives (n = 49) of 10 organizations subscribing to the Bronx Regional Health Information Organization's event notification services about organizational capabilities, notification information quality, perceived usage, perceived impact, and organizational and respondent characteristics. The response rate was 89%. Average item scores were used to create an individual domain summary score. The association between the impact of event notifications and organizational characteristics was modeled using random-intercept logistic regression models.

RESULTS

Respondents estimated that organizations followed up on the majority (83%) of event notifications. Supportive organizational policies were associated with the perception that event notifications improved quality of care (odds ratio [OR] = 2.12; 95% CI, = 1.05, 4.45), efficiency (OR = 2.06; 95% CI = 1.00, 4.21), and patient satisfaction (OR = 2.56; 95% CI = 1.13, 5.81). Higher quality of event notification information was also associated with a perceived positive impact on quality of care (OR = 2.84; 95% CI = 1.31, 6.12), efficiency (OR = 3.04; 95% CI = 1.38, 6.69), and patient satisfaction (OR = 2.96; 95% CI = 1.25, 7.03).

CONCLUSIONS

Health care organizations with appropriate processes, workflows, and staff may be better positioned to use event notifications. Additionally, information quality remains critical in users' assessments and perceptions.

Linking clinician interaction and coordination to clinical performance in Patient-Aligned Care Teams

Background

Team coordination within clinical care settings is a critical component of effective patient care. Less is known about the extent, effectiveness, and impact of coordination activities among professionals within VA Patient-Aligned Care Teams (PACTs). This study will address these gaps by describing the specific, fundamental tasks and practices involved in PACT coordination, their impact on performance measures, and the role of coordination task complexity.

Methods/design

First, we will use a web-based survey of coordination practices among 1600 PACTs in the national VHA. Survey findings will characterize PACT coordination practices and assess their association with clinical performance measures. Functional job analysis, using 6–8 subject matter experts who are 3rd and 4th year residents in VA Primary Care rotations, will be utilized to identify the tasks involved in completing clinical performance measures to standard. From this, expert ratings of coordination complexity will be used to determine the level of coordinative complexity required for each of the clinical performance measures drawn from the VA External Peer Review Program (EPRP). For objective 3, data collected from the first two methods will evaluate the effect of clinical complexity on the relationships between measures of PACT coordination and their ratings on the clinical performance measures.

Discussion

Results from this study will support successful implementation of coordinated team-based work in clinical settings by providing knowledge regarding which aspects of care require the most complex levels of coordination and how specific coordination practices impact clinical performance.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-015-0368-0) contains supplementary material, which is available to authorized users.

Consumer Engagement in Health IT: Distinguishing Rhetoric from Reality

RATIONALE

Policymakers want health information technology (health IT) to support consumer engagement to help achieve national health goals. In this paper, we review the evidence to compare the rhetoric with the reality of current practice.

CURRENT REALITY AND BARRIERS

Our environmental scan shows that consumer demand exists for electronic access to personal health information, but that technical and system or political barriers still limit the value of the available information and its potential benefits.

CONCLUSIONS AND POLICY IMPLICATIONS

There is a gap between current reality and the goals for consumer engagement. Actions that may help bridge this gap include: (1) resolving technical barriers to health information exchange (HIE); (2) developing more consumer-centric design and functionality; (3) reinforcing incentives that attract provider support by showing that consumer engagement is in their interest; and (4) building a stronger empirical case to convince decision makers that consumer engagement will lead to better care, improved health outcomes, and lower costs.

Patient Preferences for Test Result Notification

IMPORTANCE

Patients are increasingly being given access to their test results, but little is known about how preferences vary with the test under consideration or the results of the test (normal or abnormal).

OBJECTIVE

This study was conducted to examine preferences for test result communication.

DESIGN, SETTING, AND PARTICIPANTS

We surveyed adults to explore their preferences for test result notification for three common diagnostic tests of varying "emotional impact" (dual-energy x-ray absorptiometry [DXA], genital herpes, and cancer biopsy) when test results were 1) normal and 2) abnormal. We conducted our survey between June and August 2012 on the campus of an academic medical center. For each scenario, subjects were asked to rank seven methods that might be used to communicate test results (letter, unsecured email, secured email, text message, telephone call, secure Web portal, office visit) in order of acceptability.

MAIN OUTCOME MEASURES

The main measures were the percentage of respondents who ranked a particular test result notification method favorably and the percentage who ranked it as unacceptable.

RESULTS

When test results were normal, subjects' notification preferences were generally similar for DXA, herpes and cancer biopsy, with telephone and letter ranked most favorably for all three tests. Conversely, text message and unsecured email were viewed as unacceptable notification methods for normal results by 45.0-55.0 % of subjects across all three tests. When test results were abnormal, office visits became more popular. A higher proportion of subjects ranked office visits as their most preferred notification method for our test with high "emotional impact" (cancer biopsy) (38.4 %) as compared to DXA (28.2 %) and herpes (27.9 %) (P = 0.02). For most test scenarios, younger subjects appeared to rank electronic communication modalities (secure email or Web portal) higher than older subjects, though this difference did not reach statistical significance (P = 0.29).

CONCLUSIONS

Preferences for test result notification can differ substantially depending upon the test under consideration and results of the test. Providers and health care systems should consider these factors when deciding how to communicate results to patients.

Electronic Trigger-Based Intervention to Reduce Delays in Diagnostic Evaluation for Cancer: A Cluster Randomized Controlled Trial

PURPOSE

We tested whether prospective use of electronic health record-based trigger algorithms to identify patients at risk of diagnostic delays could prevent delays in diagnostic evaluation for cancer.

METHODS

We performed a cluster randomized controlled trial of primary care providers (PCPs) at two sites to test whether triggers that prospectively identify patients with potential delays in diagnostic evaluation for lung, colorectal, or prostate cancer can reduce time to follow-up diagnostic evaluation. Intervention steps included queries of the electronic health record repository for patients with abnormal findings and lack of associated follow-up actions, manual review of triggered records, and communication of this information to PCPs via secure e-mail and, if needed, phone calls to ensure message receipt. We compared times to diagnostic evaluation and proportions of patients followed up between intervention and control cohorts based on final review at 7 months.

RESULTS

We recruited 72 PCPs (36 in the intervention group and 36 in the control group) and applied the trigger to all patients under their care from April 20, 2011, to July 19, 2012. Of 10,673 patients with abnormal findings, the trigger flagged 1,256 patients (11.8%) as high risk for delayed diagnostic evaluation. Times to diagnostic evaluation were significantly lower in intervention patients compared with control patients flagged by the colorectal trigger (median, 104 v 200 days, respectively; n = 557; P < .001) and prostate trigger (40% received evaluation at 144 v 192 days, respectively; n = 157; P < .001) but not the lung trigger (median, 65 v 93 days, respectively; n = 19; P = .59). More intervention patients than control patients received diagnostic evaluation by final review (73.4% v 52.2%, respectively; relative risk, 1.41; 95% CI, 1.25 to 1.58).

CONCLUSION

Electronic trigger-based interventions seem to be effective in reducing time to diagnostic evaluation of colorectal and prostate cancer as well as improving the proportion of patients who receive follow-up. Similar interventions could improve timeliness of diagnosis of other serious conditions.

Management of laboratory data and information exchange in the electronic health record

In the era of the electronic health record, the success of laboratories and pathologists will depend on effective presentation and management of laboratory information, including test orders and results, and effective exchange of data between the laboratory information system and the electronic health record. In this third paper of a series that explores empowerment of pathology in the era of the electronic health record, we review key elements of managing laboratory information within the electronic health record and examine functional issues pertinent to pathologists and laboratories in the exchange of laboratory information between electronic health records and both anatomic and clinical pathology laboratory information systems. Issues with electronic order-entry and results-reporting interfaces are described, and considerations for setting up these interfaces are detailed in tables. The role of the laboratory medical director as mandated by the Clinical Laboratory Improvement Amendments of 1988 and the impacts of discordance between laboratory results and their display in the electronic health record are also discussed.

The Impact for Patient Outcomes of Failure to Follow Up on Test Results. How Can We Do Better?

BACKGROUND

The World Health Organization-World Alliance for Patient Safety has identified test result management as a priority area. Poor test result follow-up can have major consequences for the quality of care, including missed diagnoses and suboptimal patient outcomes. Over the last three decades there has been considerable growth in the number of requests for pathology and radiology services which has added to the complexity of how patient care is delivered and test results are managed. This can contribute to a lack of clarity about where and with whom responsibility for test follow-up should reside: a problem that is compounded by a lack of clear definitions about what are critical, unexpected or significantly abnormal results.

AIM OF THIS PAPER

This paper will present a narrative review highlighting key issues related to the problem of failure to follow up laboratory test results, and outline potential solutions.

CONCLUSIONS

Information technology (IT) has the potential to enhance the performance and safety of test result management processes. Effective solutions must engage all stakeholders, including consumers, in arriving at decisions about who needs to receive results, how and when they are communicated, and how they are acknowledged and acted upon and the documentation of these actions.