Radiology Workflow Dynamics: How Workflow Patterns Impact Radiologist Perceptions of Workplace Satisfaction

A Novel Radiology Communication Tool to Reduce Workflow Interruptions: Clinical Evaluation of RadConnect

Despite the importance of communication, radiology departments often depend on communication tools that were not created for the unique needs of imaging workflows, leading to frequent radiologist interruptions. The objective of this study was test the hypothesis that a novel asynchronous communication tool for the imaging workflow (RadConnect) reduces the daily average number of synchronous (in-person, telephone) communication requests for radiologists. We conducted a before-after study. Before adoption of RadConnect, technologists used three conventional communication methods to consult radiologists (in-person, telephone, general-purpose enterprise chat (GPEC)). After adoption, participants used RadConnect as a fourth method. Technologists manually recorded every radiologist consult request related to neuro and thorax CT scans in the 40 days before and 40 days after RadConnect adoption. Telephone traffic volume to section beepers was obtained from the hospital telephone system for the same period. The value and usability experiences were collected through an electronic survey and structured interviews. RadConnect adoption resulted in 53% reduction of synchronous (in-person, telephone) consult requests: from 6.1 ± 4.2 per day to 2.9 ± 2.9 (P < 0.001). There was 77% decrease (P < 0.001) in telephone volume to the neuro and thorax beepers, while no significant volume change was noted to the abdomen beeper (control group). Survey responses (46% response rate) and interviews confirmed the positive impact of RadConnect on interruptions. RadConnect significantly reduced radiologists' telephone interruptions. Study participants valued the role-based interaction and prioritized worklist overview in the survey and interviews. Findings from this study will contribute to a more focused work environment.

Impact of Interruptions During Screening Mammography on Physician Well-Being and Patient Care

OBJECTIVE

To assess the impact of interruptions on radiologists' efficiency, accuracy, and job satisfaction in interpreting screening mammograms.

METHODS

This institutional review board-approved retrospective reader study recruited nine breast radiologists from a single academic institution [name withheld] to interpret 150 screening mammograms performed between December 1, 2008, and December 31, 2015 under two different reading conditions, as follows: (1) uninterrupted batch reading and (2) interrupted reading. The 150 cases consisted of 125 normal mammograms and 25 mammograms with subtle breast cancers. Cases were divided into two groups of 75 cases each (cohort 1 and cohort 2), with a comparable distribution of cancer cases. Four rounds of 75 cases each were conducted with a 6-week washout period between rounds 2 and 3. After completing each interpretation session, readers completed a seven-question survey, assessing perceptions of mental and physical effort, level of frustration, and performance satisfaction. Clinical performance metrics (reading time, recall rate, sensitivity, specificity, accuracy, and positive predictive value 1) were calculated.

RESULTS

Recall rates were significantly (P = .04) higher during interrupted reading sessions (35.4%) than they were during uninterrupted batch reading sessions (31.4%). Accuracy was significantly (P = .049) worse in the interrupted reading sessions (69.5%), compared with uninterrupted sessions (73.6%). Differences in overall image interpretation times were not statistically significant (P = .065). Compared with uninterrupted batch reading sessions, readers during interrupted sessions reported feeling busier (P < .001), encountered higher levels of cognitive demand (P = .005), experienced elevated levels of physical fatigue (P = .004), and expressed lower levels of satisfaction with their performance (P = .041).

CONCLUSION

Interruptions during interpretation of screening mammography have deleterious effects on physician performance and their sense of well-being.

Trainee selection of tasks in postgraduate medical education: Is there a role for 'cherry-picking' to optimise learning?

PURPOSE

Learning is optimised when postgraduate trainees engage in clinical tasks in their zone of proximal development (ZPD). However, workplace learning environments impose additional non-learning goals and additional tasks that may lead to trainees engaging in tasks that do not fall within their ZPD. We do not fully understand how trainees select clinical tasks in the workplace learning environment. If we knew the goals and factors they consider when selecting a task, we could better equip trainees with strategies to select tasks that maximise learning. We explored how postgraduate trainees select clinical tasks using echocardiography interpretation as a model.

METHODS

Canadian General Cardiology residents and Echocardiography fellows were invited to participate in semi-structured interviews. Aligning with a theory-informed study, two independent researchers used a deductive, directed content analysis approach to identify codes and themes.

RESULTS

Eleven trainees from seven Canadian universities participated (PGY4 = 4, PGY5 = 3, PGY6 = 1 and echocardiography fellows = 3). Goals included learning content, fulfilling assessment criteria and contributing to clinical demands. Trainees switched between goals throughout the day, as it was too effortful for them to engage in tasks within their ZPD at all times. When trainees had sufficient mental effort available, they selected higher complexity tasks that could advance learning content. When available mental effort was low, trainees selected less complex tasks that fulfilled numerically based assessment goals or contributed to clinical demands. Trainees predominantly used perceived complexity of the echocardiogram as a factor to select tasks to achieve their desired goals.

CONCLUSION

Postgraduate trainees select tasks within their ZPD that enable them to maximise learning when they perceive to have sufficient mental effort available and workplace affordances are adequate. These findings can inform individual and systemic strategies to maximise learning when selecting tasks.

Integrated Automatic Examination Assignment Reduces Radiologist Interruptions: A 2-Year Cohort Study of 232,022 Examinations

Radiology departments face challenges in delivering timely and accurate imaging reports, especially in high-volume, subspecialized settings. In this retrospective cohort study at a tertiary cancer center, we assessed the efficacy of an Automatic Assignment System (AAS) in improving radiology workflow efficiency by analyzing 232,022 CT examinations over a 12-month period post-implementation and compared it to a historical control period. The AAS was integrated with the hospital-wide scheduling system and set up to automatically prioritize and distribute unreported CT examinations to available radiologists based on upcoming patient appointments, coupled with an email notification system. Following this AAS implementation, despite a 9% rise in CT volume, coupled with a concurrent 8% increase in the number of available radiologists, the mean daily urgent radiology report requests (URR) significantly decreased by 60% (25 ± 12 to 10 ± 5, t = -17.6, p < 0.001), and URR during peak days (95th quantile) was reduced by 52.2% from 46 to 22 requests. Additionally, the mean turnaround time (TAT) for reporting was significantly reduced by 440 min for patients without immediate appointments and by 86 min for those with same-day appointments. Lastly, patient waiting time sampled in one of the outpatient clinics was not negatively affected. These results demonstrate that AAS can substantially decrease workflow interruptions and improve reporting efficiency.

Implementation of Medical Students as Radiology Reading Room Coordinators

OBJECTIVE

Effort has been made to minimize the burden of non-interpretive tasks (NITs), in particular by hiring and training non-radiologist support staff as reading room coordinators (RRCs). Our medical center recruited and trained senior medical students from our affiliated school of medicine to work alongside on-call radiology residents as RRCs.

METHODS

A 12-month Malpractice Carrier monetary grant was acquired to fund medical students at with the aim to reduce malpractice risk. After the first year, residents were surveyed regarding the impact of the RRCs on perceived on-call efficiency and morale. Furthermore, report turnaround times (TAT) on call shifts that were and were not accompanied by a RRC were compared.

RESULTS

89 % of residents strongly agreed that the RRC improved workflow efficiency, decreased distractions, and felt less stressed during the call shift when the RRC was on duty. 78 % strongly agreed to be more likely to contact a referring clinician when the RRC was able to help coordinate. The mean TAT in the presence of a RRC was 36.8 min, and the mean TAT in the absence of a RRC was 36.9 min DISCUSSION: After hiring medical students to assist on-call radiology residents with noninterpretive tasks, residents reported subjective indicators of program success, but average report turnaround time was unaffected. Nevertheless, we predict that this type of program will continue to grow among academic radiology departments, though additional research is required to evaluate national trends and impacts on radiologist productivity and well-being.

The burden of the digital environment: a systematic review on organization-directed workplace interventions to mitigate physician burnout

OBJECTIVE

To conduct a systematic review identifying workplace interventions that mitigate physician burnout related to the digital environment including health information technologies (eg, electronic health records) and decision support systems) with or without the application of advanced analytics for clinical care.

MATERIALS AND METHODS

Literature published from January 1, 2007 to June 3, 2020 was systematically reviewed from multiple databases and hand searches. Subgroup analysis identified relevant physician burnout studies with interventions examining digital tool burden, related workflow inefficiencies, and measures of burnout, stress, or job satisfaction in all practice settings.

RESULTS

The search strategy identified 4806 citations of which 81 met inclusion criteria. Thirty-eight studies reported interventions to decrease digital tool burden. Sixty-eight percent of these studies reported improvement in burnout and/or its proxy measures. Burnout was decreased by interventions that optimized technologies (primarily electronic health records), provided training, reduced documentation and task time, expanded the care team, and leveraged quality improvement processes in workflows.

DISCUSSION

The contribution of digital tools to physician burnout can be mitigated by careful examination of usability, introducing technologies to save or optimize time, and applying quality improvement to workflows.

CONCLUSION

Physician burnout is not reduced by technology implementation but can be mitigated by technology and workflow optimization, training, team expansion, and careful consideration of factors affecting burnout, including specialty, practice setting, regulatory pressures, and how physicians spend their time.

Qualitative and Quantitative Workplace Analysis of Staff Requirement in an Academic Radiology Department

PURPOSE

 The role of today's hospital-based radiologists goes far beyond interpretation-related tasks. This observational study defines these types of activities and quantifies the type of value-adding interactions radiologists experience on a daily basis with referring departments and other health personnel. The purpose of this study is to evaluate the quality and quantity of these value-adding non-image interpretation tasks in the daily routine of hospital-based residents and attending radiologists.

METHODS

 A prospective, observational study was performed in the radiology department of a German university hospital. Two experienced radiologists performed a 30-day observation of the entire medical staff. The observers followed the subject radiologists throughout the workday, recording activities using a time and motion methodology. An evaluation matrix was developed to characterize and quantify image interpretation tasks (IITs), non-image interpretation tasks (NITs), and contingency allowance (CA) for residents and attending radiologists. Here, the example of the MRI unit is used.

RESULTS

 Four main categories of responsibilities for NITs were identified including teaching and education, clinical decision support, management and organization, and patient care. The quantitative analysis for residents showed: IITs 15 h/d (53 %), NITs 9.8 h/d (34 %), CA 2.2 h/d (13 %). For attendings the analysis revealed: IITs 6.7 h/d (40 %), NITs 7.8 h/d (47 %), and CA 1.7 h/d (13 %). This resulted in staff requirements of 2 attendings and 3.4 residents for the MRI unit. On average, 6 TSEs/h occurred in the case of residents and 13 TSEs/h in the case of attendings.

CONCLUSION

 NITs consumed a significant portion of a radiologist's workday. Therefore, the number of examinations performed is not a reliable surrogate for the daily workload of hospital-based radiologists especially in cross-sectional imaging units. Though time-consuming, these non-interpretive tasks are greatly contributing to the fact that modern radiology is assuming a central position in patient management, fulfilling a critical role that surpasses image interpretation-related tasks to include a more integrative and consultative role. These findings will help to further define the changing role of radiologists with respect to other physicians, non-medical personnel, hospital administrators, as well as policy makers.

KEY POINTS

  · Staff requirements are a significant factor in department strategy.. · Targeted analysis can deliver valuable information about workload per activity and the required staff.. · The number of examinations performed is not a reliable surrogate for the daily workload of hospital-based radiologists.. · NITs comprise a significant portion of a radiologist's workday.. · Though time-consuming, non-interpretive tasks contribute to the fact that modern radiology is assuming a central role in patient management..

CITATION FORMAT

· Streit U, Uhlig J, Lotz J et al. Qualitative and Quantitative Workplace Analysis of Staff Requirement in an Academic Radiology Department. Fortschr Röntgenstr 2021; DOI: 10.1055/a-1472-6530.

Learning Echocardiography in the Workplace: A Cognitive Load Perspective

PURPOSE

Although workplace learning environments provide authentic tasks to promote learning, elements of clinical settings may distract trainees and impede learning. The characteristics of workplace learning environments that require optimization are ill-defined. Applying principles of cognitive load theory (CLT) to optimize learning environments by managing intrinsic load (complexity of the task matched to learner knowledge and skill), minimizing extraneous load (any aspect that is not part of task completion), and increasing germane load (processing for storage in long-term memory) could be advantageous. The authors explored trainee perceptions of characteristics that helped or impaired learning from a cognitive load perspective. Echocardiography interpretation was used as a model.

METHOD

The authors conducted semistructured interviews between December 2018 and March 2019 with a purposeful sample of 10 cardiology trainees at the University of California, San Francisco, School of Medicine until thematic sufficiency was achieved. Participants represented a range of training levels (3 fourth-year trainees, 2 fifth-year trainees, 3 sixth-year trainees, and 2 advanced echocardiography fellows) and career aspirations (4 desired careers in imaging). Two independent coders analyzed interview transcripts using template analysis. Codes were mapped to CLT subcomponents.

RESULTS

Trainees selected their own echocardiograms to interpret; if trainees' skill levels and the complexity of the selected echocardiograms were mismatched, excess intrinsic load could result. Needing to look up information essential for task completion, interruptions, reporting software, and time pressures were characteristics that contributed to extraneous load. Characteristics that related to increasing germane load included the shared physical space (facilitating reading echocardiograms with attendings and just-in-time guidance from near peers) and the availability of final reports to obtain feedback independent of teachers.

CONCLUSIONS

As interpreted from a cognitive load perspective, findings highlight characteristics of workplace learning environments that could be optimized to improve learning. The findings have direct application to redesigning these learning environments.

The State of Radiology AI: Considerations for Purchase Decisions and Current Market Offerings

Purpose

To provide an overview of important factors to consider when purchasing radiology artificial intelligence (AI) software and current software offerings by type, subspecialty, and modality.

Materials and Methods

Important factors for consideration when purchasing AI software, including key decision makers, data ownership and privacy, cost structures, performance indicators, and potential return on investment are described. For the market overview, a list of radiology AI companies was aggregated from the Radiological Society of North America and the Society for Imaging Informatics in Medicine conferences (November 2016-June 2019), then narrowed to companies using deep learning for imaging analysis and diagnosis. Software created for image enhancement, reporting, or workflow management was excluded. Software was categorized by task (repetitive, quantitative, explorative, and diagnostic), modality, and subspecialty.

Results

A total of 119 software offerings from 55 companies were identified. There were 46 algorithms that currently have Food and Drug Administration and/or Conformité Européenne approval (as of November 2019). Of the 119 offerings, distribution of software targets was 34 of 70 (49%), 21 of 70 (30%), 14 of 70 (20%), and one of 70 (1%) for diagnostic, quantitative, repetitive, and explorative tasks, respectively. A plurality of companies are focused on nodule detection at chest CT and two-dimensional mammography. There is very little activity in certain subspecialties, including pediatrics and nuclear medicine. A comprehensive table is available on the website hitilab.org/pages/ai-companies.

Conclusion

The radiology AI marketplace is rapidly maturing, with an increase in product offerings. Radiologists and practice administrators should educate themselves on current product offerings and important factors to consider before purchase and implementation.© RSNA, 2020See also the invited commentary by Sala and Ursprung in this issue.

Evaluating Radiology Result Communication in the Emergency Department

PURPOSE

To assess the pattern of result communication that occurs between radiologists and referring physicians in the emergency department setting.

METHODS

An institutional review board-approved prospective study was performed at a large academic medical center with 24/7 emergency radiology cover. Emergency radiologists logged information regarding all result-reporting communication events that occurred over a 168-hour period.

RESULTS

A total of 286 independent result communication events occurred during the study period, the vast majority of which occurred via telephone (232/286). Emergency radiologists spent 10% of their working time communicating results. Similar amounts of time were spent discussing negative and positive cross-sectional imaging examinations. In a small minority of communication events, additional information was gathered through communication that resulted in a change of interpretation from a normal to an abnormal study.

CONCLUSIONS

Effective and efficient result communication is critical to care delivery in the emergency department setting. Discussion regarding abnormal cases, both in person and over the phone, is encouraged. However, in the emergency setting, time spent on routine direct communication of negative examination results in advance of the final report may lead to increased disruptions, longer turnaround times, and negatively impact patient care. In very few instances, does the additional information gained from the communication event result in a change of interpretation?

Decreasing radiologist burnout through informatics-based solutions

Increased performance demands have interacted with suboptimal use of technology and contributed to burnout among radiologists. Although the problem of radiologist burnout has been well documented, there is a gap in the literature in terms of how technology can be better utilized to lessen the problem. Informatics-based modifications to existing technology hold the potential to reduce the amount of time radiologists spend on noninterpretive tasks, decrease interruptions, facilitate connections with colleagues, and improve patient care. Examples of successful modifications to technology are presented and discussed in relation to how they contribute to improving workplace engagement among radiologists.

Effect of Organization-Directed Workplace Interventions on Physician Burnout: A Systematic Review

To assess the impact of organization-directed workplace interventions on physician burnout, including stress or job satisfaction in all settings, we conducted a systematic review of the literature published from January 1, 2007, to October 3, 2018, from multiple databases. Manual searches of grey literature and bibliographies were also performed. Of the 633 identified citations, 50 met inclusion criteria. Four unique categories of organization-directed workplace interventions were identified. Teamwork involved initiatives to incorporate scribes or medical assistants into electronic health record (EHR) processes, expand team responsibilities, and improve communication among physicians. Time studies evaluated the impact of schedule adjustments, duty hour restrictions, and time-banking initiatives. Transitions referred to workflow changes such as process improvement initiatives or policy changes within the organization. Technology related to the implementation or improvement of EHRs. Of the 50 included studies, 35 (70.0%) reported interventions that successfully improved the 3 measures of physician burnout, job satisfaction, and/or stress. The largest benefits resulted from interventions that improved processes, promoted team-based care, and incorporated the use of scribes/medical assistants to complete EHR documentation and tasks. Implementation of EHR interventions to improve clinical workflows worsened burnout, but EHR improvements had positive effects. Time interventions had mixed effects on burnout. The results of our study suggest that organization-directed workplace interventions that improve processes, optimize EHRs, reduce clerical burden by the use of scribes, and implement team-based care can lessen physician burnout. Benefits of process changes can enhance physician resiliency, augment care provided by the team, and optimize the coordination and communication of patient care and health information.

Trainee perception of cognitive load during observed faculty staff teaching of procedural skills

OBJECTIVES

Although teachers impact learners' cognitive load, how specific teaching activities affect intrinsic, germane and extraneous load during procedural skills training is unknown. We sought to characterise teaching activities used in the exemplar procedural setting of colonoscopy, and to explore how they were enacted and how learners perceived them as affecting intrinsic, germane and extraneous cognitive load.

METHODS

We observed 10 colonoscopies performed by eight different gastroenterology fellows and supervised by 10 different attending physicians at two hospitals, and recorded the teaching activities observed, as well as details of when they were used and how they were enacted. After the colonoscopy, each fellow completed the Cognitive Load Inventory for Colonoscopy to quantify intrinsic, germane and extraneous load. We then interviewed each fellow to determine how he or she perceived teaching as affecting cognitive load. Qualitative data were subjected to content analysis. Instances of germane load-promoting activities were correlated with measured germane load.

RESULTS

We observed 515 instances of teaching activities. The intensity of teaching varied substantially, ranging from 0.7 to 3.3 activities per minute, as did the pattern of teaching activities used by different attending physicians. Little teaching occurred immediately before or after a procedure. Fellows usually perceived teaching as affecting cognitive load in ways that promoted learning, particularly by reducing intrinsic load and increasing germane load. Fellows strongly perceived that the provision of autonomy promoted germane load. Conversely, fellows perceived that excessive teaching increased extraneous load. Instances of germane load-promoting teaching activities correlated moderately with measured germane load.

CONCLUSIONS

Teaching in the exemplar procedural setting of colonoscopy affected learners' cognitive load in mostly beneficial ways, yet even 'good' teaching activities had detrimental effects when used excessively. Teachers of procedures should consider learner experience, task complexity and environmental factors to modulate the modality, content and intensity of teaching to promote balanced cognitive load and learning. Teaching more reservedly during the procedure and taking advantage of pre- and post-procedure opportunities may help.

Perceptual and Interpretive Error in Diagnostic Radiology-Causes and Potential Solutions

Interpretation of increasingly complex imaging studies involves multiple intricate tasks requiring visual evaluation, cognitive processing, and decision-making. At each stage of this process, there are opportunities for error due to human factors including perceptual and ergonomic conditions. Investigation into the root causes of interpretive error in radiology first began over a century ago. In more recent work, there has been increasing recognition of the limits of human image perception and other human factors and greater acknowledgement of the role of the radiologist's environment in increasing the risk of error. This article reviews the state of research on perceptual and interpretive error in radiology. This article focuses on avenues for further error examination, and strategies for mitigating these errors are discussed. The relationship between artificial intelligence and interpretive error is also considered.

Cognitive load theory for training health professionals in the workplace: A BEME review of studies among diverse professions: BEME Guide No. 53

AIM

Cognitive load theory (CLT) is of increasing interest to health professions education researchers. CLT has intuitive applicability to workplace settings, yet how CLT should inform teaching, learning, and research in health professions workplaces is unclear.

METHOD

To map the existing literature, we performed a scoping review of studies involving cognitive load, mental effort and/or mental workload in professional workplace settings within and outside of the health professions. We included actual and simulated workplaces and workplace tasks.

RESULT

Searching eight databases, we identified 4571 citations, of which 116 met inclusion criteria. Studies were most often quantitative. Methods to measure cognitive load included psychometric, physiologic, and secondary task approaches. Few covariates of cognitive load or performance were studied. Overall cognitive load and intrinsic load were consistently negatively associated with the level of experience and performance. Studies consistently found distractions and other aspects of workplace environments as contributing to extraneous load. Studies outside the health professions documented similar findings to those within the health professions, supporting relevance of CLT to workplace learning.

CONCLUSION

The authors discuss implications for workplace teaching, curricular design, learning environment, and metacognition. To advance workplace learning, the authors suggest future CLT research should address higher-level questions and integrate other learning frameworks.