An Update Survey of Academic Radiologists' Clinical Productivity

Virtual Visiting Professorship Program as an Opportunity for Academic and Clinical Advancement Beyond the COVID-19 Pandemic: A Survey of Participants

OBJECTIVE

To identify structure, benefits, and shortcomings of a multi-institutional virtual visiting professorship (VVP) program from 2020 to 2022, 2 years after inception and after gradual resumption of an in-person, prepandemic academic environment.

METHODS

An IRB-exempt, 70-question survey about structure, benefits, and shortcomings of the VVP program was distributed to its participants (14 breast imaging departments across the U.S.), using the snowball sampling technique.

RESULTS

A total of 72 responses were received; 54.2% (32/59) radiologists >5 years of experience, 18.6% (11/59) radiologists <5 years of experience, 15.3% (9/59) residents, and 8.5% (5/59) fellows. Radiologists' attendance increased from 8% (5/59) to 53% (31/59) over 2 years, with 69% (41/59) of respondents supporting continued participation. The most important factors for attendance were expanding breast imaging knowledge (86.4% [51/59]) and the virtual format (76.2% [45/59]). The number of presented lectures increased from 1 to 3 lectures in 43.7% (7/16) of programs in year 1 and from 4 to 9 lectures in 50% (8/16) of programs in year 2. The greatest professional benefits were collaborations on publications for organizers (56.3% [9/16]) and building academic portfolios for presenters (50% [7/14]). For trainees, attending the program increased their knowledge (64.3% [9/14]) and enthusiasm for breast imaging (50% [7/14]).

CONCLUSION

The VVP program facilitated scholarly collaboration among breast imaging radiologists, promoted academic portfolios for junior faculty, and increased enthusiasm for breast imaging for trainees. These accomplishments extended beyond the COVID-19 pandemic, as evidenced by the growth of the program after resumption of an in-person academic environment. Future expansion to other programs would benefit more practicing radiologists.

Factors Contributing to Disproportionate Burnout in Women Breast Imaging Radiologists: A Review

Physician burnout continues to increase in prevalence and disproportionately affects women physicians. Breast imaging is a woman-dominated subspeciality, and therefore, worsening burnout among women physicians may have significant repercussions on the future of the breast imaging profession. Systemic and organizational factors have been shown to be the greatest contributors to burnout beyond individual factors. Based on the Mayo Model, we review the evidence regarding the 7 major organizational contributors to physician burnout and their potential disproportionate impacts on women breast radiologists. The major organizational factors discussed are work-life integration, control and flexibility, workload and job demands, efficiency and resources, finding meaning in work, social support and community at work, and organizational culture and values. We also propose potential strategies for institutions and practices to mitigate burnout in women breast imaging radiologists. Many of these strategies could also benefit men breast imaging radiologists, who are at risk for burnout as well.

Research output of radiologists in Australia and New Zealand: Strengths, weaknesses and future directions

INTRODUCTION

Clinical radiology is a popular career. However, academic radiology in Australia and New Zealand (ANZ) has not traditionally been a strength of the specialty which has a focus on clinical medicine and has been influenced by corporatisation of the specialty. The aim of this study was to review the source(s) of radiologist-led research in Australia and New Zealand, to identify areas of relative deficiency and propose plans to improve research output.

METHODS

A manual search was performed of all manuscripts in seven popular ANZ journals, where the corresponding or senior author was a radiologist. Publications between January 2017 and April 2022 were included.

RESULTS

There were 285 manuscripts from ANZ radiologists during the study period. This equates to 10.7 manuscripts per 100 radiologists based on RANZCR census data. Radiologists in Northern Territory, Victoria, Western Australia, South Australia and the Australian Capital Territory all produced manuscripts above the corrected mean incidence rate of 10.7 manuscripts per 100 radiologists. However, locations including Tasmania, New South Wales, New Zealand and Queensland were below the mean. The majority of manuscripts arose from public teaching hospitals with accredited trainees (86%), and there were a higher proportion of manuscripts published by female radiologists (11.5 compared to 10.4 per 100 radiologists).

CONCLUSION

Radiologists in ANZ are academically active; however, interventions aimed at increasing output could be targeted at certain locations and/or areas within a busy private sector. Time, culture, infrastructure and research support are vital, but personal motivation is also extremely important.

Current State of Private Practice and Academic Interventional Radiology: Differences in Practice Structure, Case Mix, and Productivity

PURPOSE

To investigate whether private practice interventional radiology (IR) groups self-report higher overall productivity given differing case mix and more diagnostic radiology interpretation.

MATERIALS AND METHODS

A 60-question survey was distributed to 3,159 self-identified US IR physicians via the Society of Interventional Radiologists member search engine, with 357 responses (11.3% response rate). Of these responses, there were 258 unique practices from 34 US states.

RESULTS

Out of 84 IR group responses, private practice IR (PPIR) physicians reported a minimal trend for higher annual work relative value units (wRVUs) per clinical full-time equivalent compared with academic IR physicians (8,000 versus 7,140, P = .202), but this did not reach statistical significance. PPIR groups reported fewer median weekly hours (50 versus 52), more frequent call (every 6 versus every 5 days), and significantly higher median tenured compensation ($573,000 versus $451,000, P = .000). Out of 179 responses, academic practices reported significantly higher case percentages of interventional oncology and complex hepatobiliary intervention (P <.001), and private practices reported significantly higher percentages of musculoskeletal intervention (P < .001) with a nonsignificant trend for stroke or neurologic intervention (P = .010). Private practices reported more wRVUs from the interpretation of diagnostic imaging, at 26% of total wRVU production compared with 7% of total wRVU production for academic practices (P < .001; n = 131).

CONCLUSIONS

Self-reported data from private and academic IR groups suggest minimally higher wRVUs per clinical full-time equivalent among PPIRs with lower weekly work hours, more frequent call, differing case mix, and significantly higher tenured compensation among PPIR groups.

Clinician-Scientists: Can They Survive in the Modern Era?

Clinician-scientists are commonly characterized as health care professionals who are proficient in both research and clinical practice. Their dual expertise positions them to play a vital role in translating research outcomes to clinical practice. However, economic changes in the past few decades are threatening their very survival. The purposes of this article are to review some of the economic forces that pose the greatest risks to clinician-scientists in the modern era and to glean lessons from the business world in overcoming these challenges. Health care consolidation and decreasing reimbursements are putting increasing financial pressure on academic institutions, leaving them more inclined to cut back on departmental research support. Innovative companies commit a certain percentage of their revenue to research and discovery. Academic institutions should similarly view their research budget as research and discovery that will sustain the future growth of radiology. They should quantify and define expectations for academic productivity, focus on return on investment, and bolster the infrastructure to foster commercial partnerships that can provide additional revenue to support the research mission. Success in academics does not occur by accident. It requires more than individual talent and hard work. It also requires institutional leaders who are committed to developing future academic leaders and supporting innovation.

Productivity evaluation of radiologists interpreting computed tomography scans using statistical process control charts

Radiology service managers search for efficient ways to monitor productivity and improve capacity. One way to assess radiologists' productivity is by measuring their time to complete reports. Radiology reporting times (RRTs) may be monitored using statistical tools, such as process control charts (CCs). This study was carried out in the radiology sector of a University-based general hospital with 850 inward beds. Productivity was monitored using CCs. The selected control variable was RRTs, and process capability was calculated using C_p and C_pk indices. Only chest computed tomography scans were analyzed, totaling 2862 exams over a 6-month period. Our objective was to develop a simple tool to monitor radiologist performance, as given by RRT, over time. For that, we constructed CCs using data from 10 radiologists to monitor the stability of their RRTs. Only 3 radiologists presented mean times below the group average; 6 displayed a trend in RRTs that characterized performance improvement, while 4 displayed the opposite trend. Capability measures for the group indicated a process that is not capable. We demonstrate that CCs may be a useful tool for monitoring radiologists' performances in CT scans interpretation. Results demonstrated that in the individual CT reporting process, common cause variability is the type of variability most frequently observed, being most likely related to natural variations in features of the images analyzed. Lastly, CCs may also assist in decision making in the sector, such as establishing minimum productivity goals based on historical performance.

Impact of the COVID-19 pandemic on radiology physician work RVUs at a large subspecialized radiology practice

PURPOSE

As the COVID-19 pandemic continues, efforts by radiology departments to protect patients and healthcare workers and mitigate disease spread have reduced imaging volumes. This study aims to quantify the pandemic's impact on physician productivity across radiology practice areas as measured by physician work Relative Value Units (wRVUs).

MATERIALS AND METHODS

All signed diagnostic and procedural radiology reports were curated from January 1st to July 1st of 2019 and 2020. Physician work RVUs were assigned to each study type based on the Medicare Physician Fee Schedule. Utilizing divisional assignments, radiologist schedules were mapped to each report to generate a sum of wRVUs credited to that division for each week. Differential impact on divisions were calculated relative to a matched timeframe in 2019 and a same length pre-pandemic time period in 2020.

RESULTS

All practice areas saw a substantial decrease in wRVUs from the 2020 pre- to intra-pandemic time period with a mean decrease of 51.5% (range 15.4%-76.9%). The largest declines were in Breast imaging, Musculoskeletal, and Neuroradiology, which had decreases of 76.9%, 75.3%, and 67.5%, respectively. The modalities with the greatest percentage decrease were mammography, MRI, and non-PET nuclear medicine.

CONCLUSION

All radiology practice areas and modalities experienced a substantial decrease in wRVUs. The greatest decline was in Breast imaging, Neuroradiology, and Musculoskeletal radiology. Understanding the differential impact of the pandemic on practice areas will help radiology departments prepare for the potential depth and duration of the pandemic by better understanding staffing needs and the financial effects.

A roadmap of resident-led initiatives to promote research within the radiology department

RATIONAL

While radiology residents must participate in a scholarly project per Accreditation Council for Graduate Medical Education (ACGME) Program Requirements, some residency programs may lack a well-thought out, cohesive approach to research that incorporates the residents' perspective. Our objective was to improve the radiology resident research experience with resident-led initiatives.

MATERIAL AND METHODS

An annual resident research survey was created and distributed to 28 radiology residents in December 2018. Following the survey, a newly formed resident research committee developed a six-step strategic framework of resident-led initiatives to promote research and scholarly activity within the department: Reflect, Recruit, Regroup, Revive, Recognize, and Review. Outcomes of this framework were evaluated with the second annual resident research survey in December 2019.

RESULTS

Our institution identified areas of improvement on the 2019 survey after the implementation of the six-step initiatives upon comparison to the 2018 survey. A greater number of residents reported that they had adequate or somewhat adequate resources for research within the department in 2019 (95.2% [20/21]) in comparison to 2018 (70.6% [12/17]) (p = 0.03). A greater percentage of residents found available research projects engaging/interesting in 2019 (80.9% [17/21]) compared to 2018 (70.6% 12/17) (p = 0.49). The most commonly reported departmental resources needed to encourage research on the 2019 survey were dedicated research time (26.9%, 18 out of 67 total responses) and mentorship/encouragement from the faculty (19.4%, 13/67).

CONCLUSION

With a specific framework and appropriate departmental support, resident-led initiatives can improve the research experience within the radiology department from the residents' perspective.

Deep Learning Improves Osteonecrosis Prediction of Femoral Head After Internal Fixation Using Hybrid Patient and Radiograph Variables

Femoral neck fractures (FNFs) are a great public health problem that leads to a high incidence of death and dysfunction. Osteonecrosis of the femoral head (ONFH) after internal fixation of FNF is a frequently reported complication and a major cause for reoperation. Early intervention can prevent osteonecrosis aggravation at the preliminary stage. However, at present, failure to diagnose asymptomatic ONFH after FNF fixation hinders effective intervention at early stages. The primary objective of this study was to develop a predictive model for postoperative ONFH using deep learning (DL) methods developed using plain X-ray radiographs and hybrid patient variables. A two-center retrospective study of patients who underwent closed reduction and cannulated screw fixation was performed. We trained a convolutional neural network (CNN) model using postoperative pelvic radiographs and the output regressive radiograph variables. A less experienced orthopedic doctor, and an experienced orthopedic doctor also evaluated and diagnosed the patients using postoperative pelvic radiographs. Hybrid nomograms were developed based on patient and radiograph variables to determine predictive performance. A total of 238 patients, including 95 ONFH patients and 143 non-ONFH patients, were included. A CNN model was trained using postoperative radiographs and output radiograph variables. The accuracy of the validation set was 0.873 for the CNN model, and the algorithm achieved an area under the curve (AUC) value of 0.912 for the prediction. The diagnostic and predictive ability of the algorithm was superior to that of the two doctors, based on the postoperative X-rays. The addition of DL-based radiograph variables to the clinical nomogram improved predictive performance, resulting in an AUC of 0.948 (95% CI, 0.920-0.976) and better calibration. The decision curve analysis showed that adding the DL increased the clinical usefulness of the nomogram compared with a clinical approach alone. In conclusion, we constructed a DL facilitated nomogram that incorporated a hybrid of radiograph and patient variables, which can be used to improve the prediction of preoperative osteonecrosis of the femoral head after internal fixation.

Radiological 'SATs' monitor: The use of 'study ascribable times' to assess the impact of clinical workload on resident training in a resource-limited setting

INTRODUCTION

Globally, increasing clinical demands threaten postgraduate radiology training programmes. Time-based assessment of clinical workload is optimal in the academic environment, where an estimated 30% of consultant time should ideally be devoted to non-reporting activities. There has been limited analysis of the academic radiologist workload in low- and middle-income countries.

METHODS

Departmental staffing and clinical statistics were reviewed for 2008 and 2017. The Royal Australian and New Zealand College of Radiologists 'study ascribable times' (RANZCR-SATs) for primary consultant reporting were used with the Royal College of Radiologists (RCR) 2012 guidelines for secondary review of resident reports, to estimate the total consultant-hours required for each year's clinical workload. Analyses were stratified by type of investigation (plain-film vs. special) and expressed as a proportion of the total annual available consultant working hours.

RESULTS

Reporting all investigations required 90% and 100%, while reporting special investigations alone, demanded 53% and 69% of annual consultant working hours in 2008 and 2017, respectively. Between 2008 and 2017, the proportion of consultant time available for plain-film reporting decreased from 17% to 1%, while preserving 30% for non-reporting activities.

CONCLUSION

A time-based analysis of the academic radiologist's clinical workload, utilizing the RANZCR-SATs and RCR 2012 guidelines for primary and secondary reporting, respectively, provides a reasonably accurate reflection of the service pressures in resource-constrained environments and has potential international applicability.

How Many Radiographs Does It Take to Screen for Femoral Cam Morphology?: A Noninferiority Study

PURPOSE

To compare a 2-view radiograph series (AP of the pelvis and 45° Dunn of the hip) with a 5-view radiograph series for sensitivity in identifying femoral cam morphology.

MATERIALS AND METHODS

This is a retrospective review of consecutive patients with a 5-view radiograph series (AP pelvis and AP, 45° Dunn, frog lateral, and false profile of the affected hip) from 2016 to 2017. Three fellowship trained radiologists blindly and independently evaluated 2 views (AP pelvis and Dunn) for a femoral cam lesion, acetabular rim calcification, Tonnis grade, and important incidental findings. Two weeks later, the same assessment was made on all 5 views. A noninferiority test of the 2-view series vs the 5-view series for sensitivity in identifying femoral cam morphology was conducted. Individual reader sensitivity calculations were performed and agreement was determined with the kappa statistic.

RESULTS

The 2-view series was noninferior to the 5-view series for cam identification (P value = 0.010). In comparing the 2-view vs 5-view series for individual readers, there was no difference in the sensitivities (84%-100% vs 85%-98%, P = 0.85-1.0) or specificities (11%-56% vs 7%-56%, P = 0.58-1.0) for cam identification. There was fair to excellent 2-view intrareader agreement (k = 0.38-0.93) and similar inter-reader agreement between the 2-view and 5-view (k = 0.33 vs 0.37).

CONCLUSIONS

A 2-view radiograph series (AP pelvis and Dunn hip) is noninferior to a 5-view radiograph series for sensitivity in identifying femoral cam morphology.

Effect of Analytics-Driven Worklists on Musculoskeletal MRI Interpretation Times in an Academic Setting

OBJECTIVE. The objective of this study was to determine how use of analytics-driven worklists for MRI based on relative individual interpretation time affects the overall group interpretation time in an academic musculoskeletal practice. SUBJECTS AND METHODS. In this prospective study, interpretation times for all MRI studies signed by three musculoskeletal fellowship-trained radiologists during 2016 were calculated from initial study view and report signing times. Custom worklists were made for each radiologist with body parts ordered from the fastest to the slowest based on relative interpretation time. These worklists were then used for a trial period of 7 consecutive days. The difference in mean interpretation times between the trial period and baseline and the differences in volume distribution were calculated. Changes in individual interpretation time were assessed by z-score with statistical significance set at ≤ 0.05. RESULTS. Across all readers, total interpretation time decreased by a mean of 29.5 minutes per day during the trial period. Only two types of studies were read with an individual interpretation time significantly different from baseline (wrist studies for reader 1 were 10 minutes slower [p = 0.01] and cervical spine studies for reader 3 were 9 minutes faster [p < 0.01]). Volume distributions changed across various body parts (-3% to 4% for reader 1, -13% to 14% for reader 2, and -24% to 10% for reader 3). CONCLUSION. Analytics-driven worklists for MRI may decrease overall group interpretation time without significant alteration in individual speed, though a change in volume distribution is required.

Performance of a Deep Learning Algorithm in Detecting Osteonecrosis of the Femoral Head on Digital Radiography: A Comparison With Assessments by Radiologists

OBJECTIVE. The objective of our study was to compare the sensitivity of a deep learning (DL) algorithm with the assessments by radiologists in diagnosing osteonecrosis of the femoral head (ONFH) using digital radiography. MATERIALS AND METHODS. We performed a two-center, retrospective, noninferiority study of consecutive patients (≥ 16 years old) with a diagnosis of ONFH based on MR images. We investigated the following four datasets of unilaterally cropped hip anteroposterior radiographs: training (n = 1346), internal validation (n = 148), temporal external test (n = 148), and geographic external test (n = 250). Diagnostic performance was measured for a DL algorithm, a less experienced radiologist, and an experienced radiologist. Noninferiority analyses for sensitivity were performed for the DL algorithm and both radiologists. Subgroup analysis for precollapse and postcollapse ONFH was done. RESULTS. Overall, 1892 hips (1037 diseased and 855 normal) were included. Sensitivity and specificity for the temporal external test set were 84.8% and 91.3% for the DL algorithm, 77.6% and 100.0% for the less experienced radiologist, and 82.4% and 100.0% for the experienced radiologist. Sensitivity and specificity for the geographic external test set were 75.2% and 97.2% for the DL algorithm, 77.6% and 75.0% for the less experienced radiologist, and 78.0% and 86.1% for the experienced radiologist. The sensitivity of the DL algorithm was noninferior to that of the assessments by both radiologists. The DL algorithm was more sensitive for precollapse ONFH than the assessment by the less experienced radiologist in the temporal external test set (75.9% vs 57.4%; 95% CI of the difference, 4.5-32.8%). CONCLUSION. The sensitivity of the DL algorithm for diagnosing ONFH using digital radiography was noninferior to that of both less experienced and experienced radiologist assessments.

Who's Contributing Most to American Neuroscience Journals: American or Foreign Authors?

BACKGROUND AND PURPOSE

With globalization, the contributions of authors from abroad to the American published literature has increased. We sought to determine the changes with time in the proportional contributions of American and non-American authors in the American neurosciences literature. We hypothesized the following: 1) During the past 21 years, manuscript contributions of American institutions have proportionally decreased in neuroradiology, more than in neurosurgery or neurology; 2) contributions of Asian institutions have affected neuroradiology more than neurosurgery and neurology; and 3) American articles garner more citations.

MATERIALS AND METHODS

We reviewed the May issues of 2 of the highest impact American-based neurology, neurosurgery, and neuroradiology journals published from 1997 to 2017. We counted the number of articles published by nation based on the institution of origin. We looked at trends across time and compared neurology, neurosurgery, and neuroradiology journals. We also gathered data on the number of citations of each article by nationality.

RESULTS

We reviewed 3025 articles. There was a significantly lower ratio of American to non-American authorship in neuroradiology versus neurology/neurosurgery journals (odds ratio = 0.70; 95% confidence interval, 0.60-0.82). There was a significantly decreasing trend in American authorship across the 21 years in neuroradiology. Of the countries outside the United States, Japan contributed most for neuroradiology and neurosurgery journals, and the UK, for neurology. American-authored articles were cited, on average, 1.25 times more frequently than non-American-authored articles.

CONCLUSIONS

Non-American contributions have impacted neuroradiology more than other clinical neuroscience fields with Asian authorship showing the greatest impact. That impact is growing, and the causes are manifold. Nonetheless American-authored articles are cited more.

Radiologists' Variation of Time to Read Across Different Procedure Types

The workload of US radiologists has increased over the past two decades as measured through total annual relative value units (RVUs). This increase in RVUs generated suggests that radiologists' productivity has increased. However, true productivity (output unit per input unit; RVU per time) is at large unknown since actual time required to interpret and report a case is rarely recorded. In this study, we analyzed how the time to read a case varies between radiologists over a set of different procedure types by retrospectively extracting reading times from PACS usage logs. Specifically, we tested two hypotheses that; i) relative variation in time to read per procedure type increases as the median time to read a procedure type increases, and ii) relative rankings in terms of median reading speed for individual radiologists are consistent across different procedure types. The results that, i) a correlation of -0.25 between the coefficient of variation and median time to read and ii) that only 12 out of 46 radiologists had consistent rankings in terms of time to read across different procedure types, show both hypotheses to be without support. The results show that workload distribution will not follow any general rule for a radiologist across all procedures or a general rule for a specific procedure across many readers. Rather the findings suggest that improved overall practice efficiency can be achieved only by taking into account radiologists' individual productivity per procedure type when distributing unread cases.

The Current State of Radiology Call Assistant Triage Programs Among US Radiology Residency Programs

RATIONALE AND OBJECTIVES

Given increasing volume and workflow interruptions in radiology, we sought to identify and characterize radiology call assistant triage (RCAT) programs among US radiology residency programs.

MATERIALS AND METHODS

A survey was created using Qualtrics survey software and emailed to all members of the Association of Program Directors in Radiology listserv. A total of 296 active members belong to this listserv, including program directors and assistant program directors. The survey included questions about the existence and specifics of a call triage assistant program.

RESULTS

Data were obtained from 88 active members of the Association of Program Directors in Radiology (30% response rate). Of those, 20 programs (23%) have an RCAT program. Triage assistant staffing includes nonmedical or clerical staff (60%), medical students (30%), first-year radiology residents (5%), and technologists (5%). All respondents with RCAT programs report satisfaction with their program and plan to continue. A significant majority (75%) have no plans to change, whereas the remaining 25% are considering program expansion and pay increases. Among residency programs without RCAT programs, none reported termination of their triage program. The most common reasons for not having triage assistants include cost, lack of awareness, differing opinions on utility, and the presence of 24/7 attending coverage.

CONCLUSION

Twenty US radiology residency programs report having an RCAT program. All report satisfaction with their program despite different staffing models. RCAT programs may represent an effective measure in limiting interruptions and potentially decreasing interpretative errors made by residents on call.

Metrix Matrix: A Cloud-Based System for Tracking Non-Relative Value Unit Value-Added Work Metrics

PURPOSE

In the era of value-based medicine, it will become increasingly important for radiologists to provide metrics that demonstrate their value beyond clinical productivity. In this article the authors describe their institution's development of an easy-to-use system for tracking value-added but non-relative value unit (RVU)-based activities.

METHODS

Metrix Matrix is an efficient cloud-based system for tracking value-added work. A password-protected home page contains links to web-based forms created using Google Forms, with collected data populating Google Sheets spreadsheets. Value-added work metrics selected for tracking included interdisciplinary conferences, hospital committee meetings, consulting on nonbilled outside studies, and practice-based quality improvement. Over a period of 4 months, value-added work data were collected for all clinical attending faculty members in a university-based radiology department (n = 39). Time required for data entry was analyzed for 2 faculty members over the same time period.

RESULTS

Thirty-nine faculty members (equivalent to 36.4 full-time equivalents) reported a total of 1,223.5 hours of value-added work time (VAWT). A formula was used to calculate "value-added RVUs" (vRVUs) from VAWT. VAWT amounted to 5,793.6 vRVUs or 6.0% of total work performed (vRVUs plus work RVUs [wRVUs]). Were vRVUs considered equivalent to wRVUs for staffing purposes, this would require an additional 2.3 full-time equivalents, on the basis of average wRVU calculations. Mean data entry time was 56.1 seconds per day per faculty member.

CONCLUSIONS

As health care reimbursement evolves with an emphasis on value-based medicine, it is imperative that radiologists demonstrate the value they add to patient care beyond wRVUs. This free and easy-to-use cloud-based system allows the efficient quantification of value-added work activities.

Effect of Radiology Study Flow on Report Turnaround Time

OBJECTIVE

The purpose of this study was to assess the importance of relative value unit (RVU) flow and other factors in report turnaround time (TAT) in emergency radiologic operations.

MATERIALS AND METHODS

RVU flow was defined as the normalized (to 60 minutes) total work RVUs for studies performed in a given time interval of 30 minutes (RVU flow 30) or 60 minutes (RVU flow 60). Twenty-five weekday emergency radiology shifts each for four radiologists were randomly selected. The institutional radiology search engine was queried to obtain the following data for each study: study completion time, work RVU, attending radiologist, and report TAT. RVU flow 30, RVU flow 60, presence of resident, and number of hours since start of shift were computed. Two separate multiple linear regression analyses were performed with RVU flow 30 or RVU flow 60 and other factors as independent variables and TAT as the dependent variable.

RESULTS

The study included 7378 radiology studies from 100 weekday shifts, from which 1537 RVU flow 30 and 792 RVU flow 60 data points were generated. RVU flow 60 (p = 0.0026) and RVU flow 30 (< 0.0001) were significantly associated with radiology report TAT. One attending radiologist had statistically significant lower TAT 30 and TAT 60, whereas another had a lower TAT 30 but not TAT 60. The presence of a resident was significantly associated with reduced TAT 30 (p = 0.0005) and TAT 60 (p = 0.0028).

CONCLUSION

RVU flow 60, RVU flow 30, specific attending radiologist, and presence of a resident are significantly correlated with radiology report TAT. RVU flow should be considered when evaluating radiologist and overall system performance with respect to report TAT.

Perceptual errors in pediatric radiology

Perceptual errors are common contributors to missed diagnoses in the clinical practice of radiology. While the physical attributes of an image such as image resolution, signal-to-noise characteristics, and anatomic complexity are major causes of poor conspicuity of pathologic lesions, there are major interrelated cognitive contributors to visual errors. The first is satisfaction of search (SOS), where the detection of an abnormality results in premature termination of further search. Another form of incomplete search pattern is visual isolation, where a radiologist's search pattern is truncated to the main areas of an image, while little or no attention is given to peripheral areas. A second cognitive error is inattentional blindness, defined as the failure to notice a fully visible, but unexpected object because attention was otherwise engaged. Strategies for error mitigation have centered around the use of check lists, self prompting routines, and structured reporting within an institutional culture of safety and vigilance.

Baseline Survey of the Neuroradiology Work Environment in the United States with Reported Trends in Clinical Work, Nonclinical Work, Perceptions of Trainees, and Burnout Metrics

BACKGROUND AND PURPOSE

Neuroradiologists have faced continuously increasing clinical workloads. Our aim was to establish and report a baseline survey of the current neuroradiology work environment in the United States and of experiential changes in recent years.

MATERIALS AND METHODS

A voluntary survey was sent to practicing and out-of-training members of the American Society of Neuroradiology in the United States. Selected measures included workday volume and length, burnout symptoms, participation in academic and practice-building duties; effects on perceived interpretation quality, communication of abnormal results, and consideration of early retirement or career changes, among others.

RESULTS

Four hundred thirty-two respondents across a broad range of experience reported the following: 52.8% (224/424) with teaching responsibilities; 93% (399/430) with workdays extending at least 1 hour past expected, in 45% (193/430) frequently or always; 71.9% (309/430) reading more cases per hour compared to previous years; 79.5% (341/429) sometimes-to-always interpreting cases faster than comfortable for optimal interpretation; and 67.8% (292/431) sometimes or more often with inadequate time to discuss abnormal results. Burnout symptoms ranged between 49% and 75% (211/428 to 322/428) across 4 indices. For academic activities of teaching, mentoring, and research/publications, a mean of 94.3% reported cut-backs during the past few years. For practice-building activities, 92% reported cut-backs, 51.6% (222/429) considered early retirement, and 38.8% (167/429) considered changing careers.

CONCLUSIONS

Increasing clinical demands have coincided with destructive effects in the work environment and the ability and desire of neuroradiologists in the United States to perform academic or practice-building duties with a substantial incidence of burnout symptoms. While this survey does not prove causation, the trends and the correlations should be concerning to the leaders of radiology and warrant further monitoring.

Determinants of Pediatric Echocardiography Laboratory Productivity: Analysis from the Second Survey of the American Society of Echocardiography Committee on Echocardiography Laboratory Productivity

BACKGROUND

The American Society of Echocardiography Committee on Pediatric Echocardiography Laboratory Productivity aimed to study factors that could influence the clinical productivity of physicians and sonographers and assess longitudinal trends for the same. The first survey results indicated that productivity correlated with the total volume of echocardiograms.

METHODS

Survey questions were designed to assess productivity for (1) physician full-time equivalent (FTE) allocated to echocardiography reading (echocardiograms per physician FTE per day), (2) sonographer FTE (echocardiograms per sonographer FTE per year), and (3) machine utilization (echocardiograms per machine per year). Questions were also posed to assess work flow and workforce.

RESULTS

For fiscal year 2013 or academic year 2012-2013, the mean number of total echocardiograms-including outreach, transthoracic, fetal, and transesophageal echocardiograms-per physician FTE per day was 14.3 ± 5.9, the mean number of echocardiograms per sonographer FTE per year was 1,056 ± 441, and the mean number of echocardiograms per machine per year was 778 ± 303. Both physician and sonographer productivity was higher at high-volume surgical centers and with echocardiography slots scheduled concordantly with clinic visits. Having an advanced imaging fellow and outpatient sedation correlated negatively with clinical laboratory productivity. Machine utilization was greater in laboratories with higher sonographer and physician productivity and lower for machines obtained before 2009.

CONCLUSION

Measures of pediatric echocardiography laboratory staff productivity and machine utilization were shown to correlate positively with surgical volume, total echocardiography volumes, and concordant echocardiography scheduling; the same measures correlated negatively with having an advanced imaging fellow and outpatient sedation. There has been no significant change in staff productivity noted over two Committee on Pediatric Echocardiography Laboratory Productivity survey cycles, suggesting that hiring practices have matched laboratory volume increases.

Non-Relative Value Unit-Generating Activities Represent One-Fifth of Academic Neuroradiologist Productivity

BACKGROUND AND PURPOSE

A neuroradiologist's activity includes many tasks beyond interpreting relative value unit-generating imaging studies. Our aim was to test a simple method to record and quantify the non-relative value unit-generating clinical activity represented by consults and clinical conferences, including tumor boards.

MATERIALS AND METHODS

Four full-time neuroradiologists, working an average of 50% clinical and 50% academic activity, systematically recorded all the non-relative value unit-generating consults and conferences in which they were involved during 3 months by using a simple, Web-based, computer-based application accessible from smartphones, tablets, or computers. The number and type of imaging studies they interpreted during the same period and the associated relative value units were extracted from our billing system.

RESULTS

During 3 months, the 4 neuroradiologists working an average of 50% clinical activity interpreted 4241 relative value unit-generating imaging studies, representing 8152 work relative value units. During the same period, they recorded 792 non-relative value unit-generating study reviews as part of consults and conferences (not including reading room consults), representing 19% of the interpreted relative value unit-generating imaging studies.

CONCLUSIONS

We propose a simple Web-based smartphone app to record and quantify non-relative value unit-generating activities including consults, clinical conferences, and tumor boards. The quantification of non-relative value unit-generating activities is paramount in this time of a paradigm shift from volume to value. It also represents an important tool for determining staffing levels, which cannot be performed on the basis of relative value unit only, considering the importance of time spent by radiologists on non-relative value unit-generating activities. It may also influence payment models from medical centers to radiology departments or practices.

Improving Patient Care Through Medical Image Perception Research

The interpretation of medical images across medical specialties is critical to patient care. As technology changes, so does health care, and clinicians today are increasingly viewing medical images in a variety of environments. Although access to such data is useful, even clinicians with expertise in image interpretation make errors. These errors may become more frequent as clinician workdays become longer and the number of images to be interpreted becomes larger. To prevent errors in medical image interpretation, we need to understand the underlying perceptual and cognitive mechanisms that guide image interpretation. We can then use what is learned to develop better training methods, automated image analysis, and processing tools. We can devise methods to reduce clinician fatigue and stress, and develop practice guidelines thereby improving patient care and outcomes.

Canadian Association of Radiologists Annual Scientific Meetings: How Many Abstracts Go on to Publication?

PURPOSE

To determine the percentage of abstracts presented at the Canadian Association of Radiologists (CAR) annual scientific meetings that go on to publication.

METHODS

Records of previous CAR meetings from the years 2005-2011 were obtained. An Internet search was performed to determine which abstracts went on to publication. Abstracts were assessed according to exhibit category (Resident Award Papers), educational institution, publishing journal, and time to publication.

RESULTS

Of the 402 abstracts presented, 112 (28%) were published. Overall, an average of 37% of Radiologists-In-Training Presentations, 34% of Scientific Exhibits, and 20% of Educational Exhibits went on to publication. The University of British Columbia and University of Ottawa published the largest number of abstracts (66 and 62, respectively) from the years 2005-2011. The University of Montreal had the largest percentage of abstracts published (42%). The range of publishing journals was wide, but the top publisher was the Canadian Association of Radiologists Journal (27%). Eighty-three percent of abstracts were published within 3 years of being presented.

CONCLUSION

In total, 28% of all the abstracts presented at the CAR conferences between 2005 and 2011 were published. Further exploration into the reasons and barriers for abstracts not being published may be a next step in future research.

Of mice and men: escaping the relative value unit trap

Although radiologists have kept pace with the dramatic growth of medical imaging during the past two decades through the use of PACS, digital dictation, and 3-dimensional reconstruction, radiology is approaching the point of diminishing returns. As reimbursements further decline, attempts to increase radiologists' productivity risk commoditization of the specialty. The continued evolution of US health care policy, however, presents an opportunity for radiologists, using their core competencies, to shape the future direction of medicine.

Comprehensive review of the limitations of relative value unit measurements of productivity in academic departments

Measuring radiologist, especially sonologist, productivity has never been of greater interest than now, as radiology has moved from its historical status as a cost center to the largest revenue generator in most institutions. With more local institutional and federal oversight and regulation into the reimbursement and valuation of imaging procedures, including emphasis on outsourcing, overvalued procedures, and bundling, the ability to measure productivity and to draw meaningful conclusions from the data becomes increasingly imperative if we as radiologists and sonologists expect to contribute meaningfully to the process. This article presents a history of the "relative value unit" and discusses the valuation of radiologist/sonologist productivity in this era of ubiquitous high-technology implementation.

Cognitive and system factors contributing to diagnostic errors in radiology

OBJECTIVE

In this article, we describe some of the cognitive and system-based sources of detection and interpretation errors in diagnostic radiology and discuss potential approaches to help reduce misdiagnoses.

CONCLUSION

Every radiologist worries about missing a diagnosis or giving a false-positive reading. The retrospective error rate among radiologic examinations is approximately 30%, with real-time errors in daily radiology practice averaging 3-5%. Nearly 75% of all medical malpractice claims against radiologists are related to diagnostic errors. As medical reimbursement trends downward, radiologists attempt to compensate by undertaking additional responsibilities to increase productivity. The increased workload, rising quality expectations, cognitive biases, and poor system factors all contribute to diagnostic errors in radiology. Diagnostic errors are underrecognized and underappreciated in radiology practice. This is due to the inability to obtain reliable national estimates of the impact, the difficulty in evaluating effectiveness of potential interventions, and the poor response to systemwide solutions. Most of our clinical work is executed through type 1 processes to minimize cost, anxiety, and delay; however, type 1 processes are also vulnerable to errors. Instead of trying to completely eliminate cognitive shortcuts that serve us well most of the time, becoming aware of common biases and using metacognitive strategies to mitigate the effects have the potential to create sustainable improvement in diagnostic errors.

Analysis of dominant factors affecting fatigue caused by soft-copy reading

RATIONALE AND OBJECTIVES

The aim of this study was to analyze the dominant factors affecting fatigue caused by soft-copy reading to identify a method for decreasing fatigue in clinical practice.

MATERIALS AND METHODS

Two types of fatigue-fatigue in the central nervous system and subjective visual fatigue-were evaluated using a critical fusion frequency test and a questionnaire administered to 17 male radiologists before and after soft-copy reading. Reading-induced fatigue was assumed to be affected by 20 hypothetical factors associated with personal characteristics, time required for reading, content or amount of reading, and the reading environment. We used multiple linear regression analysis with a variable selection method to detect the best combination of factors capable of expressing variations in each of the measured fatigue values. The effects of the detected (dominant) factors on fatigue were also examined based on coefficients of the dominant factors in multiple regression models.

RESULTS

Fatigue in the central nervous system decreased with a higher corrected visual acuity and a higher ambient illuminance in the reading room and was also affected by the type of monitor used. Visual fatigue was relieved when there was a larger difference in the brightness of the monitor and the surfaces surrounding the monitor and tended to be more severe when glasses rather than contact lenses were worn.

CONCLUSIONS

Increasing the ambient illuminance, using an appropriate type of monitor, improving the corrected visual acuity, and using contact lenses rather than eyeglasses could help decrease reading-induced fatigue in male radiologists.

Merits of usability testing for PACS selection

OBJECTIVES

To compare the usability of different Picture Archiving and Communication System (PACS) workstations, determine whether a usability test has added value with respect to the traditional way of comparing PACSs based on functional requirements, and to evaluate the appropriateness of a task-based methodology for a PACS usability test.

METHODS

A task-based usability test of four PACS workstations was performed. Radiologists' subjective responses to the PACSs and their performance on the tasks were measured. To mimic the traditional PACS selection process, two functional requirements were defined which the PACSs met in varying degrees. The focus of the usability test was on the aspects of the PACS related to these requirements. The usability results were compared to the PACSs' ability to meet the functional requirements.

RESULTS

One PACS outperformed the other PACSs both in terms of subjective preference and task performance, indicating its superior usability. There were differences in usability between PACSs with identical functionality. Also, a PACS with theoretically advantageous functionality for a given task did not necessarily have better usability for this task than a PACS without this functionality. There was a discrepancy between participants' subjective preferences and their task performance, which indicates that it is vital to include performance measures in the usability assessment so that it accurately reflects the efficiency of interaction.

CONCLUSIONS

The differences in usability between PACSs with identical functionality indicate that functional requirements alone are insufficient to determine a PACS's overall quality. A usability test should therefore be used in addition to a functional requirement list in a PACS selection process to ensure that a hospital buys the PACS with the highest quality. A task-based usability evaluation methodology, which yields both subjective preference data and objective performance data of radiologists interacting with the PACS, is very suitable for such a usability test.

Medical imaging displays and their use in image interpretation

The adequate and repeatable performance of the image display system is a key element of information technology platforms in a modern radiology department. However, despite the wide availability of high-end computing platforms and advanced color and gray-scale monitors, the quality and properties of the final displayed medical image may often be inadequate for diagnostic purposes if the displays are not configured and maintained properly. In this article-an expanded version of the Radiological Society of North America educational module "Image Display"-the authors discuss fundamentals of image display hardware, quality control and quality assurance processes for optimal image interpretation settings, and parameters of the viewing environment that influence reader performance. Radiologists, medical physicists, and other allied professionals should strive to understand the role of display technology and proper usage for a quality radiology practice. The display settings and display quality control and quality assurance processes described in this article can help ensure high standards of perceived image quality and image interpretation accuracy.

Do long radiology workdays affect nodule detection in dynamic CT interpretation?

PURPOSE

A previous study demonstrated decreased diagnostic accuracy for finding fractures and decreased ability to focus on skeletal radiographs after a long working day. Skeletal radiographic examinations commonly have images that are displayed statically. The aim of this study was to investigate whether diagnostic accuracy for detecting pulmonary nodules on CT of the chest displayed dynamically would be similarly affected by fatigue.

METHODS

Twenty-two radiologists and 22 residents were given 2 tests searching CT chest sequences for a solitary pulmonary nodule before and after a day of clinical reading. To measure search time, 10 lung CT sequences, each containing 20 consecutive sections and a single nodule, were inspected using free search and navigation. To measure diagnostic accuracy, 100 CT sequences, each with 20 sections and half with nodules, were displayed at preset scrolling speed and duration. Accuracy was measured using receiver operating characteristic curve analysis. Visual strain was measured via dark vergence, an indicator of the ability to keep the eyes focused on the display.

RESULTS

Diagnostic accuracy was reduced after a day of clinical reading (P = .0246), but search time was not affected (P > .05). After a day of reading, dark vergence was significantly larger and more variable (P = .0098), reflecting higher levels of visual strain, and subjective ratings of fatigue were also higher.

CONCLUSIONS

After their usual workday, radiologists experience increased fatigue and decreased diagnostic accuracy for detecting pulmonary nodules on CT. Effects of fatigue may be mitigated by active interaction with the display.

Current perspectives in medical image perception

Medical images constitute a core portion of the information a physician utilizes to render diagnostic and treatment decisions. At a fundamental level, this diagnostic process involves two basic processes: visually inspecting the image (visual perception) and rendering an interpretation (cognition). The likelihood of error in the interpretation of medical images is, unfortunately, not negligible. Errors do occur, and patients' lives are impacted, underscoring our need to understand how physicians interact with the information in an image during the interpretation process. With improved understanding, we can develop ways to further improve decision making and, thus, to improve patient care. The science of medical image perception is dedicated to understanding and improving the clinical interpretation process.

Interventional oncology research in the United States: slowing growth, limited focus, and a low level of funding

PURPOSE

To establish the characteristics of published interventional oncology (IO) research, including the volume, growth, geographic distribution, type of research, and funding patterns, and to determine how IO research compares with overall radiology research.

MATERIALS AND METHODS

This retrospective bibliometric analysis of public data was exempt from Institutional Review Board approval. IO articles published between 1996 and 2008 were identified in the National Library of Medicine MEDLINE database. Country of origin, article methodology, study topic, and source of funding were recorded. Growth was analyzed by using linear and nonlinear regression.

RESULTS

Total journal articles numbered 3801, including 847 (22.3%) from the United States, 722 (19.0%) from Japan, and 390 (10.3%) from China. World publications grew with a sigmoid (logistic) pattern (predicted maximum of 586.8 articles per year, P < .001). The United States and China also had logistic and slowing growth (maximums of 111.0 and 48.1 articles per year, respectively; both P < .001). Growth was linear in Japan (growth of 3.0 articles per year, P < .001) and exponential and accelerating in Germany, Italy, South Korea, France, and the United Kingdom. The United States produced 187 (36.9%) review articles but only 52 (13.1%) clinical trials. Japan (75, 18.8%) and China (71, 17.8%) both produced more clinical trials than other countries. U.S. IO articles were less likely than general radiology articles to receive funding from government (12.5% vs 23.7%) and nongovernment (15.0% vs 17.0%) sources. Liver cancer articles constituted 2388 (62.8%) of all IO articles.

CONCLUSION

IO research is slowing in the United States but growing elsewhere. Japan and China are leaders in clinical trial research. U.S. IO research receives less funding than does overall radiology research. IO research focuses primarily on liver cancer.

Long radiology workdays reduce detection and accommodation accuracy

PURPOSE

The aim of this study was to measure the diagnostic accuracy of fracture detection, visual accommodation, reading time, and subjective ratings of fatigue and visual strain before and after a day of clinical reading.

METHODS

Forty attending radiologists and radiology residents viewed 60 deidentified, HIPAA-compliant bone examinations, half with fractures, once before any clinical reading (early) and once after a day of clinical reading (late). Reading time was recorded. Visual accommodation (the ability to maintain focus) was measured before and after each reading session. Subjective ratings of symptoms of fatigue and oculomotor strain were collected. The study was approved by local institutional review boards.

RESULTS

Diagnostic accuracy was reduced significantly after a day of clinical reading, with average areas under the receiver operating characteristic curves of 0.885 for early reading and 0.852 for late reading (P < .05). After a day of image interpretation, visual accommodation was no more variable, though error in visual accommodation was greater (P < .01), and subjective ratings of fatigue were higher.

CONCLUSIONS

After a day of clinical reading, radiologists have reduced ability to focus, increased symptoms of fatigue and oculomotor strain, and reduced ability to detect fractures. Radiologists need to be aware of the effects of fatigue on diagnostic accuracy and take steps to mitigate these effects.

What factors affect the productivity and efficiency of physician practices?

BACKGROUND

Increasing the productivity and efficiency of physician practices could help relieve the rapid growth of US healthcare costs and the expected physician shortage. Radiology practices are an attractive specific focus for research on practices' productivity and efficiency because they are home to many purportedly productivity-enhancing operational technologies. This affords an opportunity to study the effect of production technology on physicians' output. As well, radiology is a leader in the general movement of physicians out of very small practices. And imaging is by the fastest-growing category of physician expenditure.

RESEARCH DESIGN

Using data from 2003 to 2007 surveys of radiologists, we estimate a stochastic frontier model to study the effects of practice characteristics, such as work hours, practice size, and output mix, and technologies used in work production, on practices' productivity and efficiency.

RESULTS

At the mean, the elasticities of output with respect to practice size and annual hours worked per full-time physician were 0.73 and 0.51, respectively. Some production technologies increase productivity by 15% to 20%; others generate no increase. Using "nighthawks"--ie, contracting out after-hours work to external firms that consolidate workflow--significantly increases practice efficiency.

CONCLUSIONS

The general US trend toward larger practice size is unlikely to relieve cost or physician shortage pressures. The actual effect of purportedly productivity-enhancing operational technologies needs to be carefully evaluated before they are widely adopted. As the recently-developed innovations of nighthawks and hospitalists show, practices should give more attention to a possible choice to "buy," rather than "make," part of their output.

Balancing clinical service and education in the radiology residency

RATIONALE AND OBJECTIVES

Among the various medical disciplines, the radiology residency faces unique challenges when balancing clinical service and education, which have not been explored in the literature.

MATERIALS AND METHODS

The authors present a summary of material generated during collaborative sessions at the 56th Annual Meeting of the Association of University Radiologists in Seattle, Washington, in March 2008, including strategies on maintaining an appropriate emphasis on education in the face of increasing service obligations, with a review of the pertinent literature.

RESULTS

Although the topic of service and education has been explored in the medical and surgical literature, little has been published in the radiology literature. The portability of radiology and the relative lack of patient contact can lead to the redistribution of residents as a matter of convenience to fill service gaps, often at the expense of the educational goals of training programs. Residents and faculty members alike must take part in both service and educational obligations without compromising patient care. Physician extenders, call schedule optimization, and other strategies and resources can help ensure that a proper balance is maintained.

CONCLUSION

The radiology residency presents unique challenges to the service and education balance. The authors highlight several strategies to address these challenges.

Subspecialization in radiology and radiation oncology

Practicing radiologists, radiation oncologists, and trainees were surveyed regarding the current state of subspecialization in practice and in training curricula. The authors present the results of these surveys, establish trends compared with previous survey data, and compare the plans of trainees with current postgraduate practice. Subspecialization is increasing in both radiology and radiation oncology. There remain substantial numbers of practitioners who perform work they deem "general" in nature. The authors also present a method to more accurately measure subspecialization and workload.