The Role of Perception in Imaging: Past and Future

The "Hungry Judge" effect on prostate MRI reporting: Chronobiological trends from 35'004 radiologist interpretations

AIM

To investigate the associations between the hour of the day and Prostate Imaging-Reporting and Data System (PI-RADS) scores assigned by radiologists in prostate MRI reports.

MATERIALS AND METHODS

Retrospective single-center collection of prostate MRI reports over an 8-year period. Mean PI-RADS scores assigned between 0800 and 1800 h were examined with a regression model.

RESULTS

A total of 35'004 prostate MRI interpretations by 26 radiologists were included. A significant association between the hour of day and mean PI-RADS score was identified (β2 = 0.005, p < 0.001), with malignant scores more frequently assigned later in the day.

CONCLUSION

These findings suggest chronobiological factors may contribute to variability in radiological assessments. Though the magnitude of the effect is small, this may potentially add variability and impact diagnostic accuracy.

Australian Dentist's Knowledge and Perceptions of Factors Affecting Radiographic Interpretation

BACKGROUND

Errors of interpretation of radigraphic images, also known as interpretive errors, are a critical concern as they can have profound implications for clinical decision making. Different types of interpretive errors, including errors of omission and misdiagnosis, have been described in the literature. These errors can lead to unnecessary or harmful treat/or prolonged patient care. Understanding the nature and contributing factors of interpretive errors is important in developing solutions to minimise interpretive errors. By exploring the knowledge and perceptions of dental practitioners, this study aimed to shed light on the current understanding of interpretive errors in dentistry.

METHODS

An anonymised online questionnaire was sent to dental practitioners in New South Wales (NSW) between September 2020 and March 2022. A total of 80 valid responses were received and analysed. Descriptive statistics and bivariate analysis were used to analyse the data.

RESULTS

The study found that participants commonly reported interpretive errors as occurring 'occasionally', with errors of omission being the most frequently encountered type. Participants identified several factors that most likely contribute to interpretive errors, including reading a poor-quality image, lack of clinical experience and knowledge, and excessive workload. Additionally, general practitioners and specialists held different views regarding factors affecting interpretive errors.

CONCLUSION

The survey results indicate that dental practitioners are aware of the common factors associated with interpretive errors. Errors of omission were identified as the most common type of error to occur in clinical practice. The findings suggest that interpretive errors result from a mental overload caused by factors associated with image quality, clinician-related, and image interpretation. Managing and identifying solutions to mitigate these factors are crucial for ensuring accurate and timely radiographic diagnoses. The findings of this study can serve as a foundation for future research and the development of targeted interventions to enhance the accuracy of radiographic interpretations in dentistry.

Training the New Radiologists: Approaches for Education

The field of Radiology is continually changing, requiring corresponding evolution in both medical student and resident training to adequately prepare the next generation of radiologists. With advancements in adult education theory and a deeper understanding of perception in imaging interpretation, expert educators are reshaping the training landscape by introducing innovative teaching methods to align with increased workload demands and emerging technologies. These include the use of peer and interdisciplinary teaching, gamification, case repositories, flipped-classroom models, social media, and drawing and comics. This publication aims to investigate these novel approaches and offer persuasive evidence supporting their incorporation into the updated Radiology curriculum.

A 2D Synthesized Image Improves the 3D Search for Foveated Visual Systems

Current medical imaging increasingly relies on 3D volumetric data making it difficult for radiologists to thoroughly search all regions of the volume. In some applications (e.g., Digital Breast Tomosynthesis), the volumetric data is typically paired with a synthesized 2D image (2D-S) generated from the corresponding 3D volume. We investigate how this image pairing affects the search for spatially large and small signals. Observers searched for these signals in 3D volumes, 2D-S images, and while viewing both. We hypothesize that lower spatial acuity in the observers' visual periphery hinders the search for the small signals in the 3D images. However, the inclusion of the 2D-S guides eye movements to suspicious locations, improving the observer's ability to find the signals in 3D. Behavioral results show that the 2D-S, used as an adjunct to the volumetric data, improves the localization and detection of the small (but not large) signal compared to 3D alone. There is a concomitant reduction in search errors as well. To understand this process at a computational level, we implement a Foveated Search Model (FSM) that executes human eye movements and then processes points in the image with varying spatial detail based on their eccentricity from fixations. The FSM predicts human performance for both signals and captures the reduction in search errors when the 2D-S supplements the 3D search. Our experimental and modeling results delineate the utility of 2D-S in 3D search-reduce the detrimental impact of low-resolution peripheral processing by guiding attention to regions of interest, effectively reducing errors.

Factors affecting interpretation of dental radiographs

OBJECTIVES

To identify the factors influencing errors in the interpretation of dental radiographs.

METHODS

A protocol was registered on Prospero. All studies published until May 2022 were included in this review. The search of the electronic databases spanned Ovid Medline, PubMed, EMBASE, Web of Science and Scopus. The quality of the studies was assessed using the MMAT tool. Due to the heterogeneity of the included studies, a meta-analysis was not conducted.

RESULTS

The search yielded 858 articles, of which eight papers met the inclusion and exclusion criteria and were included in the systematic review. These studies assessed the factors influencing the accuracy of the interpretation of dental radiographs. Six factors were identified as being significant that affected the occurrence of interpretation errors. These include clinical experience, clinical knowledge, and technical ability, case complexity, time pressure, location and duration of dental education and training and cognitive load.

CONCLUSIONS

The occurrence of interpretation errors has not been widely investigated in dentistry. The factors identified in this review are interlinked. Further studies are needed to better understand the extent of the occurrence of interpretive errors and their impact on the practice of dentistry.

The Legacy of the TTASAAN Report - Premature Conclusions and Forgotten Promises About SPECT Neuroimaging: A Review of Policy and Practice Part II

Brain perfusion single photon emission computed tomography (SPECT) scans were initially developed in 1970s. A key radiopharmaceutical, hexamethylpropyleneamine oxime (HMPAO), was not stabilized until 1993 and most early SPECT scans were performed on single-head gamma cameras. These early scans were of inferior quality. In 1996, the Therapeutics and Technology Assessment Subcommittee of the American Academy of Neurology (TTASAAN) issued a report regarding the use of SPECT in the evaluation of neurological disorders. This two-part series explores the policies and procedures related to perfusion SPECT functional neuroimaging. In Part I, the comparison between the quality of the SPECT scans and the depth of the data for key neurological and psychiatric indications at the time of the TTASAAN report vs. the intervening 25 years were presented. In Part II, the technical aspects of perfusion SPECT neuroimaging and image processing will be explored. The role of color scales will be reviewed and the process of interpreting a SPECT scan will be presented. Interpretation of a functional brain scans requires not only anatomical knowledge, but also technical understanding on correctly performing a scan, regardless of the scanning modality. Awareness of technical limitations allows the clinician to properly interpret a functional brain scan. With this foundation, four scenarios in which perfusion SPECT neuroimaging, together with other imaging modalities and testing, lead to a narrowing of the differential diagnoses and better treatment. Lastly, recommendations for the revision of current policies and practices are made.

The Legacy of the TTASAAN Report-Premature Conclusions and Forgotten Promises: A Review of Policy and Practice Part I

Brain perfusion single photon emission computed tomography (SPECT) scans were initially developed in 1970's. A key radiopharmaceutical, hexamethylpropyleneamine oxime (HMPAO), was originally approved in 1988, but was unstable. As a result, the quality of SPECT images varied greatly based on technique until 1993, when a method of stabilizing HMPAO was developed. In addition, most SPECT perfusion studies pre-1996 were performed on single-head gamma cameras. In 1996, the Therapeutics and Technology Assessment Subcommittee of the American Academy of Neurology (TTASAAN) issued a report regarding the use of SPECT in the evaluation of neurological disorders. Although the TTASAAN report was published in January 1996, it was approved for publication in October 1994. Consequently, the reported brain SPECT studies relied upon to derive the conclusions of the TTASAAN report largely pre-date the introduction of stabilized HMPAO. While only 12% of the studies on traumatic brain injury (TBI) in the TTASAAN report utilized stable tracers and multi-head cameras, 69 subsequent studies with more than 23,000 subjects describe the utility of perfusion SPECT scans in the evaluation of TBI. Similarly, dementia SPECT imaging has improved. Modern SPECT utilizing multi-headed gamma cameras and quantitative analysis has a sensitivity of 86% and a specificity of 89% for the diagnosis of mild to moderate Alzheimer's disease-comparable to fluorodeoxyglucose positron emission tomography. Advances also have occurred in seizure neuroimaging. Lastly, developments in SPECT imaging of neurotoxicity and neuropsychiatric disorders have been striking. At the 25-year anniversary of the publication of the TTASAAN report, it is time to re-examine the utility of perfusion SPECT brain imaging. Herein, we review studies cited by the TTASAAN report vs. current brain SPECT imaging research literature for the major indications addressed in the report, as well as for emerging indications. In Part II, we elaborate technical aspects of SPECT neuroimaging and discuss scan interpretation for the clinician.

Expertise development in volumetric image interpretation of radiology residents: what do longitudinal scroll data reveal?

The current study used theories on expertise development (the holistic model of image perception and the information reduction hypothesis) as a starting point to identify and explore potentially relevant process measures to monitor and evaluate expertise development in radiology residency training. It is the first to examine expertise development in volumetric image interpretation (i.e., CT scans) within radiology residents using scroll data collected longitudinally over five years of residency training. Consistent with the holistic model of image perception, the percentage of time spent on full runs, i.e. scrolling through more than 50% of the CT-scan slices (global search), decreased within residents over residency training years. Furthermore, the percentage of time spent on question-relevant areas in the CT scans increased within residents over residency training years, consistent with the information reduction hypothesis. Second, we examined if scroll patterns can predict diagnostic accuracy. The percentage of time spent on full runs and the percentage of time spent on question-relevant areas did not predict diagnostic accuracy. Thus, although scroll patterns over training years are consistent with visual expertise theories, they could not be used as predictors of diagnostic accuracy in the current study. Therefore, the relation between scroll patterns and performance needs to be further examined, before process measures can be used to monitor and evaluate expertise development in radiology residency training.

Intra- and Interobserver Agreement during the Assessment of the Different Stages of Root Development Using 4 Radiographic Classifications

INTRODUCTION

This study analyzed intra- and interobserver agreements during radiographic assessment of the different stages of root development using the dichotomous, Moorrees, Demirjian, and Cvek classifications, as well as the effect of the observer's level of experience on the result.

METHODS

Two hundred eighty-five digital periapical radiographs were examined via visual inspection by 3 experienced and 3 nonexperienced observers (n = 6) under strict technological and viewing conditions. After observer calibration, determination of the presence or absence of an open apex and the assignment of a root development stage according to the different subdivisions of the 4 indexes were performed. This evaluation was carried out by each observer in duplicate in the first round (n = 8) and repeated in the second round (n = 8). The 16 examinations performed by each observer (N = 96) were analyzed to determine the percentage of concordance followed by intraobserver, interobserver, and global observer agreement using the kappa coefficient and a weighted kappa. Additionally, to determine the level of concordance between the visual determination of an open or closed apex and the apical foramen width measured in millimeters, a dichotomized kappa coefficient was applied.

RESULTS

A good level of global observer agreement was found for the dichotomous, Demirjian, and Cvek classifications. However, a significantly low percentage of total concordance and global observer agreement (6.66% and 0.498, respectively) was obtained using the Moorrees classification, which was more pronounced among nonexperienced observers (0.247). Apical foramen width measurements indicated the presence of 143 roots with an open apex (50.2%) and 142 with a closed apex (49.8%), and the dichotomized kappa coefficient test revealed a good level of agreement during the visual determination of an open or closed apex (range, 0.611-0.636).

CONCLUSIONS

The classifications of Cvek and Demirjian provided reliable results when determining the different stages of root development. In contrast, the Moorrees classification provided the lowest agreement values, with a significant negative effect among nonexperienced observers. Finally, the visual estimation of the presence (or absence) of an open apex provided a good level of concordance with the radiographic apical foramen width.

Under-exploration of Three-Dimensional Images Leads to Search Errors for Small Salient Targets

Advances in 3D imaging technology are transforming how radiologists search for cancer1,2 and how security officers scrutinize baggage for dangerous objects.3 These new 3D technologies often improve search over 2D images4,5 but vastly increase the image data. Here, we investigate 3D search for targets of various sizes in filtered noise and digital breast phantoms. For a Bayesian ideal observer optimally processing the filtered noise and a convolutional neural network processing the digital breast phantoms, search with 3D image stacks increases target information and improves accuracy over search with 2D images. In contrast, 3D search by humans leads to high miss rates for small targets easily detected in 2D search, but not for larger targets more visible in the visual periphery. Analyses of human eye movements, perceptual judgments, and a computational model with a foveated visual system suggest that human errors can be explained by interaction among a target's peripheral visibility, eye movement under-exploration of the 3D images, and a perceived overestimation of the explored area. Instructing observers to extend the search reduces 75% of the small target misses without increasing false positives. Results with twelve radiologists confirm that even medical professionals reading realistic breast phantoms have high miss rates for small targets in 3D search. Thus, under-exploration represents a fundamental limitation to the efficacy with which humans search in 3D image stacks and miss targets with these prevalent image technologies.

What do radiologists look for? Advances and limitations of perceptual learning in radiologic search

Supported by guidance from training during residency programs, radiologists learn clinically relevant visual features by viewing thousands of medical images. Yet the precise visual features that expert radiologists use in their clinical practice remain unknown. Identifying such features would allow the development of perceptual learning training methods targeted to the optimization of radiology training and the reduction of medical error. Here we review attempts to bridge current gaps in understanding with a focus on computational saliency models that characterize and predict gaze behavior in radiologists. There have been great strides toward the accurate prediction of relevant medical information within images, thereby facilitating the development of novel computer-aided detection and diagnostic tools. In some cases, computational models have achieved equivalent sensitivity to that of radiologists, suggesting that we may be close to identifying the underlying visual representations that radiologists use. However, because the relevant bottom-up features vary across task context and imaging modalities, it will also be necessary to identify relevant top-down factors before perceptual expertise in radiology can be fully understood. Progress along these dimensions will improve the tools available for educating new generations of radiologists, and aid in the detection of medically relevant information, ultimately improving patient health.

Search of low-contrast liver lesions in abdominal CT: the importance of scrolling behavior

Purpose: Visual search using volumetric images is becoming the standard in medical imaging. However, we do not fully understand how eye movement strategies mediate diagnostic performance. A recent study on computed tomography (CT) images showed that the search strategies of radiologists could be classified based on saccade amplitudes and cross-quadrant eye movements [eye movement index (EMI)] into two categories: drillers and scanners. Approach: We investigate how the number of times a radiologist scrolls in a given direction during analysis of the images (number of courses) could add a supplementary variable to use to characterize search strategies. We used a set of 15 normal liver CT images in which we inserted 1 to 5 hypodense metastases of two different signal contrast amplitudes. Twenty radiologists were asked to search for the metastases while their eye-gaze was recorded by an eye-tracker device (EyeLink1000, SR Research Ltd., Mississauga, Ontario, Canada). Results: We found that categorizing radiologists based on the number of courses (rather than EMI) could better predict differences in decision times, percentage of image covered, and search error rates. Radiologists with a larger number of courses covered more volume in more time, found more metastases, and made fewer search errors than those with a lower number of courses. Our results suggest that the traditional definition of drillers and scanners could be expanded to include scrolling behavior. Drillers could be defined as scrolling back and forth through the image stack, each time exploring a different area on each image (low EMI and high number of courses). Scanners could be defined as scrolling progressively through the stack of images and focusing on different areas within each image slice (high EMI and low number of courses). Conclusions: Together, our results further enhance the understanding of how radiologists investigate three-dimensional volumes and may improve how to teach effective reading strategies to radiology residents.

Perceptual training: learning versus attentional shift

Prior research has demonstrated that perceptual training can improve the ability of healthcare trainees in identifying abnormalities on medical images, but it is unclear if the improved performance is due to learning or attentional shift-the diversion of perceptional resources away from other activities to a specified task. Our objective is to determine if research subject performance in perceiving the central venous catheter position on radiographs is improved after perceptional training and if improved performance is due to learning or an attentional shift. Forty-one physician assistant students were educated on the appropriate radiographic position of central venous catheters and then asked to evaluate the catheter position in two sets of radiographic cases. The experimental group was provided perceptional training between case sets one and two. The control group was not. Participants were asked to characterize central venous catheters for appropriate positioning (task of interest) and to assess radiographs for cardiomegaly (our marker for attentional shift). Our results demonstrated increased confidence in localization in the experimental group ( p -value < 0.001 ) but not in the control group ( p - value = 0.882 ). The ability of subjects to locate the catheter tip significantly improved in both control and experimental groups. Both the experimental ( p - value = 0.007 ) and control groups ( p - value = 0.001 ) demonstrated equivalent decreased performance in assessing cardiomegaly; the difference between groups was not significant ( p - value = 0.234 ). This suggests the performance improvement was secondary to learning not due to an attentional shift.

A Review of Perceptual Expertise in Radiology-How it develops, How we can test it, and Why humans still matter in the era of Artificial Intelligence

As the first step in image interpretation is detection, an error in perception can prematurely end the diagnostic process leading to missed diagnoses. Because perceptual errors of this sort-"failure to detect"-are the most common interpretive error (and cause of litigation) in radiology, understanding the nature of perceptual expertise is essential in decreasing radiology's long-standing error rates. In this article, we review what constitutes a perceptual error, the existing models of radiologic image perception, the development of perceptual expertise and how it can be tested, perceptual learning methods in training radiologists, and why understanding perceptual expertise is still relevant in the era of artificial intelligence. Adding targeted interventions, such as perceptual learning, to existing teaching practices, has the potential to enhance expertise and reduce medical error.

Prevalence and clinical significance of discordant LI-RADS® observations on multiphase contrast-enhanced MRI in patients with cirrhosis

PURPOSE

To determine the prevalence and clinical significance of discordant LI-RADS^® (Liver Imaging Reporting and Data System) liver observations on multiphase contrast-enhanced (MCE) magnetic resonance imaging (MRI) in patients with cirrhosis.

METHODS

This cross-sectional study included 93 cirrhosis patients who underwent 1.5 or 3 T MCE MRI for evaluation of hepatocellular carcinoma (HCC). Two abdominal radiologists independently reviewed T1-, T2-, diffusion-weighted unenhanced images as well as MCE T1-weighted fat-suppressed images and reported liver observations using LI-RADS^®. Concordance were recorded for detection (co-detected by both radiologists or not), size category (< 10; 10-19; ≥ 20 mm), and LI-RADS^® category assignment as reportable (LR-3/4/5/M) and actionable (LR-4/5/M). The overall concordance (i.e., concordant in detection, size, and LR-category) was calculated with 95% confidence interval [CI], and separately for detection, size, and LR-category. Clinical significance of discordance was assessed as impact on follow-up imaging, referral for biopsy, liver transplant eligibility, or treatment modality.

RESULTS

Reportable and actionable observations were overall concordant between two radiologists only in 32.3% [24.6, 41.0] and 40.1% [29.5, 51.5] of cases, respectively. Poor overall concordance was related to detection concordance of 52.0% [44.3, 59.5] and 62.5% [52.3, 71.8], as well as LR-category concordance of 73.7% [61.6, 83.1] and 70.9% [57.3, 81.6], for reportable and actionable observations, respectively. Discordant LI-RADS^® observations would have impacted clinical management in 30 subjects (43.5%), most (66.7%) of whom were due to discordant detection.

CONCLUSION

Discordant MRI LI-RADS^® observations are common in patients with cirrhosis and may have potential implications for patient management.

Serial dependence in a simulated clinical visual search task

In everyday life, we continuously search for and classify objects in the environment around us. This kind of visual search is extremely important when performed by radiologists in cancer image interpretation and officers in airport security screening. During these tasks, observers often examine large numbers of uncorrelated images (tumor x-rays, checkpoint x-rays, etc.) one after another. An underlying assumption of such tasks is that search and recognition are independent of our past experience. Here, we simulated a visual search task reminiscent of medical image search and found that shape classification performance was strongly impaired by recent visual experience, biasing classification errors 7% more towards the previous image content. This perceptual attraction exhibited the three main tuning characteristics of Continuity Fields: serial dependence extended over 12 seconds back in time (temporal tuning), it occurred only between similar tumor-like shapes (feature tuning), and only within a limited spatial region (spatial tuning). Taken together, these results demonstrate that serial dependence influences shape perception and occurs in visual search tasks. They also raise the possibility of a detrimental impact of serial dependence in clinical and practically relevant settings, such as medical image perception.

Risk Factors for Perceptual-versus-Interpretative Errors in Diagnostic Neuroradiology

BACKGROUND AND PURPOSE

Diagnostic errors in radiology are classified as perception or interpretation errors. This study determined whether specific conditions differed when perception or interpretation errors occurred during neuroradiology image interpretation.

MATERIALS AND METHODS

In a sample of 254 clinical error cases in diagnostic neuroradiology, we classified errors as perception or interpretation errors, then characterized imaging technique, interpreting radiologist's experience, anatomic location of the abnormality, disease etiology, time of day, and day of the week. Interpretation and perception errors were compared with hours worked per shift, cases read per shift, average cases read per shift hour, and the order of case during the shift when the error occurred.

RESULTS

Perception and interpretation errors were 74.8% (n = 190) and 25.2% (n = 64) of errors, respectively. Logistic regression analyses showed that the odds of an interpretation error were 2 times greater (OR, 2.09; 95% CI, 1.05-4.15; P = .04) for neuroradiology attending physicians with ≤5 years of experience. Interpretation errors were more likely with MR imaging compared with CT (OR, 2.10; 95% CI, 1.09-4.01; P = .03). Infectious/inflammatory/autoimmune diseases were more frequently associated with interpretation errors (P = .04). Perception errors were associated with faster reading rates (6.01 versus 5.03 cases read per hour; P = .004) and occurred later during the shift (24th-versus-18th case; P = .04).

CONCLUSIONS

Among diagnostic neuroradiology error cases, interpretation-versus-perception errors are affected by the neuroradiologist's experience, technique, and the volume and rate of cases read. Recognition of these risk factors may help guide programs for error reduction in clinical neuroradiology services.

Analysis of Perceptual Expertise in Radiology - Current Knowledge and a New Perspective

Radiologists rely principally on visual inspection to detect, describe, and classify findings in medical images. As most interpretive errors in radiology are perceptual in nature, understanding the path to radiologic expertise during image analysis is essential to educate future generations of radiologists. We review the perceptual tasks and challenges in radiologic diagnosis, discuss models of radiologic image perception, consider the application of perceptual learning methods in medical training, and suggest a new approach to understanding perceptional expertise. Specific principled enhancements to educational practices in radiology promise to deepen perceptual expertise among radiologists with the goal of improving training and reducing medical error.

Development of competence in volumetric image interpretation in radiology residents

BACKGROUND

During residency, radiology residents learn to interpret volumetric radiological images. The development of their competence for volumetric image interpretation, as opposed to 2D image reading, is not completely understood. The purpose of the present study was to investigate how competence for volumetric image interpretation develops in radiology residents and how this compares with competence development for 2D image interpretation, by studying resident scores on image-based items in digital radiology tests.

METHODS

We reviewed resident scores on volumetric and 2D image-based test items in 9 consecutive semi-annual digital radiology tests that were carried out from November 2013 to April 2018. We assessed percentage-correct sum scores for all test items about volumetric images and for all test items about 2D images in each test as well as for all residents across the 9 tests (i.e. 4.5 years of test materials). We used a paired t-test to analyze whether scores differed between volumetric and 2D image-based test items in individual residents in postgraduate year (PGY) 0-5, subdivided in 10 half-year phases (PGY 0-0.5, 0.5-1.0, 1.0-1.5 et cetera).

RESULTS

The percentage-correct scores on volumetric and 2D image-based items showed a comparable trend of development, increasing in the first half of residency and flattening off in the second half. Chance-corrected scores were generally lower in volumetric than in 2D items (on average 1-5% points). In PGY 1.5-4.5, this score difference was statistically significant (p-values ranging from 0.02 to < 0.001), with the largest difference found in PGY 2.5 (mean: 5% points; 95% CI: -7.3 - -3.4). At the end of training in PGY 5, there was no statistically significant score difference between both item types.

CONCLUSIONS

The development of competence in volumetric image interpretation fits a similar curvilinear growth curve during radiology residency as 2D image interpretation competence in digital radiology tests. Although residents performed significantly lower on volumetric than 2D items in PGY 1.5-4.5, we consider the magnitude of this difference as relatively small for our educational setting and we suggest that throughout radiology training there are no relevant differences in the development of both types of competences, as investigated by digital radiology tests.

Enhancing Parathyroid Gland Visualization Using a Near Infrared Fluorescence-Based Overlay Imaging System

BACKGROUND

Misidentifying parathyroid glands (PGs) during thyroidectomies or parathyroidectomies could significantly increase postoperative morbidity. Imaging systems based on near infrared autofluorescence (NIRAF) detection can localize PGs with high accuracy. These devices, however, depict NIRAF images on remote display monitors, where images lack spatial context and comparability with actual surgical field of view. In this study, we designed an overlay tissue imaging system (OTIS) that detects tissue NIRAF and back-projects the collected signal as a visible image directly onto the surgical field of view instead of a display monitor, and tested its ability for enhancing parathyroid visualization.

STUDY DESIGN

The OTIS was first calibrated with a fluorescent ink grid and initially tested with parathyroid, thyroid, and lymph node tissues ex vivo. For in vivo measurements, the surgeon's opinion on tissue of interest was first ascertained. After the surgeon looked away, the OTIS back-projected visible green light directly onto the tissue of interest, only if the device detected relatively high NIRAF as observed in PGs. System accuracy was determined by correlating NIRAF projection with surgeon's visual confirmation for in situ PGs or histopathology report for excised PGs.

RESULTS

The OTIS yielded 100% accuracy when tested ex vivo with parathyroid, thyroid, and lymph node specimens. Subsequently, the device was evaluated in 30 patients who underwent thyroidectomy and/or parathyroidectomy. Ninety-seven percent of exposed tissue of interest was visualized correctly as PGs by the OTIS, without requiring display monitors or contrast agents.

CONCLUSIONS

Although OTIS holds novel potential for enhancing label-free parathyroid visualization directly within the surgical field of view, additional device optimization is required for eventual clinical use.

Analysis of the French national evaluation of radiology residents

PURPOSE

In France, a national evaluation is given annually to radiology residents. The aim of this study was to perform both a docimological analysis of the quality of the questionnaire and a statistical analysis of the results.

MATERIALS AND METHODS

This retrospective study, which included French radiology residents from Year 1 to Year 5 of residency, was performed from 2015 to 2017 across 25 medical universities in France. Both qualitative and quantitative docimological analyses were performed as assessed by the Cronbach alpha coefficient, the difficulty of question (PDI), and the coefficient of discrimination (Rir). Results to the questionnaire were compared between years of residency.

RESULTS

The results of the analysis confirmed the quality of the questionnaire (Cronbach alpha coefficient=0.71, mean [PDI=0.40]) though the majority of questions could be answered by memory rather than cognitive ability. The mean Rir was 0.02, indicating that students could not be certified using only the questionnaire. The results measuring resident level of knowledge were moderate, with mean results ranging from 9.2/20 at the first year to 11.3/20 at the fifth year of residency (P<0.001). There were no significant differences in results obtained between the third, fourth, and fifth year of residency but results were significantly different among university hospitals.

CONCLUSION

Even if close interactions exist between learning and pedagogic environment, our results suggest that it may be useful to further develop an evaluation process in relation with pedagogic instructions in order to provide more optimal training.

Image quality in coronary computed tomography angiography: influence of adaptive statistical iterative reconstruction at various radiation dose levels

Background Computed tomography (CT) technology is rapidly evolving and software solution developed to optimize image quality and/or lower radiation dose. Purpose To investigate the influence of adaptive statistical iterative reconstruction (ASIR) at different radiation doses in coronary CT angiography (CCTA) in detailed image quality. Material and Methods A total of 160 CCTA were reconstructed as follows: 55 scans with filtered back projection (FBP) (650 mA), 51 scans (455 mA) with 30% ASIR (ASIR30), and 54 scans (295 mA) with 60% ASIR (ASIR60). For each reconstruction, subjective image quality was assessed by five independent certified cardiologists using a visual grading analysis (VGA) with five predefined image quality criteria consisting of a 5-point scale. Objective measures were contrast, noise, and contrast-to-noise ratio (CNR). Results The CTDI_vol resulted in 10.3 mGy, 7.4 mGy, and 4.6 mGy for FBP, ASIR30, and ASIR60, respectively. Homogeneity of the left ventricular lumen was the sole aspect in which reconstruction algorithms differed with a decreasing effect for ASIR60 compared to FBP (estimated odds ratio [OR] = 0.49 [95% confidence interval (CI) = 0.32-0.76; P = 0.001]). Decreased sharpness and spatial- and low-contrast resolutions were observed when using ASIR instead of FBP, but differences were not statistically significant. Concerning objective measurements, noise increased significantly for ASIR30 (OR = 1.08; 95% CI = 1.02-1.14; P = 0.006) and ASIR60 (OR = 1.06; 95% CI = 1.01-1.12; P = 0.034) compared to FBP. Conclusion ASIR significantly decreased the subjectively assessed homogeneity of the left ventricular lumen and increased the objectively measured noise compared to FBP. Considering these results, ASIR at a reduced radiation dose should be implemented with caution.

Volumetric image interpretation in radiology: scroll behavior and cognitive processes

The interpretation of medical images is a primary task for radiologists. Besides two-dimensional (2D) images, current imaging technologies allow for volumetric display of medical images. Whereas current radiology practice increasingly uses volumetric images, the majority of studies on medical image interpretation is conducted on 2D images. The current study aimed to gain deeper insight into the volumetric image interpretation process by examining this process in twenty radiology trainees who all completed four volumetric image cases. Two types of data were obtained concerning scroll behaviors and think-aloud data. Types of scroll behavior concerned oscillations, half runs, full runs, image manipulations, and interruptions. Think-aloud data were coded by a framework of knowledge and skills in radiology including three cognitive processes: perception, analysis, and synthesis. Relating scroll behavior to cognitive processes showed that oscillations and half runs coincided more often with analysis and synthesis than full runs, whereas full runs coincided more often with perception than oscillations and half runs. Interruptions were characterized by synthesis and image manipulations by perception. In addition, we investigated relations between cognitive processes and found an overall bottom-up way of reasoning with dynamic interactions between cognitive processes, especially between perception and analysis. In sum, our results highlight the dynamic interactions between these processes and the grounding of cognitive processes in scroll behavior. It suggests, that the types of scroll behavior are relevant to describe how radiologists interact with and manipulate volumetric images.

A multiple-perspective approach for the assessment and learning of ultrasound skills

Ultrasound has become a core skill in many specialties. We evaluated the learning and assessment of ultrasound skills in Obstetrics-Gynaecology in a series of eight studies. In the clinical setting, we found that trainees as well as experienced clinicians struggle with technical aspects of performance such as image optimization. We examined how to improve these aspects of performance in the simulated setting by determining mastery learning levels and exploring learning curves for novices. We then examined how to improve the efficiency of training as well as transfer of learning through the use of dyad practice as compared with single practice. We found that the use of simulation-based training focusing on technical aspects of performance in addition to clinical training led to sustained improvements in performance after two months of clinical training in all aspects of performance. In addition, we found an interaction effect between initial simulation-based training and subsequent clinical training on trainees' need for supervision. These findings suggest that simulation-based training can work as preparation for future learning rather than merely as added learning. Finally, we found that the use of simulation-based initial training led to a large decrease in patients' discomfort, improvements in their perceived safety and confidence in their ultrasound operator. However, simulation-based training comes at a cost and in the final study we developed a model for conducting cost-effectiveness studies and provided data from an example study on how to link training costs with quality of care.

Cognitive processing differences of experts and novices when correlating anatomy and cross-sectional imaging

The ability to correlate anatomical knowledge and medical imaging is crucial to radiology and as such, should be a critical component of medical education. However, we are hindered in our ability to teach this skill because we know very little about what expert practice looks like, and even less about novices' understanding. Using a unique simulation tool, this research conducted cognitive clinical interviews with experts and novices to explore differences in how they engage in this correlation and the underlying cognitive processes involved in doing so. This research supported what has been known in the literature, that experts are significantly faster at making decisions on medical imaging than novices. It also offers insight into the spatial ability and reasoning that is involved in the correlation of anatomy to medical imaging. There are differences in the cognitive processing of experts and novices with respect to meaningful patterns, organized content knowledge, and the flexibility of retrieval. Presented are some novice-expert similarities and differences in image processing. This study investigated extremes, opening an opportunity to investigate the sequential knowledge acquisition from student to resident to expert, and where educators can help intervene in this learning process.

Evaluation of Search Strategies for Microcalcifications and Masses in 3D Images

Medical imaging is quickly evolving towards 3D image modalities such as computed tomography (CT), magnetic resonance imaging (MRI) and digital breast tomosynthesis (DBT). These 3D image modalities add volumetric information but further increase the need for radiologists to search through the image data set. Although much is known about search strategies in 2D images less is known about the functional consequences of different 3D search strategies. We instructed readers to use two different search strategies: drillers had their eye movements restricted to a few regions while they quickly scrolled through the image stack, scanners explored through eye movements the 2D slices. We used real-time eye position monitoring to ensure observers followed the drilling or the scanning strategy while approximately preserving the percentage of the volumetric data covered by the useful field of view. We investigated search for two signals: a simulated microcalcification and a larger simulated mass. Results show an interaction between the search strategy and lesion type. In particular, scanning provided significantly better detectability for microcalcifications at the cost of 5 times more time to search while there was little change in the detectability for the larger simulated masses. Analyses of eye movements support the hypothesis that the effectiveness of a search strategy in 3D imaging arises from the interaction of the fixational sampling of visual information and the signals' visibility in the visual periphery.

Visual adaptation and the amplitude spectra of radiological images

We examined how visual sensitivity and perception are affected by adaptation to the characteristic amplitude spectra of X-ray mammography images. Because of the transmissive nature of X-ray photons, these images have relatively more low-frequency variability than natural images, a difference that is captured by a steeper slope of the amplitude spectrum (~ − 1.5) compared to the ~ 1/f (slope of − 1) spectra common to natural scenes. Radiologists inspecting these images are therefore exposed to a different balance of spectral components, and we measured how this exposure might alter spatial vision. Observers (who were not radiologists) were adapted to images of normal mammograms or the same images sharpened by filtering the amplitude spectra to shallower slopes. Prior adaptation to the original mammograms significantly biased judgments of image focus relative to the sharpened images, demonstrating that the images are sufficient to induce substantial after-effects. The adaptation also induced strong losses in threshold contrast sensitivity that were selective for lower spatial frequencies, though these losses were very similar to the threshold changes induced by the sharpened images. Visual search for targets (Gaussian blobs) added to the images was also not differentially affected by adaptation to the original or sharper images. These results complement our previous studies examining how observers adapt to the textural properties or phase spectra of mammograms. Like the phase spectrum, adaptation to the amplitude spectrum of mammograms alters spatial sensitivity and visual judgments about the images. However, unlike the phase spectrum, adaptation to the amplitude spectra did not confer a selective performance advantage relative to more natural spectra.

Intraradicular Appearances Affect Radiographic Interpretation of the Periapical Area

INTRODUCTION

No research exists evaluating the influences of specific variables such as obturation length, radiodensity, or the presence of voids on interpretation of periradicular area. The purpose of this study was to evaluate the effects of obturation length, radiodensity, and the presence of voids on the radiographic interpretations of periapical areas.

METHODS

In a Web-based survey, 3 test image groups of variable obturation lengths, radiodensities, and numbers of voids were presented to observers for evaluation of the periapical areas. Intracanal areas of the images were altered by using Adobe Photoshop to create 3 test image groups. Each observer reviewed 2 control images and 1 image from each test image group. Responses were recorded in a 5-point Likert-type scale. Within each test image group, the periapical areas were identical. Kruskal-Wallis, Mann-Whitney U, and Cliff's delta statistical tests were used to analyze results.

RESULTS

A total of 748 observer responses were analyzed. Significant differences (P ≤ .01) in the median Likert-type scale responses were identified between the following paired groups: 3 mm short and 1 mm short, 3 mm short and flush, lower radiodensity and higher radiodensity, lower radiodensity and intermediate radiodensity, no voids and several voids, and several voids and single void. Effect sizes ranged from 0.19 to 0.41.

CONCLUSIONS

Significant differences were noted within all 3 test image groups: length, radiodensity, and presence of voids. Length of obturation had the largest effect on interpretation of the periapical area, with the 3 mm short radiographic obturation length image interpreted less favorably.

Tired in the Reading Room: The Influence of Fatigue in Radiology

Commonly conflated with sleepiness, fatigue is a distinct multidimensional condition with physical and mental effects. Fatigue in health care providers and any secondary effects on patient care are an important societal concern. As medical image interpretation is highly dependent on visual input, visual fatigue is of particular interest to radiologists. Humans analyze their surroundings with rapid eye movements called saccades, and fatigue decreases saccadic velocity. Oculomotor parameters may, therefore, be an objective and reproducible metric of fatigue and eye movement analysis can provide valuable insight into the etiology of fatigue-related error.

Teaching search patterns to medical trainees in an educational laboratory to improve perception of pulmonary nodules

The goal of this research is to demonstrate that teaching healthcare trainees a formal search or scan pattern for evaluation of the lungs improves their ability to identify pulmonary nodules on chest radiographs (CXRs). A group of physician assistant trainees were randomly assigned to control and experimental groups. Each group was shown two sets of CXRs, each set with a nodule prevalence of approximately 50%. The experimental group received search pattern training between case sets, whereas the control group did not. Both groups were asked to mark nodules when present and indicate their diagnostic confidence. Subject performance at nodule detection was quantified using changes in area under the localization receiver operating characteristic curve ([Formula: see text]). There was no significant improvement in performance between case sets for the control group. There was a significant improvement in subject performance after training for the experimental group, [Formula: see text], [Formula: see text]. These results demonstrate that teaching a search pattern to trainees improves their ability to identify nodules and decreases the number of perceptual errors in nodule identification, and suggest that our knowledge of medical image perception may be used to develop rational tools for the education of healthcare trainees.

Content-based image retrieval in radiology: analysis of variability in human perception of similarity

We aim to develop a better understanding of perception of similarity in focal computed tomography (CT) liver images to determine the feasibility of techniques for developing reference sets for training and validating content-based image retrieval systems. In an observer study, four radiologists and six nonradiologists assessed overall similarity and similarity in 5 image features in 136 pairs of focal CT liver lesions. We computed intra- and inter-reader agreements in these similarity ratings and viewed the distributions of the ratings. The readers' ratings of overall similarity and similarity in each feature primarily appeared to be bimodally distributed. Median Kappa scores for intra-reader agreement ranged from 0.57 to 0.86 in the five features and from 0.72 to 0.82 for overall similarity. Median Kappa scores for inter-reader agreement ranged from 0.24 to 0.58 in the five features and were 0.39 for overall similarity. There was no significant difference in agreement for radiologists and nonradiologists. Our results show that developing perceptual similarity reference standards is a complex task. Moderate to high inter-reader variability precludes ease of dividing up the workload of rating perceptual similarity among many readers, while low intra-reader variability may make it possible to acquire large volumes of data by asking readers to view image pairs over many sessions.

Evaluation of low-contrast perceptibility in dental restorative materials under the influence of ambient light conditions

OBJECTIVES

This study aimed to assess how details on dental restorative composites with different radio-opacities are perceived under the influence of ambient light.

METHODS

Resin composite step wedges (six steps, each 1-mm thick) were custom manufactured from three materials, respectively: (M1) Filtek™ Z350 (3M/ESPE, Saint Paul, MN); (M2) Prisma AP.H™ (Dentsply International Inc., Brazil) and (M3) Glacier(®) (SDI Limited, Victoria, Australia). Each step of the manufactured wedge received three standardized drillings of different diameters and depths. An aluminium (Al) step wedge with 12 steps (1-mm thick) was used as an internal standard to calculate the radio-opacity as pixel intensity values. Standardized digital images of the set were obtained, and 11 observers independently recorded the images, noting the number of noticeable details (drillings) under 2 dissimilar conditions: in a light environment (light was turned on in the room) and in low-light conditions (light in the room was turned off). The differences between images in terms of the number of details that were observed were statistically compared using ANOVA, Cronbach's alpha coefficient and Wilcoxon and Kruskal-Wallis tests, with a significance level setting of 5% (α = 0.05).

RESULTS

The M2 showed higher radio-opacity, the M1 displayed intermediate radio-opacity and the M3 showed lower radio-opacity, respectively; however, all three were without significance (p > 0.05) compared with each other. The differences in radio-opacity resulted in a significant variation (p < 0.05) in the number of noticeable details in the image, which were influenced by characteristics of details, in addition to the ambient-light level.

CONCLUSIONS

The radio-opacity of materials and ambient light can affect the perception of details in digital radiographic images.

Predicting visual semantic descriptive terms from radiological image data: preliminary results with liver lesions in CT

We describe a framework to model visual semantics of liver lesions in CT images in order to predict the visual semantic terms (VST) reported by radiologists in describing these lesions. Computational models of VST are learned from image data using linear combinations of high-order steerable Riesz wavelets and support vector machines (SVM). In a first step, these models are used to predict the presence of each semantic term that describes liver lesions. In a second step, the distances between all VST models are calculated to establish a nonhierarchical computationally-derived ontology of VST containing inter-term synonymy and complementarity. A preliminary evaluation of the proposed framework was carried out using 74 liver lesions annotated with a set of 18 VSTs from the RadLex ontology. A leave-one-patient-out cross-validation resulted in an average area under the ROC curve of 0.853 for predicting the presence of each VST. The proposed framework is expected to foster human-computer synergies for the interpretation of radiological images while using rotation-covariant computational models of VSTs to 1) quantify their local likelihood and 2) explicitly link them with pixel-based image content in the context of a given imaging domain.

Which factors are associated with trainees' confidence in performing obstetric and gynecological ultrasound examinations?

OBJECTIVE

To explore the association between clinical training characteristics and trainees' level of confidence in performing ultrasound scans independently.

METHODS

A cross-sectional e-survey was distributed to members of the national societies of junior obstetricians/gynecologists in Denmark, Sweden and Norway (n = 973). Multiple linear regression models were used to explore the effect that amount of time spent in specialized ultrasound units and clinical experience had on trainees' confidence in performing ultrasonography independently. Exploratory factor analysis was used to identify factors that contributed to trainees' confidence in performing ultrasonography. Trainees' ultrasound confidence was finally compared with their expected levels of performance.

RESULTS

Of the 682 respondents (response rate 70.1%), 621 met the inclusion criteria. Clinical experience and time spent in specialized ultrasound units were predictors of trainees' confidence in performing ultrasonography independently (P < 0.001). Trainees required more than 24 months of clinical experience and 12-24 days of training in specialized ultrasound units in order to feel confident about performing transvaginal and transabdominal ultrasound scans independently. Three factors were related to ultrasound confidence: technical aspects, image perception and integration of scan into patient care. There were significant differences between trainees' level of confidence and their expected levels of performance (P < 0.001).

CONCLUSIONS

Clinical experience and time spent in specialized ultrasound units were predictors of trainees' confidence in performing ultrasonography independently. Discrepancies between trainees' confidence and their expected levels of performance raised concerns about the adequacy of current ultrasound training programs.

Adaptation aftereffects in the perception of radiological images

Radiologists must classify and interpret medical images on the basis of visual inspection. We examined how the perception of radiological scans might be affected by common processes of adaptation in the visual system. Adaptation selectively adjusts sensitivity to the properties of the stimulus in current view, inducing an aftereffect in the appearance of stimuli viewed subsequently. These perceptual changes have been found to affect many visual attributes, but whether they are relevant to medical image perception is not well understood. To examine this we tested whether aftereffects could be generated by the characteristic spatial structure of radiological scans, and whether this could bias their appearance along dimensions that are routinely used to classify them. Measurements were focused on the effects of adaptation to images of normal mammograms, and were tested in observers who were not radiologists. Tissue density in mammograms is evaluated visually and ranges from "dense" to "fatty." Arrays of images varying in intermediate levels between these categories were created by blending dense and fatty images with different weights. Observers first adapted by viewing image samples of dense or fatty tissue, and then judged the appearance of the intermediate images by using a texture matching task. This revealed pronounced perceptual aftereffects - prior exposure to dense images caused an intermediate image to appear more fatty and vice versa. Moreover, the appearance of the adapting images themselves changed with prolonged viewing, so that they became less distinctive as textures. These aftereffects could not be accounted for by the contrast differences or power spectra of the images, and instead tended to follow from the phase spectrum. Our results suggest that observers can selectively adapt to the properties of radiological images, and that this selectivity could strongly impact the perceived textural characteristics of the images.

International multispecialty consensus on how to evaluate ultrasound competence: a Delphi consensus survey

Objectives

To achieve international consensus across multiple specialties on a generic ultrasound rating scale using a Delphi technique.

Methods

Ultrasound experts from Obstetrics-Gynaecology, Surgery, Urology, Radiology, Rheumatology, Emergency Medicine, and Gastro-Enterology representing North America, Australia, and Europe were identified. A multi-round survey was conducted to obtain consensus between these experts. Of 60 invited experts, 44 experts agreed to participate in the first Delphi round, 41 remained in the second round, and 37 completed the third Delphi round. Seven key elements of the ultrasound examination were identified from existing literature and recommendations from international ultrasound societies. All experts rated the importance of these seven elements on a five-point Likert scale in the first round and suggested potential new elements for the assessment of ultrasound skills. In the second round, the experts re-rated all elements and a third round was conducted to allow final comments. Agreement on which elements to include in the final rating scale was pre-defined as more than 80% of the experts rating an element four or five, on importance to the ultrasound examination.

Results

Two additional elements were suggested by more than 10% of the experts in the first Delphi round. Consensus was obtained to include these two new elements along with five of the original elements in the final assessment instrument: 1) Indication for the examination 2) Applied knowledge of ultrasound equipment 3) Image optimization 4) Systematic examination 5) Interpretation of images 6) Documentation of examination and 7) Medical decision making.

Conclusion

International multispecialty consensus was achieved on the content of a generic ultrasound rating scale. This is the first step to ensure valid assessment of clinicians in different medical specialties using ultrasound.