Accounting for anatomical noise in search-capable model observers for planar nuclear imaging

A 2D Synthesized Image Improves the 3D Search for Foveated Visual Systems

Current medical imaging increasingly relies on 3D volumetric data making it difficult for radiologists to thoroughly search all regions of the volume. In some applications (e.g., Digital Breast Tomosynthesis), the volumetric data is typically paired with a synthesized 2D image (2D-S) generated from the corresponding 3D volume. We investigate how this image pairing affects the search for spatially large and small signals. Observers searched for these signals in 3D volumes, 2D-S images, and while viewing both. We hypothesize that lower spatial acuity in the observers' visual periphery hinders the search for the small signals in the 3D images. However, the inclusion of the 2D-S guides eye movements to suspicious locations, improving the observer's ability to find the signals in 3D. Behavioral results show that the 2D-S, used as an adjunct to the volumetric data, improves the localization and detection of the small (but not large) signal compared to 3D alone. There is a concomitant reduction in search errors as well. To understand this process at a computational level, we implement a Foveated Search Model (FSM) that executes human eye movements and then processes points in the image with varying spatial detail based on their eccentricity from fixations. The FSM predicts human performance for both signals and captures the reduction in search errors when the 2D-S supplements the 3D search. Our experimental and modeling results delineate the utility of 2D-S in 3D search-reduce the detrimental impact of low-resolution peripheral processing by guiding attention to regions of interest, effectively reducing errors.

Medical image quality metrics for foveated model observers

Purpose: A recently proposed model observer mimics the foveated nature of the human visual system by processing the entire image with varying spatial detail, executing eye movements, and scrolling through slices. The model can predict how human search performance changes with signal type and modality (2D versus 3D), yet its implementation is computationally expensive and time-consuming. Here, we evaluate various image quality metrics using extensions of the classic index of detectability expression and assess foveated model observers for search tasks. Approach: We evaluated foveated extensions of a channelized Hotelling and nonprewhitening matched filter model with an eye filter. The proposed methods involve calculating a model index of detectability ( d ' ) for each retinal eccentricity and combining these with a weighting function into a single detectability metric. We assessed different versions of the weighting function that varied in the required measurements of the human observers' search (no measurements, eye movement patterns, size of the image, and median search times). Results: We show that the index of detectability across eccentricities weighted using the eye movement patterns of observers best predicted human performance in 2D versus 3D search performance for a small microcalcification-like signal and a larger mass-like. The metric with a weighting function based on median search times was the second best predicting human results. Conclusions: The findings provide a set of model observer tools to evaluate image quality in the early stages of imaging system evaluation or design without implementing the more computationally complex foveated search model.

Foveated Model Observers for Visual Search in 3D Medical Images

Model observers have a long history of success in predicting human observer performance in clinically-relevant detection tasks. New 3D image modalities provide more signal information but vastly increase the search space to be scrutinized. Here, we compared standard linear model observers (ideal observers, non-pre-whitening matched filter with eye filter, and various versions of Channelized Hotelling models) to human performance searching in 3D 1/f2.8 filtered noise images and assessed its relationship to the more traditional location known exactly detection tasks and 2D search. We investigated two different signal types that vary in their detectability away from the point of fixation (visual periphery). We show that the influence of 3D search on human performance interacts with the signal's detectability in the visual periphery. Detection performance for signals difficult to detect in the visual periphery deteriorates greatly in 3D search but not in 3D location known exactly and 2D search. Standard model observers do not predict the interaction between 3D search and signal type. A proposed extension of the Channelized Hotelling model (foveated search model) that processes the image with reduced spatial detail away from the point of fixation, explores the image through eye movements, and scrolls across slices can successfully predict the interaction observed in humans and also the types of errors in 3D search. Together, the findings highlight the need for foveated model observers for image quality evaluation with 3D search.

Virtual clinical trials in medical imaging: a review

The accelerating complexity and variety of medical imaging devices and methods have outpaced the ability to evaluate and optimize their design and clinical use. This is a significant and increasing challenge for both scientific investigations and clinical applications. Evaluations would ideally be done using clinical imaging trials. These experiments, however, are often not practical due to ethical limitations, expense, time requirements, or lack of ground truth. Virtual clinical trials (VCTs) (also known as in silico imaging trials or virtual imaging trials) offer an alternative means to efficiently evaluate medical imaging technologies virtually. They do so by simulating the patients, imaging systems, and interpreters. The field of VCTs has been constantly advanced over the past decades in multiple areas. We summarize the major developments and current status of the field of VCTs in medical imaging. We review the core components of a VCT: computational phantoms, simulators of different imaging modalities, and interpretation models. We also highlight some of the applications of VCTs across various imaging modalities.

Assessing CT acquisition parameters with visual-search model observers

A principal difference between the channelized Hotelling (CH) and visual-search (VS) model observers is how they respond to noise texture in images. We compared the two observers in lesion-detection studies to evaluate linear and angular sampling parameters for CT. Simulated lung images were generated from a single two-dimensional mathematical torso phantom containing circular lesions of fixed radius and relative contrast. Projection datasets were produced for two detector pixel sizes and from 15 to 128 projections at 15 and 65 M counts per set. Filtered backprojection reconstructions were obtained with dimensions of [Formula: see text] and [Formula: see text]. A localization receiver operating characteristic study was conducted with two human observers, three single-feature VS observers, and a feature-adaptive VS observer. The effects of the sampling parameters on performance were similar for all of these observers. The CH observer, applied in location-known studies with and without background variability, was not affected by the variations in angular sampling. The two-stage VS framework was an effective modification of the CH observer for assessing the effects of noise texture on human-observer performance in this study.

Investigation of Exposure Factors for Various Breast Composition and Thicknesses in Digital Screening Mammography Related to Breast Dose

OBJECTIVE

To investigate the effect of exposure factors used in digital screening mammography on image quality of different breast compositions.

MATERIAL AND METHODS

A digital mammography unit, with tungsten (W) as target, rhodium (Rh) and silver (Ag) as filters, and amorphous selenium detectors, was used to image Computerized Imaging Reference Systems (CIRS) Model 12A phantoms of thickness 4, 5, and 6 cm. Images of each phantom were obtained using target-filter combinations of W/Rh and W/Ag, at 28, 30, and 32 kVp. Images were evaluated by 5 senior technologists with experience in mammography. Image scores were assigned, for each type of feature present in the phantom. Statistical analysis was performed using nonparametric tests to compare sets of image scores at p = 0.05.

RESULTS

A small but statistically significant improvement was detected in the visibility of microcalcifications (8.8 ± 0.2; p = 0.031) for the W/Rh combination but this did not show any differences in the visibility of masses or fibers. The entrance skin dose (ESD) and mean glandular dose (MGD) were lower for the W/Ag (ESD = 1.30-3.70; MGD = 0.44-0.93 mGy) combination compared to W/Rh (ESD = 1.66-5.40; MGD = 0.52-1.12 mGy). The Mann-Whitney test revealed that 30-kV exposure with the W/Rh combination showed a significantly better visibility of specks in the 30/70 phantom compared to other exposures.

CONCLUSION

The use of an Rh filter showed a better image quality for all phantoms. 28 and 30 kVp with the W/Rh combination provided a slightly better image quality, and the MGD is less than 1.2 mGy.

Analyzing visual-search observers using eye-tracking data for digital breast tomosynthesis images

Visual-search (VS) model observers have the potential to provide reliable predictions of human-observer performance in detection-localization tasks. The purpose of this work was to examine some characteristics of human gaze on breast images with the goal of informing the design of our VS observers. Using a helmet-mounted eye-tracking system, we recorded the movement of gaze from human observers as they searched for masses in sets of 2D digital breast tomosynthesis (DBT) images. The masses in this study were of a single profile. The DBT images were extracted from image volumes reconstructed with the filtered backprojection method. Fixation times associated with observer points of interest were computed from the observer data. We used the k-mean clustering algorithm to get dwell times of gaze data. The dwell times were then compared to sets of morphological feature values extracted from the images. These features, extracted as cross correlations involving the mass profile and the test image, included the matched filter (MF), gradient MF, Laplacian MF, and adaptive MF. The adaptive MF combining four feature maps was computed using a hotelling discriminant generated from training data. For this investigation, we computed correlation coefficients between the fixation times and the feature values. We also conducted a significance test by computing p-values of correlation coefficients for five features. Of all these features, the adaptive MF provided the highest correlation coefficients for DBT images with different densities.

Foveated Model Observers to predict human performance in 3D images

We evaluate 3D search requires model observers that take into account the peripheral human visual processing (foveated models) to predict human observer performance. We show that two different 3D tasks, free search and location-known detection, influence the relative human visual detectability of two signals of different sizes in synthetic backgrounds mimicking the noise found in 3D digital breast tomosynthesis. One of the signals resembled a microcalcification (a small and bright sphere), while the other one was designed to look like a mass (a larger Gaussian blob). We evaluated current standard models observers (Hotelling; Channelized Hotelling; non-prewhitening matched filter with eye filter, NPWE; and non-prewhitening matched filter model, NPW) and showed that they incorrectly predict the relative detectability of the two signals in 3D search. We propose a new model observer (3D Foveated Channelized Hotelling Observer) that incorporates the properties of the visual system over a large visual field (fovea and periphery). We show that the foveated model observer can accurately predict the rank order of detectability of the signals in 3D images for each task. Together, these results motivate the use of a new generation of foveated model observers for predicting image quality for search tasks in 3D imaging modalities such as digital breast tomosynthesis or computed tomography.

Visual-search observers for assessing tomographic x-ray image quality

PURPOSE

Mathematical model observers commonly used for diagnostic image-quality assessments in x-ray imaging research are generally constrained to relatively simple detection tasks due to their need for statistical prior information. Visual-search (VS) model observers that employ morphological features in sequential search and analysis stages have less need for such information and fewer task constraints. The authors compared four VS observers against human observers and an existing scanning model observer in a pilot study that quantified how mass detection and localization in simulated digital breast tomosynthesis (DBT) can be affected by the number P of acquired projections.

METHODS

Digital breast phantoms with embedded spherical masses provided single-target cases for a localization receiver operating characteristic (LROC) study. DBT projection sets based on an acquisition arc of 60° were generated for values of P between 3 and 51. DBT volumes were reconstructed using filtered backprojection with a constant 3D Butterworth postfilter; extracted 2D slices were used as test images. Three imaging physicists participated as observers. A scanning channelized nonprewhitening (CNPW) observer had knowledge of the mean lesion-absent images. The VS observers computed an initial single-feature search statistic that identified candidate locations as local maxima of either a template matched-filter (MF) image or a gradient-template MF (GMF) image. Search inefficiencies that modified the statistic were also considered. Subsequent VS candidate analyses were carried out with (i) the CNPW statistical discriminant and (ii) the discriminant computed from GMF training images. These location-invariant discriminants did not utilize covariance information. All observers read 36 training images and 108 study images per P value. Performance was scored in terms of area under the LROC curve.

RESULTS

Average human-observer performance was stable for P between 7 and 35. In the absence of search inefficiencies, the VS models based on the GMF analysis provided the best correlation (Pearson ρ ≥ 0.62) with the human results. The CNPW-based VS observers deviated from the humans primarily at lower values of P. In this limited study, search inefficiencies allowed for good quantitative agreement with the humans for most of the VS observers.

CONCLUSIONS

The computationally efficient training requirements for the VS observer are suitable for high-resolution imaging, indicating that the observer framework has the potential to overcome important task limitations of current model observers for x-ray applications.