Pre-whitened matched filter and convolutional neural network based model observer performance for mass lesion detection in non-contrast breast CT

A deep learning anthropomorphic model observer for a detection task in PET

BACKGROUND

Lesion detection is one of the most important clinical tasks in positron emission tomography (PET) for oncology. An anthropomorphic model observer (MO) designed to replicate human observers (HOs) in a detection task is an important tool for assessing task-based image quality. The channelized Hotelling observer (CHO) has been the most popular anthropomorphic MO. Recently, deep learning MOs (DLMOs), mostly based on convolutional neural networks (CNNs), have been investigated for various imaging modalities. However, there have been few studies on DLMOs for PET.

PURPOSE

The goal of the study is to investigate whether DLMOs can predict HOs better than conventional MOs such as CHO in a two-alternative forced-choice (2AFC) detection task using PET images with real anatomical variability.

METHODS

Two types of DLMOs were implemented: (1) CNN DLMO, and (2) CNN-SwinT DLMO that combines CNN and Swin Transformer (SwinT) encoders. Lesion-absent PET images were reconstructed from clinical data, and lesion-present images were reconstructed with adding simulated lesion sinogram data. Lesion-present and lesion-absent PET image pairs were labeled by eight HOs consisting of four radiologists and four image scientists in a 2AFC detection task. In total, 2268 pairs of lesion-present and lesion-absent images were used for training, 324 pairs for validation, and 324 pairs for test. CNN DLMO, CNN-SwinT DLMO, CHO with internal noise, and non-prewhitening matched filter (NPWMF) were compared in the same train-test paradigm. For comparison, six quantitative metrics including prediction accuracy, mean squared errors (MSEs) and correlation coefficients, which measure how well a MO predicts HOs, were calculated in a 9-fold cross-validation experiment.

RESULTS

In terms of the accuracy and MSE metrics, CNN DLMO and CNN-SwinT DLMO showed better performance than CHO and NPWMF, and CNN-SwinT DLMO showed the best performance among the MOs evaluated.

CONCLUSIONS

DLMO can predict HOs more accurately than conventional MOs such as CHO in PET lesion detection. Combining SwinT and CNN encoders can improve the DLMO prediction performance compared to using CNN only.

Microcalcification detectability in breast CT images using CNN observers

BACKGROUND

Breast computed tomography (CT) is an emerging breast imaging modality, and ongoing developments aim to improve breast CT's ability to detect microcalcifications. To understand the effects of different parameters on microcalcification detectability, a virtual clinical trial study was conducted using hybrid images and convolutional neural network (CNN)-based model observers. Mathematically generated microcalcifications were embedded into breast CT data sets acquired at our institution, and parameters related to calcification size, calcification contrast, cluster diameter, cluster density, and image display method (i.e., single slices, slice averaging, and maximum-intensity projections) were evaluated for their influence on microcalcification detectability.

PURPOSE

To investigate the individual effects and the interplay of parameters affecting microcalcification detectability in breast CT.

METHODS

Spherical microcalcifications of varying diameters (0.04, 0.10, 0.15, 0.20, 0.25, 0.30, 0.35, 0.40 mm) and native intensities were computer simulated to portray the partial volume effects of the imaging system. Calcifications were mathematically embedded into 109 patient breast CT volume data sets as individual calcifications or as clusters of calcifications. Six numbers of calcifications (1, 3, 5, 7, 10, 15) distributed within six cluster diameters (1, 3, 5, 6, 8, 10 mm) were simulated to study the effect of cluster density. To study the role of image display method, 2D regions of interest (ROIs) and 3D volumes of interest (VOIs) were generated using single slice extraction, slice averaging, and maximum-intensity projection (MIP). 2D and 3D CNNs were trained on the ROIs and VOIs, and receiver operating characteristic (ROC) curve analysis was used to evaluate detection performance. The area under the ROC curve (AUC) was used as the primary performance metric.

RESULTS

Detection performance decreased with increasing section thickness, and peak detection performance occurred using the native section thickness (0.2 mm) and MIP display. The MIP display method, despite using a single slice, yielded comparable performance to the native section thickness, which employed 50 slices. Reduction in slices did not sacrifice detection accuracy and provided significant computational advantages over multi-slice image volumes. Larger cluster diameters resulted in reduced overall detectability, while smaller cluster diameters led to increased detectability. Additionally, we observed that the presence of more calcifications within a cluster improved the overall detectability, while fewer calcifications decreased it.

CONCLUSIONS

As breast CT is still a relatively new breast imaging modality, there is an ongoing need to identify optimal imaging protocols. This work demonstrated the utility of MIP presentation for displaying image volumes containing microcalcification clusters. It is likely that human observers may also benefit from viewing MIPs compared to individual slices. The results of this investigation begin to elucidate how model observers interact with microcalcification clusters in a 3D volume, and will be useful for future studies investigating a broader set of parameters related to breast CT.