A generic framework to simulate realistic lung, liver and renal pathologies in CT imaging

Development and CT image-domain validation of a computational lung lesion model for use in virtual imaging trials

PURPOSE

Computational abnormalities (e.g., lesion models) for use in medical imaging simulation studies are frequently generated using data collected from clinical images. Although this approach allows for highly-customizable lesion detectability studies on clinical computed tomography (CT) data, the ground-truth lesion models produced with this method do not provide a sufficiently realistic lesion morphology for use with current anthropomorphic simulation studies. This work is intended to demonstrate that the new anatomically-informed lesion model presented here is not inferior to the previous lesion model under CT imaging, and can therefore provide a more biologically-informed model for use with simulated CT imaging studies.

METHODS

The lesion model was simulated initially from a seed cell with 10 μm diameter placed in an anatomical location within segmented lung CT and was allowed to reproduce locally within the available solid angle in discrete time-intervals (corresponding to synchronous cell cycles) up to a size of ∼200 μm in diameter. Daughter cells of generation G were allowed also to reproduce on the next available time-step given sufficient space. At lesion sizes beyond 200 μm in diameter, the health of subregions of cells were tracked with a Markov chain technique, indicating which regions were likely to continue growing, which were likely stable, and which were likely to develop necrosis given their proximity to anatomical features and other lesion cells. For lesion sizes beyond 500 μm, the lesion was represented with three nested, triangulated surfaces (corresponding to proliferating, dormant, and necrotic regions), indicating how discrete volumes of the lesion were behaving at a particular time. Lesions were then assigned smoothly-varying material properties based on their cellular level health in each region, resulting in a multi-material lesion model. The lesions produced with this model were then voxelized and placed into lung CT images for comparison with both prior work and clinical data. This model was subject to an observer study in which cardiothoracic imaging radiologists assessed the realism of both clinical and synthetic lesions in CT images.

RESULTS

The useable outputs of this work were voxel- or surface-based, validated, computational lesions, at a scale clearly visible on clinical CT (3-4 cm). Analysis of the observer study results indicated that the computationally-generated lesions were indistinguishable from clinical lesions (AUC = 0.49, 95% CI = [0.36, 0.61]) and non-inferior to an earlier image-based lesion model-indicating the advantage of the model for use in both hybrid CT images and in simulated CT imaging of the lungs.

CONCLUSIONS

Results indicated the non-inferiority of this model as compared to previous methods, indicating the utility of the model for use in both hybrid CT images and in simulated CT imaging.

XCIST-an open access x-ray/CT simulation toolkit

Objective. X-ray-based imaging modalities including mammography and computed tomography (CT) are widely used in cancer screening, diagnosis, staging, treatment planning, and therapy response monitoring. Over the past few decades, improvements to these modalities have resulted in substantially improved efficacy and efficiency, and substantially reduced radiation dose and cost. However, such improvements have evolved more slowly than would be ideal because lengthy preclinical and clinical evaluation is required. In many cases, new ideas cannot be evaluated due to the high cost of fabricating and testing prototypes. Wider availability of computer simulation tools could accelerate development of new imaging technologies. This paper introduces the development of a new open-access simulation environment for x-ray-based imaging. The main motivation of this work is to publicly distribute a fast but accurate ray-tracing x-ray and CT simulation tool along with realistic phantoms and 3D reconstruction capability, building on decades of developments in industry and academia.Approach. The x-ray-based Cancer Imaging Simulation Toolkit (XCIST) is developed in the context of cancer imaging, but can more broadly be applied. XCIST is physics-based, written in Python and C/C++, and currently consists of three major subsets: digital phantoms, the simulator itself (CatSim), and image reconstruction algorithms; planned future features include a fast dose-estimation tool and rigorous validation. To enable broad usage and to model and evaluate new technologies, XCIST is easily extendable by other researchers. To demonstrate XCIST's ability to produce realistic images and to show the benefits of using XCIST for insight into the impact of separate physics effects on image quality, we present exemplary simulations by varying contributing factors such as noise and sampling.Main results. The capabilities and flexibility of XCIST are demonstrated, showing easy applicability to specific simulation problems. Geometric and x-ray attenuation accuracy are shown, as well as XCIST's ability to model multiple scanner and protocol parameters, and to attribute fundamental image quality characteristics to specific parameters.Significance. This work represents an important first step toward the goal of creating an open-access platform for simulating existing and emerging x-ray-based imaging systems. While numerous simulation tools exist, we believe the combined XCIST toolset provides a unique advantage in terms of modeling capabilities versus ease of use and compute time. We publicly share this toolset to provide an environment for scientists to accelerate and improve the relevance of their research in x-ray and CT.

Comparison of Simulated Low-Dose and Conventional-Dose CT for Preoperative Planning in Shoulder Arthroplasty

BACKGROUND

Shoulder computed tomography (CT) is commonly utilized in preoperative planning for total shoulder arthroplasty. Conventional-dose shoulder CT may expose patients to more ionizing radiation than is necessary to provide high-quality images for this procedure. The purpose of this study was to evaluate the utility of simulated low-dose CT images for preoperative planning using manual measurements and common preoperative planning software.

METHODS

Eighteen shoulder CT scans obtained for preoperative arthroplasty planning were used to generate CT images as if they had been acquired at reduced radiation dose (RD) levels of 75%, 50%, and 25% using a simulation technique that mimics decreased x-ray tube current. This technique was validated by quantitative comparison of simulated low-dose scans of a cadaver with actual low-dose scans. Glenoid version, glenoid inclination, and humeral head subluxation were measured using 2 commercially available software platforms and were also measured manually by 3 physicians. These measurements were then analyzed for agreement across RD levels for each patient. Tolerances of 5° of glenoid version, 5° of glenoid inclination, and 10% humeral head subluxation were used as equivalent for preoperative planning purposes.

RESULTS

At all RD levels evaluated, the preoperative planning software successfully segmented the CT images. Semiautomated software measurement of 25% RD images was within tolerances in 99.1% of measurements; for 50% RD images, within tolerances in 96.3% of measurements; and for 75% RD images, within tolerances in 100% of measurements. Manual measurements of 25% RD images were within these tolerances in 95.1% of measurements; for 50% RD images, in 98.8% of measurements; and for 75% RD images, in 99.4% of measurements.

CONCLUSIONS

Simulated low-dose CT images were sufficient for reliable measurement of glenoid version, glenoid inclination, and humeral head subluxation by preoperative planning software as well as by physician-observers. These findings suggest the potential for substantial reduction in RD in preoperative shoulder CT scans without compromising surgical planning.

CLINICAL RELEVANCE

The adoption of low-dose techniques in preoperative shoulder CT may lower radiation exposure for patients undergoing shoulder arthroplasty, without compromising image quality.

Effect of optical blurring of X-ray source on breast tomosynthesis image quality: Modulation transfer function, anatomical noise power spectrum, and signal detectability perspectives

We investigated the effect of the optical blurring of X-ray source on digital breast tomosynthesis (DBT) image quality using well-designed DBT simulator and table-top experimental systems. To measure the in-plane modulation transfer function (MTF), we used simulated sphere phantom and Teflon sphere phantom and generated their projection data using two acquisition modes (i.e., step-and-shoot mode and continuous mode). After reconstruction, we measured the in-plane MTF using reconstructed sphere phantom images. In addition, we measured the anatomical noise power spectrum (aNPS) and signal detectability. We constructed simulated breast phantoms with a 50% volume glandular fraction (VGF) of breast anatomy using the power law spectrum and inserted spherical objects with 1 mm, 2 mm, and 5 mm diameters as breast masses. Projection data were acquired using two acquisition modes, and in-plane breast images were reconstructed using the Feldkamp-Davis-Kress (FDK) algorithm. For the experimental study, we used BR3D breast phantom with 50% VGF and obtained projection data using a table-top experimental system. To compare the detection performance of the two acquisition modes, we calculated the signal detectability using the channelized Hotelling observer (CHO) with Laguerre-Gauss (LG) channels. Our results show that spatial resolution of in-plane image in continuous mode was degraded due to the optical blurring of X-ray source. This blurring effect was reflected in aNPS, resulting in large β values. From a signal detectability perspective, the signal detectability in step-and-shoot mode is higher than that in continuous mode for small spherical signals but not large spherical signals. Although the step-and-shoot mode has disadvantage in terms of scan time compared to the continuous mode, scanning in step-and-shoot mode is better for detecting small signals, indicating that there is a tradeoff between scan time and image quality.

Correction for Systematic Bias in Radiomics Measurements Due to Variation in Imaging Protocols

RATIONALE AND OBJECTIVES

The accuracy of measured radiomics features is affected by CT imaging protocols. This study aims to ascertain if applying bias corrections can improve the classification performance of the radiomics features.

MATERIALS AND METHODS

A cohort of 144 Non-Small Cell Lung Cancer patient CT images was used to calculate radiomics features for use in predictive models of patient pathological stage. Simulation models of the tumors, matched to patient lesion qualities of size, contrast, and degree of spiculation, were used to both create and assess protocol-specific correction factors. The usefulness of correction was first assessed by applying the corrections to simulated lesion phantoms with known properties using a corrected paired Student's t-test. The sensitivity of radiomics features to correction factors was assessed by applying a library of possible theoretical correction factors to the uncorrected radiomics from the patient data. The data were then used to assess the effect of the correction on prediction performance (AUC) from a logistic regression radiomics model across the patient cases.

RESULTS

The correction factors were shown to reduce the bias of radiomics features, caused by protocols, provided that the correction factors were derived from lesion models with similar properties. The sensitivity of the radiomics features to changes due to protocol effects was on average 89% among all features. The corrections applied to patient data resulted in a small increase of 0.0074 in AUC that was not statistically significant (p=0.60).

CONCLUSION

Protocol-specific correction factors can be applied to radiomics studies to control for biases introduced by different imaging protocols. The correction factors should ideally be lesion-specific, derived using lesion models that echo patient lesion characteristics in terms of size, contrast, and degree of spiculation. Small corrections in the 10% range offers only a small improvement in the predictability of radiomics.

Performance Assessment Framework for Neural Network Denoising

The proliferation of deep learning image processing calls for a quantitative image quality assessment framework that is suitable for nonlinear, data-dependent algorithms. In this work, we propose a method to systematically evaluate the system and noise responses such that the nonlinear transfer properties can be mapped out. The method involves sampling of lesion perturbations as a function of size, contrast, as well as clinically relevant features such as shape and texture that may be important for diagnosis. We embed the perturbations in backgrounds of varying attenuation levels, noise magnitude and correlation that are associated with different patient anatomies and imaging protocols. The range of system and noise response are further used to evaluate performance for clinical tasks such as signal detection and classification. We performed the assessment for an example CNN-denoising algorithm for low does lung CT screening. The system response of the CNN-denoising algorithm exhibits highly nonlinear behavior where both contrast and higher order lesion features such as spiculated boundaries are not reliably represented for lesions perturbations with small size and low contrast. The noise properties are potentially highly nonstationary, and should be assumed to be the same between the signal-present and signal-absent images. Furthermore, we observer a high degree dependency of both system and noise response on the background attenuation levels. Inputs around zeros are effectively imposed a non-negativity constraint; transfer properties for higher background levels are highly variable. For a detection task, CNN-denoised images improved detectability index by 16-18% compared to low dose CT inputs. For classification task between spiculated and smooth lesions, CNN-denoised images result in a much larger improvement up to 50%. The performance assessment framework propose in this work can systematically map out the nonlinear transfer functions for deep learning algorithms and can potentially enable robust deployment of such algorithms in medical imaging applications.

Quantification of Minimum Detectable Difference in Radiomics Features Across Lesions and CT Imaging Conditions

RATIONALE AND OBJECTIVES

The 3-fold purpose of this study was to (1) develop a method to relate measured differences in radiomics features in different computed tomography (CT) scans to one another and to true feature differences; (2) quantify minimum detectable change in radiomics features based on measured radiomics features from pairs of synthesized CT images acquired under variable CT scan settings, and (3) ascertain and inform the recommendations of the Quantitative Imaging Biomarkers Alliance (QIBA) for nodule volumetry.

MATERIALS AND METHODS

Images of anthropomorphic lung nodule models were simulated using resolution and noise properties for 297 unique imaging conditions. Nineteen morphology features were calculated from both the segmentation masks derived from the imaged nodules and from ground truth nodules. Analysis was performed to calculate minimum detectable difference of radiomics features as a function of imaging protocols in comparison to QIBA guidelines.

RESULTS

The minimum detectable differences ranged from 1% to 175% depending on the specific feature and set of imaging protocols. The results showed that QIBA protocol recommendations result in improved minimum detectable difference as compared to the range of possible protocols. The results showed that the minimum detectable differences may be improved from QIBA's current recommendation by further restricting the slice thickness requirement to be between 0.5 mm and 1 mm.

CONCLUSION

Minimum detectable differences of radiomics features were quantified for lung nodules across a wide range of possible protocols. The results can be used prospectively to inform decision-making about imaging protocols to provide superior quantification of radiomics features.

Current status of deep learning in abdominal image reconstruction

Abdominal magnetic resonance imaging (MRI) and computed tomography (CT) are commonly used for disease screening, diagnosis, and treatment guidance. However, abdominal MRI has disadvantages including slow speed and vulnerability to motions, while CT suffers from problems of radiation. It has been reported that deep learning reconstruction can solve such problems while maintaining good image quality. Recently, deep learning-based image reconstruction has become a hot topic in the field of medical imaging. This study reviews the latest research on deep learning reconstruction in abdominal imaging, including the widely used convolutional neural network, generative adversarial network, and recurrent neural network.

Technical Note: Synthesizing of lung tumors in computed tomography images

PURPOSE

When investigating new radiation therapy techniques in the treatment planning stage, it can be extremely time consuming to locate multiple patient scans that match the desired characteristics for the treatment. With the help of machine learning, we propose to bypass the difficulty in finding patient computed tomography (CT) scans that match the treatment requirements. Furthermore, we aim to provide the developed method as a tool that is easily accessible to interested researchers.

METHODS

We propose a generative adversarial network (GAN) to edit individual volumes of interest (VOIs) in pre-existing CT scans, translating features of the healthy VOIs into features of cancerous volumes. Training and testing was done using VOIs from a dataset of 460 diagnostic and lung cancer screening CT scans. Agreement between real tumors and those produced by the editor was tested by comparing the distributions of several histogram parameters and second-order statistics as well as using qualitative analysis.

RESULTS

After training, the network was successfully able to map healthy CT segments to realistic looking cancerous volumes. Based on visual inspection, tumors produced by the editor were found to be both realistic and visually consistent with the surrounding anatomy when placed back into the original CT scan. Furthermore, the network was found to be able to extrapolate well beyond the upper size limit of the training set. Lastly, a graphical user interface (GUI) was developed to easily interact with the resulting network.

CONCLUSION

The trained network and associated GUI can serve as a tool to develop an abundance of lung cancer patient data to be used in treatment planning. In addition, this method can be extended to a variety of cancer types if given an appropriate baseline dataset. The GUI and instructions on how to utilize the tool have been made publicly available at https://github.com/teaghan/CT_Editor.

Minimum perceivable size difference: how well can radiologists visually detect a change in lung nodule size from CT images?

OBJECTIVE

The purpose of this study was to determine how well radiologists could visually detect a change in lung nodule size on the basis of visual image perception alone.

SUBJECTS AND METHODS

Under IRB approval, 109 standard chest CT image series were anonymized and exported from PACS. Nine hundred forty virtual lung nodule pairs (six baseline diameters, six relative volume differences, two nodule types-solid and ground glass-and 14 repeats) were digitally inserted into the chest CT image series (same location, different sizes between the pair). These digitally altered CT image pairs were shown to nine radiologists who were tasked to visually determine which image contained the larger nodule using a two-alternative forced-choice perception experimental design. These data were statistically analyzed using a generalized linear mixed effects model to determine how accurately the radiologists were able to correctly identify the larger nodule.

RESULTS

Nominal baseline nodule diameter, relative volume difference, and nodule type were found to be statistically significant factors (p < 0.001) in influencing the radiologists' accuracy. For solid (ground-glass) nodules, the baseline diameter needed to be at least 6.3 mm (13.2 mm) to be able to visually detect a 25% change in volume with 95 ± 1.4% accuracy. Accuracy was lowest for the nodules with the smallest baseline diameters and smallest relative volume differences. Additionally, accuracy was lower for ground-glass nodules compared to solid nodules.

CONCLUSIONS

Factors that impacted visual size assessment were baseline nodule diameter, relative volume difference, and solid versus non-solid nodule type, with larger and more solid lesions offering a more precise assessment of change.

KEY POINTS

• For solid nodules, radiologists could visually detect a 25% change in volume with 95% accuracy for nodules having greater than 6.3-mm baseline diameter. • For ground-glass nodules, radiologists could visually detect a 25% change in volume with 95% accuracy for nodules having greater than 13.2-mm baseline diameter. • Accuracy in detecting a change in nodule size began to stabilize around 90-100% for nodules with larger baseline diameters (> 8 mm for solid nodules, > 12 mm for ground-glass nodules) and larger relative volume differences (>15% for solid nodules, > 25% for ground-glass nodules).

Search of low-contrast liver lesions in abdominal CT: the importance of scrolling behavior

Purpose: Visual search using volumetric images is becoming the standard in medical imaging. However, we do not fully understand how eye movement strategies mediate diagnostic performance. A recent study on computed tomography (CT) images showed that the search strategies of radiologists could be classified based on saccade amplitudes and cross-quadrant eye movements [eye movement index (EMI)] into two categories: drillers and scanners. Approach: We investigate how the number of times a radiologist scrolls in a given direction during analysis of the images (number of courses) could add a supplementary variable to use to characterize search strategies. We used a set of 15 normal liver CT images in which we inserted 1 to 5 hypodense metastases of two different signal contrast amplitudes. Twenty radiologists were asked to search for the metastases while their eye-gaze was recorded by an eye-tracker device (EyeLink1000, SR Research Ltd., Mississauga, Ontario, Canada). Results: We found that categorizing radiologists based on the number of courses (rather than EMI) could better predict differences in decision times, percentage of image covered, and search error rates. Radiologists with a larger number of courses covered more volume in more time, found more metastases, and made fewer search errors than those with a lower number of courses. Our results suggest that the traditional definition of drillers and scanners could be expanded to include scrolling behavior. Drillers could be defined as scrolling back and forth through the image stack, each time exploring a different area on each image (low EMI and high number of courses). Scanners could be defined as scrolling progressively through the stack of images and focusing on different areas within each image slice (high EMI and low number of courses). Conclusions: Together, our results further enhance the understanding of how radiologists investigate three-dimensional volumes and may improve how to teach effective reading strategies to radiology residents.

Virtual clinical trials in medical imaging: a review

The accelerating complexity and variety of medical imaging devices and methods have outpaced the ability to evaluate and optimize their design and clinical use. This is a significant and increasing challenge for both scientific investigations and clinical applications. Evaluations would ideally be done using clinical imaging trials. These experiments, however, are often not practical due to ethical limitations, expense, time requirements, or lack of ground truth. Virtual clinical trials (VCTs) (also known as in silico imaging trials or virtual imaging trials) offer an alternative means to efficiently evaluate medical imaging technologies virtually. They do so by simulating the patients, imaging systems, and interpreters. The field of VCTs has been constantly advanced over the past decades in multiple areas. We summarize the major developments and current status of the field of VCTs in medical imaging. We review the core components of a VCT: computational phantoms, simulators of different imaging modalities, and interpretation models. We also highlight some of the applications of VCTs across various imaging modalities.

3D printing of anatomically realistic phantoms with detection tasks to assess the diagnostic performance of CT images

Objectives

Detectability experiments performed to assess the diagnostic performance of computed tomography (CT) images should represent the clinical situation realistically. The purpose was to develop anatomically realistic phantoms with low-contrast lesions for detectability experiments.

Methods

Low-contrast lesions were digitally inserted into a neck CT image of a patient. The original and the manipulated CT images were used to create five phantoms: four phantoms with lesions of 10, 20, 30, and 40 HU contrast and one phantom without any lesion. Radiopaque 3D printing with potassium-iodide-doped ink (600 mg/mL) was used. The phantoms were scanned with different CT settings. Lesion contrast was analyzed using HU measurement. A 2-alternative forced choice experiment was performed with seven radiologists to study the impact of lesion contrast on detection accuracy and reader confidence (1 = lowest, 5 = highest).

Results

The phantoms reproduced patient size, shape, and anatomy. Mean ± SD contrast values of the low-contrast lesions were 9.7 ± 1.2, 18.2 ± 2, 30.2 ± 2.7, and 37.7 ± 3.1 HU for the 10, 20, 30, and 40 HU contrast lesions, respectively. Mean ± SD detection accuracy and confidence values were not significantly different for 10 and 20 HU lesion contrast (82.1 ± 6.3% vs. 83.9 ± 9.4%, p = 0.863 and 1.7 ± 0.4 vs. 1.8 ± 0.5, p = 0.159). They increased to 95 ± 5.7% and 2.6 ± 0.7 for 30 HU lesion contrast and 99.5 ± 0.9% and 3.8 ± 0.7 for 40 HU lesion contrast (p < 0.005).

Conclusions

A CT image was manipulated to produce anatomically realistic phantoms for low-contrast detectability experiments. The phantoms and our initial experiments provide a groundwork for the assessment of CT image quality in a clinical context.

Key Points

• Phantoms generated from manipulated CT images provide patient anatomy and can be used for detection tasks to evaluate the diagnostic performance of CT images.

• Radiologists are unconfident and unreliable in detecting hypodense lesions of 20 HU contrast and less in an anatomical neck background.

• Detectability experiments with anatomically realistic phantoms can assess CT image quality in a clinical context.

Electronic supplementary material

The online version of this article (10.1007/s00330-020-06808-7) contains supplementary material, which is available to authorized users.

A Simulation Paradigm for Evaluation of Subtle Liver Lesions at Pediatric CT: Performance and Confidence

PURPOSE

To create and validate a systematic observer performance platform for evaluation of simulated liver lesions at pediatric CT and to test this paradigm to measure the effect of radiation dose reduction on detection performance and reader confidence.

MATERIALS AND METHODS

Thirty normal pediatric (from patients aged 0-10 years) contrast material-enhanced, de-identified abdominal CT scans obtained from July 1, 2012, through July 1, 2016, were retrospectively collected from the clinical database. The study was exempt from institutional review board approval. Zero to three simulated, low-contrast liver lesions (≤6 mm) were digitally inserted by using software, and noise was added to simulate reductions in volume CT dose index (representing radiation dose estimation) of 25% and 50%. Pediatric, abdominal, and resident radiologists (three of each) reviewed 90 data sets in three sessions using an online interface, marking each lesion location and rating confidence (scale, 0-100). Statistical analysis was performed by using software.

RESULTS

Mixed-effects models revealed a significant decrease in detection sensitivity as radiation dose decreased (P < .001). The mean confidence of the full-dose and 25% dose reduction examinations was significantly higher than that of the 50% dose reduction examinations (P = .011 and .012, respectively) but not different from one another (P = .866). Dose was not a significant predictor of time to complete each case, and subspecialty was not a significant predictor of sensitivity or false-positive results.

CONCLUSION

Sensitivity for lesion detection significantly decreased as dose decreased; however, confidence did not change between the full-dose and 25% reduced-dose scans. This suggests that readers are unaware of this decrease in performance, which should be accounted for in clinical dose reduction efforts.Keywords: Abdomen/GI, CT, Liver, Observer Performance, Pediatrics, Perception Image© RSNA, 2019.

Evaluation of Simulated Lesions as Surrogates to Clinical Lesions for Thoracic CT Volumetry: The Results of an International Challenge

RATIONALE AND OBJECTIVES

To evaluate a new approach to establish compliance of segmentation tools with the computed tomography volumetry profile of the Quantitative Imaging Biomarker Alliance (QIBA); and determine the statistical exchangeability between real and simulated lesions through an international challenge.

MATERIALS AND METHODS

The study used an anthropomorphic phantom with 16 embedded physical lesions and 30 patient cases from the Reference Image Database to Evaluate Therapy Response with pathologically confirmed malignancies. Hybrid datasets were generated by virtually inserting simulated lesions corresponding to physical lesions into the phantom datasets using one projection-domain-based method (Method 1), two image-domain insertion methods (Methods 2 and 3), and simulated lesions corresponding to real lesions into the Reference Image Database to Evaluate Therapy Response dataset (using Method 2). The volumes of the real and simulated lesions were compared based on bias (measured mean volume differences between physical and virtually inserted lesions in phantoms as quantified by segmentation algorithms), repeatability, reproducibility, equivalence (phantom phase), and overall QIBA compliance (phantom and clinical phase).

RESULTS

For phantom phase, three of eight groups were fully QIBA compliant, and one was marginally compliant. For compliant groups, the estimated biases were -1.8 ± 1.4%, -2.5 ± 1.1%, -3 ± 1%, -1.8 ± 1.5% (±95% confidence interval). No virtual insertion method showed statistical equivalence to physical insertion in bias equivalence testing using Schuirmann's two one-sided test (±5% equivalence margin). Differences in repeatability and reproducibility across physical and simulated lesions were largely comparable (0.1%-16% and 7%-18% differences, respectively). For clinical phase, 7 of 16 groups were QIBA compliant.

CONCLUSION

Hybrid datasets yielded conclusions similar to real computed tomography datasets where phantom QIBA compliant was also compliant for hybrid datasets. Some groups deemed compliant for simulated methods, not for physical lesion measurements. The magnitude of this difference was small (<5.4%). While technical performance is not equivalent, they correlate, such that, volumetrically simulated lesions could potentially serve as practical proxies.

Design and fabrication of heterogeneous lung nodule phantoms for assessing the accuracy and variability of measured texture radiomics features in CT

We aimed to design and fabricate synthetic lung nodules with patient-informed internal heterogeneity to assess the variability and accuracy of measured texture features in CT. To that end, 190 lung nodules from a publicly available database of chest CT images (Lung Image Database Consortium) were selected based on size ( > 3    mm ) and malignancy. The texture features of the nodules were used to train a statistical texture synthesis model based on clustered lumpy background. The model parameters were ascertained based on a genetic optimization of a Mahalanobis distance objective function. The resulting texture model defined internal heterogeneity within 24 anthropomorphic lesion models which were subsequently fabricated into physical phantoms using a multimaterial three-dimensional (3-D) printer. The 3-D-printed lesions were imbedded in an anthropomorphic chest phantom and imaged with a clinical scanner using different acquisition parameters including slice thickness, dose level, and reconstruction kernel. The imaged lesions were analyzed in terms of texture features to ascertain the impact of CT imaging on lesion texture quantification. The texture modeling method produced lesion models with low and stable Mahalanobis distance between real and synthetic textures. The virtual lesions were successfully printed into 3-D phantoms. The accuracy and variability of the measured features extracted from the CT images of the phantoms showed notable influence from the imaging acquisition parameters with contrast, energy, and texture entropy exhibiting most sensitivity in terms of accuracy, and contrast, dissimilarity, and texture entropy most variability. Thinner slice thicknesses yielded more accurate and edge reconstruction kernels more stable results. We conclude that printed textured models of lesions can be developed using a method that can target and minimize the mathematical distance between real and synthetic lesions. The synthetic lesions can be used as the basis to investigate how CT imaging conditions might affect radiomics features derived from CT images.

Localization of liver lesions in abdominal CT imaging: I. Correlation of human observer performance between anatomical and uniform backgrounds

The purpose of this study was to determine the correlation between human observer performance for localization of small low contrast lesions within uniform water background versus an anatomical liver background, under the conditions of varying dose, lesion size, and reconstruction algorithm. Liver lesions (5 mm, 7 mm, and 9 mm, contrast:  -21 HU) were digitally inserted into CT projection data of ten normal patients in vessel-free liver regions. Noise was inserted into the projection data to create three image sets: full dose and simulated half and quarter doses. Images were reconstructed with a standard filtered back projection (FBP) and an iterative reconstruction (IR) algorithm. Lesion and noise insertion procedures were repeated with water phantom data. Two-dimensional regions of interest (66 lesion-present, 34 lesion-absent) were selected, randomized, and independently reviewed by three medical physicists to identify the most likely location of the lesion and provide a confidence score. Locations and confidence scores were assessed using the area under the localization receiver operating characteristic curve (Az_LROC). We examined the correlation between human performance for the liver and uniform water backgrounds as dose, lesion size, and reconstruction algorithm varied. As lesion size or dose increased, reader localization performance improved. For full dose IR images, the Az_LROC for 5, 7, and 9 mm lesions were 0.53, 0.91, and 0.97 (liver) and 0.51, 0.96, and 0.99 (uniform water), respectively. Similar trends were seen with other parameters. Performance values for liver and uniform backgrounds were highly correlated for both reconstruction algorithms, with a Spearman correlation of ρ  =  0.97, and an average difference in Az_LROC of 0.05  ±  0.04. For the task of localizing low contrast liver lesions, human observer performance was highly correlated between anatomical and uniform backgrounds, suggesting that lesion localization studies emulating a clinical test of liver lesion detection can be performed using a uniform background.

Systematic analysis of bias and variability of morphologic features for lung lesions in computed tomography

We propose to characterize the bias and variability of quantitative morphology features of lung lesions across a range of computed tomography (CT) imaging conditions. A total of 15 lung lesions were simulated (five in each of three spiculation classes: low, medium, and high). For each lesion, a series of simulated CT images representing different imaging conditions were synthesized by applying three-dimensional blur and adding correlated noise based on the measured noise and resolution properties of five commercial multislice CT systems, representing three dose levels ( CTDI vol of 1.90, 3.75, 7.50 mGy), three slice thicknesses (0.625, 1.25, 2.5 mm), and 33 clinical reconstruction kernels from five clinical scanners. The images were segmented using three segmentation algorithms and each algorithm was evaluated by computing a Sørensen-Dice coefficient between the ground truth and the segmentation. A series of 21 shape-based morphology features were extracted from both "ground truth" (i.e., preblur without noise) and "image rendered" lesions (i.e., postblur and with noise). For each morphology feature, the bias was quantified by comparing the percentage relative error in the morphology metric between the imaged lesions and the ground-truth lesions. The variability was characterized by calculating the average coefficient of variation averaged across repeats and imaging conditions. The active contour segmentation had the highest average Dice coefficient of 0.80 followed by 0.63 for threshold, and 0.39 for fuzzy c-means. The bias of the features was segmentation algorithm and feature-dependent, with sharper kernels being less biased and smoother kernels being more biased in general. The feature variability from simulated images ranged from 0.30% to 10% for repeats of the same condition and from 0.74% to 25.3% for different lesions in the same spiculation class. In conclusion, the bias of morphology features is dependent on the acquisition protocol in combination with the segmentation algorithm used and the variability is primarily dependent on the segmentation algorithm.

Technical Note: Design and implementation of a high-throughput pipeline for reconstruction and quantitative analysis of CT image data

PURPOSE

With recent substantial improvements in modern computing, interest in quantitative imaging with CT has seen a dramatic increase. As a result, the need to both create and analyze large, high-quality datasets of clinical studies has increased as well. At present, no efficient, widely available method exists to accomplish this. The purpose of this technical note is to describe an open-source high-throughput computational pipeline framework for the reconstruction and analysis of diagnostic CT imaging data to conduct large-scale quantitative imaging studies and to accelerate and improve quantitative imaging research.

METHODS

The pipeline consists of two, primary "blocks": reconstruction and analysis. Reconstruction is carried out via a graphics processing unit (GPU) queuing framework developed specifically for the pipeline that allows a dataset to be reconstructed using a variety of different parameter configurations such as slice thickness, reconstruction kernel, and simulated acquisition dose. The analysis portion then automatically analyzes the output of the reconstruction using "modules" that can be combined in various ways to conduct different experiments. Acceleration of analysis is achieved using cluster processing. Efficiency and performance of the pipeline are demonstrated using an example 142 subject lung screening cohort reconstructed 36 different ways and analyzed using quantitative emphysema scoring techniques.

RESULTS

The pipeline reconstructed and analyzed the 5112 reconstructed datasets in approximately 10 days, a roughly 72× speedup over previous efforts using the scanner for reconstructions. Tightly coupled pipeline quality assurance software ensured proper performance of analysis modules with regard to segmentation and emphysema scoring.

CONCLUSIONS

The pipeline greatly reduced the time from experiment conception to quantitative results. The modular design of the pipeline allows the high-throughput framework to be utilized for other future experiments into different quantitative imaging techniques. Future applications of the pipeline being explored are robustness testing of quantitative imaging metrics, data generation for deep learning, and use as a test platform for image-processing techniques to improve clinical quantitative imaging.

Interchangeability between real and three-dimensional simulated lung tumors in computed tomography: an interalgorithm volumetry study

Using hybrid datasets consisting of patient-derived computed tomography (CT) images with digitally inserted computational tumors, we establish volumetric interchangeability between real and computational lung tumors in CT. Pathologically-confirmed malignancies from 30 thoracic patient cases from the RIDER database were modeled. Tumors were either isolated or attached to lung structures. Patient images were acquired on one of two CT scanner models (Lightspeed 16 or VCT; GE Healthcare) using standard chest protocol. Real tumors were segmented and used to inform the size and shape of simulated tumors. Simulated tumors developed in Duke Lesion Tool (Duke University) were inserted using a validated image-domain insertion program. Four readers performed volume measurements using three commercial segmentation tools. We compared the volume estimation performance of segmentation tools between real tumors in actual patient CT images and corresponding simulated tumors virtually inserted into the same patient images (i.e., hybrid datasets). Comparisons involved (1) direct assessment of measured volumes and the standard deviation between simulated and real tumors across readers and tools, respectively, (2) multivariate analysis, involving segmentation tools, readers, tumor shape, and attachment, and (3) effect of local tumor environment on volume measurement. Volume comparison showed consistent trends (9% volumetric difference) between real and simulated tumors across all segmentation tools, readers, shapes, and attachments. Across all cases, readers, and segmentation tools, an intraclass correlation coefficient = 0.99 indicates that simulated tumors correlated strongly with real tumors ( p = 0.95 ). In addition, the impact of the local tumor environment on tumor volume measurement was found to have a segmentation tool-related influence. Strong agreement between simulated tumors modeled in this study compared to their real counterparts suggests a high degree of similarity. This indicates that, volumetrically, simulated tumors embedded into patient CT data can serve as reasonable surrogates to real patient data.

Validation of lesion simulations in clinical CT data for anonymized chest and abdominal CT databases

PURPOSE

To make available to the medical imaging community a computed tomography (CT) image database composed of hybrid datasets (patient CT images with digitally inserted anthropomorphic lesions) where lesion ground truth is known a priori. It is envisioned that such a dataset could be a resource for the assessment of CT image quality, machine learning, and imaging technologies [e.g., computer aided detection (CAD) and segmentation algorithms].

ACQUISITION AND VALIDATION METHODS

This HIPPA compliant, IRB waiver of approval study consisted of utilizing 120 chest and 100 abdominal clinically acquired adult CT exams. One image series per patient exam was utilized based on coverage of the anatomical region of interest (either the thorax or abdomen). All image series were de-identified. Simulated lesions were derived from a library of anatomically informed digital lesions (93 lung and 50 liver lesions) where six and four digital lesions with nominal diameters ranging from 4 to 20 mm were inserted into lung and liver image series, respectively. Locations for lesion insertion were randomly chosen. A previously validated lesion simulation and virtual insertion technique were utilized. The resulting hybrid images were reviewed by three experienced radiologists to assure similarity with routine clinical imaging in a diverse adult population.

DATA FORMAT AND USAGE NOTES

The database is composed of four datasets that contain 100 patient cases each, for a total of 400 image series accompanied by Matlab.mat tables that provide descriptive information about the virtually inserted lesions (i.e., size, shape, opacity, and insertion location in physical (world) coordinates and voxel indices). All image and metadata are stored in DICOM format on the Quantitative Imaging Data Warehouse (https://qidw.rsna.org/#collection/57d463471cac0a4ec8ff8f46/folder/5b23dceb1cac0a4ec800a770?dialog=login), in two sets: (a) QIBA CT Hybrid Dataset I which contains Lung I and Liver I datasets, and (b) QIBA CT Hybrid Dataset II which contains Lung II and Liver II datasets. The QIDW is supported by the Radiological Society of North America (RSNA). Registration is required upon initial log in.

POTENTIAL APPLICATIONS

By simulating lesion opacity (full solid, part solid and ground glass), size, and texture, the relationship between lesion morphology and segmentation or CAD algorithm performance can be investigated without the need for repetitive patient exams. This database can also serve as a reference standard for device and reader performance studies.

Computational insertion of microcalcification clusters on mammograms: reader differentiation from native clusters and computer-aided detection comparison

Mammographic computer-aided detection (CADe) devices are typically first developed and assessed for a specific "original" acquisition system. When developers are ready to apply their CADe device to a mammographic acquisition system, they typically assess the device with images acquired using the system. Collecting large repositories of clinical images containing verified lesion locations acquired by a system is costly and time consuming. We previously developed an image blending technique that allows users to seamlessly insert regions of interest (ROIs) from one medical image into another image. Our goal is to assess the performance of this technique for inserting microcalcification clusters from one mammogram into another, with the idea that when fully developed, our technique may be useful for reducing the clinical data burden in the assessment of a CADe device for use with an image acquisition system. We first perform a reader study to assess whether experienced observers can distinguish between computationally inserted and native clusters. For this purpose, we apply our insertion technique to 55 clinical cases. ROIs containing microcalcification clusters from one breast of a patient are inserted into the contralateral breast of the same patient. The analysis of the reader ratings using receiver operating characteristic (ROC) methodology indicates that inserted clusters cannot be reliably distinguished from native clusters (area under the ROC curve = 0.58 ± 0.04 ). Furthermore, CADe sensitivity is evaluated on mammograms of 68 clinical cases with native and inserted microcalcification clusters using a commercial CADe system. The average by-case sensitivities for native and inserted clusters are equal, 85.3% (58/68). The average by-image sensitivities for native and inserted clusters are 72.3% and 67.6%, respectively, with a difference of 4.7% and a 95% confidence interval of [ - 2.1 11.6]. These results demonstrate the potential for using the inserted microcalcification clusters for assessing mammographic CADe devices.

CT reconstruction algorithms affect histogram and texture analysis: evidence for liver parenchyma, focal solid liver lesions, and renal cysts

PURPOSE

To determine the effects of different reconstruction algorithms on histogram and texture features in different targets.

MATERIALS AND METHODS

Among 3620 patients, 480 had normal liver parenchyma, 494 had focal solid liver lesions (metastases = 259; hepatocellular carcinoma = 99; hemangioma = 78; abscess = 32; and cholangiocarcinoma = 26), and 488 had renal cysts. CT images were reconstructed with filtered back-projection (FBP), hybrid iterative reconstruction (HIR), and iterative model reconstruction (IMR) algorithms. Computerized histogram and texture analyses were performed by extracting 11 features.

RESULTS

Different reconstruction algorithms had distinct, significant effects. IMR had a greater effect than HIR. For instance, IMR had a significant effect on five features of liver parenchyma, nine features of focal liver lesions, and four features of renal cysts on portal-phase scans and four, eight, and four features, respectively, on precontrast scans (p < 0.05). Meanwhile, different algorithms had a greater effect on focal liver lesions (six in HIR and nine in IMR on portal-phase, three in HIR, and eight in IMR on precontrast scans) than on liver parenchyma or cysts. The mean attenuation and standard deviation were not affected by the reconstruction algorithm (p > .05). Most parameters showed good or excellent intra- and interobserver agreement, with intraclass correlation coefficients ranging from 0.634 to 0.972.

CONCLUSIONS

Different reconstruction algorithms affect histogram and texture features. Reconstruction algorithms showed stronger effects in focal liver lesions than in liver parenchyma or renal cysts.

KEY POINTS

• Imaging heterogeneities influenced the quantification of image features. • Different reconstruction algorithms had a significant effect on histogram and texture features. • Solid liver lesions were more affected than liver parenchyma or cysts.

3D task-transfer function representation of the signal transfer properties of low-contrast lesions in FBP- and iterative-reconstructed CT

PURPOSE

The purpose of this study was to investigate how accurately the task-transfer function (TTF) models the signal transfer properties of low-contrast features in a non-linear commercial CT system.

METHODS

A cylindrical phantom containing 24 anthropomorphic "physical" lesions was 3D printed. Lesions had two sizes (523, 2145 mm³ ), and two nominal radio-densities (80 and 100 HU at 120 kV). CT images were acquired on a commercial CT system (Siemens Flash scanner) at four dose levels (CTDI_vol , 32 cm phantom:1.5, 3.0, 6.0, 22.0 mGy) and reconstructed using FBP and IR kernels (B31f, B45f, I31f\2, I44f\2). Low-contrast rod inserts (in-plane) and a slanted edge (z-direction) were used to estimate 3D-TTFs. CAD versions of lesions were blurred by the 3D-TTFs, virtually superimposed into corresponding phantom images, and compared to the physical lesions in terms of (a) a 4AFC visual assessment, (b) edge gradient, (c) size, and (d) shape similarity. Assessments 2 and 3 were based on an equivalence criterion D ¯ ≥ COV ¯ to determine if the natural variability COV ¯ in the physical lesions was greater or equal to the difference D ¯ between physical and simulated. Shape similarity was quantified via Sorensen-Dice coefficient (SDC). Comparisons were done for each lesion and for all imaging conditions.

RESULTS

The readers detected simulated lesions at a rate of 37.9 ± 3.1% (25% implies random guessing). Lesion edge blur and volume differences D ¯ were on average less than physical lesions' natural variability COV ¯ . The SDC (average ± SD) was 0.80 ± 0.13 (max of 1 possible).

CONCLUSIONS

The visual appearance, edge blur, size, and shape of simulated lesions were similar to the physical lesions, which suggests 3D-TTF models the low-contrast signal transfer properties of this non-linear CT system reasonably well.

Inter-laboratory comparison of channelized hotelling observer computation

PURPOSE

The task-based assessment of image quality using model observers is increasingly used for the assessment of different imaging modalities. However, the performance computation of model observers needs standardization as well as a well-established trust in its implementation methodology and uncertainty estimation. The purpose of this work was to determine the degree of equivalence of the channelized Hotelling observer performance and uncertainty estimation using an intercomparison exercise.

MATERIALS AND METHODS

Image samples to estimate model observer performance for detection tasks were generated from two-dimensional CT image slices of a uniform water phantom. A common set of images was sent to participating laboratories to perform and document the following tasks: (a) estimate the detectability index of a well-defined CHO and its uncertainty in three conditions involving different sized targets all at the same dose, and (b) apply this CHO to an image set where ground truth was unknown to participants (lower image dose). In addition, and on an optional basis, we asked the participating laboratories to (c) estimate the performance of real human observers from a psychophysical experiment of their choice. Each of the 13 participating laboratories was confidentially assigned a participant number and image sets could be downloaded through a secure server. Results were distributed with each participant recognizable by its number and then each laboratory was able to modify their results with justification as model observer calculation are not yet a routine and potentially error prone.

RESULTS

Detectability index increased with signal size for all participants and was very consistent for 6 mm sized target while showing higher variability for 8 and 10 mm sized target. There was one order of magnitude between the lowest and the largest uncertainty estimation.

CONCLUSIONS

This intercomparison helped define the state of the art of model observer performance computation and with thirteen participants, reflects openness and trust within the medical imaging community. The performance of a CHO with explicitly defined channels and a relatively large number of test images was consistently estimated by all participants. In contrast, the paper demonstrates that there is no agreement on estimating the variance of detectability in the training and testing setting.

Reconstruction of undersampled radial free-breathing 3D abdominal MRI using stacked convolutional auto-encoders

PURPOSE

Free-breathing three-dimensional (3D) abdominal imaging is a challenging task for MRI, as respiratory motion severely degrades image quality. One of the most promising self-navigation techniques is the 3D golden-angle radial stack-of-stars (SOS) sequence, which has advantages in terms of speed, resolution, and allowing free breathing. However, streaking artifacts are still clearly observed in reconstructed images when undersampling is applied. This work presents a novel reconstruction approach based on a stacked convolutional auto-encoder (SCAE) network to solve this problem.

METHODS

Thirty healthy volunteers participated in our experiment. To build the dataset, reference and artifact-affected images were reconstructed using 451 golden-angle spokes and the first 20, 40, or 90 golden-angle spokes corresponding to acceleration rates of 31.4, 15.7, and 6.98, respectively. In the training step, we trained the SCAE by feeding it with patches from artifact-affected images. The SCAE outputs patches in the corresponding reference images. In the testing step, we applied the trained SCAE to map each input artifact-affected patch to the corresponding reference image patch.

RESULT

The SCAE-based reconstruction images with acceleration rates of 6.98 and 15.7 show nearly similar quality as the reference images. Additionally, the calculation time is below 1 s. Moreover, the proposed approach preserves important features, such as lesions not presented in the training set.

CONCLUSION

The preliminary results demonstrate the feasibility of the proposed SCAE-based strategy for correcting the streaking artifacts of undersampled free-breathing 3D abdominal MRI with a negligible reconstruction time.

Estimating detectability index in vivo: development and validation of an automated methodology

This study's purpose was to develop and validate a method to estimate patient-specific detectability indices directly from patients' CT images (i.e., in vivo). The method extracts noise power spectrum (NPS) and modulation transfer function (MTF) resolution properties from each patient's CT series based on previously validated techniques. These are combined with a reference task function (10-mm disk lesion with [Formula: see text] HU contrast) to estimate detectability indices for a nonprewhitening matched filter observer model. This method was applied to CT data from a previous study in which diagnostic performance of 16 readers was measured for the task of detecting subtle, hypoattenuating liver lesions ([Formula: see text]), using a two-alternative-forced-choice (2AFC) method, over six dose levels and two reconstruction algorithms. In vivo detectability indices were estimated and compared to the human readers' binary 2AFC outcomes using a generalized linear mixed-effects statistical model. The results of this modeling showed that the in vivo detectability indices were strongly related to 2AFC outcomes ([Formula: see text]). Linear comparison between human-detection accuracy and model-predicted detection accuracy (for like conditions) resulted in Pearson and Spearman correlation coefficients exceeding 0.84. These results suggest the potential utility of using in vivo estimates of a detectability index for an automated image quality tracking system that could be implemented clinically.

Techniques for virtual lung nodule insertion: volumetric and morphometric comparison of projection-based and image-based methods for quantitative CT

Virtual nodule insertion paves the way towards the development of standardized databases of hybrid CT images with known lesions. The purpose of this study was to assess three methods (an established and two newly developed techniques) for inserting virtual lung nodules into CT images. Assessment was done by comparing virtual nodule volume and shape to the CT-derived volume and shape of synthetic nodules. 24 synthetic nodules (three sizes, four morphologies, two repeats) were physically inserted into the lung cavity of an anthropomorphic chest phantom (KYOTO KAGAKU). The phantom was imaged with and without nodules on a commercial CT scanner (SOMATOM Definition Flash, Siemens) using a standard thoracic CT protocol at two dose levels (1.4 and 22 mGy CTDI_vol). Raw projection data were saved and reconstructed with filtered back-projection and sinogram affirmed iterative reconstruction (SAFIRE, strength 5) at 0.6 mm slice thickness. Corresponding 3D idealized, virtual nodule models were co-registered with the CT images to determine each nodule's location and orientation. Virtual nodules were voxelized, partial volume corrected, and inserted into nodule-free CT data (accounting for system imaging physics) using two methods: projection-based Technique A, and image-based Technique B. Also a third Technique C based on cropping a region of interest from the acquired image of the real nodule and blending it into the nodule-free image was tested. Nodule volumes were measured using a commercial segmentation tool (iNtuition, TeraRecon, Inc.) and deformation was assessed using the Hausdorff distance. Nodule volumes and deformations were compared between the idealized, CT-derived and virtual nodules using a linear mixed effects regression model which utilized the mean, standard deviation, and coefficient of variation ([Formula: see text], [Formula: see text] and [Formula: see text] of the regional Hausdorff distance. Overall, there was a close concordance between the volumes of the CT-derived and virtual nodules. Percent differences between them were less than 3% for all insertion techniques and were not statistically significant in most cases. Correlation coefficient values were greater than 0.97. The deformation according to the Hausdorff distance was also similar between the CT-derived and virtual nodules with minimal statistical significance in the ([Formula: see text]) for Techniques A, B, and C. This study shows that both projection-based and image-based nodule insertion techniques yield realistic nodule renderings with statistical similarity to the synthetic nodules with respect to nodule volume and deformation. These techniques could be used to create a database of hybrid CT images containing nodules of known size, location and morphology.

Evaluation of a projection-domain lung nodule insertion technique in thoracic computed tomography

Task-based assessment of computed tomography (CT) image quality requires a large number of cases with ground truth. Prospective case acquisition can be time-consuming. Inserting lesions into existing cases to simulate positive cases is a promising alternative. The aim was to evaluate a recently developed projection-based lesion insertion technique in thoracic CT. In total, 32 lung nodules of various attenuations were segmented from 21 patient cases, forward projected, inserted into projections, and reconstructed. Two experienced radiologists and two residents independently evaluated these nodules in two substudies. First, the 32 inserted and the 32 original nodules were presented in a randomized order and each received a score from 1 to 10 (1 = absolutely artificial to 10 = absolutely realistic). Second, the inserted and the corresponding original lesions were presented side-by-side to each reader. For the randomized evaluation, discrimination of real versus inserted nodules was poor with areas under the receiver operative characteristic curves being 0.57 [95% confidence interval (CI): 0.46 to 0.68], 0.69 (95% CI: 0.58 to 0.78), and 0.62 (95% CI: 0.54 to 0.69) for the two residents, two radiologists, and all four readers, respectively. Our projection-based lung nodule insertion technique provides a robust method to artificially generate positive cases that prove to be difficult to differentiate from real cases.

"How much realism is needed?" - the wrong question in silico imagers have been asking

PURPOSE

To discuss the use of realism as a first approximation for assessing computational imaging methods.

METHODS

Although in silico methods are increasingly becoming promising surrogates to physical experimentation for various stages of device development, their acceptance remains challenging. Realism is often considered as a first approximation for assessing computational imaging methods. However, realism is subjective and does not always ensure that key features of the methodologies reflect relevant aspects of devices of interest to imaging scientists, regulators, and medical practitioners. Moreover, in some cases (e.g., in computerized image analysis applications where human interpretation is not needed) how realistic in silico images are is irrelevant and perhaps misleading.

RESULTS

I emphasize a divergence from this methodology by providing a rationale for evaluating in silico imaging methods and tools in an objective and measurable manner.

CONCLUSIONS

Improved approaches for in silico imaging will lead to the rapid advancement and acceptance of computational techniques in medical imaging primarily but not limited to the regulatory evaluation of new imaging products.

Accuracy assessment and characterization of x-ray coded aperture coherent scatter spectral imaging for breast cancer classification

Although transmission-based x-ray imaging is the most commonly used imaging approach for breast cancer detection, it exhibits false negative rates higher than 15%. To improve cancer detection accuracy, x-ray coherent scatter computed tomography (CSCT) has been explored to potentially detect cancer with greater consistency. However, the 10-min scan duration of CSCT limits its possible clinical applications. The coded aperture coherent scatter spectral imaging (CACSSI) technique has been shown to reduce scan time through enabling single-angle imaging while providing high detection accuracy. Here, we use Monte Carlo simulations to test analytical optimization studies of the CACSSI technique, specifically for detecting cancer in ex vivo breast samples. An anthropomorphic breast tissue phantom was modeled, a CACSSI imaging system was virtually simulated to image the phantom, a diagnostic voxel classification algorithm was applied to all reconstructed voxels in the phantom, and receiver-operator characteristics analysis of the voxel classification was used to evaluate and characterize the imaging system for a range of parameters that have been optimized in a prior analytical study. The results indicate that CACSSI is able to identify the distribution of cancerous and healthy tissues (i.e., fibroglandular, adipose, or a mix of the two) in tissue samples with a cancerous voxel identification area-under-the-curve of 0.94 through a scan lasting less than 10 s per slice. These results show that coded aperture scatter imaging has the potential to provide scatter images that automatically differentiate cancerous and healthy tissue within ex vivo samples. Furthermore, the results indicate potential CACSSI imaging system configurations for implementation in subsequent imaging development studies.

Effect of Radiation Dose Reduction and Reconstruction Algorithm on Image Noise, Contrast, Resolution, and Detectability of Subtle Hypoattenuating Liver Lesions at Multidetector CT: Filtered Back Projection versus a Commercial Model-based Iterative Reconstruction Algorithm

Purpose To determine the effect of radiation dose and iterative reconstruction (IR) on noise, contrast, resolution, and observer-based detectability of subtle hypoattenuating liver lesions and to estimate the dose reduction potential of the IR algorithm in question. Materials and Methods This prospective, single-center, HIPAA-compliant study was approved by the institutional review board. A dual-source computed tomography (CT) system was used to reconstruct CT projection data from 21 patients into six radiation dose levels (12.5%, 25%, 37.5%, 50%, 75%, and 100%) on the basis of two CT acquisitions. A series of virtual liver lesions (five per patient, 105 total, lesion-to-liver prereconstruction contrast of -15 HU, 12-mm diameter) were inserted into the raw CT projection data and images were reconstructed with filtered back projection (FBP) (B31f kernel) and sinogram-affirmed IR (SAFIRE) (I31f-5 kernel). Image noise (pixel standard deviation), lesion contrast (after reconstruction), lesion boundary sharpness (average normalized gradient at lesion boundary), and contrast-to-noise ratio (CNR) were compared. Next, a two-alternative forced choice perception experiment was performed (16 readers [six radiologists, 10 medical physicists]). A linear mixed-effects statistical model was used to compare detection accuracy between FBP and SAFIRE and to estimate the radiation dose reduction potential of SAFIRE. Results Compared with FBP, SAFIRE reduced noise by a mean of 53% ± 5, lesion contrast by 12% ± 4, and lesion sharpness by 13% ± 10 but increased CNR by 89% ± 19. Detection accuracy was 2% higher on average with SAFIRE than with FBP (P = .03), which translated into an estimated radiation dose reduction potential (±95% confidence interval) of 16% ± 13. Conclusion SAFIRE increases detectability at a given radiation dose (approximately 2% increase in detection accuracy) and allows for imaging at reduced radiation dose (16% ± 13), while maintaining low-contrast detectability of subtle hypoattenuating focal liver lesions. This estimated dose reduction is somewhat smaller than that suggested by past studies. ^© RSNA, 2017 Online supplemental material is available for this article.

Technical Note: FreeCT_wFBP: A robust, efficient, open-source implementation of weighted filtered backprojection for helical, fan-beam CT

PURPOSE

With growing interest in quantitative imaging, radiomics, and CAD using CT imaging, the need to explore the impacts of acquisition and reconstruction parameters has grown. This usually requires extensive access to the scanner on which the data were acquired and its workflow is not designed for large-scale reconstruction projects. Therefore, the authors have developed a freely available, open-source software package implementing a common reconstruction method, weighted filtered backprojection (wFBP), for helical fan-beam CT applications.

METHODS

FreeCT_wFBP is a low-dependency, GPU-based reconstruction program utilizing c for the host code and Nvidia CUDA C for GPU code. The software is capable of reconstructing helical scans acquired with arbitrary pitch-values, and sampling techniques such as flying focal spots and a quarter-detector offset. In this work, the software has been described and evaluated for reconstruction speed, image quality, and accuracy. Speed was evaluated based on acquisitions of the ACR CT accreditation phantom under four different flying focal spot configurations. Image quality was assessed using the same phantom by evaluating CT number accuracy, uniformity, and contrast to noise ratio (CNR). Finally, reconstructed mass-attenuation coefficient accuracy was evaluated using a simulated scan of a FORBILD thorax phantom and comparing reconstructed values to the known phantom values.

RESULTS

The average reconstruction time evaluated under all flying focal spot configurations was found to be 17.4 ± 1.0 s for a 512 row × 512 column × 32 slice volume. Reconstructions of the ACR phantom were found to meet all CT Accreditation Program criteria including CT number, CNR, and uniformity tests. Finally, reconstructed mass-attenuation coefficient values of water within the FORBILD thorax phantom agreed with original phantom values to within 0.0001 mm(2)/g (0.01%).

CONCLUSIONS

FreeCT_wFBP is a fast, highly configurable reconstruction package for third-generation CT available under the GNU GPL. It shows good performance with both clinical and simulated data.

Evaluation of a projection-domain lung nodule insertion technique in thoracic CT

Task-based assessment of computed tomography (CT) image quality requires a large number of cases with ground truth. Inserting lesions into existing cases to simulate positive cases is a promising alternative approach. The aim of this study was to evaluate a recently-developed raw-data based lesion insertion technique in thoracic CT. Lung lesions were segmented from patient CT images, forward projected, and reinserted into the same patient CT projection data. In total, 32 nodules of various attenuations were segmented from 21 CT cases. Two experienced radiologists and 2 residents blinded to the process independently evaluated these inserted nodules in two sub-studies. First, the 32 inserted and the 32 original nodules were presented in a randomized order and each received a rating score from 1 to 10 (1=absolutely artificial to 10=absolutely realistic). Second, the inserted and the corresponding original lesions were presented side-by-side to each reader, who identified the inserted lesion and provided a confidence score (1=no confidence to 5=completely certain). For the randomized evaluation, discrimination of real versus artificial nodules was poor with areas under the receiver operative characteristic curves being 0.69 (95% CI: 0.58-0.78), 0.57 (95% CI: 0.46-0.68), and 0.62 (95% CI: 0.54-0.69) for the 2 radiologists, 2 residents, and all 4 readers, respectively. For the side-by-side evaluation, although all 4 readers correctly identified inserted lesions in 103/128 pairs, the confidence score was moderate (2.6). Our projection-domain based lung nodule insertion technique provides a robust method to artificially generate clinical cases that prove to be difficult to differentiate from real cases.

Validation of a Projection-domain Insertion of Liver Lesions into CT Images

RATIONALE AND OBJECTIVES

The aim of this study was to validate a projection-domain lesion-insertion method with observer studies.

MATERIALS AND METHODS

A total of 51 proven liver lesions were segmented from computed tomography images, forward projected, and inserted into patient projection data. The images containing inserted and real lesions were then reconstructed and examined in consensus by two radiologists. First, 102 lesions (51 original, 51 inserted) were viewed in a randomized, blinded fashion and scored from 1 (absolutely inserted) to 10 (absolutely real). Statistical tests were performed to compare the scores for inserted and real lesions. Subsequently, a two-alternative-forced-choice test was conducted, with lesions viewed in pairs (real vs. inserted) in a blinded fashion. The radiologists selected the inserted lesion and provided a confidence level of 1 (no confidence) to 5 (completely certain). The number of lesion pairs that were incorrectly classified was calculated.

RESULTS

The scores for inserted and proven lesions had the same median (8) and similar interquartile ranges (inserted, 5.5-8; real, 6.5-8). The mean scores were not significantly different between real and inserted lesions (P value = 0.17). The receiver operating characteristic curve was nearly diagonal, with an area under the curve of 0.58 ± 0.06. For the two-alternative-forced-choice study, the inserted lesions were incorrectly identified in 49% (25 out of 51) of pairs; radiologists were incorrect in 38% (3 out of 8) of pairs even when they felt very confident in identifying the inserted lesion (confidence level ≥4).

CONCLUSIONS

Radiologists could not distinguish between inserted and real lesions, thereby validating the lesion-insertion technique, which may be useful for conducting virtual clinical trials to optimize image quality and radiation dose.

Impact of breast structure on lesion detection in breast tomosynthesis, a simulation study

This study aims to characterize the effect of background tissue density and heterogeneity on the detection of irregular masses in breast tomosynthesis, while demonstrating the capability of the sophisticated tools that can be used in the design, implementation, and performance analysis of virtual clinical trials (VCTs). Twenty breast phantoms from the extended cardiac-torso (XCAT) family, generated based on dedicated breast computed tomography of human subjects, were used to extract a total of 2173 volumes of interest (VOIs) from simulated tomosynthesis images. Five different lesions, modeled after human subject tomosynthesis images, were embedded in the breasts and combined with the lesion absent condition yielded a total of [Formula: see text] VOIs. Effects of background tissue density and heterogeneity on the detection of the lesions were studied by implementing a composite hypothesis signal detection paradigm with location known exactly, lesion known exactly or statistically, and background known statistically. Using the area under the receiver operating characteristic curve, detection performance deteriorated as density was increased, yielding findings consistent with clinical studies. A human observer study was performed on a subset of the simulated tomosynthesis images, confirming the detection performance trends with respect to density and serving as a validation of the implemented detector. Performance of the implemented detector varied substantially across the 20 breasts. Furthermore, background tissue density and heterogeneity affected the log-likelihood ratio test statistic differently under lesion absent and lesion present conditions. Therefore, considering background tissue variability in tissue models can change the outcomes of a VCT and is hence of crucial importance. The XCAT breast phantoms have the potential to address this concern by offering realistic modeling of background tissue variability based on a wide range of human subjects, comprising various breast shapes, sizes, and densities.

Lesion insertion in the projection domain: Methods and initial results

PURPOSE

To perform task-based image quality assessment in CT, it is desirable to have a large number of realistic patient images with known diagnostic truth. One effective way of achieving this objective is to create hybrid images that combine patient images with inserted lesions. Because conventional hybrid images generated in the image domain fails to reflect the impact of scan and reconstruction parameters on lesion appearance, this study explored a projection-domain approach.

METHODS

Lesions were segmented from patient images and forward projected to acquire lesion projections. The forward-projection geometry was designed according to a commercial CT scanner and accommodated both axial and helical modes with various focal spot movement patterns. The energy employed by the commercial CT scanner for beam hardening correction was measured and used for the forward projection. The lesion projections were inserted into patient projections decoded from commercial CT projection data. The combined projections were formatted to match those of commercial CT raw data, loaded onto a commercial CT scanner, and reconstructed to create the hybrid images. Two validations were performed. First, to validate the accuracy of the forward-projection geometry, images were reconstructed from the forward projections of a virtual ACR phantom and compared to physically acquired ACR phantom images in terms of CT number accuracy and high-contrast resolution. Second, to validate the realism of the lesion in hybrid images, liver lesions were segmented from patient images and inserted back into the same patients, each at a new location specified by a radiologist. The inserted lesions were compared to the original lesions and visually assessed for realism by two experienced radiologists in a blinded fashion.

RESULTS

For the validation of the forward-projection geometry, the images reconstructed from the forward projections of the virtual ACR phantom were consistent with the images physically acquired for the ACR phantom in terms of Hounsfield unit and high-contrast resolution. For the validation of the lesion realism, lesions of various types were successfully inserted, including well circumscribed and invasive lesions, homogeneous and heterogeneous lesions, high-contrast and low-contrast lesions, isolated and vessel-attached lesions, and small and large lesions. The two experienced radiologists who reviewed the original and inserted lesions could not identify the lesions that were inserted. The same lesion, when inserted into the projection domain and reconstructed with different parameters, demonstrated a parameter-dependent appearance.

CONCLUSIONS

A framework has been developed for projection-domain insertion of lesions into commercial CT images, which can be potentially expanded to all geometries of CT scanners. Compared to conventional image-domain methods, the authors' method reflected the impact of scan and reconstruction parameters on lesion appearance. Compared to prior projection-domain methods, the authors' method has the potential to achieve higher anatomical complexity by employing clinical patient projections and real patient lesions.

Design and implementation of coded aperture coherent scatter spectral imaging of cancerous and healthy breast tissue samples

A scatter imaging technique for the differentiation of cancerous and healthy breast tissue in a heterogeneous sample is introduced in this work. Such a technique has potential utility in intraoperative margin assessment during lumpectomy procedures. In this work, we investigate the feasibility of the imaging method for tumor classification using Monte Carlo simulations and physical experiments. The coded aperture coherent scatter spectral imaging technique was used to reconstruct three-dimensional (3-D) images of breast tissue samples acquired through a single-position snapshot acquisition, without rotation as is required in coherent scatter computed tomography. We perform a quantitative assessment of the accuracy of the cancerous voxel classification using Monte Carlo simulations of the imaging system; describe our experimental implementation of coded aperture scatter imaging; show the reconstructed images of the breast tissue samples; and present segmentations of the 3-D images in order to identify the cancerous and healthy tissue in the samples. From the Monte Carlo simulations, we find that coded aperture scatter imaging is able to reconstruct images of the samples and identify the distribution of cancerous and healthy tissues (i.e., fibroglandular, adipose, or a mix of the two) inside them with a cancerous voxel identification sensitivity, specificity, and accuracy of 92.4%, 91.9%, and 92.0%, respectively. From the experimental results, we find that the technique is able to identify cancerous and healthy tissue samples and reconstruct differential coherent scatter cross sections that are highly correlated with those measured by other groups using x-ray diffraction. Coded aperture scatter imaging has the potential to provide scatter images that automatically differentiate cancerous and healthy tissue inside samples within a time on the order of a minute per slice.

Quantitative Features of Liver Lesions, Lung Nodules, and Renal Stones at Multi-Detector Row CT Examinations: Dependency on Radiation Dose and Reconstruction Algorithm

PURPOSE

To determine if radiation dose and reconstruction algorithm affect the computer-based extraction and analysis of quantitative imaging features in lung nodules, liver lesions, and renal stones at multi-detector row computed tomography (CT).

MATERIALS AND METHODS

Retrospective analysis of data from a prospective, multicenter, HIPAA-compliant, institutional review board-approved clinical trial was performed by extracting 23 quantitative imaging features (size, shape, attenuation, edge sharpness, pixel value distribution, and texture) of lesions on multi-detector row CT images of 20 adult patients (14 men, six women; mean age, 63 years; range, 38-72 years) referred for known or suspected focal liver lesions, lung nodules, or kidney stones. Data were acquired between September 2011 and April 2012. All multi-detector row CT scans were performed at two different radiation dose levels; images were reconstructed with filtered back projection, adaptive statistical iterative reconstruction, and model-based iterative reconstruction (MBIR) algorithms. A linear mixed-effects model was used to assess the effect of radiation dose and reconstruction algorithm on extracted features.

RESULTS

Among the 23 imaging features assessed, radiation dose had a significant effect on five, three, and four of the features for liver lesions, lung nodules, and renal stones, respectively (P < .002 for all comparisons). Adaptive statistical iterative reconstruction had a significant effect on three, one, and one of the features for liver lesions, lung nodules, and renal stones, respectively (P < .002 for all comparisons). MBIR reconstruction had a significant effect on nine, 11, and 15 of the features for liver lesions, lung nodules, and renal stones, respectively (P < .002 for all comparisons). Of note, the measured size of lung nodules and renal stones with MBIR was significantly different than those for the other two algorithms (P < .002 for all comparisons). Although lesion texture was significantly affected by the reconstruction algorithm used (average of 3.33 features affected by MBIR throughout lesion types; P < .002, for all comparisons), no significant effect of the radiation dose setting was observed for all but one of the texture features (P = .002-.998).

CONCLUSION

Radiation dose settings and reconstruction algorithms affect the extraction and analysis of quantitative imaging features in lesions at multi-detector row CT.