Lesion insertion in the projection domain: Methods and initial results

Image quality evaluation in deep-learning-based CT noise reduction using virtual imaging trial methods: Contrast-dependent spatial resolution

BACKGROUND

Deep-learning-based image reconstruction and noise reduction methods (DLIR) have been increasingly deployed in clinical CT. Accurate image quality assessment of these methods is challenging as the performance measured using physical phantoms may not represent the true performance of DLIR in patients since DLIR is trained mostly on patient images.

PURPOSE

In this work, we aim to develop a patient-data-based virtual imaging trial framework and, as a first application, use it to measure the spatial resolution properties of a DLIR method.

METHODS

The patient-data-based virtual imaging trial framework consists of five steps: (1) insertion of lesions into projection domain data using the acquisition geometry of the patient exam to simulate different lesion characteristics; (2) insertion of noise into projection domain data using a realistic photon statistical model of the CT system to simulate different dose levels; (3) creation of DLIR-processed images from projection or image data; (4) creation of ensembles of DLIR-processed patient images from a large number of noise and lesion realizations; and (5) evaluation of image quality using ensemble DLIR images. This framework was applied to measure the spatial resolution of a ResNet based deep convolutional neural network (DCNN) trained on patient images. Lesions in a cylindrical shape and different contrast levels (-500, -100, -50, -20, -10 HU) were inserted to the lower right lobe of the liver in a patient case. Multiple dose levels were simulated (50%, 25%, 12.5%). Each lesion and dose condition had 600 noise realizations. Multiple reconstruction and denoising methods were used on all the noise realizations, including the original filtered-backprojection (FBP), iterative reconstruction (IR), and the DCNN method with three different strength setting (DCNN-weak, DCNN-medium, and DCNN-strong). Mean lesion signal was calculated by performing ensemble averaging of all the noise realizations for each lesion and dose condition and then subtracting the lesion-present images from the lesion absent images. Modulation transfer functions (MTFs) both in-plane and along the z-axis were calculated based on the mean lesion signals. The standard deviations of MTFs at each condition were estimated with bootstrapping: randomly sampling (with replacement) all the DLIR/FBP/IR images from the ensemble data (600 samples) at each condition. The impact of varying lesion contrast, dose levels, and denoising strengths were evaluated. Statistical analysis with paired t-test was used to compare the z-axis and in-plane spatial resolution of five algorithms for five different contrasts and three dose levels.

RESULTS

The in-plane and z-axis spatial resolution degradation of DCNN becomes more severe as the contrast or radiation dose decreased, or DCNN denoising strength increased. In comparison with FBP, a 59.5% and 4.1% reduction of in-plane and z-axis MTF (in terms of spatial frequencies at 50% MTF), respectively, was observed at low contrast (-10 HU) for DCNN with the highest denoising strength at 25% routine dose level. When the dose level reduces from 50% to 12.5% of routine dose, the in-plane and z-axis MTFs reduces from 92.1% to 76.3%, and from 98.9% to 95.5%, respectively, at contrast of -100 HU, using FBP as the reference. For most conditions of contrasts and dose levels, significant differences were found among the five algorithms, with the following relationship in both in-plane and cross-plane spatial resolution: FBP > DCNN-Weak > IR > DCNN-Medium > DCNN-Strong. The spatial resolution difference among algorithms decreases at higher contrast or dose levels.

CONCLUSIONS

A patient-data-based virtual imaging trial framework was developed and applied to measuring the spatial resolution properties of a DCNN noise reduction method at different contrast and dose levels using real patient data. As with other non-linear image reconstruction and post-processing techniques, the evaluated DCNN method degraded the in-plane and z-axis spatial resolution at lower contrast levels, lower radiation dose, and higher denoising strength.

Framework of metal insertion in the projection domain for image quality optimization in interventional computed tomography

Purpose: This work aims to develop a framework to accurately and efficiently simulate metallic objects used during interventional oncology (IO) procedures and their artifacts in computed tomography (CT) images of different body regions. Approach: A metal insertion framework based on an existing lesion insertion tool was developed. Noise and beam hardening models were incorporated into the model and validated by comparing images of real and artificially inserted metallic rods of known material composition and dimensions. The framework was further validated by inserting ablation probes into a water phantom and comparing image appearance to scans of real probes at matching locations in the phantom. Finally, a comprehensive library of metallic probes used in our IO practice was generated and a graphical user interface was built to efficiently insert any number of probes at arbitrary positions in patient CT data, including projection and image domain insertions. Results: Metallic rod experiments demonstrated that noise and beam hardening were properly modeled. Phantom and patient data with virtually inserted probes demonstrated similar artifact appearance and magnitude compared with real probes. The developed user interface resulted in accurately co-registered virtual probes both with and without accompanying artifacts from projection and image domain insertions, respectively. Conclusions: The developed metal insertion framework successfully replicates metallic object and artifact appearance with projection domain insertions and provides corresponding artifact-free images with the metallic object in the identical location through image domain insertion. This framework has potential to generate robust training libraries for deep learning algorithms and facilitate image quality optimization in interventional CT.

Analytical covariance estimation for iterative CT reconstruction methods

Covariance of reconstruction images are useful to analyze the magnitude and correlation of noise in the evaluation of systems and reconstruction algorithms. The covariance estimation requires a big number of image samples that are hard to acquire in reality. A covariance propagation method from projection by a few noisy realizations is studied in this work. Based on the property of convergent points of cost funtions, the proposed method is composed of three steps, (1) construct a relationship between the covariance of projection and corresponding reconstruction from cost functions at its convergent point, (2) simplify the covariance relationship constructed in (1) by introducing an approximate gradient of penalties, and (3) obtain an analytical covariance estimation according to the simplified relationship in (2). Three approximation methods for step (2) are studied: the linear approximation of the gradient of penalties (LAM), the Taylor apprximation (TAM), and the mixture of LAM and TAM (MAM). TV and qGGMRF penalized weighted least square methods are experimented on. Results from statistical methods are used as reference. Under the condition of unstable 2nd derivative of penalties such as TV, the covariance image estimated by LAM accords to reference well but of smaller values, while the covarianc estimation by TAM is quite off. Under the conditon of relatively stable 2nd derivative of penalties such as qGGMRF, TAM performs well and LAM is again with a negative bias in magnitude. MAM gives a best performance under both conditions by combining LAM and TAM. Results also show that only one noise realization is enough to obtain reasonable covariance estimation analytically, which is important for practical usage. This work suggests the necessity and a new way to estimate the covariance for non-quadratically penalized reconstructions. Currently, the proposed method is computationally expensive for large size reconstructions.Computational efficiency is our future work to focus.

Deep-learning model observer for a low-contrast hepatic metastases localization task in computed tomography

PURPOSE

Conventional model observers (MO) in CT are often limited to a uniform background or varying background that is random and can be modeled in an analytical form. It is unclear if these conventional MOs can be readily generalized to predict human observer performance in clinical CT tasks that involve realistic anatomical background. Deep-learning-based model observers (DL-MO) have recently been developed, but have not been validated for challenging low contrast diagnostic tasks in abdominal CT. We consequently sought to validate a DL-MO for a low-contrast hepatic metastases localization task.

METHODS

We adapted our recently developed DL-MO framework for the liver metastases localization task. Our previously-validated projection-domain lesion-/noise-insertion techniques were used to synthesize realistic positive and low-dose abdominal CT exams, using the archived patient projection data. Ten experimental conditions were generated, which involved different lesion sizes/contrasts, radiation dose levels, and image reconstruction types. Each condition included 100 trials generated from a patient cohort of 7 cases. Each trial was presented as liver image patches (160×160×5 voxels). The DL-MO performance was calculated for each condition and was compared with human observer performance, which was obtained by three sub-specialized radiologists in an observer study. The performance of DL-MO and radiologists was gauged by the area under localization receiver-operating-characteristic curves. The generalization performance of the DL-MO was estimated with the repeated twofold cross-validation method over the same set of trials used in the human observer study. A multi-slice Channelized Hoteling Observers (CHO) was compared with the DL-MO across the same experimental conditions.

RESULTS

The performance of DL-MO was highly correlated to that of radiologists (Pearson's correlation coefficient: 0.987; 95% CI: [0.942, 0.997]). The performance level of DL-MO was comparable to that of the grouped radiologists, that is, the mean performance difference was -3.3%. The CHO performance was poorer than the grouped radiologist performance, before internal noise could be added. The correlation between CHO and radiologists was weaker (Pearson's correlation coefficient: 0.812, and 95% CI: [0.378, 0.955]), and the corresponding performance bias (-29.5%) was statistically significant.

CONCLUSION

The presented study demonstrated the potential of using the DL-MO for image quality assessment in patient abdominal CT tasks.

Reduction of streak artifacts caused by low photon counts utilizing an image-based forward projection in computed tomography

BACKGROUND

The streak artifacts in computed tomography (CT) images caused by low photon counts are known to be effectively suppressed by raw-data-based techniques. This study aims to propose a technique to reduce the streak artifact without accessing the raw data.

METHODS

The proposed streak artifact reduction (SAR) technique consists of three steps: numerical forward projection to a CT image, adaptive filtering of the generated sinogram, and image reconstruction from the processed sinogram. The authors have expanded the two-dimensional method (2D-SAR) to three dimensions (3D-SAR) by using consecutive CT images. The modulation transfer function (MTF), the image noise (standard deviation), and the visibility of comb-shaped objects were evaluated at a low dose of 5 mGy. Using anthropomorphic abdominal and chest phantoms, CT images and the artifact index (AI) were compared between 3D-SAR and two types of iterative reconstruction (IR).

RESULTS

Sufficient artifact reductions associated with 54% and 61% reduction of noise for 2D- and 3D-SAR, respectively, were obtained in the phantom images, although the 50%MTF decreased by 28%. The visibility of the combs was improved with both the 2D- and 3D-SAR methods. The AI results of 3D-SAR were better than one type of IR and almost equal to the other type of IR, which was consistent with observed artifacts.

CONCLUSION

Both 2D-SAR and 3D-SAR have turned out to be effective in reducing streak artifacts. The proposed technique will be an effective tool since it needs no raw data, and thus can be applied to any CT images produced by a wide variety of CT systems.

A physics and learning-based transmission-less attenuation compensation method for SPECT

Attenuation compensation (AC) is a pre-requisite for reliable quantification and beneficial for visual interpretation tasks in single-photon emission computed tomography (SPECT). Typical AC methods require the availability of an attenuation map, which is obtained using a transmission scan, such as a CT scan. This has several disadvantages such as increased radiation dose, higher costs, and possible misalignment between SPECT and CT scans. Also, often a CT scan is unavailable. In this context, we and others are showing that scattered photons in SPECT contain information to estimate the attenuation distribution. To exploit this observation, we propose a physics and learning-based method that uses the SPECT emission data in the photopeak and scatter windows to perform transmission-less AC in SPECT. The proposed method uses data acquired in the scatter window to reconstruct an initial estimate of the attenuation map using a physics-based approach. A convolutional neural network is then trained to segment this initial estimate into different regions. Pre-defined attenuation coefficients are assigned to these regions, yielding the reconstructed attenuation map, which is then used to reconstruct the activity distribution using an ordered subsets expectation maximization (OSEM)-based reconstruction approach. We objectively evaluated the performance of this method using highly realistic simulation studies conducted on the clinically relevant task of detecting perfusion defects in myocardial perfusion SPECT. Our results showed no statistically significant differences between the performance achieved using the proposed method and that with the true attenuation maps. Visually, the images reconstructed using the proposed method looked similar to those with the true attenuation map. Overall, these results provide evidence of the capability of the proposed method to perform transmission-less AC and motivate further evaluation.

Deep-learning lesion and noise insertion for virtual clinical trial in Chest CT

Accurate and objective image quality assessment is essential for the task of radiation dose optimization in clinical CT. Standard method relies on multi-reader multi-case (MRMC) studies in which radiologists are tasked to interpret diagnostic image quality of many carefully-collected positive and negative cases. The efficiency of such MRMC studies is frequently challenged by the lengthy and expensive procedure of case collection and the establishment of clinical reference standard. To address this challenge, multiple methods of virtual clinical trial to synthesize patient cases at different conditions have been proposed. Projection-domain lesion- / noise-insertion methods require the access to patient raw data and vendor-specific proprietary tools which are frequently not accessible to most users. The conventional image-domain noise-insertion methods are often challenged by the over-simplified lesion models and CT system models which may not represent conditions in real scans. In this work, we developed deep-learning lesion and noise insertion techniques that can synthesize chest CT images at different dose levels with and without lung nodules using existing patient cases. The proposed method involved a nodule-insertion convolutional neural network (CNN) and a noise-insertion CNN. Both CNNs demonstrated comparable quality to our previously-validated projection domain lesion- / noise-insertion techniques: mean structural similarity index (SSIM) of inserted nodules 0.94 (routine dose), and mean percent noise difference ~5% (50% of routine dose). The proposed deep-learning techniques for chest CT virtual clinical trial operate directly on image domain, which is more widely applicable than projection-domain techniques.

Low-dose CT image and projection dataset

PURPOSE

To describe a large, publicly available dataset comprising computed tomography (CT) projection data from patient exams, both at routine clinical doses and simulated lower doses.

ACQUISITION AND VALIDATION METHODS

The library was developed under local ethics committee approval. Projection and image data from 299 clinically performed patient CT exams were archived for three types of clinical exams: noncontrast head CT scans acquired for acute cognitive or motor deficit, low-dose noncontrast chest scans acquired to screen high-risk patients for pulmonary nodules, and contrast-enhanced CT scans of the abdomen acquired to look for metastatic liver lesions. Scans were performed on CT systems from two different CT manufacturers using routine clinical protocols. Projection data were validated by reconstructing the data using several different reconstruction algorithms and through use of the data in the 2016 Low Dose CT Grand Challenge. Reduced dose projection data were simulated for each scan using a validated noise-insertion method. Radiologists marked location and diagnosis for detected pathologies. Reference truth was obtained from the patient medical record, either from histology or subsequent imaging.

DATA FORMAT AND USAGE NOTES

Projection datasets were converted into the previously developed DICOM-CT-PD format, which is an extended DICOM format created to store CT projections and acquisition geometry in a nonproprietary format. Image data are stored in the standard DICOM image format and clinical data in a spreadsheet. Materials are provided to help investigators use the DICOM-CT-PD files, including a dictionary file, data reader, and user manual. The library is publicly available from The Cancer Imaging Archive (https://doi.org/10.7937/9npb-2637).

POTENTIAL APPLICATIONS

This CT data library will facilitate the development and validation of new CT reconstruction and/or denoising algorithms, including those associated with machine learning or artificial intelligence. The provided clinical information allows evaluation of task-based diagnostic performance.

Deep-learning-based model observer for a lung nodule detection task in computed tomography

Purpose: Task-based image quality assessment using model observers (MOs) is an effective approach to radiation dose and scanning protocol optimization in computed tomography (CT) imaging, once the correlation between MOs and radiologists can be established in well-defined clinically relevant tasks. Conventional MO studies were typically simplified to detection, classification, or localization tasks using tissue-mimicking phantoms, as traditional MOs cannot be readily used in complex anatomical background. However, anatomical variability can affect human diagnostic performance. Approach: To address this challenge, we developed a deep-learning-based MO (DL-MO) for localization tasks and validated in a lung nodule detection task, using previously validated projection-based lesion-/noise-insertion techniques. The DL-MO performance was compared with 4 radiologist readers over 12 experimental conditions, involving varying radiation dose levels, nodule sizes, nodule types, and reconstruction types. Each condition consisted of 100 trials (i.e., 30 images per trial) generated from a patient cohort of 50 cases. DL-MO was trained using small image volume-of-interests extracted across the entire volume of training cases. For each testing trial, the nodule searching of DL-MO was confined to a 3-mm thick volume to improve computational efficiency, and radiologist readers were tasked to review the entire volume. Results: A strong correlation between DL-MO and human readers was observed (Pearson's correlation coefficient: 0.980 with a 95% confidence interval of [0.924, 0.994]). The averaged performance bias between DL-MO and human readers was 0.57%. Conclusion: The experimental results indicated the potential of using the proposed DL-MO for diagnostic image quality assessment in realistic chest CT tasks.

Dual-source photon counting detector CT with a tin filter: a phantom study on iodine quantification performance

Photon counting detectors (PCD) can provide spectral information to enable iodine quantification through multi-energy imaging but performance is limited by current PCD technology. The purpose of this work is to evaluate iodine quantification in a phantom study using dual-source PCD-CT (DS-PCD-CT), and compare to single-source (SS)-PCD-CT and traditional DS energy integrating detector (EID)-based dual-energy CT. A multi-energy CT phantom with iodine inserts (0 to 15 mg ml^-1 concentration) was imaged on a research SS-PCD-CT scanner (CTDI_vol  =  18 mGy). A DS-PCD-CT was emulated by acquiring two sequential scans (CTDI_vol  =  9 mGy each) using tube potentials: 140 kVp/80 kVp, 140 kVp/100 kVp and 140 kVp/120 kVp. For each kVp, 1 or 2 energy bins were reconstructed to achieve either dual-energy or quadruple energy CT. In addition to these energy combinations, a Sn filter was used for the high tube potential (140 kVp) of each kVp pair. For comparison, the same phantom was also scanned on a commercially available DS-EID-CT with matched radiation dose (CTDI_vol  =  18 mGy). Material decomposition was performed in image space using a standard least-squares based approach to generate iodine and water-specific images. The root-mean-square-error (RMSE) measured over each insert from the iodine image was used to determine iodine accuracy. The iodine RMSE from SS-PCD (140 kVp with 2 energy bins) was 2.72 mg ml^-1. The use of a DS configuration with 1 energy bin per kVp (140 kVp/80 kVp) resulted in a RMSE of 2.29 mg ml^-1. Two energy bins per kVp further reduced iodine RMSE to 1.83 mg ml^-1. The addition of a Sn filter to the latter quadruple energy mode reduced RMSE to 1.48 mg ml^-1. RMSE for DS-PCD-CT (2 energy bins per kVp) decreased by 1.3% (Sn140 kVp/80 kVp) and 15% (Sn140 kVp/100 kVp) as compared to DS-EID-CT. DS-PCD-CT with a Sn filter improved iodine quantification as compared to both SS-PCD-CT and DS-EID-CT.

Localization of liver lesions in abdominal CT imaging: I. Correlation of human observer performance between anatomical and uniform backgrounds

The purpose of this study was to determine the correlation between human observer performance for localization of small low contrast lesions within uniform water background versus an anatomical liver background, under the conditions of varying dose, lesion size, and reconstruction algorithm. Liver lesions (5 mm, 7 mm, and 9 mm, contrast:  -21 HU) were digitally inserted into CT projection data of ten normal patients in vessel-free liver regions. Noise was inserted into the projection data to create three image sets: full dose and simulated half and quarter doses. Images were reconstructed with a standard filtered back projection (FBP) and an iterative reconstruction (IR) algorithm. Lesion and noise insertion procedures were repeated with water phantom data. Two-dimensional regions of interest (66 lesion-present, 34 lesion-absent) were selected, randomized, and independently reviewed by three medical physicists to identify the most likely location of the lesion and provide a confidence score. Locations and confidence scores were assessed using the area under the localization receiver operating characteristic curve (Az_LROC). We examined the correlation between human performance for the liver and uniform water backgrounds as dose, lesion size, and reconstruction algorithm varied. As lesion size or dose increased, reader localization performance improved. For full dose IR images, the Az_LROC for 5, 7, and 9 mm lesions were 0.53, 0.91, and 0.97 (liver) and 0.51, 0.96, and 0.99 (uniform water), respectively. Similar trends were seen with other parameters. Performance values for liver and uniform backgrounds were highly correlated for both reconstruction algorithms, with a Spearman correlation of ρ  =  0.97, and an average difference in Az_LROC of 0.05  ±  0.04. For the task of localizing low contrast liver lesions, human observer performance was highly correlated between anatomical and uniform backgrounds, suggesting that lesion localization studies emulating a clinical test of liver lesion detection can be performed using a uniform background.

Techniques for virtual lung nodule insertion: volumetric and morphometric comparison of projection-based and image-based methods for quantitative CT

Virtual nodule insertion paves the way towards the development of standardized databases of hybrid CT images with known lesions. The purpose of this study was to assess three methods (an established and two newly developed techniques) for inserting virtual lung nodules into CT images. Assessment was done by comparing virtual nodule volume and shape to the CT-derived volume and shape of synthetic nodules. 24 synthetic nodules (three sizes, four morphologies, two repeats) were physically inserted into the lung cavity of an anthropomorphic chest phantom (KYOTO KAGAKU). The phantom was imaged with and without nodules on a commercial CT scanner (SOMATOM Definition Flash, Siemens) using a standard thoracic CT protocol at two dose levels (1.4 and 22 mGy CTDI_vol). Raw projection data were saved and reconstructed with filtered back-projection and sinogram affirmed iterative reconstruction (SAFIRE, strength 5) at 0.6 mm slice thickness. Corresponding 3D idealized, virtual nodule models were co-registered with the CT images to determine each nodule's location and orientation. Virtual nodules were voxelized, partial volume corrected, and inserted into nodule-free CT data (accounting for system imaging physics) using two methods: projection-based Technique A, and image-based Technique B. Also a third Technique C based on cropping a region of interest from the acquired image of the real nodule and blending it into the nodule-free image was tested. Nodule volumes were measured using a commercial segmentation tool (iNtuition, TeraRecon, Inc.) and deformation was assessed using the Hausdorff distance. Nodule volumes and deformations were compared between the idealized, CT-derived and virtual nodules using a linear mixed effects regression model which utilized the mean, standard deviation, and coefficient of variation ([Formula: see text], [Formula: see text] and [Formula: see text] of the regional Hausdorff distance. Overall, there was a close concordance between the volumes of the CT-derived and virtual nodules. Percent differences between them were less than 3% for all insertion techniques and were not statistically significant in most cases. Correlation coefficient values were greater than 0.97. The deformation according to the Hausdorff distance was also similar between the CT-derived and virtual nodules with minimal statistical significance in the ([Formula: see text]) for Techniques A, B, and C. This study shows that both projection-based and image-based nodule insertion techniques yield realistic nodule renderings with statistical similarity to the synthetic nodules with respect to nodule volume and deformation. These techniques could be used to create a database of hybrid CT images containing nodules of known size, location and morphology.

Technical Note: Insertion of digital lesions in the projection domain for dual-source, dual-energy CT

PURPOSE

To compare algorithms performing material decomposition and classification in dual-energy CT, it is desirable to know the ground truth of the lesion to be analyzed in real patient data. In this work, we developed and validated a framework to insert digital lesions of arbitrary chemical composition into patient projection data acquired on a dual-source, dual-energy CT system.

METHODS

A model that takes into account beam-hardening effects was developed to predict the CT number of objects with known chemical composition. The model utilizes information about the x-ray energy spectra, the patient/phantom attenuation, and the x-ray detector energy response. The beam-hardening model was validated on samples of iodine (I) and calcium (Ca) for a second-generation dual-source, dual-energy CT scanner for all tube potentials available and a wide range of patient sizes. The seven most prevalent mineral components of renal stones were modeled and digital stones were created with CT numbers computed for each patient/phantom size and x-ray energy spectra using the developed beam-hardening model. Each digital stone was inserted in the dual-energy projection data of a water phantom scanned on a dual-source scanner and reconstructed with the routine algorithms in use in our practice. The geometry of the forward projection for dual-energy data was validated by comparing CT number accuracy and high-contrast resolution of simulated dual-energy CT data of the ACR phantom with experimentally acquired data.

RESULTS

The beam-hardening model and forward projection method accurately predicted the CT number of I and Ca over a wide range of tube potentials and phantom sizes. The images reconstructed after the insertion of digital kidney stones were consistent with the images reconstructed from the scanner, and the CT number ratios for different kidney stone types were consistent with data in the literature. A sample application of the proposed tool was also demonstrated.

CONCLUSION

A framework was developed and validated for the creation of digital objects of known mineral composition, and for inserting the digital objects into projection data from a commercial dual-source, dual-energy CT scanner. Among other applications, it will allow a systematic investigation of the impact of scan and reconstruction parameters on kidney stone dual-energy properties under rigorously controlled conditions.

Evaluation of a projection-domain lung nodule insertion technique in thoracic computed tomography

Task-based assessment of computed tomography (CT) image quality requires a large number of cases with ground truth. Prospective case acquisition can be time-consuming. Inserting lesions into existing cases to simulate positive cases is a promising alternative. The aim was to evaluate a recently developed projection-based lesion insertion technique in thoracic CT. In total, 32 lung nodules of various attenuations were segmented from 21 patient cases, forward projected, inserted into projections, and reconstructed. Two experienced radiologists and two residents independently evaluated these nodules in two substudies. First, the 32 inserted and the 32 original nodules were presented in a randomized order and each received a score from 1 to 10 (1 = absolutely artificial to 10 = absolutely realistic). Second, the inserted and the corresponding original lesions were presented side-by-side to each reader. For the randomized evaluation, discrimination of real versus inserted nodules was poor with areas under the receiver operative characteristic curves being 0.57 [95% confidence interval (CI): 0.46 to 0.68], 0.69 (95% CI: 0.58 to 0.78), and 0.62 (95% CI: 0.54 to 0.69) for the two residents, two radiologists, and all four readers, respectively. Our projection-based lung nodule insertion technique provides a robust method to artificially generate positive cases that prove to be difficult to differentiate from real cases.

A virtual clinical trial using projection-based nodule insertion to determine radiologist reader performance in lung cancer screening CT

Task-based image quality assessment using model observers is promising to provide an efficient, quantitative, and objective approach to CT dose optimization. Before this approach can be reliably used in practice, its correlation with radiologist performance for the same clinical task needs to be established. Determining human observer performance for a well-defined clinical task, however, has always been a challenge due to the tremendous amount of efforts needed to collect a large number of positive cases. To overcome this challenge, we developed an accurate projection-based insertion technique. In this study, we present a virtual clinical trial using this tool and a low-dose simulation tool to determine radiologist performance on lung-nodule detection as a function of radiation dose, nodule type, nodule size, and reconstruction methods. The lesion insertion and low-dose simulation tools together were demonstrated to provide flexibility to generate realistically-appearing clinical cases under well-defined conditions. The reader performance data obtained in this virtual clinical trial can be used as the basis to develop model observers for lung nodule detection, as well as for dose and protocol optimization in lung cancer screening CT.

Effect of Radiation Dose Reduction and Reconstruction Algorithm on Image Noise, Contrast, Resolution, and Detectability of Subtle Hypoattenuating Liver Lesions at Multidetector CT: Filtered Back Projection versus a Commercial Model-based Iterative Reconstruction Algorithm

Purpose To determine the effect of radiation dose and iterative reconstruction (IR) on noise, contrast, resolution, and observer-based detectability of subtle hypoattenuating liver lesions and to estimate the dose reduction potential of the IR algorithm in question. Materials and Methods This prospective, single-center, HIPAA-compliant study was approved by the institutional review board. A dual-source computed tomography (CT) system was used to reconstruct CT projection data from 21 patients into six radiation dose levels (12.5%, 25%, 37.5%, 50%, 75%, and 100%) on the basis of two CT acquisitions. A series of virtual liver lesions (five per patient, 105 total, lesion-to-liver prereconstruction contrast of -15 HU, 12-mm diameter) were inserted into the raw CT projection data and images were reconstructed with filtered back projection (FBP) (B31f kernel) and sinogram-affirmed IR (SAFIRE) (I31f-5 kernel). Image noise (pixel standard deviation), lesion contrast (after reconstruction), lesion boundary sharpness (average normalized gradient at lesion boundary), and contrast-to-noise ratio (CNR) were compared. Next, a two-alternative forced choice perception experiment was performed (16 readers [six radiologists, 10 medical physicists]). A linear mixed-effects statistical model was used to compare detection accuracy between FBP and SAFIRE and to estimate the radiation dose reduction potential of SAFIRE. Results Compared with FBP, SAFIRE reduced noise by a mean of 53% ± 5, lesion contrast by 12% ± 4, and lesion sharpness by 13% ± 10 but increased CNR by 89% ± 19. Detection accuracy was 2% higher on average with SAFIRE than with FBP (P = .03), which translated into an estimated radiation dose reduction potential (±95% confidence interval) of 16% ± 13. Conclusion SAFIRE increases detectability at a given radiation dose (approximately 2% increase in detection accuracy) and allows for imaging at reduced radiation dose (16% ± 13), while maintaining low-contrast detectability of subtle hypoattenuating focal liver lesions. This estimated dose reduction is somewhat smaller than that suggested by past studies. ^© RSNA, 2017 Online supplemental material is available for this article.

Validation of a Projection-domain Insertion of Liver Lesions into CT Images

RATIONALE AND OBJECTIVES

The aim of this study was to validate a projection-domain lesion-insertion method with observer studies.

MATERIALS AND METHODS

A total of 51 proven liver lesions were segmented from computed tomography images, forward projected, and inserted into patient projection data. The images containing inserted and real lesions were then reconstructed and examined in consensus by two radiologists. First, 102 lesions (51 original, 51 inserted) were viewed in a randomized, blinded fashion and scored from 1 (absolutely inserted) to 10 (absolutely real). Statistical tests were performed to compare the scores for inserted and real lesions. Subsequently, a two-alternative-forced-choice test was conducted, with lesions viewed in pairs (real vs. inserted) in a blinded fashion. The radiologists selected the inserted lesion and provided a confidence level of 1 (no confidence) to 5 (completely certain). The number of lesion pairs that were incorrectly classified was calculated.

RESULTS

The scores for inserted and proven lesions had the same median (8) and similar interquartile ranges (inserted, 5.5-8; real, 6.5-8). The mean scores were not significantly different between real and inserted lesions (P value = 0.17). The receiver operating characteristic curve was nearly diagonal, with an area under the curve of 0.58 ± 0.06. For the two-alternative-forced-choice study, the inserted lesions were incorrectly identified in 49% (25 out of 51) of pairs; radiologists were incorrect in 38% (3 out of 8) of pairs even when they felt very confident in identifying the inserted lesion (confidence level ≥4).

CONCLUSIONS

Radiologists could not distinguish between inserted and real lesions, thereby validating the lesion-insertion technique, which may be useful for conducting virtual clinical trials to optimize image quality and radiation dose.