1
|
Ghammraoui B, Bader S, Thuering T, Glick SJ. Classification of breast microcalcifications with GaAs photon-counting spectral mammography using an inverse problem approach. Biomed Phys Eng Express 2023; 9. [PMID: 36716475 DOI: 10.1088/2057-1976/acb70f] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Accepted: 01/30/2023] [Indexed: 02/01/2023]
Abstract
The purpose of this study was to investigate the use of a Gallium Arsenide (GaAs) photon-counting spectral mammography system to differentiate between Type I and Type II calcifications. Type I calcifications, consisting of calcium oxalate dihydrate (CO) or weddellite compounds are more often associated with benign lesions in the breast, and Type II calcifications containing hydroxyapatite (HA) are associated with both benign and malignant lesions in the breast. To be able to differentiate between these two calcification types, it is necessary to be able to estimate the full spectrum of the x-ray beam transmitted through the breast. We propose a novel method for estimating the energy-dependent x-ray transmission fraction of a beam using a photon counting detector with a limited number of energy bins. Using the estimated x-ray transmission through microcalcifications, it was observed that calcification type can be accurately estimated with machine learning. The study was carried out on a custom-built laboratory benchtop system using the SANTIS 0804 GaAs detector prototype system from DECTRIS Ltd with two energy thresholds enabled. Four energy thresholds detector was simulated by taking two separate acquisitions in which two energy thresholds were enabled for each acquisition and set at (12 keV, 21 keV) and then (29 keV, 36 keV). Measurements were performed using BR3D (CIRS, Norfolk, VA) breast imaging phantoms mimicking 100% adipose and 100% glandular tissues swirled together in an approximate 50/50 ratio by weight with the addition of in-house-developed synthetic microcalcifications. First, an inverse problem-based approach was used to estimate the full energy x-ray transmission fraction factor using known basis transmission factors from varying thicknesses of aluminum and polymethyl methacrylate (PMMA). Second, the classification of Type I and Type II calcifications was performed using the estimated energy-dependent transmission fraction factors for the pixels containing calcifications. The results were analyzed using receiver operating characteristic (ROC) analysis and demonstrated good discrimination performance with the area under the ROC curve greater than 84%. They indicated that GaAs photon-counting spectral mammography has potential use as a non-invasive method for discrimination between Type I and Type II calcifications. Results from this study suggested that GaAs-based spectral mammography could serve as a non-invasive measure for ruling out malignancy of calcifications found in the breast. Additional studies in more clinically realistic conditions involving breast tissues samples with smaller microcalcification specks should be performed to further explore the feasibility of this approach.
Collapse
Affiliation(s)
- Bahaa Ghammraoui
- Division of Imaging, Diagnostics, and Software Reliability, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, MD 20993, United States of America
| | - Shahed Bader
- Division of Imaging, Diagnostics, and Software Reliability, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, MD 20993, United States of America
| | | | - Stephen J Glick
- Division of Imaging, Diagnostics, and Software Reliability, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, MD 20993, United States of America
| |
Collapse
|
2
|
Fan M, Thayib T, McCollough C, Yu L. Accurate and efficient measurement of channelized Hotelling observer-based low-contrast detectability on the ACR CT accreditation phantom. Med Phys 2023; 50:737-749. [PMID: 36273393 PMCID: PMC9931649 DOI: 10.1002/mp.16068] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2021] [Revised: 10/17/2022] [Accepted: 10/17/2022] [Indexed: 11/05/2022] Open
Abstract
BACKGROUND Current CT quality control (QC) for low-contrast detectability relies on visual inspection and measurement of contrast-to-noise ratio (CNR). However, CNR numbers become unreliable when it comes to nonlinear methods, such as iterative reconstruction (IR) and deep-learning-based techniques. Image quality metrics using channelized Hotelling observer (CHO) have been validated to be well correlated with human observer performance on phantom-based and patient-based tasks, but it has not been widely used in routine CT QC mainly because the CHO calculation typically requires a large number of repeated scans in order to provide accurate and precise estimate of index of detectability (d'). PURPOSE The main goal of this work is to optimize channel filters and other CHO parameters and accurately estimate the low-contrast detectability with minimum number of repeated scans for the widely used American College of Radiology (ACR) CT accreditation phantom so that it can become practically feasible for routine CT QC tests. METHODS To provide a converged d' value, an ACR phantom was repeatedly scanned 100 times at three dose levels (24, 12, and 6 mGy). Images were reconstructed with two kernels (FBP Br44 and IR Br44-3). d' as a function of number of repeated scans was determined for different number of background regions of interest (ROIs), different number of low-contrast objects, different number of slices per each object, and different channel filter options. A reference d' was established using the optimized CHO setting, and the bias of d' was quantified using the d' calculated from all 100 repeated scans. The variation of d' at each condition was estimated using a resampling method combining random subsampling among 100 repeated scans and bootstrapping of the ensembles of signal and background ROIs. RESULTS Optimized parameters in CHO calculation were determined: two background ROIs per object, four objects per low-contrast object size, nine non-overlapping slices per object, and a 4-channel Gabor filter. The bias and uncertainty were estimated at different numbers of repeated scans using these parameters. When only one single scan was used in the CHO calculation, the bias of d' was below 6.2% and the uncertainty 15.6-19.6% for the 6, 5, and 4 mm objects, while with three repeated scans the bias was below 2.0% and uncertainty 8.7-10.9% for the three object sizes. CONCLUSION With optimized parameter settings in CHO, efficient and accurate measurement of low-contrast detectability on the commonly used ACR phantom becomes feasible, which could potentially lead to adoption of CHO-based low-contrast evaluation in routine QC tests.
Collapse
Affiliation(s)
- Mingdong Fan
- Department of Radiology, Mayo Clinic, Rochester, MN 55905, USA
| | - Theodore Thayib
- Department of Radiology, Mayo Clinic, Rochester, MN 55905, USA
| | | | - Lifeng Yu
- Department of Radiology, Mayo Clinic, Rochester, MN 55905, USA
| |
Collapse
|
3
|
Tang X, Ren Y, Xie H. Photon-counting CT via interleaved/gapped spectral channels: Feasibility and imaging performance. Med Phys 2021; 49:1445-1457. [PMID: 34914108 DOI: 10.1002/mp.15416] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2021] [Revised: 11/18/2021] [Accepted: 12/03/2021] [Indexed: 11/07/2022] Open
Abstract
PURPOSE Compared to energy-integration, photon-counting x-ray detection facilitates the spectral channelization (energy binning) in spectral CT and thus offers the opportunity of implementing data acquisition via sophisticated schemes, e.g., gapping or interleaving in spectral channels. In this article, we report our investigation of the performance of material decomposition based spectral imaging in photon-counting CT implemented in such data acquisition schemes, and their comparison with the benchmark scheme and other schemes without spectral gapping or interleaving. MATERIALS AND METHODS Using a deliberately designed anthropomorphic head phantom that mimics the intracranial soft tissues and bony structures, a simulation study is carried out with the focus on two-material decomposition-based spectral imaging in photon-counting CT, under both ideal and realistic detector spectral responses. The projection data are acquired in four spectral channels, and then are sorted to implement the schemes of gapping ((ch1 , ch3 ); (ch2 , ch4 ); (ch1 , ch4 )) and interleaving ((ch1 , ch3 )+(ch2 , ch4 ); (ch1 , ch4 )+(ch2 , ch3 ); ((ch1 +ch3 ), (ch2 +ch4 )); ((ch1 +ch4 ), (ch2 +ch3 ))) in spectral channels, in addition to the benchmark scheme ((ch1 +ch2 ), (ch3 +ch4 )) and other conventional schemes (ch1 , ch2 ), (ch2 , ch3 ) and (ch3 , ch4 ), where 'ch' denotes channel, '+' denote addition, and (·,·) the operation of material decomposition and image reconstruction. Using the contrast-to-noise ratio between targeted regions of interest as the figure of merit, we study the performance of spectral imaging (material specific and virtual monochromatic) associated with these spectral channelization schemes. RESULTS Under ideal detector spectral response, the scheme (ch1 , ch4 ) outperforms the benchmark scheme ((ch1 +ch2 ), (ch3 +ch4 )) and others in gapped and/or interleaved spectral channelization in material specific imaging, while the interleaved scheme (ch1 , ch4 )+(ch2 , ch3 ) performs the best in virtual monochromatic imaging. Notably, only about half x-ray dose is utilized in the scheme (ch1 , ch4 ) for image formation. Under realistic detector spectral response, the difference in imaging performance over all spectral channelization schemes diminishes, along with degradation in each scheme's individual performance. The results suggest that (i) different strategy in spectral channelization may have to be exercised in material specific imaging and virtual monochromatic imaging, respectively, and (ii) the spectral distortion in realistic detector's response due to charge-sharing, Compton scattering and fluorescent escaping should be mitigated as much as possible. CONCLUSION The spectral channelization schemes and associated imaging performance reported herein are novel and thus informative to the community, which may further the understanding of physical fundamentals and design principles for material decomposition based spectral imaging in photon-counting CT and other x-ray related imaging modalities. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Xiangyang Tang
- Imaging and Medical Physics, Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Georgia, USA
| | - Yan Ren
- Imaging and Medical Physics, Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Georgia, USA
| | - Huiqiao Xie
- Imaging and Medical Physics, Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Georgia, USA
| |
Collapse
|
4
|
Abouhawwash M, Alessio AM. Multi-Objective Evolutionary Algorithm for PET Image Reconstruction: Concept. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:2142-2151. [PMID: 33852383 PMCID: PMC8415095 DOI: 10.1109/tmi.2021.3073243] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
In many diagnostic imaging settings, including positron emission tomography (PET), images are typically used for multiple tasks such as detecting disease and quantifying disease. Unlike conventional image reconstruction that optimizes a single objective, this work proposes a multi-objective optimization algorithm for PET image reconstruction to identify a set of images that are optimal for more than one task. This work is reliant on a genetic algorithm to evolve a set of solutions that satisfies two distinct objectives. In this paper, we defined the objectives as the commonly used Poisson log-likelihood function, typically reflective of quantitative accuracy, and a variant of the generalized scan-statistic model, to reflect detection performance. The genetic algorithm uses new mutation and crossover operations at each iteration. After each iteration, the child population is selected with non-dominated sorting to identify the set of solutions along the dominant front or fronts. After multiple iterations, these fronts approach a single non-dominated optimal front, defined as the set of PET images for which none the objective function values can be improved without reducing the opposing objective function. This method was applied to simulated 2D PET data of the heart and liver with hot features. We compared this approach to conventional, single-objective approaches for trading off performance: maximum likelihood estimation with increasing explicit regularization and maximum a posteriori estimation with varying penalty strength. Results demonstrate that the proposed method generates solutions with comparable to improved objective function values compared to the conventional approaches for trading off performance amongst different tasks. In addition, this approach identifies a diverse set of solutions in the multi-objective function space which can be challenging to estimate with single-objective formulations.
Collapse
|
5
|
Omigbodun A, Vaishnav JY, Hsieh SS. Rapid measurement of the low contrast detectability of CT scanners. Med Phys 2021; 48:1054-1063. [PMID: 33325033 PMCID: PMC8058889 DOI: 10.1002/mp.14657] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2019] [Revised: 09/07/2020] [Accepted: 11/30/2020] [Indexed: 12/25/2022] Open
Abstract
PURPOSE Low contrast detectability (LCD) is a metric of fundamental importance in computed tomography (CT) imaging. In spite of this, its measurement is challenging in the context of nonlinear data processing. We introduce a new framework for objectively characterizing LCD with a single scan of a special-purpose phantom and automated analysis software. The output of the analysis software is a "machine LCD" metric which is more representative of LCD than contrast-noise ratio (CNR). It is not intended to replace human observer or model observer studies. METHODS Following preliminary simulations, we fabricated a phantom containing hundreds of low-contrast beads. These beads are acrylic spheres (1.6 mm, net contrast ~10 HU) suspended and randomly dispersed in a background matrix of nylon pellets and isoattenuating saline. The task was to search for and localize the beads. A modified matched filter was used to automatically scan the reconstruction and select candidate bead localizations of varying confidence. These were compared to bead locations as determined from a high-dose reference scan to produce free-response ROC curves. We compared iterative reconstruction (IR) and filtered backpropagation (FBP) at multiple dose levels between 40 and 240 mAs. The scans at 60, 120, and 180 mAs were performed three times each to estimate uncertainty. RESULTS Experimental scans demonstrated the feasibility of our technique. Our metric for machine LCD was the area under the exponential transform of the FROC curve (AUC). AUC increased monotonically from 0.21 at 40 mAs to 0.84 at 240 mAs. The sample standard deviation of AUC was approximately 0.02. This measurement uncertainty in AUC corresponded to a change in tube current of 4% to 8%. Surprisingly, we found that AUCs for IR were slightly worse than AUCs for FBP. While the phantom was sufficient for these experiments, it contained small air bubbles and alternative fabrication methods will be necessary for widespread utilization. CONCLUSIONS It is feasible to measure machine LCD using a search task on a phantom with hundreds of beads and to obtain tight error bars using only a single scan. Our method could facilitate routine quality assurance or possibly enable comparisons between different protocols and scanners.
Collapse
Affiliation(s)
| | | | - Scott S. Hsieh
- Department of Radiological Sciences, UCLA, Los Angeles, CA 90024, USA
- Department of Radiology, Mayo Clinic, Rochester, MN 55902, USA
| |
Collapse
|
6
|
Fan M, Thayib T, Ren L, Hsieh S, McCollough C, Holmes D, Yu L. A Web-Based Software Platform for Efficient and Quantitative CT Image Quality Assessment and Protocol Optimization. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2021; 11595. [PMID: 33986559 DOI: 10.1117/12.2582123] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
Channelized Hotelling observer (CHO), which has been shown to be well correlated with human observer performance in many clinical CT tasks, has a great potential to become the method of choice for objective image quality assessment. However, the use of CHO in clinical CT is still quite limited, mainly due to its complexity in measurement and calculation in practice, and the lack of access to an efficient and validated software tool for most clinical users. In this work, a web-based software platform for CT image quality assessment and protocol optimization (CTPro) was introduced. A validated CHO tool, along with other common image quality assessment tools, was made readily accessible through this web platform for clinical users and researchers without the need of installing additional software. An example of its application to evaluation of convolutional-neural-network (CNN)-based denoising was demonstrated.
Collapse
Affiliation(s)
- Mingdong Fan
- Department of Radiology, Mayo Clinic, Rochester, MN, 55901, USA
| | - Theodore Thayib
- Department of Radiology, Mayo Clinic, Rochester, MN, 55901, USA
| | - Liqiang Ren
- Department of Radiology, Mayo Clinic, Rochester, MN, 55901, USA
| | - Scott Hsieh
- Department of Radiology, Mayo Clinic, Rochester, MN, 55901, USA
| | | | - David Holmes
- Department of Radiology, Mayo Clinic, Rochester, MN, 55901, USA
| | - Lifeng Yu
- Department of Radiology, Mayo Clinic, Rochester, MN, 55901, USA
| |
Collapse
|
7
|
Conzelmann J, Schwarz FB, Hamm B, Scheel M, Jahnke P. Development of a method to create uniform phantoms for task-based assessment of CT image quality. J Appl Clin Med Phys 2020; 21:201-208. [PMID: 32721106 PMCID: PMC7497917 DOI: 10.1002/acm2.12974] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2019] [Revised: 06/13/2020] [Accepted: 06/18/2020] [Indexed: 12/22/2022] Open
Abstract
Purpose To develop a customized method to produce uniform phantoms for task‐based assessment of CT image quality. Methods Contrasts between polymethyl methacrylate (PMMA) and fructose solutions of different concentrations (240, 250, 260, 280, 290, 300, 310, 320, 330, and 340 mg/mL) were calculated. A phantom was produced by laser cutting PMMA slabs to the shape of a patient’s neck. An opening of 10 mm diameter was cut into the left parapharyngeal space. An angioplasty balloon was inserted and filled with the fructose solutions to simulate low‐contrast lesions. The phantom was scanned with six tube currents. Images were reconstructed with filtered back projection (FBP) and adaptive iterative dose reduction 3D (AIDR 3D). Calculated and measured contrasts were compared. The phantom was evaluated in a detectability experiment using images with 4 and 20 HU lesion contrast. Results Low‐contrast lesions of 4, 9, 11, 13, 18, 20, 24, 30, 35, and 37 HU contrast were simulated. Calculated and measured contrasts correlated excellently (r = 0.998; 95% confidence interval: 0.991 to 1). The mean ± SD difference was 0.41 ± 2.32 HU (P < 0.0001). Detection accuracy and reader confidence were 62.9 ± 18.2% and 1.58 ± 0.68 for 4 HU lesion contrast and 99.6 ± 1.3% and 4.27 ± 0.92 for 20 HU lesion contrast (P < 0.0001), confirming that the method produced lesions at the threshold of detectability. Conclusion A cost‐effective and flexible approach was developed to create uniform phantoms with low‐contrast signals. The method should facilitate access to customized phantoms for task‐based image quality assessment.
Collapse
Affiliation(s)
- Juliane Conzelmann
- Department of Radiology, Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin Institute of Health, Berlin, Germany
| | - Felix Benjamin Schwarz
- Department of Radiology, Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin Institute of Health, Berlin, Germany
| | - Bernd Hamm
- Department of Radiology, Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin Institute of Health, Berlin, Germany
| | - Michael Scheel
- Department of Neuroradiology, Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin Institute of Health, Berlin, Germany
| | - Paul Jahnke
- Department of Radiology, Charité - Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin Institute of Health, Berlin, Germany
| |
Collapse
|
8
|
Vaishnav JY, Ghammraoui B, Leifer M, Zeng R, Jiang L, Myers KJ. CT metal artifact reduction algorithms: Toward a framework for objective performance assessment. Med Phys 2020; 47:3344-3355. [PMID: 32406534 PMCID: PMC7496341 DOI: 10.1002/mp.14231] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2019] [Revised: 04/05/2020] [Accepted: 04/29/2020] [Indexed: 12/26/2022] Open
Abstract
Purpose Although several metal artifact reduction (MAR) algorithms for computed tomography (CT) scanning are commercially available, no quantitative, rigorous, and reproducible method exists for assessing their performance. The lack of assessment methods poses a challenge to regulators, consumers, and industry. We explored a phantom‐based framework for assessing an important aspect of MAR performance: how applying MAR in the presence of metal affects model observer performance at a low‐contrast detectability (LCD) task This work is, to our knowledge, the first model observer–based framework for the evaluation of MAR algorithms in the published literature. Methods We designed a numerical head phantom with metal implants. In order to incorporate an element of randomness, the phantom included a rotatable inset with an inhomogeneous background. We generated simulated projection data for the phantom. We applied two variants of a simple MAR algorithm, sinogram inpainting, to the projection data, that we reconstructed using filtered backprojection. To assess how MAR affected observer performance, we examined the detectability of a signal at the center of a region of interest (ROI) by a channelized Hotelling observer (CHO). As a figure of merit, we used the area under the ROC curve (AUC). Results We used simulation to test our framework on two variants of the MAR technique of sinogram inpainting. We found that our method was able to resolve the difference in two different MAR algorithms’ effect on LCD task performance, as well as the difference in task performances when MAR was applied, vs not. Conclusion We laid out a phantom‐based framework for objective assessment of how MAR impacts low‐contrast detectability, that we tested on two MAR algorithms. Our results demonstrate the importance of testing MAR performance over a range of object and imaging parameters, since applying MAR does not always improve the quality of an image for a given diagnostic task. Our framework is an initial step toward developing a more comprehensive objective assessment method for MAR, which would require developing additional phantoms and methods specific to various clinical applications of MAR, and increasing study efficiency.
Collapse
Affiliation(s)
- J Y Vaishnav
- Diagnostic X-Ray Systems Branch, Office of In Vitro Diagnostic Devices and Radiological Health, Center for Devices and Radiological Health, United States Food & Drug Administration, 10903 New Hampshire Ave., Silver Spring, MD, 20993, USA.,Canon Medical Systems, USA, Inc., 2441 Michelle Drive, Tustin, CA, 92780, USA
| | - B Ghammraoui
- Division of Imaging, Diagnostics, and Software Reliability, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, United States Food & Drug Administration, 10903 New Hampshire Ave., Silver Spring, MD, 20993, USA
| | - M Leifer
- Division of Imaging, Diagnostics, and Software Reliability, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, United States Food & Drug Administration, 10903 New Hampshire Ave., Silver Spring, MD, 20993, USA
| | - R Zeng
- Division of Imaging, Diagnostics, and Software Reliability, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, United States Food & Drug Administration, 10903 New Hampshire Ave., Silver Spring, MD, 20993, USA
| | - L Jiang
- Diagnostic X-Ray Systems Branch, Office of In Vitro Diagnostic Devices and Radiological Health, Center for Devices and Radiological Health, United States Food & Drug Administration, 10903 New Hampshire Ave., Silver Spring, MD, 20993, USA
| | - K J Myers
- Division of Imaging, Diagnostics, and Software Reliability, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, United States Food & Drug Administration, 10903 New Hampshire Ave., Silver Spring, MD, 20993, USA
| |
Collapse
|
9
|
Mileto A, Guimaraes LS, McCollough CH, Fletcher JG, Yu L. State of the Art in Abdominal CT: The Limits of Iterative Reconstruction Algorithms. Radiology 2019; 293:491-503. [DOI: 10.1148/radiol.2019191422] [Citation(s) in RCA: 77] [Impact Index Per Article: 15.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Affiliation(s)
- Achille Mileto
- From the Department of Radiology, University of Washington School of Medicine, Seattle, Wash (A.M.); Joint Department of Medical Imaging, Sinai Health System, University of Toronto, Toronto, Ontario, Canada (L.S.G.); and Department of Radiology, Mayo Clinic, 200 First St SW, Rochester, MN 55905 (C.H.M., J.G.F., L.Y.)
| | - Luis S. Guimaraes
- From the Department of Radiology, University of Washington School of Medicine, Seattle, Wash (A.M.); Joint Department of Medical Imaging, Sinai Health System, University of Toronto, Toronto, Ontario, Canada (L.S.G.); and Department of Radiology, Mayo Clinic, 200 First St SW, Rochester, MN 55905 (C.H.M., J.G.F., L.Y.)
| | - Cynthia H. McCollough
- From the Department of Radiology, University of Washington School of Medicine, Seattle, Wash (A.M.); Joint Department of Medical Imaging, Sinai Health System, University of Toronto, Toronto, Ontario, Canada (L.S.G.); and Department of Radiology, Mayo Clinic, 200 First St SW, Rochester, MN 55905 (C.H.M., J.G.F., L.Y.)
| | - Joel G. Fletcher
- From the Department of Radiology, University of Washington School of Medicine, Seattle, Wash (A.M.); Joint Department of Medical Imaging, Sinai Health System, University of Toronto, Toronto, Ontario, Canada (L.S.G.); and Department of Radiology, Mayo Clinic, 200 First St SW, Rochester, MN 55905 (C.H.M., J.G.F., L.Y.)
| | - Lifeng Yu
- From the Department of Radiology, University of Washington School of Medicine, Seattle, Wash (A.M.); Joint Department of Medical Imaging, Sinai Health System, University of Toronto, Toronto, Ontario, Canada (L.S.G.); and Department of Radiology, Mayo Clinic, 200 First St SW, Rochester, MN 55905 (C.H.M., J.G.F., L.Y.)
| |
Collapse
|
10
|
Samei E, Bakalyar D, Boedeker KL, Brady S, Fan J, Leng S, Myers KJ, Popescu LM, Ramirez Giraldo JC, Ranallo F, Solomon J, Vaishnav J, Wang J. Performance evaluation of computed tomography systems: Summary of AAPM Task Group 233. Med Phys 2019; 46:e735-e756. [DOI: 10.1002/mp.13763] [Citation(s) in RCA: 80] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2019] [Revised: 07/30/2019] [Accepted: 08/08/2019] [Indexed: 11/09/2022] Open
Affiliation(s)
- Ehsan Samei
- Duke University 2424 Erwin Rd Durham NC 27710USA
| | | | | | - Samuel Brady
- Cincinnati Children's Hospital 3333 Burnet Ave Cincinnati OH 45229USA
| | - Jiahua Fan
- GE Healthcare 3000 N. Grandview Blvd Waukesha WI 53188USA
| | - Shuai Leng
- Mayo Clinic 200 1st. St Rochester MN 55901USA
| | - Kyle J. Myers
- Office of Science and Engineering Laboratories FDA 10903 New Hampshire Ave Silver Spring MD 20993USA
| | | | | | - Frank Ranallo
- University of Wisconsin 1111 Highland Ave Madison WI 53705USA
| | - Justin Solomon
- Duke University Medical Center 2424 Erwin Rd Durham NC 27710USA
| | - Jay Vaishnav
- Canon Medical Systems 2441 Michelle Dr Tustin CA 92780USA
| | - Jia Wang
- Stanford University 480 Oak Road Stanford CA 94305USA
| |
Collapse
|
11
|
Mileto A, Zamora DA, Alessio AM, Pereira C, Liu J, Bhargava P, Carnell J, Cowan SM, Dighe MK, Gunn ML, Kim S, Kolokythas O, Lee JH, Maki JH, Moshiri M, Nasrullah A, O'Malley RB, Schmiedl UP, Soloff EV, Toia GV, Wang CL, Kanal KM. CT Detectability of Small Low-Contrast Hypoattenuating Focal Lesions: Iterative Reconstructions versus Filtered Back Projection. Radiology 2018; 289:443-454. [PMID: 30015591 DOI: 10.1148/radiol.2018180137] [Citation(s) in RCA: 36] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Purpose To investigate performance in detectability of small (≤1 cm) low-contrast hypoattenuating focal lesions by using filtered back projection (FBP) and iterative reconstruction (IR) algorithms from two major CT vendors across a range of 11 radiation exposures. Materials and Methods A low-contrast detectability phantom consisting of 21 low-contrast hypoattenuating focal objects (seven sizes between 2.4 and 10.0 mm, three contrast levels) embedded into a liver-equivalent background was scanned at 11 radiation exposures (volume CT dose index range, 0.5-18.0 mGy; size-specific dose estimate [SSDE] range, 0.8-30.6 mGy) with four high-end CT platforms. Data sets were reconstructed by using FBP and varied strengths of image-based, model-based, and hybrid IRs. Sixteen observers evaluated all data sets for lesion detectability by using a two-alternative-forced-choice (2AFC) paradigm. Diagnostic performances were evaluated by calculating area under the receiver operating characteristic curve (AUC) and by performing noninferiority analyses. Results At benchmark exposure, FBP yielded a mean AUC of 0.79 ± 0.09 (standard deviation) across all platforms which, on average, was approximately 2% lower than that observed with the different IR algorithms, which showed an average AUC of 0.81 ± 0.09 (P = .12). Radiation decreases of 30%, 50%, and 80% resulted in similar declines of observer detectability with FBP (mean AUC decrease, -0.02 ± 0.05, -0.03 ± 0.05, and -0.05 ± 0.05, respectively) and all IR methods investigated (mean AUC decrease, -0.00 ± 0.05, -0.04 ± 0.05, and -0.04 ± 0.05, respectively). For each radiation level and CT platform, variance in performance across observers was greater than that across reconstruction algorithms (P = .03). Conclusion Iterative reconstruction algorithms have limited radiation optimization potential in detectability of small low-contrast hypoattenuating focal lesions. This task may be further complicated by a high degree of variation in radiologists' performances, seemingly exceeding real performance differences among reconstruction algorithms. © RSNA, 2018 Online supplemental material is available for this article.
Collapse
Affiliation(s)
- Achille Mileto
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - David A Zamora
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - Adam M Alessio
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - Carina Pereira
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - Jin Liu
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - Puneet Bhargava
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - Jonathan Carnell
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - Sophie M Cowan
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - Manjiri K Dighe
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - Martin L Gunn
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - Sooah Kim
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - Orpheus Kolokythas
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - Jean H Lee
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - Jeffrey H Maki
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - Mariam Moshiri
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - Ayesha Nasrullah
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - Ryan B O'Malley
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - Udo P Schmiedl
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - Erik V Soloff
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - Giuseppe V Toia
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - Carolyn L Wang
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| | - Kalpana M Kanal
- From the Departments of Radiology (A.M., D.A.Z., A.M.A., P.B., J.C., S.M.C., M.K.D., M.L.G., S.K., O.K., J.H.L., M.M., A.N., R.B.O., U.P.S., E.V.S., G.V.T., C.L.W., K.M.K.) and Bioengineering (C.P., J.L.), University of Washington School of Medicine, Box 357115, 1959 NE Pacific St, Seattle, WA 98195; and Department of Radiology, University of Colorado-Denver, Aurora, Colo (J.H.M.)
| |
Collapse
|
12
|
Lee J, Nishikawa RM, Reiser I, Zuley ML, Boone JM. Lack of agreement between radiologists: implications for image-based model observers. J Med Imaging (Bellingham) 2017; 4:025502. [PMID: 28491908 DOI: 10.1117/1.jmi.4.2.025502] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2016] [Accepted: 04/17/2017] [Indexed: 11/14/2022] Open
Abstract
We tested the agreement of radiologists' rankings of different reconstructions of breast computed tomography images based on their diagnostic (classification) performance and on their subjective image quality assessments. We used 102 pathology proven cases (62 malignant, 40 benign), and an iterative image reconstruction (IIR) algorithm to obtain 24 reconstructions per case with different image appearances. Using image feature analysis, we selected 3 IIRs and 1 clinical reconstruction and 50 lesions. The reconstructions produced a range of image quality from smooth/low-noise to sharp/high-noise, which had a range in classifier performance corresponding to AUCs of 0.62 to 0.96. Six experienced Mammography Quality Standards Act (MQSA) radiologists rated the likelihood of malignancy for each lesion. We conducted an additional reader study with the same radiologists and a subset of 30 lesions. Radiologists ranked each reconstruction according to their preference. There was disagreement among the six radiologists on which reconstruction produced images with the highest diagnostic content, but they preferred the midsharp/noise image appearance over the others. However, the reconstruction they preferred most did not match with their performance. Due to these disagreements, it may be difficult to develop a single image-based model observer that is representative of a population of radiologists for this particular imaging task.
Collapse
Affiliation(s)
- Juhun Lee
- University of Pittsburgh, Department of Radiology, Pittsburgh, Pennsylvania, United States
| | - Robert M Nishikawa
- University of Pittsburgh, Department of Radiology, Pittsburgh, Pennsylvania, United States
| | - Ingrid Reiser
- The University of Chicago, Department of Radiology, Chicago, Illinois, United States
| | - Margarita L Zuley
- University of Pittsburgh, Department of Radiology, Pittsburgh, Pennsylvania, United States
| | - John M Boone
- University of California Davis Medical Center, Department of Radiology, Sacramento, California, United States
| |
Collapse
|
13
|
Gifford HC, Liang Z, Das M. Visual-search observers for assessing tomographic x-ray image quality. Med Phys 2016; 43:1563-75. [PMID: 26936739 DOI: 10.1118/1.4942485] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023] Open
Abstract
PURPOSE Mathematical model observers commonly used for diagnostic image-quality assessments in x-ray imaging research are generally constrained to relatively simple detection tasks due to their need for statistical prior information. Visual-search (VS) model observers that employ morphological features in sequential search and analysis stages have less need for such information and fewer task constraints. The authors compared four VS observers against human observers and an existing scanning model observer in a pilot study that quantified how mass detection and localization in simulated digital breast tomosynthesis (DBT) can be affected by the number P of acquired projections. METHODS Digital breast phantoms with embedded spherical masses provided single-target cases for a localization receiver operating characteristic (LROC) study. DBT projection sets based on an acquisition arc of 60° were generated for values of P between 3 and 51. DBT volumes were reconstructed using filtered backprojection with a constant 3D Butterworth postfilter; extracted 2D slices were used as test images. Three imaging physicists participated as observers. A scanning channelized nonprewhitening (CNPW) observer had knowledge of the mean lesion-absent images. The VS observers computed an initial single-feature search statistic that identified candidate locations as local maxima of either a template matched-filter (MF) image or a gradient-template MF (GMF) image. Search inefficiencies that modified the statistic were also considered. Subsequent VS candidate analyses were carried out with (i) the CNPW statistical discriminant and (ii) the discriminant computed from GMF training images. These location-invariant discriminants did not utilize covariance information. All observers read 36 training images and 108 study images per P value. Performance was scored in terms of area under the LROC curve. RESULTS Average human-observer performance was stable for P between 7 and 35. In the absence of search inefficiencies, the VS models based on the GMF analysis provided the best correlation (Pearson ρ ≥ 0.62) with the human results. The CNPW-based VS observers deviated from the humans primarily at lower values of P. In this limited study, search inefficiencies allowed for good quantitative agreement with the humans for most of the VS observers. CONCLUSIONS The computationally efficient training requirements for the VS observer are suitable for high-resolution imaging, indicating that the observer framework has the potential to overcome important task limitations of current model observers for x-ray applications.
Collapse
Affiliation(s)
- Howard C Gifford
- Department of Biomedical Engineering, University of Houston, Houston, Texas 77204
| | - Zhihua Liang
- Department of Biomedical Engineering, University of Houston, Houston, Texas 77204 and Department of Physics, University of Houston, Houston, Texas 77204
| | - Mini Das
- Department of Biomedical Engineering, University of Houston, Houston, Texas 77204 and Department of Physics, University of Houston, Houston, Texas 77204
| |
Collapse
|
14
|
Solomon J, Samei E. Correlation between human detection accuracy and observer model-based image quality metrics in computed tomography. J Med Imaging (Bellingham) 2016; 3:035506. [PMID: 27704032 DOI: 10.1117/1.jmi.3.3.035506] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2016] [Accepted: 09/08/2016] [Indexed: 11/14/2022] Open
Abstract
The purpose of this study was to compare computed tomography (CT) low-contrast detectability from human readers with observer model-based surrogates of image quality. A phantom with a range of low-contrast signals (five contrasts, three sizes) was imaged on a state-of-the-art CT scanner (Siemens' force). Images were reconstructed using filtered back projection and advanced modeled iterative reconstruction and were assessed by 11 readers using a two alternative forced choice method. Concurrently, contrast-to-noise ratio (CNR), area-weighted CNR (CNRA), and observer model-based metrics were estimated, including nonprewhitening (NPW) matched filter, NPW with eye filter (NPWE), NPW with internal noise, NPW with an eye filter and internal noise (NPWEi), channelized Hotelling observer (CHO), and CHO with internal noise (CHOi). The correlation coefficients (Pearson and Spearman), linear discriminator error, [Formula: see text], and magnitude of confidence intervals, [Formula: see text], were used to determine correlation, proper characterization of the reconstruction algorithms, and model precision, respectively. Pearson (Spearman) correlation was 0.36 (0.33), 0.83 (0.84), 0.84 (0.86), 0.86 (0.88), 0.86 (0.91), 0.88 (0.90), 0.85 (0.89), and 0.87 (0.84), [Formula: see text] was 0.25, 0.15, 0.2, 0.25, 0.3, 0.25, 0.4, and 0.45, and [Formula: see text] was [Formula: see text], [Formula: see text], [Formula: see text], [Formula: see text], [Formula: see text], [Formula: see text], [Formula: see text], and [Formula: see text] for CNR, CNRA, NPW, NPWE, NPWi, NPWEi, CHO, and CHOi, respectively.
Collapse
Affiliation(s)
- Justin Solomon
- Duke University Health System , Department of Radiology, Carl E. Ravin Advanced Imaging Laboratories, 2424 Erwin Road, Suite 302, Durham, North Carolina 27705, United State s
| | - Ehsan Samei
- Duke University Health System, Department of Radiology, Carl E. Ravin Advanced Imaging Laboratories, 2424 Erwin Road, Suite 302, Durham, North Carolina 27705, United States; Duke University Medical Center, Department of Radiology, Clinical Imaging Physics Group, 2424 Erwin Road, Suite 302, Durham, North Carolina 27705, United States; Duke University, Pratt School of Engineering, Departments of Biomedical Engineering and Electrical and Computer Engineering, 2424 Erwin Road, Suite 302, Durham, North Carolina 27705, United States
| |
Collapse
|
15
|
Eck BL, Fahmi R, Brown KM, Zabic S, Raihani N, Miao J, Wilson DL. Computational and human observer image quality evaluation of low dose, knowledge-based CT iterative reconstruction. Med Phys 2015; 42:6098-111. [PMID: 26429285 PMCID: PMC4592430 DOI: 10.1118/1.4929973] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2014] [Revised: 06/22/2015] [Accepted: 08/06/2015] [Indexed: 01/24/2023] Open
Abstract
PURPOSE Aims in this study are to (1) develop a computational model observer which reliably tracks the detectability of human observers in low dose computed tomography (CT) images reconstructed with knowledge-based iterative reconstruction (IMR™, Philips Healthcare) and filtered back projection (FBP) across a range of independent variables, (2) use the model to evaluate detectability trends across reconstructions and make predictions of human observer detectability, and (3) perform human observer studies based on model predictions to demonstrate applications of the model in CT imaging. METHODS Detectability (d') was evaluated in phantom studies across a range of conditions. Images were generated using a numerical CT simulator. Trained observers performed 4-alternative forced choice (4-AFC) experiments across dose (1.3, 2.7, 4.0 mGy), pin size (4, 6, 8 mm), contrast (0.3%, 0.5%, 1.0%), and reconstruction (FBP, IMR), at fixed display window. A five-channel Laguerre-Gauss channelized Hotelling observer (CHO) was developed with internal noise added to the decision variable and/or to channel outputs, creating six different internal noise models. Semianalytic internal noise computation was tested against Monte Carlo and used to accelerate internal noise parameter optimization. Model parameters were estimated from all experiments at once using maximum likelihood on the probability correct, PC. Akaike information criterion (AIC) was used to compare models of different orders. The best model was selected according to AIC and used to predict detectability in blended FBP-IMR images, analyze trends in IMR detectability improvements, and predict dose savings with IMR. Predicted dose savings were compared against 4-AFC study results using physical CT phantom images. RESULTS Detection in IMR was greater than FBP in all tested conditions. The CHO with internal noise proportional to channel output standard deviations, Model-k4, showed the best trade-off between fit and model complexity according to AICc. With parameters fixed, the model reasonably predicted detectability of human observers in blended FBP-IMR images. Semianalytic internal noise computation gave results equivalent to Monte Carlo, greatly speeding parameter estimation. Using Model-k4, the authors found an average detectability improvement of 2.7 ± 0.4 times that of FBP. IMR showed greater improvements in detectability with larger signals and relatively consistent improvements across signal contrast and x-ray dose. In the phantom tested, Model-k4 predicted an 82% dose reduction compared to FBP, verified with physical CT scans at 80% reduced dose. CONCLUSIONS IMR improves detectability over FBP and may enable significant dose reductions. A channelized Hotelling observer with internal noise proportional to channel output standard deviation agreed well with human observers across a wide range of variables, even across reconstructions with drastically different image characteristics. Utility of the model observer was demonstrated by predicting the effect of image processing (blending), analyzing detectability improvements with IMR across dose, size, and contrast, and in guiding real CT scan dose reduction experiments. Such a model observer can be applied in optimizing parameters in advanced iterative reconstruction algorithms as well as guiding dose reduction protocols in physical CT experiments.
Collapse
Affiliation(s)
- Brendan L Eck
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, Ohio 44106
| | - Rachid Fahmi
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, Ohio 44106
| | | | | | | | - Jun Miao
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, Ohio 44106
| | - David L Wilson
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, Ohio 44106 and Department of Radiology, Case Western Reserve University, Cleveland, Ohio 44106
| |
Collapse
|
16
|
Barrett HH, Myers KJ, Hoeschen C, Kupinski MA, Little MP. Task-based measures of image quality and their relation to radiation dose and patient risk. Phys Med Biol 2015; 60:R1-75. [PMID: 25564960 PMCID: PMC4318357 DOI: 10.1088/0031-9155/60/2/r1] [Citation(s) in RCA: 79] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/12/2023]
Abstract
The theory of task-based assessment of image quality is reviewed in the context of imaging with ionizing radiation, and objective figures of merit (FOMs) for image quality are summarized. The variation of the FOMs with the task, the observer and especially with the mean number of photons recorded in the image is discussed. Then various standard methods for specifying radiation dose are reviewed and related to the mean number of photons in the image and hence to image quality. Current knowledge of the relation between local radiation dose and the risk of various adverse effects is summarized, and some graphical depictions of the tradeoffs between image quality and risk are introduced. Then various dose-reduction strategies are discussed in terms of their effect on task-based measures of image quality.
Collapse
Affiliation(s)
- Harrison H. Barrett
- College of Optical Sciences, University of Arizona, Tucson, AZ
- Center for Gamma-Ray Imaging, Department of Medical Imaging, University of Arizona, Tucson, AZ
| | - Kyle J. Myers
- Division of Imaging and Applied Mathematics, Office of Scientific and Engineering Laboratories, Center for Devices and Radiological Health, Food and Drug Administration, Silver Spring, MD
| | - Christoph Hoeschen
- Department of Electrical Engineering and Information Technology, Otto-von-Guericke University, Magdeburg, Germany
- Research unit Medical Radiation Physics and Diagnostics, Helmholtz Zentrum München, Oberschleissheim, Germany
| | - Matthew A. Kupinski
- College of Optical Sciences, University of Arizona, Tucson, AZ
- Center for Gamma-Ray Imaging, Department of Medical Imaging, University of Arizona, Tucson, AZ
| | - Mark P. Little
- Division of Cancer Epidemiology and Genetics, Radiation Epidemiology Branch, National Cancer Institute, Bethesda, MD
| |
Collapse
|
17
|
Shieh CC, Kipritidis J, O'Brien RT, Cooper BJ, Kuncic Z, Keall PJ. Improving thoracic four-dimensional cone-beam CT reconstruction with anatomical-adaptive image regularization (AAIR). Phys Med Biol 2015; 60:841-68. [PMID: 25565244 DOI: 10.1088/0031-9155/60/2/841] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
Total-variation (TV) minimization reconstructions can significantly reduce noise and streaks in thoracic four-dimensional cone-beam computed tomography (4D CBCT) images compared to the Feldkamp-Davis-Kress (FDK) algorithm currently used in practice. TV minimization reconstructions are, however, prone to over-smoothing anatomical details and are also computationally inefficient. The aim of this study is to demonstrate a proof of concept that these disadvantages can be overcome by incorporating the general knowledge of the thoracic anatomy via anatomy segmentation into the reconstruction. The proposed method, referred as the anatomical-adaptive image regularization (AAIR) method, utilizes the adaptive-steepest-descent projection-onto-convex-sets (ASD-POCS) framework, but introduces an additional anatomy segmentation step in every iteration. The anatomy segmentation information is implemented in the reconstruction using a heuristic approach to adaptively suppress over-smoothing at anatomical structures of interest. The performance of AAIR depends on parameters describing the weighting of the anatomy segmentation prior and segmentation threshold values. A sensitivity study revealed that the reconstruction outcome is not sensitive to these parameters as long as they are chosen within a suitable range. AAIR was validated using a digital phantom and a patient scan and was compared to FDK, ASD-POCS and the prior image constrained compressed sensing (PICCS) method. For the phantom case, AAIR reconstruction was quantitatively shown to be the most accurate as indicated by the mean absolute difference and the structural similarity index. For the patient case, AAIR resulted in the highest signal-to-noise ratio (i.e. the lowest level of noise and streaking) and the highest contrast-to-noise ratios for the tumor and the bony anatomy (i.e. the best visibility of anatomical details). Overall, AAIR was much less prone to over-smoothing anatomical details compared to ASD-POCS and did not suffer from residual noise/streaking and motion blur migrated from the prior image as in PICCS. AAIR was also found to be more computationally efficient than both ASD-POCS and PICCS, with a reduction in computation time of over 50% compared to ASD-POCS. The use of anatomy segmentation was, for the first time, demonstrated to significantly improve image quality and computational efficiency for thoracic 4D CBCT reconstruction. Further developments are required to facilitate AAIR for practical use.
Collapse
Affiliation(s)
- Chun-Chien Shieh
- Radiation Physics Laboratory, Sydney Medical School, The University of Sydney, NSW 2006, Australia. Institute of Medical Physics, School of Physics, The University of Sydney, NSW 2006, Australia
| | | | | | | | | | | |
Collapse
|
18
|
He X, Samuelson F, Zeng R, Sahiner B. Discovering intrinsic properties of human observers' visual search and mathematical observers' scanning. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2014; 31:2495-2510. [PMID: 25401363 DOI: 10.1364/josaa.31.002495] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
There is a lack of consensus in measuring observer performance in search tasks. To pursue a consensus, we set our goal to obtain metrics that are practical, meaningful, and predictive. We consider a metric practical if it can be implemented to measure human and computer observers' performance. To be meaningful, we propose to discover intrinsic properties of search observers and formulate the metrics to characterize these properties. If the discovered properties allow verifiable predictions, we consider them predictive. We propose a theory and a conjecture toward two intrinsic properties of search observers: rationality in classification as measured by the location-known-exactly (LKE) receiver operating characteristic (ROC) curve and location uncertainty as measured by the effective set size (M*). These two properties are used to develop search models in both single-response and free-response search tasks. To confirm whether these properties are "intrinsic," we investigate their ability in predicting search performance of both human and scanning channelized Hotelling observers. In particular, for each observer, we designed experiments to measure the LKE-ROC curve and M*, which were then used to predict the same observer's performance in other search tasks. The predictions were then compared to the experimentally measured observer performance. Our results indicate that modeling the search performance using the LKE-ROC curve and M* leads to successful predictions in most cases.
Collapse
|
19
|
Vaishnav JY, Jung WC, Popescu LM, Zeng R, Myers KJ. Objective assessment of image quality and dose reduction in CT iterative reconstruction. Med Phys 2014; 41:071904. [PMID: 24989382 DOI: 10.1118/1.4881148] [Citation(s) in RCA: 82] [Impact Index Per Article: 8.2] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023] Open
Affiliation(s)
- J Y Vaishnav
- Diagnostic X-Ray Systems Branch, Office of In Vitro Diagnostic Devices and Radiological Health, Center for Devices and Radiological Health, United States Food and Drug Administration, 10903 New Hampshire Avenue, Silver Spring, Maryland 20993
| | - W C Jung
- Diagnostic X-Ray Systems Branch, Office of In Vitro Diagnostic Devices and Radiological Health, Center for Devices and Radiological Health, United States Food and Drug Administration, 10903 New Hampshire Avenue, Silver Spring, Maryland 20993
| | - L M Popescu
- Division of Imaging and Applied Mathematics, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, United States Food and Drug Administration, 10903 New Hampshire Avenue, Silver Spring, Maryland 20993
| | - R Zeng
- Division of Imaging and Applied Mathematics, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, United States Food and Drug Administration, 10903 New Hampshire Avenue, Silver Spring, Maryland 20993
| | - K J Myers
- Division of Imaging and Applied Mathematics, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, United States Food and Drug Administration, 10903 New Hampshire Avenue, Silver Spring, Maryland 20993
| |
Collapse
|
20
|
Hernandez-Giron I, Calzado A, Geleijns J, Joemai RMS, Veldkamp WJH. Comparison between human and model observer performance in low-contrast detection tasks in CT images: application to images reconstructed with filtered back projection and iterative algorithms. Br J Radiol 2014; 87:20140014. [PMID: 24837275 DOI: 10.1259/bjr.20140014] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/16/2023] Open
Abstract
OBJECTIVE To compare low-contrast detectability (LCDet) performance between a model [non-pre-whitening matched filter with an eye filter (NPWE)] and human observers in CT images reconstructed with filtered back projection (FBP) and iterative [adaptive iterative dose reduction three-dimensional (AIDR 3D; Toshiba Medical Systems, Zoetermeer, Netherlands)] algorithms. METHODS Images of the Catphan® phantom (Phantom Laboratories, New York, NY) were acquired with Aquilion ONE™ 320-detector row CT (Toshiba Medical Systems, Tokyo, Japan) at five tube current levels (20-500 mA range) and reconstructed with FBP and AIDR 3D. Samples containing either low-contrast objects (diameters, 2-15 mm) or background were extracted and analysed by the NPWE model and four human observers in a two-alternative forced choice detection task study. Proportion correct (PC) values were obtained for each analysed object and used to compare human and model observer performances. An efficiency factor (η) was calculated to normalize NPWE to human results. RESULTS Human and NPWE model PC values (normalized by the efficiency, η = 0.44) were highly correlated for the whole dose range. The Pearson's product-moment correlation coefficients (95% confidence interval) between human and NPWE were 0.984 (0.972-0.991) for AIDR 3D and 0.984 (0.971-0.991) for FBP, respectively. Bland-Altman plots based on PC results showed excellent agreement between human and NPWE [mean absolute difference 0.5 ± 0.4%; range of differences (-4.7%, 5.6%)]. CONCLUSION The NPWE model observer can predict human performance in LCDet tasks in phantom CT images reconstructed with FBP and AIDR 3D algorithms at different dose levels. ADVANCES IN KNOWLEDGE Quantitative assessment of LCDet in CT can accurately be performed using software based on a model observer.
Collapse
|