1
|
Nakashima M, Fukui R, Sugimoto S, Iguchi T. Deep learning-based approach for acquisition time reduction in ventilation SPECT in patients after lung transplantation. Radiol Phys Technol 2024:10.1007/s12194-024-00853-3. [PMID: 39441494 DOI: 10.1007/s12194-024-00853-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2024] [Revised: 10/15/2024] [Accepted: 10/16/2024] [Indexed: 10/25/2024]
Abstract
We aimed to evaluate the image quality and diagnostic performance of chronic lung allograft dysfunction (CLAD) with lung ventilation single-photon emission computed tomography (SPECT) images acquired briefly using a convolutional neural network (CNN) in patients after lung transplantation and to explore the feasibility of short acquisition times. We retrospectively identified 93 consecutive lung-transplant recipients who underwent ventilation SPECT/computed tomography (CT). We employed a CNN to distinguish the images acquired in full time from those acquired in a short time. The image quality was evaluated using the structural similarity index (SSIM) loss and normalized mean square error (NMSE). The correlation between functional volume/morphological volume (F/M) ratios of full-time SPECT images and predicted SPECT images was evaluated. Differences in the F/M ratio were evaluated using Bland-Altman plots, and the diagnostic performance was compared using the area under the curve (AUC). The learning curve, obtained using MSE, converged within 100 epochs. The NMSE was significantly lower (P < 0.001) and the SSIM was significantly higher (P < 0.001) for the CNN-predicted SPECT images compared to the short-time SPECT images. The F/M ratio of full-time SPECT images and predicted SPECT images showed a significant correlation (r = 0.955, P < 0.0001). The Bland-Altman plot revealed a bias of -7.90% in the F/M ratio. The AUC values were 0.942 for full-time SPECT images, 0.934 for predicted SPECT images and 0.872 for short-time SPECT images. Our findings suggest that a deep-learning-based approach can significantly curtail the acquisition time of ventilation SPECT, while preserving the image quality and diagnostic accuracy for CLAD.
Collapse
Affiliation(s)
- Masahiro Nakashima
- Division of Radiological Technology, Okayama University Hospital, 2-5-1 Shikatacho, Kitaku, Okayama, 700-8558, Japan.
| | - Ryohei Fukui
- Department of Radiological Technology, Faculty of Health Sciences, Okayama University, 2-5-1 Shikatacho, Kitaku, Okayama, 700-8558, Japan
| | - Seiichiro Sugimoto
- Department of General Thoracic Surgery and Breast and Endocrinological Surgery, Dentistry and Pharmaceutical Sciences, Okayama University Graduate School of Medicine, 2-5-1 Shikatacho, Kitaku, Okayama, 700-8558, Japan
| | - Toshihiro Iguchi
- Department of Radiological Technology, Faculty of Health Sciences, Okayama University, 2-5-1 Shikatacho, Kitaku, Okayama, 700-8558, Japan
| |
Collapse
|
2
|
Yousefzadeh F, Yazdi M, Entezarmahdi SM, Faghihi R, Ghasempoor S, Shahamiri N, Mehrizi ZA, Haghighatafshar M. SPECT-MPI iterative denoising during the reconstruction process using a two-phase learned convolutional neural network. EJNMMI Phys 2024; 11:82. [PMID: 39378001 PMCID: PMC11461437 DOI: 10.1186/s40658-024-00687-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2024] [Accepted: 09/26/2024] [Indexed: 10/11/2024] Open
Abstract
PURPOSE The problem of image denoising in single-photon emission computed tomography (SPECT) myocardial perfusion imaging (MPI) is a fundamental challenge. Although various image processing techniques have been presented, they may degrade the contrast of denoised images. The proposed idea in this study is to use a deep neural network as the denoising procedure during the iterative reconstruction process rather than the post-reconstruction phase. This method could decrease the background coefficient of variation (COV_bkg) of the final reconstructed image, which represents the amount of random noise, while improving the contrast-to-noise ratio (CNR). METHODS In this study, a generative adversarial network is used, where its generator is trained by a two-phase approach. In the first phase, the network is trained by a confined image region around the heart in transverse view. The second phase improves the network's generalization by tuning the network weights with the full image size as the input. The network was trained and tested by a dataset of 247 patients who underwent two immediate serially high- and low-noise SPECT-MPI. RESULTS Quantitative results show that compared to post-reconstruction low pass filtering and post-reconstruction deep denoising methods, our proposed method can decline the COV_bkg of the images by up to 10.28% and 12.52% and enhance the CNR by up to 54.54% and 45.82%, respectively. CONCLUSION The iterative deep denoising method outperforms 2D low-pass Gaussian filtering with an 8.4-mm FWHM and post-reconstruction deep denoising approaches.
Collapse
Affiliation(s)
- Farnaz Yousefzadeh
- Department of Computer Science and Engineering and IT, School of Electrical and Computer Engineering, Shiraz University, Shiraz, Iran
| | - Mehran Yazdi
- School of Electrical and Computer Engineering, Shiraz University, Shiraz, Iran.
| | | | - Reza Faghihi
- Department of Nuclear Engineering, Shiraz University, Shiraz, Iran
| | - Sadegh Ghasempoor
- Department of Nuclear Medicine, Alzahra Hospital, Shiraz University of Medical Sciences, Shiraz, Iran
| | | | - Zahra Abuee Mehrizi
- Department of Nuclear Medicine, School of Medicine, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Mahdi Haghighatafshar
- Department of Nuclear Medicine, School of Medicine, Shiraz University of Medical Sciences, Shiraz, Iran
| |
Collapse
|
3
|
Du Y, Sun J, Li CY, Yang BH, Wu TH, Mok GSP. Deep learning-based multi-frequency denoising for myocardial perfusion SPECT. EJNMMI Phys 2024; 11:80. [PMID: 39356406 PMCID: PMC11447183 DOI: 10.1186/s40658-024-00680-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2024] [Accepted: 09/04/2024] [Indexed: 10/03/2024] Open
Abstract
BACKGROUND Deep learning (DL)-based denoising has been proven to improve image quality and quantitation accuracy of low dose (LD) SPECT. However, conventional DL-based methods used SPECT images with mixed frequency components. This work aims to develop an integrated multi-frequency denoising network to further enhance LD myocardial perfusion (MP) SPECT denoising. METHODS Fifty anonymized patients who underwent routine 99mTc-sestamibi stress SPECT/CT scans were retrospectively recruited. Three LD datasets were obtained by reducing the 10 s acquisition time of full dose (FD) SPECT to be 5, 2 and 1 s per projection based on the list mode data for a total of 60 projections. FD and LD projections were Fourier transformed to magnitude and phase images, which were then separated into two or three frequency bands. Each frequency band was then inversed Fourier transformed back to the image domain. We proposed a 3D integrated attention-guided multi-frequency conditional generative adversarial network (AttMFGAN) and compared with AttGAN, and separate AttGAN for multi-frequency bands denoising (AttGAN-MF).The multi-frequency FD and LD projections of 35, 5 and 10 patients were paired for training, validation and testing. The LD projections to be tested were separated to multi-frequency components and input to corresponding networks to get the denoised components, which were summed to get the final denoised projections. Voxel-based error indices were measured on the cardiac region on the reconstructed images. The perfusion defect size (PDS) was also analyzed. RESULTS AttGAN-MF and AttMFGAN have superior performance on all physical and clinical indices as compared to conventional AttGAN. The integrated AttMFGAN is better than AttGAN-MF. Multi-frequency denoising with two frequency bands have generally better results than corresponding three-frequency bands methods. CONCLUSIONS AttGAN-MF and AttMFGAN are promising to further improve LD MP SPECT denoising.
Collapse
Affiliation(s)
- Yu Du
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Taipa, Macau SAR, China
- Center for Cognitive and Brain Sciences, Institute of Collaborative Innovation, University of Macau, Taipa, Macau SAR, China
| | - Jingzhang Sun
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Taipa, Macau SAR, China
- School of Cyberspace Security, Hainan University, Haikou, Hainan, China
| | - Chien-Ying Li
- Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, Taipei, Taiwan
- Department of Nuclear Medicine, Taipei Veterans General Hospital, Taipei, Taiwan
| | - Bang-Hung Yang
- Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, Taipei, Taiwan
- Department of Nuclear Medicine, Taipei Veterans General Hospital, Taipei, Taiwan
| | - Tung-Hsin Wu
- Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Greta S P Mok
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Taipa, Macau SAR, China.
- Center for Cognitive and Brain Sciences, Institute of Collaborative Innovation, University of Macau, Taipa, Macau SAR, China.
| |
Collapse
|
4
|
Chen X, Zhou B, Guo X, Xie H, Liu Q, Duncan JS, Sinusas AJ, Liu C. DuDoCFNet: Dual-Domain Coarse-to-Fine Progressive Network for Simultaneous Denoising, Limited-View Reconstruction, and Attenuation Correction of Cardiac SPECT. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:3110-3125. [PMID: 38578853 PMCID: PMC11539864 DOI: 10.1109/tmi.2024.3385650] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/07/2024]
Abstract
Single-Photon Emission Computed Tomography (SPECT) is widely applied for the diagnosis of coronary artery diseases. Low-dose (LD) SPECT aims to minimize radiation exposure but leads to increased image noise. Limited-view (LV) SPECT, such as the latest GE MyoSPECT ES system, enables accelerated scanning and reduces hardware expenses but degrades reconstruction accuracy. Additionally, Computed Tomography (CT) is commonly used to derive attenuation maps ( μ -maps) for attenuation correction (AC) of cardiac SPECT, but it will introduce additional radiation exposure and SPECT-CT misalignments. Although various methods have been developed to solely focus on LD denoising, LV reconstruction, or CT-free AC in SPECT, the solution for simultaneously addressing these tasks remains challenging and under-explored. Furthermore, it is essential to explore the potential of fusing cross-domain and cross-modality information across these interrelated tasks to further enhance the accuracy of each task. Thus, we propose a Dual-Domain Coarse-to-Fine Progressive Network (DuDoCFNet), a multi-task learning method for simultaneous LD denoising, LV reconstruction, and CT-free μ -map generation of cardiac SPECT. Paired dual-domain networks in DuDoCFNet are cascaded using a multi-layer fusion mechanism for cross-domain and cross-modality feature fusion. Two-stage progressive learning strategies are applied in both projection and image domains to achieve coarse-to-fine estimations of SPECT projections and CT-derived μ -maps. Our experiments demonstrate DuDoCFNet's superior accuracy in estimating projections, generating μ -maps, and AC reconstructions compared to existing single- or multi-task learning methods, under various iterations and LD levels. The source code of this work is available at https://github.com/XiongchaoChen/DuDoCFNet-MultiTask.
Collapse
|
5
|
Miller RJH, Slomka PJ. Artificial Intelligence in Nuclear Cardiology: An Update and Future Trends. Semin Nucl Med 2024; 54:648-657. [PMID: 38521708 DOI: 10.1053/j.semnuclmed.2024.02.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2024] [Accepted: 02/19/2024] [Indexed: 03/25/2024]
Abstract
Myocardial perfusion imaging (MPI), using either single photon emission computed tomography (SPECT) or positron emission tomography (PET), is one of the most commonly ordered cardiac imaging tests, with prominent clinical roles for disease diagnosis and risk prediction. Artificial intelligence (AI) could potentially play a role in many steps along the typical MPI workflow, from image acquisition through to clinical reporting and risk estimation. AI can be utilized to improve image quality, reducing radiation exposure and image acquisition times. Once images are acquired, AI can help optimize motion correction and image registration during image reconstruction or provide direct image attenuation correction. Utilizing these image sets, AI can segment a number of anatomic features from associated computed tomographic imaging or even generate synthetic attenuation imaging. Lastly, AI may play an important role in disease diagnosis or risk prediction by combining the large number of potentially important clinical, stress, and imaging-related variables. This review will focus on the most recent developments in the field, providing clinicians and researchers with a timely update on the field. Additionally, it will discuss future trends including applications of AI during multiple points of the typical MPI workflow to maximize clinical utility and methods to maximize the information that can be obtained from hybrid imaging.
Collapse
Affiliation(s)
- Robert J H Miller
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Biomedical Sciences, and Imaging, Cedars-Sinai Medical Center, Los Angeles, CA; Department of Cardiac Sciences, University of Calgary, Calgary, AB, Canada
| | - Piotr J Slomka
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Biomedical Sciences, and Imaging, Cedars-Sinai Medical Center, Los Angeles, CA.
| |
Collapse
|
6
|
Miller RJH, Slomka PJ. Current status and future directions in artificial intelligence for nuclear cardiology. Expert Rev Cardiovasc Ther 2024; 22:367-378. [PMID: 39001698 DOI: 10.1080/14779072.2024.2380764] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/29/2024] [Accepted: 07/12/2024] [Indexed: 07/18/2024]
Abstract
INTRODUCTION Myocardial perfusion imaging (MPI) is one of the most commonly ordered cardiac imaging tests. Accurate motion correction, image registration, and reconstruction are critical for high-quality imaging, but this can be technically challenging and has traditionally relied on expert manual processing. With accurate processing, there is a rich variety of clinical, stress, functional, and anatomic data that can be integrated to guide patient management. AREAS COVERED PubMed and Google Scholar were reviewed for articles related to artificial intelligence in nuclear cardiology published between 2020 and 2024. We will outline the prominent roles for artificial intelligence (AI) solutions to provide motion correction, image registration, and reconstruction. We will review the role for AI in extracting anatomic data for hybrid MPI which is otherwise neglected. Lastly, we will discuss AI methods to integrate the wealth of data to improve disease diagnosis or risk stratification. EXPERT OPINION There is growing evidence that AI will transform the performance of MPI by automating and improving on aspects of image acquisition and reconstruction. Physicians and researchers will need to understand the potential strengths of AI in order to benefit from the full clinical utility of MPI.
Collapse
Affiliation(s)
- Robert J H Miller
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Biomedical Sciences, and Imaging, Cedars-Sinai Medical Center, Los Angeles, CA, USA
- Department of Cardiac Sciences, University of Calgary, Calgary, Canada
| | - Piotr J Slomka
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Biomedical Sciences, and Imaging, Cedars-Sinai Medical Center, Los Angeles, CA, USA
| |
Collapse
|
7
|
Bousse A, Kandarpa VSS, Shi K, Gong K, Lee JS, Liu C, Visvikis D. A Review on Low-Dose Emission Tomography Post-Reconstruction Denoising with Neural Network Approaches. IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES 2024; 8:333-347. [PMID: 39429805 PMCID: PMC11486494 DOI: 10.1109/trpms.2023.3349194] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2024]
Abstract
Low-dose emission tomography (ET) plays a crucial role in medical imaging, enabling the acquisition of functional information for various biological processes while minimizing the patient dose. However, the inherent randomness in the photon counting process is a source of noise which is amplified low-dose ET. This review article provides an overview of existing post-processing techniques, with an emphasis on deep neural network (NN) approaches. Furthermore, we explore future directions in the field of NN-based low-dose ET. This comprehensive examination sheds light on the potential of deep learning in enhancing the quality and resolution of low-dose ET images, ultimately advancing the field of medical imaging.
Collapse
Affiliation(s)
| | | | - Kuangyu Shi
- Lab for Artificial Intelligence & Translational Theranostics, Dept. Nuclear Medicine, Inselspital, University of Bern, 3010 Bern, Switzerland
| | - Kuang Gong
- The Center for Advanced Medical Computing and Analysis, Massachusetts General Hospital/Harvard Medical School, Boston, MA 02114, USA
| | - Jae Sung Lee
- Department of Nuclear Medicine, Seoul National University College of Medicine, Seoul 03080, Korea
| | - Chi Liu
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, USA
| | | |
Collapse
|
8
|
Valero-Martínez C, Castillo-Morales V, Gómez-León N, Hernández-Pérez I, Vicente-Rabaneda EF, Uriarte M, Castañeda S. Application of Nuclear Medicine Techniques in Musculoskeletal Infection: Current Trends and Future Prospects. J Clin Med 2024; 13:1058. [PMID: 38398371 PMCID: PMC10889833 DOI: 10.3390/jcm13041058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2023] [Revised: 02/05/2024] [Accepted: 02/08/2024] [Indexed: 02/25/2024] Open
Abstract
Nuclear medicine has become an indispensable discipline in the diagnosis and management of musculoskeletal infections. Radionuclide tests serve as a valuable diagnostic tool for patients suspected of having osteomyelitis, spondylodiscitis, or prosthetic joint infections. The choice of the most suitable imaging modality depends on various factors, including the affected area, potential extra osseous involvement, or the impact of previous bone/joint conditions. This review provides an update on the use of conventional radionuclide imaging tests and recent advancements in fusion imaging scans for the differential diagnosis of musculoskeletal infections. Furthermore, it examines the role of radionuclide scans in monitoring treatment responses and explores current trends in their application. We anticipate that this update will be of significant interest to internists, rheumatologists, radiologists, orthopedic surgeons, rehabilitation physicians, and other specialists involved in musculoskeletal pathology.
Collapse
Affiliation(s)
- Cristina Valero-Martínez
- Rheumatology Service, Hospital Universitario de La Princesa, IIS-Princesa, 28006 Madrid, Spain; (C.V.-M.); (E.F.V.-R.); (M.U.)
| | - Valentina Castillo-Morales
- Nuclear Medicine Service, Hospital Universitario de La Princesa, IIS-Princesa, 28006 Madrid, Spain; (V.C.-M.); (I.H.-P.)
| | - Nieves Gómez-León
- Radiology Service, Hospital Universitario de La Princesa, IIS-Princesa, 28006 Madrid, Spain;
| | - Isabel Hernández-Pérez
- Nuclear Medicine Service, Hospital Universitario de La Princesa, IIS-Princesa, 28006 Madrid, Spain; (V.C.-M.); (I.H.-P.)
| | - Esther F. Vicente-Rabaneda
- Rheumatology Service, Hospital Universitario de La Princesa, IIS-Princesa, 28006 Madrid, Spain; (C.V.-M.); (E.F.V.-R.); (M.U.)
| | - Miren Uriarte
- Rheumatology Service, Hospital Universitario de La Princesa, IIS-Princesa, 28006 Madrid, Spain; (C.V.-M.); (E.F.V.-R.); (M.U.)
| | - Santos Castañeda
- Rheumatology Service, Hospital Universitario de La Princesa, IIS-Princesa, 28006 Madrid, Spain; (C.V.-M.); (E.F.V.-R.); (M.U.)
- Cathedra UAM-Roche, EPID-Future, Department of Medicine, Universidad Autónoma de Madrid (UAM), 28006 Madrid, Spain
| |
Collapse
|
9
|
Balaji V, Song TA, Malekzadeh M, Heidari P, Dutta J. Artificial Intelligence for PET and SPECT Image Enhancement. J Nucl Med 2024; 65:4-12. [PMID: 37945384 PMCID: PMC10755520 DOI: 10.2967/jnumed.122.265000] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2023] [Revised: 10/10/2023] [Indexed: 11/12/2023] Open
Abstract
Nuclear medicine imaging modalities such as PET and SPECT are confounded by high noise levels and low spatial resolution, necessitating postreconstruction image enhancement to improve their quality and quantitative accuracy. Artificial intelligence (AI) models such as convolutional neural networks, U-Nets, and generative adversarial networks have shown promising outcomes in enhancing PET and SPECT images. This review article presents a comprehensive survey of state-of-the-art AI methods for PET and SPECT image enhancement and seeks to identify emerging trends in this field. We focus on recent breakthroughs in AI-based PET and SPECT image denoising and deblurring. Supervised deep-learning models have shown great potential in reducing radiotracer dose and scan times without sacrificing image quality and diagnostic accuracy. However, the clinical utility of these methods is often limited by their need for paired clean and corrupt datasets for training. This has motivated research into unsupervised alternatives that can overcome this limitation by relying on only corrupt inputs or unpaired datasets to train models. This review highlights recently published supervised and unsupervised efforts toward AI-based PET and SPECT image enhancement. We discuss cross-scanner and cross-protocol training efforts, which can greatly enhance the clinical translatability of AI-based image enhancement tools. We also aim to address the looming question of whether the improvements in image quality generated by AI models lead to actual clinical benefit. To this end, we discuss works that have focused on task-specific objective clinical evaluation of AI models for image enhancement or incorporated clinical metrics into their loss functions to guide the image generation process. Finally, we discuss emerging research directions, which include the exploration of novel training paradigms, curation of larger task-specific datasets, and objective clinical evaluation that will enable the realization of the full translation potential of these models in the future.
Collapse
Affiliation(s)
- Vibha Balaji
- Department of Biomedical Engineering, University of Massachusetts Amherst, Amherst, Massachusetts; and
| | - Tzu-An Song
- Department of Biomedical Engineering, University of Massachusetts Amherst, Amherst, Massachusetts; and
| | - Masoud Malekzadeh
- Department of Biomedical Engineering, University of Massachusetts Amherst, Amherst, Massachusetts; and
| | - Pedram Heidari
- Division of Nuclear Medicine and Molecular Imaging, Department of Radiology, Massachusetts General Hospital, Boston, Massachusetts
| | - Joyita Dutta
- Department of Biomedical Engineering, University of Massachusetts Amherst, Amherst, Massachusetts; and
| |
Collapse
|
10
|
Hijazi W, Miller RJH. Deep learning to automate SPECT MPI myocardial reorientation. J Nucl Cardiol 2023; 30:1836-1837. [PMID: 37101018 DOI: 10.1007/s12350-023-03260-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Accepted: 03/22/2023] [Indexed: 04/28/2023]
Affiliation(s)
- Waseem Hijazi
- Department of Cardiac Sciences, University of Calgary, GAA08, 3230 Hospital Drive NW, Calgary, AB, T2N 2T9, Canada
| | - Robert J H Miller
- Department of Cardiac Sciences, University of Calgary, GAA08, 3230 Hospital Drive NW, Calgary, AB, T2N 2T9, Canada.
| |
Collapse
|
11
|
Sohlberg A, Kangasmaa T, Tikkakoski A. Comparison of post reconstruction- and reconstruction-based deep learning denoising methods in cardiac SPECT. Biomed Phys Eng Express 2023; 9:065007. [PMID: 37666231 DOI: 10.1088/2057-1976/acf66c] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Accepted: 09/04/2023] [Indexed: 09/06/2023]
Abstract
Objective. The quality of myocardial perfusion SPECT (MPS) images is often hampered by low count statistics. Poor image quality might hinder reporting the studies and in the worst case lead to erroneous diagnosis. Deep learning (DL)-based methods can be used to improve the quality of the low count studies. DL can be applied in several different methods, which might affect the outcome. The aim of this study was to investigate the differences between post reconstruction- and reconstruction-based denoising methods.Approach. A UNET-type network was trained using ordered subsets expectation maximization (OSEM) reconstructed MPS studies acquired with half, quarter and eighth of full-activity. The trained network was applied as a post reconstruction denoiser (OSEM+DL) and it was incorporated into a regularized reconstruction algorithm as a deep learning penalty (DLP). OSEM+DL and DLP were compared against each other and against OSEM images without DL denoising in terms of noise level, myocardium-ventricle contrast and defect detection performance with signal-to-noise ratio of a non-prewhitening matched filter (NPWMF-SNR) applied to artificial perfusion defects inserted into defect-free clinical MPS scans. Comparisons were made using half-, quarter- and eighth-activity data.Main results. OSEM+DL provided lower noise level at all activities than other methods. DLP's noise level was also always lower than matching activity OSEM's. In addition, OSEM+DL and DLP outperformed OSEM in defect detection performance, but contrary to noise level ranking DLP had higher NPWMF-SNR overall than OSEM+DL. The myocardium-ventricle contrast was highest with DLP and lowest with OSEM+DL. Both OSEM+DL and DLP offered better image quality than OSEM, but visually perfusion defects were deeper in OSEM images at low activities.Significance. Both post reconstruction- and reconstruction-based DL denoising methods have great potential for MPS. The preference between these methods is a trade-off between smoother images and better defect detection performance.
Collapse
Affiliation(s)
- Antti Sohlberg
- Department of Nuclear Medicine, Päijät-Häme Central Hospital, Lahti, Finland
- HERMES Medical Solutions, Stockholm, Sweden
| | - Tuija Kangasmaa
- Department of Clinical Physiology and Nuclear Medicine, Vaasa Central Hospital, Vaasa, Finland
| | - Antti Tikkakoski
- Clinical Physiology and Nuclear Medicine, Tampere University Hospital, Tampere, Finland
| |
Collapse
|
12
|
Fukami M, Matsutomo N, Hashimoto T, Yamamoto T, Sasaki M. Compressed sensing reconstruction shortens the acquisition time for myocardial perfusion imaging: a simulation study. Radiol Phys Technol 2023; 16:397-405. [PMID: 37382801 DOI: 10.1007/s12194-023-00730-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Revised: 06/16/2023] [Accepted: 06/17/2023] [Indexed: 06/30/2023]
Abstract
Compressed sensing (CS) has been used to improve image quality in single-photon emission tomography (SPECT) imaging. However, the effects of CS on image quality parameters in myocardial perfusion imaging (MPI) have not been investigated in detail. This preliminary study aimed to compare the performance of CS-iterative reconstruction (CS-IR) with filtered back-projection (FBP) and maximum likelihood expectation maximization (ML-EM) on their ability to reduce the acquisition time of MPI. A digital phantom that mimicked the left ventricular myocardium was created. Projection images with 120 and 30 directions (360°), and with 60 and 15 directions (180°) were generated. The SPECT images were reconstructed using FBP, ML-EM, and CS-IR. The coefficient of variation (CV) for the uniformity of myocardial accumulation, septal wall thickness, and contrast ratio (Contrast) of the defect/normal lateral wall were calculated for evaluation. The simulation was performed ten times. The CV of CS-IR was lower than that of FBP and ML-EM in both 360° and 180° acquisitions. The septal wall thickness of CS-IR at the 360° acquisition was inferior to that of ML-EM, with a difference of 2.5 mm. Contrast did not differ between ML-EM and CS-IR for the 360° and 180° acquisitions. The CV for the quarter-acquisition time in CS-IR was lower than that for the full-acquisition time in the other reconstruction methods. CS-IR has the potential to reduce the acquisition time of MPI.
Collapse
Affiliation(s)
- Mitsuha Fukami
- Department of Medical Radiological Technology, Faculty of Health Sciences, Kyorin University, 5-4-1 Shimorenjaku, Mitaka-shi, Tokyo, 181-8612, Japan.
- Department of Medical Quantum Science, Graduate School of Medical Sciences, Kyushu University, Fukuoka-shi, Japan.
| | - Norikazu Matsutomo
- Department of Medical Radiological Technology, Faculty of Health Sciences, Kyorin University, 5-4-1 Shimorenjaku, Mitaka-shi, Tokyo, 181-8612, Japan
| | - Takeyuki Hashimoto
- Department of Medical Radiological Technology, Faculty of Health Sciences, Kyorin University, 5-4-1 Shimorenjaku, Mitaka-shi, Tokyo, 181-8612, Japan
| | - Tomoaki Yamamoto
- Department of Medical Radiological Technology, Faculty of Health Sciences, Kyorin University, 5-4-1 Shimorenjaku, Mitaka-shi, Tokyo, 181-8612, Japan
| | - Masayuki Sasaki
- Department of Medical Quantum Science, Faculty of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-ku, Fukuoka-shi, Fukuoka, 812-8582, Japan
| |
Collapse
|
13
|
Yu Z, Rahman A, Laforest R, Schindler TH, Gropler RJ, Wahl RL, Siegel BA, Jha AK. Need for objective task-based evaluation of deep learning-based denoising methods: A study in the context of myocardial perfusion SPECT. Med Phys 2023; 50:4122-4137. [PMID: 37010001 PMCID: PMC10524194 DOI: 10.1002/mp.16407] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Revised: 01/20/2023] [Accepted: 03/01/2023] [Indexed: 04/04/2023] Open
Abstract
BACKGROUND Artificial intelligence-based methods have generated substantial interest in nuclear medicine. An area of significant interest has been the use of deep-learning (DL)-based approaches for denoising images acquired with lower doses, shorter acquisition times, or both. Objective evaluation of these approaches is essential for clinical application. PURPOSE DL-based approaches for denoising nuclear-medicine images have typically been evaluated using fidelity-based figures of merit (FoMs) such as root mean squared error (RMSE) and structural similarity index measure (SSIM). However, these images are acquired for clinical tasks and thus should be evaluated based on their performance in these tasks. Our objectives were to: (1) investigate whether evaluation with these FoMs is consistent with objective clinical-task-based evaluation; (2) provide a theoretical analysis for determining the impact of denoising on signal-detection tasks; and (3) demonstrate the utility of virtual imaging trials (VITs) to evaluate DL-based methods. METHODS A VIT to evaluate a DL-based method for denoising myocardial perfusion SPECT (MPS) images was conducted. To conduct this evaluation study, we followed the recently published best practices for the evaluation of AI algorithms for nuclear medicine (the RELAINCE guidelines). An anthropomorphic patient population modeling clinically relevant variability was simulated. Projection data for this patient population at normal and low-dose count levels (20%, 15%, 10%, 5%) were generated using well-validated Monte Carlo-based simulations. The images were reconstructed using a 3-D ordered-subsets expectation maximization-based approach. Next, the low-dose images were denoised using a commonly used convolutional neural network-based approach. The impact of DL-based denoising was evaluated using both fidelity-based FoMs and area under the receiver operating characteristic curve (AUC), which quantified performance on the clinical task of detecting perfusion defects in MPS images as obtained using a model observer with anthropomorphic channels. We then provide a mathematical treatment to probe the impact of post-processing operations on signal-detection tasks and use this treatment to analyze the findings of this study. RESULTS Based on fidelity-based FoMs, denoising using the considered DL-based method led to significantly superior performance. However, based on ROC analysis, denoising did not improve, and in fact, often degraded detection-task performance. This discordance between fidelity-based FoMs and task-based evaluation was observed at all the low-dose levels and for different cardiac-defect types. Our theoretical analysis revealed that the major reason for this degraded performance was that the denoising method reduced the difference in the means of the reconstructed images and of the channel operator-extracted feature vectors between the defect-absent and defect-present cases. CONCLUSIONS The results show the discrepancy between the evaluation of DL-based methods with fidelity-based metrics versus the evaluation on clinical tasks. This motivates the need for objective task-based evaluation of DL-based denoising approaches. Further, this study shows how VITs provide a mechanism to conduct such evaluations computationally, in a time and resource-efficient setting, and avoid risks such as radiation dose to the patient. Finally, our theoretical treatment reveals insights into the reasons for the limited performance of the denoising approach and may be used to probe the effect of other post-processing operations on signal-detection tasks.
Collapse
Affiliation(s)
- Zitong Yu
- Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, Missouri, USA
| | - Ashequr Rahman
- Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, Missouri, USA
| | - Richard Laforest
- Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, Missouri, USA
| | - Thomas H. Schindler
- Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, Missouri, USA
| | - Robert J. Gropler
- Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, Missouri, USA
| | - Richard L. Wahl
- Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, Missouri, USA
| | - Barry A. Siegel
- Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, Missouri, USA
| | - Abhinav K. Jha
- Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, Missouri, USA
- Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, Missouri, USA
| |
Collapse
|
14
|
Pribanić I, Simić SD, Tanković N, Debeljuh DD, Jurković S. Reduction of SPECT acquisition time using deep learning: A phantom study. Phys Med 2023; 111:102615. [PMID: 37302268 DOI: 10.1016/j.ejmp.2023.102615] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/24/2023] [Revised: 05/03/2023] [Accepted: 05/30/2023] [Indexed: 06/13/2023] Open
Abstract
Single photon emission computed tomography (SPECT) procedures are characterized by long acquisition time to acquire diagnostically acceptable image data. The goal of this investigation was to assess the feasibility of using a deep convolutional neural network (DCNN) to reduce the acquisition time. The DCNN was implemented using the PyTorch and trained using image data from standard SPECT quality phantoms. The under-sampled image dataset is provided to neural network as input, while missing projections were provided as targets. The network is to produce for the output the missing projections. The baseline method of calculating the missing projections as arithmetic means of adjacent ones was introduced. The obtained synthesized projections and reconstructed images were compared to original data and baseline data across several parameters using PyTorch and PyTorch Image Quality code libraries. Results obtained from comparisons of projection and reconstructed image data show the DCNN clearly outperforming the baseline method. However, subsequent analysis revealed the synthesized image data being more comparable to under-sampled than to fully-sampled image data. The results of this investigation imply that neural network can replicate coarser objects better. However, densely sampled clinical image datasets, coarse reconstruction matrices and patient data featuring coarse structures combined with a lack of baseline data generation methods will hamper the ability to analyse the neural network outputs correctly. This study calls for use of phantom image data and introduction of a baseline method in the evaluation of neural network outputs.
Collapse
Affiliation(s)
- Ivan Pribanić
- Medical Physics and Radiation Protection Department, University Hospital Rijeka, Croatia; Department of Medical Physics and Biophysics, Faculty of Medicine, University of Rijeka, Croatia
| | | | - Nikola Tanković
- Faculty of Informatics, Juraj Dobrila University of Pula, Croatia
| | - Dea Dundara Debeljuh
- Medical Physics and Radiation Protection Department, University Hospital Rijeka, Croatia; Department of Medical Physics and Biophysics, Faculty of Medicine, University of Rijeka, Croatia; Radiology Department, General Hospital Pula, Croatia
| | - Slaven Jurković
- Medical Physics and Radiation Protection Department, University Hospital Rijeka, Croatia; Department of Medical Physics and Biophysics, Faculty of Medicine, University of Rijeka, Croatia.
| |
Collapse
|
15
|
Sun J, Jiang H, Du Y, Li CY, Wu TH, Liu YH, Yang BH, Mok GSP. Deep learning-based denoising in projection-domain and reconstruction-domain for low-dose myocardial perfusion SPECT. J Nucl Cardiol 2023; 30:970-985. [PMID: 35982208 DOI: 10.1007/s12350-022-03045-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2021] [Accepted: 06/13/2022] [Indexed: 10/15/2022]
Abstract
BACKGROUND Low-dose (LD) myocardial perfusion (MP) SPECT suffers from high noise level, leading to compromised diagnostic accuracy. Here we investigated the denoising performance for MP-SPECT using a conditional generative adversarial network (cGAN) in projection-domain (cGAN-prj) and reconstruction-domain (cGAN-recon). METHODS Sixty-four noisy SPECT projections were simulated for a population of 100 XCAT phantoms with different anatomical variations and 99mTc-sestamibi distributions. Series of LD projections were obtained by scaling the full dose (FD) count rate to be 1/20 to 1/2 of the original. Twenty patients with 99mTc-sestamibi stress SPECT/CT scans were retrospectively analyzed. For each patient, LD SPECT images (7/10 to 1/10 of FD) were generated from the FD list mode data. All projections were reconstructed by the quantitative OS-EM method. A 3D cGAN was implemented to predict FD images from their corresponding LD images in the projection- and reconstruction-domain. The denoised projections were reconstructed for analysis in various quantitative indices along with cGAN-recon, Gaussian, and Butterworth-filtered images. RESULTS cGAN denoising improves image quality as compared to LD and conventional post-reconstruction filtering. cGAN-prj can further reduce the dose level as compared to cGAN-recon without compromising the image quality. CONCLUSIONS Denoising based on cGAN-prj is superior to cGAN-recon for MP-SPECT.
Collapse
Affiliation(s)
- Jingzhang Sun
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Macau SAR, China
| | - Han Jiang
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Macau SAR, China
| | - Yu Du
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Macau SAR, China
| | - Chien-Ying Li
- Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, Taipei, Taiwan, ROC
- Department of Nuclear Medicine, Taipei Veterans General Hospital, Taipei, Taiwan, ROC
| | - Tung-Hsin Wu
- Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, Taipei, Taiwan, ROC
| | - Yi-Hwa Liu
- Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, Taipei, Taiwan, ROC
- Department of Internal Medicine, Yale University School of Medicine, New Haven, CT, USA
| | - Bang-Hung Yang
- Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, Taipei, Taiwan, ROC.
- Department of Nuclear Medicine, Taipei Veterans General Hospital, Taipei, Taiwan, ROC.
| | - Greta S P Mok
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Macau SAR, China.
| |
Collapse
|
16
|
Garcia EV, Piccinelli M. Preparing for the Artificial Intelligence Revolution in Nuclear Cardiology. Nucl Med Mol Imaging 2023; 57:51-60. [PMID: 36998588 PMCID: PMC10043081 DOI: 10.1007/s13139-021-00733-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2021] [Revised: 12/18/2021] [Accepted: 12/19/2021] [Indexed: 10/19/2022] Open
Abstract
A major opportunity in nuclear cardiology is the many significant artificial intelligence (AI) applications that have recently been reported. These developments include using deep learning (DL) for reducing the needed injected dose and acquisition time in perfusion acquisitions also due to DL improvements in image reconstruction and filtering, SPECT attenuation correction using DL without need for transmission images, DL and machine learning (ML) use for feature extraction to define myocardial left ventricular (LV) borders for functional measurements and improved detection of the LV valve plane and AI, ML, and DL implementations for MPI diagnosis, prognosis, and structured reporting. Although some have, most of these applications have yet to make it to widespread commercial distribution due to the recency of their developments, most reported in 2020. We must be prepared both technically and socio-economically to fully benefit from these and a tsunami of other AI applications that are coming.
Collapse
Affiliation(s)
- Ernest V. Garcia
- Department of Radiology and Imaging Sciences, Emory University School of Medicine, 101 Woodruff Circle, Room 1203, GA 30322 Atlanta, USA
| | - Marina Piccinelli
- Department of Radiology and Imaging Sciences, Emory University School of Medicine, 101 Woodruff Circle, Room 1203, GA 30322 Atlanta, USA
| |
Collapse
|
17
|
Sohlberg A, Kangasmaa T, Constable C, Tikkakoski A. Comparison of deep learning-based denoising methods in cardiac SPECT. EJNMMI Phys 2023; 10:9. [PMID: 36752847 PMCID: PMC9908801 DOI: 10.1186/s40658-023-00531-0] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Accepted: 02/01/2023] [Indexed: 02/09/2023] Open
Abstract
BACKGROUND Myocardial perfusion SPECT (MPS) images often suffer from artefacts caused by low-count statistics. Poor-quality images can lead to misinterpretations of perfusion defects. Deep learning (DL)-based methods have been proposed to overcome the noise artefacts. The aim of this study was to investigate the differences among several DL denoising models. METHODS Convolution neural network (CNN), residual neural network (RES), UNET and conditional generative adversarial neural network (cGAN) were generated and trained using ordered subsets expectation maximization (OSEM) reconstructed MPS studies acquired with full, half, three-eighths and quarter acquisition time. All DL methods were compared against each other and also against images without DL-based denoising. Comparisons were made using half and quarter time acquisition data. The methods were evaluated in terms of noise level (coefficient of variation of counts, CoV), structural similarity index measure (SSIM) in the myocardium of normal patients and receiver operating characteristic (ROC) analysis of realistic artificial perfusion defects inserted into normal MPS scans. Total perfusion deficit scores were used as observer rating for the presence of a perfusion defect. RESULTS All the DL denoising methods tested provided statistically significantly lower noise level than OSEM without DL-based denoising with the same acquisition time. CoV of the myocardium counts with the different DL noising methods was on average 7% (CNN), 8% (RES), 7% (UNET) and 14% (cGAN) lower than with OSEM. All DL methods also outperformed full time OSEM without DL-based denoising in terms of noise level with both half and quarter acquisition time, but this difference was not statistically significant. cGAN had the lowest CoV of the DL methods at all noise levels. Image quality and polar map uniformity of DL-denoised images were also better than reduced acquisition time OSEM's. SSIM of the reduced acquisition time OSEM was overall higher than with the DL methods. The defect detection performance of full time OSEM measured as area under the ROC curve (AUC) was on average 0.97. Half time OSEM, CNN, RES and UNET provided equal or nearly equal AUC. However, with quarter time data CNN, RES and UNET had an average AUC of 0.93, which was lower than full time OSEM's AUC, but equal to quarter acquisition time OSEM. cGAN did not achieve the defect detection performance of the other DL methods. Its average AUC with half time data was 0.94 and 0.91 with quarter time data. CONCLUSIONS DL-based denoising effectively improved noise level with slightly lower perfusion defect detection performance than full time reconstruction. cGAN achieved the lowest noise level, but at the same time the poorest defect detection performance among the studied DL methods.
Collapse
Affiliation(s)
- Antti Sohlberg
- Department of Clinical Physiology and Nuclear Medicine, Päijät-Häme Central Hospital, Lahti, Finland.
- HERMES Medical Solutions, Stockholm, Sweden.
| | - Tuija Kangasmaa
- Department of Clinical Physiology and Nuclear Medicine, Vaasa Central Hospital, Vaasa, Finland
| | | | - Antti Tikkakoski
- Clinical Physiology and Nuclear Medicine, Tampere University Hospital, Tampere, Finland
| |
Collapse
|
18
|
Sun J, Yang BH, Li CY, Du Y, Liu YH, Wu TH, Mok GSP. Fast myocardial perfusion SPECT denoising using an attention-guided generative adversarial network. Front Med (Lausanne) 2023; 10:1083413. [PMID: 36817784 PMCID: PMC9935600 DOI: 10.3389/fmed.2023.1083413] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2022] [Accepted: 01/16/2023] [Indexed: 02/05/2023] Open
Abstract
Purpose Deep learning-based denoising is promising for myocardial perfusion (MP) SPECT. However, conventional convolutional neural network (CNN)-based methods use fixed-sized convolutional kernels to convolute one region within the receptive field at a time, which would be ineffective for learning the feature dependencies across large regions. The attention mechanism (Att) is able to learn the relationships between the local receptive field and other voxels in the image. In this study, we propose a 3D attention-guided generative adversarial network (AttGAN) for denoising fast MP-SPECT images. Methods Fifty patients who underwent 1184 MBq 99mTc-sestamibi stress SPECT/CT scan were retrospectively recruited. Sixty projections were acquired over 180° and the acquisition time was 10 s/view for the full time (FT) mode. Fast MP-SPECT projection images (1 s to 7 s) were generated from the FT list mode data. We further incorporated binary patient defect information (0 = without defect, 1 = with defect) into AttGAN (AttGAN-def). AttGAN, AttGAN-def, cGAN, and Unet were implemented using Tensorflow with the Adam optimizer running up to 400 epochs. FT and fast MP-SPECT projection pairs of 35 patients were used for training the networks for each acquisition time, while 5 and 10 patients were applied for validation and testing. Five-fold cross-validation was performed and data for all 50 patients were tested. Voxel-based error indices, joint histogram, linear regression, and perfusion defect size (PDS) were analyzed. Results All quantitative indices of AttGAN-based networks are superior to cGAN and Unet on all acquisition time images. AttGAN-def further improves AttGAN performance. The mean absolute error of PDS by AttcGAN-def was 1.60 on acquisition time of 1 s/prj, as compared to 2.36, 2.76, and 3.02 by AttGAN, cGAN, and Unet. Conclusion Denoising based on AttGAN is superior to conventional CNN-based networks for MP-SPECT.
Collapse
Affiliation(s)
- Jingzhang Sun
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Taipa, Macao SAR, China
| | - Bang-Hung Yang
- Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, Hsinchu, Taiwan,Department of Nuclear Medicine, Taipei Veterans General Hospital, Taipei City, Taiwan
| | - Chien-Ying Li
- Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, Hsinchu, Taiwan,Department of Nuclear Medicine, Taipei Veterans General Hospital, Taipei City, Taiwan
| | - Yu Du
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Taipa, Macao SAR, China
| | - Yi-Hwa Liu
- Department of Internal Medicine, Yale University School of Medicine, New Haven, CT, United States
| | - Tung-Hsin Wu
- Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, Hsinchu, Taiwan,Tung-Hsin Wu,
| | - Greta S. P. Mok
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Taipa, Macao SAR, China,Center for Cognitive and Brain Sciences, Institute of Collaborative Innovation, University of Macau, Taipa, Macao SAR, China,Ministry of Education Frontiers Science Center for Precision Oncology, Faculty of Health Science, University of Macau, Taipa, Macao SAR, China,*Correspondence: Greta S. P. Mok,
| |
Collapse
|
19
|
Miller RJ. Artificial Intelligence in Nuclear Cardiology. Cardiol Clin 2023; 41:151-161. [PMID: 37003673 DOI: 10.1016/j.ccl.2023.01.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/22/2023]
Abstract
Artificial intelligence (AI) encompasses a variety of computer algorithms that have a wide range of potential clinical applications in nuclear cardiology. This article will introduce core terminology and concepts for AI including classifications of AI as well as training and testing regimens. We will then highlight the potential role for AI to improve image registration and image quality. Next, we will discuss methods for AI-driven image attenuation correction. Finally, we will review advancements in machine learning and deep-learning applications for disease diagnosis and risk stratification, including efforts to improve clinical translation of this valuable technology with explainable AI models.
Collapse
|
20
|
Apostolopoulos ID, Papandrianos NI, Feleki A, Moustakidis S, Papageorgiou EI. Deep learning-enhanced nuclear medicine SPECT imaging applied to cardiac studies. EJNMMI Phys 2023; 10:6. [PMID: 36705775 PMCID: PMC9883373 DOI: 10.1186/s40658-022-00522-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2022] [Accepted: 12/19/2022] [Indexed: 01/28/2023] Open
Abstract
Deep learning (DL) has a growing popularity and is a well-established method of artificial intelligence for data processing, especially for images and videos. Its applications in nuclear medicine are broad and include, among others, disease classification, image reconstruction, and image de-noising. Positron emission tomography (PET) and single-photon emission computerized tomography (SPECT) are major image acquisition technologies in nuclear medicine. Though several studies have been conducted to apply DL in many nuclear medicine domains, such as cancer detection and classification, few studies have employed such methods for cardiovascular disease applications. The present paper reviews recent DL approaches focused on cardiac SPECT imaging. Extensive research identified fifty-five related studies, which are discussed. The review distinguishes between major application domains, including cardiovascular disease diagnosis, SPECT attenuation correction, image denoising, full-count image estimation, and image reconstruction. In addition, major findings and dominant techniques employed for the mentioned task are revealed. Current limitations of DL approaches and future research directions are discussed.
Collapse
Affiliation(s)
- Ioannis D. Apostolopoulos
- grid.11047.330000 0004 0576 5395Department of Medical Physics, School of Medicine, University of Patras, 26504 Patras, Greece ,grid.410558.d0000 0001 0035 6670Department of Energy Systems, University of Thessaly, Gaiopolis Campus, 41500 Larisa, Greece
| | - Nikolaos I. Papandrianos
- grid.410558.d0000 0001 0035 6670Department of Energy Systems, University of Thessaly, Gaiopolis Campus, 41500 Larisa, Greece
| | - Anna Feleki
- grid.410558.d0000 0001 0035 6670Department of Energy Systems, University of Thessaly, Gaiopolis Campus, 41500 Larisa, Greece
| | - Serafeim Moustakidis
- grid.410558.d0000 0001 0035 6670Department of Energy Systems, University of Thessaly, Gaiopolis Campus, 41500 Larisa, Greece ,AIDEAS OÜ, 10117 Tallinn, Estonia
| | - Elpiniki I. Papageorgiou
- grid.410558.d0000 0001 0035 6670Department of Energy Systems, University of Thessaly, Gaiopolis Campus, 41500 Larisa, Greece
| |
Collapse
|
21
|
Chen X, Zhou B, Xie H, Miao T, Liu H, Holler W, Lin M, Miller EJ, Carson RE, Sinusas AJ, Liu C. DuDoSS: Deep-learning-based dual-domain sinogram synthesis from sparsely sampled projections of cardiac SPECT. Med Phys 2023; 50:89-103. [PMID: 36048541 PMCID: PMC9868054 DOI: 10.1002/mp.15958] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2022] [Revised: 08/04/2022] [Accepted: 08/19/2022] [Indexed: 01/26/2023] Open
Abstract
PURPOSE Myocardial perfusion imaging (MPI) using single-photon emission-computed tomography (SPECT) is widely applied for the diagnosis of cardiovascular diseases. In clinical practice, the long scanning procedures and acquisition time might induce patient anxiety and discomfort, motion artifacts, and misalignments between SPECT and computed tomography (CT). Reducing the number of projection angles provides a solution that results in a shorter scanning time. However, fewer projection angles might cause lower reconstruction accuracy, higher noise level, and reconstruction artifacts due to reduced angular sampling. We developed a deep-learning-based approach for high-quality SPECT image reconstruction using sparsely sampled projections. METHODS We proposed a novel deep-learning-based dual-domain sinogram synthesis (DuDoSS) method to recover full-view projections from sparsely sampled projections of cardiac SPECT. DuDoSS utilized the SPECT images predicted in the image domain as guidance to generate synthetic full-view projections in the sinogram domain. The synthetic projections were then reconstructed into non-attenuation-corrected and attenuation-corrected (AC) SPECT images for voxel-wise and segment-wise quantitative evaluations in terms of normalized mean square error (NMSE) and absolute percent error (APE). Previous deep-learning-based approaches, including direct sinogram generation (Direct Sino2Sino) and direct image prediction (Direct Img2Img), were tested in this study for comparison. The dataset used in this study included a total of 500 anonymized clinical stress-state MPI studies acquired on a GE NM/CT 850 scanner with 60 projection angles following the injection of 99m Tc-tetrofosmin. RESULTS Our proposed DuDoSS generated more consistent synthetic projections and SPECT images with the ground truth than other approaches. The average voxel-wise NMSE between the synthetic projections by DuDoSS and the ground-truth full-view projections was 2.08% ± 0.81%, as compared to 2.21% ± 0.86% (p < 0.001) by Direct Sino2Sino. The averaged voxel-wise NMSE between the AC SPECT images by DuDoSS and the ground-truth AC SPECT images was 1.63% ± 0.72%, as compared to 1.84% ± 0.79% (p < 0.001) by Direct Sino2Sino and 1.90% ± 0.66% (p < 0.001) by Direct Img2Img. The averaged segment-wise APE between the AC SPECT images by DuDoSS and the ground-truth AC SPECT images was 3.87% ± 3.23%, as compared to 3.95% ± 3.21% (p = 0.023) by Direct Img2Img and 4.46% ± 3.58% (p < 0.001) by Direct Sino2Sino. CONCLUSIONS Our proposed DuDoSS is feasible to generate accurate synthetic full-view projections from sparsely sampled projections for cardiac SPECT. The synthetic projections and reconstructed SPECT images generated from DuDoSS are more consistent with the ground-truth full-view projections and SPECT images than other approaches. DuDoSS can potentially enable fast data acquisition of cardiac SPECT.
Collapse
Affiliation(s)
- Xiongchao Chen
- Department of Biomedical Engineering, Yale University, New Haven, Connecticut, United States, 06511
| | - Bo Zhou
- Department of Biomedical Engineering, Yale University, New Haven, Connecticut, United States, 06511
| | - Huidong Xie
- Department of Biomedical Engineering, Yale University, New Haven, Connecticut, United States, 06511
| | - Tianshun Miao
- Department of Biomedical Engineering, Yale University, New Haven, Connecticut, United States, 06511
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, Connecticut, United States, 06511
| | - Hui Liu
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, Connecticut, United States, 06511
| | | | - MingDe Lin
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, Connecticut, United States, 06511
- Visage Imaging, Inc., San Diego, California, United States, 92130
| | - Edward J. Miller
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, Connecticut, United States, 06511
- Department of Internal Medicine (Cardiology), Yale University School of Medicine, New Haven, Connecticut, United States, 06511
| | - Richard E. Carson
- Department of Biomedical Engineering, Yale University, New Haven, Connecticut, United States, 06511
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, Connecticut, United States, 06511
| | - Albert J. Sinusas
- Department of Biomedical Engineering, Yale University, New Haven, Connecticut, United States, 06511
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, Connecticut, United States, 06511
- Department of Internal Medicine (Cardiology), Yale University School of Medicine, New Haven, Connecticut, United States, 06511
| | - Chi Liu
- Department of Biomedical Engineering, Yale University, New Haven, Connecticut, United States, 06511
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, Connecticut, United States, 06511
| |
Collapse
|
22
|
Singh A, Miller RJH. Deep learning-based attenuation map generation and correction; could it be useful clinically? J Nucl Cardiol 2022; 29:2893-2895. [PMID: 34877640 DOI: 10.1007/s12350-021-02875-5] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2021] [Accepted: 11/04/2021] [Indexed: 01/22/2023]
Affiliation(s)
- Ananya Singh
- Departments of Imaging, Medicine and Biomedical Sciences, Division of Artificial Intelligence in Medicine, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
| | - Robert J H Miller
- Departments of Imaging, Medicine and Biomedical Sciences, Division of Artificial Intelligence in Medicine, Cedars-Sinai Medical Center, Los Angeles, CA, USA
- Department of Cardiac Sciences, University of Calgary, GAA08, 3230 Hospital Drive NW, Calgary, AB, T2N 2T9, Canada
- Libin Cardiovascular Institute, Calgary, AB, Canada
| |
Collapse
|
23
|
Miller RJH, Slomka PJ. Artificial intelligence-based attenuation correction; closer to clinical reality? J Nucl Cardiol 2022; 29:2251-2253. [PMID: 34228331 DOI: 10.1007/s12350-021-02724-5] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2021] [Accepted: 06/22/2021] [Indexed: 01/23/2023]
Affiliation(s)
- Robert J H Miller
- Department of Cardiac Sciences, University of Calgary, Calgary, AB, Canada.
- Libin Cardiovascular Institute, Calgary, AB, Canada.
- Department of Imaging, Medicine, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
| | - Piotr J Slomka
- Department of Imaging, Medicine, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, CA, USA
| |
Collapse
|
24
|
Sun J, Du Y, Li C, Wu TH, Yang B, Mok GSP. Pix2Pix generative adversarial network for low dose myocardial perfusion SPECT denoising. Quant Imaging Med Surg 2022; 12:3539-3555. [PMID: 35782241 PMCID: PMC9246746 DOI: 10.21037/qims-21-1042] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2021] [Accepted: 02/18/2022] [Indexed: 11/12/2023]
Abstract
BACKGROUND Myocardial perfusion (MP) SPECT is a well-established method for diagnosing cardiac disease, yet its radiation risk poses safety concern. This study aims to apply and evaluate the use of Pix2Pix generative adversarial network (Pix2Pix GAN) in denoising low dose MP SPECT images. METHODS One hundred male and female patients with different 99mTc-sestamibi activity distributions, organ and body sizes were simulated by a population of digital 4D Extended Cardiac Torso (XCAT) phantoms. Realistic noisy SPECT projections of full dose of 987 MBq injection and 16 min acquisition, and low dose ranged from 1/20 to 1/2 of the full dose, were generated by an analytical projector from the right anterior oblique (RAO) to the left posterior oblique (LPO) positions. Additionally, twenty patients underwent ~1,184 MBq 99mTc-sestamibi stress SPECT/CT scan were also retrospectively recruited for the study. For each patient, low dose SPECT images (7/10 to 1/10 of full dose) were generated from the full dose list mode data. Our Pix2Pix GAN model was trained with full dose and low dose reconstructed SPECT image pairs. Normalized mean square error (NMSE), structural similarity index (SSIM), coefficient of variation (CV), full-width-at-half-maximum (FWHM) and relative defect size differences (RSD) of Pix2Pix GAN processed images were evaluated along with a reference convolutional auto encoder (CAE) network and post-reconstruction filters. RESULTS NMSE values of 0.0233±0.004 vs. 0.0249±0.004 and 0.0313±0.007 vs. 0.0579±0.016 were obtained on 1/2 and 1/20 dose level for Pix2Pix GAN and CAE in the simulation study, while they were 0.0376±0.010 vs. 0.0433±0.010 and 0.0907±0.020 vs. 0.1186±0.025 on 7/10 and 1/10 dose level in the clinical study. Similar results were also obtained from the SSIM, CV, FWHM and RSD values. Overall, the use of Pix2Pix GAN was superior to other denoising methods in all physical indices, particular in the lower dose levels in the simulation and clinical study. CONCLUSIONS The Pix2Pix GAN method is effective to reduce the noise level of low dose MP SPECT. Further studies on clinical performance are warranted to demonstrate its full clinical effectiveness.
Collapse
Affiliation(s)
- Jingzhang Sun
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Macau, China
| | - Yu Du
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Macau, China
- Center for Cognitive and Brain Sciences, Institute of Collaborative Innovation, University of Macau, Macau, China
| | - ChienYing Li
- Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, Taipei
- Department of Nuclear Medicine, Taipei Veterans General Hospital, Taipei
| | - Tung-Hsin Wu
- Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, Taipei
| | - BangHung Yang
- Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, Taipei
- Department of Nuclear Medicine, Taipei Veterans General Hospital, Taipei
| | - Greta S. P. Mok
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Macau, China
- Center for Cognitive and Brain Sciences, Institute of Collaborative Innovation, University of Macau, Macau, China
| |
Collapse
|
25
|
Chen X, Zhou B, Xie H, Shi L, Liu H, Holler W, Lin M, Liu YH, Miller EJ, Sinusas AJ, Liu C. Direct and indirect strategies of deep-learning-based attenuation correction for general purpose and dedicated cardiac SPECT. Eur J Nucl Med Mol Imaging 2022; 49:3046-3060. [PMID: 35169887 PMCID: PMC9253078 DOI: 10.1007/s00259-022-05718-8] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Accepted: 02/06/2022] [Indexed: 12/22/2022]
Abstract
PURPOSE Deep-learning-based attenuation correction (AC) for SPECT includes both indirect and direct approaches. Indirect approaches generate attenuation maps (μ-maps) from emission images, while direct approaches predict AC images directly from non-attenuation-corrected (NAC) images without μ-maps. For dedicated cardiac SPECT scanners with CZT detectors, indirect approaches are challenging due to the limited field-of-view (FOV). In this work, we aim to 1) first develop novel indirect approaches to improve the AC performance for dedicated SPECT; and 2) compare the AC performance between direct and indirect approaches for both general purpose and dedicated SPECT. METHODS For dedicated SPECT, we developed strategies to predict truncated μ-maps from NAC images reconstructed with a small matrix, or full μ-maps from NAC images reconstructed with a large matrix using 270 anonymized clinical studies scanned on a GE Discovery NM/CT 570c SPECT/CT. For general purpose SPECT, we implemented direct and indirect approaches using 400 anonymized clinical studies scanned on a GE NM/CT 850c SPECT/CT. NAC images in both photopeak and scatter windows were input to predict μ-maps or AC images. RESULTS For dedicated SPECT, the averaged normalized mean square error (NMSE) using our proposed strategies with full μ-maps was 1.20 ± 0.72% as compared to 2.21 ± 1.17% using the previous direct approaches. The polar map absolute percent error (APE) using our approaches was 3.24 ± 2.79% (R2 = 0.9499) as compared to 4.77 ± 3.96% (R2 = 0.9213) using direct approaches. For general purpose SPECT, the averaged NMSE of the predicted AC images using the direct approaches was 2.57 ± 1.06% as compared to 1.37 ± 1.16% using the indirect approaches. CONCLUSIONS We developed strategies of generating μ-maps for dedicated cardiac SPECT with small FOV. For both general purpose and dedicated SPECT, indirect approaches showed superior performance of AC than direct approaches.
Collapse
Affiliation(s)
- Xiongchao Chen
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA
| | - Bo Zhou
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA
| | - Huidong Xie
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA
| | - Luyao Shi
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA
| | - Hui Liu
- Department of Radiology and Biomedical Imaging, Yale University, CT, New Haven, USA
- Department of Engineering Physics, Tsinghua University, Beijing, People's Republic of China
| | | | - MingDe Lin
- Department of Radiology and Biomedical Imaging, Yale University, CT, New Haven, USA
- Visage Imaging, Inc, San Diego, CA, USA
| | - Yi-Hwa Liu
- Department of Internal Medicine (Cardiology), Yale University School of Medicine, New Haven, CT, USA
- Department of Biomedical Imaging and Radiological Sciences, School of Biomedical Science and Engineering, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Edward J Miller
- Department of Radiology and Biomedical Imaging, Yale University, CT, New Haven, USA
- Department of Internal Medicine (Cardiology), Yale University School of Medicine, New Haven, CT, USA
| | - Albert J Sinusas
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA
- Department of Radiology and Biomedical Imaging, Yale University, CT, New Haven, USA
- Department of Internal Medicine (Cardiology), Yale University School of Medicine, New Haven, CT, USA
| | - Chi Liu
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA.
- Department of Radiology and Biomedical Imaging, Yale University, CT, New Haven, USA.
| |
Collapse
|
26
|
Pan B, Qi N, Meng Q, Wang J, Peng S, Qi C, Gong NJ, Zhao J. Ultra high speed SPECT bone imaging enabled by a deep learning enhancement method: a proof of concept. EJNMMI Phys 2022; 9:43. [PMID: 35698006 PMCID: PMC9192886 DOI: 10.1186/s40658-022-00472-0] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Accepted: 05/29/2022] [Indexed: 11/12/2022] Open
Abstract
Background To generate high-quality bone scan SPECT images from only 1/7 scan time SPECT images using deep learning-based enhancement method. Materials and methods Normal-dose (925–1110 MBq) clinical technetium 99 m-methyl diphosphonate (99mTc-MDP) SPECT/CT images and corresponding SPECT/CT images with 1/7 scan time from 20 adult patients with bone disease and a phantom were collected to develop a lesion-attention weighted U2-Net (Qin et al. in Pattern Recognit 106:107404, 2020), which produces high-quality SPECT images from fast SPECT/CT images. The quality of synthesized SPECT images from different deep learning models was compared using PSNR and SSIM. Clinic evaluation on 5-point Likert scale (5 = excellent) was performed by two experienced nuclear physicians. Average score and Wilcoxon test were constructed to assess the image quality of 1/7 SPECT, DL-enhanced SPECT and the standard SPECT. SUVmax, SUVmean, SSIM and PSNR from each detectable sphere filled with imaging agent were measured and compared for different images. Results U2-Net-based model reached the best PSNR (40.8) and SSIM (0.788) performance compared with other advanced deep learning methods. The clinic evaluation showed the quality of the synthesized SPECT images is much higher than that of fast SPECT images (P < 0.05). Compared to the standard SPECT images, enhanced images exhibited the same general image quality (P > 0.999), similar detail of 99mTc-MDP (P = 0.125) and the same diagnostic confidence (P = 0.1875). 4, 5 and 6 spheres could be distinguished on 1/7 SPECT, DL-enhanced SPECT and the standard SPECT, respectively. The DL-enhanced phantom image outperformed 1/7 SPECT in SUVmax, SUVmean, SSIM and PSNR in quantitative assessment. Conclusions Our proposed method can yield significant image quality improvement in the noise level, details of anatomical structure and SUV accuracy, which enabled applications of ultra fast SPECT bone imaging in real clinic settings.
Collapse
Affiliation(s)
- Boyang Pan
- RadioDynamic Healthcare, Shanghai, China
| | - Na Qi
- Department of Nuclear Medicine, Shanghai East Hospital, Tongji University School of Medicine, No. 150 Jimo Road, Pudong New District, Shanghai, China
| | - Qingyuan Meng
- Department of Nuclear Medicine, Shanghai East Hospital, Tongji University School of Medicine, No. 150 Jimo Road, Pudong New District, Shanghai, China
| | | | - Siyue Peng
- RadioDynamic Healthcare, Shanghai, China
| | | | - Nan-Jie Gong
- Vector Lab for Intelligent Medical Imaging and Neural Engineering, International Innovation Center of Tsinghua University, No. 602 Tongpu Street, Putuo District, Shanghai, China.
| | - Jun Zhao
- Department of Nuclear Medicine, Shanghai East Hospital, Tongji University School of Medicine, No. 150 Jimo Road, Pudong New District, Shanghai, China.
| |
Collapse
|
27
|
Sun J, Zhang Q, Du Y, Zhang D, Pretorius PH, King MA, Mok GSP. Dual gating myocardial perfusion SPECT denoising using a conditional generative adversarial network. Med Phys 2022; 49:5093-5106. [DOI: 10.1002/mp.15707] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2021] [Revised: 04/29/2022] [Accepted: 05/01/2022] [Indexed: 11/12/2022] Open
Affiliation(s)
- Jingzhang Sun
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering Faculty of Science and Technology University of Macau Macau SAR China
| | - Qi Zhang
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering Faculty of Science and Technology University of Macau Macau SAR China
- Department of Computer and Information Science Faculty of Science and Technology University of Macau Macau SAR China
| | - Yu Du
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering Faculty of Science and Technology University of Macau Macau SAR China
| | - Duo Zhang
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering Faculty of Science and Technology University of Macau Macau SAR China
- Research Center for Healthcare Data Science Zhejiang Lab Hangzhou Zhejiang China
| | - P. Hendrik Pretorius
- Department of Radiology University of Massachusetts Medical School Worcester USA
| | - Michael A. King
- Department of Radiology University of Massachusetts Medical School Worcester USA
| | - Greta S. P. Mok
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering Faculty of Science and Technology University of Macau Macau SAR China
- Center for Cognitive and Brain Sciences Institute of Collaborative Innovation University of Macau Macau SAR China
| |
Collapse
|
28
|
Murata T. [[SPECT] 5. Application of Artificial Intelligence in Nuclear Medicine for SPECT]. Nihon Hoshasen Gijutsu Gakkai Zasshi 2022; 78:1230-1236. [PMID: 36261360 DOI: 10.6009/jjrt.2022-2096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
|
29
|
Shiri I, Arabi H, Salimi Y, Sanaat A, Akhavanallaf A, Hajianfar G, Askari D, Moradi S, Mansouri Z, Pakbin M, Sandoughdaran S, Abdollahi H, Radmard AR, Rezaei‐Kalantari K, Ghelich Oghli M, Zaidi H. COLI-Net: Deep learning-assisted fully automated COVID-19 lung and infection pneumonia lesion detection and segmentation from chest computed tomography images. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY 2022; 32:12-25. [PMID: 34898850 PMCID: PMC8652855 DOI: 10.1002/ima.22672] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/10/2021] [Revised: 09/18/2021] [Accepted: 10/17/2021] [Indexed: 05/17/2023]
Abstract
We present a deep learning (DL)-based automated whole lung and COVID-19 pneumonia infectious lesions (COLI-Net) detection and segmentation from chest computed tomography (CT) images. This multicenter/multiscanner study involved 2368 (347'259 2D slices) and 190 (17 341 2D slices) volumetric CT exams along with their corresponding manual segmentation of lungs and lesions, respectively. All images were cropped, resized, and the intensity values clipped and normalized. A residual network with non-square Dice loss function built upon TensorFlow was employed. The accuracy of lung and COVID-19 lesions segmentation was evaluated on an external reverse transcription-polymerase chain reaction positive COVID-19 dataset (7'333 2D slices) collected at five different centers. To evaluate the segmentation performance, we calculated different quantitative metrics, including radiomic features. The mean Dice coefficients were 0.98 ± 0.011 (95% CI, 0.98-0.99) and 0.91 ± 0.038 (95% CI, 0.90-0.91) for lung and lesions segmentation, respectively. The mean relative Hounsfield unit differences were 0.03 ± 0.84% (95% CI, -0.12 to 0.18) and -0.18 ± 3.4% (95% CI, -0.8 to 0.44) for the lung and lesions, respectively. The relative volume difference for lung and lesions were 0.38 ± 1.2% (95% CI, 0.16-0.59) and 0.81 ± 6.6% (95% CI, -0.39 to 2), respectively. Most radiomic features had a mean relative error less than 5% with the highest mean relative error achieved for the lung for the range first-order feature (-6.95%) and least axis length shape feature (8.68%) for lesions. We developed an automated DL-guided three-dimensional whole lung and infected regions segmentation in COVID-19 patients to provide fast, consistent, robust, and human error immune framework for lung and pneumonia lesion detection and quantification.
Collapse
Affiliation(s)
- Isaac Shiri
- Division of Nuclear Medicine and Molecular ImagingGeneva University HospitalGenevaSwitzerland
| | - Hossein Arabi
- Division of Nuclear Medicine and Molecular ImagingGeneva University HospitalGenevaSwitzerland
| | - Yazdan Salimi
- Division of Nuclear Medicine and Molecular ImagingGeneva University HospitalGenevaSwitzerland
| | - Amirhossein Sanaat
- Division of Nuclear Medicine and Molecular ImagingGeneva University HospitalGenevaSwitzerland
| | - Azadeh Akhavanallaf
- Division of Nuclear Medicine and Molecular ImagingGeneva University HospitalGenevaSwitzerland
| | - Ghasem Hajianfar
- Rajaie Cardiovascular Medical and Research CenterIran University of Medical SciencesTehranIran
| | - Dariush Askari
- Department of Radiology TechnologyShahid Beheshti University of Medical SciencesTehranIran
| | - Shakiba Moradi
- Research and Development DepartmentMed Fanavaran Plus Co.KarajIran
| | - Zahra Mansouri
- Division of Nuclear Medicine and Molecular ImagingGeneva University HospitalGenevaSwitzerland
| | - Masoumeh Pakbin
- Clinical Research Development CenterQom University of Medical SciencesQomIran
| | - Saleh Sandoughdaran
- Men's Health and Reproductive Health Research CenterShahid Beheshti University of Medical SciencesTehranIran
| | - Hamid Abdollahi
- Department of Radiologic Technology, Faculty of Allied MedicineKerman University of Medical SciencesKermanIran
| | - Amir Reza Radmard
- Department of RadiologyShariati Hospital, Tehran University of Medical SciencesTehranIran
| | - Kiara Rezaei‐Kalantari
- Rajaie Cardiovascular Medical and Research CenterIran University of Medical SciencesTehranIran
| | - Mostafa Ghelich Oghli
- Research and Development DepartmentMed Fanavaran Plus Co.KarajIran
- Department of Cardiovascular SciencesKU LeuvenLeuvenBelgium
| | - Habib Zaidi
- Division of Nuclear Medicine and Molecular ImagingGeneva University HospitalGenevaSwitzerland
- Geneva University NeurocenterGeneva UniversityGenevaSwitzerland
- Department of Nuclear Medicine and Molecular ImagingUniversity of Groningen, University Medical Center GroningenGroningenNetherlands
- Department of Nuclear MedicineUniversity of Southern DenmarkOdenseDenmark
| |
Collapse
|
30
|
de Souza Filho EM, Fernandes FDA, Wiefels C, de Carvalho LND, Dos Santos TF, Dos Santos AASMD, Mesquita ET, Seixas FL, Chow BJW, Mesquita CT, Gismondi RA. Machine Learning Algorithms to Distinguish Myocardial Perfusion SPECT Polar Maps. Front Cardiovasc Med 2021; 8:741667. [PMID: 34901207 PMCID: PMC8660123 DOI: 10.3389/fcvm.2021.741667] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2021] [Accepted: 09/29/2021] [Indexed: 12/18/2022] Open
Abstract
Myocardial perfusion imaging (MPI) plays an important role in patients with suspected and documented coronary artery disease (CAD). Machine Learning (ML) algorithms have been developed for many medical applications with excellent performance. This study used ML algorithms to discern normal and abnormal gated Single Photon Emission Computed Tomography (SPECT) images. We analyzed one thousand and seven polar maps from a database of patients referred to a university hospital for clinically indicated MPI between January 2016 and December 2018. These studies were reported and evaluated by two different expert readers. The image features were extracted from a specific type of polar map segmentation based on horizontal and vertical slices. A senior expert reading was the comparator (gold standard). We used cross-validation to divide the dataset into training and testing subsets, using data augmentation in the training set, and evaluated 04 ML models. All models had accuracy >90% and area under the receiver operating characteristics curve (AUC) >0.80 except for Adaptive Boosting (AUC = 0.77), while all precision and sensitivity obtained were >96 and 92%, respectively. Random Forest had the best performance (AUC: 0.853; accuracy: 0,938; precision: 0.968; sensitivity: 0.963). ML algorithms performed very well in image classification. These models were capable of distinguishing polar maps remarkably into normal and abnormal.
Collapse
Affiliation(s)
- Erito Marques de Souza Filho
- Post-graduation in Cardiovascular Sciences, Universidade Federal Fluminense, Niterói, Rio de Janeiro, Brazil.,Department of Languages and Technologies, Universidade Federal Rural do Rio de Janeiro, Rio de Janeiro, Brazil
| | - Fernando de Amorim Fernandes
- Post-graduation in Cardiovascular Sciences, Universidade Federal Fluminense, Niterói, Rio de Janeiro, Brazil.,Department of Nuclear Medicine, Hospital Universitário Antônio Pedro/EBSERH, Universidade Federal Fluminense, Rio de Janeiro, Brazil
| | - Christiane Wiefels
- Post-graduation in Cardiovascular Sciences, Universidade Federal Fluminense, Niterói, Rio de Janeiro, Brazil.,Department of Cardiac Image, University of Ottawa Heart Institute, Ottawa, ON, Canada
| | | | - Tadeu Francisco Dos Santos
- Post-graduation in Cardiovascular Sciences, Universidade Federal Fluminense, Niterói, Rio de Janeiro, Brazil
| | | | - Evandro Tinoco Mesquita
- Post-graduation in Cardiovascular Sciences, Universidade Federal Fluminense, Niterói, Rio de Janeiro, Brazil
| | - Flávio Luiz Seixas
- Institute of Computing, Universidade Federal Fluminense, Rio de Janeiro, Brazil
| | - Benjamin J W Chow
- Department of Cardiac Image, University of Ottawa Heart Institute, Ottawa, ON, Canada
| | - Claudio Tinoco Mesquita
- Post-graduation in Cardiovascular Sciences, Universidade Federal Fluminense, Niterói, Rio de Janeiro, Brazil.,Department of Nuclear Medicine, Hospital Pró-Cardíaco, Americas Serviços Medicos, Rio de Janeiro, Brazil
| | - Ronaldo Altenburg Gismondi
- Post-graduation in Cardiovascular Sciences, Universidade Federal Fluminense, Niterói, Rio de Janeiro, Brazil
| |
Collapse
|
31
|
Garcia EV. Deep learning, another important tool for improving acquisition efficiency in SPECT MPI Imaging. J Nucl Cardiol 2021; 28:2780-2783. [PMID: 32419070 DOI: 10.1007/s12350-020-02188-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2020] [Accepted: 05/04/2020] [Indexed: 12/18/2022]
Affiliation(s)
- Ernest V Garcia
- Department of Radiology and Imaging Sciences, Emory University School of Medicine, 101 Woodruff Circle, Room 1203, Atlanta, GA, 30322, USA.
| |
Collapse
|
32
|
Deep learning-based denoising of low-dose SPECT myocardial perfusion images: quantitative assessment and clinical performance. Eur J Nucl Med Mol Imaging 2021; 49:1508-1522. [PMID: 34778929 PMCID: PMC8940834 DOI: 10.1007/s00259-021-05614-7] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2021] [Accepted: 11/01/2021] [Indexed: 11/28/2022]
Abstract
Purpose This work was set out to investigate the feasibility of dose reduction in SPECT myocardial perfusion imaging (MPI) without sacrificing diagnostic accuracy. A deep learning approach was proposed to synthesize full-dose images from the corresponding low-dose images at different dose reduction levels in the projection space. Methods Clinical SPECT-MPI images of 345 patients acquired on a dedicated cardiac SPECT camera in list-mode format were retrospectively employed to predict standard-dose from low-dose images at half-, quarter-, and one-eighth-dose levels. To simulate realistic low-dose projections, 50%, 25%, and 12.5% of the events were randomly selected from the list-mode data through applying binomial subsampling. A generative adversarial network was implemented to predict non-gated standard-dose SPECT images in the projection space at the different dose reduction levels. Well-established metrics, including peak signal-to-noise ratio (PSNR), root mean square error (RMSE), and structural similarity index metrics (SSIM) in addition to Pearson correlation coefficient analysis and clinical parameters derived from Cedars-Sinai software were used to quantitatively assess the predicted standard-dose images. For clinical evaluation, the quality of the predicted standard-dose images was evaluated by a nuclear medicine specialist using a seven-point (− 3 to + 3) grading scheme. Results The highest PSNR (42.49 ± 2.37) and SSIM (0.99 ± 0.01) and the lowest RMSE (1.99 ± 0.63) were achieved at a half-dose level. Pearson correlation coefficients were 0.997 ± 0.001, 0.994 ± 0.003, and 0.987 ± 0.004 for the predicted standard-dose images at half-, quarter-, and one-eighth-dose levels, respectively. Using the standard-dose images as reference, the Bland–Altman plots sketched for the Cedars-Sinai selected parameters exhibited remarkably less bias and variance in the predicted standard-dose images compared with the low-dose images at all reduced dose levels. Overall, considering the clinical assessment performed by a nuclear medicine specialist, 100%, 80%, and 11% of the predicted standard-dose images were clinically acceptable at half-, quarter-, and one-eighth-dose levels, respectively. Conclusion The noise was effectively suppressed by the proposed network, and the predicted standard-dose images were comparable to reference standard-dose images at half- and quarter-dose levels. However, recovery of the underlying signals/information in low-dose images beyond a quarter of the standard dose would not be feasible (due to very poor signal-to-noise ratio) which will adversely affect the clinical interpretation of the resulting images. Supplementary Information The online version contains supplementary material available at 10.1007/s00259-021-05614-7.
Collapse
|
33
|
Bouchareb Y, Moradi Khaniabadi P, Al Kindi F, Al Dhuhli H, Shiri I, Zaidi H, Rahmim A. Artificial intelligence-driven assessment of radiological images for COVID-19. Comput Biol Med 2021; 136:104665. [PMID: 34343890 PMCID: PMC8291996 DOI: 10.1016/j.compbiomed.2021.104665] [Citation(s) in RCA: 32] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2021] [Revised: 07/11/2021] [Accepted: 07/17/2021] [Indexed: 12/24/2022]
Abstract
Artificial Intelligence (AI) methods have significant potential for diagnosis and prognosis of COVID-19 infections. Rapid identification of COVID-19 and its severity in individual patients is expected to enable better control of the disease individually and at-large. There has been remarkable interest by the scientific community in using imaging biomarkers to improve detection and management of COVID-19. Exploratory tools such as AI-based models may help explain the complex biological mechanisms and provide better understanding of the underlying pathophysiological processes. The present review focuses on AI-based COVID-19 studies as applies to chest x-ray (CXR) and computed tomography (CT) imaging modalities, and the associated challenges. Explicit radiomics, deep learning methods, and hybrid methods that combine both deep learning and explicit radiomics have the potential to enhance the ability and usefulness of radiological images to assist clinicians in the current COVID-19 pandemic. The aims of this review are: first, to outline COVID-19 AI-analysis workflows, including acquisition of data, feature selection, segmentation methods, feature extraction, and multi-variate model development and validation as appropriate for AI-based COVID-19 studies. Secondly, existing limitations of AI-based COVID-19 analyses are discussed, highlighting potential improvements that can be made. Finally, the impact of AI and radiomics methods and the associated clinical outcomes are summarized. In this review, pipelines that include the key steps for AI-based COVID-19 signatures identification are elaborated. Sample size, non-standard imaging protocols, segmentation, availability of public COVID-19 databases, combination of imaging and clinical information and full clinical validation remain major limitations and challenges. We conclude that AI-based assessment of CXR and CT images has significant potential as a viable pathway for the diagnosis, follow-up and prognosis of COVID-19.
Collapse
Affiliation(s)
- Yassine Bouchareb
- Department of Radiology and Molecular Imaging, College of Medicine and Health Science, Sultan Qaboos University, PO. Box 35, Al Khod, Muscat, 123, Oman.
| | - Pegah Moradi Khaniabadi
- Department of Radiology and Molecular Imaging, College of Medicine and Health Science, Sultan Qaboos University, PO. Box 35, Al Khod, Muscat, 123, Oman.
| | | | - Humoud Al Dhuhli
- Department of Radiology and Molecular Imaging, College of Medicine and Health Science, Sultan Qaboos University, PO. Box 35, Al Khod, Muscat, 123, Oman
| | - Isaac Shiri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva 4, Switzerland
| | - Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva 4, Switzerland; Geneva University Neurocenter, Geneva University, Geneva, Switzerland; Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, Netherlands; Department of Nuclear Medicine, University of Southern Denmark, Odense, Denmark
| | - Arman Rahmim
- Departments of Radiology and Physics, University of British Columbia, Vancouver, BC, Canada; Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, Canada
| |
Collapse
|
34
|
Garcia EV. Artificial intelligence in nuclear cardiology: Preparing for the fifth industrial revolution. J Nucl Cardiol 2021; 28:1199-1202. [PMID: 34342863 DOI: 10.1007/s12350-021-02671-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2021] [Accepted: 05/05/2021] [Indexed: 01/28/2023]
Affiliation(s)
- Ernest V Garcia
- Department of Radiology and Imaging Sciences, Emory University School of Medicine, 101 Woodruff Circle, Room 1203, Atlanta, GA, 30322, USA.
| |
Collapse
|
35
|
Sanaat A, Shiri I, Arabi H, Mainta I, Nkoulou R, Zaidi H. Deep learning-assisted ultra-fast/low-dose whole-body PET/CT imaging. Eur J Nucl Med Mol Imaging 2021; 48:2405-2415. [PMID: 33495927 PMCID: PMC8241799 DOI: 10.1007/s00259-020-05167-1] [Citation(s) in RCA: 55] [Impact Index Per Article: 18.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2020] [Accepted: 12/15/2020] [Indexed: 12/21/2022]
Abstract
PURPOSE Tendency is to moderate the injected activity and/or reduce acquisition time in PET examinations to minimize potential radiation hazards and increase patient comfort. This work aims to assess the performance of regular full-dose (FD) synthesis from fast/low-dose (LD) whole-body (WB) PET images using deep learning techniques. METHODS Instead of using synthetic LD scans, two separate clinical WB 18F-Fluorodeoxyglucose (18F-FDG) PET/CT studies of 100 patients were acquired: one regular FD (~ 27 min) and one fast or LD (~ 3 min) consisting of 1/8th of the standard acquisition time. A modified cycle-consistent generative adversarial network (CycleGAN) and residual neural network (ResNET) models, denoted as CGAN and RNET, respectively, were implemented to predict FD PET images. The quality of the predicted PET images was assessed by two nuclear medicine physicians. Moreover, the diagnostic quality of the predicted PET images was evaluated using a pass/fail scheme for lesion detectability task. Quantitative analysis using established metrics including standardized uptake value (SUV) bias was performed for the liver, left/right lung, brain, and 400 malignant lesions from the test and evaluation datasets. RESULTS CGAN scored 4.92 and 3.88 (out of 5) (adequate to good) for brain and neck + trunk, respectively. The average SUV bias calculated over normal tissues was 3.39 ± 0.71% and - 3.83 ± 1.25% for CGAN and RNET, respectively. Bland-Altman analysis reported the lowest SUV bias (0.01%) and 95% confidence interval of - 0.36, + 0.47 for CGAN compared with the reference FD images for malignant lesions. CONCLUSION CycleGAN is able to synthesize clinical FD WB PET images from LD images with 1/8th of standard injected activity or acquisition time. The predicted FD images present almost similar performance in terms of lesion detectability, qualitative scores, and quantification bias and variance.
Collapse
Affiliation(s)
- Amirhossein Sanaat
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva, Switzerland
| | - Isaac Shiri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva, Switzerland
| | - Hossein Arabi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva, Switzerland
| | - Ismini Mainta
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva, Switzerland
| | - René Nkoulou
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva, Switzerland
| | - Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva, Switzerland
- Geneva University Neurocenter, Geneva University, 1205 Geneva, Switzerland
- Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, Netherlands
- Department of Nuclear Medicine, University of Southern Denmark, DK-500 Odense, Denmark
| |
Collapse
|
36
|
Murata T, Yokota H, Yamato R, Horikoshi T, Tsuneda M, Kurosawa R, Hashimoto T, Ota J, Sawada K, Iimori T, Masuda Y, Mori Y, Suyari H, Uno T. Development of attenuation correction methods using deep learning in brain-perfusion single-photon emission computed tomography. Med Phys 2021; 48:4177-4190. [PMID: 34061380 DOI: 10.1002/mp.15016] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2020] [Revised: 05/25/2021] [Accepted: 05/26/2021] [Indexed: 12/22/2022] Open
Abstract
PURPOSE Computed tomography (CT)-based attenuation correction (CTAC) in single-photon emission computed tomography (SPECT) is highly accurate, but it requires hybrid SPECT/CT instruments and additional radiation exposure. To obtain attenuation correction (AC) without the need for additional CT images, a deep learning method was used to generate pseudo-CT images has previously been reported, but it is limited because of cross-modality transformation, resulting in misalignment and modality-specific artifacts. This study aimed to develop a deep learning-based approach using non-attenuation-corrected (NAC) images and CTAC-based images for training to yield AC images in brain-perfusion SPECT. This study also investigated whether the proposed approach is superior to conventional Chang's AC (ChangAC). METHODS In total, 236 patients who underwent brain-perfusion SPECT were randomly divided into two groups: the training group (189 patients; 80%) and the test group (47 patients; 20%). Two models were constructed using Autoencoder (AutoencoderAC) and U-Net (U-NetAC), respectively. ChangAC, AutoencoderAC, and U-NetAC approaches were compared with CTAC using qualitative analysis (visual evaluation) and quantitative analysis (normalized mean squared error [NMSE] and the percentage error in each brain region). Statistical analyses were performed using the Wilcoxon signed-rank sum test and Bland-Altman analysis. RESULTS U-NetAC had the highest visual evaluation score. The NMSE results for the U-NetAC were the lowest, followed by AutoencoderAC and ChangAC (P < 0.001). Bland-Altman analysis showed a fixed bias for ChangAC and AutoencoderAC and a proportional bias for ChangAC. ChangAC underestimated counts by 30-40% in all brain regions. AutoencoderAC and U-NetAC produced mean errors of <1% and maximum errors of 3%, respectively. CONCLUSION New deep learning-based AC methods for AutoencoderAC and U-NetAC were developed. Their accuracy was higher than that obtained by ChangAC. U-NetAC exhibited higher qualitative and quantitative accuracy than AutoencoderAC. We generated highly accurate AC images directly from NAC images without the need for intermediate pseudo-CT images. To verify our models' generalizability, external validation is required.
Collapse
Affiliation(s)
- Taisuke Murata
- Department of Radiology, Chiba University Hospital, Chiba, 260-8677, Japan
| | - Hajime Yokota
- Department of Diagnostic Radiology and Radiation Oncology, Graduate School of Medicine, Chiba University, Chiba, 260-8670, Japan
| | - Ryuhei Yamato
- Graduate School of Engineering, Chiba University, Chiba, 263-8522, Japan
| | - Takuro Horikoshi
- Department of Radiology, Chiba University Hospital, Chiba, 260-8677, Japan
| | - Masato Tsuneda
- Department of Radiation Oncology, MR Linac ART Division, Graduate School of Medicine, Chiba University, Chiba, 260-8670, Japan
| | - Ryuna Kurosawa
- Department of Radiology, Chiba University Hospital, Chiba, 260-8677, Japan
| | - Takuma Hashimoto
- Department of Radiology, Chiba University Hospital, Chiba, 260-8677, Japan
| | - Joji Ota
- Department of Radiology, Chiba University Hospital, Chiba, 260-8677, Japan
| | - Koichi Sawada
- Department of Radiology, Chiba University Hospital, Chiba, 260-8677, Japan
| | - Takashi Iimori
- Department of Radiology, Chiba University Hospital, Chiba, 260-8677, Japan
| | - Yoshitada Masuda
- Department of Radiology, Chiba University Hospital, Chiba, 260-8677, Japan
| | - Yasukuni Mori
- Graduate School of Engineering, Chiba University, Chiba, 263-8522, Japan
| | - Hiroki Suyari
- Graduate School of Engineering, Chiba University, Chiba, 263-8522, Japan
| | - Takashi Uno
- Department of Diagnostic Radiology and Radiation Oncology, Graduate School of Medicine, Chiba University, Chiba, 260-8670, Japan
| |
Collapse
|
37
|
Mohammadi R, Shokatian I, Salehi M, Arabi H, Shiri I, Zaidi H. Deep learning-based auto-segmentation of organs at risk in high-dose rate brachytherapy of cervical cancer. Radiother Oncol 2021; 159:231-240. [DOI: 10.1016/j.radonc.2021.03.030] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2021] [Revised: 03/20/2021] [Accepted: 03/24/2021] [Indexed: 12/11/2022]
|
38
|
Cheng Z, Wen J, Huang G, Yan J. Applications of artificial intelligence in nuclear medicine image generation. Quant Imaging Med Surg 2021; 11:2792-2822. [PMID: 34079744 PMCID: PMC8107336 DOI: 10.21037/qims-20-1078] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2020] [Accepted: 02/14/2021] [Indexed: 12/12/2022]
Abstract
Recently, the application of artificial intelligence (AI) in medical imaging (including nuclear medicine imaging) has rapidly developed. Most AI applications in nuclear medicine imaging have focused on the diagnosis, treatment monitoring, and correlation analyses with pathology or specific gene mutation. It can also be used for image generation to shorten the time of image acquisition, reduce the dose of injected tracer, and enhance image quality. This work provides an overview of the application of AI in image generation for single-photon emission computed tomography (SPECT) and positron emission tomography (PET) either without or with anatomical information [CT or magnetic resonance imaging (MRI)]. This review focused on four aspects, including imaging physics, image reconstruction, image postprocessing, and internal dosimetry. AI application in generating attenuation map, estimating scatter events, boosting image quality, and predicting internal dose map is summarized and discussed.
Collapse
Affiliation(s)
- Zhibiao Cheng
- Department of Biomedical Engineering, School of Life Science, Beijing Institute of Technology, Beijing, China
| | - Junhai Wen
- Department of Biomedical Engineering, School of Life Science, Beijing Institute of Technology, Beijing, China
| | - Gang Huang
- Shanghai Key Laboratory of Molecular Imaging, Shanghai University of Medicine and Health Sciences, Shanghai, China
| | - Jianhua Yan
- Shanghai Key Laboratory of Molecular Imaging, Shanghai University of Medicine and Health Sciences, Shanghai, China
| |
Collapse
|
39
|
Jha AK, Mithun S, Rangarajan V, Wee L, Dekker A. Emerging role of artificial intelligence in nuclear medicine. Nucl Med Commun 2021; 42:592-601. [PMID: 33660696 DOI: 10.1097/mnm.0000000000001381] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
The role of artificial intelligence is increasing in all branches of medicine. The emerging role of artificial intelligence applications in nuclear medicine is going to improve the nuclear medicine clinical workflow in the coming years. Initial research outcomes are suggestive of increasing role of artificial intelligence in nuclear medicine workflow, particularly where selective automation tasks are of concern. Artificial intelligence-assisted planning, dosimetry and procedure execution appear to be areas for rapid and significant development. The role of artificial intelligence in more directly imaging-related tasks, such as dose optimization, image corrections and image reconstruction, have been particularly strong points of artificial intelligence research in nuclear medicine. Natural Language Processing (NLP)-based text processing task is another area of interest of artificial intelligence implementation in nuclear medicine.
Collapse
Affiliation(s)
- Ashish Kumar Jha
- Department of Radiation Oncology (Maastro), GROW School for Oncology, Maastricht University Medical Centre, Maastricht, The Netherlands
- Department of Nuclear Medicine and Molecular Imaging, Tata Memorial Hospital
| | - Sneha Mithun
- Department of Radiation Oncology (Maastro), GROW School for Oncology, Maastricht University Medical Centre, Maastricht, The Netherlands
- Department of Nuclear Medicine and Molecular Imaging, Tata Memorial Hospital
- Homi Bhabha National Institute (HBNI), Deemed University, Mumbai, India
| | - Venkatesh Rangarajan
- Department of Nuclear Medicine and Molecular Imaging, Tata Memorial Hospital
- Homi Bhabha National Institute (HBNI), Deemed University, Mumbai, India
| | - Leonard Wee
- Department of Radiation Oncology (Maastro), GROW School for Oncology, Maastricht University Medical Centre, Maastricht, The Netherlands
| | - Andre Dekker
- Department of Radiation Oncology (Maastro), GROW School for Oncology, Maastricht University Medical Centre, Maastricht, The Netherlands
| |
Collapse
|
40
|
Slart RHJA, Williams MC, Juarez-Orozco LE, Rischpler C, Dweck MR, Glaudemans AWJM, Gimelli A, Georgoulias P, Gheysens O, Gaemperli O, Habib G, Hustinx R, Cosyns B, Verberne HJ, Hyafil F, Erba PA, Lubberink M, Slomka P, Išgum I, Visvikis D, Kolossváry M, Saraste A. Position paper of the EACVI and EANM on artificial intelligence applications in multimodality cardiovascular imaging using SPECT/CT, PET/CT, and cardiac CT. Eur J Nucl Med Mol Imaging 2021; 48:1399-1413. [PMID: 33864509 PMCID: PMC8113178 DOI: 10.1007/s00259-021-05341-z] [Citation(s) in RCA: 41] [Impact Index Per Article: 13.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Accepted: 03/25/2021] [Indexed: 12/18/2022]
Abstract
In daily clinical practice, clinicians integrate available data to ascertain the diagnostic and prognostic probability of a disease or clinical outcome for their patients. For patients with suspected or known cardiovascular disease, several anatomical and functional imaging techniques are commonly performed to aid this endeavor, including coronary computed tomography angiography (CCTA) and nuclear cardiology imaging. Continuous improvement in positron emission tomography (PET), single-photon emission computed tomography (SPECT), and CT hardware and software has resulted in improved diagnostic performance and wide implementation of these imaging techniques in daily clinical practice. However, the human ability to interpret, quantify, and integrate these data sets is limited. The identification of novel markers and application of machine learning (ML) algorithms, including deep learning (DL) to cardiovascular imaging techniques will further improve diagnosis and prognostication for patients with cardiovascular diseases. The goal of this position paper of the European Association of Nuclear Medicine (EANM) and the European Association of Cardiovascular Imaging (EACVI) is to provide an overview of the general concepts behind modern machine learning-based artificial intelligence, highlights currently prefered methods, practices, and computational models, and proposes new strategies to support the clinical application of ML in the field of cardiovascular imaging using nuclear cardiology (hybrid) and CT techniques.
Collapse
Affiliation(s)
- Riemer H J A Slart
- Medical Imaging Centre, Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Hanzeplein 1, PO 9700 RB, Groningen, The Netherlands.
- Faculty of Science and Technology Biomedical, Photonic Imaging, University of Twente, Enschede, The Netherlands.
| | - Michelle C Williams
- British Heart Foundation Centre for Cardiovascular Science, University of Edinburgh, Edinburgh, UK
- Edinburgh Imaging facility QMRI, Edinburgh, UK
| | - Luis Eduardo Juarez-Orozco
- Department of Cardiology, Division Heart & Lungs, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands
- University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Christoph Rischpler
- Department of Nuclear Medicine, University Hospital Essen, University of Duisburg-Essen, Essen, Germany
| | - Marc R Dweck
- British Heart Foundation Centre for Cardiovascular Science, University of Edinburgh, Edinburgh, UK
- Edinburgh Imaging facility QMRI, Edinburgh, UK
| | - Andor W J M Glaudemans
- Medical Imaging Centre, Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Hanzeplein 1, PO 9700 RB, Groningen, The Netherlands
| | | | - Panagiotis Georgoulias
- Department of Nuclear Medicine, Faculty of Medicine, University of Thessaly, University Hospital of Larissa, Larissa, Greece
| | - Olivier Gheysens
- Department of Nuclear Medicine, Cliniques Universitaires Saint-Luc and Institute of Clinical and Experimental Research (IREC), Université catholique de Louvain (UCLouvain), Brussels, Belgium
| | | | - Gilbert Habib
- APHM, Cardiology Department, La Timone Hospital, Marseille, France
- IRD, APHM, MEPHI, IHU-Méditerranée Infection, Aix Marseille Université, Marseille, France
| | - Roland Hustinx
- Division of Nuclear Medicine and Oncological Imaging, Department of Medical Physics, ULiège, Liège, Belgium
| | - Bernard Cosyns
- Department of Cardiology, Centrum voor Hart en Vaatziekten, Universitair Ziekenhuis Brussel, 101 Laarbeeklaan, 1090, Brussels, Belgium
| | - Hein J Verberne
- Department of Radiology and Nuclear Medicine, Amsterdam UMC, location AMC, University of Amsterdam, Amsterdam, The Netherlands
| | - Fabien Hyafil
- Department of Nuclear Medicine, DMU IMAGINA, Georges-Pompidou European Hospital, Assistance Publique - Hôpitaux de Paris, F-75015, Paris, France
- University of Paris, PARCC, INSERM, F-75006, Paris, France
| | - Paola A Erba
- Medical Imaging Centre, Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Hanzeplein 1, PO 9700 RB, Groningen, The Netherlands
- Department of Nuclear Medicine (P.A.E.), University of Pisa, Pisa, Italy
- Department of Translational Research and New Technology in Medicine (P.A.E.), University of Pisa, Pisa, Italy
| | - Mark Lubberink
- Department of Surgical Sciences/Radiology, Uppsala University, Uppsala, Sweden
- Medical Physics, Uppsala University Hospital, Uppsala, Sweden
| | - Piotr Slomka
- Department of Imaging, Medicine, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Ivana Išgum
- Department of Radiology and Nuclear Medicine, Amsterdam UMC, location AMC, University of Amsterdam, Amsterdam, The Netherlands
- Department of Biomedical Engineering and Physics, Amsterdam UMC - location AMC, University of Amsterdam, 1105, Amsterdam, AZ, Netherlands
| | | | - Márton Kolossváry
- MTA-SE Cardiovascular Imaging Research Group, Heart and Vascular Center, Semmelweis University, 68 Városmajor Street, Budapest, Hungary
| | - Antti Saraste
- Turku PET Centre, Turku University Hospital, University of Turku, Turku, Finland
- Heart Center, Turku University Hospital, Turku, Finland
| |
Collapse
|
41
|
Shao W, Rowe SP, Du Y. Artificial intelligence in single photon emission computed tomography (SPECT) imaging: a narrative review. ANNALS OF TRANSLATIONAL MEDICINE 2021; 9:820. [PMID: 34268433 PMCID: PMC8246162 DOI: 10.21037/atm-20-5988] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/20/2020] [Accepted: 01/08/2021] [Indexed: 12/26/2022]
Abstract
Artificial intelligence (AI) has been widely applied to medical imaging. The use of AI for emission computed tomography, particularly single-photon emission computed tomography (SPECT) emerged nearly 30 years ago but has been accelerated in recent years due to the development of AI technology. In this review, we will describe and discuss the progress of AI technology in SPECT imaging. The applications of AI are dispersed in disease prediction and diagnosis, post-reconstruction image denoising, attenuation map generation, and image reconstruction. These applications are relevant to many disease categories such as the neurological disorders, kidney failure, cancer, heart disease, etc. This review summarizes these applications so that SPECT researchers can have a reference overview of the role of AI in current SPECT studies. For each application, we followed the timeline to present the evolution of AI’s usage and offered insights on how AI was combined with the knowledge of underlying physics as well as traditional non-learning techniques. Ultimately, AI applications are critical to the progress of modern SPECT technology because they provide compensations for many deficiencies in conventional SPECT imaging methods and demonstrate unparalleled success. Nonetheless, AI also has its own challenges and limitations in the medical field, including SPECT imaging. These fundamental questions are discussed, and possible future directions and countermeasures are suggested.
Collapse
Affiliation(s)
- Wenyi Shao
- Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD 21287, USA
| | - Steven P Rowe
- Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD 21287, USA
| | - Yong Du
- Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD 21287, USA
| |
Collapse
|
42
|
Zaidi H, El Naqa I. Quantitative Molecular Positron Emission Tomography Imaging Using Advanced Deep Learning Techniques. Annu Rev Biomed Eng 2021; 23:249-276. [PMID: 33797938 DOI: 10.1146/annurev-bioeng-082420-020343] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The widespread availability of high-performance computing and the popularity of artificial intelligence (AI) with machine learning and deep learning (ML/DL) algorithms at the helm have stimulated the development of many applications involving the use of AI-based techniques in molecular imaging research. Applications reported in the literature encompass various areas, including innovative design concepts in positron emission tomography (PET) instrumentation, quantitative image reconstruction and analysis techniques, computer-aided detection and diagnosis, as well as modeling and prediction of outcomes. This review reflects the tremendous interest in quantitative molecular imaging using ML/DL techniques during the past decade, ranging from the basic principles of ML/DL techniques to the various steps required for obtaining quantitatively accurate PET data, including algorithms used to denoise or correct for physical degrading factors as well as to quantify tracer uptake and metabolic tumor volume for treatment monitoring or radiation therapy treatment planning and response prediction.This review also addresses future opportunities and current challenges facing the adoption of ML/DL approaches and their role in multimodality imaging.
Collapse
Affiliation(s)
- Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, 1211 Geneva, Switzerland; .,Geneva Neuroscience Centre, University of Geneva, 1205 Geneva, Switzerland.,Department of Nuclear Medicine and Molecular Imaging, University of Groningen, 9700 RB Groningen, Netherlands.,Department of Nuclear Medicine, University of Southern Denmark, DK-5000 Odense, Denmark
| | - Issam El Naqa
- Department of Machine Learning, Moffitt Cancer Center, Tampa, Florida 33612, USA.,Department of Radiation Oncology, University of Michigan, Ann Arbor, Michigan 48109, USA.,Department of Oncology, McGill University, Montreal, Quebec H3A 1G5, Canada
| |
Collapse
|
43
|
Arabi H, AkhavanAllaf A, Sanaat A, Shiri I, Zaidi H. The promise of artificial intelligence and deep learning in PET and SPECT imaging. Phys Med 2021; 83:122-137. [DOI: 10.1016/j.ejmp.2021.03.008] [Citation(s) in RCA: 84] [Impact Index Per Article: 28.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/27/2020] [Revised: 02/18/2021] [Accepted: 03/03/2021] [Indexed: 02/06/2023] Open
|
44
|
Shiri I, Akhavanallaf A, Sanaat A, Salimi Y, Askari D, Mansouri Z, Shayesteh SP, Hasanian M, Rezaei-Kalantari K, Salahshour A, Sandoughdaran S, Abdollahi H, Arabi H, Zaidi H. Ultra-low-dose chest CT imaging of COVID-19 patients using a deep residual neural network. Eur Radiol 2021; 31:1420-1431. [PMID: 32879987 PMCID: PMC7467843 DOI: 10.1007/s00330-020-07225-6] [Citation(s) in RCA: 40] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2020] [Revised: 08/13/2020] [Accepted: 08/21/2020] [Indexed: 02/07/2023]
Abstract
OBJECTIVES The current study aimed to design an ultra-low-dose CT examination protocol using a deep learning approach suitable for clinical diagnosis of COVID-19 patients. METHODS In this study, 800, 170, and 171 pairs of ultra-low-dose and full-dose CT images were used as input/output as training, test, and external validation set, respectively, to implement the full-dose prediction technique. A residual convolutional neural network was applied to generate full-dose from ultra-low-dose CT images. The quality of predicted CT images was assessed using root mean square error (RMSE), structural similarity index (SSIM), and peak signal-to-noise ratio (PSNR). Scores ranging from 1 to 5 were assigned reflecting subjective assessment of image quality and related COVID-19 features, including ground glass opacities (GGO), crazy paving (CP), consolidation (CS), nodular infiltrates (NI), bronchovascular thickening (BVT), and pleural effusion (PE). RESULTS The radiation dose in terms of CT dose index (CTDIvol) was reduced by up to 89%. The RMSE decreased from 0.16 ± 0.05 to 0.09 ± 0.02 and from 0.16 ± 0.06 to 0.08 ± 0.02 for the predicted compared with ultra-low-dose CT images in the test and external validation set, respectively. The overall scoring assigned by radiologists showed an acceptance rate of 4.72 ± 0.57 out of 5 for reference full-dose CT images, while ultra-low-dose CT images rated 2.78 ± 0.9. The predicted CT images using the deep learning algorithm achieved a score of 4.42 ± 0.8. CONCLUSIONS The results demonstrated that the deep learning algorithm is capable of predicting standard full-dose CT images with acceptable quality for the clinical diagnosis of COVID-19 positive patients with substantial radiation dose reduction. KEY POINTS • Ultra-low-dose CT imaging of COVID-19 patients would result in the loss of critical information about lesion types, which could potentially affect clinical diagnosis. • Deep learning-based prediction of full-dose from ultra-low-dose CT images for the diagnosis of COVID-19 could reduce the radiation dose by up to 89%. • Deep learning algorithms failed to recover the correct lesion structure/density for a number of patients considered outliers, and as such, further research and development is warranted to address these limitations.
Collapse
Affiliation(s)
- Isaac Shiri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva, Switzerland
| | - Azadeh Akhavanallaf
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva, Switzerland
| | - Amirhossein Sanaat
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva, Switzerland
| | - Yazdan Salimi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva, Switzerland
| | - Dariush Askari
- Department of Radiology Technology, Shahid Beheshti University of Medical, Tehran, Iran
| | - Zahra Mansouri
- Department of Biomedical Engineering and Medical Physics, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Sajad P Shayesteh
- Department of Physiology, Pharmacology and Medical Physics, Alborz University of Medical Sciences, Karaj, Iran
| | - Mohammad Hasanian
- Department of Radiology, Arak University of Medical Sciences, Arak, Iran
| | - Kiara Rezaei-Kalantari
- Rajaie Cardiovascular, Medical & Research Center, Iran University of Medical Science, Tehran, Iran
| | - Ali Salahshour
- Department of Radiology, Alborz University of Medical Sciences, Karaj, Iran
| | - Saleh Sandoughdaran
- Department of Radiation Oncology, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Hamid Abdollahi
- Department of Radiologic Sciences and Medical Physics, Faculty of Allied Medicine, Kerman University of Medical sciences, Kerman, Iran
| | - Hossein Arabi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva, Switzerland
| | - Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva, Switzerland.
- Geneva University Neurocenter, Geneva University, CH-1205, Geneva, Switzerland.
- Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, Netherlands.
- Department of Nuclear Medicine, University of Southern Denmark, Odense, Denmark.
| |
Collapse
|
45
|
Slomka PJ, Moody JB, Miller RJH, Renaud JM, Ficaro EP, Garcia EV. Quantitative clinical nuclear cardiology, part 2: Evolving/emerging applications. J Nucl Cardiol 2021; 28:115-127. [PMID: 33067750 DOI: 10.1007/s12350-020-02337-4] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2020] [Accepted: 07/28/2020] [Indexed: 02/07/2023]
Abstract
Quantitative analysis has been applied extensively to image processing and interpretation in nuclear cardiology to improve disease diagnosis and risk stratification. This is Part 2 of a two-part continuing medical education article, which will review the potential clinical role for emerging quantitative analysis tools. The article will describe advanced methods for quantifying dyssynchrony, ventricular function and perfusion, and hybrid imaging analysis. This article discusses evolving methods to measure myocardial blood flow with positron emission tomography and single-photon emission computed tomography. Novel quantitative assessments of myocardial viability, microcalcification and in patients with cardiac sarcoidosis and cardiac amyloidosis will also be described. Lastly, we will review the potential role for artificial intelligence to improve image analysis, disease diagnosis, and risk prediction. The potential clinical role for all these novel techniques will be highlighted as well as methods to optimize their implementation.
Collapse
Affiliation(s)
- Piotr J Slomka
- Department of Imaging (Division of Nuclear Medicine), Medicine, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
| | | | - Robert J H Miller
- Department of Imaging (Division of Nuclear Medicine), Medicine, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, CA, USA
- Department of Cardiac Sciences, University of Calgary, Calgary, AB, Canada
| | | | - Edward P Ficaro
- INVIA Medical Imaging Solutions, Ann Arbor, MI, USA
- Division of Cardiology, Department of Internal Medicine, University of Michigan, Ann Arbor, MI, USA
| | - Ernest V Garcia
- Department of Radiology and Imaging Sciences, Emory University, Atlanta, GA, USA
| |
Collapse
|
46
|
Slomka PJ, Moody JB, Miller RJH, Renaud JM, Ficaro EP, Garcia EV. Quantitative clinical nuclear cardiology, part 2: Evolving/emerging applications. J Nucl Med 2020; 62:168-176. [PMID: 33067339 DOI: 10.2967/jnumed.120.242537] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2020] [Accepted: 07/28/2020] [Indexed: 01/15/2023] Open
Abstract
Quantitative analysis has been applied extensively to image processing and interpretation in nuclear cardiology to improve disease diagnosis and risk stratification. This is Part 2 of a two-part continuing medical education article, which will review the potential clinical role for emerging quantitative analysis tools. The article will describe advanced methods for quantifying dyssynchrony, ventricular function and perfusion, and hybrid imaging analysis. This article discusses evolving methods to measure myocardial blood flow with positron emission tomography and single-photon emission computed tomography. Novel quantitative assessments of myocardial viability, microcalcification and in patients with cardiac sarcoidosis and cardiac amyloidosis will also be described. Lastly, we will review the potential role for artificial intelligence to improve image analysis, disease diagnosis, and risk prediction. The potential clinical role for all these novel techniques will be highlighted as well as methods to optimize their implementation. (J Nucl Cardiol 2020).
Collapse
Affiliation(s)
- Piotr J Slomka
- Department of Imaging (Division of Nuclear Medicine), Medicine, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, CA
| | | | - Robert J H Miller
- Department of Imaging (Division of Nuclear Medicine), Medicine, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, CA.,Department of Cardiac Sciences, University of Calgary, Calgary, AB, Canada
| | | | - Edward P Ficaro
- INVIA Medical Imaging Solutions, Ann Arbor, MI.,Division of Cardiology, Department of Internal Medicine, University of Michigan, Ann Arbor, MI; and
| | - Ernest V Garcia
- Department of Radiology and Imaging Sciences, Emory University, Atlanta, GA
| |
Collapse
|
47
|
Arabi H, Zaidi H. Applications of artificial intelligence and deep learning in molecular imaging and radiotherapy. Eur J Hybrid Imaging 2020; 4:17. [PMID: 34191161 PMCID: PMC8218135 DOI: 10.1186/s41824-020-00086-8] [Citation(s) in RCA: 45] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2020] [Accepted: 08/10/2020] [Indexed: 12/22/2022] Open
Abstract
This brief review summarizes the major applications of artificial intelligence (AI), in particular deep learning approaches, in molecular imaging and radiation therapy research. To this end, the applications of artificial intelligence in five generic fields of molecular imaging and radiation therapy, including PET instrumentation design, PET image reconstruction quantification and segmentation, image denoising (low-dose imaging), radiation dosimetry and computer-aided diagnosis, and outcome prediction are discussed. This review sets out to cover briefly the fundamental concepts of AI and deep learning followed by a presentation of seminal achievements and the challenges facing their adoption in clinical setting.
Collapse
Affiliation(s)
- Hossein Arabi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva 4, Switzerland
| | - Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva 4, Switzerland.
- Geneva University Neurocenter, Geneva University, CH-1205, Geneva, Switzerland.
- Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, 9700, Groningen, RB, Netherlands.
- Department of Nuclear Medicine, University of Southern Denmark, 500, Odense, Denmark.
| |
Collapse
|
48
|
Whole-body voxel-based internal dosimetry using deep learning. Eur J Nucl Med Mol Imaging 2020; 48:670-682. [PMID: 32875430 PMCID: PMC8036208 DOI: 10.1007/s00259-020-05013-4] [Citation(s) in RCA: 34] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2020] [Accepted: 08/23/2020] [Indexed: 12/20/2022]
Abstract
Purpose In the era of precision medicine, patient-specific dose calculation using Monte Carlo (MC) simulations is deemed the gold standard technique for risk-benefit analysis of radiation hazards and correlation with patient outcome. Hence, we propose a novel method to perform whole-body personalized organ-level dosimetry taking into account the heterogeneity of activity distribution, non-uniformity of surrounding medium, and patient-specific anatomy using deep learning algorithms. Methods We extended the voxel-scale MIRD approach from single S-value kernel to specific S-value kernels corresponding to patient-specific anatomy to construct 3D dose maps using hybrid emission/transmission image sets. In this context, we employed a Deep Neural Network (DNN) to predict the distribution of deposited energy, representing specific S-values, from a single source in the center of a 3D kernel composed of human body geometry. The training dataset consists of density maps obtained from CT images and the reference voxelwise S-values generated using Monte Carlo simulations. Accordingly, specific S-value kernels are inferred from the trained model and whole-body dose maps constructed in a manner analogous to the voxel-based MIRD formalism, i.e., convolving specific voxel S-values with the activity map. The dose map predicted using the DNN was compared with the reference generated using MC simulations and two MIRD-based methods, including Single and Multiple S-Values (SSV and MSV) and Olinda/EXM software package. Results The predicted specific voxel S-value kernels exhibited good agreement with the MC-based kernels serving as reference with a mean relative absolute error (MRAE) of 4.5 ± 1.8 (%). Bland and Altman analysis showed the lowest dose bias (2.6%) and smallest variance (CI: − 6.6, + 1.3) for DNN. The MRAE of estimated absorbed dose between DNN, MSV, and SSV with respect to the MC simulation reference were 2.6%, 3%, and 49%, respectively. In organ-level dosimetry, the MRAE between the proposed method and MSV, SSV, and Olinda/EXM were 5.1%, 21.8%, and 23.5%, respectively. Conclusion The proposed DNN-based WB internal dosimetry exhibited comparable performance to the direct Monte Carlo approach while overcoming the limitations of conventional dosimetry techniques in nuclear medicine.
Collapse
|