1
|
Hashimoto F, Onishi Y, Ote K, Tashima H, Yamaya T. Fully 3D implementation of the end-to-end deep image prior-based PET image reconstruction using block iterative algorithm. Phys Med Biol 2023; 68:155009. [PMID: 37406637 DOI: 10.1088/1361-6560/ace49c] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Accepted: 07/05/2023] [Indexed: 07/07/2023]
Abstract
Objective. Deep image prior (DIP) has recently attracted attention owing to its unsupervised positron emission tomography (PET) image reconstruction method, which does not require any prior training dataset. In this paper, we present the first attempt to implement an end-to-end DIP-based fully 3D PET image reconstruction method that incorporates a forward-projection model into a loss function.Approach. A practical implementation of a fully 3D PET image reconstruction could not be performed at present because of a graphics processing unit memory limitation. Consequently, we modify the DIP optimization to a block iteration and sequential learning of an ordered sequence of block sinograms. Furthermore, the relative difference penalty (RDP) term is added to the loss function to enhance the quantitative accuracy of the PET image.Main results. We evaluated our proposed method using Monte Carlo simulation with [18F]FDG PET data of a human brain and a preclinical study on monkey-brain [18F]FDG PET data. The proposed method was compared with the maximum-likelihood expectation maximization (EM), maximuma posterioriEM with RDP, and hybrid DIP-based PET reconstruction methods. The simulation results showed that, compared with other algorithms, the proposed method improved the PET image quality by reducing statistical noise and better preserved the contrast of brain structures and inserted tumors. In the preclinical experiment, finer structures and better contrast recovery were obtained with the proposed method.Significance.The results indicated that the proposed method could produce high-quality images without a prior training dataset. Thus, the proposed method could be a key enabling technology for the straightforward and practical implementation of end-to-end DIP-based fully 3D PET image reconstruction.
Collapse
Affiliation(s)
- Fumio Hashimoto
- Central Research Laboratory, Hamamatsu Photonics K. K., 5000 Hirakuchi, Hamakita-ku, Hamamatsu 434-8601, Japan
- Graduate School of Science and Engineering, Chiba University, 1-33, Yayoicho, Inage-ku, Chiba, 263-8522, Japan
- National Institutes for Quantum Science and Technology, 4-9-1, Anagawa, Inage-ku, Chiba, 263-8555, Japan
| | - Yuya Onishi
- Central Research Laboratory, Hamamatsu Photonics K. K., 5000 Hirakuchi, Hamakita-ku, Hamamatsu 434-8601, Japan
| | - Kibo Ote
- Central Research Laboratory, Hamamatsu Photonics K. K., 5000 Hirakuchi, Hamakita-ku, Hamamatsu 434-8601, Japan
| | - Hideaki Tashima
- National Institutes for Quantum Science and Technology, 4-9-1, Anagawa, Inage-ku, Chiba, 263-8555, Japan
| | - Taiga Yamaya
- Graduate School of Science and Engineering, Chiba University, 1-33, Yayoicho, Inage-ku, Chiba, 263-8522, Japan
- National Institutes for Quantum Science and Technology, 4-9-1, Anagawa, Inage-ku, Chiba, 263-8555, Japan
| |
Collapse
|
2
|
Zhang YD, Dong Z, Wang SH, Yu X, Yao X, Zhou Q, Hu H, Li M, Jiménez-Mesa C, Ramirez J, Martinez FJ, Gorriz JM. Advances in multimodal data fusion in neuroimaging: Overview, challenges, and novel orientation. AN INTERNATIONAL JOURNAL ON INFORMATION FUSION 2020; 64:149-187. [PMID: 32834795 PMCID: PMC7366126 DOI: 10.1016/j.inffus.2020.07.006] [Citation(s) in RCA: 115] [Impact Index Per Article: 28.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/30/2020] [Revised: 07/06/2020] [Accepted: 07/14/2020] [Indexed: 05/13/2023]
Abstract
Multimodal fusion in neuroimaging combines data from multiple imaging modalities to overcome the fundamental limitations of individual modalities. Neuroimaging fusion can achieve higher temporal and spatial resolution, enhance contrast, correct imaging distortions, and bridge physiological and cognitive information. In this study, we analyzed over 450 references from PubMed, Google Scholar, IEEE, ScienceDirect, Web of Science, and various sources published from 1978 to 2020. We provide a review that encompasses (1) an overview of current challenges in multimodal fusion (2) the current medical applications of fusion for specific neurological diseases, (3) strengths and limitations of available imaging modalities, (4) fundamental fusion rules, (5) fusion quality assessment methods, and (6) the applications of fusion for atlas-based segmentation and quantification. Overall, multimodal fusion shows significant benefits in clinical diagnosis and neuroscience research. Widespread education and further research amongst engineers, researchers and clinicians will benefit the field of multimodal neuroimaging.
Collapse
Affiliation(s)
- Yu-Dong Zhang
- School of Informatics, University of Leicester, Leicester, LE1 7RH, Leicestershire, UK
- Department of Information Systems, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Zhengchao Dong
- Department of Psychiatry, Columbia University, USA
- New York State Psychiatric Institute, New York, NY 10032, USA
| | - Shui-Hua Wang
- Department of Information Systems, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia
- School of Architecture Building and Civil engineering, Loughborough University, Loughborough, LE11 3TU, UK
- School of Mathematics and Actuarial Science, University of Leicester, LE1 7RH, UK
| | - Xiang Yu
- School of Informatics, University of Leicester, Leicester, LE1 7RH, Leicestershire, UK
| | - Xujing Yao
- School of Informatics, University of Leicester, Leicester, LE1 7RH, Leicestershire, UK
| | - Qinghua Zhou
- School of Informatics, University of Leicester, Leicester, LE1 7RH, Leicestershire, UK
| | - Hua Hu
- Department of Psychiatry, Columbia University, USA
- Department of Neurology, The Second Affiliated Hospital of Soochow University, China
| | - Min Li
- Department of Psychiatry, Columbia University, USA
- School of Internet of Things, Hohai University, Changzhou, China
| | - Carmen Jiménez-Mesa
- Department of Signal Theory, Networking and Communications, University of Granada, Granada, Spain
| | - Javier Ramirez
- Department of Signal Theory, Networking and Communications, University of Granada, Granada, Spain
| | - Francisco J Martinez
- Department of Signal Theory, Networking and Communications, University of Granada, Granada, Spain
| | - Juan Manuel Gorriz
- Department of Signal Theory, Networking and Communications, University of Granada, Granada, Spain
- Department of Psychiatry, University of Cambridge, Cambridge CB21TN, UK
| |
Collapse
|
3
|
137Cs transmission imaging and segmented attenuation corrections in a small animal PET scanner. Radiol Phys Technol 2017; 10:321-330. [DOI: 10.1007/s12194-017-0407-4] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2017] [Revised: 07/01/2017] [Accepted: 07/03/2017] [Indexed: 10/19/2022]
|
4
|
Ibaraki M, Matsubara K, Sato K, Mizuta T, Kinoshita T. Validation of a simplified scatter correction method for 3D brain PET with 15O. Ann Nucl Med 2016; 30:690-698. [PMID: 27534771 PMCID: PMC5108829 DOI: 10.1007/s12149-016-1114-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2016] [Accepted: 08/09/2016] [Indexed: 12/04/2022]
Abstract
Objective Positron emission tomography (PET) enables quantitative measurements of various biological functions. Accuracy in data acquisition and processing schemes is a prerequisite for this. The correction of scatter is especially important when a 3D PET scanner is used. The aim of this study was to validate the use of a simplified calculation-based scatter correction method for 15O studies in the brain. Methods We applied two scatter correction methods to the same 15O PET data acquired from patients with cerebrovascular disease (n = 10): a hybrid dual-energy-window scatter correction (reference method), and a deconvolution scatter correction (simplified method). The PET study included three sequential scans for 15O-CO, 15O-O2, and 15O-H2O, from which the following quantitative parameters were calculated, cerebral blood flow, cerebral blood volume, cerebral metabolic rate of oxygen, and oxygen extraction fraction. Results Both scatter correction methods provided similar reconstruction images with almost identical image noise, although there were slightly greater differences in white-matter regions compared with gray matter regions. These differences were also greater for 15O-CO than for 15O-H2O and 15O-O2. Region of interest analysis of the quantitative parameters demonstrated that the differences were less than 10 % (except for cerebral blood volume in white-matter regions), and the agreement between the methods was excellent, with intraclass correlation coefficients above 0.95 for all the parameters. Conclusions The deconvolution scatter correction despite its simplified implementation provided similar results to the hybrid dual-energy-window scatter correction. We consider it suitable for application in a clinical 15O brain study using a 3D PET scanner.
Collapse
Affiliation(s)
- Masanobu Ibaraki
- Department of Radiology and Nuclear Medicine, Akita Research Institute of Brain and Blood Vessels, 6-10 Senshu-Kubota Machi, Akita, 010-0874, Japan.
| | - Keisuke Matsubara
- Department of Radiology and Nuclear Medicine, Akita Research Institute of Brain and Blood Vessels, 6-10 Senshu-Kubota Machi, Akita, 010-0874, Japan
| | - Kaoru Sato
- Department of Radiology and Nuclear Medicine, Akita Research Institute of Brain and Blood Vessels, 6-10 Senshu-Kubota Machi, Akita, 010-0874, Japan
| | - Tetsuro Mizuta
- Medical System Division, Shimadzu Corporation, Kyoto, Japan
| | - Toshibumi Kinoshita
- Department of Radiology and Nuclear Medicine, Akita Research Institute of Brain and Blood Vessels, 6-10 Senshu-Kubota Machi, Akita, 010-0874, Japan
| |
Collapse
|
5
|
Estrada S, Lubberink M, Thibblin A, Sprycha M, Buchanan T, Mestdagh N, Kenda B, Mercier J, Provins L, Gillard M, Tytgat D, Antoni G. [(11)C]UCB-A, a novel PET tracer for synaptic vesicle protein 2A. Nucl Med Biol 2016; 43:325-32. [PMID: 27260773 DOI: 10.1016/j.nucmedbio.2016.03.004] [Citation(s) in RCA: 47] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2015] [Revised: 02/19/2016] [Accepted: 03/15/2016] [Indexed: 01/16/2023]
Abstract
INTRODUCTION Development of a selective and specific high affinity PET tracer, [(11)C]UCB-A, for the in vivo study of SV2A expression in humans. Radiochemistry and preclinical studies in rats and pigs including development of a tracer kinetic model to determine VT. A method for the measurement of percent intact tracer in plasma was developed and the radiation dosimetry was determined in rats. RESULTS 3-5GBq of [(11)C]UCB-A could be produced with radiochemical purity exceeding 98% with a specific radioactivity of around 65GBq/μmol. In vitro binding showed high selective binding towards SV2A. [(11)C]UCB-A displayed a dose-dependent and reversible binding to SV2A as measured with PET in rats and pigs and the VT could be determined by Logan analysis. The dosimetry was favorable and low enough to allow multiple administrations of [(11)C]UCB-A to healthy volunteers, and the metabolite analysis showed no sign of labeled metabolites in brain. CONCLUSIONS We have developed the novel PET tracer, [(11)C]UCB-A, that can be used to measure SV2A expression in vivo. The dosimetry allows up to 5 administrations of 400MBq of [(11)C]UCB-A in humans. Apart from measuring drug occupancy, as we have shown, the tracer can potentially be used to compare SV2A expression between individuals because of the rather narrow range of baseline VT values. This will have to be further validated in human studies.
Collapse
Affiliation(s)
- Sergio Estrada
- Preclinical PET platform, Uppsala University, Uppsala, Sweden
| | - Mark Lubberink
- Nuclear Medicine & PET, Uppsala University, Uppsala, Sweden; Medical Physics, Uppsala University Hospital, Uppsala, Sweden
| | - Alf Thibblin
- Nuclear Medicine & PET, Uppsala University, Uppsala, Sweden; PET Centre, Uppsala University Hospital, Uppsala, Sweden
| | | | | | | | | | | | | | | | | | - Gunnar Antoni
- Preclinical PET platform, Uppsala University, Uppsala, Sweden; PET Centre, Uppsala University Hospital, Uppsala, Sweden.
| |
Collapse
|
6
|
Sarrhini O, Bentourkia M. Simultaneous attenuation and scatter corrections from the projections in small animal PET imaging. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2012; 108:889-899. [PMID: 22609114 DOI: 10.1016/j.cmpb.2012.04.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/17/2011] [Revised: 01/29/2012] [Accepted: 04/27/2012] [Indexed: 06/01/2023]
Abstract
Attenuation and scatter corrections are important in quantitative positron emission tomography (PET) imaging even in small animals such as mice and rats. In this work we describe a simple and efficient model to correct for both scatter and attenuation in a single operation. The model aims to solve the equation M=(A+F) P for the primaries P, corrected for attenuation and scatter, based on the measured coincidences M, the matrix of compensation for attenuation A and on the scatter fractions F issued from all emitting sources and contributing to M. The scatter functions are analytically calculated using Klein-Nishina formula, the scanner geometry and the detection efficiencies. This method was applied in measured data of line sources and hot spots phantoms as well as in rat heart and tumors and compared to Monte Carlo based simulations and to the single scatter simulation model developed by Watson et al. The corrected data showed a quantitative contrast and signal to noise ratio enhancement with respect to the uncorrected data. In terms of results, our method is comparable to that of Watson et al. The Monte Carlo simulations, where the primaries and the scattered events were separately registered, confirmed the accuracy of the new approach.
Collapse
Affiliation(s)
- Otman Sarrhini
- Department of Nuclear Medicine and Radiobiology, Faculty of Medicine and Health Sciences, Université de Sherbrooke, Sherbrooke (QC) J1H 5N4, Canada
| | | |
Collapse
|
7
|
Rührnschopf and EP, Klingenbeck K. A general framework and review of scatter correction methods in cone beam CT. Part 2: Scatter estimation approaches. Med Phys 2011; 38:5186-99. [DOI: 10.1118/1.3589140] [Citation(s) in RCA: 106] [Impact Index Per Article: 8.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023] Open
|
8
|
Bentourkia M, Sarrhini O. Simultaneous attenuation and scatter corrections in small animal PET imaging. Comput Med Imaging Graph 2009; 33:477-88. [PMID: 19467839 DOI: 10.1016/j.compmedimag.2009.04.003] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2008] [Revised: 03/08/2009] [Accepted: 04/08/2009] [Indexed: 11/17/2022]
Abstract
The aim of this work is to simultaneously correct for attenuation and scatter in PET by analytically assessing the distribution of the scattered photons using the emission and the transmission images, the probability of scatter interactions and the detection efficiency. Above the usual lower energy threshold of 350 keV, the attenuated photons are dominantly those which have undergone a Compton scattering. By considering that each pixel in the image is the measurement of the transmitted photons through the subject, added to the contribution from the other sources by means of their scatter at this position, a simple equation is established accounting for the primaries by simultaneously correcting the data for attenuation and scatter for all emitting sources. This new method was applied in Monte Carlo simulated and measured data with the Sherbrooke small animal PET scanner in line sources, hot spot phantoms, and in rat hearts and tumors, and was compared to the approach developed by Watson et al.
Collapse
Affiliation(s)
- M'hamed Bentourkia
- Department of Nuclear Medicine and Radiobiology, Faculty of Medicine and Health Sciences, 3001, 12th Avenue North, Université de Sherbrooke, Sherbrooke (QC), Canada J1H 5N4.
| | | |
Collapse
|
9
|
|