1
|
Cheng Y, Zheng W, Bing R, Zhang H, Huang C, Huang P, Ying L, Xia J. Unsupervised denoising of photoacoustic images based on the Noise2Noise network. BIOMEDICAL OPTICS EXPRESS 2024; 15:4390-4405. [PMID: 39346987 PMCID: PMC11427216 DOI: 10.1364/boe.529253] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/06/2024] [Revised: 05/29/2024] [Accepted: 06/15/2024] [Indexed: 10/01/2024]
Abstract
In this study, we implemented an unsupervised deep learning method, the Noise2Noise network, for the improvement of linear-array-based photoacoustic (PA) imaging. Unlike supervised learning, which requires a noise-free ground truth, the Noise2Noise network can learn noise patterns from a pair of noisy images. This is particularly important for in vivo PA imaging, where the ground truth is not available. In this study, we developed a method to generate noise pairs from a single set of PA images and verified our approach through simulation and experimental studies. Our results reveal that the method can effectively remove noise, improve signal-to-noise ratio, and enhance vascular structures at deeper depths. The denoised images show clear and detailed vascular structure at different depths, providing valuable insights for preclinical research and potential clinical applications.
Collapse
Affiliation(s)
- Yanda Cheng
- Department of Biomedical Engineering, University at Buffalo, The State University of New York, Buffalo, New York, USA
| | - Wenhan Zheng
- Department of Biomedical Engineering, University at Buffalo, The State University of New York, Buffalo, New York, USA
| | - Robert Bing
- Department of Biomedical Engineering, University at Buffalo, The State University of New York, Buffalo, New York, USA
| | - Huijuan Zhang
- Department of Biomedical Engineering, University at Buffalo, The State University of New York, Buffalo, New York, USA
| | - Chuqin Huang
- Department of Biomedical Engineering, University at Buffalo, The State University of New York, Buffalo, New York, USA
| | - Peizhou Huang
- Department of Biomedical Engineering, University at Buffalo, The State University of New York, Buffalo, New York, USA
| | - Leslie Ying
- Department of Biomedical Engineering, University at Buffalo, The State University of New York, Buffalo, New York, USA
- Department of Electrical Engineering, University at Buffalo, The State University of New York, Buffalo, New York, USA
| | - Jun Xia
- Department of Biomedical Engineering, University at Buffalo, The State University of New York, Buffalo, New York, USA
| |
Collapse
|
2
|
Rahman H, Khan AR, Sadiq T, Farooqi AH, Khan IU, Lim WH. A Systematic Literature Review of 3D Deep Learning Techniques in Computed Tomography Reconstruction. Tomography 2023; 9:2158-2189. [PMID: 38133073 PMCID: PMC10748093 DOI: 10.3390/tomography9060169] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Revised: 11/27/2023] [Accepted: 12/01/2023] [Indexed: 12/23/2023] Open
Abstract
Computed tomography (CT) is used in a wide range of medical imaging diagnoses. However, the reconstruction of CT images from raw projection data is inherently complex and is subject to artifacts and noise, which compromises image quality and accuracy. In order to address these challenges, deep learning developments have the potential to improve the reconstruction of computed tomography images. In this regard, our research aim is to determine the techniques that are used for 3D deep learning in CT reconstruction and to identify the training and validation datasets that are accessible. This research was performed on five databases. After a careful assessment of each record based on the objective and scope of the study, we selected 60 research articles for this review. This systematic literature review revealed that convolutional neural networks (CNNs), 3D convolutional neural networks (3D CNNs), and deep learning reconstruction (DLR) were the most suitable deep learning algorithms for CT reconstruction. Additionally, two major datasets appropriate for training and developing deep learning systems were identified: 2016 NIH-AAPM-Mayo and MSCT. These datasets are important resources for the creation and assessment of CT reconstruction models. According to the results, 3D deep learning may increase the effectiveness of CT image reconstruction, boost image quality, and lower radiation exposure. By using these deep learning approaches, CT image reconstruction may be made more precise and effective, improving patient outcomes, diagnostic accuracy, and healthcare system productivity.
Collapse
Affiliation(s)
- Hameedur Rahman
- Department of Computer Games Development, Faculty of Computing & AI, Air University, E9, Islamabad 44000, Pakistan;
| | - Abdur Rehman Khan
- Department of Creative Technologies, Faculty of Computing & AI, Air University, E9, Islamabad 44000, Pakistan;
| | - Touseef Sadiq
- Centre for Artificial Intelligence Research, Department of Information and Communication Technology, University of Agder, Jon Lilletuns vei 9, 4879 Grimstad, Norway
| | - Ashfaq Hussain Farooqi
- Department of Computer Science, Faculty of Computing AI, Air University, Islamabad 44000, Pakistan;
| | - Inam Ullah Khan
- Department of Electronic Engineering, School of Engineering & Applied Sciences (SEAS), Isra University, Islamabad Campus, Islamabad 44000, Pakistan;
| | - Wei Hong Lim
- Faculty of Engineering, Technology and Built Environment, UCSI University, Kuala Lumpur 56000, Malaysia;
| |
Collapse
|
3
|
Huang C, Cheng Y, Zheng W, Bing RW, Zhang H, Komornicki I, Harris LM, Arany PR, Chakraborty S, Zhou Q, Xu W, Xia J. Dual-Scan Photoacoustic Tomography for the Imaging of Vascular Structure on Foot. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2023; 70:1703-1713. [PMID: 37276111 PMCID: PMC10809222 DOI: 10.1109/tuffc.2023.3283139] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Chronic leg ulcers are affecting approximately 6.5 million Americans, and they are associated with significant mortality, reduced quality of life, and high treatment costs. Since many chronic ulcers have underlying vascular insufficiency, accurate assessment of tissue perfusion is critical to treatment planning and monitoring. This study introduces a dual-scan photoacoustic (PA) tomography (PAT) system that can simultaneously image the dorsal and plantar sides of the foot to reduce imaging time. To account for the unique shape of the foot, the system employs height-adjustable and articulating baseball stages that can scan along the foot's contour. In vivo results from healthy volunteers demonstrate the system's ability to acquire clear images of foot vasculature, and results from patients indicate that the system can image patients with various ulcer conditions. We also investigated various PA features and examined their correlation with the foot condition. Our preliminary results indicate that vessel sharpness, occupancy, intensity, and density could all be used to assess tissue perfusion. This research demonstrated the potential of PAT for routine clinical tissue perfusion assessment.
Collapse
|
4
|
Zheng W, Zhang H, Huang C, Shijo V, Xu C, Xu W, Xia J. Deep Learning Enhanced Volumetric Photoacoustic Imaging of Vasculature in Human. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2023; 10:e2301277. [PMID: 37530209 PMCID: PMC10582405 DOI: 10.1002/advs.202301277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/24/2023] [Revised: 06/26/2023] [Indexed: 08/03/2023]
Abstract
The development of high-performance imaging processing algorithms is a core area of photoacoustic tomography. While various deep learning based image processing techniques have been developed in the area, their applications in 3D imaging are still limited due to challenges in computational cost and memory allocation. To address those limitations, this work implements a 3D fully-dense (3DFD) U-net to linear array based photoacoustic tomography and utilizes volumetric simulation and mixed precision training to increase efficiency and training size. Through numerical simulation, phantom imaging, and in vivo experiments, this work demonstrates that the trained network restores the true object size, reduces the noise level and artifacts, improves the contrast at deep regions, and reveals vessels subject to limited view distortion. With these enhancements, 3DFD U-net successfully produces clear 3D vascular images of the palm, arms, breasts, and feet of human subjects. These enhanced vascular images offer improved capabilities for biometric identification, foot ulcer evaluation, and breast cancer imaging. These results indicate that the new algorithm will have a significant impact on preclinical and clinical photoacoustic tomography.
Collapse
Affiliation(s)
- Wenhan Zheng
- Department of Biomedical EngineeringUniversity at BuffaloThe State University of New YorkBuffaloNew YorkNY14260USA
| | - Huijuan Zhang
- Department of Biomedical EngineeringUniversity at BuffaloThe State University of New YorkBuffaloNew YorkNY14260USA
| | - Chuqin Huang
- Department of Biomedical EngineeringUniversity at BuffaloThe State University of New YorkBuffaloNew YorkNY14260USA
| | - Varun Shijo
- Department of Biomedical EngineeringUniversity at BuffaloThe State University of New YorkBuffaloNew YorkNY14260USA
- Department of Computer Science and EngineeringUniversity at BuffaloThe State University of New YorkBuffaloNew YorkNY14260USA
| | - Chenhan Xu
- Department of Computer Science and EngineeringUniversity at BuffaloThe State University of New YorkBuffaloNew YorkNY14260USA
| | - Wenyao Xu
- Department of Computer Science and EngineeringUniversity at BuffaloThe State University of New YorkBuffaloNew YorkNY14260USA
| | - Jun Xia
- Department of Biomedical EngineeringUniversity at BuffaloThe State University of New YorkBuffaloNew YorkNY14260USA
- Department of Computer Science and EngineeringUniversity at BuffaloThe State University of New YorkBuffaloNew YorkNY14260USA
| |
Collapse
|
5
|
Chen Z, Gezginer I, Augath M, Liu Y, Ni R, Deán‐Ben XL, Razansky D. Simultaneous Functional Magnetic Resonance and Optoacoustic Imaging of Brain-Wide Sensory Responses in Mice. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2023; 10:e2205191. [PMID: 36437110 PMCID: PMC9875624 DOI: 10.1002/advs.202205191] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/19/2022] [Revised: 10/26/2022] [Indexed: 05/30/2023]
Abstract
Functional magnetic resonance imaging (fMRI) has massively contributed to the understanding of mammalian brain function. However, the origin and interpretation of the blood oxygen level-dependent (BOLD) signals retrieved by fMRI remain highly disputed. This article reports on the development of a fully hybridized system enabling concurrent functional magnetic resonance optoacoustic tomography (MROT) measurements of stimulus-evoked brain-wide sensory responses in mice. The highly complementary angiographic and soft tissue contrasts of both modalities along with simultaneous multi-parametric readings of stimulus-evoked hemodynamic responses are leveraged in order to establish unequivocal links between the various counteracting physiological and metabolic processes in the brain. The results indicate that the BOLD signals are highly correlated, both spatially and temporally, with the total hemoglobin readings resolved with volumetric multi-spectral optoacoustic tomography. Furthermore, the differential oxygenated and deoxygenated hemoglobin optoacoustic readings exhibit superior sensitivity as compared to the BOLD signals when detecting stimulus-evoked hemodynamic responses. The fully hybridized MROT approach greatly expands the neuroimaging toolset to comprehensively study neurovascular and neurometabolic coupling mechanisms and related diseases.
Collapse
Affiliation(s)
- Zhenyue Chen
- Institute for Biomedical Engineering and Institute of Pharmacology and ToxicologyFaculty of MedicineUniversity of ZurichZurich8057Switzerland
- Institute for Biomedical EngineeringDepartment of Information Technology and Electrical EngineeringETH ZurichZurich8093Switzerland
| | - Irmak Gezginer
- Institute for Biomedical Engineering and Institute of Pharmacology and ToxicologyFaculty of MedicineUniversity of ZurichZurich8057Switzerland
- Institute for Biomedical EngineeringDepartment of Information Technology and Electrical EngineeringETH ZurichZurich8093Switzerland
| | - Mark‐Aurel Augath
- Institute for Biomedical Engineering and Institute of Pharmacology and ToxicologyFaculty of MedicineUniversity of ZurichZurich8057Switzerland
- Institute for Biomedical EngineeringDepartment of Information Technology and Electrical EngineeringETH ZurichZurich8093Switzerland
| | - Yu‐Hang Liu
- Institute for Biomedical Engineering and Institute of Pharmacology and ToxicologyFaculty of MedicineUniversity of ZurichZurich8057Switzerland
- Institute for Biomedical EngineeringDepartment of Information Technology and Electrical EngineeringETH ZurichZurich8093Switzerland
| | - Ruiqing Ni
- Institute for Biomedical Engineering and Institute of Pharmacology and ToxicologyFaculty of MedicineUniversity of ZurichZurich8057Switzerland
- Institute for Biomedical EngineeringDepartment of Information Technology and Electrical EngineeringETH ZurichZurich8093Switzerland
- Zurich Neuroscience Center (ZNZ)ZurichSwitzerland
| | - Xosé Luís Deán‐Ben
- Institute for Biomedical Engineering and Institute of Pharmacology and ToxicologyFaculty of MedicineUniversity of ZurichZurich8057Switzerland
- Institute for Biomedical EngineeringDepartment of Information Technology and Electrical EngineeringETH ZurichZurich8093Switzerland
| | - Daniel Razansky
- Institute for Biomedical Engineering and Institute of Pharmacology and ToxicologyFaculty of MedicineUniversity of ZurichZurich8057Switzerland
- Institute for Biomedical EngineeringDepartment of Information Technology and Electrical EngineeringETH ZurichZurich8093Switzerland
- Zurich Neuroscience Center (ZNZ)ZurichSwitzerland
| |
Collapse
|