1
|
Chen Z, Gezginer I, Zhou Q, Tang L, Deán-Ben XL, Razansky D. Multimodal optoacoustic imaging: methods and contrast materials. Chem Soc Rev 2024; 53:6068-6099. [PMID: 38738633 PMCID: PMC11181994 DOI: 10.1039/d3cs00565h] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2023] [Indexed: 05/14/2024]
Abstract
Optoacoustic (OA) imaging offers powerful capabilities for interrogating biological tissues with rich optical absorption contrast while maintaining high spatial resolution for deep tissue observations. The spectrally distinct absorption of visible and near-infrared photons by endogenous tissue chromophores facilitates extraction of diverse anatomic, functional, molecular, and metabolic information from living tissues across various scales, from organelles and cells to whole organs and organisms. The primarily blood-related contrast and limited penetration depth of OA imaging have fostered the development of multimodal approaches to fully exploit the unique advantages and complementarity of the method. We review the recent hybridization efforts, including multimodal combinations of OA with ultrasound, fluorescence, optical coherence tomography, Raman scattering microscopy and magnetic resonance imaging as well as ionizing methods, such as X-ray computed tomography, single-photon-emission computed tomography and positron emission tomography. Considering that most molecules absorb light across a broad range of the electromagnetic spectrum, the OA interrogations can be extended to a large number of exogenously administered small molecules, particulate agents, and genetically encoded labels. This unique property further makes contrast moieties used in other imaging modalities amenable for OA sensing.
Collapse
Affiliation(s)
- Zhenyue Chen
- Institute for Biomedical Engineering and Institute of Pharmacology and Toxicology, Faculty of Medicine, University of Zurich, Switzerland.
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Switzerland
| | - Irmak Gezginer
- Institute for Biomedical Engineering and Institute of Pharmacology and Toxicology, Faculty of Medicine, University of Zurich, Switzerland.
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Switzerland
| | - Quanyu Zhou
- Institute for Biomedical Engineering and Institute of Pharmacology and Toxicology, Faculty of Medicine, University of Zurich, Switzerland.
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Switzerland
| | - Lin Tang
- Institute for Biomedical Engineering and Institute of Pharmacology and Toxicology, Faculty of Medicine, University of Zurich, Switzerland.
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Switzerland
| | - Xosé Luís Deán-Ben
- Institute for Biomedical Engineering and Institute of Pharmacology and Toxicology, Faculty of Medicine, University of Zurich, Switzerland.
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Switzerland
| | - Daniel Razansky
- Institute for Biomedical Engineering and Institute of Pharmacology and Toxicology, Faculty of Medicine, University of Zurich, Switzerland.
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Switzerland
| |
Collapse
|
2
|
Zhong Y, Zhang S, Liu Z, Zhang X, Mo Z, Zhang Y, Hu H, Chen W, Qi L. Unsupervised Fusion of Misaligned PAT and MRI Images via Mutually Reinforcing Cross-Modality Image Generation and Registration. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:1702-1714. [PMID: 38147426 DOI: 10.1109/tmi.2023.3347511] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/28/2023]
Abstract
Photoacoustic tomography (PAT) and magnetic resonance imaging (MRI) are two advanced imaging techniques widely used in pre-clinical research. PAT has high optical contrast and deep imaging range but poor soft tissue contrast, whereas MRI provides excellent soft tissue information but poor temporal resolution. Despite recent advances in medical image fusion with pre-aligned multimodal data, PAT-MRI image fusion remains challenging due to misaligned images and spatial distortion. To address these issues, we propose an unsupervised multi-stage deep learning framework called PAMRFuse for misaligned PAT and MRI image fusion. PAMRFuse comprises a multimodal to unimodal registration network to accurately align the input PAT-MRI image pairs and a self-attentive fusion network that selects information-rich features for fusion. We employ an end-to-end mutually reinforcing mode in our registration network, which enables joint optimization of cross-modality image generation and registration. To the best of our knowledge, this is the first attempt at information fusion for misaligned PAT and MRI. Qualitative and quantitative experimental results show the excellent performance of our method in fusing PAT-MRI images of small animals captured from commercial imaging systems.
Collapse
|
3
|
Eleni Karakatsani M, Estrada H, Chen Z, Shoham S, Deán-Ben XL, Razansky D. Shedding light on ultrasound in action: Optical and optoacoustic monitoring of ultrasound brain interventions. Adv Drug Deliv Rev 2024; 205:115177. [PMID: 38184194 DOI: 10.1016/j.addr.2023.115177] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Revised: 12/27/2023] [Accepted: 12/31/2023] [Indexed: 01/08/2024]
Abstract
Monitoring brain responses to ultrasonic interventions is becoming an important pillar of a growing number of applications employing acoustic waves to actuate and cure the brain. Optical interrogation of living tissues provides a unique means for retrieving functional and molecular information related to brain activity and disease-specific biomarkers. The hybrid optoacoustic imaging methods have further enabled deep-tissue imaging with optical contrast at high spatial and temporal resolution. The marriage between light and sound thus brings together the highly complementary advantages of both modalities toward high precision interrogation, stimulation, and therapy of the brain with strong impact in the fields of ultrasound neuromodulation, gene and drug delivery, or noninvasive treatments of neurological and neurodegenerative disorders. In this review, we elaborate on current advances in optical and optoacoustic monitoring of ultrasound interventions. We describe the main principles and mechanisms underlying each method before diving into the corresponding biomedical applications. We identify areas of improvement as well as promising approaches with clinical translation potential.
Collapse
Affiliation(s)
- Maria Eleni Karakatsani
- Institute for Biomedical Engineering and Institute of Pharmacology and Toxicology, Faculty of Medicine, University of Zurich, Switzerland; Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Switzerland
| | - Héctor Estrada
- Institute for Biomedical Engineering and Institute of Pharmacology and Toxicology, Faculty of Medicine, University of Zurich, Switzerland; Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Switzerland
| | - Zhenyue Chen
- Institute for Biomedical Engineering and Institute of Pharmacology and Toxicology, Faculty of Medicine, University of Zurich, Switzerland; Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Switzerland
| | - Shy Shoham
- Department of Ophthalmology and Tech4Health and Neuroscience Institutes, NYU Langone Health, NY, USA
| | - Xosé Luís Deán-Ben
- Institute for Biomedical Engineering and Institute of Pharmacology and Toxicology, Faculty of Medicine, University of Zurich, Switzerland; Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Switzerland.
| | - Daniel Razansky
- Institute for Biomedical Engineering and Institute of Pharmacology and Toxicology, Faculty of Medicine, University of Zurich, Switzerland; Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Switzerland.
| |
Collapse
|
4
|
Zhang J, Treyer V, Sun J, Zhang C, Gietl A, Hock C, Razansky D, Nitsch RM, Ni R. Automatic analysis of skull thickness, scalp-to-cortex distance and association with age and sex in cognitively normal elderly. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.01.19.524484. [PMID: 36711717 PMCID: PMC9882276 DOI: 10.1101/2023.01.19.524484] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
Abstract
Personalized neurostimulation has been a potential treatment for many brain diseases, which requires insights into brain/skull geometry. Here, we developed an open source efficient pipeline BrainCalculator for automatically computing the skull thickness map, scalp-to-cortex distance (SCD), and brain volume based on T 1 -weighted magnetic resonance imaging (MRI) data. We examined the influence of age and sex cross-sectionally in 407 cognitively normal older adults (71.9±8.0 years, 60.2% female) from the ADNI. We demonstrated the compatibility of our pipeline with commonly used preprocessing packages and found that BrainSuite Skullfinder was better suited for such automatic analysis compared to FSL Brain Extraction Tool 2 and SPM12- based unified segmentation using ground truth. We found that the sphenoid bone and temporal bone were thinnest among the skull regions in both females and males. There was no increase in regional minimum skull thickness with age except in the female sphenoid bone. No sex difference in minimum skull thickness or SCD was observed. Positive correlations between age and SCD were observed, faster in females (0.307%/y) than males (0.216%/y) in temporal SCD. A negative correlation was observed between age and whole brain volume computed based on brain surface (females -1.031%/y, males -0.998%/y). In conclusion, we developed an automatic pipeline for MR-based skull thickness map, SCD, and brain volume analysis and demonstrated the sex-dependent association between minimum regional skull thickness, SCD and brain volume with age. This pipeline might be useful for personalized neurostimulation planning.
Collapse
Affiliation(s)
- Junhao Zhang
- Institute for Regenerative Medicine, University of Zurich, 8952 Zurich, Switzerland
- Institute for Biomedical Engineering, ETH Zurich & University of Zurich, 8093 Zurich, Switzerland
| | - Valerie Treyer
- Institute for Regenerative Medicine, University of Zurich, 8952 Zurich, Switzerland
- Department of Nuclear Medicine, University Hospital of Zurich, University of Zurich, Zurich, Switzerland
| | - Junfeng Sun
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Chencheng Zhang
- Department of Neurosurgery, Center for Functional Neurosurgery, Ruijin Hospital, Shanghai JiaoTong University School of Medicine, Shanghai, China
| | - Anton Gietl
- Institute for Regenerative Medicine, University of Zurich, 8952 Zurich, Switzerland
| | - Christoph Hock
- Institute for Regenerative Medicine, University of Zurich, 8952 Zurich, Switzerland
- Neurimmune, Schlieren, Switzerland
| | - Daniel Razansky
- Institute for Biomedical Engineering, ETH Zurich & University of Zurich, 8093 Zurich, Switzerland
| | - Roger M Nitsch
- Institute for Regenerative Medicine, University of Zurich, 8952 Zurich, Switzerland
- Neurimmune, Schlieren, Switzerland
| | - Ruiqing Ni
- Institute for Regenerative Medicine, University of Zurich, 8952 Zurich, Switzerland
- Institute for Biomedical Engineering, ETH Zurich & University of Zurich, 8093 Zurich, Switzerland
- Zentrum für Neurowissenschaften Zurich, Zurich, Switzerland
| |
Collapse
|