1
|
Danilov VV, De Landro M, Felli E, Barberio M, Diana M, Saccomandi P. Advancing laser ablation assessment in hyperspectral imaging through machine learning. Comput Biol Med 2024; 179:108849. [PMID: 39018883 DOI: 10.1016/j.compbiomed.2024.108849] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Revised: 04/23/2024] [Accepted: 07/03/2024] [Indexed: 07/19/2024]
Abstract
Hyperspectral imaging (HSI) is gaining increasing relevance in medicine, with an innovative application being the intraoperative assessment of the outcome of laser ablation treatment used for minimally invasive tumor removal. However, the high dimensionality and complexity of HSI data create a need for end-to-end image processing workflows specifically tailored to handle these data. This study addresses this challenge by proposing a multi-stage workflow for the analysis of hyperspectral data and allows investigating the performance of different components and modalities for ablation detection and segmentation. To address dimensionality reduction, we integrated principal component analysis (PCA) and t-distributed stochastic neighbor embedding (t-SNE) to capture dominant variations and reveal intricate structures, respectively. Additionally, we employed the Faster Region-based Convolutional Neural Network (Faster R-CNN) to accurately localize ablation areas. The two-stage detection process of Faster R-CNN, along with the choice of dimensionality reduction technique and data modality, significantly influenced the performance in detecting ablation areas. The evaluation of the ablation detection on an independent test set demonstrated a mean average precision of approximately 0.74, which validates the generalization ability of the models. In the segmentation component, the Mean Shift algorithm showed high quality segmentation without manual cluster definition. Our results prove that the integration of PCA, t-SNE, and Faster R-CNN enables improved interpretation of hyperspectral data, leading to the development of reliable ablation detection and segmentation systems.
Collapse
Affiliation(s)
| | - Martina De Landro
- Department of Mechanical Engineering, Politecnico di Milano, Milan, Italy
| | - Eric Felli
- Department of Visceral Surgery and Medicine, Inselspital, Bern University Hospital, University of Bern, Switzerland
| | - Manuel Barberio
- Department of General Surgery, Cardinal G. Panico Hospital, Tricase, Italy
| | - Michele Diana
- Research Institute against Digestive Cancer, Strasbourg, France; ICube Laboratory, University of Strasbourg, Strasbourg, France
| | - Paola Saccomandi
- Department of Mechanical Engineering, Politecnico di Milano, Milan, Italy.
| |
Collapse
|
2
|
Campbell JM, Gosnell M, Agha A, Handley S, Knab A, Anwer AG, Bhargava A, Goldys EM. Label-Free Assessment of Key Biological Autofluorophores: Material Characteristics and Opportunities for Clinical Applications. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2024:e2403761. [PMID: 38775184 DOI: 10.1002/adma.202403761] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/13/2024] [Revised: 05/04/2024] [Indexed: 06/13/2024]
Abstract
Autofluorophores are endogenous fluorescent compounds that naturally occur in the intra and extracellular spaces of all tissues and organs. Most have vital biological functions - like the metabolic cofactors NAD(P)H and FAD+, as well as the structural protein collagen. Others are considered to be waste products - like lipofuscin and advanced glycation end products - which accumulate with age and are associated with cellular dysfunction. Due to their natural fluorescence, these materials have great utility for enabling non-invasive, label-free assays with direct ties to biological function. Numerous technologies, with different advantages and drawbacks, are applied to their assessment, including fluorescence lifetime imaging microscopy, hyperspectral microscopy, and flow cytometry. Here, the applications of label-free autofluorophore assessment are reviewed for clinical and health-research applications, with specific attention to biomaterials, disease detection, surgical guidance, treatment monitoring, and tissue assessment - fields that greatly benefit from non-invasive methodologies capable of continuous, in vivo characterization.
Collapse
Affiliation(s)
- Jared M Campbell
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Graduate School of Biomedical Engineering, University of New South Wales, Sydney, NSW, 2033, Australia
| | | | - Adnan Agha
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Graduate School of Biomedical Engineering, University of New South Wales, Sydney, NSW, 2033, Australia
| | - Shannon Handley
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Graduate School of Biomedical Engineering, University of New South Wales, Sydney, NSW, 2033, Australia
| | - Aline Knab
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Graduate School of Biomedical Engineering, University of New South Wales, Sydney, NSW, 2033, Australia
| | - Ayad G Anwer
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Graduate School of Biomedical Engineering, University of New South Wales, Sydney, NSW, 2033, Australia
| | - Akanksha Bhargava
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Graduate School of Biomedical Engineering, University of New South Wales, Sydney, NSW, 2033, Australia
| | - Ewa M Goldys
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Graduate School of Biomedical Engineering, University of New South Wales, Sydney, NSW, 2033, Australia
| |
Collapse
|
3
|
Yang H, Majumder JA, Huang Z, Saluja D, Laurita K, Rollins AM, Hendon CP. Robust, high-density lesion mapping in the left atrium with near-infrared spectroscopy. JOURNAL OF BIOMEDICAL OPTICS 2024; 29:028001. [PMID: 38419756 PMCID: PMC10901242 DOI: 10.1117/1.jbo.29.2.028001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/10/2023] [Revised: 02/06/2024] [Accepted: 02/09/2024] [Indexed: 03/02/2024]
Abstract
Significance Radiofrequency ablation (RFA) procedures for atrial fibrillation frequently fail to prevent recurrence, partially due to limitations in assessing extent of ablation. Optical spectroscopy shows promise in assessing RFA lesion formation but has not been validated in conditions resembling those in vivo. Aim Catheter-based near-infrared spectroscopy (NIRS) was applied to porcine hearts to demonstrate that spectrally derived optical indices remain accurate in blood and at oblique incidence angles. Approach Porcine left atria were ablated and mapped using a custom-fabricated NIRS catheter. Each atrium was mapped first in phosphate-buffered saline (PBS) then in porcine blood. Results NIRS measurements showed little angle dependence up to 60 deg. A trained random forest model predicted lesions with a sensitivity of 81.7%, a specificity of 86.1%, and a receiver operating characteristic curve area of 0.921. Predicted lesion maps achieved a mean structural similarity index of 0.749 and a mean normalized inner product of 0.867 when comparing maps obtained in PBS and blood. Conclusions Catheter-based NIRS can precisely detect RFA lesions on left atria submerged in blood. Optical parameters are reliable in blood and without perpendicular contact, confirming their ability to provide useful feedback during in vivo RFA procedures.
Collapse
Affiliation(s)
- Haiqiu Yang
- Columbia University, Department of Electrical Engineering, New York, United States
| | - Jonah A. Majumder
- Columbia University, Department of Biomedical Engineering, New York, United States
| | - Ziyi Huang
- Columbia University, Department of Electrical Engineering, New York, United States
| | - Deepak Saluja
- Columbia University Irving Medical Center, Cardiology Division, Department of Medicine, New York, United States
| | - Kenneth Laurita
- MetroHealth Hospital, Cardiology Division, Department of Medicine, Cleveland, Ohio, United States
- Case Western Reserve University, Department of Biomedical Engineering, Cleveland, Ohio, United States
| | - Andrew M. Rollins
- Case Western Reserve University, Department of Biomedical Engineering, Cleveland, Ohio, United States
| | - Christine P. Hendon
- Columbia University, Department of Electrical Engineering, New York, United States
| |
Collapse
|
4
|
Campbell JM, Habibalahi A, Handley S, Agha A, Mahbub SB, Anwer AG, Goldys EM. Emerging clinical applications in oncology for non-invasive multi- and hyperspectral imaging of cell and tissue autofluorescence. JOURNAL OF BIOPHOTONICS 2023; 16:e202300105. [PMID: 37272291 DOI: 10.1002/jbio.202300105] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Revised: 05/02/2023] [Accepted: 05/16/2023] [Indexed: 06/06/2023]
Abstract
Hyperspectral and multispectral imaging of cell and tissue autofluorescence is an emerging technology in which fluorescence imaging is applied to biological materials across multiple spectral channels. This produces a stack of images where each matched pixel contains information about the sample's spectral properties at that location. This allows precise collection of molecularly specific data from a broad range of native fluorophores. Importantly, complex information, directly reflective of biological status, is collected without staining and tissues can be characterised in situ, without biopsy. For oncology, this can spare the collection of biopsies from sensitive regions and enable accurate tumour mapping. For in vivo tumour analysis, the greatest focus has been on oral cancer, whereas for ex vivo assessment head-and-neck cancers along with colon cancer have been the most studied, followed by oral and eye cancer. This review details the scope and progress of research undertaken towards clinical translation in oncology.
Collapse
Affiliation(s)
- Jared M Campbell
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, The University of Adelaide, Adelaide, South Australia, Australia
| | - Abbas Habibalahi
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, The University of Adelaide, Adelaide, South Australia, Australia
| | - Shannon Handley
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, The University of Adelaide, Adelaide, South Australia, Australia
| | - Adnan Agha
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, The University of Adelaide, Adelaide, South Australia, Australia
| | - Saabah B Mahbub
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, The University of Adelaide, Adelaide, South Australia, Australia
| | - Ayad G Anwer
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, The University of Adelaide, Adelaide, South Australia, Australia
| | - Ewa M Goldys
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, The University of Adelaide, Adelaide, South Australia, Australia
| |
Collapse
|
5
|
John S, Hester S, Basij M, Paul A, Xavierselvan M, Mehrmohammadi M, Mallidi S. Niche preclinical and clinical applications of photoacoustic imaging with endogenous contrast. PHOTOACOUSTICS 2023; 32:100533. [PMID: 37636547 PMCID: PMC10448345 DOI: 10.1016/j.pacs.2023.100533] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Revised: 06/30/2023] [Accepted: 07/14/2023] [Indexed: 08/29/2023]
Abstract
In the past decade, photoacoustic (PA) imaging has attracted a great deal of popularity as an emergent diagnostic technology owing to its successful demonstration in both preclinical and clinical arenas by various academic and industrial research groups. Such steady growth of PA imaging can mainly be attributed to its salient features, including being non-ionizing, cost-effective, easily deployable, and having sufficient axial, lateral, and temporal resolutions for resolving various tissue characteristics and assessing the therapeutic efficacy. In addition, PA imaging can easily be integrated with the ultrasound imaging systems, the combination of which confers the ability to co-register and cross-reference various features in the structural, functional, and molecular imaging regimes. PA imaging relies on either an endogenous source of contrast (e.g., hemoglobin) or those of an exogenous nature such as nano-sized tunable optical absorbers or dyes that may boost imaging contrast beyond that provided by the endogenous sources. In this review, we discuss the applications of PA imaging with endogenous contrast as they pertain to clinically relevant niches, including tissue characterization, cancer diagnostics/therapies (termed as theranostics), cardiovascular applications, and surgical applications. We believe that PA imaging's role as a facile indicator of several disease-relevant states will continue to expand and evolve as it is adopted by an increasing number of research laboratories and clinics worldwide.
Collapse
Affiliation(s)
- Samuel John
- Department of Biomedical Engineering, Wayne State University, Detroit, MI, USA
| | - Scott Hester
- Department of Biomedical Engineering, Tufts University, Medford, MA, USA
| | - Maryam Basij
- Department of Biomedical Engineering, Wayne State University, Detroit, MI, USA
| | - Avijit Paul
- Department of Biomedical Engineering, Tufts University, Medford, MA, USA
| | | | - Mohammad Mehrmohammadi
- Department of Imaging Sciences, University of Rochester Medical Center, Rochester, NY, USA
- Department of Biomedical Engineering, University of Rochester, Rochester, NY, USA
- Wilmot Cancer Institute, Rochester, NY, USA
| | - Srivalleesha Mallidi
- Department of Biomedical Engineering, Tufts University, Medford, MA, USA
- Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, MA 02114, USA
| |
Collapse
|
6
|
Campbell JM, Mahbub SB, Habibalahi A, Agha A, Handley S, Anwer AG, Goldys EM. Clinical applications of non-invasive multi and hyperspectral imaging of cell and tissue autofluorescence beyond oncology. JOURNAL OF BIOPHOTONICS 2023; 16:e202200264. [PMID: 36602432 DOI: 10.1002/jbio.202200264] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/23/2022] [Revised: 12/20/2022] [Accepted: 12/24/2022] [Indexed: 06/17/2023]
Abstract
Hyperspectral and multispectral imaging of cell and tissue autofluorescence employs fluorescence imaging, without exogenous fluorophores, across multiple excitation/emission combinations (spectral channels). This produces an image stack where each pixel (matched by location) contains unique information about the sample's spectral properties. Analysis of this data enables access to a rich, molecularly specific data set from a broad range of cell-native fluorophores (autofluorophores) directly reflective of biochemical status, without use of fixation or stains. This non-invasive, non-destructive technology has great potential to spare the collection of biopsies from sensitive regions. As both staining and biopsy may be impossible, or undesirable, depending on the context, this technology great diagnostic potential for clinical decision making. The main research focus has been on the identification of neoplastic tissues. However, advances have been made in diverse applications-including ophthalmology, cardiovascular health, neurology, infection, assisted reproduction technology and organ transplantation.
Collapse
Affiliation(s)
- Jared M Campbell
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Sydney, Australia
| | - Saabah B Mahbub
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Sydney, Australia
| | - Abbas Habibalahi
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Sydney, Australia
| | - Adnan Agha
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Sydney, Australia
| | - Shannon Handley
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Sydney, Australia
| | - Ayad G Anwer
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Sydney, Australia
| | - Ewa M Goldys
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Sydney, Australia
| |
Collapse
|
7
|
Park SY, Singh-Moon R, Yang H, Hendon C. Monitoring of irrigated lesion formation with single fiber based multispectral system using machine learning. JOURNAL OF BIOPHOTONICS 2022; 15:e202100374. [PMID: 35666015 PMCID: PMC9452461 DOI: 10.1002/jbio.202100374] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/04/2021] [Revised: 05/15/2022] [Accepted: 05/18/2022] [Indexed: 06/15/2023]
Abstract
In radiofrequency ablation (RFA) treatment of cardiac arrhythmias, intraprocedural assessment of treatment efficacy relies on indirect measures of adequate tissue destruction. Direct sensing of diffuse reflectance spectral changes at the ablation site using optically integrated RFA catheters has been shown to enable accurate prediction of lesion dimensions, ex vivo. Challenges of optical guidance can be due to obtaining reliable measurements under various catheter-tissue contact orientations. In this work, addressed this limitation by assessing the feasibility of monitoring lesion progression using single-fiber reflectance spectroscopy (SFRS). A total of 110 endocardial lesions of various sizes were generated in freshly excised swine right ventricular tissue using a custom-built, irrigated SFRS-RFA catheter. Models were developed for assessing catheter-tissue contact, the presence of nontransmural or transmural lesions and lesion depth percentage. These results support the use of SFRS-based catheters for irrigated lesion assessment and motivate further exploration of using multi-SFRS catheters for omnidirectionality.
Collapse
Affiliation(s)
- Soo Young Park
- Department of Electrical Engineering, Columbia University, 500 W. 120 St, New York, NY 10027
| | - Rajinder Singh-Moon
- Department of Electrical Engineering, Columbia University, 500 W. 120 St, New York, NY 10027
| | - Haiqiu Yang
- Department of Electrical Engineering, Columbia University, 500 W. 120 St, New York, NY 10027
| | - Christine Hendon
- Department of Electrical Engineering, Columbia University, 500 W. 120 St, New York, NY 10027
| |
Collapse
|
8
|
Park SY, Yang H, Marboe C, Ziv O, Laurita K, Rollins A, Saluja D, Hendon CP. Cardiac endocardial left atrial substrate and lesion depth mapping using near-infrared spectroscopy. BIOMEDICAL OPTICS EXPRESS 2022; 13:1801-1819. [PMID: 35519253 PMCID: PMC9045901 DOI: 10.1364/boe.451547] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/22/2021] [Revised: 02/18/2022] [Accepted: 02/18/2022] [Indexed: 06/14/2023]
Abstract
Atrial fibrillation (AF) is a rapid irregular electrical activity in the upper chamber and the most common sustained cardiac arrhythmia. Many patients require radiofrequency ablation (RFA) therapy to restore sinus rhythm. Pulmonary vein isolation requires distinguishing normal atrial wall from the pulmonary vein tissue, and atrial substrate ablation requires differentiating scar tissue, fibrosis, and adipose tissue. However, current anatomical mapping methods for strategically locating ablation sites by identifying structural substrates in real-time are limited. An intraoperative tool that accurately provides detailed structural information and classifies endocardial substrates could help improve RF guidance during RF ablation therapy. In this work, we propose a 7F NIRS integrated ablation catheter and demonstrate endocardial mapping on ex vivo swine (n = 12) and human (n = 5) left atrium (LA). First, pulmonary vein (PV) sleeve, fibrosis and ablation lesions were identified with NIRS-derived contrast indices. Based on these key spectral features, classification algorithms identified endocardial substrates with high accuracy (<11% error). Then, a predictive model for lesion depth was evaluated on classified lesions. Model predictions correlated well with histological measurements of lesion dimensions (R = 0.984). Classified endocardial substrates and lesion depth were represented in 2D spatial maps. These results suggest NIRS integrated mapping catheters can serve as a complementary tool to the current electroanatomical mapping system to improve treatment efficacy.
Collapse
Affiliation(s)
- Soo Young Park
- Department of Electrical Engineering, Columbia University, New York, USA
| | - Haiqiu Yang
- Department of Electrical Engineering, Columbia University, New York, USA
| | - Charles Marboe
- Department of Cell Biology and Pathology, Columbia University Irving Medical Center, New York, USA
| | - Ohad Ziv
- Department of Medicine, Cardiology Division, MetroHealth Hospital, Ohio, USA
| | - Kenneth Laurita
- Department of Medicine, Cardiology Division, MetroHealth Hospital, Ohio, USA
- Department of Biomedical Engineering, Case Western Reserve University, Ohio, USA
| | - Andrew Rollins
- Department of Biomedical Engineering, Case Western Reserve University, Ohio, USA
| | - Deepak Saluja
- Department of Medicine, Cardiology Division, Columbia University Irving Medical Center, New York, USA
| | | |
Collapse
|
9
|
Prediction of In Vivo Laser-Induced Thermal Damage with Hyperspectral Imaging Using Deep Learning. SENSORS 2021; 21:s21206934. [PMID: 34696147 PMCID: PMC8539534 DOI: 10.3390/s21206934] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/02/2021] [Revised: 10/11/2021] [Accepted: 10/15/2021] [Indexed: 12/26/2022]
Abstract
Thermal ablation is an acceptable alternative treatment for primary liver cancer, of which laser ablation (LA) is one of the least invasive approaches, especially for tumors in high-risk locations. Precise control of the LA effect is required to safely destroy the tumor. Although temperature imaging techniques provide an indirect measurement of the thermal damage, a degree of uncertainty remains about the treatment effect. Optical techniques are currently emerging as tools to directly assess tissue thermal damage. Among them, hyperspectral imaging (HSI) has shown promising results in image-guided surgery and in the thermal ablation field. The highly informative data provided by HSI, associated with deep learning, enable the implementation of non-invasive prediction models to be used intraoperatively. Here we show a novel paradigm “peak temperature prediction model” (PTPM), convolutional neural network (CNN)-based, trained with HSI and infrared imaging to predict LA-induced damage in the liver. The PTPM demonstrated an optimal agreement with tissue damage classification providing a consistent threshold (50.6 ± 1.5 °C) for the damage margins with high accuracy (~0.90). The high correlation with the histology score (r = 0.9085) and the comparison with the measured peak temperature confirmed that PTPM preserves temperature information accordingly with the histopathological assessment.
Collapse
|
10
|
De Landro M, Espíritu García-Molina I, Barberio M, Felli E, Agnus V, Pizzicannella M, Diana M, Zappa E, Saccomandi P. Hyperspectral Imagery for Assessing Laser-Induced Thermal State Change in Liver. SENSORS 2021; 21:s21020643. [PMID: 33477656 PMCID: PMC7831494 DOI: 10.3390/s21020643] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/03/2020] [Revised: 01/05/2021] [Accepted: 01/13/2021] [Indexed: 12/16/2022]
Abstract
This work presents the potential of hyperspectral imaging (HSI) to monitor the thermal outcome of laser ablation therapy used for minimally invasive tumor removal. Our main goal is the establishment of indicators of the thermal damage of living tissues, which can be used to assess the effect of the procedure. These indicators rely on the spectral variation of temperature-dependent tissue chromophores, i.e., oxyhemoglobin, deoxyhemoglobin, methemoglobin, and water. Laser treatment was performed at specific temperature thresholds (from 60 to 110 °C) on in-vivo animal liver and was assessed with a hyperspectral camera (500-995 nm) during and after the treatment. The indicators were extracted from the hyperspectral images after the following processing steps: the breathing motion compensation and the spectral and spatial filtering, the selection of spectral bands corresponding to specific tissue chromophores, and the analysis of the areas under the curves for each spectral band. Results show that properly combining spectral information related to deoxyhemoglobin, methemoglobin, lipids, and water allows for the segmenting of different zones of the laser-induced thermal damage. This preliminary investigation provides indicators for describing the thermal state of the liver, which can be employed in the future as clinical endpoints of the procedure outcome.
Collapse
Affiliation(s)
- Martina De Landro
- Department of Mechanical Engineering, Politecnico di Milano, 20156 Milan, Italy; (M.D.L.); (I.E.G.-M.); (E.Z.)
| | | | - Manuel Barberio
- IHU-Strasbourg, 67000 Strasbourg, France; (M.B.); (E.F.); (V.A.); (M.P.); (M.D.)
- Department of General Surgery, Ospedale Card. G. Panico, 73039 Tricase, Italy
| | - Eric Felli
- IHU-Strasbourg, 67000 Strasbourg, France; (M.B.); (E.F.); (V.A.); (M.P.); (M.D.)
| | - Vincent Agnus
- IHU-Strasbourg, 67000 Strasbourg, France; (M.B.); (E.F.); (V.A.); (M.P.); (M.D.)
| | | | - Michele Diana
- IHU-Strasbourg, 67000 Strasbourg, France; (M.B.); (E.F.); (V.A.); (M.P.); (M.D.)
- Research Institute against Cancer of the Digestive System IRCAD, 67091 Strasbourg, France
- ICube Laboratory, Photonics Instrumentation for Health, 67400 Strasbourg, France
| | - Emanuele Zappa
- Department of Mechanical Engineering, Politecnico di Milano, 20156 Milan, Italy; (M.D.L.); (I.E.G.-M.); (E.Z.)
| | - Paola Saccomandi
- Department of Mechanical Engineering, Politecnico di Milano, 20156 Milan, Italy; (M.D.L.); (I.E.G.-M.); (E.Z.)
- Correspondence:
| |
Collapse
|
11
|
Armstrong K, Larson C, Asfour H, Ransbury T, Sarvazyan N. A Percutaneous Catheter for In Vivo Hyperspectral Imaging of Cardiac Tissue: Challenges, Solutions and Future Directions. Cardiovasc Eng Technol 2020; 11:560-575. [PMID: 32666326 PMCID: PMC7530025 DOI: 10.1007/s13239-020-00476-w] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/24/2019] [Accepted: 06/30/2020] [Indexed: 12/16/2022]
Abstract
PURPOSE Multiple studies have shown that spectral analysis of tissue autofluorescence can be used as a live indicator for various pathophysiological states of cardiac tissue, including ischemia, ablation-induced damage, or scar formation. Yet today there are no percutaneous devices that can detect autofluorescence signals from inside a beating heart. Our aim was to develop a prototype catheter to demonstrate the feasibility of doing so. METHODS AND RESULTS Here we summarize technical solutions leading to the development of a percutaneous catheter capable of multispectral imaging of intracardiac surfaces. The process included several iterations of light sources, optical filtering, and image acquisition techniques. The developed system included a compliant balloon, 355 nm laser irradiance, a high-sensitivity CCD, bandpass filtering, and image acquisition synchronized with the cardiac cycle. It enabled us to capture autofluorescence images from multiple spectral bands within the visible range while illuminating the endocardial surface with ultraviolet light. Principal component analysis and other spectral unmixing post-processing algorithms were then used to reveal target tissue. CONCLUSION Based on the success of our prototype system, we are confident that the development of ever more sensitive cameras, recent advances in tunable filters, fiber bundles, and other optical and computational components makes it possible to create percutaneous catheters capable of acquiring hyper or multispectral hypercubes, including those based on autofluorescence, in real-time. This opens the door for widespread use of this methodology for high-resolution intraoperative imaging of internal tissues and organs-including cardiovascular applications.
Collapse
Affiliation(s)
- Kenneth Armstrong
- Nocturnal Product Development, LLC, 8128 Renaissance Pkwy #210, Durham, NC, 27713, USA.
| | - Cinnamon Larson
- Nocturnal Product Development, LLC, 8128 Renaissance Pkwy #210, Durham, NC, 27713, USA
| | - Huda Asfour
- Department of Pharmacology and Physiology, The George Washington University, 2300 Eye Street NW, Washington, DC, 20037, USA
| | - Terry Ransbury
- LuxMed Systems, Inc, 124 Country Drive, Weston, MA, 02493, USA
| | - Narine Sarvazyan
- Department of Pharmacology and Physiology, The George Washington University, 2300 Eye Street NW, Washington, DC, 20037, USA.
| |
Collapse
|
12
|
Asfour H, Otridge J, Thomasian R, Larson C, Sarvazyan N. Autofluorescence properties of balloon polymers used in medical applications. JOURNAL OF BIOMEDICAL OPTICS 2020; 25:JBO-200216R. [PMID: 33084257 PMCID: PMC7575097 DOI: 10.1117/1.jbo.25.10.106004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/09/2020] [Accepted: 10/06/2020] [Indexed: 06/11/2023]
Abstract
SIGNIFICANCE For use in medical balloons and related clinical applications, polymers are usually designed for transparency under illumination with white-light sources. However, when illuminated with ultraviolet (UV) or blue light, most of these materials autofluoresce in the visible range, which can be a concern for modalities that rely on tissue autofluorescence for diagnostic or therapeutic purposes. AIM A search for published information on spectral properties of polymers that can be used for medical balloon manufacturing revealed a scarcity of published information on this subject. The aim of these studies was to address this gap. APPROACH The autofluorescence properties of polymers used in medical balloon manufacturing were examined for their suitability for hyperspectral imaging and related applications. Excitation-emission matrices of different balloon materials were acquired within the 320- to 620-nm spectral range. In parallel, autofluorescence profiles from the 420- to 620-nm range were extracted from hyperspectral datasets of the same samples illuminated with UV light. The list of tested polymers included polyurethanes, nylon, polyethylene terephthalate (PET), polyether block amide (PEBAX), vulcanized silicone, thermoplastic elastomers with and without talc, and cyclic olefin copolymers, known by their trade name TOPAS. RESULTS Each type of polymer exhibited a specific pattern of autofluorescence. Polyurethanes, PET, and thermoplastic elastomers containing talc had the highest autofluorescence values, while sheets made of nylon, PEBAX, and TOPAS exhibited negligible autofluorescence. Hyperspectral imaging was used to illustrate how the choice of specific balloon material can impact the ability of principal component analysis to reveal the ablated cardiac tissue. CONCLUSIONS The data revealed significant differences between autofluorescence profiles of the polymers and pointed to the most promising balloon materials for clinical implementation of approaches that depend on tissue autofluorescence.
Collapse
Affiliation(s)
- Huda Asfour
- The George Washington University, Department of Pharmacology and Physiology, Washington, DC, United States
| | - Jeremy Otridge
- The George Washington University, Department of Pharmacology and Physiology, Washington, DC, United States
| | - Robert Thomasian
- The George Washington University, Department of Pharmacology and Physiology, Washington, DC, United States
| | - Cinnamon Larson
- Nocturnal Product Development, LLC, Durham, North Carolina, United States
| | - Narine Sarvazyan
- The George Washington University, Department of Pharmacology and Physiology, Washington, DC, United States
| |
Collapse
|
13
|
Key factors behind autofluorescence changes caused by ablation of cardiac tissue. Sci Rep 2020; 10:15369. [PMID: 32958843 PMCID: PMC7506017 DOI: 10.1038/s41598-020-72351-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2020] [Accepted: 08/25/2020] [Indexed: 11/30/2022] Open
Abstract
Radiofrequency ablation is a commonly used clinical procedure that destroys arrhythmogenic sources in patients suffering from atrial fibrillation and other types of cardiac arrhythmias. To improve the success of this procedure, new approaches for real-time visualization of ablation sites are being developed. One of these promising methods is hyperspectral imaging, an approach that detects lesions based on changes in the endogenous tissue autofluorescence profile. To facilitate the clinical implementation of this approach, we examined the key variables that can influence ablation-induced spectral changes, including the drop in myocardial NADH levels, the release of lipofuscin-like pigments, and the increase in diffuse reflectance of the cardiac muscle beneath the endocardial layer. Insights from these experiments suggested simpler algorithms that can be used to acquire and post-process the spectral information required to reveal the lesion sites. Our study is relevant to a growing number of multilayered clinical targets to which spectral approaches are being applied.
Collapse
|
14
|
Iskander-Rizk S, Kruizinga P, Beurskens R, Springeling G, Mastik F, de Groot NM, Knops P, van der Steen AF, van Soest G. Real-time photoacoustic assessment of radiofrequency ablation lesion formation in the left atrium. PHOTOACOUSTICS 2019; 16:100150. [PMID: 31871891 PMCID: PMC6909067 DOI: 10.1016/j.pacs.2019.100150] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/01/2019] [Revised: 10/24/2019] [Accepted: 11/13/2019] [Indexed: 05/20/2023]
Abstract
In interventional electrophysiology, catheter-based radiofrequency (RF) ablation procedures restore cardiac heart rhythm by interrupting aberrant conduction paths. Real-time feedback on lesion formation and post-treatment lesion assessment could overcome procedural challenges related to ablation of underlying structures and lesion gaps. This study aims to evaluate real-time visualization of lesion progression and continuity during intra-atrial ablation with photoacoustic (PA) imaging, using clinically deployable technology. A PA-enabled RF ablation catheter was used to ablate and illuminate porcine left atrium, both excised and intact in a passive beating heart ex-vivo, for photoacoustic signal generation. PA signals were received with an intracardiac echography catheter. Using the ratio of PA images acquired with excitation wavelengths of 790 nm and 930 nm, ablation lesions were successfully imaged through circulating saline and/or blood, and lesion gaps were identified in real-time. PA-based assessment of RF-ablation lesions was successful in a realistic preclinical model of atrial intervention.
Collapse
Affiliation(s)
- Sophinese Iskander-Rizk
- Department of Cardiology, Erasmus MC, University Medical Center Rotterdam, the Netherlands
- Corresponding author at: Department of Biomedical Engineering, Erasmus Medical Center, Ee-2322, Wytemaweg 80, 3015 CN, Rotterdam, the Netherlands.
| | - Pieter Kruizinga
- Department of Neuroscience, Erasmus MC, University Medical Center Rotterdam, the Netherlands
| | - Robert Beurskens
- Department of Cardiology, Erasmus MC, University Medical Center Rotterdam, the Netherlands
| | - Geert Springeling
- Department of Experimental Medical Instruments, Erasmus MC, University Medical Center Rotterdam, the Netherlands
| | - Frits Mastik
- Department of Cardiology, Erasmus MC, University Medical Center Rotterdam, the Netherlands
| | - Natasja M.S. de Groot
- Department of Cardiology, Erasmus MC, University Medical Center Rotterdam, the Netherlands
| | - Paul Knops
- Department of Cardiology, Erasmus MC, University Medical Center Rotterdam, the Netherlands
| | - Antonius F.W. van der Steen
- Department of Cardiology, Erasmus MC, University Medical Center Rotterdam, the Netherlands
- Department of Imaging Physics, Faculty of Applied Sciences, Delft University of Technology, Delft, the Netherlands
| | - Gijs van Soest
- Department of Cardiology, Erasmus MC, University Medical Center Rotterdam, the Netherlands
| |
Collapse
|
15
|
Landro MD, Saccomandi P, Barberio M, Schena E, Marescaux MJ, Diana M. Hyperspectral imaging for thermal effect monitoring in in vivo liver during laser ablation. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2019; 2019:1851-1854. [PMID: 31946258 DOI: 10.1109/embc.2019.8856487] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Thermal ablation is a minimally invasive technique used to induce a controlled necrosis of malignant cells by increasing the temperature in localized areas. This procedure needs an accurate and real-time monitoring of thermal effects to evaluate and control treatment outcome. In this work, a hyperspectral imaging (HSI) technique is proposed as a new and non-invasive method to monitor ablative therapy. HSI provides images of the target object in several spectral bands, hence the reflectance/absorbance spectrum for each pixel. This paper presents a preliminary and original HSI-based analysis of the thermal state in the in vivo porcine liver undergoing laser ablation. In order to compare the spectral response between treated and untreated areas of the organ, proper Regions of Interest (ROIs) were chosen on the hyperspectral images; for each ROI, the absorbance variation for the selected wavelengths (i.e., 630, 760, and 960nm, for deoxyhemoglobin, methemoglobin, and water respectively) was assessed. Results obtained during and after laser ablation show that the absorbance of the methemoglobin peaks increases up to 40% in the burned region with respect to the non-ablated one. Conversely, the relative change of deoxyhemoglobin and water peaks is less marked. Based on these results, absorbance threshold values were retrieved and used to visualize the ablation zone on the images. This preliminary analysis suggests that a combination of the absorbance information is essential to achieve a more accurate identification of the ablation region. The results encourage further studies on the correlation between thermal effects and the spectral response of biological tissues undergoing thermal ablation, for final clinical use.
Collapse
|
16
|
Park SY, Singh-Moon RP, Wan EY, Hendon CP. Towards real-time multispectral endoscopic imaging for cardiac lesion quality assessment. BIOMEDICAL OPTICS EXPRESS 2019; 10:2829-2846. [PMID: 31259054 PMCID: PMC6583339 DOI: 10.1364/boe.10.002829] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/20/2019] [Revised: 05/08/2019] [Accepted: 05/08/2019] [Indexed: 05/08/2023]
Abstract
Atrial fibrillation (Afib) can lead to life threatening conditions such as heart failure and stroke. During Afib treatment, clinicians aim to repress unusual electrical activity by electrically isolating the pulmonary veins (PV) from the left atrium (LA) using radiofrequency ablation. However, current clinical tools are limited in reliably assessing transmurality of the ablation lesions and detecting the presence of gaps within ablation lines, which can warrant repeat procedures. In this study, we developed an endoscopic multispectral reflectance imaging (eMSI) system for enhanced discrimination of tissue treatment at the PV junction. The system enables direct visualization of cardiac lesions through an endoscope at acquisition rates up to 25 Hz. Five narrowband, high-power LEDs were used to illuminate the sample (450, 530, 625, 810 and 940nm) and combinatory parameters were calculated based on their relative reflectance. A stitching algorithm was employed to generate large field-of-view, multispectral mosaics of the ablated PV junction from individual eMSI images. A total of 79 lesions from 15 swine hearts were imaged, ex vivo. Statistical analysis of the acquired five spectral data sets and ratiometric maps revealed significant differences between transmural lesions, non-transmural lesions around the venoatrial junctions, unablated posterior wall of left atrium tissue, and pulmonary vein (p < 0.0001). A pixel-based quadratic discriminant analysis classifier was applied to distinguish four tissue types: PV, untreated LA, non-transmural and transmural lesions. We demonstrate tissue type classification accuracies of 80.2% and 92.1% for non-transmural and transmural lesions, and 95.0% and 92.8% for PV and untreated LA sites, respectively. These findings showcase the potential of eMSI for lesion validation and may help to improve AFib treatment efficacy.
Collapse
Affiliation(s)
- Soo Young Park
- Department of Electrical Engineering, Columbia University, 500 W 120th Street, New York, NY, 10027, USA
| | - Rajinder P. Singh-Moon
- Department of Electrical Engineering, Columbia University, 500 W 120th Street, New York, NY, 10027, USA
| | - Elaine Y. Wan
- Department of Medicine, Division of Cardiology, Columbia University Medical Center, 630 W 168th Street, New York, NY, 10032, USA
| | - Christine P. Hendon
- Department of Electrical Engineering, Columbia University, 500 W 120th Street, New York, NY, 10027, USA
| |
Collapse
|
17
|
Singh-Moon RP, Yao X, Iyer V, Marboe C, Whang W, Hendon CP. Real-time optical spectroscopic monitoring of nonirrigated lesion progression within atrial and ventricular tissues. JOURNAL OF BIOPHOTONICS 2019; 12:e201800144. [PMID: 30058239 PMCID: PMC6353711 DOI: 10.1002/jbio.201800144] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/18/2018] [Revised: 07/23/2018] [Accepted: 07/24/2018] [Indexed: 05/24/2023]
Abstract
Despite considerable advances in guidance of radiofrequency ablation (RFA) therapy for the treatment of cardiac arrhythmias, success rates have been hampered by a lack of tools for precise intraoperative evaluation of lesion extent. Near-infrared spectroscopic (NIRS) techniques are sensitive to tissue structural and biomolecular properties, characteristics that are directly altered by radiofrequency (RF) treatment. In this work, a combined NIRS-RFA catheter is developed for real-time monitoring of tissue reflectance during RF energy delivery. An algorithm is proposed for processing NIR spectra to approximate nonirrigated lesion depth in both atrial and ventricular tissues. The probe optical geometry was designed to bias measurement influence toward absorption enabling enhanced sensitivity to changes in tissue composition. A set of parameters termed "lesion optical indices" are defined encapsulating spectral differences between ablated and unablated tissue. Utilizing these features, a model for real-time tissue spectra classification and lesion size estimation is presented. Experimental validation conducted within freshly excised porcine cardiac specimens showed strong concordance between algorithm estimates and post-hoc tissue assessment.
Collapse
Affiliation(s)
- Rajinder P. Singh-Moon
- Department of Electrical Engineering, Columbia University, 500 W. 120 St, New York, NY 10027, USA
| | - Xinwen Yao
- Department of Electrical Engineering, Columbia University, 500 W. 120 St, New York, NY 10027, USA
| | - Vivek Iyer
- Department of Medicine, Cardiology Division, Columbia University Medical Center, 630 W. 168 St, New York, NY 10032, USA
| | - Charles Marboe
- Department of Pathology and Cell Biology, Columbia University Medical Center, 630 W. 168 St, New York, NY 10032, USA
| | - William Whang
- Department of Medicine, Cardiology Division, Columbia University Medical Center, 630 W. 168 St, New York, NY 10032, USA
- Currently with Department of Medicine, Cardiology Division, Mount Sinai School of Medicine, 1 Gustave L. Levy Place, New York, NY 10029, USA
| | - Christine P. Hendon
- Department of Electrical Engineering, Columbia University, 500 W. 120 St, New York, NY 10027, USA
| |
Collapse
|
18
|
Lo WCY, Uribe-Patarroyo N, Hoebel K, Beaudette K, Villiger M, Nishioka NS, Vakoc BJ, Bouma BE. Balloon catheter-based radiofrequency ablation monitoring in porcine esophagus using optical coherence tomography. BIOMEDICAL OPTICS EXPRESS 2019; 10:2067-2089. [PMID: 31086717 PMCID: PMC6484999 DOI: 10.1364/boe.10.002067] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/03/2018] [Revised: 02/15/2019] [Accepted: 03/12/2019] [Indexed: 05/05/2023]
Abstract
We present a microscopic image guidance platform for radiofrequency ablation (RFA) using a clinical balloon-catheter-based optical coherence tomography (OCT) system, currently used in the surveillance of Barrett's esophagus patients. Our integrated thermal therapy delivery and monitoring platform consists of a flexible, customized bipolar RFA electrode array designed for use with a clinical balloon OCT catheter and a processing algorithm to accurately map the thermal coagulation process. Non-uniform rotation distortion was corrected using a feature tracking-based technique, which enables robust, frame-to-frame analysis of the temporal fluctuation of the complex OCT signal. With proper noise calibration, precise delineation of the thermal therapy zone was demonstrated using cumulative complex differential variance in porcine esophagus ex vivo with the integrated OCT-RFA system, as validated by nitroblue tetrazolium chloride (NBTC) histology. The ability to directly and accurately visualize the thermal coagulation process at high resolution is critical to the precise delivery of thermal energy to a wide range of epithelial lesions.
Collapse
Affiliation(s)
- William C Y Lo
- Wellman Center for Photomedicine, Massachusetts General Hospital and Harvard Medical School, 40 Blossom Street, Boston, Massachusetts 02114, USA
- Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, Massachusetts 02142, USA
| | - Néstor Uribe-Patarroyo
- Wellman Center for Photomedicine, Massachusetts General Hospital and Harvard Medical School, 40 Blossom Street, Boston, Massachusetts 02114, USA
| | - Katharina Hoebel
- Wellman Center for Photomedicine, Massachusetts General Hospital and Harvard Medical School, 40 Blossom Street, Boston, Massachusetts 02114, USA
| | - Kathy Beaudette
- Wellman Center for Photomedicine, Massachusetts General Hospital and Harvard Medical School, 40 Blossom Street, Boston, Massachusetts 02114, USA
| | - Martin Villiger
- Wellman Center for Photomedicine, Massachusetts General Hospital and Harvard Medical School, 40 Blossom Street, Boston, Massachusetts 02114, USA
| | - Norman S Nishioka
- Wellman Center for Photomedicine, Massachusetts General Hospital and Harvard Medical School, 40 Blossom Street, Boston, Massachusetts 02114, USA
- Department of Gastroenterology, Massachusetts General Hospital and Harvard Medical School, 55 Fruit Street, Boston, Massachusetts 02114, USA
| | - Benjamin J Vakoc
- Wellman Center for Photomedicine, Massachusetts General Hospital and Harvard Medical School, 40 Blossom Street, Boston, Massachusetts 02114, USA
- Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, Massachusetts 02142, USA
| | - Brett E Bouma
- Wellman Center for Photomedicine, Massachusetts General Hospital and Harvard Medical School, 40 Blossom Street, Boston, Massachusetts 02114, USA
- Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, Massachusetts 02142, USA
| |
Collapse
|
19
|
Guan S, Asfour H, Sarvazyan N, Loew M. Application of unsupervised learning to hyperspectral imaging of cardiac ablation lesions. J Med Imaging (Bellingham) 2018; 5:046003. [PMID: 30840727 DOI: 10.1117/1.jmi.5.4.046003] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2018] [Accepted: 11/12/2018] [Indexed: 12/24/2022] Open
Abstract
Atrial fibrillation is the most common cardiac arrhythmia. It is being effectively treated using the radiofrequency ablation (RFA) procedure, which destroys culprit tissue and creates scars that prevent the spread of abnormal electrical activity. Long-term success of RFA could be improved further if ablation lesions can be directly visualized during the surgery. We have shown that autofluorescence-based hyperspectral imaging (aHSI) can help to identify lesions based on spectral unmixing. We show that use of k -means clustering, an unsupervised learning method, is capable of detecting RFA lesions without a priori knowledge of the lesions' spectral characteristics. We also show that the number of spectral bands required for successful lesion identification can be significantly reduced, enabling the use of increased spectral bandwidth. Together, these findings can help with clinical implementation of a percutaneous aHSI catheter, since by reducing the number of spectral bands one can reduce hypercube acquisition and processing times, and by increasing the spectral width of individual bands one can collect more photons. The latter is of critical importance in low-light applications such as intracardiac aHSI. The ultimate goal of our studies is to help improve clinical outcomes for atrial fibrillation patients.
Collapse
Affiliation(s)
- Shuyue Guan
- George Washington University, Department of Biomedical Engineering, Washington, DC, United States
| | - Huda Asfour
- George Washington University Medical Center, Department of Pharmacology and Physiology, Washington, DC, United States
| | - Narine Sarvazyan
- George Washington University Medical Center, Department of Pharmacology and Physiology, Washington, DC, United States
| | - Murray Loew
- George Washington University, Department of Biomedical Engineering, Washington, DC, United States
| |
Collapse
|
20
|
Asfour H, Guan S, Muselimyan N, Swift L, Loew M, Sarvazyan N. Optimization of wavelength selection for multispectral image acquisition: a case study of atrial ablation lesions. BIOMEDICAL OPTICS EXPRESS 2018; 9:2189-2204. [PMID: 29760980 PMCID: PMC5946781 DOI: 10.1364/boe.9.002189] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/11/2017] [Revised: 03/08/2018] [Accepted: 04/09/2018] [Indexed: 05/17/2023]
Abstract
In vivo autofluorescence hyperspectral imaging of moving objects can be challenging due to motion artifacts and to the limited amount of acquired photons. To address both limitations, we selectively reduced the number of spectral bands while maintaining accurate target identification. Several downsampling approaches were applied to data obtained from the atrial tissue of adult pigs with sites of radiofrequency ablation lesions. Standard image qualifiers such as the mean square error, the peak signal-to-noise ratio, the structural similarity index map, and an accuracy index of lesion component images were used to quantify the effects of spectral binning, an increased spectral distance between individual bands, as well as random combinations of spectral bands. Results point to several quantitative strategies for deriving combinations of a small number of spectral bands that can successfully detect target tissue. Insights from our studies can be applied to a wide range of applications.
Collapse
Affiliation(s)
- Huda Asfour
- Department of Pharmacology & Physiology, The George Washington University Medical Center, 2300 Eye Street NW, Washington, DC 20037, USA
| | - Shuyue Guan
- Department of Biomedical Engineering, The George Washington University, 800 22nd Street NW, Washington, DC 20052, USA
| | - Narine Muselimyan
- Department of Pharmacology & Physiology, The George Washington University Medical Center, 2300 Eye Street NW, Washington, DC 20037, USA
| | - Luther Swift
- Department of Pharmacology & Physiology, The George Washington University Medical Center, 2300 Eye Street NW, Washington, DC 20037, USA
| | - Murray Loew
- Department of Biomedical Engineering, The George Washington University, 800 22nd Street NW, Washington, DC 20052, USA
| | - Narine Sarvazyan
- Department of Pharmacology & Physiology, The George Washington University Medical Center, 2300 Eye Street NW, Washington, DC 20037, USA
| |
Collapse
|
21
|
Iskander-Rizk S, Kruizinga P, van der Steen AFW, van Soest G. Spectroscopic photoacoustic imaging of radiofrequency ablation in the left atrium. BIOMEDICAL OPTICS EXPRESS 2018; 9:1309-1322. [PMID: 29541523 PMCID: PMC5846533 DOI: 10.1364/boe.9.001309] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/26/2017] [Revised: 01/16/2018] [Accepted: 01/31/2018] [Indexed: 05/20/2023]
Abstract
Catheter-based radiofrequency ablation for atrial fibrillation has long-term success in 60-70% of cases. A better assessment of lesion quality, depth, and continuity could improve the procedure's outcome. We investigate here photoacoustic contrast between ablated and healthy atrial-wall tissue in vitro in wavelengths spanning from 410 nm to 1000 nm. We studied single- and multi-wavelength imaging of ablation lesions and we demonstrate that a two-wavelength technique yields precise detection of lesions, achieving a diagnostic accuracy of 97%. We compare this with a best single-wavelength (640 nm) analysis that correctly identifies 82% of lesions. We discuss the origin of relevant spectroscopic features and perspectives for translation to clinical imaging.
Collapse
Affiliation(s)
- Sophinese Iskander-Rizk
- Biomedical Engineering Department, Thorax Center-Erasmus MC, Wytemaweg 80, 3015 CN Rotterdam, The Netherlands
| | - Pieter Kruizinga
- Biomedical Engineering Department, Thorax Center-Erasmus MC, Wytemaweg 80, 3015 CN Rotterdam, The Netherlands
- ImPhys, Faculty of Applied Sciences, Delft University of Technology, Lorentzweg 1, 2628 CJ Delft, The Netherlands
| | - Antonius F. W. van der Steen
- Biomedical Engineering Department, Thorax Center-Erasmus MC, Wytemaweg 80, 3015 CN Rotterdam, The Netherlands
- ImPhys, Faculty of Applied Sciences, Delft University of Technology, Lorentzweg 1, 2628 CJ Delft, The Netherlands
| | - Gijs van Soest
- Biomedical Engineering Department, Thorax Center-Erasmus MC, Wytemaweg 80, 3015 CN Rotterdam, The Netherlands
| |
Collapse
|
22
|
Swift LM, Asfour H, Muselimyan N, Larson C, Armstrong K, Sarvazyan NA. Hyperspectral imaging for label-free in vivo identification of myocardial scars and sites of radiofrequency ablation lesions. Heart Rhythm 2017; 15:564-575. [PMID: 29246829 DOI: 10.1016/j.hrthm.2017.12.014] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/29/2017] [Indexed: 12/14/2022]
Abstract
BACKGROUND Treatment of cardiac arrhythmias often involves ablating viable muscle tissue within or near islands of scarred myocardium. Yet, today there are limited means by which the boundaries of such scars can be visualized during surgery and distinguished from the sites of acute injury caused by radiofrequency (RF) ablation. OBJECTIVE We sought to explore a hyperspectral imaging (HSI) methodology to delineate and distinguish scar tissue from tissue injury caused by RF ablation. METHODS RF ablation of the ventricular surface of live rats that underwent thoracotomy was followed by a 2-month animal recovery period. During a second surgery, new RF lesions were placed next to the scarred tissue from the previous ablation procedure. The myocardial infarction model was used as an alternative way to create scar tissue. RESULTS Excitation-emission matrices acquired from the sites of RF lesions, scar region, and the surrounding unablated tissue revealed multiple spectral changes. These findings justified HSI of the heart surface using illumination with 365 nm UV light while acquiring spectral images within the visible range. Autofluorescence-based HSI enabled to distinguish sites of RF lesions from scar or unablated myocardium in open-chest rats. A pilot version of a percutaneous HSI catheter was used to demonstrate the feasibility of RF lesion visualization in atrial tissue of live pigs. CONCLUSION HSI based on changes in tissue autofluorescence is a highly effective tool for revealing-in vivo and with high spatial resolution-surface boundaries of myocardial scar and discriminating it from areas of acute necrosis caused by RF ablation.
Collapse
Affiliation(s)
- Luther M Swift
- The George Washington University School of Medicine and Health Sciences, Washington, District of Columbia
| | - Huda Asfour
- The George Washington University School of Medicine and Health Sciences, Washington, District of Columbia
| | - Narine Muselimyan
- The George Washington University School of Medicine and Health Sciences, Washington, District of Columbia
| | | | | | - Narine A Sarvazyan
- The George Washington University School of Medicine and Health Sciences, Washington, District of Columbia.
| |
Collapse
|
23
|
Melby DP. Catheter Ablation of Atrial Fibrillation: A Review of the Current Status and Future Directions. J Innov Card Rhythm Manag 2017; 8:2907-2917. [PMID: 32477760 PMCID: PMC7252758 DOI: 10.19102/icrm.2017.081101] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2017] [Accepted: 08/19/2017] [Indexed: 11/20/2022] Open
Abstract
Atrial fibrillation (AF) is one of the most common arrhythmias encountered in clinical practice today. Over the last 20 years, the frequency of use of catheter ablation to treat AF has grown, commensurate with the rise in arrhythmia burden and via a number of technical advancements. These developments can be divided into new techniques for myocardial ablation, improvements in the understanding of AF trigger mechanisms, and advancements in atrial mapping. Progress in these fields has led to a fundamental change in daily practice, and has contributed to a rise, for ablation, from a procedure performed infrequently at select centers to one that is commonplace worldwide. In this article, the data and methods leading to this fundamental change will be presented and discussed.
Collapse
Affiliation(s)
- Daniel P Melby
- Minneapolis Heart Institute at Abbott Northwestern Hospital, Minneapolis, MN, USA
| |
Collapse
|
24
|
Muselimyan N, Jishi MA, Asfour H, Swift L, Sarvazyan NA. Anatomical and Optical Properties of Atrial Tissue: Search for a Suitable Animal Model. Cardiovasc Eng Technol 2017; 8:505-514. [PMID: 28884368 DOI: 10.1007/s13239-017-0329-7] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/09/2017] [Accepted: 08/28/2017] [Indexed: 12/12/2022]
Abstract
The purpose of this study was to evaluate structural and optical properties of atrial tissue from common animal models and to compare it with human atria. We aimed to do this in a format that will be useful for development of better ablation tools and/or new means for visualizing atrial lesions. Human atrial tissue from clinically relevant age group was compared and contrasted with atrial tissue of large animal models commonly available for research purposes. These included pigs, sheep, dogs and cows. The presented data include area measurements of smooth atrial surface available for ablation and estimates of thickness of collagen and muscle for five different species. We also described methods to quantify presence of collagen and overall thickness of atrial wall. Provided information enables placement of atrial lesions to locations with clinically relevant atrial wall thickness and macroscopic structure ultimately helping investigators to develop better ablation and imaging tools. It also highlights the impact of collagen thickness on optical measurements and lesion visualization.
Collapse
Affiliation(s)
- Narine Muselimyan
- Department of Pharmacology and Physiology, The George Washington University School of Medicine and Health Sciences, 2300 Eye Street NW, Washington, DC, 20052, USA
| | - Mohammed Al Jishi
- Department of Pharmacology and Physiology, The George Washington University School of Medicine and Health Sciences, 2300 Eye Street NW, Washington, DC, 20052, USA
| | - Huda Asfour
- Department of Pharmacology and Physiology, The George Washington University School of Medicine and Health Sciences, 2300 Eye Street NW, Washington, DC, 20052, USA
| | - Luther Swift
- Department of Pharmacology and Physiology, The George Washington University School of Medicine and Health Sciences, 2300 Eye Street NW, Washington, DC, 20052, USA
| | - Narine A Sarvazyan
- Department of Pharmacology and Physiology, The George Washington University School of Medicine and Health Sciences, 2300 Eye Street NW, Washington, DC, 20052, USA.
| |
Collapse
|
25
|
Muselimyan N, Swift LM, Asfour H, Chahbazian T, Mazhari R, Mercader MA, Sarvazyan NA. Seeing the Invisible: Revealing Atrial Ablation Lesions Using Hyperspectral Imaging Approach. PLoS One 2016; 11:e0167760. [PMID: 27930718 PMCID: PMC5145191 DOI: 10.1371/journal.pone.0167760] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2016] [Accepted: 11/18/2016] [Indexed: 01/11/2023] Open
Abstract
Background Currently, there are limited means for high-resolution monitoring of tissue injury during radiofrequency ablation procedures. Objective To develop the next generation of visualization catheters that can reveal irreversible atrial muscle damage caused by ablation and identify viability gaps between the lesions. Methods Radiofrequency lesions were placed on the endocardial surfaces of excised human and bovine atria and left ventricles of blood perfused rat hearts. Tissue was illuminated with 365nm light and a series of images were acquired from individual spectral bands within 420-720nm range. By extracting spectral profiles of individual pixels and spectral unmixing, the relative contribution of ablated and unablated spectra to each pixel was then displayed. Results of spectral unmixing were compared to lesion pathology. Results RF ablation caused significant changes in the tissue autofluorescence profile. The magnitude of these spectral changes in human left atrium was relatively small (< 10% of peak fluorescence value), yet highly significant. Spectral unmixing of hyperspectral datasets enabled high spatial resolution, in-situ delineation of radiofrequency lesion boundaries without the need for exogenous markers. Lesion dimensions derived from hyperspectral imaging approach strongly correlated with histological outcomes. Presence of blood within the myocardium decreased the amplitude of the autofluorescence spectra while having minimal effect on their overall shapes. As a result, the ability of hyperspectral imaging to delineate ablation lesions in vivo was not affected. Conclusions Hyperspectral imaging greatly increases the contrast between ablated and unablated tissue enabling visualization of viability gaps at clinically relevant locations. Data supports the possibility for developing percutaneous hyperspectral catheters for high-resolution ablation guidance.
Collapse
Affiliation(s)
- Narine Muselimyan
- Department of Pharmacology and Physiology, The George Washington University School of Medicine and Health Sciences, Washington, District of Columbia, United States of America
| | - Luther M. Swift
- Department of Pharmacology and Physiology, The George Washington University School of Medicine and Health Sciences, Washington, District of Columbia, United States of America
| | - Huda Asfour
- Department of Pharmacology and Physiology, The George Washington University School of Medicine and Health Sciences, Washington, District of Columbia, United States of America
| | | | - Ramesh Mazhari
- Division of Cardiology, The George Washington University, Medical Faculty Associates, Washington, District of Columbia, United States of America
| | - Marco A. Mercader
- Division of Cardiology, The George Washington University, Medical Faculty Associates, Washington, District of Columbia, United States of America
| | - Narine A. Sarvazyan
- Department of Pharmacology and Physiology, The George Washington University School of Medicine and Health Sciences, Washington, District of Columbia, United States of America
- * E-mail:
| |
Collapse
|