1
|
Zhang H, Gu C, Lan Q, Zhang W, Liu C, Yang J. Learning-based distortion correction enables proximal-scanning endoscopic OCT elastography. BIOMEDICAL OPTICS EXPRESS 2024; 15:4345-4364. [PMID: 39022540 PMCID: PMC11249688 DOI: 10.1364/boe.528522] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/26/2024] [Revised: 06/13/2024] [Accepted: 06/14/2024] [Indexed: 07/20/2024]
Abstract
Proximal rotary scanning is predominantly used in the clinical practice of endoscopic and intravascular OCT, mainly because of the much lower manufacturing cost of the probe compared to distal scanning. However, proximal scanning causes severe beam stability issues (also known as non-uniform rotational distortion, NURD), which hinders the extension of its applications to functional imaging, such as OCT elastography (OCE). In this work, we demonstrate the abilities of learning-based NURD correction methods to enable the imaging stability required for intensity-based OCE. Compared with the previous learning-based NURD correction methods that use pseudo distortion vectors for model training, we propose a method to extract real distortion vectors from a specific endoscopic OCT system, and validate its superiority in accuracy under both convolutional-neural-network- and transformer-based learning architectures. We further verify its effectiveness in elastography calculations (digital image correlation and optical flow) and the advantages of our method over other NURD correction methods. Using the air pressure of a balloon catheter as a mechanical stimulus, our proximal-scanning endoscopic OCE could effectively differentiate between areas of varying stiffness of atherosclerotic vascular phantoms. Compared with the existing endoscopic OCE methods that measure only in the radial direction, our method could achieve 2D displacement/strain distribution in both radial and circumferential directions.
Collapse
Affiliation(s)
- Haoran Zhang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Chengfu Gu
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Qi Lan
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Weiyi Zhang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Chang Liu
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Jianlong Yang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
2
|
Turker-Burhan M, Ellidokuz EB, Bagriyanik HA, Tozburun S. An endoscopic approach providing near-infrared laser-induced coagulation with accurate depth limits. JOURNAL OF BIOPHOTONICS 2024; 17:e202300377. [PMID: 38247032 DOI: 10.1002/jbio.202300377] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Revised: 12/07/2023] [Accepted: 12/07/2023] [Indexed: 01/23/2024]
Abstract
This article investigates an endoscopic approach that utilizes negative pressure to achieve laser-induced thermal coagulation limited to the esophageal wall's mucosal and superficial submucosal layers. The study was built upon a series of studies combining numerical simulation based on the Monte-Carlo technique and ex vivo porcine tissue experiments, including apparatus design and histology analysis. An endoscopy apparatus was developed using 3D printing to validate the tissue stretching-based approach. A fiber-pigtailed diode was used as the near-infrared source, emitting 208.8 W/cm2 laser irradiance at 1.5 μm. Simulation results suggested that the approach successfully created a local heat well to prevent residual thermal effects (>65°C) from penetrating the deeper submucosal layer. Histology analysis of ex vivo tissues showed that at a fluence of 5.22 kJ/cm2, the depth of thermal coagulation was reduced by half compared to the control. With further preclinical studies, including endoscopy apparatus design, the approach can be applied to the larger esophageal surface.
Collapse
Affiliation(s)
- Merve Turker-Burhan
- Izmir Biomedicine and Genome Center, Izmir, Turkey
- Izmir International Biomedicine and Genome Institute, Dokuz Eylul University, Izmir, Türkiye
| | - Ender Berat Ellidokuz
- Izmir Biomedicine and Genome Center, Izmir, Turkey
- Department of Internal Medicine Gastroenterology, Faculty of Medicine, Dokuz Eylul University, Izmir, Türkiye
| | - Husnu Alper Bagriyanik
- Izmir Biomedicine and Genome Center, Izmir, Turkey
- Department of Histology and Embryology, Faculty of Medicine, Dokuz Eylul University, Izmir, Türkiye
| | - Serhat Tozburun
- Izmir Biomedicine and Genome Center, Izmir, Turkey
- Izmir International Biomedicine and Genome Institute, Dokuz Eylul University, Izmir, Türkiye
- Department of Biophysics, Faculty of Medicine, Dokuz Eylul University, Izmir, Türkiye
| |
Collapse
|
3
|
Zhang H, Yang J, Zhang J, Zhao S, Zhang A. Cross-attention learning enables real-time nonuniform rotational distortion correction in OCT. BIOMEDICAL OPTICS EXPRESS 2024; 15:319-335. [PMID: 38223193 PMCID: PMC10783899 DOI: 10.1364/boe.512337] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Accepted: 12/13/2023] [Indexed: 01/16/2024]
Abstract
Nonuniform rotational distortion (NURD) correction is vital for endoscopic optical coherence tomography (OCT) imaging and its functional extensions, such as angiography and elastography. Current NURD correction methods require time-consuming feature tracking/registration or cross-correlation calculations and thus sacrifice temporal resolution. Here we propose a cross-attention learning method for the NURD correction in OCT. Our method is inspired by the recent success of the self-attention mechanism in natural language processing and computer vision. By leveraging its ability to model long-range dependencies, we can directly obtain the spatial correlation between OCT A-lines at any distance, thus accelerating the NURD correction. We develop an end-to-end stacked cross-attention network and design three types of optimization constraints. We compare our method with two traditional feature-based methods and a CNN-based method on two publicly-available endoscopic OCT datasets. We further verify the NURD correction performance of our method on 3D stent reconstruction using a home-built endoscopic OCT system. Our method achieves a ∼3 × speedup to real time (26 ± 3 fps), and superior correction performance.
Collapse
Affiliation(s)
- Haoran Zhang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Jianlong Yang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Jingqian Zhang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Shiqing Zhao
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Aili Zhang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
4
|
Gunalan A, Mattos LS. Towards OCT-Guided Endoscopic Laser Surgery-A Review. Diagnostics (Basel) 2023; 13:diagnostics13040677. [PMID: 36832167 PMCID: PMC9955820 DOI: 10.3390/diagnostics13040677] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2022] [Revised: 02/03/2023] [Accepted: 02/09/2023] [Indexed: 02/16/2023] Open
Abstract
Optical Coherence Tomography (OCT) is an optical imaging technology occupying a unique position in the resolution vs. imaging depth spectrum. It is already well established in the field of ophthalmology, and its application in other fields of medicine is growing. This is motivated by the fact that OCT is a real-time sensing technology with high sensitivity to precancerous lesions in epithelial tissues, which can be exploited to provide valuable information to clinicians. In the prospective case of OCT-guided endoscopic laser surgery, these real-time data will be used to assist surgeons in challenging endoscopic procedures in which high-power lasers are used to eradicate diseases. The combination of OCT and laser is expected to enhance the detection of tumors, the identification of tumor margins, and ensure total disease eradication while avoiding damage to healthy tissue and critical anatomical structures. Therefore, OCT-guided endoscopic laser surgery is an important nascent research area. This paper aims to contribute to this field with a comprehensive review of state-of-the-art technologies that may be exploited as the building blocks for achieving such a system. The paper begins with a review of the principles and technical details of endoscopic OCT, highlighting challenges and proposed solutions. Then, once the state of the art of the base imaging technology is outlined, the new OCT-guided endoscopic laser surgery frontier is reviewed. Finally, the paper concludes with a discussion on the constraints, benefits and open challenges associated with this new type of surgical technology.
Collapse
Affiliation(s)
- Ajay Gunalan
- Department of Advanced Robotics, Istituto Italiano di Tecnologia, 16163 Genoa, Italy
- Department of Informatics, Bioengineering, Robotics and Systems Engineering, University of Genoa, 16145 Genoa, Italy
| | - Leonardo S. Mattos
- Department of Advanced Robotics, Istituto Italiano di Tecnologia, 16163 Genoa, Italy
- Correspondence:
| |
Collapse
|
5
|
Double-Clad Fiber-Based Multifunctional Biosensors and Multimodal Bioimaging Systems: Technology and Applications. BIOSENSORS 2022; 12:bios12020090. [PMID: 35200350 PMCID: PMC8869713 DOI: 10.3390/bios12020090] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/24/2021] [Revised: 01/25/2022] [Accepted: 01/27/2022] [Indexed: 12/27/2022]
Abstract
Optical fibers have been used to probe various tissue properties such as temperature, pH, absorption, and scattering. Combining different sensing and imaging modalities within a single fiber allows for increased sensitivity without compromising the compactness of an optical fiber probe. A double-clad fiber (DCF) can sustain concurrent propagation modes (single-mode, through its core, and multimode, through an inner cladding), making DCFs ideally suited for multimodal approaches. This study provides a technological review of how DCFs are used to combine multiple sensing functionalities and imaging modalities. Specifically, we discuss the working principles of DCF-based sensors and relevant instrumentation as well as fiber probe designs and functionalization schemes. Secondly, we review different applications using a DCF-based probe to perform multifunctional sensing and multimodal bioimaging.
Collapse
|
6
|
Bouma B, de Boer J, Huang D, Jang I, Yonetsu T, Leggett C, Leitgeb R, Sampson D, Suter M, Vakoc B, Villiger M, Wojtkowski M. Optical coherence tomography. NATURE REVIEWS. METHODS PRIMERS 2022; 2:79. [PMID: 36751306 PMCID: PMC9901537 DOI: 10.1038/s43586-022-00162-2] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/09/2023]
Abstract
Optical coherence tomography (OCT) is a non-contact method for imaging the topological and internal microstructure of samples in three dimensions. OCT can be configured as a conventional microscope, as an ophthalmic scanner, or using endoscopes and small diameter catheters for accessing internal biological organs. In this Primer, we describe the principles underpinning the different instrument configurations that are tailored to distinct imaging applications and explain the origin of signal, based on light scattering and propagation. Although OCT has been used for imaging inanimate objects, we focus our discussion on biological and medical imaging. We examine the signal processing methods and algorithms that make OCT exquisitely sensitive to reflections as weak as just a few photons and that reveal functional information in addition to structure. Image processing, display and interpretation, which are all critical for effective biomedical imaging, are discussed in the context of specific applications. Finally, we consider image artifacts and limitations that commonly arise and reflect on future advances and opportunities.
Collapse
Affiliation(s)
- B.E. Bouma
- Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, MA, USA,Institute for Medical Engineering and Physics, Massachusetts Institute of Technology, Cambridge, MA, USA,Harvard Medical School, Boston, MA, USA,Corresponding author:
| | - J.F. de Boer
- Department of Physics and Astronomy, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - D. Huang
- Casey Eye Institute, Oregon Health and Science University, Portland, OR, USA
| | - I.K. Jang
- Harvard Medical School, Boston, MA, USA,Cardiology Division, Massachusetts General Hospital, Boston, MA, USA
| | - T. Yonetsu
- Department of Cardiovascular Medicine, Tokyo Medical and Dental University
| | - C.L. Leggett
- Division of Gastroenterology and Hepatology, Mayo Clinic, Rochester, MN, USA
| | - R. Leitgeb
- Institute of Medical Physics, University of Vienna, Wien, Austria
| | - D.D. Sampson
- School of Physics and School of Biosciences and Medicine, University of Surrey, Guildford, United Kingdom
| | - M. Suter
- Harvard Medical School, Boston, MA, USA,Division of Pulmonary and Critical Care Medicine, Massachusetts General Hospital, Boston, MA, USA
| | - B. Vakoc
- Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, MA, USA,Harvard Medical School, Boston, MA, USA
| | - M. Villiger
- Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, MA, USA,Harvard Medical School, Boston, MA, USA
| | - M. Wojtkowski
- Institute of Physical Chemistry and International Center for Translational Eye Research, Institute of Physical Chemistry, Polish Academy of Sciences, Warsaw, Poland,Faculty of Physics, Astronomy and Informatics, Nicolaus Copernicus University, Torun, Poland
| |
Collapse
|
7
|
Maltais-Tariant R, Boudoux C, Uribe-Patarroyo N. Real-time co-localized OCT surveillance of laser therapy using motion corrected speckle decorrelation. BIOMEDICAL OPTICS EXPRESS 2020; 11:2925-2950. [PMID: 32637233 PMCID: PMC7316020 DOI: 10.1364/boe.385654] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/12/2019] [Revised: 03/19/2020] [Accepted: 04/09/2020] [Indexed: 05/27/2023]
Abstract
We present a system capable of real-time delivery and monitoring of laser therapy by imaging with optical coherence tomography (OCT) through a double-clad fiber (DCF). A double-clad fiber coupler is used to inject and collect OCT light into the core of a DCF and inject the therapy light into its larger inner cladding, allowing for both imaging and therapy to be perfectly coregistered. Monitoring of treatment depth is achieved by calculating the speckle intensity decorrelation occurring during tissue coagulation. Furthermore, an analytical noise correction was used on the correlation to extend the maximum monitoring depth. We also present a method for correcting motion-induced decorrelation using a lookup table. Using the value of the noise- and motion-corrected correlation coefficient in a novel approach, our system is capable of identifying the depth of thermal coagulation in real time and automatically shut the therapy laser off when the targeted depth is reached. The process is demonstrated ex vivo in rat tongue and abdominal muscles for depths ranging from 500 µm to 1000 µm with induced motion in real time.
Collapse
Affiliation(s)
- Raphaël Maltais-Tariant
- Polytechnique Montréal, Department of Engineering Physics, 2900 Boulevard Edouard-Montpetit, Montreal, Qc, Canada
| | - Caroline Boudoux
- Polytechnique Montréal, Department of Engineering Physics, 2900 Boulevard Edouard-Montpetit, Montreal, Qc, Canada
- Castor Optics Inc., 361 Boul Montpellier, St-Laurent, Qc, Canada
| | - Néstor Uribe-Patarroyo
- Wellman Center for Photomedicine, Harvard Medical School and Massachusetts General Hospital, 40 Blossom Street, Boston, Massachusetts 02114, USA
| |
Collapse
|
8
|
Tozburun S. Superficial photothermal laser ablation of ex vivo sheep esophagus using a cone-shaped optical fiber tip. JOURNAL OF BIOPHOTONICS 2020; 13:e201960116. [PMID: 32134552 DOI: 10.1002/jbio.201960116] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/16/2019] [Revised: 02/28/2020] [Accepted: 02/29/2020] [Indexed: 06/10/2023]
Abstract
Superficial photothermal laser ablation (SPLA) may be useful as a therapeutic approach producing a depth of injury that is sufficient to eliminate mucosal lesion but not deep enough to induce thermal effects in deeper tissue layers. The purpose of this preliminary study is twofold: (a) to describe design steps of a fiber probe capable of delivering a tightly focused laser beam, including Monte-Carlo-based simulations, and (b) to complete the initial testing of the probe in a sheep esophagus model, ex vivo. The cone-shaped (tapered) fiber tip was obtained by chemical etching of the optical fiber. A 1505 nm diode laser providing power up to 500 mW was operated in continuous wave. The successful SPLA of the sheep mucosa layer was demonstrated for various speed-power combinations, including 300 mW laser power at a surface scanning rate of 0.5 mm/s and 450 mW laser power at a surface scanning rate of 2.0 mm/s. Upon further development, this probe may be useful for endoscopic photothermal laser ablation of the mucosa layer using relatively low laser power.
Collapse
Affiliation(s)
- Serhat Tozburun
- Izmir Biomedicine and Genome Center, Izmir, Turkey
- Izmir International Biomedicine and Genome Institute, Dokuz Eylul University, Izmir, Turkey
- Department of Biophysics, Faculty of Medicine, Dokuz Eylul University, Izmir, Turkey
| |
Collapse
|
9
|
Uribe-Patarroyo N, Post AL, Ruiz-Lopera S, Faber DJ, Bouma BE. Noise and bias in optical coherence tomography intensity signal decorrelation. OSA CONTINUUM 2020; 3:709-741. [PMID: 34085035 PMCID: PMC8171193 DOI: 10.1364/osac.385431] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
Functional optical coherence tomography (OCT) imaging based on the decorrelation of the intensity signal has been used extensively in angiography and is finding use in flowmetry and therapy monitoring. In this work, we present a rigorous analysis of the autocorrelation function, introduce the concepts of contrast bias, statistical bias and variability, and identify the optimal definition of the second-order autocorrelation function (ACF) g (2) to improve its estimation from limited data. We benchmark different averaging strategies in reducing statistical bias and variability. We also developed an analytical correction for the noise contributions to the decorrelation of the ACF in OCT that extends the signal-to-noise ratio range in which ACF analysis can be used. We demonstrate the use of all the tools developed in the experimental determination of the lateral speckle size depth dependence in a rotational endoscopic probe with low NA, and we show the ability to more accurately determine the rotational speed of an endoscopic probe to implement NURD detection. We finally present g (2)-based angiography of the finger nailbed, demonstrating the improved results from noise correction and the optimal bias mitigation strategies.
Collapse
Affiliation(s)
- Néstor Uribe-Patarroyo
- Wellman Center for Photomedicine, Harvard Medical School and Massachusetts General Hospital, 40 Blossom Street, MA 02114, USA
| | - Anouk L. Post
- Amsterdam UMC, University of Amsterdam, Department of Biomedical Engineering and Physics, Cancer Center Amsterdam, Amsterdam Cardiovascular Sciences, Meibergdreef 9, 1105 AZ, Amsterdam, The Netherlands
- These authors contributed equally to this work and are listed in alphabetical order
| | - Sebastián Ruiz-Lopera
- Applied Optics Group, Universidad EAFIT, Carrera 49 # 7 Sur-50, Medellín, Colombia
- These authors contributed equally to this work and are listed in alphabetical order
| | - Dirk J. Faber
- Amsterdam UMC, University of Amsterdam, Department of Biomedical Engineering and Physics, Cancer Center Amsterdam, Amsterdam Cardiovascular Sciences, Meibergdreef 9, 1105 AZ, Amsterdam, The Netherlands
| | - Brett E. Bouma
- Wellman Center for Photomedicine, Harvard Medical School and Massachusetts General Hospital, 40 Blossom Street, MA 02114, USA
- Institute for Medical Engineering and Science, Massachussets Institute of Technology, Cambridge, MA 02142, USA
| |
Collapse
|
10
|
Mora OC, Zanne P, Zorn L, Nageotte F, Zulina N, Gravelyn S, Montgomery P, de Mathelin M, Dallemagne B, Gora MJ. Steerable OCT catheter for real-time assistance during teleoperated endoscopic treatment of colorectal cancer. BIOMEDICAL OPTICS EXPRESS 2020; 11:1231-1243. [PMID: 32206405 PMCID: PMC7075597 DOI: 10.1364/boe.381357] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/04/2019] [Revised: 12/22/2019] [Accepted: 12/27/2019] [Indexed: 05/06/2023]
Abstract
When detected early, colorectal cancer can be treated with minimally invasive flexible endoscopy. However, since only specialized experts can delineate margins and perform endoscopic resections of lesions, patients still often undergo colon resections. To better assist in the performance of surgical tasks, a robotized flexible interventional endoscope was previously developed, having two additional side channels for surgical instrument. We propose to enhance the imaging capabilities of this device by combining it with optical coherence tomography (OCT). For this purpose, we have developed a new steerable OCT instrument with an outer diameter of 3.5 mm. The steerable instrument is terminated with a 2 cm long transparent sheath to allow three-dimensional OCT imaging using a side-focusing optical probe with two external scanning actuators. The instrument is connected to an OCT imaging system built around the OCT Axsun engine, with a 1310 nm center wavelength swept source laser and 100 kHz A-line rate. Once inserted in one of the side channels of the robotized endoscope, bending, rotation and translation of the steerable OCT instrument can be controlled by a physician using a joystick. Ex vivo and in vivo tests show that the novel, steerable and teleoperated OCT device enhances dexterity, allowing for inspection of the surgical field without the need for changing the position of the main endoscope.
Collapse
Affiliation(s)
- Oscar Caravaca Mora
- ICube Laboratory, CNRS, Strasbourg University, 4, rue Kirschleger - 67085 Strasbourg Cedex, France
| | - Philippe Zanne
- ICube Laboratory, CNRS, Strasbourg University, 4, rue Kirschleger - 67085 Strasbourg Cedex, France
| | - Lucile Zorn
- ICube Laboratory, CNRS, Strasbourg University, 4, rue Kirschleger - 67085 Strasbourg Cedex, France
| | - Florent Nageotte
- ICube Laboratory, CNRS, Strasbourg University, 4, rue Kirschleger - 67085 Strasbourg Cedex, France
| | - Natalia Zulina
- ICube Laboratory, CNRS, Strasbourg University, 4, rue Kirschleger - 67085 Strasbourg Cedex, France
| | - Sara Gravelyn
- ICube Laboratory, CNRS, Strasbourg University, 4, rue Kirschleger - 67085 Strasbourg Cedex, France
| | - Paul Montgomery
- ICube Laboratory, CNRS, Strasbourg University, 4, rue Kirschleger - 67085 Strasbourg Cedex, France
| | - Michel de Mathelin
- ICube Laboratory, CNRS, Strasbourg University, 4, rue Kirschleger - 67085 Strasbourg Cedex, France
| | - Bernard Dallemagne
- IRCAD - Hôpitaux Universitaires - 1, place de l'Hôpital - 67091 Strasbourg Cedex, France
| | - Michalina J Gora
- ICube Laboratory, CNRS, Strasbourg University, 4, rue Kirschleger - 67085 Strasbourg Cedex, France
| |
Collapse
|