1
|
Yuan S, Xu C, Cui B, Zhang T, Liang B, Yuan W, Ren H. Motor-free telerobotic endomicroscopy for steerable and programmable imaging in complex curved and localized areas. Nat Commun 2024; 15:7680. [PMID: 39227604 PMCID: PMC11372151 DOI: 10.1038/s41467-024-51633-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2024] [Accepted: 08/12/2024] [Indexed: 09/05/2024] Open
Abstract
Intraluminal epithelial abnormalities, potential precursors to significant conditions like cancer, necessitate early detection for improved prognosis. We present a motor-free telerobotic optical coherence tomography (OCT) endoscope that offers high-resolution intraluminal imaging and overcomes the limitations of traditional systems in navigating curved lumens. This system incorporates a compact magnetic rotor with a rotatable diametrically magnetized cylinder permanent magnet (RDPM) and a reflector, effectively mitigating thermal and electrical risks by utilizing an external magnetic field to maintain temperature increases below 0.5 °C and generated voltage under 0.02 mV. Additionally, a learning-based method corrects imaging distortions resulting from nonuniform rotational speeds. Demonstrating superior maneuverability, the device achieves steerable angles up to 110° and operates effectively in vivo, providing distortion-free 3D programmable imaging in mouse colons. This advancement represents a significant step towards guidewire-independent endomicroscopy, enhancing both safety and potential patient outcomes.
Collapse
Affiliation(s)
- Sishen Yuan
- Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Chao Xu
- Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Beilei Cui
- Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Tinghua Zhang
- Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Baijia Liang
- Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Wu Yuan
- Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China.
| | - Hongliang Ren
- Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China.
| |
Collapse
|
2
|
Malone J, Hill C, Tanskanen A, Liu K, Ng S, MacAulay C, Poh CF, Lane PM. Imaging Biomarkers of Oral Dysplasia and Carcinoma Measured with In Vivo Endoscopic Optical Coherence Tomography. Cancers (Basel) 2024; 16:2751. [PMID: 39123478 PMCID: PMC11311571 DOI: 10.3390/cancers16152751] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2024] [Revised: 07/27/2024] [Accepted: 07/30/2024] [Indexed: 08/12/2024] Open
Abstract
Optical coherence tomography is a noninvasive imaging technique that provides three-dimensional visualization of subsurface tissue structures. OCT has been proposed and explored in the literature as a tool to assess oral cancer status, select biopsy sites, or identify surgical margins. Our endoscopic OCT device can generate widefield (centimeters long) imaging of lesions at any location in the oral cavity-but it is challenging for raters to quantitatively assess and score large volumes of data. Leveraging a previously developed epithelial segmentation network, this work develops quantifiable biomarkers that provide direct measurements of tissue properties in three dimensions. We hypothesize that features related to morphology, tissue attenuation, and contrast between tissue layers will be able to provide a quantitative assessment of disease status (dysplasia through carcinoma). This work retrospectively assesses seven biomarkers on a lesion-contralateral matched OCT dataset of the lateral and ventral tongue (40 patients, 70 sites). Epithelial depth and loss of epithelial-stromal boundary visualization provide the strongest discrimination between disease states. The stroma optical attenuation coefficient provides a distinction between benign lesions from dysplasia and carcinoma. The stratification biomarkers visualize subsurface changes, which provides potential for future utility in biopsy site selection or treatment margin delineation.
Collapse
Affiliation(s)
- Jeanie Malone
- Department of Integrative Oncology, British Columbia Cancer Research Institute, 675 W 10th Ave., Vancouver, BC V5Z 1L3, Canada (P.M.L.)
- School of Biomedical Engineering, University of British Columbia, 251-2222 Health Sciences Mall, Vancouver, BC V6T 1Z3, Canada
| | - Chloe Hill
- Department of Integrative Oncology, British Columbia Cancer Research Institute, 675 W 10th Ave., Vancouver, BC V5Z 1L3, Canada (P.M.L.)
- School of Engineering Science, Simon Fraser University, 8888 University Drive, Burnaby, BC V5A 1S6, Canada
| | - Adrian Tanskanen
- Department of Integrative Oncology, British Columbia Cancer Research Institute, 675 W 10th Ave., Vancouver, BC V5Z 1L3, Canada (P.M.L.)
- School of Biomedical Engineering, University of British Columbia, 251-2222 Health Sciences Mall, Vancouver, BC V6T 1Z3, Canada
| | - Kelly Liu
- Department of Integrative Oncology, British Columbia Cancer Research Institute, 675 W 10th Ave., Vancouver, BC V5Z 1L3, Canada (P.M.L.)
- Department of Oral Biological and Medical Sciences, Faculty of Dentistry, University of British Columbia, 350-2194 Health Sciences Mall, Vancouver, BC V6T 1Z3, Canada
| | - Samson Ng
- Department of Oral Biological and Medical Sciences, Faculty of Dentistry, University of British Columbia, 350-2194 Health Sciences Mall, Vancouver, BC V6T 1Z3, Canada
| | - Calum MacAulay
- Department of Integrative Oncology, British Columbia Cancer Research Institute, 675 W 10th Ave., Vancouver, BC V5Z 1L3, Canada (P.M.L.)
- Department of Pathology and Laboratory Medicine, University of British Columbia and Vancouver General Hospital, G227-2211 Wesbrook Mall, Vancouver, BC V6 T 1Z7, Canada
| | - Catherine F. Poh
- Department of Integrative Oncology, British Columbia Cancer Research Institute, 675 W 10th Ave., Vancouver, BC V5Z 1L3, Canada (P.M.L.)
- Department of Oral Biological and Medical Sciences, Faculty of Dentistry, University of British Columbia, 350-2194 Health Sciences Mall, Vancouver, BC V6T 1Z3, Canada
| | - Pierre M. Lane
- Department of Integrative Oncology, British Columbia Cancer Research Institute, 675 W 10th Ave., Vancouver, BC V5Z 1L3, Canada (P.M.L.)
- School of Biomedical Engineering, University of British Columbia, 251-2222 Health Sciences Mall, Vancouver, BC V6T 1Z3, Canada
- School of Engineering Science, Simon Fraser University, 8888 University Drive, Burnaby, BC V5A 1S6, Canada
| |
Collapse
|
3
|
Song P, Wang R, Loetgering L, Liu J, Vouras P, Lee Y, Jiang S, Feng B, Maiden A, Yang C, Zheng G. Ptycho-endoscopy on a lensless ultrathin fiber bundle tip. LIGHT, SCIENCE & APPLICATIONS 2024; 13:168. [PMID: 39019852 PMCID: PMC11255264 DOI: 10.1038/s41377-024-01510-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/30/2024] [Revised: 06/10/2024] [Accepted: 06/25/2024] [Indexed: 07/19/2024]
Abstract
Synthetic aperture radar (SAR) utilizes an aircraft-carried antenna to emit electromagnetic pulses and detect the returning echoes. As the aircraft travels across a designated area, it synthesizes a large virtual aperture to improve image resolution. Inspired by SAR, we introduce synthetic aperture ptycho-endoscopy (SAPE) for micro-endoscopic imaging beyond the diffraction limit. SAPE operates by hand-holding a lensless fiber bundle tip to record coherent diffraction patterns from specimens. The fiber cores at the distal tip modulate the diffracted wavefield within a confined area, emulating the role of the 'airborne antenna' in SAR. The handheld operation introduces positional shifts to the tip, analogous to the aircraft's movement. These shifts facilitate the acquisition of a ptychogram and synthesize a large virtual aperture extending beyond the bundle's physical limit. We mitigate the influences of hand motion and fiber bending through a low-rank spatiotemporal decomposition of the bundle's modulation profile. Our tests demonstrate the ability to resolve a 548-nm linewidth on a resolution target. The achieved space-bandwidth product is ~1.1 million effective pixels, representing a 36-fold increase compared to that of the original fiber bundle. Furthermore, SAPE's refocusing capability enables imaging over an extended depth of field exceeding 2 cm. The aperture synthesizing process in SAPE surpasses the diffraction limit set by the probe's maximum collection angle, opening new opportunities for both fiber-based and distal-chip endoscopy in applications such as medical diagnostics and industrial inspection.
Collapse
Affiliation(s)
- Pengming Song
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA.
| | - Ruihai Wang
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - Lars Loetgering
- CarlZeiss AG, Carl Zeiss Promenade, Jena, Thuringia, 07745, Germany
| | - Jia Liu
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - Peter Vouras
- United States Department of Defense, Washington, DC, 20301, USA
| | - Yujin Lee
- School of Electrical and Electronic Engineering, Yonsei University, Seoul, 03722, Republic of Korea
| | - Shaowei Jiang
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - Bin Feng
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - Andrew Maiden
- Department of Electronic and Electrical Engineering, University of Sheffield, Sheffield, South Yorkshire S1 3JD, UK
- Diamond Light Source, Harwell, Oxfordshire, OX11 0DE, UK
| | - Changhuei Yang
- Department of Electrical Engineering, California Institute of Technology, Pasadena, CA, 91125, USA
| | - Guoan Zheng
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA.
- Center for Biomedical and Bioengineering Innovation, University of Connecticut, Storrs, CT, 06269, USA.
| |
Collapse
|
4
|
Yang S, Hu S. Perspectives on endoscopic functional photoacoustic microscopy. APPLIED PHYSICS LETTERS 2024; 125:030502. [PMID: 39022117 PMCID: PMC11251735 DOI: 10.1063/5.0201691] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Accepted: 06/27/2024] [Indexed: 07/20/2024]
Abstract
Endoscopy, enabling high-resolution imaging of deep tissues and internal organs, plays an important role in basic research and clinical practice. Recent advances in photoacoustic microscopy (PAM), demonstrating excellent capabilities in high-resolution functional imaging, have sparked significant interest in its integration into the field of endoscopy. However, there are challenges in achieving functional PAM in the endoscopic setting. This Perspective article discusses current progress in the development of endoscopic PAM and the challenges related to functional measurements. Then, it points out potential directions to advance endoscopic PAM for functional imaging by leveraging fiber optics, microfabrication, optical engineering, and computational approaches. Finally, it highlights emerging opportunities for functional endoscopic PAM in basic and translational biomedicine.
Collapse
Affiliation(s)
- Shuo Yang
- Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, Missouri 63130, USA
| | - Song Hu
- Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, Missouri 63130, USA
| |
Collapse
|
5
|
Chang S, Krzyzanowska H, Bowden AK. Label-Free Optical Technologies to Enhance Noninvasive Endoscopic Imaging of Early-Stage Cancers. ANNUAL REVIEW OF ANALYTICAL CHEMISTRY (PALO ALTO, CALIF.) 2024; 17:289-311. [PMID: 38424030 DOI: 10.1146/annurev-anchem-061622-014208] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/02/2024]
Abstract
White light endoscopic imaging allows for the examination of internal human organs and is essential in the detection and treatment of early-stage cancers. To facilitate diagnosis of precancerous changes and early-stage cancers, label-free optical technologies that provide enhanced malignancy-specific contrast and depth information have been extensively researched. The rapid development of technology in the past two decades has enabled integration of these optical technologies into clinical endoscopy. In recent years, the significant advantages of using these adjunct optical devices have been shown, suggesting readiness for clinical translation. In this review, we provide an overview of the working principles and miniaturization considerations and summarize the clinical and preclinical demonstrations of several such techniques for early-stage cancer detection. We also offer an outlook for the integration of multiple technologies and the use of computer-aided diagnosis in clinical endoscopy.
Collapse
Affiliation(s)
- Shuang Chang
- 1Vanderbilt Biophotonics Center, Vanderbilt University, Nashville, Tennessee, USA;
- 2Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, USA
| | - Halina Krzyzanowska
- 1Vanderbilt Biophotonics Center, Vanderbilt University, Nashville, Tennessee, USA;
- 2Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, USA
| | - Audrey K Bowden
- 1Vanderbilt Biophotonics Center, Vanderbilt University, Nashville, Tennessee, USA;
- 2Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, USA
- 3Department of Electrical and Computer Engineering, Vanderbilt University, Nashville, Tennessee, USA
| |
Collapse
|
6
|
Zhang H, Gu C, Lan Q, Zhang W, Liu C, Yang J. Learning-based distortion correction enables proximal-scanning endoscopic OCT elastography. BIOMEDICAL OPTICS EXPRESS 2024; 15:4345-4364. [PMID: 39022540 PMCID: PMC11249688 DOI: 10.1364/boe.528522] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/26/2024] [Revised: 06/13/2024] [Accepted: 06/14/2024] [Indexed: 07/20/2024]
Abstract
Proximal rotary scanning is predominantly used in the clinical practice of endoscopic and intravascular OCT, mainly because of the much lower manufacturing cost of the probe compared to distal scanning. However, proximal scanning causes severe beam stability issues (also known as non-uniform rotational distortion, NURD), which hinders the extension of its applications to functional imaging, such as OCT elastography (OCE). In this work, we demonstrate the abilities of learning-based NURD correction methods to enable the imaging stability required for intensity-based OCE. Compared with the previous learning-based NURD correction methods that use pseudo distortion vectors for model training, we propose a method to extract real distortion vectors from a specific endoscopic OCT system, and validate its superiority in accuracy under both convolutional-neural-network- and transformer-based learning architectures. We further verify its effectiveness in elastography calculations (digital image correlation and optical flow) and the advantages of our method over other NURD correction methods. Using the air pressure of a balloon catheter as a mechanical stimulus, our proximal-scanning endoscopic OCE could effectively differentiate between areas of varying stiffness of atherosclerotic vascular phantoms. Compared with the existing endoscopic OCE methods that measure only in the radial direction, our method could achieve 2D displacement/strain distribution in both radial and circumferential directions.
Collapse
Affiliation(s)
- Haoran Zhang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Chengfu Gu
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Qi Lan
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Weiyi Zhang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Chang Liu
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Jianlong Yang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
7
|
Lotz S, Göb M, Böttger S, Ha-Wissel L, Hundt J, Ernst F, Huber R. Large area robotically assisted optical coherence tomography (LARA-OCT). BIOMEDICAL OPTICS EXPRESS 2024; 15:3993-4009. [PMID: 38867778 PMCID: PMC11166428 DOI: 10.1364/boe.525524] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/08/2024] [Revised: 05/16/2024] [Accepted: 05/16/2024] [Indexed: 06/14/2024]
Abstract
We demonstrate large-area robotically assisted optical coherence tomography (LARA-OCT), utilizing a seven-degree-of-freedom robotic arm in conjunction with a 3.3 MHz swept-source OCT to raster scan samples of arbitrary shape. By combining multiple fields of view (FOV), LARA-OCT can probe a much larger area than conventional OCT. Also, nonplanar and curved surfaces like skin on arms and legs can be probed. The lenses in the LARA-OCT scanner with their normal FOV can have fewer aberrations and less complex optics compared to a single wide field design. This may be especially critical for high resolution scans. We directly use our fast MHz-OCT for tracking and stitching, making additional machine vision systems like cameras, positioning, tracking or navigation devices obsolete. This also eliminates the need for complex coordinate system registration between OCT and the machine vision system. We implemented a real time probe-to-surface control that maintains the probe alignment orthogonal to the sample by only using surface information from the OCT images. We present OCT data sets with volume sizes of 140 × 170 × 20 mm3, captured in 2.5 minutes.
Collapse
Affiliation(s)
- Simon Lotz
- Institute of Biomedical Optics, Universität zu Lübeck, Peter-Monnik-Weg 4, 23562 Lübeck, Germany
| | - Madita Göb
- Institute of Biomedical Optics, Universität zu Lübeck, Peter-Monnik-Weg 4, 23562 Lübeck, Germany
| | - Sven Böttger
- Institute for Robotic and Cognitive Systems, Universität zu Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
- qtec Services GmbH, Niels-Bohr-Ring 3-5, 23568 Lübeck, Germany
| | - Linh Ha-Wissel
- Lübeck Institute of Experimental Dermatology, Universität zu Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Department of Dermatology, Allergology, Venerology, University Hospital of Schleswig-Holstein, Ratzeburger Allee 160, 23538 Lübeck, Germany
| | - Jennifer Hundt
- Lübeck Institute of Experimental Dermatology, Universität zu Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Floris Ernst
- Institute for Robotic and Cognitive Systems, Universität zu Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Robert Huber
- Institute of Biomedical Optics, Universität zu Lübeck, Peter-Monnik-Weg 4, 23562 Lübeck, Germany
- Medizinisches Laserzentrum Lübeck GmbH, Peter-Monnik-Weg 4, 23562 Lübeck, Germany
| |
Collapse
|
8
|
Searles K, Shalabi N, Hohert G, Gharib N, Jayhooni SMH, Lane PM, Takahata K. Distal planar rotary scanner for endoscopic optical coherence tomography. Biomed Eng Lett 2024; 14:583-592. [PMID: 38645593 PMCID: PMC11026329 DOI: 10.1007/s13534-024-00353-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Revised: 01/10/2024] [Accepted: 01/18/2024] [Indexed: 04/23/2024] Open
Abstract
Optical coherence tomography (OCT) is becoming a more common endoscopic imaging modality for detecting and treating disease given its high resolution and image quality. To use OCT for 3-dimensional imaging of small lumen, embedding an optical scanner at the distal end of an endoscopic probe for circumferential scanning the probing light is a promising way to implement high-quality imaging unachievable with the conventional method of revolving an entire probe. To this end, the present work proposes a hollow and planar micro rotary actuator for its use as an endoscopic distal scanner. A miniaturized design of this ferrofluid-assisted electromagnetic actuator is prototyped to act as a full 360° optical scanner, which is integrated at the tip of a fiber-optic probe together with a gradient-index lens for use with OCT. The scanner is revealed to achieve a notably improved dynamic performance that shows a maximum speed of 6500 rpm, representing 325% of the same reported with the preceding design, while staying below the thermal limit for safe in-vivo use. The scanner is demonstrated to perform real-time OCT using human fingers as live tissue samples for the imaging tests. The acquired images display no shadows from the electrical wires to the scanner, given its hollow architecture that allows the probing light to pass through the actuator body, as well as the quality high enough to differentiate the dermis from the epidermis while resolving individual sweat glands, proving the effectiveness of the prototyped scanner design for endoscopic OCT application.
Collapse
Affiliation(s)
- Kyle Searles
- School of Biomedical Engineering, University of British Columbia, Vancouver, BC V6T 1Z3 Canada
| | - Nabil Shalabi
- Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, BC V6T 1Z4 Canada
| | - Geoffrey Hohert
- Integrative Oncology, BC Cancer Research Institute, Vancouver, BC V5Z 4E6 Canada
| | - Nirvana Gharib
- Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, BC V6T 1Z4 Canada
| | | | - Pierre M. Lane
- Integrative Oncology, BC Cancer Research Institute, Vancouver, BC V5Z 4E6 Canada
| | - Kenichi Takahata
- School of Biomedical Engineering, University of British Columbia, Vancouver, BC V6T 1Z3 Canada
- Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, BC V6T 1Z4 Canada
| |
Collapse
|
9
|
Park HC, Li D, Liang R, Adrales G, Li X. Multifunctional Ablative Gastrointestinal Imaging Capsule (MAGIC) for Esophagus Surveillance and Interventions. BME FRONTIERS 2024; 5:0041. [PMID: 38577399 PMCID: PMC10993155 DOI: 10.34133/bmef.0041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2023] [Accepted: 03/04/2024] [Indexed: 04/06/2024] Open
Abstract
Objective and Impact Statement: A clinically viable technology for comprehensive esophagus surveillance and potential treatment is lacking. Here, we report a novel multifunctional ablative gastrointestinal imaging capsule (MAGIC) technology platform to address this clinical need. The MAGIC technology could also facilitate the clinical translation and adoption of the tethered capsule endomicroscopy (TCE) technology. Introduction: Recently developed optical coherence tomography (OCT) TCE technologies have shown a promising potential for surveillance of Barrett's esophagus and esophageal cancer in awake patients without the need for sedation. However, it remains challenging with the current TCE technology for detecting early lesions and clinical adoption due to its suboptimal resolution, imaging contrast, and lack of visual guidance during imaging. Methods: Our technology reported here integrates dual-wavelength OCT imaging (operating at 800 and 1300 nm), an ultracompact endoscope camera, and an ablation laser, aiming to enable comprehensive surveillance, guidance, and potential ablative treatment of the esophagus. Results: The MAGIC has been successfully developed with its multimodality imaging and ablation capabilities demonstrated by imaging swine esophagus ex vivo and in vivo. The 800-nm OCT imaging offers exceptional resolution and contrast for the superficial layers, well suited for detecting subtle changes associated with early neoplasia. The 1300-nm OCT imaging provides deeper penetration, essential for assessing lesion invasion. The built-in miniature camera affords a conventional endoscopic view for assisting capsule deployment and laser ablation. Conclusion: By offering complementary and clinically viable functions in a single device, the reported technology represents an effective solution for endoscopic screening, diagnosis, and potential ablation treatment of the esophagus of a patient in an office setting.
Collapse
Affiliation(s)
- Hyeon-Cheol Park
- Department of Biomedical Engineering,
Johns Hopkins University, Baltimore, MD 21205, USA
| | - Dawei Li
- Department of Biomedical Engineering,
Johns Hopkins University, Baltimore, MD 21205, USA
- Department of College of Future Technology,
Peking University, Beijing, 100871, China
| | - Rongguang Liang
- College of Optical Sciences,
University of Arizona, Tucson, AZ 85721, USA
| | - Gina Adrales
- Department of Surgery,
Johns Hopkins University School of Medicine, Baltimore, MD 21205, USA
| | - Xingde Li
- Department of Biomedical Engineering,
Johns Hopkins University, Baltimore, MD 21205, USA
| |
Collapse
|
10
|
Schulte B, Göb M, Singh AP, Lotz S, Draxinger W, Heimke M, Pieper M, Heinze T, Wedel T, Rahlves M, Huber R, Ellrichmann M. High-resolution rectoscopy using MHz optical coherence tomography: a step towards real time 3D endoscopy. Sci Rep 2024; 14:4672. [PMID: 38409328 PMCID: PMC10897148 DOI: 10.1038/s41598-024-55338-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Accepted: 02/22/2024] [Indexed: 02/28/2024] Open
Abstract
Colonoscopy and endoscopic ultrasound play pivotal roles in the assessment of rectal diseases, especially rectal cancer and inflammatory bowel diseases. Optical coherence tomography (OCT) offers a superior depth resolution, which is a critical factor for individualizing the therapeutic concept and evaluating the therapy response. We developed two distinct rectoscope prototypes, which were integrated into a 1300 nm MHz-OCT system constructed at our facility. The rapid rotation of the distal scanning probe at 40,000 revolutions per minute facilitates a 667 Hz OCT frame rate, enabling real-time endoscopic imaging of large areas. The performance of these OCT-rectoscopes was assessed in an ex vivo porcine colon and a post mortem human in-situ colon. The OCT-rectoscope consistently distinguished various layers of the intestinal wall, identified gut-associated lymphatic tissue, and visualized a rectal polyp during the imaging procedure with 3D-reconstruction in real time. Subsequent histological examination confirmed these findings. The body donor was preserved using an ethanol-glycerol-lysoformin-based technique for true-to-life tissue consistency. We could demonstrate that the novel MHZ-OCT-rectoscope effectively discriminates rectal wall layers and crucial tissue characteristics in a post mortem human colon in-situ. This real-time-3D-OCT holds promise as a valuable future diagnostic tool for assessing disease state and therapy response on-site in rectal diseases.
Collapse
Affiliation(s)
- Berenice Schulte
- Interdisciplinary Endoscopy, Medical Department 1, University Hospital Schleswig-Holstein, Campus Kiel, Kiel, Germany
| | - Madita Göb
- Institute of Biomedical Optics, University of Luebeck, Luebeck, Germany
| | | | - Simon Lotz
- Institute of Biomedical Optics, University of Luebeck, Luebeck, Germany
| | | | - Marvin Heimke
- Center of Clinical Anatomy, Institute of Anatomy, Christian-Albrechts University Kiel, Kiel, Germany
| | - Mario Pieper
- Institute of Anatomy, University of Luebeck, Luebeck, Germany
- Airway Research Center North (ARCN), German Center for Lung Research (DZL), Luebeck, Germany
| | - Tillmann Heinze
- Center of Clinical Anatomy, Institute of Anatomy, Christian-Albrechts University Kiel, Kiel, Germany
| | - Thilo Wedel
- Center of Clinical Anatomy, Institute of Anatomy, Christian-Albrechts University Kiel, Kiel, Germany
| | - Maik Rahlves
- Institute of Biomedical Optics, University of Luebeck, Luebeck, Germany
| | - Robert Huber
- Institute of Biomedical Optics, University of Luebeck, Luebeck, Germany
| | - Mark Ellrichmann
- Interdisciplinary Endoscopy, Medical Department 1, University Hospital Schleswig-Holstein, Campus Kiel, Kiel, Germany.
| |
Collapse
|
11
|
Singh AP, Göb M, Ahrens M, Eixmann T, Schulte B, Schulz-Hildebrandt H, Hüttmann G, Ellrichmann M, Huber R, Rahlves M. Virtual Hall sensor triggered multi-MHz endoscopic OCT imaging for stable real-time visualization. OPTICS EXPRESS 2024; 32:5809-5825. [PMID: 38439298 DOI: 10.1364/oe.514636] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/01/2023] [Accepted: 01/18/2024] [Indexed: 03/06/2024]
Abstract
Circumferential scanning in endoscopic imaging is crucial across various disciplines, and optical coherence tomography (OCT) is often the preferred choice due to its high-speed, high-resolution, and micron-scale imaging capabilities. Moreover, real-time and high-speed 3D endoscopy is a pivotal technology for medical screening and precise surgical guidance, among other applications. However, challenges such as image jitter and non-uniform rotational distortion (NURD) are persistent obstacles that hinder real-time visualization during high-speed OCT procedures. To address this issue, we developed an innovative, low-cost endoscope that employs a brushless DC motor for scanning, and a sensorless technique for triggering and synchronizing OCT imaging with the scanning motor. This sensorless approach uses the motor's electrical feedback (back electromotive force, BEMF) as a virtual Hall sensor to initiate OCT image acquisition and synchronize it with a Fourier Domain Mode-Locked (FDML)-based Megahertz OCT system. Notably, the implementation of BEMF-triggered OCT has led to a substantial reduction in image jitter and NURD (<4 mrad), thereby opening up a new window for real-time visualization capabilities. This approach suggests potential benefits across various applications, aiming to provide a more accurate, deployable, and cost-effective solution. Subsequent studies can explore the adaptability of this system to specific clinical scenarios and its performance under practical endoscopic conditions.
Collapse
|
12
|
Zhang H, Yang J, Zhang J, Zhao S, Zhang A. Cross-attention learning enables real-time nonuniform rotational distortion correction in OCT. BIOMEDICAL OPTICS EXPRESS 2024; 15:319-335. [PMID: 38223193 PMCID: PMC10783899 DOI: 10.1364/boe.512337] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Accepted: 12/13/2023] [Indexed: 01/16/2024]
Abstract
Nonuniform rotational distortion (NURD) correction is vital for endoscopic optical coherence tomography (OCT) imaging and its functional extensions, such as angiography and elastography. Current NURD correction methods require time-consuming feature tracking/registration or cross-correlation calculations and thus sacrifice temporal resolution. Here we propose a cross-attention learning method for the NURD correction in OCT. Our method is inspired by the recent success of the self-attention mechanism in natural language processing and computer vision. By leveraging its ability to model long-range dependencies, we can directly obtain the spatial correlation between OCT A-lines at any distance, thus accelerating the NURD correction. We develop an end-to-end stacked cross-attention network and design three types of optimization constraints. We compare our method with two traditional feature-based methods and a CNN-based method on two publicly-available endoscopic OCT datasets. We further verify the NURD correction performance of our method on 3D stent reconstruction using a home-built endoscopic OCT system. Our method achieves a ∼3 × speedup to real time (26 ± 3 fps), and superior correction performance.
Collapse
Affiliation(s)
- Haoran Zhang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Jianlong Yang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Jingqian Zhang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Shiqing Zhao
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Aili Zhang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
13
|
Fishman M, Matt A, Wang F, Gracheva E, Zhu J, Ouyang X, Komarov A, Wang Y, Liang H, Zhou C. A Drosophila heart optical coherence microscopy dataset for automatic video segmentation. Sci Data 2023; 10:886. [PMID: 38071220 PMCID: PMC10710430 DOI: 10.1038/s41597-023-02802-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Accepted: 11/30/2023] [Indexed: 12/18/2023] Open
Abstract
The heart of the fruit fly, Drosophila melanogaster, is a particularly suitable model for cardiac studies. Optical coherence microscopy (OCM) captures in vivo cross-sectional videos of the beating Drosophila heart for cardiac function quantification. To analyze those large-size multi-frame OCM recordings, human labelling has been employed, leading to low efficiency and poor reproducibility. Here, we introduce a robust and accurate automated Drosophila heart segmentation algorithm, called FlyNet 2.0+, which utilizes a long short-term memory (LSTM) convolutional neural network to leverage time series information in the videos, ensuring consistent, high-quality segmentation. We present a dataset of 213 Drosophila heart videos, equivalent to 604,000 cross-sectional images, containing all developmental stages and a wide range of beating patterns, including faster and slower than normal beating, arrhythmic beating, and periods of heart stop to capture these heart dynamics. Each video contains a corresponding ground truth mask. We expect this unique large dataset of the beating Drosophila heart in vivo will enable new deep learning approaches to efficiently characterize heart function to advance cardiac research.
Collapse
Affiliation(s)
- Matthew Fishman
- Washington University in St. Louis, Department of Computer Science and Engineering, St. Louis, MO, 63130, USA
| | - Abigail Matt
- Washington University in St. Louis, Department of Biomedical Engineering, St. Louis, MO, 63130, USA
| | - Fei Wang
- Washington University in St. Louis, Department of Biomedical Engineering, St. Louis, MO, 63130, USA
| | - Elena Gracheva
- Washington University in St. Louis, Department of Biomedical Engineering, St. Louis, MO, 63130, USA
| | - Jiantao Zhu
- Washington University in St. Louis, Department of Biomedical Engineering, St. Louis, MO, 63130, USA
| | - Xiangping Ouyang
- Washington University in St. Louis, Department of Computer Science and Engineering, St. Louis, MO, 63130, USA
| | - Andrey Komarov
- Washington University in St. Louis, Department of Biomedical Engineering, St. Louis, MO, 63130, USA
| | - Yuxuan Wang
- Washington University in St. Louis, Department of Biomedical Engineering, St. Louis, MO, 63130, USA
| | - Hongwu Liang
- Washington University in St. Louis, Department of Biomedical Engineering, St. Louis, MO, 63130, USA
| | - Chao Zhou
- Washington University in St. Louis, Department of Biomedical Engineering, St. Louis, MO, 63130, USA.
| |
Collapse
|
14
|
Hren R, Sersa G, Simoncic U, Milanic M. Imaging microvascular changes in nonocular oncological clinical applications by optical coherence tomography angiography: a literature review. Radiol Oncol 2023; 57:411-418. [PMID: 38038417 PMCID: PMC10690745 DOI: 10.2478/raon-2023-0057] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Accepted: 10/03/2023] [Indexed: 12/02/2023] Open
Abstract
BACKGROUND Optical coherence tomography angiography (OCTA) is an emerging imaging modality that enables noninvasive visualization and analysis of tumor vasculature. OCTA has been particularly useful in clinical ocular oncology, while in this article, we evaluated OCTA in assessing microvascular changes in clinical nonocular oncology through a systematic review of the literature. METHOD The inclusion criterion for the literature search in PubMed, Web of Science and Scopus electronic databases was the use of OCTA in nonocular clinical oncology, meaning that all ocular clinical studies and all ocular and nonocular animal, phantom, ex vivo, experimental, research and development, and purely methodological studies were excluded. RESULTS Eleven articles met the inclusion criteria. The anatomic locations of the neoplasms in the selected articles were the gastrointestinal tract (2 articles), head and neck (1 article) and skin (8 articles). CONCLUSIONS While OCTA has shown great advancements in ophthalmology, its translation to the nonocular clinical oncology setting presents several limitations, with a lack of standardized protocols and interpretation guidelines posing the most significant challenge.
Collapse
Affiliation(s)
- Rok Hren
- Faculty of Mathematics and Physics, Ljubljana, Slovenia
- Institute of Mathematics, Physics, and Mechanics, Ljubljana, Slovenia
- Syreon Research Institute, Budapest, Hungary
| | - Gregor Sersa
- Institute of Oncology Ljubljana, Ljubljana, Slovenia
| | - Urban Simoncic
- Faculty of Mathematics and Physics, Ljubljana, Slovenia
- Jozef Stefan Institute, Ljubljana, Slovenia
| | - Matija Milanic
- Faculty of Mathematics and Physics, Ljubljana, Slovenia
- Jozef Stefan Institute, Ljubljana, Slovenia
| |
Collapse
|
15
|
Li C, Wieduwilt T, Wendisch FJ, Márquez A, Menezes LDS, Maier SA, Schmidt MA, Ren H. Metafiber transforming arbitrarily structured light. Nat Commun 2023; 14:7222. [PMID: 37940676 PMCID: PMC10632407 DOI: 10.1038/s41467-023-43068-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Accepted: 10/30/2023] [Indexed: 11/10/2023] Open
Abstract
Structured light has proven useful for numerous photonic applications. However, the current use of structured light in optical fiber science and technology is severely limited by mode mixing or by the lack of optical elements that can be integrated onto fiber end-faces for wavefront engineering, and hence generation of structured light is still handled outside the fiber via bulky optics in free space. We report a metafiber platform capable of creating arbitrarily structured light on the hybrid-order Poincaré sphere. Polymeric metasurfaces, with unleashed height degree of freedom and a greatly expanded 3D meta-atom library, were 3D laser nanoprinted and interfaced with polarization-maintaining single-mode fibers. Multiple metasurfaces were interfaced on the fiber end-faces, transforming the fiber output into different structured-light fields, including cylindrical vector beams, circularly polarized vortex beams, and arbitrary vector field. Our work provides a paradigm for advancing optical fiber science and technology towards fiber-integrated light shaping, which may find important applications in fiber communications, fiber lasers and sensors, endoscopic imaging, fiber lithography, and lab-on-fiber technology.
Collapse
Affiliation(s)
- Chenhao Li
- Chair in Hybrid Nanosystems, Nanoinstitute Munich, Faculty of Physics, Ludwig Maximilian University of Munich, 80539, Munich, Germany
| | | | - Fedja J Wendisch
- Chair in Hybrid Nanosystems, Nanoinstitute Munich, Faculty of Physics, Ludwig Maximilian University of Munich, 80539, Munich, Germany
| | - Andrés Márquez
- I.U. Física Aplicada a las Ciencias y las Tecnologías, Universidad de Alicante, P.O. Box 99, 03080, Alicante, Spain
- Dpto. de Física, Ing. de Sistemas y Teoría de la Señal, Universidad de Alicante, P.O. Box 99, 03080, Alicante, Spain
| | - Leonardo de S Menezes
- Chair in Hybrid Nanosystems, Nanoinstitute Munich, Faculty of Physics, Ludwig Maximilian University of Munich, 80539, Munich, Germany
- Departamento de Física, Universidade Federal de Pernambuco, 50670-901, Recife-PE, Brazil
| | - Stefan A Maier
- Chair in Hybrid Nanosystems, Nanoinstitute Munich, Faculty of Physics, Ludwig Maximilian University of Munich, 80539, Munich, Germany.
- School of Physics and Astronomy, Faculty of Science, Monash University, Melbourne, Victoria, 3800, Australia.
- Department of Physics, Imperial College London, London, SW7 2AZ, UK.
| | - Markus A Schmidt
- Leibniz Institute of Photonic Technology, 07745, Jena, Germany.
- Abbe Center of Photonics and Faculty of Physics, FSU Jena, 07745, Jena, Germany.
- Otto Schott Institute of Material Research, FSU Jena, 07745, Jena, Germany.
| | - Haoran Ren
- School of Physics and Astronomy, Faculty of Science, Monash University, Melbourne, Victoria, 3800, Australia.
| |
Collapse
|
16
|
Balasubramanian H, Hobson CM, Chew TL, Aaron JS. Imagining the future of optical microscopy: everything, everywhere, all at once. Commun Biol 2023; 6:1096. [PMID: 37898673 PMCID: PMC10613274 DOI: 10.1038/s42003-023-05468-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Accepted: 10/16/2023] [Indexed: 10/30/2023] Open
Abstract
The optical microscope has revolutionized biology since at least the 17th Century. Since then, it has progressed from a largely observational tool to a powerful bioanalytical platform. However, realizing its full potential to study live specimens is hindered by a daunting array of technical challenges. Here, we delve into the current state of live imaging to explore the barriers that must be overcome and the possibilities that lie ahead. We venture to envision a future where we can visualize and study everything, everywhere, all at once - from the intricate inner workings of a single cell to the dynamic interplay across entire organisms, and a world where scientists could access the necessary microscopy technologies anywhere.
Collapse
Affiliation(s)
| | - Chad M Hobson
- Advanced Imaging Center; Howard Hughes Medical Institute Janelia Research Campus, Ashburn, VA, 20147, USA
| | - Teng-Leong Chew
- Advanced Imaging Center; Howard Hughes Medical Institute Janelia Research Campus, Ashburn, VA, 20147, USA
| | - Jesse S Aaron
- Advanced Imaging Center; Howard Hughes Medical Institute Janelia Research Campus, Ashburn, VA, 20147, USA.
| |
Collapse
|
17
|
Zhang C, Yang F, Wang F, Tan Q, He H, Zhang S, Wu J, Tu S. High-speed submillimeter magnetic-driven rotational scanning side-imaging OCT probe. JOURNAL OF BIOPHOTONICS 2023; 16:e202300106. [PMID: 37340704 DOI: 10.1002/jbio.202300106] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Revised: 05/29/2023] [Accepted: 06/16/2023] [Indexed: 06/22/2023]
Abstract
A high-speed side-imaging magnetic-driven scanning (MDS) probe is proposed for endoscopic optical coherence tomography (OCT). In the distal end of the probe, a reflecting micromirror is attached to a tiny magnet, which is driven by an external fast-rotating magnetic field to achieve unobstructed 360-degree side-view scanning. A prototype probe was fabricated with an outer diameter of 0.89 mm. Using the prototype probe, OCT images of an ex vivo porcine artery with implanted stent were acquired in 100 frames per second. The OCT engine was a swept-source system, and the system sensitivity with the prototype probe was 95 dB with an output power of 6 mW. The axial and lateral resolutions of the system were 10.3 and 39.7 μm, respectively. The high-speed submillimeter MDS-OCT probe provides a promising alternative endoscopic OCT solution for intravascular imaging applications.
Collapse
Affiliation(s)
- Chi Zhang
- School of Biomedical Engineering, Biomedical Instrument Institute, Shanghai Jiao Tong University, Shanghai, China
| | - Fan Yang
- School of Biomedical Engineering, Biomedical Instrument Institute, Shanghai Jiao Tong University, Shanghai, China
| | - Fu Wang
- School of Biomedical Engineering, Biomedical Instrument Institute, Shanghai Jiao Tong University, Shanghai, China
| | - Qingyue Tan
- School of Biomedical Engineering, Biomedical Instrument Institute, Shanghai Jiao Tong University, Shanghai, China
| | - Hao He
- School of Biomedical Engineering, Biomedical Instrument Institute, Shanghai Jiao Tong University, Shanghai, China
| | - Su Zhang
- School of Biomedical Engineering, Biomedical Instrument Institute, Shanghai Jiao Tong University, Shanghai, China
| | - Jigang Wu
- Biophotonics Laboratory, University of Michigan - Shanghai Jiao Tong University Joint Institute, Shanghai Jiao Tong University, Shanghai, China
| | - Shengxian Tu
- School of Biomedical Engineering, Biomedical Instrument Institute, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
18
|
Merchán Gómez B, Milla Collado L, Rodríguez M. Artificial intelligence in esophageal cancer diagnosis and treatment: where are we now?-a narrative review. ANNALS OF TRANSLATIONAL MEDICINE 2023; 11:353. [PMID: 37675332 PMCID: PMC10477654 DOI: 10.21037/atm-22-3977] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Accepted: 04/21/2023] [Indexed: 09/08/2023]
Abstract
Background and Objective Artificial intelligence (AI) use is becoming increasingly prevalent directly or indirectly in daily clinical practice, including esophageal cancer (EC) diagnosis and treatment. Although the limits of its adoption and their clinical benefits are still unknown, any physician related to EC patients' management should be aware of the status and future perspectives of AI use in their field. The purpose of this review is to summarize the existing literature regarding the role of AI in diagnosis and treatment of EC. We have focused on the aids AI entails in the management of this pathology and we have tried to offer an updated perspective to maximize current applications and to identify potential future uses of it. Methods Data concerning AI applied to EC diagnosis and treatment is not limited, including direct (those specifically related to them) and indirect (those referring to other specialties as radiology or pathology), applications. However, the clinical relevance of the discussed and presented models is still unknown. We performed a research in PubMed of English and Spanish written studies from January 1970 to June 2022. Key Content and Findings Information regarding the role of AI in EC diagnosis and treatment has increased exponentially in recent years. Several models, including different variables and features have been investigated and some of them internally and externally validated. However, the main challenge remains to apply and introduce all these data into clinical practice, and, as some of the discussed studies argue, if the models are able to enhance experienced endoscopists' judgement. Although AI use is increasing steadily in different medical specialties, the truth is, most of the time, the gap between model development and clinical implementation is not closed. Learning to understand the routinely application of AI, as well as future improvements, would lead to a broadened adoption. Conclusions Physicians should be aware of the multiple current clinical uses of AI in EC diagnosis and treatment and should take part in their clinical application and future developments to enhance patient care.
Collapse
Affiliation(s)
| | | | - María Rodríguez
- Thoracic Surgery Department, Clínica Universidad de Navarra, Madrid, Spain
| |
Collapse
|
19
|
Liu HC, Lin MH, Ting CH, Wang YM, Sun CW. Intraoperative application of optical coherence tomography for lung tumor. JOURNAL OF BIOPHOTONICS 2023; 16:e202200344. [PMID: 36755475 DOI: 10.1002/jbio.202200344] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Revised: 01/06/2023] [Accepted: 01/18/2023] [Indexed: 06/07/2023]
Abstract
On-site instant determination of benign or malignant tumors for deciding the types of resection is crucial during pulmonary surgery. We designed a portable spectral-domain optical coherence tomography (SD-OCT) system to do real-time scanning intraoperatively for the distinction of fresh tumor specimens in the lung. A total of 12 ex vivo lung specimens from six patients were enrolled. Three patients were diagnosed with invasive adenocarcinoma (IA), while the others were benign. After OCT-imaged reconstruction, we compared the qualitative morphology of OCT and histology among malignant, benign, and normal tissues. In addition, through analysis of the quantitative data, a discrete difference in optical attenuation coefficients around the junctional surface was shown by our data processing. This study demonstrated a feasible OCT-assisted resection guide by a rapid on-site tumor diagnosis. The results indicate that future deep learning of OCT-captured image systems able to improve diagnostic and therapeutic efficiency is warranted.
Collapse
Affiliation(s)
- Hung-Chang Liu
- Department of Thoracic Surgery, Mackay Memorial Hospital, Taipei City, Taiwan
- Department of Medicine, Mackay Medical College, New Taipei City, Taiwan
- Department of Nursing, Mackay Junior College of Medicine, Nursing, and Management, Taipei City, Taiwan
| | - Miao-Hui Lin
- Biomedical Optical Imaging Lab, Department of Photonics, College of Electrical and Computer Engineering, National Yang Ming Chiao Tung University, Hsinchu City, Taiwan
| | - Ching-Heng Ting
- Department of Medicine, Mackay Medical College, New Taipei City, Taiwan
- Department of Nursing, Mackay Junior College of Medicine, Nursing, and Management, Taipei City, Taiwan
- Department of Pathology, Mackay Memorial Hospital, New Taipei City, Taiwan
| | - Yi-Min Wang
- Biomedical Optical Imaging Lab, Department of Photonics, College of Electrical and Computer Engineering, National Yang Ming Chiao Tung University, Hsinchu City, Taiwan
| | - Chia-Wei Sun
- Biomedical Optical Imaging Lab, Department of Photonics, College of Electrical and Computer Engineering, National Yang Ming Chiao Tung University, Hsinchu City, Taiwan
- Institute of Biomedical Engineering, College of Electrical and Computer Engineering, National Yang Ming Chiao Tung University, Hsinchu, Taiwan
- Medical Device Innovation and Translation Center, National Yang Ming Chiao Tung University, Taipei, Taiwan
| |
Collapse
|
20
|
Niemitz L, van der Stel SD, Sorensen S, Messina W, Venkata Sekar SK, Sterenborg HJCM, Andersson-Engels S, Ruers TJM, Burke R. Microcamera Visualisation System to Overcome Specular Reflections for Tissue Imaging. MICROMACHINES 2023; 14:mi14051062. [PMID: 37241685 DOI: 10.3390/mi14051062] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Revised: 05/09/2023] [Accepted: 05/15/2023] [Indexed: 05/28/2023]
Abstract
In vivo tissue imaging is an essential tool for medical diagnosis, surgical guidance, and treatment. However, specular reflections caused by glossy tissue surfaces can significantly degrade image quality and hinder the accuracy of imaging systems. In this work, we further the miniaturisation of specular reflection reduction techniques using micro cameras, which have the potential to act as intra-operative supportive tools for clinicians. In order to remove these specular reflections, two small form factor camera probes, handheld at 10 mm footprint and miniaturisable to 2.3 mm, are developed using different modalities, with line-of-sight to further miniaturisation. (1) The sample is illuminated via multi-flash technique from four different positions, causing a shift in reflections which are then filtered out in a post-processing image reconstruction step. (2) The cross-polarisation technique integrates orthogonal polarisers onto the tip of the illumination fibres and camera, respectively, to filter out the polarisation maintaining reflections. These form part of a portable imaging system that is capable of rapid image acquisition using different illumination wavelengths, and employs techniques that lend themselves well to further footprint reduction. We demonstrate the efficacy of the proposed system with validating experiments on tissue-mimicking phantoms with high surface reflection, as well as on excised human breast tissue. We show that both methods can provide clear and detailed images of tissue structures along with the effective removal of distortion or artefacts caused by specular reflections. Our results suggest that the proposed system can improve the image quality of miniature in vivo tissue imaging systems and reveal underlying feature information at depth, for both human and machine observers, leading to better diagnosis and treatment outcomes.
Collapse
Affiliation(s)
- Lorenzo Niemitz
- Biophotonics @ Tyndall, IPIC, Tyndall National Institute, University College Cork, T12 R5CP Cork, Ireland
| | - Stefan D van der Stel
- Netherlands Cancer Institute-Antoni van Leeuwenhoek, 1066 CX Amsterdam, The Netherlands
- Group Nanobiophysics, Faculty TNW, Twente University, 7522 NB Enschede, The Netherlands
| | - Simon Sorensen
- Biophotonics @ Tyndall, IPIC, Tyndall National Institute, University College Cork, T12 R5CP Cork, Ireland
| | - Walter Messina
- Biophotonics @ Tyndall, IPIC, Tyndall National Institute, University College Cork, T12 R5CP Cork, Ireland
| | - Sanathana Konugolu Venkata Sekar
- Biophotonics @ Tyndall, IPIC, Tyndall National Institute, University College Cork, T12 R5CP Cork, Ireland
- BioPixS Ltd.-Biophotonics Standards, IPIC, Lee Maltings Complex, Dyke Parade, T12 R5CP Cork, Ireland
| | | | - Stefan Andersson-Engels
- Biophotonics @ Tyndall, IPIC, Tyndall National Institute, University College Cork, T12 R5CP Cork, Ireland
- BioPixS Ltd.-Biophotonics Standards, IPIC, Lee Maltings Complex, Dyke Parade, T12 R5CP Cork, Ireland
- Department of Physics, University College Cork, T12 K8AF Cork, Ireland
| | - Theo J M Ruers
- Netherlands Cancer Institute-Antoni van Leeuwenhoek, 1066 CX Amsterdam, The Netherlands
- Group Nanobiophysics, Faculty TNW, Twente University, 7522 NB Enschede, The Netherlands
| | - Ray Burke
- Biophotonics @ Tyndall, IPIC, Tyndall National Institute, University College Cork, T12 R5CP Cork, Ireland
| |
Collapse
|
21
|
Makvandi P, Shabani M, Rabiee N, Anjani QK, Maleki A, Zare EN, Sabri AHB, De Pasquale D, Koskinopoulou M, Sharifi E, Sartorius R, Seyedhamzeh M, Bochani S, Hirata I, Paiva-Santos AC, Mattos LS, Donnelly RF, Mattoli V. Engineering and Development of a Tissue Model for the Evaluation of Microneedle Penetration Ability, Drug Diffusion, Photothermal Activity, and Ultrasound Imaging: A Promising Surrogate to Ex Vivo and In Vivo Tissues. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2023; 35:e2210034. [PMID: 36739591 DOI: 10.1002/adma.202210034] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/30/2022] [Revised: 01/13/2023] [Indexed: 05/05/2023]
Abstract
Driven by regulatory authorities and the ever-growing demands from industry, various artificial tissue models have been developed. Nevertheless, there is no model to date that is capable of mimicking the biomechanical properties of the skin whilst exhibiting the hydrophilicity/hydrophobicity properties of the skin layers. As a proof-of-concept study, tissue surrogates based on gel and silicone are fabricated for the evaluation of microneedle penetration, drug diffusion, photothermal activity, and ultrasound bioimaging. The silicone layer aims to imitate the stratum corneum while the gel layer aims to mimic the water-rich viable epidermis and dermis present in in vivo tissues. The diffusion of drugs across the tissue model is assessed, and the results reveal that the proposed tissue model shows similar behavior to a cancerous kidney. In place of typical in vitro aqueous solutions, this model can also be employed for evaluating the photoactivity of photothermal agents since the tissue model shows a similar heating profile to skin of mice when irradiated with near-infrared laser. In addition, the designed tissue model exhibits promising results for biomedical applications in optical coherence tomography and ultrasound imaging. Such a tissue model paves the way to reduce the use of animals testing in research whilst obviating ethical concerns.
Collapse
Affiliation(s)
- Pooyan Makvandi
- Centre for Materials Interfaces, Istituto Italiano di Tecnologia, viale Rinaldo Piaggio 34, Pontedera, 56025, Pisa, Italy
- School of Engineering, Institute for Bioengineering, The University of Edinburgh, Edinburgh, EH9 3JL, UK
| | - Majid Shabani
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Pontedera, 56025, Pisa, Italy
- Bioinspired Soft Robotics Laboratory, Istituto Italiano di Tecnologia, 16163, Genova, Italy
| | - Navid Rabiee
- Centre for Molecular Medicine and Innovative Therapeutics, Murdoch University, Perth, WA 6150, Australia
- School of Engineering, Macquarie University, Sydney, New South Wales, 2109, Australia
| | - Qonita Kurnia Anjani
- School of Pharmacy, Queen's University Belfast, 97 Lisburn Road, Belfast, BT9 7BL, UK
| | - Aziz Maleki
- Zanjan Pharmaceutical, Nanotechnology Research Center (ZPNRC), Department of Pharmaceutical Nanotechnology, School of Pharmacy, Zanjan University of Medical Sciences, Zanjan, 45139-56184, Iran
| | | | | | - Daniele De Pasquale
- Centre for Materials Interfaces, Istituto Italiano di Tecnologia, viale Rinaldo Piaggio 34, Pontedera, 56025, Pisa, Italy
| | - Maria Koskinopoulou
- Department of Advanced Robotics (ADVR), Istituto Italiano di Tecnologia, 16163, Genova, Italy
| | - Esmaeel Sharifi
- Cancer Research Center, Hamadan University of Medical Sciences, Hamadan, 65178-38736, Iran
| | - Rossella Sartorius
- Institute of Biochemistry and Cell Biology (IBBC), National Research Council (CNR), 80131, Naples, Italy
| | - Mohammad Seyedhamzeh
- Zanjan Pharmaceutical, Nanotechnology Research Center (ZPNRC), Department of Pharmaceutical Nanotechnology, School of Pharmacy, Zanjan University of Medical Sciences, Zanjan, 45139-56184, Iran
| | - Shayesteh Bochani
- Zanjan Pharmaceutical, Nanotechnology Research Center (ZPNRC), Department of Pharmaceutical Nanotechnology, School of Pharmacy, Zanjan University of Medical Sciences, Zanjan, 45139-56184, Iran
| | - Ikue Hirata
- Centre for Materials Interfaces, Istituto Italiano di Tecnologia, viale Rinaldo Piaggio 34, Pontedera, 56025, Pisa, Italy
| | - Ana Cláudia Paiva-Santos
- Department of Pharmaceutical Technology, Faculty of Pharmacy of the University of Coimbra, University of Coimbra, Azinhaga Sta. Comba, Coimbra, 3000-548, Portugal
- LAQV, REQUIMTE, Department of Pharmaceutical Technology, Faculty of Pharmacy of the University of Coimbra, University of Coimbra, Azinhaga Sta. Comba, Coimbra, 3000-548, Portugal
| | - Leonardo S Mattos
- Department of Advanced Robotics (ADVR), Istituto Italiano di Tecnologia, 16163, Genova, Italy
| | - Ryan F Donnelly
- School of Pharmacy, Queen's University Belfast, 97 Lisburn Road, Belfast, BT9 7BL, UK
| | - Virgilio Mattoli
- Centre for Materials Interfaces, Istituto Italiano di Tecnologia, viale Rinaldo Piaggio 34, Pontedera, 56025, Pisa, Italy
| |
Collapse
|
22
|
Papazoglou AS, Karagiannidis E, Liatsos A, Bompoti A, Moysidis DV, Arvanitidis C, Tsolaki F, Tsagkaropoulos S, Theocharis S, Tagarakis G, Michaelson JS, Herrmann MD. Volumetric Tissue Imaging of Surgical Tissue Specimens Using Micro-Computed Tomography: An Emerging Digital Pathology Modality for Nondestructive, Slide-Free Microscopy-Clinical Applications of Digital Pathology in 3 Dimensions. Am J Clin Pathol 2023; 159:242-254. [PMID: 36478204 DOI: 10.1093/ajcp/aqac143] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2022] [Accepted: 10/14/2022] [Indexed: 12/14/2022] Open
Abstract
OBJECTIVES Micro-computed tomography (micro-CT) is a novel, nondestructive, slide-free digital imaging modality that enables the acquisition of high-resolution, volumetric images of intact surgical tissue specimens. The aim of this systematic mapping review is to provide a comprehensive overview of the available literature on clinical applications of micro-CT tissue imaging and to assess its relevance and readiness for pathology practice. METHODS A computerized literature search was performed in the PubMed, Scopus, Web of Science, and CENTRAL databases. To gain insight into regulatory and financial considerations for performing and examining micro-CT imaging procedures in a clinical setting, additional searches were performed in medical device databases. RESULTS Our search identified 141 scientific articles published between 2000 and 2021 that described clinical applications of micro-CT tissue imaging. The number of relevant publications is progressively increasing, with the specialties of pulmonology, cardiology, otolaryngology, and oncology being most commonly concerned. The included studies were mostly performed in pathology departments. Current micro-CT devices have already been cleared for clinical use, and a Current Procedural Terminology (CPT) code exists for reimbursement of micro-CT imaging procedures. CONCLUSIONS Micro-CT tissue imaging enables accurate volumetric measurements and evaluations of entire surgical specimens at microscopic resolution across a wide range of clinical applications.
Collapse
Affiliation(s)
| | - Efstratios Karagiannidis
- First Department of Cardiology, AHEPA University Hospital, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Alexandros Liatsos
- First Department of Cardiology, AHEPA University Hospital, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Andreana Bompoti
- Diagnostic Imaging, Peterborough City Hospital, North West Anglia NHS Foundation Trust, Peterborough, UK
| | - Dimitrios V Moysidis
- First Department of Cardiology, AHEPA University Hospital, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Christos Arvanitidis
- Institute of Marine Biology, Biotechnology and Aquaculture, Hellenic Centre for Marine Research, Heraklion, Crete, Greece.,LifeWatch ERIC, Sector II-II, Seville, Spain
| | - Fani Tsolaki
- Department of Cardiothoracic Surgery, AHEPA University Hospital, Thessaloniki, Greece
| | | | - Stamatios Theocharis
- First Department of Pathology, National and Kapoditrian University of Athens, Athens, Greece
| | - Georgios Tagarakis
- Department of Cardiothoracic Surgery, AHEPA University Hospital, Thessaloniki, Greece
| | - James S Michaelson
- Department of Pathology, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA
| | - Markus D Herrmann
- Department of Pathology, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA
| |
Collapse
|
23
|
Durand T, Paul-Gilloteaux P, Gora M, Laboudie L, Coron E, Neveu I, Neunlist M, Naveilhan P. Visualizing enteric nervous system activity through dye-free dynamic full-field optical coherence tomography. Commun Biol 2023; 6:236. [PMID: 36864093 PMCID: PMC9981581 DOI: 10.1038/s42003-023-04593-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2022] [Accepted: 02/14/2023] [Indexed: 03/04/2023] Open
Abstract
Major advances have been achieved in imaging technologies but most methodological approaches currently used to study the enteric neuronal functions rely on exogenous contrast dyes that can interfere with cellular functions or survival. In the present paper, we investigated whether full-field optical coherence tomography (FFOCT), could be used to visualize and analyze the cells of the enteric nervous system. Experimental work on whole-mount preparations of unfixed mouse colons showed that FFOCT enables the visualization of the myenteric plexus network whereas dynamic FFOCT enables to visualize and identify in situ individual cells in the myenteric ganglia. Analyzes also showed that dynamic FFOCT signal could be modified by external stimuli such veratridine or changes in osmolarity. These data suggest that dynamic FFOCT could be of great interest to detect changes in the functions of enteric neurons and glia in normal and disease conditions.
Collapse
Affiliation(s)
- Tony Durand
- Nantes Université, CHU Nantes, Inserm, TENS, The Enteric Nervous System in Gut and Brain Diseases, IMAD, Nantes, France
| | - Perrine Paul-Gilloteaux
- Nantes Université, CNRS, INSERM, l'institut du thorax, F-44000, Nantes, France
- Nantes Université, CHU Nantes, Inserm, CNRS, SFR Santé, Inserm UMS 016, CNRS UAR 3556, F-44000, Nantes, France
| | - Michalina Gora
- Wyss Center for Bio and Neuroengineering, Campus Biotech, Geneva, Switzerland
- ICube Laboratory, CNRS, Strasbourg University, Strasbourg, France
| | - Lara Laboudie
- Nantes Université, CHU Nantes, Inserm, TENS, The Enteric Nervous System in Gut and Brain Diseases, IMAD, Nantes, France
| | - Emmanuel Coron
- Nantes Université, CHU Nantes, Inserm, TENS, The Enteric Nervous System in Gut and Brain Diseases, IMAD, Nantes, France
- Department of Gastroenterology and Hepatology, University Hospital of Geneva (HUG), rue Gabrielle Perret-Gentil 4, 1211, Genève, 1205, Switzerland
| | - Isabelle Neveu
- Nantes Université, CHU Nantes, Inserm, TENS, The Enteric Nervous System in Gut and Brain Diseases, IMAD, Nantes, France
| | - Michel Neunlist
- Nantes Université, CHU Nantes, Inserm, TENS, The Enteric Nervous System in Gut and Brain Diseases, IMAD, Nantes, France.
| | - Philippe Naveilhan
- Nantes Université, CHU Nantes, Inserm, TENS, The Enteric Nervous System in Gut and Brain Diseases, IMAD, Nantes, France
| |
Collapse
|
24
|
Kim HJ, Sritandi W, Xiong Z, Ho JS. Bioelectronic devices for light-based diagnostics and therapies. BIOPHYSICS REVIEWS 2023; 4:011304. [PMID: 38505817 PMCID: PMC10903427 DOI: 10.1063/5.0102811] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/13/2022] [Accepted: 12/28/2022] [Indexed: 03/21/2024]
Abstract
Light has broad applications in medicine as a tool for diagnosis and therapy. Recent advances in optical technology and bioelectronics have opened opportunities for wearable, ingestible, and implantable devices that use light to continuously monitor health and precisely treat diseases. In this review, we discuss recent progress in the development and application of light-based bioelectronic devices. We summarize the key features of the technologies underlying these devices, including light sources, light detectors, energy storage and harvesting, and wireless power and communications. We investigate the current state of bioelectronic devices for the continuous measurement of health and on-demand delivery of therapy. Finally, we highlight major challenges and opportunities associated with light-based bioelectronic devices and discuss their promise for enabling digital forms of health care.
Collapse
Affiliation(s)
| | - Weni Sritandi
- Department of Electrical and Computer Engineering, National University of Singapore, Singapore
| | | | - John S. Ho
- Author to whom correspondence should be addressed:
| |
Collapse
|
25
|
Fitzgerald S, Akhtar J, Schartner E, Ebendorff-Heidepriem H, Mahadevan-Jansen A, Li J. Multimodal Raman spectroscopy and optical coherence tomography for biomedical analysis. JOURNAL OF BIOPHOTONICS 2023; 16:e202200231. [PMID: 36308009 PMCID: PMC10082563 DOI: 10.1002/jbio.202200231] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Revised: 10/19/2022] [Accepted: 10/26/2022] [Indexed: 06/16/2023]
Abstract
Optical techniques hold great potential to detect and monitor disease states as they are a fast, non-invasive toolkit. Raman spectroscopy (RS) in particular is a powerful label-free method capable of quantifying the biomolecular content of tissues. Still, spontaneous Raman scattering lacks information about tissue morphology due to its inability to rapidly assess a large field of view. Optical Coherence Tomography (OCT) is an interferometric optical method capable of fast, depth-resolved imaging of tissue morphology, but lacks detailed molecular contrast. In many cases, pairing label-free techniques into multimodal systems allows for a more diverse field of applications. Integrating RS and OCT into a single instrument allows for both structural imaging and biochemical interrogation of tissues and therefore offers a more comprehensive means for clinical diagnosis. This review summarizes the efforts made to date toward combining spontaneous RS-OCT instrumentation for biomedical analysis, including insights into primary design considerations and data interpretation.
Collapse
Affiliation(s)
- Sean Fitzgerald
- Vanderbilt Biophotonics Center, Nashville, Tennessee, USA
- Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, USA
| | - Jobaida Akhtar
- School of Physical Sciences, The University of Adelaide, Adelaide, South Australia, Australia
- Institute for Photonics and Advanced Sensing, The University of Adelaide, Adelaide, South Australia, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Adelaide, South Australia, Australia
| | - Erik Schartner
- School of Physical Sciences, The University of Adelaide, Adelaide, South Australia, Australia
- Institute for Photonics and Advanced Sensing, The University of Adelaide, Adelaide, South Australia, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Adelaide, South Australia, Australia
| | - Heike Ebendorff-Heidepriem
- School of Physical Sciences, The University of Adelaide, Adelaide, South Australia, Australia
- Institute for Photonics and Advanced Sensing, The University of Adelaide, Adelaide, South Australia, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Adelaide, South Australia, Australia
| | - Anita Mahadevan-Jansen
- Vanderbilt Biophotonics Center, Nashville, Tennessee, USA
- Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, USA
| | - Jiawen Li
- Institute for Photonics and Advanced Sensing, The University of Adelaide, Adelaide, South Australia, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Adelaide, South Australia, Australia
- School of Electrical and Electronic Engineering, The University of Adelaide, Adelaide, South Australia, Australia
| |
Collapse
|
26
|
Gunalan A, Mattos LS. Towards OCT-Guided Endoscopic Laser Surgery-A Review. Diagnostics (Basel) 2023; 13:diagnostics13040677. [PMID: 36832167 PMCID: PMC9955820 DOI: 10.3390/diagnostics13040677] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2022] [Revised: 02/03/2023] [Accepted: 02/09/2023] [Indexed: 02/16/2023] Open
Abstract
Optical Coherence Tomography (OCT) is an optical imaging technology occupying a unique position in the resolution vs. imaging depth spectrum. It is already well established in the field of ophthalmology, and its application in other fields of medicine is growing. This is motivated by the fact that OCT is a real-time sensing technology with high sensitivity to precancerous lesions in epithelial tissues, which can be exploited to provide valuable information to clinicians. In the prospective case of OCT-guided endoscopic laser surgery, these real-time data will be used to assist surgeons in challenging endoscopic procedures in which high-power lasers are used to eradicate diseases. The combination of OCT and laser is expected to enhance the detection of tumors, the identification of tumor margins, and ensure total disease eradication while avoiding damage to healthy tissue and critical anatomical structures. Therefore, OCT-guided endoscopic laser surgery is an important nascent research area. This paper aims to contribute to this field with a comprehensive review of state-of-the-art technologies that may be exploited as the building blocks for achieving such a system. The paper begins with a review of the principles and technical details of endoscopic OCT, highlighting challenges and proposed solutions. Then, once the state of the art of the base imaging technology is outlined, the new OCT-guided endoscopic laser surgery frontier is reviewed. Finally, the paper concludes with a discussion on the constraints, benefits and open challenges associated with this new type of surgical technology.
Collapse
Affiliation(s)
- Ajay Gunalan
- Department of Advanced Robotics, Istituto Italiano di Tecnologia, 16163 Genoa, Italy
- Department of Informatics, Bioengineering, Robotics and Systems Engineering, University of Genoa, 16145 Genoa, Italy
| | - Leonardo S. Mattos
- Department of Advanced Robotics, Istituto Italiano di Tecnologia, 16163 Genoa, Italy
- Correspondence:
| |
Collapse
|
27
|
Xie Z, Liu J, Ren Y, Huang J, Lin R, Wang X, Tan Q, Lv S, Song L, Liu C, Ma T, Gong X. Circular array transducer based-photoacoustic/ultrasonic endoscopic imaging with tunable ring-beam excitation. PHOTOACOUSTICS 2023; 29:100441. [PMID: 36606259 PMCID: PMC9807825 DOI: 10.1016/j.pacs.2022.100441] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/04/2022] [Accepted: 12/18/2022] [Indexed: 06/17/2023]
Abstract
Photoacoustic/ultrasound endoscopic imaging is regarded as an effective method to achieve accurate detection of intestinal disease by offering both the functional and structural information, simultaneously. Compared to the conventional endoscopy with single transducer and laser spot for signal detection and optical excitation, photoacoustic/ultrasound endoscopic probe using circular array transducer and ring-shaped laser beam avoids the instability brought by the mechanical scanning point-to-point, offering the dual-modality imaging with high accuracy and efficiency. Meanwhile, considering the complex morphological environments of intestinal tracts in clinics, developing the probe having sufficient wide imaging distance range is especially important. In this work, we develop a compact circular photoacoustic/ultrasonic endoscopic probe, using the group of fiber, lens and home-made axicon, to generate relatively concentrated ring-shaped laser beam for 360° excitation with high efficiency. Furthermore, the laser ring size can be tuned conveniently by changing the fiber-lens distance to ensure the potential applicability of the probe in various and complex morphological environments of intestines. Phantom experimental results demonstrate imaging distance range wide enough to cover from 12 mm to 30 mm. In addition, the accessibility of the photoacoustic signals of molecular probes in ex vivo experiments at the tissue depth of 7 mm using excitation energy of 5 mJ has also been demonstrated, showing a high optical excitation efficiency of the probe.
Collapse
Affiliation(s)
- Zhihua Xie
- Research Laboratory for Biomedical Optics and Molecular Imaging, Guangdong Provincial Key Laboratory of Biomedical Optical Imaging Technology, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
- CAS Key Laboratory of Health Informatics, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Jiamei Liu
- CAS Key Laboratory of Health Informatics, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Yaguang Ren
- Research Laboratory for Biomedical Optics and Molecular Imaging, Guangdong Provincial Key Laboratory of Biomedical Optical Imaging Technology, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
- CAS Key Laboratory of Health Informatics, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Jiqing Huang
- CAS Key Laboratory of Health Informatics, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Riqiang Lin
- Research Laboratory for Biomedical Optics and Molecular Imaging, Guangdong Provincial Key Laboratory of Biomedical Optical Imaging Technology, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
- CAS Key Laboratory of Health Informatics, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Xiatian Wang
- Research Laboratory for Biomedical Optics and Molecular Imaging, Guangdong Provincial Key Laboratory of Biomedical Optical Imaging Technology, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
- CAS Key Laboratory of Health Informatics, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Qingyuan Tan
- CAS Key Laboratory of Health Informatics, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Shengmiao Lv
- Research Laboratory for Biomedical Optics and Molecular Imaging, Guangdong Provincial Key Laboratory of Biomedical Optical Imaging Technology, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
- CAS Key Laboratory of Health Informatics, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Liang Song
- Research Laboratory for Biomedical Optics and Molecular Imaging, Guangdong Provincial Key Laboratory of Biomedical Optical Imaging Technology, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
- CAS Key Laboratory of Health Informatics, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Chengbo Liu
- Research Laboratory for Biomedical Optics and Molecular Imaging, Guangdong Provincial Key Laboratory of Biomedical Optical Imaging Technology, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
- CAS Key Laboratory of Health Informatics, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Teng Ma
- CAS Key Laboratory of Health Informatics, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Xiaojing Gong
- Research Laboratory for Biomedical Optics and Molecular Imaging, Guangdong Provincial Key Laboratory of Biomedical Optical Imaging Technology, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
- CAS Key Laboratory of Health Informatics, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| |
Collapse
|
28
|
Tampu IE, Eklund A, Johansson K, Gimm O, Haj-Hosseini N. Diseased thyroid tissue classification in OCT images using deep learning: Towards surgical decision support. JOURNAL OF BIOPHOTONICS 2023; 16:e202200227. [PMID: 36203247 DOI: 10.1002/jbio.202200227] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Revised: 09/15/2022] [Accepted: 09/16/2022] [Indexed: 06/16/2023]
Abstract
Intraoperative guidance tools for thyroid surgery based on optical coherence tomography (OCT) could aid distinguish between normal and diseased tissue. However, OCT images are difficult to interpret, thus, real-time automatic analysis could support the clinical decision-making. In this study, several deep learning models were investigated for thyroid disease classification on 2D and 3D OCT data obtained from ex vivo specimens of 22 patients undergoing surgery and diagnosed with several thyroid pathologies. Additionally, two open-access datasets were used to evaluate the custom models. On the thyroid dataset, the best performance was achieved by the 3D vision transformer model with a Matthew's correlation coefficient (MCC) of 0.79 (accuracy = 0.90) for the normal-versus-abnormal classification. On the open-access datasets, the custom models achieved the best performance (MCC > 0.88, accuracy > 0.96). Results obtained for the normal-versus-abnormal classification suggest OCT, complemented with deep learning-based analysis, as a tool for real-time automatic diseased tissue identification in thyroid surgery.
Collapse
Affiliation(s)
- Iulian Emil Tampu
- Department of Biomedical Engineering, Linköping University, Linköping, Sweden
- Center for Medical Image Science and Visualization, Linköping University, Linköping, Sweden
| | - Anders Eklund
- Department of Biomedical Engineering, Linköping University, Linköping, Sweden
- Center for Medical Image Science and Visualization, Linköping University, Linköping, Sweden
- Division of Statistics & Machine Learning, Department of Computer and Information Science, Linköping University, Linköping, Sweden
| | - Kenth Johansson
- Department of Surgery, Västervik Hospital, Västervik, Sweden
- Department of Surgery, Örebro University Hospital, Örebro, Sweden
| | - Oliver Gimm
- Department of Surgery, Linköping University Hospital, Linköping, Sweden
- Department of Biomedical and Clinical Sciences, Linköping University, Linköping, Sweden
| | - Neda Haj-Hosseini
- Department of Biomedical Engineering, Linköping University, Linköping, Sweden
- Center for Medical Image Science and Visualization, Linköping University, Linköping, Sweden
| |
Collapse
|
29
|
Cao G, Li S, Zhang S, Peng Z, Wu Y, Wang D, Dai C. Improved FAST algorithm for non-uniform rotational distortion correction in OCT endoscopic imaging. OPTICS EXPRESS 2023; 31:2754-2767. [PMID: 36785282 DOI: 10.1364/oe.474955] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/06/2022] [Accepted: 12/21/2022] [Indexed: 06/18/2023]
Abstract
Optical Coherence Tomography (OCT) is widely used for endoscopic imaging in endoluminal organs because of its high imaging accuracy and resolution. However, OCT endoscopic imaging suffers from Non-Uniform Rotational Distortion (NURD), which can be caused by many factors, such as irregular motor rotation and changes in friction between the probe and the sheath. Correcting this distortion is essential to obtaining high-quality Optical Coherence Tomography Angiography (OCTA) images. There are two main approaches for correcting NURD: hardware-based methods and algorithm-based methods. Hardware-based methods can be costly, challenging to implement, and may not eliminate NURD. Algorithm-based methods, such as image registration, can be effective for correcting NURD but can also be prone to the problem of NURD propagation. To address this issue, we process frames by coarse and fine registration, respectively. The new reference frame is generated by filtering out the A-scan that may have the NURD problem by coarse registration. And the fine registration uses this frame to achieve the final NURD correction. In addition, we have improved the Features from Accelerated Segment Test (FAST) algorithm and put it into coarse and fine registration process. Four evaluation functions were used for the experimental results, including signal-to-noise ratio (SNR), peak signal-to-noise ratio (PSNR), mean squared error (MSE), and structural similarity index measure (SSIM). By comparing with Scale-invariant feature transform (SIFT), Speeded up robust features (SURF), Oriented FAST and Rotated BRIEF (ORB), intensity-based (Cross-correlation), and Optical Flow algorithms, our algorithm has a higher similarity between the corrected frames. Moreover, the noise in the OCTA data is better suppressed, and the vascular information is well preserved. Our image registration-based algorithm reduces the problem of NURD propagation between B-scan frames and improves the imaging quality of OCT endoscopic images.
Collapse
|
30
|
Pleskow DK, Sawhney MS, Upputuri PK, Berzin TM, Coughlan MF, Khan U, Glyavina M, Zhang X, Chen L, Sheil CJ, Cohen JM, Vitkin E, Zakharov YN, Itzkan I, Zhang L, Qiu L, Perelman LT. In vivo detection of bile duct pre-cancer with endoscopic light scattering spectroscopy. Nat Commun 2023; 14:109. [PMID: 36611024 PMCID: PMC9825389 DOI: 10.1038/s41467-022-35780-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2021] [Accepted: 12/23/2022] [Indexed: 01/09/2023] Open
Abstract
Bile duct cancer is the second most common primary liver cancer, with most diagnoses occurring in the advanced stages. This leads to a poor survival rate, which means a technique capable of reliably detecting pre-cancer in the bile duct is urgently required. Unfortunately, radiological imaging lacks adequate accuracy for distinguishing dysplastic and benign biliary ducts, while endoscopic techniques, which can directly assess the bile duct lining, often suffer from insufficient sampling. Here, we report an endoscopic optical light scattering technique for clinical evaluation of the malignant potential of the bile duct. This technique employs an ultraminiature spatial gating fiber optic probe compatible with cholangioscopes and endoscopic retrograde cholangiopancreatography (ERCP) catheters. The probe allowed us to investigate the internal cellular composition of the bile duct epithelium with light scattering spectroscopy (LSS) and phenotypic properties of the underlying connective tissue with diffuse reflectance spectroscopy (DRS). In a pilot in vivo double-blind prospective study involving 29 patients undergoing routine ERCP procedures, the technique detected malignant transformation with 97% accuracy, showing that biliary duct pre-cancer can be reliably identified in vivo non-invasively.
Collapse
Affiliation(s)
- Douglas K Pleskow
- Center for Advanced Biomedical Imaging and Photonics, Division of Gastroenterology, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard University, Boston, MA, USA.,Center for Advanced Endoscopy, Division of Gastroenterology, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard University, Boston, MA, USA
| | - Mandeep S Sawhney
- Center for Advanced Endoscopy, Division of Gastroenterology, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard University, Boston, MA, USA
| | - Paul K Upputuri
- Center for Advanced Biomedical Imaging and Photonics, Division of Gastroenterology, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard University, Boston, MA, USA
| | - Tyler M Berzin
- Center for Advanced Endoscopy, Division of Gastroenterology, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard University, Boston, MA, USA
| | - Mark F Coughlan
- Center for Advanced Biomedical Imaging and Photonics, Division of Gastroenterology, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard University, Boston, MA, USA
| | - Umar Khan
- Center for Advanced Biomedical Imaging and Photonics, Division of Gastroenterology, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard University, Boston, MA, USA
| | - Maria Glyavina
- Center for Advanced Biomedical Imaging and Photonics, Division of Gastroenterology, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard University, Boston, MA, USA
| | - Xuejun Zhang
- Center for Advanced Biomedical Imaging and Photonics, Division of Gastroenterology, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard University, Boston, MA, USA
| | - Liming Chen
- Center for Advanced Biomedical Imaging and Photonics, Division of Gastroenterology, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard University, Boston, MA, USA
| | - Conor J Sheil
- Center for Advanced Biomedical Imaging and Photonics, Division of Gastroenterology, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard University, Boston, MA, USA
| | - Jonah M Cohen
- Center for Advanced Endoscopy, Division of Gastroenterology, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard University, Boston, MA, USA
| | - Edward Vitkin
- Center for Advanced Biomedical Imaging and Photonics, Division of Gastroenterology, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard University, Boston, MA, USA
| | - Yuri N Zakharov
- Center for Advanced Biomedical Imaging and Photonics, Division of Gastroenterology, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard University, Boston, MA, USA
| | - Irving Itzkan
- Center for Advanced Biomedical Imaging and Photonics, Division of Gastroenterology, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard University, Boston, MA, USA
| | - Lei Zhang
- Center for Advanced Biomedical Imaging and Photonics, Division of Gastroenterology, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard University, Boston, MA, USA.
| | - Le Qiu
- Center for Advanced Biomedical Imaging and Photonics, Division of Gastroenterology, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard University, Boston, MA, USA.
| | - Lev T Perelman
- Center for Advanced Biomedical Imaging and Photonics, Division of Gastroenterology, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard University, Boston, MA, USA. .,Biological and Biomedical Sciences Program, Harvard University, Boston, MA, USA.
| |
Collapse
|
31
|
Nelson MS, Liu Y, Wilson HM, Li B, Rosado-Mendez IM, Rogers JD, Block WF, Eliceiri KW. Multiscale Label-Free Imaging of Fibrillar Collagen in the Tumor Microenvironment. Methods Mol Biol 2023; 2614:187-235. [PMID: 36587127 DOI: 10.1007/978-1-0716-2914-7_13] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
Abstract
With recent advances in cancer therapeutics, there is a great need for improved imaging methods for characterizing cancer onset and progression in a quantitative and actionable way. Collagen, the most abundant extracellular matrix protein in the tumor microenvironment (and the body in general), plays a multifaceted role, both hindering and promoting cancer invasion and progression. Collagen deposition can defend the tumor with immunosuppressive effects, while aligned collagen fiber structures can enable tumor cell migration, aiding invasion and metastasis. Given the complex role of collagen fiber organization and topology, imaging has been a tool of choice to characterize these changes on multiple spatial scales, from the organ and tumor scale to cellular and subcellular level. Macroscale density already aids in the detection and diagnosis of solid cancers, but progress is being made to integrate finer microscale features into the process. Here we review imaging modalities ranging from optical methods of second harmonic generation (SHG), polarized light microscopy (PLM), and optical coherence tomography (OCT) to the medical imaging approaches of ultrasound and magnetic resonance imaging (MRI). These methods have enabled scientists and clinicians to better understand the impact collagen structure has on the tumor environment, at both the bulk scale (density) and microscale (fibrillar structure) levels. We focus on imaging methods with the potential to both examine the collagen structure in as natural a state as possible and still be clinically amenable, with an emphasis on label-free strategies, exploiting intrinsic optical properties of collagen fibers.
Collapse
Affiliation(s)
- Michael S Nelson
- Center for Quantitative Cell Imaging, University of Wisconsin-Madison, Madison, WI, USA.,Department of Biomedical Engineering, University of Wisconsin-Madison, Madison, WI, USA
| | - Yuming Liu
- Center for Quantitative Cell Imaging, University of Wisconsin-Madison, Madison, WI, USA
| | - Helen M Wilson
- Center for Quantitative Cell Imaging, University of Wisconsin-Madison, Madison, WI, USA.,Department of Biomedical Engineering, University of Wisconsin-Madison, Madison, WI, USA
| | - Bin Li
- Center for Quantitative Cell Imaging, University of Wisconsin-Madison, Madison, WI, USA.,Department of Biomedical Engineering, University of Wisconsin-Madison, Madison, WI, USA.,Morgridge Institute for Research, Madison, WI, USA
| | - Ivan M Rosado-Mendez
- Department of Medical Physics, University of Wisconsin-Madison, Madison, WI, USA
| | - Jeremy D Rogers
- Morgridge Institute for Research, Madison, WI, USA.,McPherson Eye Research Institute, University of Wisconsin-Madison, Madison, WI, USA
| | - Walter F Block
- Department of Medical Physics, University of Wisconsin-Madison, Madison, WI, USA
| | - Kevin W Eliceiri
- Center for Quantitative Cell Imaging, University of Wisconsin-Madison, Madison, WI, USA. .,Department of Biomedical Engineering, University of Wisconsin-Madison, Madison, WI, USA. .,Morgridge Institute for Research, Madison, WI, USA. .,Department of Medical Physics, University of Wisconsin-Madison, Madison, WI, USA. .,McPherson Eye Research Institute, University of Wisconsin-Madison, Madison, WI, USA.
| |
Collapse
|
32
|
Confocal laser endomicroscope with distal MEMS scanner for real-time histopathology. Sci Rep 2022; 12:20155. [PMID: 36418439 PMCID: PMC9684518 DOI: 10.1038/s41598-022-24210-9] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Accepted: 11/11/2022] [Indexed: 11/25/2022] Open
Abstract
Confocal laser endomicroscopy is an emerging methodology to perform real time optical biopsy. Fluorescence images with histology-like quality can be collected instantaneously from the epithelium of hollow organs. Currently, scanning is performed at the proximal end of probe-based instruments used routinely in the clinic, and flexibility to control the focus is limited. We demonstrate use of a parametric resonance scanner packaged in the distal end of the endomicroscope to perform high speed lateral deflections. An aperture was etched in the center of the reflector to fold the optical path. This design reduced the dimensions of the instrument to 2.4 mm diameter and 10 mm length, allowing for forward passage through the working channel of a standard medical endoscope. A compact lens assembly provides lateral and axial resolution of 1.1 and 13.6 μm, respectively. A working distance of 0 μm and field-of-view of 250 μm × 250 μm was achieved at frame rates up to 20 Hz. Excitation at 488 nm was delivered to excite fluorescein, an FDA-approved dye, to generate high tissue contrast. The endomicroscope was reprocessed using a clinically-approved sterilization method for 18 cycles without failure. Fluorescence images were collected during routine colonoscopy from normal colonic mucosa, tubular adenomas, hyperplastic polyps, ulcerative colitis, and Crohn's colitis. Individual cells, including colonocytes, goblet cells, and inflammatory cells, could be identified. Mucosal features, such as crypt structures, crypt lumens, and lamina propria, could be distinguished. This instrument has potential to be used as an accessory during routine medical endoscopy.
Collapse
|
33
|
Starovoyt A, Quirk BC, Putzeys T, Kerckhofs G, Nuyts J, Wouters J, McLaughlin RA, Verhaert N. An optically-guided cochlear implant sheath for real-time monitoring of electrode insertion into the human cochlea. Sci Rep 2022; 12:19234. [PMID: 36357503 PMCID: PMC9649659 DOI: 10.1038/s41598-022-23653-4] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2022] [Accepted: 11/03/2022] [Indexed: 11/12/2022] Open
Abstract
In cochlear implant surgery, insertion of perimodiolar electrode arrays into the scala tympani can be complicated by trauma or even accidental translocation of the electrode array within the cochlea. In patients with partial hearing loss, cochlear trauma can not only negatively affect implant performance, but also reduce residual hearing function. These events have been related to suboptimal positioning of the cochlear implant electrode array with respect to critical cochlear walls of the scala tympani (modiolar wall, osseous spiral lamina and basilar membrane). Currently, the position of the electrode array in relation to these walls cannot be assessed during the insertion and the surgeon depends on tactile feedback, which is unreliable and often comes too late. This study presents an image-guided cochlear implant device with an integrated, fiber-optic imaging probe that provides real-time feedback using optical coherence tomography during insertion into the human cochlea. This novel device enables the surgeon to accurately detect and identify the cochlear walls ahead and to adjust the insertion trajectory, avoiding collision and trauma. The functionality of this prototype has been demonstrated in a series of insertion experiments, conducted by experienced cochlear implant surgeons on fresh-frozen human cadaveric cochleae.
Collapse
Affiliation(s)
- Anastasiya Starovoyt
- grid.5596.f0000 0001 0668 7884Department of Neurosciences, ExpORL, KU Leuven, 3000 Leuven, Belgium ,grid.5596.f0000 0001 0668 7884Department of Neurosciences, Leuven Brain Institute, KU Leuven, 3000 Leuven, Belgium
| | - Bryden C. Quirk
- grid.1010.00000 0004 1936 7304Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Faculty of Health and Medical Sciences, The University of Adelaide, Adelaide, SA 5005 Australia ,grid.1010.00000 0004 1936 7304Institute for Photonics and Advanced Sensing, The University of Adelaide, Adelaide, SA 5005 Australia
| | - Tristan Putzeys
- grid.5596.f0000 0001 0668 7884Department of Neurosciences, ExpORL, KU Leuven, 3000 Leuven, Belgium ,grid.5596.f0000 0001 0668 7884Department of Neurosciences, Leuven Brain Institute, KU Leuven, 3000 Leuven, Belgium ,grid.5596.f0000 0001 0668 7884Laboratory for Soft Matter and Biophysics, Department of Physics and Astronomy, KU Leuven, 3000 Leuven, Belgium
| | - Greet Kerckhofs
- grid.7942.80000 0001 2294 713XBiomechanics Laboratory, Institute of Mechanics, Materials, and Civil Engineering, UCLouvain, 1348 Louvain-La-Neuve, Belgium ,grid.5596.f0000 0001 0668 7884Department of Materials Science and Engineering, KU Leuven, 3000 Leuven, Belgium ,grid.7942.80000 0001 2294 713XInstitute of Experimental and Clinical Research, UCLouvain, 1200 Woluwé-Saint-Lambert, Belgium ,grid.5596.f0000 0001 0668 7884Prometheus, Division of Skeletal Tissue Engineering, KU Leuven, 3000 Leuven, Belgium
| | - Johan Nuyts
- grid.5596.f0000 0001 0668 7884Department of Imaging and Pathology, Division of Nuclear Medicine, KU Leuven, 3000 Leuven, Belgium ,Nuclear Medicine and Molecular Imaging, Medical Imaging Research Center, 3000 Leuven, Belgium
| | - Jan Wouters
- grid.5596.f0000 0001 0668 7884Department of Neurosciences, ExpORL, KU Leuven, 3000 Leuven, Belgium ,grid.5596.f0000 0001 0668 7884Department of Neurosciences, Leuven Brain Institute, KU Leuven, 3000 Leuven, Belgium
| | - Robert A. McLaughlin
- grid.1010.00000 0004 1936 7304Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Faculty of Health and Medical Sciences, The University of Adelaide, Adelaide, SA 5005 Australia ,grid.1010.00000 0004 1936 7304Institute for Photonics and Advanced Sensing, The University of Adelaide, Adelaide, SA 5005 Australia ,grid.1012.20000 0004 1936 7910School of Engineering, University of Western Australia, Perth, WA 6009 Australia
| | - Nicolas Verhaert
- grid.5596.f0000 0001 0668 7884Department of Neurosciences, ExpORL, KU Leuven, 3000 Leuven, Belgium ,grid.5596.f0000 0001 0668 7884Department of Neurosciences, Leuven Brain Institute, KU Leuven, 3000 Leuven, Belgium ,grid.410569.f0000 0004 0626 3338Department of Otorhinolaryngology, Head and Neck Surgery, University Hospitals of Leuven, 3000 Leuven, Belgium
| |
Collapse
|
34
|
OCT Meets micro-CT: A Subject-Specific Correlative Multimodal Imaging Workflow for Early Chick Heart Development Modeling. J Cardiovasc Dev Dis 2022; 9:jcdd9110379. [DOI: 10.3390/jcdd9110379] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 10/29/2022] [Accepted: 10/31/2022] [Indexed: 11/06/2022] Open
Abstract
Structural and Doppler velocity data collected from optical coherence tomography have already provided crucial insights into cardiac morphogenesis. X-ray microtomography and other ex vivo methods have elucidated structural details of developing hearts. However, by itself, no single imaging modality can provide comprehensive information allowing to fully decipher the inner workings of an entire developing organ. Hence, we introduce a specimen-specific correlative multimodal imaging workflow combining OCT and micro-CT imaging which is applicable for modeling of early chick heart development—a valuable model organism in cardiovascular development research. The image acquisition and processing employ common reagents, lab-based micro-CT imaging, and software that is free for academic use. Our goal is to provide a step-by-step guide on how to implement this workflow and to demonstrate why those two modalities together have the potential to provide new insight into normal cardiac development and heart malformations leading to congenital heart disease.
Collapse
|
35
|
Thiboutot J, Yuan W, Park HC, Li D, Loube J, Mitzner W, Yarmus L, Li X, Brown RH. Visualization and Validation of The Microstructures in The Airway Wall in vivo Using Diffractive Optical Coherence Tomography. Acad Radiol 2022; 29:1623-1630. [PMID: 35282990 PMCID: PMC9463401 DOI: 10.1016/j.acra.2022.01.008] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Revised: 12/22/2021] [Accepted: 01/09/2022] [Indexed: 11/17/2022]
Abstract
RATIONALE AND OBJECTIVES At present, there is no available method to study the in vivo microstructures of the airway wall (epithelium, smooth muscle, adventitia, basement membrane, glands, cartilage). Currently, we rely on ex vivo histologic evaluation of airway biopsies. To overcome this obstacle, we have developed an endoscopic ultrahigh-resolution diffractive optical coherence tomography (OCT) system, operating at a wavelength of 800 nm, to non-invasively study the in vivo microstructures of the airway wall. Prior to human study, validation of diffractive OCT's ability to quantitate airway microstructural components is required. MATERIALS AND METHODS To validate and demonstrate the accuracy of this OCT system, we used an ovine model to image small airways (∼ 2 mm in diameter). Histologic samples and correlated OCT images were matched. The cross-sectional area of the airway wall, lumen, and other microstructures were measured and compared. RESULTS A total of 27 sheep were studied from which we identified 39 paired OCT-histology airway images. We found strong correlations between the OCT and the histology measurements of the airway wall area and the microstructural area measurements of the epithelium, basement membrane, airway smooth muscle, glands, cartilage, and adventitia. The correlations ranged from r=0.61 (p<0.001) for the epithelium to r=0.86 (p<0.001) for the adventitia with the correlation between the OCT and the histology measurements for the entire airway wall of r=0.76 (p<0.001). CONCLUSION Given the high degree of correlation, these data validate the ability to acquire and quantify in vivo microscopic level imaging with this newly developed 800nm ultra-high resolution diffractive OCT system.
Collapse
Affiliation(s)
- Jeffrey Thiboutot
- Division of Pulmonary and Critical Care Medicine, School of Medicine, Johns Hopkins University, Baltimore, Maryland
| | - Wu Yuan
- Department of Biomedical Engineering, School of Medicine, Johns Hopkins University, Baltimore, Maryland; Department of Biomedical Engineering and Shun Hing Institute of Advanced Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Hyeon-Cheol Park
- Department of Biomedical Engineering, School of Medicine, Johns Hopkins University, Baltimore, Maryland
| | - Dawei Li
- Department of Biomedical Engineering, School of Medicine, Johns Hopkins University, Baltimore, Maryland
| | - Jeffrey Loube
- Department of Environmental Health and Engineering, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland
| | - Wayne Mitzner
- Division of Pulmonary and Critical Care Medicine, School of Medicine, Johns Hopkins University, Baltimore, Maryland; Department of Environmental Health and Engineering, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland; Department of Anesthesiology/Critical Care Medicine, School of Medicine, Johns Hopkins University, Baltimore, Maryland
| | - Lonny Yarmus
- Division of Pulmonary and Critical Care Medicine, School of Medicine, Johns Hopkins University, Baltimore, Maryland
| | - Xingde Li
- Department of Biomedical Engineering, School of Medicine, Johns Hopkins University, Baltimore, Maryland
| | - Robert H Brown
- Division of Pulmonary and Critical Care Medicine, School of Medicine, Johns Hopkins University, Baltimore, Maryland; Department of Environmental Health and Engineering, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland; Department of Anesthesiology/Critical Care Medicine, School of Medicine, Johns Hopkins University, Baltimore, Maryland.
| |
Collapse
|
36
|
Non-contact optical in-vivo sensing of cilia motion by analyzing speckle patterns. Sci Rep 2022; 12:16614. [PMID: 36198733 PMCID: PMC9534876 DOI: 10.1038/s41598-022-20557-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2022] [Accepted: 09/14/2022] [Indexed: 11/17/2022] Open
Abstract
Cilia motion is an indicator of pathological-ciliary function, however current diagnosis relies on biopsies. In this paper, we propose an innovative approach for sensing cilia motility. We present an endoscopic configuration for measuring the motion frequency of cilia in the nasal cavity. The technique is based on temporal tracking of the reflected spatial distribution of defocused speckle patterns while illuminating the cilia with a laser. The setup splits the optical signal into two channels; One imaging channel is for the visualization of the physician and another is, defocusing channel, to capture the speckles. We present in-vivo measurements from healthy subjects undergoing endoscopic examination. We found an average motion frequency of around 7.3 Hz and 9.8 Hz in the antero-posterior nasal mucus (an area rich in cilia), which matches the normal cilia range of 7–16 Hz. Quantitative and precise measurements of cilia vibration will optimize the diagnosis and treatment of pathological-ciliary function. This method is simple, minimally invasive, inexpensive, and promising to distinguish between normal and ciliary dysfunction.
Collapse
|
37
|
Wang T, Pfeiffer T, Akyildiz A, van Beusekom HMM, Huber R, van der Steen AFW, van Soest G. Intravascular optical coherence elastography. BIOMEDICAL OPTICS EXPRESS 2022; 13:5418-5433. [PMID: 36425628 PMCID: PMC9664873 DOI: 10.1364/boe.470039] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/11/2022] [Revised: 08/30/2022] [Accepted: 08/31/2022] [Indexed: 05/07/2023]
Abstract
Optical coherence elastography (OCE), a functional extension of optical coherence tomography (OCT), visualizes tissue strain to deduce the tissue's biomechanical properties. In this study, we demonstrate intravascular OCE using a 1.1 mm motorized catheter and a 1.6 MHz Fourier domain mode-locked OCT system. We induced an intraluminal pressure change by varying the infusion rate from the proximal end of the catheter. We analysed the pixel-matched phase change between two different frames to yield the radial strain. Imaging experiments were carried out in a phantom and in human coronary arteries in vitro. At an imaging speed of 3019 frames/s, we were able to capture the dynamic strain. Stiff inclusions in the phantom and calcification in atherosclerotic plaques are associated with low strain values and can be distinguished from the surrounding soft material, which exhibits elevated strain. For the first time, circumferential intravascular OCE images are provided side by side with conventional OCT images, simultaneously mapping both the tissue structure and stiffness.
Collapse
Affiliation(s)
- Tianshi Wang
- Thoraxcentre, Erasmus University Medical Centre, Rotterdam 3015 AA, The Netherlands
| | - Tom Pfeiffer
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck 23562, Germany
| | - Ali Akyildiz
- Thoraxcentre, Erasmus University Medical Centre, Rotterdam 3015 AA, The Netherlands
- Department of Biomechanical Engineering, Delft University of Technology, Delft 2600 AA, The Netherlands
| | | | - Robert Huber
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck 23562, Germany
| | - Antonius F. W. van der Steen
- Thoraxcentre, Erasmus University Medical Centre, Rotterdam 3015 AA, The Netherlands
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518005, China
- Department of Imaging Science and Technology, Delft University of Technology, Delft 2600 AA, The Netherlands
| | - Gijs van Soest
- Thoraxcentre, Erasmus University Medical Centre, Rotterdam 3015 AA, The Netherlands
| |
Collapse
|
38
|
Wu G, Song Z, Hao M, Yin L. Edge detection in single multimode fiber imaging based on deep learning. OPTICS EXPRESS 2022; 30:30718-30726. [PMID: 36242170 DOI: 10.1364/oe.464492] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/19/2022] [Accepted: 06/20/2022] [Indexed: 06/16/2023]
Abstract
We propose a new edge detection scheme based on deep learning in single multimode fiber imaging. In this scheme, we creatively design a novel neural network, whose input is a one-dimensional light intensity sequence, and the output is the edge detection result of the target. Different from the traditional scheme, we can directly obtain the edge information of unknown objects by using this neural network without rebuilding the image. Simulation and experimental results show that, compared with the traditional method, this method can get better edge details, especially in the case of low sampling rates. It can increase the structural similarity index of edge detection imaging from 0.38 to 0.62 at the sampling rate of 0.6%. At the same time, the robustness of the method to fiber bending is also proved. This scheme improves the edge detection performance of endoscopic images and provides a promising way for the practical application of multimode fiber endoscopy.
Collapse
|
39
|
Zhao T, Pham TT, Baker C, Ma MT, Ourselin S, Vercauteren T, Zhang E, Beard PC, Xia W. Ultrathin, high-speed, all-optical photoacoustic endomicroscopy probe for guiding minimally invasive surgery. BIOMEDICAL OPTICS EXPRESS 2022; 13:4414-4428. [PMID: 36032566 PMCID: PMC9408236 DOI: 10.1364/boe.463057] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/04/2022] [Revised: 07/01/2022] [Accepted: 07/01/2022] [Indexed: 06/15/2023]
Abstract
Photoacoustic (PA) endoscopy has shown significant potential for clinical diagnosis and surgical guidance. Multimode fibres (MMFs) are becoming increasingly attractive for the development of miniature endoscopy probes owing to their ultrathin size, low cost and diffraction-limited spatial resolution enabled by wavefront shaping. However, current MMF-based PA endomicroscopy probes are either limited by a bulky ultrasound detector or a low imaging speed that hindered their usability. In this work, we report the development of a highly miniaturised and high-speed PA endomicroscopy probe that is integrated within the cannula of a 20 gauge medical needle. This probe comprises a MMF for delivering the PA excitation light and a single-mode optical fibre with a plano-concave microresonator for ultrasound detection. Wavefront shaping with a digital micromirror device enabled rapid raster-scanning of a focused light spot at the distal end of the MMF for tissue interrogation. High-resolution PA imaging of mouse red blood cells covering an area 100 µm in diameter was achieved with the needle probe at ∼3 frames per second. Mosaicing imaging was performed after fibre characterisation by translating the needle probe to enlarge the field-of-view in real-time. The developed ultrathin PA endomicroscopy probe is promising for guiding minimally invasive surgery by providing functional, molecular and microstructural information of tissue in real-time.
Collapse
Affiliation(s)
- Tianrui Zhao
- School of Biomedical Engineering and Imaging Sciences, King’s College London, 4 Floor, Lambeth Wing St Thomas’ Hospital, London SE1 7EH, United Kingdom
| | - Truc Thuy Pham
- School of Biomedical Engineering and Imaging Sciences, King’s College London, 4 Floor, Lambeth Wing St Thomas’ Hospital, London SE1 7EH, United Kingdom
| | - Christian Baker
- School of Biomedical Engineering and Imaging Sciences, King’s College London, 4 Floor, Lambeth Wing St Thomas’ Hospital, London SE1 7EH, United Kingdom
| | - Michelle T. Ma
- School of Biomedical Engineering and Imaging Sciences, King’s College London, 4 Floor, Lambeth Wing St Thomas’ Hospital, London SE1 7EH, United Kingdom
| | - Sebastien Ourselin
- School of Biomedical Engineering and Imaging Sciences, King’s College London, 4 Floor, Lambeth Wing St Thomas’ Hospital, London SE1 7EH, United Kingdom
| | - Tom Vercauteren
- School of Biomedical Engineering and Imaging Sciences, King’s College London, 4 Floor, Lambeth Wing St Thomas’ Hospital, London SE1 7EH, United Kingdom
| | - Edward Zhang
- Department of Medical Physics and Biomedical Engineering, University College London, Gower Street, London WC1E 6BT, UK
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, Charles Bell House, 67-73 Riding House Street, London W1W 7EJ, UK
| | - Paul C. Beard
- Department of Medical Physics and Biomedical Engineering, University College London, Gower Street, London WC1E 6BT, UK
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, Charles Bell House, 67-73 Riding House Street, London W1W 7EJ, UK
| | - Wenfeng Xia
- School of Biomedical Engineering and Imaging Sciences, King’s College London, 4 Floor, Lambeth Wing St Thomas’ Hospital, London SE1 7EH, United Kingdom
| |
Collapse
|
40
|
Wang C, Liu H, Cui H, Ma J, Li Y, Tian J, Jin C, Chen Y, Gao Y, Fu Q, Hu Y, Wu D, Yu F, Wu R, Wang A, Feng L. Two-photon endomicroscopy with microsphere-spliced double-cladding antiresonant fiber for resolution enhancement. OPTICS EXPRESS 2022; 30:26090-26101. [PMID: 36236806 DOI: 10.1364/oe.461325] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/17/2022] [Accepted: 06/16/2022] [Indexed: 06/16/2023]
Abstract
We demonstrate a miniature fiber-optic two two-photon endomicroscopy with microsphere-spliced double-cladding antiresonant fiber for resolution enhancement. An easy-to-operate process for fixing microsphere permanently in an antiresonant fiber core, by arc discharge, is proposed. The flexible fiber-optic probe is integrated with a parameter of 5.8 mm × 49.1 mm (outer diameter × rigid length); the field of view is 210 µm, the resolution is 1.3 µm, and the frame rate is 0.7 fps. The imaging ability is verified using ex-vivo mouse kidney, heart, stomach, tail tendon, and in-vivo brain neural imaging.
Collapse
|
41
|
Lee J, Yoon J. Assessment of angle-dependent spectral distortion to develop accurate hyperspectral endoscopy. Sci Rep 2022; 12:11892. [PMID: 35831360 PMCID: PMC9279473 DOI: 10.1038/s41598-022-16232-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Accepted: 07/06/2022] [Indexed: 11/29/2022] Open
Abstract
Hyperspectral endoscopy has shown its potential to improve disease diagnosis in gastrointestinal tracts. Recent approaches in developing hyperspectral endoscopy are mainly focusing on enhancing image speed and quality of spectral information under a clinical environment, but there are many issues in obtaining consistent spectral information due to complicated imaging conditions, including imaging angle, non-uniform illumination, working distance, and low reflected signal. We quantitatively investigated the effect of imaging angle on the distortion of spectral information by exploiting a bifurcated fiber, spectrometer, and tissue-mimicking phantom. Spectral distortion becomes severe as increasing the angle of the imaging fiber or shortening camera exposure time for fast image acquisition. Moreover, spectral ranges from 450 to 550 nm are more susceptible to the angle-dependent spectral distortion than longer spectral ranges. Therefore, imaging angles close to normal and longer target spectral ranges with enough detector exposure time could minimize spectral distortion in hyperspectral endoscopy. These findings will help implement clinical HSI endoscopy for the robust and accurate measurement of spectral information from patients in vivo.
Collapse
Affiliation(s)
- Jungwoo Lee
- Department of Physics, Ajou University, Suwon, Republic of Korea
| | - Jonghee Yoon
- Department of Physics, Ajou University, Suwon, Republic of Korea.
| |
Collapse
|
42
|
Bueno MR, Estrela C. A computational modeling method for root canal endoscopy using a specific CBCT filter: A new era in the metaverse of endodontics begins. Braz Dent J 2022; 33:21-30. [PMID: 36043565 DOI: 10.1590/0103-6440202205078] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Accepted: 07/04/2022] [Indexed: 01/16/2023] Open
Abstract
A contemporary technological revolution has started a new era in the metaverse of Endodontics, a world of virtual operational possibilities that use an exact replica of the natural structures of the maxillofacial complex. This study describes a modeling method for root canal endoscopy using modern cone-beam CT (CBCT) software in a series of clinical cases. The method consists in acquiring thin CBCT slices (0.10mm) in the coronal, sagittal, and axial planes. A specific 3D volume filter, the pulp cavity filter of the e-Vol DX CBCT software, was used to navigate anatomical root canal microstructures, and to scan them using root canal endoscopy. The pulp cavity filter should be set to synchronize CBCT scans from 2D mode - multiplanar reformations (MPR) - to 3D mode - volumetric reconstruction. This filter, when adopting the option of volumetric reconstruction, the developed algorithm leaves the dentin density in transparent mode so that the pulp cavity may be visualized. The algorithm applied performs the suppression (visual) of areas with dentin density. This ensures 3D visualization of the slices and the microanatomy of the root canal, as well as a dynamic navigation throughout the pulp cavity. This computational modeling method adds new resources to Endodontics, which may impact the predictability of root canal treatments positively. The virtual visualization of the internal anatomy of an exact replica of the canal ensures better communications, reliability, and clinical operationalization. Root canal endoscopy using this novel CBCT filter may be used for clinical applications together with innovative digital and virtual-reality resources that will be naturally incorporated into the principles of Endodontics.
Collapse
Affiliation(s)
- Mike R Bueno
- Professor of Radiology, CROIF, Diagnostic Imaging Center, Cuiabá, Brazil
| | - Carlos Estrela
- Professor of Endodontics, Department of Stomatology Sciences, Federal University of Goiás, Goiânia, Brazil
| |
Collapse
|
43
|
Le N, Lu J, Tang P, Chung KH, Subhash H, Kilpatrick-Liverman L, Wang RK. Intraoral optical coherence tomography and angiography combined with autofluorescence for dental assessment. BIOMEDICAL OPTICS EXPRESS 2022; 13:3629-3646. [PMID: 35781964 PMCID: PMC9208603 DOI: 10.1364/boe.460575] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Revised: 05/20/2022] [Accepted: 05/21/2022] [Indexed: 05/11/2023]
Abstract
There remains a clinical need for an accurate and non-invasive imaging tool for intraoral evaluation of dental conditions. Optical coherence tomography (OCT) is a potential candidate to meet this need, but the design of current OCT systems limits their utility in the intraoral examinations. The inclusion of light-induced autofluorescence (LIAF) can expedite the image collection process and provides a large field of view for viewing the condition of oral tissues. This study describes a novel LIAF-OCT system equipped with a handheld probe designed for intraoral examination of microstructural (via OCT) and microvascular information (via OCT angiography, OCTA). The handheld probe is optimized for use in clinical studies, maintaining the ability to detect and image changes in the condition of oral tissue (e.g., hard tissue damage, presence of dental restorations, plaque, and tooth stains). The real-time LIAF provides guidance for OCT imaging to achieve a field of view of approximately 6.9 mm × 7.8 mm, and a penetration depth of 1.5 mm to 3 mm depending on the scattering property of the target oral tissue. We demonstrate that the proposed system is successful in capturing reliable depth-resolved images from occlusal and palatal surfaces and offers added design features that can enhance its usability in clinical settings.
Collapse
Affiliation(s)
- Nhan Le
- Department of Bioengineering,
University of Washington, Seattle, WA
98195, USA
- These authors contributed equally to this
work
| | - Jie Lu
- Department of Bioengineering,
University of Washington, Seattle, WA
98195, USA
- These authors contributed equally to this
work
| | - Peijun Tang
- Department of Bioengineering,
University of Washington, Seattle, WA
98195, USA
| | - Kwok-Hung Chung
- Department of Restorative Dentistry,
University of Washington, Seattle, WA
98195, USA
| | | | | | - Ruikang K. Wang
- Department of Bioengineering,
University of Washington, Seattle, WA
98195, USA
| |
Collapse
|
44
|
Kohlfaerber T, Pieper M, Münter M, Holzhausen C, Ahrens M, Idel C, Bruchhage KL, Leichtle A, König P, Hüttmann G, Schulz-Hildebrandt H. Dynamic microscopic optical coherence tomography to visualize the morphological and functional micro-anatomy of the airways. BIOMEDICAL OPTICS EXPRESS 2022; 13:3211-3223. [PMID: 35781952 PMCID: PMC9208592 DOI: 10.1364/boe.456104] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Revised: 04/03/2022] [Accepted: 04/19/2022] [Indexed: 06/15/2023]
Abstract
In the imaging of airway tissue, optical coherence tomography (OCT) provides cross-sectional images of tissue structures, shows cilia movement and mucus secretion, but does not provide sufficient contrast to differentiate individual cells. By using fast sequences of microscopic resolution OCT (mOCT) images, OCT can use small signal fluctuations to overcome lack in contrast and speckle noise. In this way, OCT visualizes airway morphology on a cellular level and allows the tracking of the dynamic behavior of immune cells, as well as mucus transport and secretion. Here, we demonstrate that mOCT, by using temporal tissue fluctuation as contrast (dynamic mOCT), provides the possibility to study physiological and pathological tissue processes in vivo.
Collapse
Affiliation(s)
- Tabea Kohlfaerber
- Medizinisches Laserzentrum Lübeck GmbH, Peter-Monnik-Weg 4, 23562 Lübeck, Germany
| | - Mario Pieper
- University of Lübeck, Institute of Anatomy, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Airway Research Center North Member of the German Center for Lung Research, DZL, 22927 Großhansdorf, Germany
| | - Michael Münter
- University of Lübeck, Institute of Biomedical Optics, Peter-Monnik-Weg 4, 23562 Lübeck, Germany
| | - Cornelia Holzhausen
- University of Lübeck, Institute of Anatomy, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Martin Ahrens
- Airway Research Center North Member of the German Center for Lung Research, DZL, 22927 Großhansdorf, Germany
- University of Lübeck, Institute of Biomedical Optics, Peter-Monnik-Weg 4, 23562 Lübeck, Germany
| | - Christian Idel
- University Hospital Schleswig-Holstein, ENT Clinics, Ratzeburger Allee 160, 23538 Lübeck, Germany
| | - Karl-Ludwig Bruchhage
- University Hospital Schleswig-Holstein, ENT Clinics, Ratzeburger Allee 160, 23538 Lübeck, Germany
| | - Anke Leichtle
- University Hospital Schleswig-Holstein, ENT Clinics, Ratzeburger Allee 160, 23538 Lübeck, Germany
| | - Peter König
- University of Lübeck, Institute of Anatomy, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Airway Research Center North Member of the German Center for Lung Research, DZL, 22927 Großhansdorf, Germany
| | - Gereon Hüttmann
- Medizinisches Laserzentrum Lübeck GmbH, Peter-Monnik-Weg 4, 23562 Lübeck, Germany
- University of Lübeck, Institute of Anatomy, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Airway Research Center North Member of the German Center for Lung Research, DZL, 22927 Großhansdorf, Germany
- Center of Brain, Behavior and Metabolism (CBBM), University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Hinnerk Schulz-Hildebrandt
- Medizinisches Laserzentrum Lübeck GmbH, Peter-Monnik-Weg 4, 23562 Lübeck, Germany
- University of Lübeck, Institute of Anatomy, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Airway Research Center North Member of the German Center for Lung Research, DZL, 22927 Großhansdorf, Germany
| |
Collapse
|
45
|
Luo H, Li S, Zeng Y, Cheema H, Otegbeye E, Ahmed S, Chapman WC, Mutch M, Zhou C, Zhu Q. Human colorectal cancer tissue assessment using optical coherence tomography catheter and deep learning. JOURNAL OF BIOPHOTONICS 2022; 15:e202100349. [PMID: 35150067 PMCID: PMC9581715 DOI: 10.1002/jbio.202100349] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/09/2021] [Revised: 01/16/2022] [Accepted: 02/09/2022] [Indexed: 05/02/2023]
Abstract
Optical coherence tomography (OCT) can differentiate normal colonic mucosa from neoplasia, potentially offering a new mechanism of endoscopic tissue assessment and biopsy targeting, with a high optical resolution and an imaging depth of ~1 mm. Recent advances in convolutional neural networks (CNN) have enabled application in ophthalmology, cardiology, and gastroenterology malignancy detection with high sensitivity and specificity. Here, we describe a miniaturized OCT catheter and a residual neural network (ResNet)-based deep learning model manufactured and trained to perform automatic image processing and real-time diagnosis of the OCT images. The OCT catheter has an outer diameter of 3.8 mm, a lateral resolution of ~7 μm, and an axial resolution of ~6 μm. A customized ResNet is utilized to classify OCT catheter colorectal images. An area under the receiver operating characteristic (ROC) curve (AUC) of 0.975 is achieved to distinguish between normal and cancerous colorectal tissue images.
Collapse
Affiliation(s)
- Hongbo Luo
- Department of Electrical & Systems Engineering, Washington University in St. Louis, St. Louis, Missouri, USA
| | - Shuying Li
- Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, Missouri, USA
| | - Yifeng Zeng
- Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, Missouri, USA
| | - Hassam Cheema
- Department of Anatomic & Molecular Pathology, Washington University School of Medicine, St. Louis, Missouri, USA
| | - Ebunoluwa Otegbeye
- Department of Surgery, Washington University School of Medicine, St. Louis, Missouri, USA
| | - Safee Ahmed
- Department of Anatomic & Clinical Pathology, Washington University School of Medicine, St. Louis, Missouri, USA
| | - William C. Chapman
- Department of Surgery, Washington University School of Medicine, St. Louis, Missouri, USA
| | - Matthew Mutch
- Department of Surgery, Washington University School of Medicine, St. Louis, Missouri, USA
| | - Chao Zhou
- Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, Missouri, USA
| | - Quing Zhu
- Department of Electrical & Systems Engineering, Washington University in St. Louis, St. Louis, Missouri, USA
- Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, Missouri, USA
- Department of Radiology, Washington University School of Medicine, St. Louis, Missouri, USA
| |
Collapse
|
46
|
Optomechanical Analysis and Design of Polygon Mirror-Based Laser Scanners. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12115592] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Abstract
Polygon Mirror (PM)-based scanning heads are one of the fastest and most versatile optomechanical laser scanners. The aim of this work is to develop a multi-parameter opto-mechanical analysis of PMs, from which to extract rules-of-thumbs for the design of such systems. The characteristic functions and parameters of PMs scanning heads are deduced and studied, considering their constructive and functional parameters. Optical aspects related to the kinematics of emergent laser beams (and of corresponding laser spots on a scanned plane or objective lens) are investigated. The PM analysis (which implies a larger number of parameters) is confronted with the corresponding, but less complex aspects of Galvanometer Scanners (GSs). The issue of the non-linearity of the scanning functions of both PMs and GSs (and, consequently, of their variable scanning velocities) is approached, as well as characteristic angles, the angular and linear Field-of-View (FOV), and the duty cycle. A device with two supplemental mirrors is proposed and designed to increase the distance between the GS or PM and the scanned plane or lens to linearize the scanning function (and thus to achieve an approximately constant scanning velocity). These optical aspects are completed with Finite Element Analyses (FEA) of fast rotational PMs, to assess their structural integrity issues. The study is concluded with an optomechanical design scheme of PM-based scanning heads, which unites optical and mechanical aspects—to allow for a more comprehensive approach of possible issues of such scanners. Such a scheme can be applied to other types of optomechanical scanners, with mirrors or refractive elements, as well.
Collapse
|
47
|
Endoscopic OCT Angiography Using Clinical Proximal-End Scanning Catheters. PHOTONICS 2022. [DOI: 10.3390/photonics9050329] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Endoscopic optical coherence tomography angiography (OCTA) is a promising modality to inspect the microvasculature of inner organs in the early-stage tumor diagnosis. However, an endoscopic clinical proximal-end scanning catheter has limited flow imaging capability due to the nonuniform rotational distortion (NURD) and physiological motion. In this study, a combined local and global (CLG) optical flow algorithm was used to estimate the motion vectors caused by NURD and physiological motion. The motion vectors were used to bicubic-interpolation-resample the OCT structure to ensure that the circumferential pixels were equally spaced in the space domain. Then, angiograms were computed based on the statistical relation between inverse SNR (iSNR) and amplitude decorrelation (IDa), termed as IDa-OCTA. Finally, the ability of this technique for endoscopic OCTA imaging was demonstrated by flow phantom experiments and human nailfold capillary imaging.
Collapse
|
48
|
Li C, Jia H, Tian J, He C, Lu F, Li K, Gong Y, Hu S, Yu B, Wang Z. Comprehensive Assessment of Coronary Calcification in Intravascular OCT Using a Spatial-Temporal Encoder-Decoder Network. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:857-868. [PMID: 34735339 DOI: 10.1109/tmi.2021.3125061] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/25/2023]
Abstract
Coronary calcification is a strong indicator of coronary artery disease and a key determinant of the outcome of percutaneous coronary intervention. We propose a fully automated method to segment and quantify coronary calcification in intravascular OCT (IVOCT) images based on convolutional neural networks (CNN). All possible calcified plaques were segmented from IVOCT pullbacks using a spatial-temporal encoder-decoder network by exploiting the 3D continuity information of the plaques, which were then screened and classified by a DenseNet network to reduce false positives. A novel data augmentation method based on the IVOCT image acquisition pattern was also proposed to improve the performance and robustness of the segmentation. Clinically relevant metrics including calcification area, depth, angle, thickness, volume, and stent-deployment calcification score, were automatically computed. 13844 IVOCT images with 2627 calcification slices from 45 clinical OCT pullbacks were collected and used to train and test the model. The proposed method performed significantly better than existing state-of-the-art 2D and 3D CNN methods. The data augmentation method improved the Dice similarity coefficient for calcification segmentation from 0.615±0.332 to 0.756±0.222, reaching human-level inter-observer agreement. Our proposed region-based classifier improved image-level calcification classification precision and F1-score from 0.725±0.071 and 0.791±0.041 to 0.964±0.002 and 0.883±0.008, respectively. Bland-Altman analysis showed close agreement between manual and automatic calcification measurements. Our proposed method is valuable for automated assessment of coronary calcification lesions and in-procedure planning of stent deployment.
Collapse
|
49
|
Li J, Thiele S, Kirk RW, Quirk BC, Hoogendoorn A, Chen YC, Peter K, Nicholls SJ, Verjans JW, Psaltis PJ, Bursill C, Herkommer AM, Giessen H, McLaughlin RA. 3D-Printed Micro Lens-in-Lens for In Vivo Multimodal Microendoscopy. SMALL (WEINHEIM AN DER BERGSTRASSE, GERMANY) 2022; 18:e2107032. [PMID: 35229467 DOI: 10.1002/smll.202107032] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/14/2021] [Revised: 01/19/2022] [Indexed: 06/14/2023]
Abstract
Multimodal microendoscopes enable co-located structural and molecular measurements in vivo, thus providing useful insights into the pathological changes associated with disease. However, different optical imaging modalities often have conflicting optical requirements for optimal lens design. For example, a high numerical aperture (NA) lens is needed to realize high-sensitivity fluorescence measurements. In contrast, optical coherence tomography (OCT) demands a low NA to achieve a large depth of focus. These competing requirements present a significant challenge in the design and fabrication of miniaturized imaging probes that are capable of supporting high-quality multiple modalities simultaneously. An optical design is demonstrated which uses two-photon 3D printing to create a miniaturized lens that is simultaneously optimized for these conflicting imaging modalities. The lens-in-lens design contains distinct but connected optical surfaces that separately address the needs of both fluorescence and OCT imaging within a lens of 330 µm diameter. This design shows an improvement in fluorescence sensitivity of >10x in contrast to more conventional fiber-optic design approaches. This lens-in-lens is then integrated into an intravascular catheter probe with a diameter of 520 µm. The first simultaneous intravascular OCT and fluorescence imaging of a mouse artery in vivo is reported.
Collapse
Affiliation(s)
- Jiawen Li
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, University of Adelaide, Adelaide, SA, 5005, Australia
- School of Electrical and Electronic Engineering, University of Adelaide, Adelaide, SA, 5005, Australia
- Institute for Photonics and Advanced Sensing, The University of Adelaide, Adelaide, SA, 5005, Australia
| | - Simon Thiele
- Institute of Applied Optics (ITO) and Research Center SCoPE, University of Stuttgart, 70569, Stuttgart, Germany
| | - Rodney W Kirk
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, University of Adelaide, Adelaide, SA, 5005, Australia
- Institute for Photonics and Advanced Sensing, The University of Adelaide, Adelaide, SA, 5005, Australia
- School of Biomedicine, University of Adelaide, Adelaide, SA, 5005, Australia
| | - Bryden C Quirk
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, University of Adelaide, Adelaide, SA, 5005, Australia
- Institute for Photonics and Advanced Sensing, The University of Adelaide, Adelaide, SA, 5005, Australia
- School of Biomedicine, University of Adelaide, Adelaide, SA, 5005, Australia
| | - Ayla Hoogendoorn
- Lifelong Health Theme, South Australian Health and Medical Research Institute (SAHMRI), Adelaide, SA, 5000, Australia
| | - Yung Chih Chen
- Baker Heart and Diabetes Institute, Melbourne, VIC, 3004, Australia
- Department of Cardiometabolic Health, Bio21 Institute, Melbourne Medical School, University of Melbourne, Parkville, VIC, 3052, Australia
| | - Karlheinz Peter
- Baker Heart and Diabetes Institute, Melbourne, VIC, 3004, Australia
- Department of Cardiometabolic Health, Bio21 Institute, Melbourne Medical School, University of Melbourne, Parkville, VIC, 3052, Australia
| | - Stephen J Nicholls
- Victorian Heart Institute, Monash University, Melbourne, VIC, 3168, Australia
| | - Johan W Verjans
- Lifelong Health Theme, South Australian Health and Medical Research Institute (SAHMRI), Adelaide, SA, 5000, Australia
- Department of Cardiology, Royal Adelaide Hospital, Adelaide, SA, 5000, Australia
- Adelaide Medical School, University of Adelaide, Adelaide, SA, 5005, Australia
| | - Peter J Psaltis
- Lifelong Health Theme, South Australian Health and Medical Research Institute (SAHMRI), Adelaide, SA, 5000, Australia
- Department of Cardiology, Royal Adelaide Hospital, Adelaide, SA, 5000, Australia
- Adelaide Medical School, University of Adelaide, Adelaide, SA, 5005, Australia
| | - Christina Bursill
- Lifelong Health Theme, South Australian Health and Medical Research Institute (SAHMRI), Adelaide, SA, 5000, Australia
| | - Alois M Herkommer
- Institute of Applied Optics (ITO) and Research Center SCoPE, University of Stuttgart, 70569, Stuttgart, Germany
| | - Harald Giessen
- 4th Physics Institute and Research Center SCoPE, University of Stuttgart, 70569, Stuttgart, Germany
| | - Robert A McLaughlin
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, University of Adelaide, Adelaide, SA, 5005, Australia
- Institute for Photonics and Advanced Sensing, The University of Adelaide, Adelaide, SA, 5005, Australia
- School of Biomedicine, University of Adelaide, Adelaide, SA, 5005, Australia
| |
Collapse
|
50
|
Abstract
Photoacoustic (PA) imaging is able to provide extremely high molecular
contrast while maintaining the superior imaging depth of ultrasound (US)
imaging. Conventional microscopic PA imaging has limited access to deeper tissue
due to strong light scattering and attenuation. Endoscopic PA technology enables
direct delivery of excitation light into the interior of a hollow organ or
cavity of the body for functional and molecular PA imaging of target tissue.
Various endoscopic PA probes have been developed for different applications,
including the intravascular imaging of lipids in atherosclerotic plaque and
endoscopic imaging of colon cancer. In this paper, the authors review
representative probe configurations and corresponding preclinical applications.
In addition, the potential challenges and future directions of endoscopic PA
imaging are discussed.
Collapse
Affiliation(s)
- Yan Li
- Beckman Laser Institute, University of California Irvine,
Irvine, CA 92617, USA
| | - Gengxi Lu
- Roski Eye Institute, Keck School of Medicine, University of
Southern California, Los Angeles, CA 90033, USA
| | - Qifa Zhou
- Roski Eye Institute, Keck School of Medicine, University of
Southern California, Los Angeles, CA 90033, USA
| | - Zhongping Chen
- Beckman Laser Institute, University of California Irvine,
Irvine, CA 92617, USA
- The Edwards Lifesciences Center for Cardiovascular
Technology, University of California Irvine, Irvine, CA 92617, USA
- Department of Biomedical Engineering, University of
California Irvine, Irvine, CA 92697, USA
- Correspondence:
| |
Collapse
|