1
|
Xu X, Zhao S, Gong L, Zuo S. A novel contact optimization algorithm for endomicroscopic surface scanning. Int J Comput Assist Radiol Surg 2024; 19:2031-2041. [PMID: 38970745 DOI: 10.1007/s11548-024-03223-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Accepted: 06/24/2024] [Indexed: 07/08/2024]
Abstract
PURPOSE Probe-based confocal laser endomicroscopy (pCLE) offers real-time, cell-level imaging and holds promise for early cancer diagnosis. However, a large area surface scanning for image acquisition is needed to overcome the limitation of field-of-view. Obtaining high-quality images during scanning requires maintaining a stable contact distance between the tissue and probe. This work presents a novel contact optimization algorithm to acquire high-quality pCLE images. METHODS The contact optimization algorithm, based on swarm intelligence of whale optimization algorithm, is designed to optimize the probe position, according to the quality of the image acquired by probe. An accurate image quality assessment of total co-occurrence entropy is introduced to evaluate the pCLE image quality. The algorithm aims to maintain a consistent probe-tissue contact, resulting in high-quality images acquisition. RESULTS Scanning experiments on sponge, ex vivo swine skin tissue and stomach tissue demonstrate the effectiveness of the contact optimization algorithm. Scanning results of the sponge with three different trajectories (spiral trajectory, circle trajectory, and raster trajectory) reveal high-quality mosaics with clear details in every part of the image and no blurred sections. CONCLUSION The contact optimization algorithm successfully identifies the optimal distance between probe and tissue, improving the quality of pCLE images. Experimental results confirm the high potential of this method in endomicroscopic surface scanning.
Collapse
Affiliation(s)
- Xingfeng Xu
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin, 300072, China
| | - Shengzhe Zhao
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin, 300072, China
| | - Lun Gong
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin, 300072, China
| | - Siyang Zuo
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin, 300072, China.
| |
Collapse
|
2
|
Zhang C, Huang W, Xu X, Zuo S. Flexible endoscopic instrument for diagnosis and treatment of early gastric cancer. Med Biol Eng Comput 2023; 61:2815-2828. [PMID: 37608080 DOI: 10.1007/s11517-023-02911-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2022] [Accepted: 08/14/2023] [Indexed: 08/24/2023]
Abstract
Gastric cancer is a common cancer endangering human life and health worldwide. Early detection and diagnosis of gastric cancer that is normally performed by flexible endoscope can significantly improve the survival rate of patients. However, current endoscopic instruments have some problems, such as limitation of degrees of freedom (DOFs) and lack of surgical triangulation. Meanwhile, the lack of an intraoperative technique for the real-time evaluation of early gastric cancer is also a serious problem. To solve these problems, we have developed a dual-bending flexible endoscopic instrument for the diagnosis and treatment of early gastric cancer. This instrument has a compact structure with a maximum outer diameter of 3 mm and an insertion length of 1220 mm. It has 5 DOFs with a dual-bending function, which can form a surgical operation triangulation to easily perform the endoscopic procedure. Apart from the surgical forceps, the end of the instrument can be equipped with different endoscopic devices to meet the needs of diagnosis and treatment, such as endomicroscopic probes, electrosurgical knives, and laser ablation optical fibers. It is verified that the instrument can carry these devices to complete corresponding tasks, demonstrating the great potential of this instrument in clinical applications.
Collapse
Affiliation(s)
- Chi Zhang
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin, 300072, China
| | - Weihao Huang
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin, 300072, China
| | - Xingfeng Xu
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin, 300072, China
| | - Siyang Zuo
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin, 300072, China.
| |
Collapse
|
3
|
Zhou C, Lin Z, Huang S, Li B, Gao A. Progress in Probe-Based Sensing Techniques for In Vivo Diagnosis. BIOSENSORS 2022; 12:943. [PMID: 36354452 PMCID: PMC9688418 DOI: 10.3390/bios12110943] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/14/2022] [Revised: 10/13/2022] [Accepted: 10/24/2022] [Indexed: 06/16/2023]
Abstract
Advancements in robotic surgery help to improve the endoluminal diagnosis and treatment with minimally invasive or non-invasive intervention in a precise and safe manner. Miniaturized probe-based sensors can be used to obtain information about endoluminal anatomy, and they can be integrated with medical robots to augment the convenience of robotic operations. The tremendous benefit of having this physiological information during the intervention has led to the development of a variety of in vivo sensing technologies over the past decades. In this paper, we review the probe-based sensing techniques for the in vivo physical and biochemical sensing in China in recent years, especially on in vivo force sensing, temperature sensing, optical coherence tomography/photoacoustic/ultrasound imaging, chemical sensing, and biomarker sensing.
Collapse
Affiliation(s)
- Cheng Zhou
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
- Department of Automation, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Zecai Lin
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
- Department of Automation, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Shaoping Huang
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
- Department of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Bing Li
- Institute for Materials Discovery, University College London, London WC1E 7JE, UK
| | - Anzhu Gao
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
- Department of Automation, Shanghai Jiao Tong University, Shanghai 200240, China
| |
Collapse
|
4
|
Ping Z, Zhang T, Gong L, Zhang C, Zuo S. Miniature Flexible Instrument with Fibre Bragg Grating-Based Triaxial Force Sensing for Intraoperative Gastric Endomicroscopy. Ann Biomed Eng 2021; 49:2323-2336. [PMID: 33880633 DOI: 10.1007/s10439-021-02781-4] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2020] [Accepted: 04/11/2021] [Indexed: 11/28/2022]
Abstract
Optical biopsy methods, such as probe-based endomicroscopy, can be used to identify early-stage gastric cancer in vivo. However, it is difficult to scan a large area of the gastric mucosa for mosaicking during endoscopy. In this work, we propose a miniaturised flexible instrument based on contact-aided compliant mechanisms and fibre Bragg grating (FBG) sensing for intraoperative gastric endomicroscopy. The instrument has a compact design with an outer diameter of 2.7 mm, incorporating a central channel with a diameter of 1.9 mm for the endomicroscopic probe to pass through. Experimental results show that the instrument can achieve raster trajectory scanning over a large tissue surface with a positioning accuracy of 0.5 mm. The tip force sensor provides a 4.6 mN resolution for the axial force and 2.8 mN for transverse forces. Validation with random samples shows that the force sensor can provide consistent and accurate three-axis force detection. Endomicroscopic imaging experiments were conducted, and the flexible instrument performed no gap scanning (mosaicking area more than 3 mm2) and contact force monitoring during scanning, demonstrating the potential of the system in clinical applications.
Collapse
Affiliation(s)
- Zhongyuan Ping
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin, 300072, China
| | - Tianci Zhang
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin, 300072, China
| | - Lun Gong
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin, 300072, China
| | - Chi Zhang
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin, 300072, China
| | - Siyang Zuo
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin, 300072, China.
| |
Collapse
|
5
|
Li Z, Shahbazi M, Patel N, O' Sullivan E, Zhang H, Vyas K, Chalasani P, Deguet A, Gehlbach PL, Iordachita I, Yang GZ, Taylor RH. Hybrid Robot-assisted Frameworks for Endomicroscopy Scanning in Retinal Surgeries. IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS 2020; 2:176-187. [PMID: 32699833 PMCID: PMC7375438 DOI: 10.1109/tmrb.2020.2988312] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/30/2023]
Abstract
High-resolution real-time intraocular imaging of retina at the cellular level is very challenging due to the vulnerable and confined space within the eyeball as well as the limited availability of appropriate modalities. A probe-based confocal laser endomicroscopy (pCLE) system, can be a potential imaging modality for improved diagnosis. The ability to visualize the retina at the cellular level could provide information that may predict surgical outcomes. The adoption of intraocular pCLE scanning is currently limited due to the narrow field of view and the micron-scale range of focus. In the absence of motion compensation, physiological tremors of the surgeons' hand and patient movements also contribute to the deterioration of the image quality. Therefore, an image-based hybrid control strategy is proposed to mitigate the above challenges. The proposed hybrid control strategy enables a shared control of the pCLE probe between surgeons and robots to scan the retina precisely, with the absence of hand tremors and with the advantages of an image-based auto-focus algorithm that optimizes the quality of pCLE images. The hybrid control strategy is deployed on two frameworks - cooperative and teleoperated. Better image quality, smoother motion, and reduced workload are all achieved in a statistically significant manner with the hybrid control frameworks.
Collapse
Affiliation(s)
- Zhaoshuo Li
- Authors with the Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, Maryland 21218, USA
| | - Mahya Shahbazi
- Authors with the Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, Maryland 21218, USA
| | - Niravkumar Patel
- Authors with the Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, Maryland 21218, USA
| | - Eimear O' Sullivan
- Authors with the Hamlyn Centre for Robotic Surgery, Imperial College London, SW7 2AZ, London, UK
| | - Haojie Zhang
- Authors with the Hamlyn Centre for Robotic Surgery, Imperial College London, SW7 2AZ, London, UK
| | - Khushi Vyas
- Authors with the Hamlyn Centre for Robotic Surgery, Imperial College London, SW7 2AZ, London, UK
| | - Preetham Chalasani
- Authors with the Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, Maryland 21218, USA
| | - Anton Deguet
- Authors with the Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, Maryland 21218, USA
| | - Peter L Gehlbach
- Author with the Johns Hopkins Wilmer Eye Institute, Johns Hopkins Hospital, 600 N. Wolfe Street, Maryland 21287, USA
| | - Iulian Iordachita
- Authors with the Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, Maryland 21218, USA
| | - Guang-Zhong Yang
- Authors with the Hamlyn Centre for Robotic Surgery, Imperial College London, SW7 2AZ, London, UK
| | - Russell H Taylor
- Authors with the Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, Maryland 21218, USA
| |
Collapse
|
6
|
Ping Z, Wang H, Chen X, Wang S, Zuo S. Modular Robotic Scanning Device for Real-Time Gastric Endomicroscopy. Ann Biomed Eng 2018; 47:563-575. [PMID: 30362081 DOI: 10.1007/s10439-018-02156-2] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2018] [Accepted: 10/13/2018] [Indexed: 01/15/2023]
Abstract
Optical biopsy methods, such as probe-based endomicroscopy, can be used for the identification of early mucosal dysplasia in various gastrointestinal conditions and have potential applications in the screening of early-stage gastric cancer in vivo. However, it is difficult to scan a large area of the gastric mucosa for mosaicing during standard endoscopy. This paper proposes a novel 'snap-on' robotic scanning device that can integrate distally with a commercial endoscope. A customized low-cost endomicroscopy system is used for obtaining micro imaging. The developed device could scan a large area of gastric tissue during standard endoscopy. The device achieves positioning accuracy that is less than 0.23 mm. Experimental results showed that the device could achieve large area mosaicing (15.8-18.6 mm2) and demonstrated the potential clinical value of the device for real-time gastric tissue identification and margin assessment. This approach presents an important alternative to current histology techniques for gastrointestinal tract diagnosis.
Collapse
Affiliation(s)
- Zhongyuan Ping
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin, 300072, China
| | - Haibo Wang
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin, 300072, China
| | - Xin Chen
- Department of Gastroenterology and Hepatology, Tianjin Medical University General Hospital, Tianjin, 300070, China
| | - Shuxin Wang
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin, 300072, China
| | - Siyang Zuo
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin, 300072, China.
| |
Collapse
|