1
|
van Leeuwen FWB, Buckle T, van Oosterom MN, Rietbergen DDD. The Rise of Molecular Image-Guided Robotic Surgery. J Nucl Med 2024:jnumed.124.267783. [PMID: 38991755 DOI: 10.2967/jnumed.124.267783] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2024] [Accepted: 06/05/2024] [Indexed: 07/13/2024] Open
Abstract
Following early acceptance by urologists, the use of surgical robotic platforms is rapidly spreading to other surgical fields. This empowerment of surgical perception via robotic advances occurs in parallel to developments in intraoperative molecular imaging. Convergence of these efforts creates a logical incentive to advance the decades-old image-guided robotics paradigm. This yields new radioguided surgery strategies set to optimally exploit the symbiosis between the growing clinical translation of robotics and molecular imaging. These strategies intend to advance surgical precision by increasing dexterity and optimizing surgical decision-making. In this state-of-the-art review, topic-related developments in chemistry (tracer development) and engineering (medical device development) are discussed, and future scientific robotic growth markets for molecular imaging are presented.
Collapse
Affiliation(s)
- Fijs W B van Leeuwen
- Interventional Molecular Imaging Laboratory, Leiden University Medical Center, Leiden, The Netherlands; and
| | - Tessa Buckle
- Interventional Molecular Imaging Laboratory, Leiden University Medical Center, Leiden, The Netherlands; and
| | - Matthias N van Oosterom
- Interventional Molecular Imaging Laboratory, Leiden University Medical Center, Leiden, The Netherlands; and
| | - Daphne D D Rietbergen
- Interventional Molecular Imaging Laboratory, Leiden University Medical Center, Leiden, The Netherlands; and
- Section of Nuclear Medicine, Department of Radiology, Leiden University Medical Center, Leiden, The Netherlands
| |
Collapse
|
2
|
Cho H, Moon D, Heo SM, Chu J, Bae H, Choi S, Lee Y, Kim D, Jo Y, Kim K, Hwang K, Lee D, Choi HK, Kim S. Artificial intelligence-based real-time histopathology of gastric cancer using confocal laser endomicroscopy. NPJ Precis Oncol 2024; 8:131. [PMID: 38877301 PMCID: PMC11178780 DOI: 10.1038/s41698-024-00621-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2024] [Accepted: 05/24/2024] [Indexed: 06/16/2024] Open
Abstract
There has been a persistent demand for an innovative modality in real-time histologic imaging, distinct from the conventional frozen section technique. We developed an artificial intelligence-driven real-time evaluation model for gastric cancer tissue using confocal laser endomicroscopic system. The remarkable performance of the model suggests its potential utilization as a standalone modality for instantaneous histologic assessment and as a complementary tool for pathologists' interpretation.
Collapse
Affiliation(s)
- Haeyon Cho
- Department of Pathology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Damin Moon
- Artificial Intelligence Research Center, JLK Inc., Seoul, Republic of Korea
| | - So Mi Heo
- Department of Pathology, Ajou University School of Medicine, Suwon, Republic of Korea
| | - Jinah Chu
- Department of Pathology, Kangbuk Samsung Hospital, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
| | - Hyunsik Bae
- Department of Pathology and Translational Genomics, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
- Pathology center, Seegene Medical Foundation, Seoul, Republic of Korea
| | - Sangjoon Choi
- Department of Pathology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Yubin Lee
- Artificial Intelligence Research Center, JLK Inc., Seoul, Republic of Korea
| | - Dongmin Kim
- Artificial Intelligence Research Center, JLK Inc., Seoul, Republic of Korea
| | - Yeonju Jo
- VPIX Medical Inc., Daejeon, Republic of Korea
| | | | | | - Dakeun Lee
- Department of Pathology, Ajou University School of Medicine, Suwon, Republic of Korea.
- Department of Biomedical Sciences, Ajou University Graduate School of Medicine, Suwon, Republic of Korea.
| | - Heung-Kook Choi
- Artificial Intelligence Research Center, JLK Inc., Seoul, Republic of Korea.
| | - Seokhwi Kim
- Department of Pathology, Ajou University School of Medicine, Suwon, Republic of Korea.
- Department of Biomedical Sciences, Ajou University Graduate School of Medicine, Suwon, Republic of Korea.
| |
Collapse
|
3
|
Cen P, Cui C, Huang J, Chen H, Wu F, Niu J, Zhong Y, Jin C, Zhu WH, Zhang H, Tian M. Cellular senescence imaging and senolysis monitoring in cancer therapy based on a β-galactosidase-activated aggregation-induced emission luminogen. Acta Biomater 2024; 179:340-353. [PMID: 38556136 DOI: 10.1016/j.actbio.2024.03.027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2023] [Revised: 03/23/2024] [Accepted: 03/27/2024] [Indexed: 04/02/2024]
Abstract
Cellular senescence is a permanent state of cell cycle arrest characterized by increased activity of senescence associated β-galactosidase (SA-β-gal). Notably, cancer cells have been also observed to exhibit the senescence response and are being considered for sequential treatment with pro-senescence therapy followed by senolytic therapy. However, there is currently no effective agent targeting β-galactosidase (β-Gal) for imaging cellular senescence and monitoring senolysis in cancer therapy. Aggregation-induced emission luminogen (AIEgen) demonstrates strong fluorescence, good photostability, and biocompatibility, making it a potential candidate for imaging cellular senescence and monitoring senolysis in cancer therapy when endowed with β-Gal-responsive capabilities. In this study, we introduced a β-Gal-activated AIEgen named QM-β-gal for cellular senescence imaging and senolysis monitoring in cancer therapy. QM-β-gal exhibited good amphiphilic properties and formed aggregates that emitted a fluorescence signal upon β-Gal activation. It showed high specificity towards the activity of β-Gal in lysosomes and successfully visualized DOX-induced senescent cancer cells with intense fluorescence both in vitro and in vivo. Encouragingly, QM-β-gal could image senescent cancer cells in vivo for over 14 days with excellent biocompatibility. Moreover, it allowed for the monitoring of senescent cancer cell clearance during senolytic therapy with ABT263. This investigation indicated the potential of the β-Gal-activated AIEgen, QM-β-gal, as an in vivo approach for imaging cellular senescence and monitoring senolysis in cancer therapy via highly specific and long-term fluorescence imaging. STATEMENT OF SIGNIFICANCE: This work reported a β-galactosidase-activated AIEgen called QM-β-gal, which effectively imaged DOX-induced senescent cancer cells both in vitro and in vivo. QM-β-gal specifically targeted the increased expression and activity of β-galactosidase in senescent cancer cells, localized within lysosomes. It was cleared rapidly before activation but maintained stability after activation in the DOX-induced senescent tumor. The AIEgen exhibited a remarkable long-term imaging capability for senescent cancer cells, lasting over 14 days and enabled monitoring of senescent cancer cell clearance through ABT263-induced apoptosis. This approach held promise for researchers seeking to achieve prolonged imaging of senescent cells in vivo.
Collapse
Affiliation(s)
- Peili Cen
- Department of Nuclear Medicine and PET Center, The Second Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou, Zhejiang 310009, China; Institute of Nuclear Medicine and Molecular Imaging of Zhejiang University, Hangzhou, Zhejiang 310009, China; Key Laboratory of Medical Molecular Imaging of Zhejiang Province, Hangzhou, Zhejiang 310009, China
| | - Chunyi Cui
- Department of Nuclear Medicine and PET Center, The Second Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou, Zhejiang 310009, China; Institute of Nuclear Medicine and Molecular Imaging of Zhejiang University, Hangzhou, Zhejiang 310009, China; Key Laboratory of Medical Molecular Imaging of Zhejiang Province, Hangzhou, Zhejiang 310009, China
| | - Jiani Huang
- Department of Nuclear Medicine and PET Center, The Second Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou, Zhejiang 310009, China; Institute of Nuclear Medicine and Molecular Imaging of Zhejiang University, Hangzhou, Zhejiang 310009, China; Key Laboratory of Medical Molecular Imaging of Zhejiang Province, Hangzhou, Zhejiang 310009, China
| | - Hetian Chen
- Department of Nuclear Medicine and PET Center, The Second Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou, Zhejiang 310009, China; Institute of Nuclear Medicine and Molecular Imaging of Zhejiang University, Hangzhou, Zhejiang 310009, China; Key Laboratory of Medical Molecular Imaging of Zhejiang Province, Hangzhou, Zhejiang 310009, China
| | - Fei Wu
- Department of Nuclear Medicine and PET Center, The Second Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou, Zhejiang 310009, China; Institute of Nuclear Medicine and Molecular Imaging of Zhejiang University, Hangzhou, Zhejiang 310009, China; Key Laboratory of Medical Molecular Imaging of Zhejiang Province, Hangzhou, Zhejiang 310009, China
| | - Jiaqi Niu
- Department of Nuclear Medicine and PET Center, The Second Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou, Zhejiang 310009, China; Institute of Nuclear Medicine and Molecular Imaging of Zhejiang University, Hangzhou, Zhejiang 310009, China; Key Laboratory of Medical Molecular Imaging of Zhejiang Province, Hangzhou, Zhejiang 310009, China
| | - Yan Zhong
- Department of Nuclear Medicine and PET Center, The Second Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou, Zhejiang 310009, China; Institute of Nuclear Medicine and Molecular Imaging of Zhejiang University, Hangzhou, Zhejiang 310009, China; Key Laboratory of Medical Molecular Imaging of Zhejiang Province, Hangzhou, Zhejiang 310009, China
| | - Chentao Jin
- Department of Nuclear Medicine and PET Center, The Second Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou, Zhejiang 310009, China; Institute of Nuclear Medicine and Molecular Imaging of Zhejiang University, Hangzhou, Zhejiang 310009, China; Key Laboratory of Medical Molecular Imaging of Zhejiang Province, Hangzhou, Zhejiang 310009, China
| | - Wei-Hong Zhu
- Key Laboratory for Advanced Materials and Institute of Fine Chemicals, Shanghai Key Laboratory of Functional Materials Chemistry, East China University of Science and Technology, Shanghai 200237, China
| | - Hong Zhang
- Department of Nuclear Medicine and PET Center, The Second Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou, Zhejiang 310009, China; Institute of Nuclear Medicine and Molecular Imaging of Zhejiang University, Hangzhou, Zhejiang 310009, China; Key Laboratory of Medical Molecular Imaging of Zhejiang Province, Hangzhou, Zhejiang 310009, China; College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, Zhejiang 310014, China; Key Laboratory for Biomedical Engineering of Ministry of Education, Zhejiang University, Hangzhou, Zhejiang 310014, China.
| | - Mei Tian
- Department of Nuclear Medicine and PET Center, The Second Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou, Zhejiang 310009, China; Institute of Nuclear Medicine and Molecular Imaging of Zhejiang University, Hangzhou, Zhejiang 310009, China; Key Laboratory of Medical Molecular Imaging of Zhejiang Province, Hangzhou, Zhejiang 310009, China; Human Phenome Institute, Fudan University, Shanghai 201203, China.
| |
Collapse
|
4
|
Bae H, Cho H, Jo Y, Heo SM, Chu J, Choi S, Hwang K, Kim K, Kim S. Real-time Histological Evaluation of Gastric Cancer Tissue by Using a Confocal Laser Endomicroscopic System. In Vivo 2024; 38:855-863. [PMID: 38418139 PMCID: PMC10905484 DOI: 10.21873/invivo.13511] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2023] [Revised: 10/31/2023] [Accepted: 11/15/2023] [Indexed: 03/01/2024]
Abstract
BACKGROUND/AIM The need for instant histological evaluation of fresh tissue, especially in cancer treatment, remains paramount. The conventional frozen section technique has inherent limitations, prompting the exploration of alternative methods. A recently developed confocal laser endomicroscopic system provides real-time imaging of the tissue without the need for glass slide preparation. Herein, we evaluated its applicability in the histologic evaluation of gastric cancer tissues. MATERIALS AND METHODS A confocal laser endomicroscopic system (CLES) with a Lissajous pattern laser scanning, was developed. Fourteen fresh gastric cancer tissues and the same number of normal gastric tissues were obtained from advanced gastric cancer patients. Fluorescein sodium was used for staining. Five pathologists interpreted 100 endomicroscopic images and decided their histologic location and the presence of cancer. Following the review of matched hematoxylin and eosin (H&E) slides, their performance was evaluated with another 100 images. RESULTS CLES images mirrored gastric tissue histology. Pathologists were able to detect the histologic location of the images with 65.7% accuracy and differentiate cancer tissue from normal with 74.7% accuracy. The sensitivity and specificity of cancer detection were 71.9% and 76.1%. Following the review of matched H&E images, the accuracy of identifying the histologic location was increased to 92.8% (p<0.0001), and that of detecting cancer tissue was also increased to 90.9% (p<0.001). The sensitivity and specificity of cancer detection were enhanced to 89.1% and 93.2% (p<0.0001). CONCLUSION High-quality histological images were immediately acquired by the CLES. The operator training enabled the accurate detection of cancer and histologic location raising its potential applicability as a real-time tissue imaging modality.
Collapse
Affiliation(s)
- Hyunsik Bae
- Department of Pathology and Translational Genomics, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
| | - Haeyon Cho
- Department of Pathology, Asan Medical Center, Ulsan University Medical School, Seoul, Republic of Korea
| | - Yeonju Jo
- VPIX Medical Inc., Daejeon, Republic of Korea
| | - So Mi Heo
- Department of Pathology, Ajou University School of Medicine, Suwon, Republic of Korea
| | - Jinah Chu
- Department of Pathology, Kangbuk Samsung Hospital, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
| | - Sangjoon Choi
- Department of Pathology, Asan Medical Center, Ulsan University Medical School, Seoul, Republic of Korea
| | | | | | - Seokhwi Kim
- Department of Pathology, Ajou University School of Medicine, Suwon, Republic of Korea;
- Department of Biomedical Sciences, Ajou University Graduate School of Medicine, Suwon, Republic of Korea
| |
Collapse
|
5
|
Hong DH, Kim JH, Won JK, Kim H, Kim C, Park KJ, Hwang K, Jeong KH, Kang SH. Clinical feasibility of miniaturized Lissajous scanning confocal laser endomicroscopy for indocyanine green-enhanced brain tumor diagnosis. Front Oncol 2023; 12:994054. [PMID: 36713547 PMCID: PMC9880156 DOI: 10.3389/fonc.2022.994054] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Accepted: 12/15/2022] [Indexed: 01/15/2023] Open
Abstract
Background Intraoperative real-time confocal laser endomicroscopy (CLE) is an alternative modality for frozen tissue histology that enables visualization of the cytoarchitecture of living tissues with spatial resolution at the cellular level. We developed a new CLE with a "Lissajous scanning pattern" and conducted a study to identify its feasibility for fluorescence-guided brain tumor diagnosis. Materials and methods Conventional hematoxylin and eosin (H&E) histological images were compared with indocyanine green (ICG)-enhanced CLE images in two settings (1): experimental study with in vitro tumor cells and ex vivo glial tumors of mice, and (2) clinical evaluation with surgically resected human brain tumors. First, CLE images were obtained from cultured U87 and GL261 glioma cells. Then, U87 and GL261 tumor cells were implanted into the mouse brain, and H&E staining was compared with CLE images of normal and tumor tissues ex vivo. To determine the invasion of the normal brain, two types of patient-derived glioma cells (CSC2 and X01) were used for orthotopic intracranial tumor formation and compared using two methods (CLE vs. H&E staining). Second, in human brain tumors, tissue specimens from 69 patients were prospectively obtained after elective surgical resection and were also compared using two methods, namely, CLE and H&E staining. The comparison was performed by an experienced neuropathologist. Results When ICG was incubated in vitro, U87 and GL261 cell morphologies were well-defined in the CLE images and depended on dimethyl sulfoxide. Ex vivo examination of xenograft glioma tissues revealed dense and heterogeneous glioma cell cores and peritumoral necrosis using both methods. CLE images also detected invasive tumor cell clusters in the normal brain of the patient-derived glioma xenograft model, which corresponded to H&E staining. In human tissue specimens, CLE images effectively visualized the cytoarchitecture of the normal brain and tumors. In addition, pathognomonic microstructures according to tumor subtype were also clearly observed. Interestingly, in gliomas, the cellularity of the tumor and the density of streak-like patterns were significantly associated with tumor grade in the CLE images. Finally, panoramic view reconstruction was successfully conducted for visualizing a gross tissue morphology. Conclusion In conclusion, the newly developed CLE with Lissajous laser scanning can be a helpful intraoperative device for the diagnosis, detection of tumor-free margins, and maximal safe resection of brain tumors.
Collapse
Affiliation(s)
- Duk Hyun Hong
- Department of Neurosurgery, Korea University Hospital, Korea University College of Medicine, Seoul, Republic of Korea
| | - Jang Hun Kim
- Department of Neurosurgery, Korea University Hospital, Korea University College of Medicine, Seoul, Republic of Korea
| | - Jae-Kyung Won
- Department of Pathology, Seoul National University Hospital, Seoul National University College of Medicine, Seoul, Republic of Korea
| | - Hyungsin Kim
- Department of Neurosurgery, Korea University Hospital, Korea University College of Medicine, Seoul, Republic of Korea
| | - Chayeon Kim
- VPIX Medical Inc., Daejeon, Republic of Korea
| | - Kyung-Jae Park
- Department of Neurosurgery, Korea University Hospital, Korea University College of Medicine, Seoul, Republic of Korea
| | | | - Ki-Hun Jeong
- Department of Bio and Brain Engineering, KAIST Institute for Health Science and Technology (KIHST), Korea Advanced Institute of Science and Technology (KAIST), Seoul, Republic of Korea
| | - Shin-Hyuk Kang
- Department of Neurosurgery, Korea University Hospital, Korea University College of Medicine, Seoul, Republic of Korea
| |
Collapse
|
6
|
Confocal laser endomicroscope with distal MEMS scanner for real-time histopathology. Sci Rep 2022; 12:20155. [PMID: 36418439 PMCID: PMC9684518 DOI: 10.1038/s41598-022-24210-9] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Accepted: 11/11/2022] [Indexed: 11/25/2022] Open
Abstract
Confocal laser endomicroscopy is an emerging methodology to perform real time optical biopsy. Fluorescence images with histology-like quality can be collected instantaneously from the epithelium of hollow organs. Currently, scanning is performed at the proximal end of probe-based instruments used routinely in the clinic, and flexibility to control the focus is limited. We demonstrate use of a parametric resonance scanner packaged in the distal end of the endomicroscope to perform high speed lateral deflections. An aperture was etched in the center of the reflector to fold the optical path. This design reduced the dimensions of the instrument to 2.4 mm diameter and 10 mm length, allowing for forward passage through the working channel of a standard medical endoscope. A compact lens assembly provides lateral and axial resolution of 1.1 and 13.6 μm, respectively. A working distance of 0 μm and field-of-view of 250 μm × 250 μm was achieved at frame rates up to 20 Hz. Excitation at 488 nm was delivered to excite fluorescein, an FDA-approved dye, to generate high tissue contrast. The endomicroscope was reprocessed using a clinically-approved sterilization method for 18 cycles without failure. Fluorescence images were collected during routine colonoscopy from normal colonic mucosa, tubular adenomas, hyperplastic polyps, ulcerative colitis, and Crohn's colitis. Individual cells, including colonocytes, goblet cells, and inflammatory cells, could be identified. Mucosal features, such as crypt structures, crypt lumens, and lamina propria, could be distinguished. This instrument has potential to be used as an accessory during routine medical endoscopy.
Collapse
|
7
|
Yang D, Ortinau L, Jeong Y, Park D. Advances and challenges in intravital imaging of craniofacial and dental progenitor cells. Genesis 2022; 60:e23498. [PMID: 35980285 PMCID: PMC10015615 DOI: 10.1002/dvg.23498] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Revised: 07/28/2022] [Accepted: 07/29/2022] [Indexed: 11/11/2022]
Abstract
Craniofacial and appendicular bone homeostasis is dynamically regulated by a balance between bone formation and resorption by osteoblasts and osteoclasts, respectively. Despite the developments in multiple imaging techniques in bone biology, there are still technical challenges and limitations in the investigation of spatial/anatomical location of rare stem/progenitor cells and their molecular regulation in tooth and craniofacial bones of living animals. Recent advances in live animal imaging techniques for the craniofacial and dental apparatus can provide new insights in real time into bone stem/progenitor cell dynamics and function in vivo. Here, we review the current inventions and applications of the noninvasive intravital imaging technique and its practical uses and limitations in the analysis of stem/progenitor cells in craniofacial and dental apparatus in vivo. Furthermore, we also explore the potential applications of intravital microscopy in the dental field.
Collapse
Affiliation(s)
- Dongwook Yang
- Department of Molecular & Human Genetics, Baylor College of Medicine, Houston, Texas, USA.,Center for Skeletal Biology, Baylor College of Medicine, Houston, Texas, USA
| | - Laura Ortinau
- Department of Molecular & Human Genetics, Baylor College of Medicine, Houston, Texas, USA.,Center for Skeletal Biology, Baylor College of Medicine, Houston, Texas, USA
| | - Youngjae Jeong
- Department of Molecular & Human Genetics, Baylor College of Medicine, Houston, Texas, USA.,Center for Skeletal Biology, Baylor College of Medicine, Houston, Texas, USA
| | - Dongsu Park
- Department of Molecular & Human Genetics, Baylor College of Medicine, Houston, Texas, USA.,Center for Skeletal Biology, Baylor College of Medicine, Houston, Texas, USA.,Department of Pathology & Immunology, Baylor College of Medicine, Houston, Texas, USA
| |
Collapse
|
8
|
Jeon J, Kim H, Jang H, Hwang K, Kim K, Park YG, Jeong KH. Handheld laser scanning microscope catheter for real-time and in vivo confocal microscopy using a high definition high frame rate Lissajous MEMS mirror. BIOMEDICAL OPTICS EXPRESS 2022; 13:1497-1505. [PMID: 35414975 PMCID: PMC8973198 DOI: 10.1364/boe.447558] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/03/2021] [Revised: 02/09/2022] [Accepted: 02/09/2022] [Indexed: 06/14/2023]
Abstract
A handheld confocal microscope using a rapid MEMS scanning mirror facilitates real-time optical biopsy for simple cancer diagnosis. Here we report a handheld confocal microscope catheter using high definition and high frame rate (HDHF) Lissajous scanning MEMS mirror. The broad resonant frequency region of the fast axis on the MEMS mirror with a low Q-factor facilitates the flexible selection of scanning frequencies. HDHF Lissajous scanning was achieved by selecting the scanning frequencies with high greatest common divisor (GCD) and high total lobe number. The MEMS mirror was fully packaged into a handheld configuration, which was coupled to a home-built confocal imaging system. The confocal microscope catheter allows fluorescence imaging of in vivo and ex vivo mouse tissues with 30 Hz frame rate and 95.4% fill factor at 256 × 256 pixels image, where the lateral resolution is 4.35 μm and the field-of-view (FOV) is 330 μm × 330 μm. This compact confocal microscope can provide diverse handheld microscopic applications for real-time, on-demand, and in vivo optical biopsy.
Collapse
Affiliation(s)
- Jaehun Jeon
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
- KAIST Institute for Health Science and Technology (KIHST), KAIST, 291 Daehak-ro, Yuseong-gu, Daejeon, 305-701, Republic of Korea
| | - Hyunwoo Kim
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
- KAIST Institute for Health Science and Technology (KIHST), KAIST, 291 Daehak-ro, Yuseong-gu, Daejeon, 305-701, Republic of Korea
| | - Hyunwoo Jang
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
| | | | - Kyuyoung Kim
- VPIX Medical, Inc, Deajeon, 34873, Republic of Korea
| | - Young-Gyun Park
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
| | - Ki-Hun Jeong
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
- KAIST Institute for Health Science and Technology (KIHST), KAIST, 291 Daehak-ro, Yuseong-gu, Daejeon, 305-701, Republic of Korea
| |
Collapse
|
9
|
Zhang H, Wang X, Du H, Yu H, Wu J, Meng Y, Qiu Y, Mao B, Zhou P, Li Y. Machine learning enabled self-calibration single fiber endoscopic imaging. OPTICS LETTERS 2021; 46:3673-3676. [PMID: 34329253 DOI: 10.1364/ol.432336] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/26/2021] [Accepted: 06/28/2021] [Indexed: 06/13/2023]
Abstract
Single fiber scanners (SFSs), with the advantages of compact size, versatility, large field of view, and high resolution, have been applied in many areas. However, image distortions persistently impair the imaging quality of the SFS, although many efforts have been made to address the problem. In this Letter, we propose a simple and complete solution by combining the piezoelectric (PZT) self-induction sensor and machine learning algorithms. The PZT tube was utilized as both the actuator and the fiber position sensor. Additionally, the feedback sensor signal was interrogated by a convolution neural network to eliminate the noise. The experimental results show that the predicted fiber trajectory error was below 0.1%. Moreover, this self-calibration SFS has an excellent robustness to temperature changes (20-50°C). It is believed that the proposed solution has removed the biggest barrier for the SFS and greatly improved its performance and stability in complex environments.
Collapse
|