1
|
Shirazi A, Sahraeibelverdi T, Lee M, Li H, Yu J, Jaiswal S, Oldham KR, Wang TD. Miniature side-view dual axes confocal endomicroscope for repetitive in vivo imaging. BIOMEDICAL OPTICS EXPRESS 2023; 14:4277-4295. [PMID: 37799693 PMCID: PMC10549747 DOI: 10.1364/boe.494210] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Revised: 06/17/2023] [Accepted: 06/28/2023] [Indexed: 10/07/2023]
Abstract
A side-view dual axes confocal endomicroscope is demonstrated that can be inserted repetitively in hollow organs of genetically engineered mice for in vivo real-time imaging in horizontal and vertical planes. Near infrared (NIR) excitation at λex = 785 nm was used. A monolithic 3-axis parametric resonance scan mirror was fabricated using micro-electro-mechanical systems (MEMS) technology to perform post-objective scanning in the distal end of a 4.19 mm diameter instrument. Torsional and serpentine springs were designed to "switch" the mode of imaging between vertical and horizontal planes by tuning the actuation frequency. This system demonstrated real-time in-vivo images in horizontal and vertical planes with 310 µm depth and 1.75 and 7.5 µm lateral and axial resolution. Individual cells and discrete mucosal structures could be identified.
Collapse
Affiliation(s)
- Ahmad Shirazi
- Division of Integrative Systems and Design,
University of Michigan, Ann Arbor, MI
48109, USA
| | | | - Miki Lee
- Department of Internal Medicine, Division
of Gastroenterology, University of
Michigan, Ann Arbor, MI 48109, USA
| | - Haijun Li
- Department of Internal Medicine, Division
of Gastroenterology, University of
Michigan, Ann Arbor, MI 48109, USA
| | - Joonyoung Yu
- Department of Mechanical Engineering,
University of Michigan, Ann Arbor, MI
48109, USA
| | - Sangeeta Jaiswal
- Department of Internal Medicine, Division
of Gastroenterology, University of
Michigan, Ann Arbor, MI 48109, USA
| | - Kenn R Oldham
- Department of Mechanical Engineering,
University of Michigan, Ann Arbor, MI
48109, USA
| | - Thomas D Wang
- Department of Mechanical Engineering,
University of Michigan, Ann Arbor, MI
48109, USA
- Department of Internal Medicine, Division
of Gastroenterology, University of
Michigan, Ann Arbor, MI 48109, USA
- Department of Biomedical Engineering,
University of Michigan, Ann Arbor, MI
48109, USA
| |
Collapse
|
2
|
Lee M, Li H, Birla MB, Li G, Wang TD, Oldham KR. Capacitive Sensing for 2-D Electrostatic MEMS Scanner in a Clinical Endomicroscope. IEEE SENSORS JOURNAL 2022; 22:24493-24503. [PMID: 37497077 PMCID: PMC10367433 DOI: 10.1109/jsen.2022.3216502] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/28/2023]
Abstract
A flexible fiber-coupled confocal laser endomicroscope has been developed using an electrostatic micro-electromechanical system (MEMS) scanner located in at distal optics to collect in vivo images in human subjects. Long transmission lines are required that deliver drive and sense signals with limited bandwidth. Phase shifts have been observed between orthogonal X and Y scanner axes from environmental perturbations, which impede image reconstruction. Image processing algorithms used for correction depend on image content and quality, while scanner calibration in the clinic can be limited by potential patient exposure to lasers. We demonstrate a capacitive sensing method to track the motion of the electrostatically driven two-dimensional MEMS scanner and to extract phase information needed for image reconstruction. This circuit uses an amplitude modulation envelope detection method on shared drive and sensing electrodes of the scanner. Circuit parameters were optimized for performance given high scan frequencies, transmission line effects, and substantial parasitic coupling of drive signal to circuit output. Extraction of phase information further leverages nonlinear dynamics of the MEMS scanner. The sensing circuit was verified by comparing with data from a position sensing detector measurement. The phase estimation showed an accuracy of 2.18° and 0.79° in X and Y axes for motion sensing, respectively. The results indicate that the sensing circuit can be implemented with feedback control for pre-calibration of the scanner in clinical MEMS-based imaging systems.
Collapse
Affiliation(s)
- Miki Lee
- Department of Internal Medicine, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Haijun Li
- Department of Internal Medicine, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Mayur B Birla
- Department of Mechanical Engineering, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Gaoming Li
- Department of Internal Medicine, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Thomas D Wang
- Departments of Internal Medicine, Biomedical Engineering, and Mechanical Engineering, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Kenn R Oldham
- Department of Mechanical Engineering, University of Michigan, Ann Arbor, MI, 48109, USA
| |
Collapse
|
3
|
Yang M, Wei K, Zhang C, Liu D, Yang Y, Han F, Zhao S. Optimization design of two-stage amplification micro-drive system without additional motion based on particle swarm optimization algorithm. Vis Comput Ind Biomed Art 2022; 5:28. [PMID: 36434401 PMCID: PMC9700539 DOI: 10.1186/s42492-022-00124-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2022] [Accepted: 11/01/2022] [Indexed: 11/26/2022] Open
Abstract
With the increasing requirements of precision mechanical systems in electronic packaging, ultra-precision machining, biomedicine and other high-tech fields, it is necessary to study a precision two-stage amplification micro-drive system that can safely provide high precision and a large amplification ratio. In view of the disadvantages of the current two-stage amplification and micro-drive system, such as poor security, low motion accuracy and limited amplification ratio, an optimization design of a precise symmetrical two-stage amplification micro-drive system was completed in this study, and its related performance was studied. Based on the guiding principle of the flexure hinge, a two-stage amplification micro-drive mechanism with no parasitic motion or non-motion direction force was designed. In addition, the structure optimization design of the mechanism was completed using the particle swarm optimization algorithm, which increased the amplification ratio of the mechanism from 5 to 18 times. A precise symmetrical two-stage amplification system was designed using a piezoelectric ceramic actuator and two-stage amplification micro-drive mechanism as the micro-driver and actuator, respectively. The driving, strength, and motion performances of the system were subsequently studied. The results showed that the driving linearity of the system was high, the strength satisfied the design requirements, the motion amplification ratio was high and the motion accuracy was high (relative error was 5.31%). The research in this study can promote the optimization of micro-drive systems.
Collapse
Affiliation(s)
- Manzhi Yang
- grid.440720.50000 0004 1759 0801School of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an, 710054 China
| | - Kaiyang Wei
- grid.440720.50000 0004 1759 0801School of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an, 710054 China
| | - Chuanwei Zhang
- grid.440720.50000 0004 1759 0801School of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an, 710054 China
| | - Dandan Liu
- grid.7728.a0000 0001 0724 6933Department of Mechanical and Aerospace Engineering, Brunel University London, Uxbridge, 361199 UK
| | - Yizhi Yang
- grid.440720.50000 0004 1759 0801School of Humanities and Foreign Languages, Xi’an University of Science and Technology, Xi’an, 710054 China
| | - Feiyan Han
- grid.440720.50000 0004 1759 0801School of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an, 710054 China
| | - Shuanfeng Zhao
- grid.440720.50000 0004 1759 0801School of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an, 710054 China
| |
Collapse
|
4
|
Confocal laser endomicroscope with distal MEMS scanner for real-time histopathology. Sci Rep 2022; 12:20155. [PMID: 36418439 PMCID: PMC9684518 DOI: 10.1038/s41598-022-24210-9] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Accepted: 11/11/2022] [Indexed: 11/25/2022] Open
Abstract
Confocal laser endomicroscopy is an emerging methodology to perform real time optical biopsy. Fluorescence images with histology-like quality can be collected instantaneously from the epithelium of hollow organs. Currently, scanning is performed at the proximal end of probe-based instruments used routinely in the clinic, and flexibility to control the focus is limited. We demonstrate use of a parametric resonance scanner packaged in the distal end of the endomicroscope to perform high speed lateral deflections. An aperture was etched in the center of the reflector to fold the optical path. This design reduced the dimensions of the instrument to 2.4 mm diameter and 10 mm length, allowing for forward passage through the working channel of a standard medical endoscope. A compact lens assembly provides lateral and axial resolution of 1.1 and 13.6 μm, respectively. A working distance of 0 μm and field-of-view of 250 μm × 250 μm was achieved at frame rates up to 20 Hz. Excitation at 488 nm was delivered to excite fluorescein, an FDA-approved dye, to generate high tissue contrast. The endomicroscope was reprocessed using a clinically-approved sterilization method for 18 cycles without failure. Fluorescence images were collected during routine colonoscopy from normal colonic mucosa, tubular adenomas, hyperplastic polyps, ulcerative colitis, and Crohn's colitis. Individual cells, including colonocytes, goblet cells, and inflammatory cells, could be identified. Mucosal features, such as crypt structures, crypt lumens, and lamina propria, could be distinguished. This instrument has potential to be used as an accessory during routine medical endoscopy.
Collapse
|
5
|
Morkvenaite-Vilkonciene I, Bucinskas V, Subaciute-Zemaitiene J, Sutinys E, Virzonis D, Dzedzickis A. Development of Electrostatic Microactuators: 5-Year Progress in Modeling, Design, and Applications. MICROMACHINES 2022; 13:mi13081256. [PMID: 36014178 PMCID: PMC9414043 DOI: 10.3390/mi13081256] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Revised: 07/29/2022] [Accepted: 08/01/2022] [Indexed: 02/01/2023]
Abstract
The implementation of electrostatic microactuators is one of the most popular technical solutions in the field of micropositioning due to their versatility and variety of possible operation modes and methods. Nevertheless, such uncertainty in existing possibilities creates the problem of choosing suitable methods. This paper provides an effort to classify electrostatic actuators and create a system in the variety of existing devices. Here is overviewed and classified a wide spectrum of electrostatic actuators developed in the last 5 years, including modeling of different designs, and their application in various devices. The paper provides examples of possible implementations, conclusions, and an extensive list of references.
Collapse
Affiliation(s)
- Inga Morkvenaite-Vilkonciene
- Department of Mechatronics, Robotics and Digital Manufacturing, Vilnius Gediminas Technical University, 10257 Vilnius, Lithuania
- Laboratory of Electrochemical Energy Conversion, State Research Institute Centre for Physical Sciences and Technology, Sauletekio 3, 10257 Vilnius, Lithuania
- Correspondence: (I.M.-V.); (A.D.); Tel.: +370-(8-5)-237-0668 (I.M.-V. & A.D.)
| | - Vytautas Bucinskas
- Department of Mechatronics, Robotics and Digital Manufacturing, Vilnius Gediminas Technical University, 10257 Vilnius, Lithuania
| | - Jurga Subaciute-Zemaitiene
- Department of Mechatronics, Robotics and Digital Manufacturing, Vilnius Gediminas Technical University, 10257 Vilnius, Lithuania
| | - Ernestas Sutinys
- Department of Mechatronics, Robotics and Digital Manufacturing, Vilnius Gediminas Technical University, 10257 Vilnius, Lithuania
| | - Darius Virzonis
- Department of Mechatronics, Robotics and Digital Manufacturing, Vilnius Gediminas Technical University, 10257 Vilnius, Lithuania
| | - Andrius Dzedzickis
- Department of Mechatronics, Robotics and Digital Manufacturing, Vilnius Gediminas Technical University, 10257 Vilnius, Lithuania
- Correspondence: (I.M.-V.); (A.D.); Tel.: +370-(8-5)-237-0668 (I.M.-V. & A.D.)
| |
Collapse
|
6
|
Birla M, Duan X, Li H, Lee M, Li G, Wang T, Oldham K. Image processing metrics for phase identification of a multiaxis MEMS scanner used in single pixel imaging. IEEE/ASME TRANSACTIONS ON MECHATRONICS : A JOINT PUBLICATION OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY AND THE ASME DYNAMIC SYSTEMS AND CONTROL DIVISION 2021; 26:1445-1454. [PMID: 34295138 PMCID: PMC8293905 DOI: 10.1109/tmech.2020.3020923] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
This paper applies image processing metrics to tracking of perturbations in mechanical phase delay in a multi-axis microelectromechanical system (MEMS) scanner. The compact mirror is designed to scan a laser beam in a Lissajous pattern during the collection of endoscopic confocal fluorescence images, but environmental perturbations to the mirror dynamics can lead to image registration errors and blurry images. A binarized, threshold-based blur metric and variance-based sharpness metric are introduced for detecting scanner phase delay. Accuracy of local optima of the metric for identification of phase delay is examined, and relative advantages for processing accuracy and computational complexity are assessed. Image reconstruction is demonstrated using both generic images and sample tissue images, with significant improvement in image quality for tissue imaging. Implications of non-ideal Lissajous scan effects on phase detection and image reconstruction are discussed.
Collapse
Affiliation(s)
- Mayur Birla
- Department of Mechanical Engineering, University of Michigan, Ann Arbor, MI, 48109 USA
| | - Xiyu Duan
- University of Michigan, Ann Arbor, MI 48109, USA
| | - Haijun Li
- Division of Gastroenterology, Department of Internal Medicine, University of Michigan, Ann Arbor, MI 48109, USA
| | - Miki Lee
- Division of Gastroenterology, Department of Internal Medicine, University of Michigan, Ann Arbor, MI 48109, USA
| | - Gaoming Li
- Division of Gastroenterology, Department of Internal Medicine, University of Michigan, Ann Arbor, MI 48109, USA
| | - Thomas Wang
- Division of Gastroenterology, Department of Internal Medicine, University of Michigan, Ann Arbor, MI 48109, USA
| | - Kenn Oldham
- Department of Mechanical Engineering, University of Michigan, Ann Arbor, MI, 48109 USA
| |
Collapse
|