1
|
Chen C, Hao Q, Liu L, Cao J, Qiao Z, Cheng Y. Continuous Optical Zoom Compound Eye Imaging Using Alvarez Lenses Actuated by Dielectric Elastomers. Biomimetics (Basel) 2024; 9:374. [PMID: 38921254 PMCID: PMC11202164 DOI: 10.3390/biomimetics9060374] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2024] [Revised: 06/13/2024] [Accepted: 06/18/2024] [Indexed: 06/27/2024] Open
Abstract
The compound eye is a natural multi-aperture optical imaging system. In this paper, a continuous optical zoom compound eye imaging system based on Alvarez lenses is proposed. The main optical imaging part of the proposed system consists of a curved Alvarez lens array (CALA) and two Alvarez lenses. The movement of the CALA and two Alvarez lenses perpendicular to the optical axis is realized by the actuation of the dielectric elastomers (DEs). By adjusting the focal length of the CALA and the two Alvarez lenses, the proposed system can realize continuous zoom imaging without any mechanical movement vertically to the optical axis. The experimental results show that the paraxial magnification of the target can range from ∼0.30× to ∼0.9×. The overall dimensions of the optical imaging part are 54 mm × 36 mm ×60 mm (L × W × H). The response time is 180 ms. The imaging resolution can reach up to 50 lp/mm during the optical zoom process. The proposed continuous optical zoom compound eye imaging system has potential applications in various fields, including large field of view imaging, medical diagnostics, machine vision, and distance detection.
Collapse
Affiliation(s)
- Chuanxun Chen
- Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, Beijing Institute of Technology, Beijing 100081, China; (C.C.); (Q.H.); (L.L.); (J.C.); (Z.Q.)
| | - Qun Hao
- Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, Beijing Institute of Technology, Beijing 100081, China; (C.C.); (Q.H.); (L.L.); (J.C.); (Z.Q.)
- Yangtze Delta Region Academy of Beijing Institute of Technology, Jiaxing 314003, China
| | - Lin Liu
- Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, Beijing Institute of Technology, Beijing 100081, China; (C.C.); (Q.H.); (L.L.); (J.C.); (Z.Q.)
| | - Jie Cao
- Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, Beijing Institute of Technology, Beijing 100081, China; (C.C.); (Q.H.); (L.L.); (J.C.); (Z.Q.)
- Yangtze Delta Region Academy of Beijing Institute of Technology, Jiaxing 314003, China
- National Key Laboratory on Near-Surface Detection, Beijing 100072, China
| | - Zhibo Qiao
- Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, Beijing Institute of Technology, Beijing 100081, China; (C.C.); (Q.H.); (L.L.); (J.C.); (Z.Q.)
| | - Yang Cheng
- Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, Beijing Institute of Technology, Beijing 100081, China; (C.C.); (Q.H.); (L.L.); (J.C.); (Z.Q.)
- Yangtze Delta Region Academy of Beijing Institute of Technology, Jiaxing 314003, China
- National Key Laboratory on Near-Surface Detection, Beijing 100072, China
| |
Collapse
|
2
|
Yan J, Ye Z, Jiang T, Chen S, Feng H, Xu Z, Li Q, Chen Y. Image restoration for optical zooming system based on Alvarez lenses. OPTICS EXPRESS 2023; 31:35765-35776. [PMID: 38017741 DOI: 10.1364/oe.500967] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Accepted: 09/29/2023] [Indexed: 11/30/2023]
Abstract
Alvarez lenses are known for their ability to achieve a broad range of optical power adjustment by utilizing complementary freeform surfaces. However, these lenses suffer from optical aberrations, which restrict their potential applications. To address this issue, we propose a field of view (FOV) attention image restoration model for continuous zooming. In order to simulate the degradation of optical zooming systems based on Alvarez lenses (OZA), a baseline OZA is designed where the polynomial for the Alvarez lenses consists of only three coefficients. By computing spatially varying point spread functions (PSFs), we simulate the degraded images of multiple zoom configurations and conduct restoration experiments. The results demonstrate that our approach surpasses the compared methods in the restoration of degraded images across various zoom configurations while also exhibiting strong generalization capabilities under untrained configurations.
Collapse
|
3
|
Mao F, Huang T, Ma L, Zhang X, Liao H. A Monocular Variable Magnifications 3D Laparoscope System Using Double Liquid Lenses. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2023; 12:32-42. [PMID: 38059130 PMCID: PMC10697296 DOI: 10.1109/jtehm.2023.3311022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 08/13/2023] [Accepted: 08/21/2023] [Indexed: 12/08/2023]
Abstract
During minimal invasive surgery (MIS), the laparoscope only provides a single viewpoint to the surgeon, leaving a lack of 3D perception. Many works have been proposed to obtain depth and 3D reconstruction by designing a new optical structure or by depending on the camera pose and image sequences. Most of these works modify the structure of the conventional laparoscopes and cannot provide 3D reconstruction of different magnification views. In this study, we propose a laparoscopic system based on double liquid lenses, which provide doctors with variable magnification rates, near observation, and real-time monocular 3D reconstruction. Our system composes of an optical structure that can obtain auto magnification change and autofocus without any physically moving element, and a deep learning network based on the Depth from Defocus (DFD) method, trained to suit inconsistent camera intrinsic situations and estimate depth from images of different focal lengths. The optical structure is portable and can be mounted on conventional laparoscopes. The depth estimation network estimates depth in real-time from monocular images of different focal lengths and magnification rates. Experiments show that our system provides a 0.68-1.44x zoom rate and can estimate depth from different magnification rates at 6fps. Monocular 3D reconstruction reaches at least 6mm accuracy. The system also provides a clear view even under 1mm close working distance. Ex-vivo experiments and implementation on clinical images prove that our system provides doctors with a magnified clear view of the lesion, as well as quick monocular depth perception during laparoscopy, which help surgeons get better detection and size diagnosis of the abdomen during laparoscope surgeries.
Collapse
Affiliation(s)
- Fan Mao
- Department of Biomedical EngineeringSchool of MedicineTsinghua UniversityBeijing100084China
| | - Tianqi Huang
- Department of Biomedical EngineeringSchool of MedicineTsinghua UniversityBeijing100084China
| | - Longfei Ma
- Department of Biomedical EngineeringSchool of MedicineTsinghua UniversityBeijing100084China
| | - Xinran Zhang
- Department of Biomedical EngineeringSchool of MedicineTsinghua UniversityBeijing100084China
| | - Hongen Liao
- Department of Biomedical EngineeringSchool of MedicineTsinghua UniversityBeijing100084China
| |
Collapse
|
4
|
Lippman DH, Schmidt GR, Bentley JL, Moore DT, Akhavan H, Harmon JP, Williams GM. Gradient-index Alvarez lenses. APPLIED OPTICS 2023; 62:3485-3495. [PMID: 37132850 DOI: 10.1364/ao.487089] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
Gradient-index Alvarez lenses (GALs), a new, to the best of our knowledge, type of freeform optical component, are surveyed in this work for their unique properties in generating variable optical power. GALs display similar behavior to conventional surface Alvarez lenses (SALs) by means of a freeform refractive index distribution that has only recently been achievable in fabrication. A first-order framework is described for GALs including analytical expressions for their refractive index distribution and power variation. A useful feature of Alvarez lenses for introducing bias power is also detailed and is helpful for both GALs and SALs. The performance of GALs is studied, and the value of three-dimensional higher-order refractive index terms is demonstrated in an optimized design. Last, a fabricated GAL is demonstrated along with power measurements agreeing closely with the developed first-order theory.
Collapse
|
5
|
A Compact Two-Dimensional Varifocal Scanning Imaging Device Actuated by Artificial Muscle Material. Biomimetics (Basel) 2023; 8:biomimetics8010120. [PMID: 36975350 PMCID: PMC10046869 DOI: 10.3390/biomimetics8010120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2023] [Revised: 03/07/2023] [Accepted: 03/10/2023] [Indexed: 03/17/2023] Open
Abstract
This paper presents a compact two-dimensional varifocal-scanning imaging device, with the capability of continuously variable focal length and a large scanning range, actuated by artificial muscle material. The varifocal function is realized by the principle of laterally shifting cubic phase masks and the scanning function is achieved by the principle of the decentered lens. One remarkable feature of these two principles is that both are based on the lateral displacements perpendicular to the optical axis. Artificial muscle material is emerging as a good choice of soft actuators capable of high strain, high efficiency, fast response speed, and light weight. Inspired by the artificial muscle, the dielectric elastomer is used as an actuator and produces the lateral displacements of the Alvarez lenses and the decentered lenses. A two-dimensional varifocal scanning imaging device prototype was established and validated through experiments to verify the feasibility of the proposed varifocal-scanning device. The results showed that the focal length variation of the proposed varifocal scanning device is up to 4.65 times higher (31.6 mm/6.8 mm), and the maximum scanning angle was 26.4°. The rise and fall times were 110 ms and 185 ms, respectively. Such a varifocal scanning device studied here has the potential to be used in consumer electronics, endoscopy, and microscopy in the future.
Collapse
|
6
|
Experimental characterization, modelling and compensation of temperature effects in optotunable lenses. Sci Rep 2023; 13:1575. [PMID: 36709218 PMCID: PMC9884192 DOI: 10.1038/s41598-023-28795-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Accepted: 01/24/2023] [Indexed: 01/30/2023] Open
Abstract
Most tunable lenses (TLs) are affected by deviations in optical power induced by external temperature changes or due to internal heating while in use. This study proposes: (1) An experimental characterization method to evaluate the magnitude of the optical power deviations due to internal temperature shifts; (2) three different mathematical models (experimental, polynomial, and optimized) to describe the response of the lens with temperature; (3) predictions of the internal temperature shifts while using the lens in time frames of minutes, seconds, and milliseconds and; (4) a real time optical power compensation tool based on the implementation of the models on a custom voltage electronic driver. The compensation methods were successfully applied to two TL samples in static and dynamic experiments and in hysteresis cycles. After 40 min at a static nominal power of 5 diopters (dpt), the internal temperature exponentially increased by 17 °C, producing an optical power deviation of 1.0 dpt (1.5 dpt when the lens cools down), representing a 20% distortion for heating and 30% for cooling. Modelling and compensation reduced the deviations to 0.2 dpt when heating (0.35 dpt when cooling) and the distortions to 4% and 7%. Similar levels of improvement were obtained in dynamic and hysteresis experiments. Compensation reduced temperature effects by more than 75%, representing a significant improvement in the performance of the lens.
Collapse
|
7
|
Lopez-de-Haro AG, Barcala X, Martinez-Ibarburu I, Marrakchi Y, Gambra E, Rodriguez-Lopez V, Sawides L, Dorronsoro C. Closed-loop experimental optimization of tunable lenses. APPLIED OPTICS 2022; 61:8091-8099. [PMID: 36255931 DOI: 10.1364/ao.467848] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/14/2022] [Accepted: 09/01/2022] [Indexed: 06/16/2023]
Abstract
Tunable lenses (TLs) are optical devices that can change their optical power in response to an electrical signal. In many applications, they are often pushed to or beyond their temporal limits. Fast periodic and/or abrupt variations of the optical power induce undesired distortions in their transient response and produce a decrease in their performance. A low-cost focimetry system, along with a custom closed-loop iterative optimization algorithm, was developed to (1) characterize a TL's response at high speed and (2) optimize their performance in realistic TL working conditions. A significant lens performance improvement was found in about 23 iterations with a decrease in the area under the error curve and an improved effective time. Applying the closed-loop optimization algorithm in a depth scanning experiment enhanced the image quality. Quantitatively, the image quality was evaluated using the structural similarity index metric that improves in individual frames, on average, from 0.345 to 0.895.
Collapse
|
8
|
Cheng Y, Cao J, Tang X, Hao Q. Optical zoom imaging systems using adaptive liquid lenses. BIOINSPIRATION & BIOMIMETICS 2021; 16:041002. [PMID: 33906161 DOI: 10.1088/1748-3190/abfc2b] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/23/2020] [Accepted: 04/27/2021] [Indexed: 06/12/2023]
Abstract
An optical zoom imaging system that can vary the magnification factor without displacing the object and the image plane has been widely used. Nonetheless, conventional optical zoom imaging systems suffer from slow response, complicated configuration, vulnerability to misalignment during zoom operation, and are incompatible with miniaturized applications. This review article focuses on state-of-the-art research on novel optical zoom imaging systems that use adaptive liquid lenses. From the aspect of the configuration, according to the number of adaptive liquid lenses, we broadly divide the current optical zoom imaging systems using adaptive liquid lenses into two configurations: multiple adaptive liquid lenses, and a single adaptive liquid lens. The principles and configurations of these optical zoom imaging systems are introduced and represented. Three different working principles of the adaptive liquid lens (liquid crystal, polymer elastic membrane, and electrowetting effect) adopted in the optical zoom imaging systems are reviewed. Some representative applications of optical zoom imaging systems using adaptive liquid lenses are introduced. The opportunities and challenges of the optical zoom imaging systems using adaptive liquid lenses are also discussed. This review aims to provide a snapshot of the current state of this research field with the aim to attract more attention to put forward the development of the next-generation optical zoom imaging systems.
Collapse
Affiliation(s)
- Yang Cheng
- Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, Beijing Institute of Technology, Beijing, People's Republic of China
- Yangtze Delta Region Academy, Beijing Institute of Technology, Jiaxing, People's Republic of China
| | - Jie Cao
- Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, Beijing Institute of Technology, Beijing, People's Republic of China
- Yangtze Delta Region Academy, Beijing Institute of Technology, Jiaxing, People's Republic of China
| | - Xin Tang
- Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, Beijing Institute of Technology, Beijing, People's Republic of China
- Yangtze Delta Region Academy, Beijing Institute of Technology, Jiaxing, People's Republic of China
| | - Qun Hao
- Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, Beijing Institute of Technology, Beijing, People's Republic of China
- Yangtze Delta Region Academy, Beijing Institute of Technology, Jiaxing, People's Republic of China
| |
Collapse
|
9
|
Kose T, Ben-Mrad R. Optical design of a 2× zoom lens for miniature imaging systems. OPTICAL ENGINEERING 2019; 58:1. [DOI: 10.1117/1.oe.58.8.085107] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
Affiliation(s)
- Talha Kose
- University of Toronto, Mechatronics and Microsystems Design Laboratory, Department of Mechanical and
| | - Ridha Ben-Mrad
- University of Toronto, Mechatronics and Microsystems Design Laboratory, Department of Mechanical and
| |
Collapse
|
10
|
Zhang B, Cui Q, Piao M, Hu Y. Design of dual-band infrared zoom lens with multilayer diffractive optical elements. APPLIED OPTICS 2019; 58:2058-2067. [PMID: 30874079 DOI: 10.1364/ao.58.002058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/15/2018] [Accepted: 02/01/2019] [Indexed: 06/09/2023]
Abstract
A mid-wave infrared (MWIR)/long-wave infrared (LWIR) dual-band zoom lens design with multilayer diffractive optical elements (MLDOEs) is presented. The mathematical relationship between the substrate material selection for dual-band MLDOE and polychromatic integral diffraction efficiency (PIDE) is deduced in the oblique incident situation, and further, a method for optimal selection of substrate material is proposed to obtain the high PIDE in an incident angle range. In the optimization process, the optimal substrate material combination is selected based on the proposed method, and the principle of lens material replacement is discussed. After optimization, the 5× hybrid dual-band infrared zoom system is obtained, which consists of seven lenses. The modulation transfer function values in all configurations are larger than 0.5 and 0.3 in MWIR and LWIR, respectively. The distortion values are less than 2% both in MWIR and LWIR for all configurations.
Collapse
|
11
|
Ronzitti E, Emiliani V, Papagiakoumou E. Methods for Three-Dimensional All-Optical Manipulation of Neural Circuits. Front Cell Neurosci 2018; 12:469. [PMID: 30618626 PMCID: PMC6304748 DOI: 10.3389/fncel.2018.00469] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2018] [Accepted: 11/19/2018] [Indexed: 12/18/2022] Open
Abstract
Optical means for modulating and monitoring neuronal activity, have provided substantial insights to neurophysiology and toward our understanding of how the brain works. Optogenetic actuators, calcium or voltage imaging probes and other molecular tools, combined with advanced microscopies have allowed an "all-optical" readout and modulation of neural circuits. Completion of this remarkable work is evolving toward a three-dimensional (3D) manipulation of neural ensembles at a high spatiotemporal resolution. Recently, original optical methods have been proposed for both activating and monitoring neurons in a 3D space, mainly through optogenetic compounds. Here, we review these methods and anticipate possible combinations among them.
Collapse
Affiliation(s)
| | | | - Eirini Papagiakoumou
- Wavefront Engineering Microscopy Group, Photonics Department, Institut de la Vision, Sorbonne Université, Inserm S968, CNRS UMR7210, Paris, France
| |
Collapse
|