1
|
Park J, Kim MS, Kim J, Chang S, Lee M, Lee GJ, Song YM, Kim DH. Avian eye-inspired perovskite artificial vision system for foveated and multispectral imaging. Sci Robot 2024; 9:eadk6903. [PMID: 38809996 DOI: 10.1126/scirobotics.adk6903] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2023] [Accepted: 04/26/2024] [Indexed: 05/31/2024]
Abstract
Avian eyes have deep central foveae as a result of extensive evolution. Deep foveae efficiently refract incident light, creating a magnified image of the target object and making it easier to track object motion. These features are essential for detecting and tracking remote objects in dynamic environments. Furthermore, avian eyes respond to a wide spectrum of light, including visible and ultraviolet light, allowing them to efficiently distinguish the target object from complex backgrounds. Despite notable advances in artificial vision systems that mimic animal vision, the exceptional object detection and targeting capabilities of avian eyes via foveated and multispectral imaging remain underexplored. Here, we present an artificial vision system that capitalizes on these aspects of avian vision. We introduce an artificial fovea and vertically stacked perovskite photodetector arrays whose designs were optimized by theoretical simulations for the demonstration of foveated and multispectral imaging. The artificial vision system successfully identifies colored and mixed-color objects and detects remote objects through foveated imaging. The potential for use in uncrewed aerial vehicles that need to detect, track, and recognize distant targets in dynamic environments is also discussed. Our avian eye-inspired perovskite artificial vision system marks a notable advance in bioinspired artificial visions.
Collapse
Affiliation(s)
- Jinhong Park
- Center for Nanoparticle Research, Institute for Basic Science (IBS), Seoul 08826, Republic of Korea
- School of Chemical and Biological Engineering, Institute of Chemical Processes, Seoul National University, Seoul 08826, Republic of Korea
| | - Min Seok Kim
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology (GIST), Gwangju 61005, Republic of Korea
| | - Joonsoo Kim
- Center for Nanoparticle Research, Institute for Basic Science (IBS), Seoul 08826, Republic of Korea
- School of Chemical and Biological Engineering, Institute of Chemical Processes, Seoul National University, Seoul 08826, Republic of Korea
| | - Sehui Chang
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology (GIST), Gwangju 61005, Republic of Korea
| | - Mincheol Lee
- Center for Nanoparticle Research, Institute for Basic Science (IBS), Seoul 08826, Republic of Korea
- School of Chemical and Biological Engineering, Institute of Chemical Processes, Seoul National University, Seoul 08826, Republic of Korea
- Electro-Medical Equipment Research Division, Korea Electrotechnology Research Institute (KERI), Ansan 15588, Republic of Korea
| | - Gil Ju Lee
- Department of Electronics Engineering, Pusan National University, Busan 46241, Republic of Korea
| | - Young Min Song
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology (GIST), Gwangju 61005, Republic of Korea
- Artificial Intelligence (AI) Graduate School, GIST, Gwangju 61005, Republic of Korea
| | - Dae-Hyeong Kim
- Center for Nanoparticle Research, Institute for Basic Science (IBS), Seoul 08826, Republic of Korea
- School of Chemical and Biological Engineering, Institute of Chemical Processes, Seoul National University, Seoul 08826, Republic of Korea
- Department of Materials Science and Engineering, Seoul National University, Seoul 08826, Republic of Korea
| |
Collapse
|
2
|
Ma W, Li J, Liu S, Han Y, Liu X, Wang Z, Jiang C. An Autocollimator Axial Measurement Method Based on the Strapdown Inertial Navigation System. SENSORS (BASEL, SWITZERLAND) 2024; 24:2590. [PMID: 38676206 PMCID: PMC11055003 DOI: 10.3390/s24082590] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/23/2024] [Revised: 04/13/2024] [Accepted: 04/16/2024] [Indexed: 04/28/2024]
Abstract
Autocollimators are widely used optical axis-measuring tools, but their measurement errors increase significantly when measuring under non-leveled conditions and they have a limited measurement range due to the limitations of the measurement principle. To realize axis measurement under non-leveled conditions, this paper proposes an autocollimator axis measurement method based on the strapdown inertial navigation system (SINS). First, the measurement model of the system was established. This model applies the SINS to measure the change in attitude of the autocollimator. The autocollimator was then applied to measure the angular relationship between the measured axis and its own axis, based on which the angular relationship of the axis was measured via computation through signal processing and data fusion in a multi-sensor system. After analyzing the measurement errors of the system model, the Monte Carlo method was applied to carry out a simulation analysis. This showed that the majority of the measurement errors were within ±0.002° and the overall measurement accuracy was within ±0.006°. Tests using equipment with the same parameters as those used in the simulation analysis showed that the majority of the measurement errors were within ±0.004° and the overall error was within ±0.006°, which is consistent with the simulation results. This analysis proves that this method solves the problem of the autocollimator being unable to measure the axis under non-leveled conditions and meets the needs of axis measurement with the application of autocollimators under a moving base.
Collapse
Affiliation(s)
- Wenjia Ma
- Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China; (W.M.); (J.L.); (S.L.); (Y.H.); (X.L.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Jianrong Li
- Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China; (W.M.); (J.L.); (S.L.); (Y.H.); (X.L.)
| | - Shaojin Liu
- Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China; (W.M.); (J.L.); (S.L.); (Y.H.); (X.L.)
| | - Yan Han
- Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China; (W.M.); (J.L.); (S.L.); (Y.H.); (X.L.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Xu Liu
- Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China; (W.M.); (J.L.); (S.L.); (Y.H.); (X.L.)
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Zhiqian Wang
- Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China; (W.M.); (J.L.); (S.L.); (Y.H.); (X.L.)
| | - Changhong Jiang
- School of Electrical and Electronic Engineering, Changchun University of Technology, Changchun 130012, China
| |
Collapse
|
3
|
Kim K, Yang H, Lee J, Lee WG. Metaverse Wearables for Immersive Digital Healthcare: A Review. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2023; 10:e2303234. [PMID: 37740417 PMCID: PMC10625124 DOI: 10.1002/advs.202303234] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Revised: 07/15/2023] [Indexed: 09/24/2023]
Abstract
The recent exponential growth of metaverse technology has been instrumental in reshaping a myriad of sectors, not least digital healthcare. This comprehensive review critically examines the landscape and future applications of metaverse wearables toward immersive digital healthcare. The key technologies and advancements that have spearheaded the metamorphosis of metaverse wearables are categorized, encapsulating all-encompassed extended reality, such as virtual reality, augmented reality, mixed reality, and other haptic feedback systems. Moreover, the fundamentals of their deployment in assistive healthcare (especially for rehabilitation), medical and nursing education, and remote patient management and treatment are investigated. The potential benefits of integrating metaverse wearables into healthcare paradigms are multifold, encompassing improved patient prognosis, enhanced accessibility to high-quality care, and high standards of practitioner instruction. Nevertheless, these technologies are not without their inherent challenges and untapped opportunities, which span privacy protection, data safeguarding, and innovation in artificial intelligence. In summary, future research trajectories and potential advancements to circumvent these hurdles are also discussed, further augmenting the incorporation of metaverse wearables within healthcare infrastructures in the post-pandemic era.
Collapse
Affiliation(s)
- Kisoo Kim
- Intelligent Optical Module Research CenterKorea Photonics Technology Institute (KOPTI)Gwangju61007Republic of Korea
| | - Hyosill Yang
- Department of NursingCollege of Nursing ScienceKyung Hee UniversitySeoul02447Republic of Korea
| | - Jihun Lee
- Department of Mechanical EngineeringCollege of EngineeringKyung Hee UniversityYongin17104Republic of Korea
| | - Won Gu Lee
- Department of Mechanical EngineeringCollege of EngineeringKyung Hee UniversityYongin17104Republic of Korea
| |
Collapse
|
4
|
Kang BH, Jang KW, Yu ES, Jeong H, Jeong KH. Single-shot multi-channel plasmonic real-time polymerase chain reaction for multi-target point-of-care testing. LAB ON A CHIP 2023; 23:4701-4707. [PMID: 37823261 DOI: 10.1039/d3lc00687e] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/13/2023]
Abstract
Plasmonic nucleic acid amplification tests demand high-throughput and multi-target detection of infectious diseases as well as short turnaround time and small size for point-of-care molecular diagnostics. Here, we report a multi-channel plasmonic real-time reverse-transcription polymerase chain reaction (mpRT-qPCR) assay for ultrafast and on-chip multi-target detection. The mpRT-qPCR system features two pairs of plasmonic thermocyclers for rapid nanostructure-driven amplification and microlens array fluorescence microscopes for in situ multi-color fluorescence quantification. Each channel shows a physical dimension of 32 mm, 75 mm, and 25 mm in width, length, and thickness. The ultrathin microscopes simultaneously capture four different fluorescence images from two PCR chambers of a single cartridge at a single shot exposure per PCR cycle of four different excitation light sources. The experimental results demonstrate a single assay result of high-throughput amplification and multi-target quantification for RNA-dependent RNA polymerase, nucleocapsid, and human ribonuclease P genes in SARS-CoV-2 RNA detection. The mpRT-PCR increases the number of tests four times over the single RT-PCR and exhibits a short detection time of 15 min for the four RT-PCR reactions. This point-of-care molecular diagnostic platform can reduce false negative results in clinical applications of virus detection and decentralize healthcare facilities with limited infrastructure.
Collapse
Affiliation(s)
- Byoung-Hoon Kang
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea.
- KAIST Institute for Health Science and Technology (KIHST), Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
| | - Kyung-Won Jang
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea.
- KAIST Institute for Health Science and Technology (KIHST), Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
| | - Eun-Sil Yu
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea.
- KAIST Institute for Health Science and Technology (KIHST), Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
| | - Hyejeong Jeong
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea.
- KAIST Institute for Health Science and Technology (KIHST), Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
| | - Ki-Hun Jeong
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea.
- KAIST Institute for Health Science and Technology (KIHST), Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
| |
Collapse
|
5
|
Li H, Zhang H, Liu X, Jia D, Liu T. Curved fiber compound eye camera inspired by the Strepsiptera vision. OPTICS EXPRESS 2023; 31:36903-36914. [PMID: 38017830 DOI: 10.1364/oe.503578] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/23/2023] [Accepted: 10/05/2023] [Indexed: 11/30/2023]
Abstract
The Strepsiptera vision possesses intriguing features of a large field of view (FOV) and relatively high resolution compared to normal compound eyes. However, it presents a significant challenge of the mismatch between the curved compound eyelet lens array and the planar image sensor to image in a large FOV for artificial compound eyes (ACE). We propose what we believe to be a novel curved fiber compound eye camera (CFCEC) here, which employs coherent fiber bundles as the optical relay system to transmit sub-images curvilinearly. A total of 106 eyelets are arranged based on a scheme similar to the Goldberg polyhedron, with the advantages of uniform interval and minor edge blindness. Then, a prototype of the CFCEC is fabricated and assembled. A series of experiments are conducted to assess the FOV, contrast, resolution, and overlap rate of FOV of the prototype. The results prove that the CFCEC has a total FOV of up to 160°×160° and a total overlap rate of FOV of approximately 65%, demonstrating the promising potential of the CFCEC in various applications, such as panoramic surveillance, 3D detection, and motion tracking.
Collapse
|
6
|
Wu M, Jiang L, Li X, Xiang Z, Yi P, Liu Y, Zhang L, Li X, Wang Z, Zhang X. Microheater-Integrated Microlens Array for Robust Rapid Fog Removal. ACS APPLIED MATERIALS & INTERFACES 2023; 15:41092-41100. [PMID: 37599436 DOI: 10.1021/acsami.3c07262] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/22/2023]
Abstract
In extreme environments, fog formation on a microlens array (MLA) surface results in a device failure. One reliable solution for fog removal is to heat the surface using a microheater. However, due to the surface interference, the combination of these two microdevices remains elusive. In this study, we introduce lift-off and electroless plating into femtosecond laser processing to fabricate a microheater integrated MLA (μH-MLA) on the same substrate with high light transmittance, durability, and fog removal efficiency. Laser-induced micro-nano grooves enable the microheater to be tightly coupled with the MLA and have high heating performance, thus maintaining a stable performance for over 24 h during continuous operation as well as under long time ultrasonic vibration and mechanical friction. With a rapid response time (τ0.5) of 17 s and a high working temperature of 188 °C, the μH-MLA removed fog that covers the entire face within 14 s. Finally, we prove the use of this fabrication method in large areas and curved surface environments. This study provides a flexible, stable, and economical method to integrate micro-optical and microelectrical devices.
Collapse
Affiliation(s)
- Mengnan Wu
- School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China
- Laser Micro/Nano Fabrication Laboratory, School of Mechanical Engineering, Beijing Institute of Technology, Beijing 100081, China
| | - Lan Jiang
- Laser Micro/Nano Fabrication Laboratory, School of Mechanical Engineering, Beijing Institute of Technology, Beijing 100081, China
| | - Xiaowei Li
- Laser Micro/Nano Fabrication Laboratory, School of Mechanical Engineering, Beijing Institute of Technology, Beijing 100081, China
| | - Zhikun Xiang
- Laser Micro/Nano Fabrication Laboratory, School of Mechanical Engineering, Beijing Institute of Technology, Beijing 100081, China
| | - Peng Yi
- Laser Micro/Nano Fabrication Laboratory, School of Mechanical Engineering, Beijing Institute of Technology, Beijing 100081, China
| | - Yang Liu
- Institute of Micro-Nano Optoelectronics and Terahertz Technology, School of Mechanical Engineering, Jiangsu University, Zhenjiang 212013, P. R. China
| | - Leyi Zhang
- Laser Micro/Nano Fabrication Laboratory, School of Mechanical Engineering, Beijing Institute of Technology, Beijing 100081, China
| | - Xibiao Li
- Laser Micro/Nano Fabrication Laboratory, School of Mechanical Engineering, Beijing Institute of Technology, Beijing 100081, China
| | - Zhi Wang
- Laser Micro/Nano Fabrication Laboratory, School of Mechanical Engineering, Beijing Institute of Technology, Beijing 100081, China
| | - Xiangyu Zhang
- Laser Micro/Nano Fabrication Laboratory, School of Mechanical Engineering, Beijing Institute of Technology, Beijing 100081, China
| |
Collapse
|
7
|
Cha YG, Na J, Kim HK, Kwon JM, Huh SH, Jo SU, Kim CH, Kim MH, Jeong KH. Microlens array camera with variable apertures for single-shot high dynamic range (HDR) imaging. OPTICS EXPRESS 2023; 31:29589-29595. [PMID: 37710755 DOI: 10.1364/oe.498763] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Accepted: 08/12/2023] [Indexed: 09/16/2023]
Abstract
We report a microlens array camera with variable apertures (MACVA) for high dynamic range (HDR) imaging by using microlens arrays with various sizes of apertures. The MACVA comprises variable apertures, microlens arrays, gap spacers, and a CMOS image sensor. The microlenses with variable apertures capture low dynamic range (LDR) images with different f-stops under single-shot exposure. The reconstructed HDR images clearly exhibit expanded dynamic ranges surpassing LDR images as well as high resolution without motion artifacts, comparable to the maximum MTF50 value observed among the LDR images. This compact camera provides, what we believe to be, a new perspective for various machine vision or mobile devices applications.
Collapse
|
8
|
Cheng HT, Pan JS, Lin WH, Yang YC, Wu CH. Zone-addressable 20 × 20 940 nm VCSEL array with a 5-bit binary number pattern. OPTICS LETTERS 2023; 48:3937-3940. [PMID: 37527087 DOI: 10.1364/ol.494760] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Accepted: 06/25/2023] [Indexed: 08/03/2023]
Abstract
This article presents a monolithically zone-addressable 20 × 20 940 nm vertical-cavity surface-emitting laser (VCSEL) array with a binary number pattern design for sensing applications. The emitters in this VCSEL array have a uniquely designed binary pattern design, with each row representing a 5-bit pattern designed to aid pattern-matching algorithms to deduce the shape and depth information efficiently. Approximately 200 VCSELs are arranged in four individually addressable light-emitting zones, with ∼50 emitters in each zone. Each zone generates laser pulses up to 7.2 W in peak power.
Collapse
|
9
|
Zhang H, Li F, Song H, Liu Y, Huang L, Zhao S, Xiong Z, Wang Z, Dong Y, Liu H. Random Silica-Glass Microlens Arrays Based on the Molding Technology of Photocurable Nanocomposites. ACS APPLIED MATERIALS & INTERFACES 2023; 15:19230-19240. [PMID: 37039331 DOI: 10.1021/acsami.3c02040] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Random microlens arrays (rMLAs) have been widely applied as a beam-shaping component within an optical system. Silica glass is undoubtedly the best choice for rMLAs because of its wide range of spectra with high transmission and high damage threshold. Yet, machining silica glass with user-defined shapes is still challenging. In this work, novel design and fabrication methods of random silica-glass microlens arrays (rSMLAs) are proposed and a detailed investigation of this technology is presented. Based on the molding technology, the fabricated rSMLAs with tunable divergent angles demonstrate superior physical properties with 1.81 nm roughness, 1074.33 HV hardness, and excellent thermal stability at 1250 °C for 3 h. Meanwhile, their characterized optical performance shows a high transmission of over 90% in the ultraviolet spectrum. The fabricated two types of rSMLAs exhibit excellent effects of beam homogenization with surprising energy utilization (more than 90%) and light spot uniformity (more than 80%). This innovative process paves a new route for fabricating rMLAs on solid silica glass and breaking down the barrier of rMLAs to broader applications.
Collapse
Affiliation(s)
- Han Zhang
- Center for Advanced Optoelectronic Functional Materials Research, and Key Laboratory for UV Emitting Materials and Technology of Ministry of Education, National Demonstration Center for Experimental Physics Education, Northeast Normal University, 5268 Renmin Street, Changchun 130024, China
| | - Feng Li
- Center for Advanced Optoelectronic Functional Materials Research, and Key Laboratory for UV Emitting Materials and Technology of Ministry of Education, National Demonstration Center for Experimental Physics Education, Northeast Normal University, 5268 Renmin Street, Changchun 130024, China
| | - Huiying Song
- Center for Advanced Optoelectronic Functional Materials Research, and Key Laboratory for UV Emitting Materials and Technology of Ministry of Education, National Demonstration Center for Experimental Physics Education, Northeast Normal University, 5268 Renmin Street, Changchun 130024, China
| | - Yuqing Liu
- Center for Advanced Optoelectronic Functional Materials Research, and Key Laboratory for UV Emitting Materials and Technology of Ministry of Education, National Demonstration Center for Experimental Physics Education, Northeast Normal University, 5268 Renmin Street, Changchun 130024, China
| | - Long Huang
- Center for Advanced Optoelectronic Functional Materials Research, and Key Laboratory for UV Emitting Materials and Technology of Ministry of Education, National Demonstration Center for Experimental Physics Education, Northeast Normal University, 5268 Renmin Street, Changchun 130024, China
| | - Shaoqing Zhao
- Center for Advanced Optoelectronic Functional Materials Research, and Key Laboratory for UV Emitting Materials and Technology of Ministry of Education, National Demonstration Center for Experimental Physics Education, Northeast Normal University, 5268 Renmin Street, Changchun 130024, China
| | - Zheng Xiong
- Corning Research & Development Corporation, 1 Riverfront Plaza, Corning, New York 14831, United States
| | - Zhengxiao Wang
- High School Attached to Northeast Normal University, Changchun 130024, China
| | - Yongjun Dong
- Center for Advanced Optoelectronic Functional Materials Research, and Key Laboratory for UV Emitting Materials and Technology of Ministry of Education, National Demonstration Center for Experimental Physics Education, Northeast Normal University, 5268 Renmin Street, Changchun 130024, China
| | - Hua Liu
- Center for Advanced Optoelectronic Functional Materials Research, and Key Laboratory for UV Emitting Materials and Technology of Ministry of Education, National Demonstration Center for Experimental Physics Education, Northeast Normal University, 5268 Renmin Street, Changchun 130024, China
| |
Collapse
|
10
|
Kang BH, Jang KW, Yu ES, Na H, Lee YJ, Ko WY, Bae N, Rho D, Jeong KH. Ultrafast Plasmonic Nucleic Acid Amplification and Real-Time Quantification for Decentralized Molecular Diagnostics. ACS NANO 2023; 17:6507-6518. [PMID: 36971140 PMCID: PMC10081571 DOI: 10.1021/acsnano.2c11831] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/27/2022] [Accepted: 03/23/2023] [Indexed: 06/18/2023]
Abstract
Point-of-care real-time reverse-transcription polymerase chain reaction (RT-PCR) facilitates the widespread use of rapid, accurate, and cost-effective near-patient testing that is available to the public. Here, we report ultrafast plasmonic nucleic acid amplification and real-time quantification for decentralized molecular diagnostics. The plasmonic real-time RT-PCR system features an ultrafast plasmonic thermocycler (PTC), a disposable plastic-on-metal (PoM) cartridge, and an ultrathin microlens array fluorescence (MAF) microscope. The PTC provides ultrafast photothermal cycling under white-light-emitting diode illumination and precise temperature monitoring with an integrated resistance temperature detector. The PoM thin film cartridge allows rapid heat transfer as well as complete light blocking from the photothermal excitation source, resulting in real-time and highly efficient PCR quantification. Besides, the MAF microscope exhibits close-up and high-contrast fluorescence microscopic imaging. All of the systems were fully packaged in a palm size for point-of-care testing. The real-time RT-PCR system demonstrates the rapid diagnosis of coronavirus disease-19 RNA virus within 10 min and yields 95.6% of amplification efficiency, 96.6% of classification accuracy for preoperational test, and 91% of total percent agreement for clinical diagnostic test. The ultrafast and compact PCR system can decentralize point-of-care molecular diagnostic testing in primary care and developing countries.
Collapse
Affiliation(s)
- Byoung-Hoon Kang
- Department
of Bio and Brain Engineering, Korea Advanced
Institute of Science and Technology (KAIST), 291 Daehak-ro,
Yuseong-gu, Daejeon 34141, Republic of Korea
- KAIST
Institute for Health Science and Technology (KIHST), Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro,
Yuseong-gu, Daejeon 34141, Republic of Korea
| | - Kyung-Won Jang
- Department
of Bio and Brain Engineering, Korea Advanced
Institute of Science and Technology (KAIST), 291 Daehak-ro,
Yuseong-gu, Daejeon 34141, Republic of Korea
- KAIST
Institute for Health Science and Technology (KIHST), Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro,
Yuseong-gu, Daejeon 34141, Republic of Korea
| | - Eun-Sil Yu
- Department
of Bio and Brain Engineering, Korea Advanced
Institute of Science and Technology (KAIST), 291 Daehak-ro,
Yuseong-gu, Daejeon 34141, Republic of Korea
- KAIST
Institute for Health Science and Technology (KIHST), Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro,
Yuseong-gu, Daejeon 34141, Republic of Korea
| | - Hamin Na
- Department
of Bio and Brain Engineering, Korea Advanced
Institute of Science and Technology (KAIST), 291 Daehak-ro,
Yuseong-gu, Daejeon 34141, Republic of Korea
- KAIST
Institute for Health Science and Technology (KIHST), Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro,
Yuseong-gu, Daejeon 34141, Republic of Korea
| | - Yun-Jae Lee
- OSANG
Healthcare Co., Ltd., 132, Anyangcheondong-ro, Dongan-gu, Anyang-si, Gyeonggi-do 14040, Korea
| | - Woong-Yeol Ko
- OSANG
Healthcare Co., Ltd., 132, Anyangcheondong-ro, Dongan-gu, Anyang-si, Gyeonggi-do 14040, Korea
| | - NamHo Bae
- Center
for Nano Bio Development, National NanoFab
Center (NNFC), 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
| | - Donggee Rho
- Center
for Nano Bio Development, National NanoFab
Center (NNFC), 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
| | - Ki-Hun Jeong
- Department
of Bio and Brain Engineering, Korea Advanced
Institute of Science and Technology (KAIST), 291 Daehak-ro,
Yuseong-gu, Daejeon 34141, Republic of Korea
- KAIST
Institute for Health Science and Technology (KIHST), Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro,
Yuseong-gu, Daejeon 34141, Republic of Korea
| |
Collapse
|
11
|
Kim K, Lee WG. Portable, Automated and Deep-Learning-Enabled Microscopy for Smartphone-Tethered Optical Platform Towards Remote Homecare Diagnostics: A Review. SMALL METHODS 2023; 7:e2200979. [PMID: 36420919 DOI: 10.1002/smtd.202200979] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/27/2022] [Revised: 10/18/2022] [Indexed: 06/16/2023]
Abstract
Globally new pandemic diseases induce urgent demands for portable diagnostic systems to prevent and control infectious diseases. Smartphone-based portable diagnostic devices are significantly efficient tools to user-friendly connect personalized health conditions and collect valuable optical information for rapid diagnosis and biomedical research through at-home screening. Deep learning algorithms for portable microscopes also help to enhance diagnostic accuracy by reducing the imaging resolution gap between benchtop and portable microscopes. This review highlighted recent progress and continued efforts in a smartphone-tethered optical platform through portable, automated, and deep-learning-enabled microscopy for personalized diagnostics and remote monitoring. In detail, the optical platforms through smartphone-based microscopes and lens-free holographic microscopy are introduced, and deep learning-based portable microscopic imaging is explained to improve the image resolution and accuracy of diagnostics. The challenges and prospects of portable optical systems with microfluidic channels and a compact microscope to screen COVID-19 in the current pandemic are also discussed. It has been believed that this review offers a novel guide for rapid diagnosis, biomedical imaging, and digital healthcare with low cost and portability.
Collapse
Affiliation(s)
- Kisoo Kim
- Intelligent Optical Module Research Center, Korea Photonics Technology Institute (KOPTI), Buk-gu, Gwangju, 61007, Republic of Korea
| | - Won Gu Lee
- Department of Mechanical Engineering, Kyung Hee University, Yongin, 17104, Republic of Korea
| |
Collapse
|
12
|
Abstract
Inspired by insect compound eyes (CEs) that feature unique optical schemes for imaging, there has recently been growing interest in developing optoelectronic CE cameras with comparable size and functions. However, considering the mismatch between the complex 3D configuration of CEs and the planar nature of available imaging sensors, it is currently challenging to reach this end. Here, we report a paradigm in miniature optoelectronic integrated CE camera by manufacturing polymer CEs with 19~160 logarithmic profile ommatidia via femtosecond laser two-photon polymerization. In contrast to μ-CEs with spherical ommatidia that suffer from defocusing problems, the as-obtained μ-CEs with logarithmic ommatidia permit direct integration with a commercial CMOS detector, because the depth-of-field and focus range of all the logarithmic ommatidia are significantly increased. The optoelectronic integrated μ-CE camera enables large field-of-view imaging (90°), spatial position identification and sensitive trajectory monitoring of moving targets. Moreover, the miniature μ-CE camera can be integrated with a microfluidic chip and serves as an on-chip camera for real-time microorganisms monitoring. The insect-scale optoelectronic μ-CE camera provides a practical route for integrating well-developed planar imaging sensors with complex micro-optics elements, holding great promise for cutting-edge applications in endoscopy and robot vision.
Collapse
|
13
|
Kawano H, Nakagawa N, Takushima S, Makita T, Kurihara K, Sugano M. Apposition compound-eye image scanner by glass plate optics. APPLIED OPTICS 2022; 61:7010-7016. [PMID: 36256316 DOI: 10.1364/ao.465537] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Accepted: 07/25/2022] [Indexed: 06/16/2023]
Abstract
We propose a design approach for a thin image scanner using the concept of an apposition compound eye comprising many imaging units that take only one pixel image. Although light shielding between adjacent imaging units is always one of the main issues for an artificial compound eye, a simple plane structure using three aperture array layers on two glued glass plates prevents such stray light. Our prototyped scanner, with only 6.8-mm thickness as a packaged module, has 632 microlenses with 200-dpi resolution, resulting in a field of view of 80 mm. The evaluated images show no ghost images.
Collapse
|
14
|
Kim K. Single-Shot Light-Field Microscopy: An Emerging Tool for 3D Biomedical Imaging. BIOCHIP JOURNAL 2022. [DOI: 10.1007/s13206-022-00077-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
Abstract3D microscopy is a useful tool to visualize the detailed structures and mechanisms of biomedical specimens. In particular, biophysical phenomena such as neural activity require fast 3D volumetric imaging because fluorescence signals degrade quickly. A light-field microscope (LFM) has recently attracted attention as a high-speed volumetric imaging technique by recording 3D information in a single-snapshot. This review highlighted recent progress in LFM techniques for 3D biomedical applications. In detail, various image reconstruction algorithms according to LFM configurations are explained, and several biomedical applications such as neuron activity localization, live-cell imaging, locomotion analysis, and single-molecule visualization are introduced. We also discuss deep learning-based LFMs to enhance image resolution and reduce reconstruction artifacts.
Collapse
|
15
|
Multi-Mode Compact Microscopy for High-Contrast and High-Resolution Imaging. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12157399] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
We report a multi-mode compact microscope (MCM) for high-contrast and high-resolution imaging. The MCM consists of two LED illuminations, a magnification lens, a lift stage, and a housing with image processing and LED control boards. The MCM allows multi-modal imaging, including reflection, transmission, and higher magnification modes. The dual illuminations also provide high-contrast imaging of various targets such as biological samples and microcircuits. The high dynamic range (HDR) imaging reconstruction of MCM increases the dynamic range of the acquired images by 1.36 times. The microlens array (MLA)-assisted MCM also improves image resolution through the magnified virtual image of MLA. The MLA-assisted MCM successfully provides a clear, magnified image by integrating a pinhole mask to prevent image overlap without additional alignment. The magnification of MLA-assisted MCM was increased by 3.92 times compared with that of MCM, and the higher magnification mode demonstrates the image resolution of 2.46 μm. The compact portable microscope can provide a new platform for defect inspection or disease detection on site.
Collapse
|
16
|
Zhang L, Zhan H, Liu X, Xing F, You Z. A wide-field and high-resolution lensless compound eye microsystem for real-time target motion perception. MICROSYSTEMS & NANOENGINEERING 2022; 8:83. [PMID: 35874173 PMCID: PMC9304386 DOI: 10.1038/s41378-022-00388-w] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/08/2022] [Accepted: 04/11/2022] [Indexed: 06/15/2023]
Abstract
Optical measurement systems suffer from a fundamental tradeoff between the field of view (FOV), the resolution and the update rate. A compound eye has the advantages of a wide FOV, high update rate and high sensitivity to motion, providing inspiration for breaking through the constraint and realizing high-performance optical systems. However, most existing studies on artificial compound eyes are limited by complex structure and low resolution, and they focus on imaging instead of precise measurement. Here, a high-performance lensless compound eye microsystem is developed to realize target motion perception through precise and fast orientation measurement. The microsystem splices multiple sub-FOVs formed by long-focal subeyes, images targets distributed in a panoramic range into a single multiplexing image sensor, and codes the subeye aperture array for distinguishing the targets from different sub-FOVs. A wide-field and high resolution are simultaneously realized in a simple and easy-to-manufacture microelectromechanical system (MEMS) aperture array. Moreover, based on the electronic rolling shutter technique of the image sensor, a hyperframe update rate is achieved by the precise measurement of multiple time-shifted spots of one target. The microsystem achieves an orientation measurement accuracy of 0.0023° (3σ) in the x direction and 0.0028° (3σ) in the y direction in a cone FOV of 120° with an update rate ~20 times higher than the frame rate. This study provides a promising approach for achieving optical measurements with comprehensive high performance and may have great significance in various applications, such as vision-controlled directional navigation and high-dynamic target tracking, formation and obstacle avoidance of unmanned aerial vehicles.
Collapse
Affiliation(s)
- Li Zhang
- Department of Precision Instrument, Tsinghua University, Beijing, 100084 China
- State Key Laboratory of Precision Measurement Technology and Instrument, Tsinghua University, Beijing, 100084 China
- Beijing Advanced Innovation Center for Integrated Circuits, Beijing, 100084 China
| | - Haiyang Zhan
- Department of Precision Instrument, Tsinghua University, Beijing, 100084 China
- State Key Laboratory of Precision Measurement Technology and Instrument, Tsinghua University, Beijing, 100084 China
- Beijing Advanced Innovation Center for Integrated Circuits, Beijing, 100084 China
| | - Xinyuan Liu
- Department of Precision Instrument, Tsinghua University, Beijing, 100084 China
- State Key Laboratory of Precision Measurement Technology and Instrument, Tsinghua University, Beijing, 100084 China
- Beijing Advanced Innovation Center for Integrated Circuits, Beijing, 100084 China
| | - Fei Xing
- Department of Precision Instrument, Tsinghua University, Beijing, 100084 China
- State Key Laboratory of Precision Measurement Technology and Instrument, Tsinghua University, Beijing, 100084 China
- Beijing Advanced Innovation Center for Integrated Circuits, Beijing, 100084 China
| | - Zheng You
- Department of Precision Instrument, Tsinghua University, Beijing, 100084 China
- State Key Laboratory of Precision Measurement Technology and Instrument, Tsinghua University, Beijing, 100084 China
- Beijing Advanced Innovation Center for Integrated Circuits, Beijing, 100084 China
| |
Collapse
|
17
|
Zhang S, Wu Q, Liu C, Wang T, Zhang H, Wang J, Ding Y, Chi J, Xu W, Xiang Y, Shi C. Bio-inspired spherical compound eye camera for simultaneous wide-band and large field of view imaging. OPTICS EXPRESS 2022; 30:20952-20962. [PMID: 36224828 DOI: 10.1364/oe.454530] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Accepted: 05/11/2022] [Indexed: 06/16/2023]
Abstract
Natural compound eyes have excellent optical characteristics, namely large field of view, small size, no aberration, and sensitive to motion. Some arthropods have more powerful vision. For example, the Morpho butterfly's compound eyes can perceive the near-infrared and ultraviolet light that the human eye cannot see. This wide-band imaging with a large field of view has great potential in wide-area surveillance, all-weather panoramic imaging, and medical imaging. Hence, a wide-band spherical compound eye camera inspired by the Morpho butterfly's eye was proposed. The wide-band spherical compound eye camera which can achieve a large field of view (360° × 171°) imaging over a wide range of wavelengths from 400nm to 1000nm, mainly consists of three parts: a wide-band spherical compound eye with 234 sub-eyes for light collection, a wide-band optical relay system for light transmission, and a wide-band CMOS image sensor for photoelectric conversion. Our experimental results show that the wide-band spherical compound eye camera not only captures a large field of view without anomalous blurring or aberrations but also perceives near-infrared light that is not recognized by the human eye. These features make it possible for distortion-free panoramic vision and panoramic medical diagnosis.
Collapse
|
18
|
A Comprehensive Review of Methods and Equipment for Aiding Automatic Glaucoma Tracking. Diagnostics (Basel) 2022; 12:diagnostics12040935. [PMID: 35453985 PMCID: PMC9031684 DOI: 10.3390/diagnostics12040935] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2022] [Revised: 04/05/2022] [Accepted: 04/07/2022] [Indexed: 02/01/2023] Open
Abstract
Glaucoma is a chronic optic neuropathy characterized by irreversible damage to the retinal nerve fiber layer (RNFL), resulting in changes in the visual field (VC). Glaucoma screening is performed through a complete ophthalmological examination, using images of the optic papilla obtained in vivo for the evaluation of glaucomatous characteristics, eye pressure, and visual field. Identifying the glaucomatous papilla is quite important, as optical papillary images are considered the gold standard for tracking. Therefore, this article presents a review of the diagnostic methods used to identify the glaucomatous papilla through technology over the last five years. Based on the analyzed works, the current state-of-the-art methods are identified, the current challenges are analyzed, and the shortcomings of these methods are investigated, especially from the point of view of automation and independence in performing these measurements. Finally, the topics for future work and the challenges that need to be solved are proposed.
Collapse
|
19
|
Toulouse A, Drozella J, Motzfeld P, Fahrbach N, Aslani V, Thiele S, Giessen H, Herkommer AM. Ultra-compact 3D-printed wide-angle cameras realized by multi-aperture freeform optical design. OPTICS EXPRESS 2022; 30:707-720. [PMID: 35209256 DOI: 10.1364/oe.439963] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/09/2021] [Accepted: 11/07/2021] [Indexed: 06/14/2023]
Abstract
Simultaneous realization of ultra-large field of view (FOV), large lateral image size, and a small form factor is one of the challenges in imaging lens design and fabrication. All combined this yields an extensive flow of information while conserving ease of integration where space is limited. Here, we present concepts, correction methods and realizations towards freeform multi-aperture wide-angle cameras fabricated by femtosecond direct laser writing (fsDLW). The 3D printing process gives us the design freedom to create 180° × 360° cameras with a flat form factor in the micrometer range by splitting the FOV into several apertures. Highly tilted and decentered non-rotational lens shapes as well as catadioptric elements are used in the optical design to map the FOV onto a flat surface in a Scheimpflug manner. We present methods to measure and correct freeform surfaces with up to 180° surface normals by confocal measurements, and iterative fabrication via fsDLW. Finally, approaches for digital distortion correction and image stitching are demonstrated and two realizations of freeform multi-aperture wide-angle cameras are presented.
Collapse
|
20
|
Yi J, Baek C, Kim J, Koo K, Seo J. Fabrication of a light screen-aperture integrated flexible thin film micro-lens array for a biomimetic superposition compound eye. OPTICS EXPRESS 2021; 29:39214-39226. [PMID: 34809290 DOI: 10.1364/oe.442774] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/12/2021] [Accepted: 10/27/2021] [Indexed: 06/13/2023]
Abstract
Micro-lens array, an artificial compound eye vision system, provides a wide field of view and multi-perspective view. However, it has not been adopted as a computer vision application due to its limited visible range and high optical interference. In this research, a novel fabrication method for the flexible polydimethylsiloxane micro-lens array with a polytetrafluoroethylene light screen-aperture integrated layer was established by the simple protrusion method. The integrated layer provided longer visible range by one meter while maintaining the wide field-of-view of 100 °. The resulting images were used for obtaining depth information of a target as an example and for analyzing the rectangular and hexagonal arrangements of the micro-lenses for the future applications. With the improved visual range, wide field-of-view and flexibility, the fabricated micro-lens array can be applied to the small and curved CMOS image sensors in the future.
Collapse
|
21
|
Zhang Y, Chen X, Wang MY, Yu H. Multidimensional Tactile Sensor with a Thin Compound Eye-Inspired Imaging System. Soft Robot 2021; 9:861-870. [PMID: 34619070 DOI: 10.1089/soro.2020.0202] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Artificial tactile sensing for robots is a counterpart to the human sense of touch, serving as a feedback interface for sensing and interacting with the environment. A vision-based tactile sensor has emerged as a novel and advantageous branch of artificial tactile sensors. Compared with conventional tactile sensors, vision-based tactile sensors possess stronger potential thanks to acquiring multimodal contact information in much higher spatial resolution, although they typically suffer from bulky size and fabrication challenges. In this article, we report a thin vision-based tactile sensor that draws inspiration from natural compound eye structures and demonstrate its capability of sensing three-dimensional (3D) force. The sensor is composed of an array of vision units, an elastic touching interface, and a supporting structure with illumination. Experiments validated the sensor's advantages, including competitive spatial resolution of deformation as high as 1016 dpi on a 5 × 8 mm2 sensing area, superior accuracy of 3D force measurement at levels of 0.018 N for tangential force and 0.213 N (0.108 N at the center region) for normal force, and real-time processing at 30 Hz, while achieving a thin size of 5 mm. We further demonstrate the sensor capability in sensing 3D force and slip occurrence in real grasping experiments. This device paves the way for robotic applications that require rich tactile information with miniaturized sensor structure.
Collapse
Affiliation(s)
- Yazhan Zhang
- Department of Mechanical and Aerospace Engineering and Hong Kong University of Science and Technology, Hong Kong, Hong Kong
| | - Xia Chen
- Department of Mechanical and Aerospace Engineering and Hong Kong University of Science and Technology, Hong Kong, Hong Kong
| | - Michael Yu Wang
- Department of Mechanical and Aerospace Engineering and Hong Kong University of Science and Technology, Hong Kong, Hong Kong.,Department of Electronic and Computer Engineering, Hong Kong University of Science and Technology, Hong Kong, Hong Kong
| | - Hongyu Yu
- Department of Mechanical and Aerospace Engineering and Hong Kong University of Science and Technology, Hong Kong, Hong Kong
| |
Collapse
|
22
|
Artificial Compound Eye Systems and Their Application: A Review. MICROMACHINES 2021; 12:mi12070847. [PMID: 34357257 PMCID: PMC8307767 DOI: 10.3390/mi12070847] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/27/2021] [Revised: 07/08/2021] [Accepted: 07/15/2021] [Indexed: 12/24/2022]
Abstract
The natural compound eye system has many outstanding properties, such as a more compact size, wider-angle view, better capacity to detect moving objects, and higher sensitivity to light intensity, compared to that of a single-aperture vision system. Thanks to the development of micro- and nano-fabrication techniques, many artificial compound eye imaging systems have been studied and fabricated to inherit fascinating optical features of the natural compound eye. This paper provides a review of artificial compound eye imaging systems. This review begins by introducing the principle of the natural compound eye, and then, the analysis of two types of artificial compound eye systems. We equally present the applications of the artificial compound eye imaging systems. Finally, we suggest our outlooks about the artificial compound eye imaging system.
Collapse
|
23
|
Kim K, Jang KW, Bae SI, Kim HK, Cha Y, Ryu JK, Jo YJ, Jeong KH. Ultrathin arrayed camera for high-contrast near-infrared imaging. OPTICS EXPRESS 2021; 29:1333-1339. [PMID: 33726351 DOI: 10.1364/oe.409472] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/07/2020] [Accepted: 12/22/2020] [Indexed: 06/12/2023]
Abstract
We report an ultrathin arrayed camera (UAC) for high-contrast near infrared (NIR) imaging by using microlens arrays with a multilayered light absorber. The UAC consists of a multilayered composite light absorber, inverted microlenses, gap-alumina spacers and a planar CMOS image sensor. The multilayered light absorber was fabricated through lift-off and repeated photolithography processes. The experimental results demonstrate that the image contrast is increased by 4.48 times and the MTF 50 is increased by 2.03 times by eliminating optical noise between microlenses through the light absorber. The NIR imaging of UAC successfully allows distinguishing the security strip of authentic bill and the blood vessel of finger. The ultrathin camera offers a new route for diverse applications in biometric, surveillance, and biomedical imaging.
Collapse
|
24
|
Liu C, Shi C, Wang T, Zhang H, Jing L, Jin X, Xu J, Wang H. Bio-inspired multimodal 3D endoscope for image-guided and robotic surgery. OPTICS EXPRESS 2021; 29:145-157. [PMID: 33362105 DOI: 10.1364/oe.410424] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/17/2020] [Accepted: 11/19/2020] [Indexed: 06/12/2023]
Abstract
Image-guided and robotic surgery based on endoscopic imaging technologies can enhance cancer treatment by ideally removing all cancerous tissue and avoiding iatrogenic damage to healthy tissue. Surgeons evaluate the tumor margins at the cost of impeding surgical workflow or working with dimmed surgical illumination, since current endoscopic imaging systems cannot simultaneous and real-time color and near-infrared (NIR) fluorescence imaging under normal surgical illumination. To overcome this problem, a bio-inspired multimodal 3D endoscope combining the excellent characteristics of human eyes and compound eyes of mantis shrimp is proposed. This 3D endoscope, which achieves simultaneous and real-time imaging of three-dimensional stereoscopic, color, and NIR fluorescence, consists of three parts: a broad-band binocular optical system like as human eye, an optical relay system, and a multiband sensor inspired by the mantis shrimp's compound eye. By introducing an optical relay system, the two sub-images after the broad-band binocular optical system can be projected onto one and the same multiband sensor. A series of experiments demonstrate that this bio-inspired multimodal 3D endoscope not only provides surgeons with real-time feedback on the location of tumor tissue and lymph nodes but also creates an immersive experience for surgeons without impeding surgical workflow. Its excellent characteristics and good scalability can promote the further development and application of image-guided and robotic surgery.
Collapse
|
25
|
Miniaturized 3D Depth Sensing-Based Smartphone Light Field Camera. SENSORS 2020; 20:s20072129. [PMID: 32283826 PMCID: PMC7181038 DOI: 10.3390/s20072129] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/25/2020] [Revised: 04/01/2020] [Accepted: 04/07/2020] [Indexed: 11/22/2022]
Abstract
The miniaturization of 3D depth camera systems to reduce cost and power consumption is essential for their application in electrical devices that are trending toward smaller sizes (such as smartphones and unmanned aerial systems) and in other applications that cannot be realized via conventional approaches. Currently, equipment exists for a wide range of depth-sensing devices, including stereo vision, structured light, and time-of-flight. This paper reports on a miniaturized 3D depth camera based on a light field camera (LFC) configured with a single aperture and a micro-lens array (MLA). The single aperture and each micro-lens of the MLA serve as multi-camera systems for 3D surface imaging. To overcome the optical alignment challenge in the miniaturized LFC system, the MLA was designed to focus by attaching it to an image sensor. Theoretical analysis of the optical parameters was performed using optical simulation based on Monte Carlo ray tracing to find the valid optical parameters for miniaturized 3D camera systems. Moreover, we demonstrated multi-viewpoint image acquisition via a miniaturized 3D camera module integrated into a smartphone.
Collapse
|