1
|
Feng X, Liu Y, Dong J, Yu Y, Xing Y, Shu F, Peng L, Wu Y. A Meniscus Multifocusing Compound Eye Camera Based on Negative Pressure Forming Technology. MICROMACHINES 2023; 14:420. [PMID: 36838120 PMCID: PMC9962903 DOI: 10.3390/mi14020420] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/02/2022] [Revised: 01/12/2023] [Accepted: 02/08/2023] [Indexed: 06/18/2023]
Abstract
To meet the challenge of preparing a high-resolution compound eye, this paper proposes a multi-focal-length meniscus compound eye based on MEMS negative pressure molding technology. The aperture is increased, a large field of view angle of 101.14° is obtained, and the ommatidia radius of each stage is gradually increased from 250 μm to 440 μm. A meniscus structure is used to improve the imaging quality of the marginal compound eye so that its resolution can reach 36.00 lp/mm. The prepared microlenses have a uniform shape and a smooth surface, and both panoramic image stitching and moving object tracking are achieved. This technology has great potential for application in many fields, including automatic driving, machine vision, and medical endoscopy.
Collapse
Affiliation(s)
- Xin Feng
- Changchun Institute of Optics, Fine Mechanics and Physics (CIOMP), Chinese Academy of Sciences, Changchun 130033, China
- University of Chinese Academy of Sciences, Beijing 100039, China
| | - Yongshun Liu
- Changchun Institute of Optics, Fine Mechanics and Physics (CIOMP), Chinese Academy of Sciences, Changchun 130033, China
| | - Junyu Dong
- Changchun Institute of Optics, Fine Mechanics and Physics (CIOMP), Chinese Academy of Sciences, Changchun 130033, China
| | - Yongjian Yu
- Changchun Institute of Optics, Fine Mechanics and Physics (CIOMP), Chinese Academy of Sciences, Changchun 130033, China
- School of Ophthalmology and Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou 325035, China
| | - Yi Xing
- Changchun Institute of Optics, Fine Mechanics and Physics (CIOMP), Chinese Academy of Sciences, Changchun 130033, China
- University of Chinese Academy of Sciences, Beijing 100039, China
| | - Fengfeng Shu
- Changchun Institute of Optics, Fine Mechanics and Physics (CIOMP), Chinese Academy of Sciences, Changchun 130033, China
| | - Lanxin Peng
- Changchun Institute of Optics, Fine Mechanics and Physics (CIOMP), Chinese Academy of Sciences, Changchun 130033, China
- University of Chinese Academy of Sciences, Beijing 100039, China
| | - Yihui Wu
- Changchun Institute of Optics, Fine Mechanics and Physics (CIOMP), Chinese Academy of Sciences, Changchun 130033, China
| |
Collapse
|
2
|
Abstract
This paper presents a two-dimensional mathematical model of compound eye vision. Such a model is useful for solving navigation issues for autonomous mobile robots on the ground plane. The model is inspired by the insect compound eye that consists of ommatidia, which are tiny independent photoreception units, each of which combines a cornea, lens, and rhabdom. The model describes the planar binocular compound eye vision, focusing on measuring distance and azimuth to a circular feature with an arbitrary size. The model provides a necessary and sufficient condition for the visibility of a circular feature by each ommatidium. On this basis, an algorithm is built for generating a training data set to create two deep neural networks (DNN): the first detects the distance, and the second detects the azimuth to a circular feature. The hyperparameter tuning and the configurations of both networks are described. Experimental results showed that the proposed method could effectively and accurately detect the distance and azimuth to objects.
Collapse
|
3
|
Biomimetic apposition compound eye fabricated using microfluidic-assisted 3D printing. Nat Commun 2021; 12:6458. [PMID: 34753909 PMCID: PMC8578215 DOI: 10.1038/s41467-021-26606-z] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2020] [Accepted: 09/13/2021] [Indexed: 11/29/2022] Open
Abstract
After half a billion years of evolution, arthropods have developed sophisticated compound eyes with extraordinary visual capabilities that have inspired the development of artificial compound eyes. However, the limited 2D nature of most traditional fabrication techniques makes it challenging to directly replicate these natural systems. Here, we present a biomimetic apposition compound eye fabricated using a microfluidic-assisted 3D-printing technique. Each microlens is connected to the bottom planar surface of the eye via intracorporal, zero-crosstalk refractive-index-matched waveguides to mimic the rhabdoms of a natural eye. Full-colour wide-angle panoramic views and position tracking of a point source are realized by placing the fabricated eye directly on top of a commercial imaging sensor. As a biomimetic analogue to naturally occurring compound eyes, the eye's full-colour 3D to 2D mapping capability has the potential to enable a wide variety of applications from improving endoscopic imaging to enhancing machine vision for facilitating human-robot interactions.
Collapse
|
4
|
Cheng Y, Cao J, Zhang Y, Hao Q. Review of state-of-the-art artificial compound eye imaging systems. BIOINSPIRATION & BIOMIMETICS 2019; 14:031002. [PMID: 30654337 DOI: 10.1088/1748-3190/aaffb5] [Citation(s) in RCA: 34] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
The natural compound eye has received much attention in recent years due to its remarkable properties, such as its large field of view (FOV), compact structure, and high sensitivity to moving objects. Many studies have been devoted to mimicking the imaging system of the natural compound eye. The paper gives a review of state-of-the-art artificial compound eye imaging systems. Firstly, we introduce the imaging principle of three types of natural compound eye. Then, we divide current artificial compound eye imaging systems into four categories according to the difference of structural composition. Readers can easily grasp methods to build an artificial compound eye imaging system from the perspective of structural composition. Moreover, we compare the imaging performance of state-of-the-art artificial compound eye imaging systems, which provides a reference for readers to design system parameters of an artificial compound eye imaging system. Next, we present the applications of the artificial compound eye imaging system including imaging with a large FOV, imaging with high resolution, object distance detection, medical imaging, egomotion estimation, and navigation. Finally, an outlook of the artificial compound eye imaging system is highlighted.
Collapse
Affiliation(s)
- Yang Cheng
- Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, Beijing Institute of Technology, Beijing, People's Republic of China
| | | | | | | |
Collapse
|
5
|
Iida F, Nurzaman SG. Adaptation of sensor morphology: an integrative view of perception from biologically inspired robotics perspective. Interface Focus 2016; 6:20160016. [PMID: 27499843 DOI: 10.1098/rsfs.2016.0016] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022] Open
Abstract
Sensor morphology, the morphology of a sensing mechanism which plays a role of shaping the desired response from physical stimuli from surroundings to generate signals usable as sensory information, is one of the key common aspects of sensing processes. This paper presents a structured review of researches on bioinspired sensor morphology implemented in robotic systems, and discusses the fundamental design principles. Based on literature review, we propose two key arguments: first, owing to its synthetic nature, biologically inspired robotics approach is a unique and powerful methodology to understand the role of sensor morphology and how it can evolve and adapt to its task and environment. Second, a consideration of an integrative view of perception by looking into multidisciplinary and overarching mechanisms of sensor morphology adaptation across biology and engineering enables us to extract relevant design principles that are important to extend our understanding of the unfinished concepts in sensing and perception.
Collapse
Affiliation(s)
- Fumiya Iida
- Biologically Inspired Robotics Laboratory, Department of Engineering , University of Cambridge , Tumpington Street, Cambridge CB2 1PZ , UK
| | - Surya G Nurzaman
- Mechanical Engineering Discipline, School of Engineering , Malaysia Campus, Monash University, Jl. Lagoon Selatan, Bandar Sunway 47500 , Malaysia
| |
Collapse
|
6
|
Kuo WK, Kuo GF, Lin SY, Yu HH. Fabrication and characterization of artificial miniaturized insect compound eyes for imaging. BIOINSPIRATION & BIOMIMETICS 2015; 10:056010. [PMID: 26414303 DOI: 10.1088/1748-3190/10/5/056010] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Polystyrene (PS) microspheres are synthesized by dispersion polymerization, and a close-packed two-dimensional (2D) array of the PS microspheres is formed by the self-assembly method through dip drawing under magnetic stirring. This array is then used to fabricate a 2D polydimethylsiloxane concave mold by soft lithography. The mold is employed to produce convex polymethylmethacrylate-based compound eye-replicating films of different hemispherical heights by thermopressing. The optical properties of the ommatidia on these biomimetic compound eye-replicating films are investigated, and the films are used with a charge-coupled device camera to construct a biomimetic visual system. The visual distance and field of view of this system are measured. The film with the greatest hemispherical height results in the biomimetic visual system with the highest visual distance and the widest field of view. In addition, it is found that the quality of the optical images is not dependent on the hemispherical height of the biomimetic films. The ability of the biomimetic visual system to detect moving object in real time is also studied.
Collapse
Affiliation(s)
- Wen-Kai Kuo
- Institute of Electro-Optical and Materials Science
| | | | | | | |
Collapse
|
7
|
Colonnier F, Manecy A, Juston R, Mallot H, Leitel R, Floreano D, Viollet S. A small-scale hyperacute compound eye featuring active eye tremor: application to visual stabilization, target tracking, and short-range odometry. BIOINSPIRATION & BIOMIMETICS 2015; 10:026002. [PMID: 25712307 DOI: 10.1088/1748-3190/10/2/026002] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
In this study, a miniature artificial compound eye (15 mm in diameter) called the curved artificial compound eye (CurvACE) was endowed for the first time with hyperacuity, using similar micro-movements to those occurring in the fly's compound eye. A periodic micro-scanning movement of only a few degrees enables the vibrating compound eye to locate contrasting objects with a 40-fold greater resolution than that imposed by the interommatidial angle. In this study, we developed a new algorithm merging the output of 35 local processing units consisting of adjacent pairs of artificial ommatidia. The local measurements performed by each pair are processed in parallel with very few computational resources, which makes it possible to reach a high refresh rate of 500 Hz. An aerial robotic platform with two degrees of freedom equipped with the active CurvACE placed over naturally textured panels was able to assess its linear position accurately with respect to the environment thanks to its efficient gaze stabilization system. The algorithm was found to perform robustly at different light conditions as well as distance variations relative to the ground and featured small closed-loop positioning errors of the robot in the range of 45 mm. In addition, three tasks of interest were performed without having to change the algorithm: short-range odometry, visual stabilization, and tracking contrasting objects (hands) moving over a textured background.
Collapse
Affiliation(s)
- Fabien Colonnier
- Aix-Marseille Université, CNRS, ISM UMR 7287, 13288, Marseille cedex 09, France
| | | | | | | | | | | | | |
Collapse
|
8
|
Yue S, Rind FC. Postsynaptic organisations of directional selective visual neural networks for collision detection. Neurocomputing 2013. [DOI: 10.1016/j.neucom.2012.08.027] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|