1
|
Cheng Y, Cao J, Zhang Y, Hao Q. Review of state-of-the-art artificial compound eye imaging systems. BIOINSPIRATION & BIOMIMETICS 2019; 14:031002. [PMID: 30654337 DOI: 10.1088/1748-3190/aaffb5] [Citation(s) in RCA: 34] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
The natural compound eye has received much attention in recent years due to its remarkable properties, such as its large field of view (FOV), compact structure, and high sensitivity to moving objects. Many studies have been devoted to mimicking the imaging system of the natural compound eye. The paper gives a review of state-of-the-art artificial compound eye imaging systems. Firstly, we introduce the imaging principle of three types of natural compound eye. Then, we divide current artificial compound eye imaging systems into four categories according to the difference of structural composition. Readers can easily grasp methods to build an artificial compound eye imaging system from the perspective of structural composition. Moreover, we compare the imaging performance of state-of-the-art artificial compound eye imaging systems, which provides a reference for readers to design system parameters of an artificial compound eye imaging system. Next, we present the applications of the artificial compound eye imaging system including imaging with a large FOV, imaging with high resolution, object distance detection, medical imaging, egomotion estimation, and navigation. Finally, an outlook of the artificial compound eye imaging system is highlighted.
Collapse
Affiliation(s)
- Yang Cheng
- Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, Beijing Institute of Technology, Beijing, People's Republic of China
| | | | | | | |
Collapse
|
2
|
Kuo WK, Kuo GF, Lin SY, Yu HH. Fabrication and characterization of artificial miniaturized insect compound eyes for imaging. BIOINSPIRATION & BIOMIMETICS 2015; 10:056010. [PMID: 26414303 DOI: 10.1088/1748-3190/10/5/056010] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Polystyrene (PS) microspheres are synthesized by dispersion polymerization, and a close-packed two-dimensional (2D) array of the PS microspheres is formed by the self-assembly method through dip drawing under magnetic stirring. This array is then used to fabricate a 2D polydimethylsiloxane concave mold by soft lithography. The mold is employed to produce convex polymethylmethacrylate-based compound eye-replicating films of different hemispherical heights by thermopressing. The optical properties of the ommatidia on these biomimetic compound eye-replicating films are investigated, and the films are used with a charge-coupled device camera to construct a biomimetic visual system. The visual distance and field of view of this system are measured. The film with the greatest hemispherical height results in the biomimetic visual system with the highest visual distance and the widest field of view. In addition, it is found that the quality of the optical images is not dependent on the hemispherical height of the biomimetic films. The ability of the biomimetic visual system to detect moving object in real time is also studied.
Collapse
Affiliation(s)
- Wen-Kai Kuo
- Institute of Electro-Optical and Materials Science
| | | | | | | |
Collapse
|
3
|
Colonnier F, Manecy A, Juston R, Mallot H, Leitel R, Floreano D, Viollet S. A small-scale hyperacute compound eye featuring active eye tremor: application to visual stabilization, target tracking, and short-range odometry. BIOINSPIRATION & BIOMIMETICS 2015; 10:026002. [PMID: 25712307 DOI: 10.1088/1748-3190/10/2/026002] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
In this study, a miniature artificial compound eye (15 mm in diameter) called the curved artificial compound eye (CurvACE) was endowed for the first time with hyperacuity, using similar micro-movements to those occurring in the fly's compound eye. A periodic micro-scanning movement of only a few degrees enables the vibrating compound eye to locate contrasting objects with a 40-fold greater resolution than that imposed by the interommatidial angle. In this study, we developed a new algorithm merging the output of 35 local processing units consisting of adjacent pairs of artificial ommatidia. The local measurements performed by each pair are processed in parallel with very few computational resources, which makes it possible to reach a high refresh rate of 500 Hz. An aerial robotic platform with two degrees of freedom equipped with the active CurvACE placed over naturally textured panels was able to assess its linear position accurately with respect to the environment thanks to its efficient gaze stabilization system. The algorithm was found to perform robustly at different light conditions as well as distance variations relative to the ground and featured small closed-loop positioning errors of the robot in the range of 45 mm. In addition, three tasks of interest were performed without having to change the algorithm: short-range odometry, visual stabilization, and tracking contrasting objects (hands) moving over a textured background.
Collapse
Affiliation(s)
- Fabien Colonnier
- Aix-Marseille Université, CNRS, ISM UMR 7287, 13288, Marseille cedex 09, France
| | | | | | | | | | | | | |
Collapse
|
4
|
Viollet S, Godiot S, Leitel R, Buss W, Breugnon P, Menouni M, Juston R, Expert F, Colonnier F, L'Eplattenier G, Brückner A, Kraze F, Mallot H, Franceschini N, Pericet-Camara R, Ruffier F, Floreano D. Hardware architecture and cutting-edge assembly process of a tiny curved compound eye. SENSORS 2014; 14:21702-21. [PMID: 25407908 PMCID: PMC4279557 DOI: 10.3390/s141121702] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/02/2014] [Revised: 11/07/2014] [Accepted: 11/10/2014] [Indexed: 11/25/2022]
Abstract
The demand for bendable sensors increases constantly in the challenging field of soft and micro-scale robotics. We present here, in more detail, the flexible, functional, insect-inspired curved artificial compound eye (CurvACE) that was previously introduced in the Proceedings of the National Academy of Sciences (PNAS, 2013). This cylindrically-bent sensor with a large panoramic field-of-view of 180° × 60° composed of 630 artificial ommatidia weighs only 1.75 g, is extremely compact and power-lean (0.9 W), while it achieves unique visual motion sensing performance (1950 frames per second) in a five-decade range of illuminance. In particular, this paper details the innovative Very Large Scale Integration (VLSI) sensing layout, the accurate assembly fabrication process, the innovative, new fast read-out interface, as well as the auto-adaptive dynamic response of the CurvACE sensor. Starting from photodetectors and microoptics on wafer substrates and flexible printed circuit board, the complete assembly of CurvACE was performed in a planar configuration, ensuring high alignment accuracy and compatibility with state-of-the art assembling processes. The characteristics of the photodetector of one artificial ommatidium have been assessed in terms of their dynamic response to light steps. We also characterized the local auto-adaptability of CurvACE photodetectors in response to large illuminance changes: this feature will certainly be of great interest for future applications in real indoor and outdoor environments.
Collapse
Affiliation(s)
- Stéphane Viollet
- Aix-Marseille Université, CNRS, UMR 7287 ISM, 13288 Marseille, France; E-Mails: (R.J.); (F.E.); (F.C.); (N.F.); (F.R.)
- Author to whom correspondence should be addressed; E-Mail: ; Tel.: +33-491-828-368; Fax: +33-491-828-375
| | - Stéphanie Godiot
- Aix-Marseille Université, CNRS, UMR 7346 CPPM, 13288 Marseille, France; E-Mails: (S.G.); (P.B.); (M.M.)
| | - Robert Leitel
- Fraunhofer Institute for Applied Optics and Precision Engineering, 07745 Jena, Germany; E-Mails: (R.L.); (W.B.); (A.B.); (F.K.)
| | - Wolfgang Buss
- Fraunhofer Institute for Applied Optics and Precision Engineering, 07745 Jena, Germany; E-Mails: (R.L.); (W.B.); (A.B.); (F.K.)
| | - Patrick Breugnon
- Aix-Marseille Université, CNRS, UMR 7346 CPPM, 13288 Marseille, France; E-Mails: (S.G.); (P.B.); (M.M.)
| | - Mohsine Menouni
- Aix-Marseille Université, CNRS, UMR 7346 CPPM, 13288 Marseille, France; E-Mails: (S.G.); (P.B.); (M.M.)
| | - Raphaël Juston
- Aix-Marseille Université, CNRS, UMR 7287 ISM, 13288 Marseille, France; E-Mails: (R.J.); (F.E.); (F.C.); (N.F.); (F.R.)
| | - Fabien Expert
- Aix-Marseille Université, CNRS, UMR 7287 ISM, 13288 Marseille, France; E-Mails: (R.J.); (F.E.); (F.C.); (N.F.); (F.R.)
| | - Fabien Colonnier
- Aix-Marseille Université, CNRS, UMR 7287 ISM, 13288 Marseille, France; E-Mails: (R.J.); (F.E.); (F.C.); (N.F.); (F.R.)
| | - Géraud L'Eplattenier
- Laboratory of Intelligent Systems, École Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland; E-Mails: (G.L.E.); (R.P.-C.); (D.F.)
| | - Andreas Brückner
- Fraunhofer Institute for Applied Optics and Precision Engineering, 07745 Jena, Germany; E-Mails: (R.L.); (W.B.); (A.B.); (F.K.)
| | - Felix Kraze
- Fraunhofer Institute for Applied Optics and Precision Engineering, 07745 Jena, Germany; E-Mails: (R.L.); (W.B.); (A.B.); (F.K.)
| | - Hanspeter Mallot
- Laboratory of Cognitive Neuroscience, Department of Biology, University of Tübingen, 72076 Tübingen, Germany; E-Mail:
| | - Nicolas Franceschini
- Aix-Marseille Université, CNRS, UMR 7287 ISM, 13288 Marseille, France; E-Mails: (R.J.); (F.E.); (F.C.); (N.F.); (F.R.)
| | - Ramon Pericet-Camara
- Laboratory of Intelligent Systems, École Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland; E-Mails: (G.L.E.); (R.P.-C.); (D.F.)
| | - Franck Ruffier
- Aix-Marseille Université, CNRS, UMR 7287 ISM, 13288 Marseille, France; E-Mails: (R.J.); (F.E.); (F.C.); (N.F.); (F.R.)
| | - Dario Floreano
- Laboratory of Intelligent Systems, École Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland; E-Mails: (G.L.E.); (R.P.-C.); (D.F.)
| |
Collapse
|
5
|
Davis JD, Barrett SF, Wright CHG, Wilcox M. A bio-inspired apposition compound eye machine vision sensor system. BIOINSPIRATION & BIOMIMETICS 2009; 4:046002. [PMID: 19901450 DOI: 10.1088/1748-3182/4/4/046002] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
Abstract
The Wyoming Information, Signal Processing, and Robotics Laboratory is developing a wide variety of bio-inspired vision sensors. We are interested in exploring the vision system of various insects and adapting some of their features toward the development of specialized vision sensors. We do not attempt to supplant traditional digital imaging techniques but rather develop sensor systems tailor made for the application at hand. We envision that many applications may require a hybrid approach using conventional digital imaging techniques enhanced with bio-inspired analogue sensors. In this specific project, we investigated the apposition compound eye and its characteristics commonly found in diurnal insects and certain species of arthropods. We developed and characterized an array of apposition compound eye-type sensors and tested them on an autonomous robotic vehicle. The robot exhibits the ability to follow a pre-defined target and avoid specified obstacles using a simple control algorithm.
Collapse
Affiliation(s)
- J D Davis
- Applied Research Laboratories, University of Texas, 10000 Burnet Rd, Austin, TX 78757, USA
| | | | | | | |
Collapse
|