Image formation by a biological curved mirror array of the fisheye in the deep-sea environment

Inspiration from Visual Ecology for Advancing Multifunctional Robotic Vision Systems: Bio-inspired Electronic Eyes and Neuromorphic Image Sensors

In robotics, particularly for autonomous navigation and human-robot collaboration, the significance of unconventional imaging techniques and efficient data processing capabilities is paramount. The unstructured environments encountered by robots, coupled with complex missions assigned to them, present numerous challenges necessitating diverse visual functionalities, and consequently, the development of multifunctional robotic vision systems has become indispensable. Meanwhile, rich diversity inherent in animal vision systems, honed over evolutionary epochs to meet their survival demands across varied habitats, serves as a profound source of inspirations. Here, recent advancements in multifunctional robotic vision systems drawing inspiration from natural ocular structures and their visual perception mechanisms are delineated. First, unique imaging functionalities of natural eyes across terrestrial, aerial, and aquatic habitats and visual signal processing mechanism of humans are explored. Then, designs and functionalities of bio-inspired electronic eyes are explored, engineered to mimic key components and underlying optical principles of natural eyes. Furthermore, neuromorphic image sensors are discussed, emulating functional properties of synapses, neurons, and retinas and thereby enhancing accuracy and efficiency of robotic vision tasks. Next, integration examples of electronic eyes with mobile robotic/biological systems are introduced. Finally, a forward-looking outlook on the development of bio-inspired electronic eyes and neuromorphic image sensors is provided.

Advanced visual components inspired by animal eyes

Artificial vision systems pervade our daily lives as a foremost sensing apparatus in various digital technologies, from smartphones to autonomous cars and robotics. The broad range of applications for conventional vision systems requires facile adaptation under extreme and dynamic visual environments. However, these current needs have complicated individual visual components for high-quality image acquisition and processing, which indeed leads to a decline in efficiency in the overall system. Here, we review recent advancements in visual components for high-performance visual processing based on strategies of biological eyes that execute diverse imaging functionalities and sophisticated visual processes with simple and concise ocular structures. This review first covers the structures and functions of biological eyes (i.e., single-lens eyes and compound eyes), which contain micro-optic components and nanophotonic structures. After that, we focus on their inspirations in imaging optics/photonics, light-trapping and filtering components, and retinomorphic devices. We discuss the remaining challenges and notable biological structures waiting to be implemented.

A forgotten element of the blue economy: marine biomimetics and inspiration from the deep sea

The morphology, physiology, and behavior of marine organisms have been a valuable source of inspiration for solving conceptual and design problems. Here, we introduce this rich and rapidly expanding field of marine biomimetics, and identify it as a poorly articulated and often overlooked element of the ocean economy associated with substantial monetary benefits. We showcase innovations across seven broad categories of marine biomimetic design (adhesion, antifouling, armor, buoyancy, movement, sensory, stealth), and use this framing as context for a closer consideration of the increasingly frequent focus on deep-sea life as an inspiration for biomimetic design. We contend that marine biomimetics is not only a "forgotten" sector of the ocean economy, but has the potential to drive appreciation of nonmonetary values, conservation, and stewardship, making it well-aligned with notions of a sustainable blue economy. We note, however, that the highest ambitions for a blue economy are that it not only drives sustainability, but also greater equity and inclusivity, and conclude by articulating challenges and considerations for bringing marine biomimetics onto this trajectory.