An Analog VLSI Chip Emulating Polarization Vision of Octopus Retina

Programmable broadband ultrathin micropolarizer based on photoalignment technology

A method for creating broadband ultrathin azo dye micropolarizers is introduced, utilizing photoalignment technology and liquid crystal polymers to organize azo dyes into a long-range ordered structure. Achievements include a 3.63 μm thick polarizer with an extinction ratio over 140 and polarization efficiency over 99.3% across 400-650 nm, 5 μm × 5 μm pixel pitch flexible ultrathin checkerboard arrays and 6 μm pixel pitch flexible ultrathin one-dimensional grating with a 0.45 duty ratio through mask exposure technology. After a substrate-transfer technique, the bending cycle test demonstrates the mechanical stability and durability of the broadband ultrathin flexible polarizers, highlighting their potential for widespread use in integrated flexible optoelectronic systems.

Biomimetic Polarized Light Navigation Sensor: A Review

A polarized light sensor is applied to the front-end detection of a biomimetic polarized light navigation system, which is an important part of analyzing the atmospheric polarization mode and realizing biomimetic polarized light navigation, having received extensive attention in recent years. In this paper, biomimetic polarized light navigation in nature, the mechanism of polarized light navigation, point source sensor, imaging sensor, and a sensor based on micro nano machining technology are compared and analyzed, which provides a basis for the optimal selection of different polarized light sensors. The comparison results show that the point source sensor can be divided into basic point source sensor with simple structure and a point source sensor applied to integrated navigation. The imaging sensor can be divided into a simple time-sharing imaging sensor, a real-time amplitude splitting sensor that can detect images of multi-directional polarization angles, a real-time aperture splitting sensor that uses a light field camera, and a real-time focal plane light splitting sensor with high integration. In recent years, with the development of micro and nano machining technology, polarized light sensors are developing towards miniaturization and integration. In view of this, this paper also summarizes the latest progress of polarized light sensors based on micro and nano machining technology. Finally, this paper summarizes the possible future prospects and current challenges of polarized light sensor design, providing a reference for the feasibility selection of different polarized light sensors.

A Biomimetic Model of Adaptive Contrast Vision Enhancement from Mantis Shrimp

Mantis shrimp have complex visual sensors, and thus, they have both color vision and polarization vision, and are adept at using polarization information for visual tasks, such as finding prey. In addition, mantis shrimp, almost unique among animals, can perform three-axis eye movements, such as pitch, yaw, and roll. With this behavior, polarization contrast in their field of view can be adjusted in real time. Inspired by this, we propose a bionic model that can adaptively enhance contrast vision. In this model, a pixel array is used to simulate a compound eye array, and the angle of polarization (AoP) is used as an adjustment mechanism. The polarization information is pre-processed by adjusting the direction of the photosensitive axis point-to-point. Experiments were performed around scenes where the color of the target and the background were similar, or the visibility of the target was low. The influence of the pre-processing model on traditional feature components of polarized light was analyzed. The results show that the model can effectively improve the contrast between the object and the background in the AoP image, enhance the significance of the object, and have important research significance for applications, such as contrast-based object detection.

Biologically inspired artificial eyes and photonics

Natural visual systems have inspired scientists and engineers to mimic their intriguing features for the development of advanced photonic devices that can provide better solutions than conventional ones. Among various kinds of natural eyes, researchers have had intensive interest in mammal eyes and compound eyes due to their advantages in optical properties such as focal length tunability, high-resolution imaging, light intensity modulation, wide field of view, high light sensitivity, and efficient light management. A variety of different approaches in the broad field of science and technology have been tried and succeeded to duplicate the functions of natural eyes and develop bioinspired photonic devices for various applications. In this review, we present a comprehensive overview of bioinspired artificial eyes and photonic devices that mimic functions of natural eyes. After we briefly introduce visual systems in nature, we discuss optical components inspired by the mammal eyes, including tunable lenses actuated with different mechanisms, curved image sensors with low aberration, and light intensity modulators. Next, compound eye inspired photonic devices are presented, such as microlenses and micromirror arrays, imaging sensor arrays on curved surfaces, self-written waveguides with microlens arrays, and antireflective nanostructures (ARS). Subsequently, compound eyes with focal length tunability, photosensitivity enhancers, and polarization imaging sensors are described.

Single step fabrication of nano scale optical devices using binary contact mask deep UV interference lithography

Interference Lithography (IL) is a powerful and inexpensive tool for large area precision nanoscale patterning of periodic structures. In this work we extend IL's capability to create features in arbitrary shapes and locations through the use of binary contact masks with wavefront division deep-UV interference lithography. Grating couplers for use in a streak measurement system and a focal plane division polarimeter are created to demonstrate the viability and versatility of the technique. Simultaneous fabrication of 90nm and 20μm features proves the potential of this process to simplify and streamline common fabrication processes in research and in industrial applications.

Polarized skylight-based heading measurements: a bio-inspired approach

Many insects such as desert ants, crickets, locusts, dung beetles, bees and monarch butterflies have been found to extract their navigation cues from the regular pattern of the linearly polarized skylight. These species are equipped with ommatidia in the dorsal rim area of their compound eyes, which are sensitive to the angle of polarization of the skylight. In the polarization-based robotic vision, most of the sensors used so far comprise high-definition CCD or CMOS cameras topped with linear polarizers. Here, we present a 2-pixel polarization-sensitive visual sensor, which was strongly inspired by the dorsal rim area of desert ants' compound eyes, designed to determine the direction of polarization of the skylight. The spectral sensitivity of this minimalistic sensor, which requires no lenses, is in the ultraviolet range. Five different methods of computing the direction of polarization were implemented and tested here. Our own methods, the extended and AntBot method, outperformed the other three, giving a mean angular error of only 0.62° ± 0.40° (median: 0.24°) and 0.69° ± 0.52° (median: 0.39°), respectively (mean ± standard deviation). The results obtained in outdoor field studies show that our celestial compass gives excellent results at a very low computational cost, which makes it highly suitable for autonomous outdoor navigation purposes.

A bio-inspired model for bidirectional polarisation detection

This study investigated a novel polarisation detection model based on the microstructure of rhabdom in mantis shrimp eyes, in which a single unit can detect two directions of orthogonal polarisation. The bionic model incorporated multi-layered orthogonal Si wire grids, and the finite-difference time-domain method was used to simulate light absorption. A single-layer Si wire grid was simulated to study the effects of thickness and duty cycle on extinction ratios. A multi-layer orthogonal wire grid was simulated to study the effects of distance between adjacent layers. The simulations revealed that the bionic model can achieve orthogonal polarisation detection. Additionally, for 600 coupled layers, the extinction ratios in both directions were greater than 60, and light absorption in the absorptive directions exceeded 96%.

Multichannel spectrometers in animals

Multispectral, hyperspectral, polarimetric, and other types of multichannel imaging spectrometers are coming into common use for a variety of applications, including remote sensing, material identification, forensics, and medical diagnosis. These instruments are often bulky and intolerant of field abuse, so designing compact, reliable, portable, and robust devices is a priority. In contrast to most engineering designs, animals have been building compact and robust multichannel imaging systems for millennia-their eyes. Biological sensors arise by evolution, of course, and are not designed 'for' a particular use; they exist because the creatures that were blessed with useful mutations were better able to survive and reproduce than their competitors. While this is an inefficient process for perfecting a sensor, it brings unexpected innovations and novel concepts into visual system design-concepts that may be useful in the inspiration of new engineered solutions to problematic challenges, like the ones mentioned above. Here, we review a diversity of multichannel visual systems from both vertebrate and invertebrate animals, considering the receptor molecules and cells, spectral sensitivity and its tuning, and some aspects of the higher-level processing systems used to shape spectral (and polarizational) channels in vision. The eyes of mantis shrimps are presented as potential models for biomimetic multichannel imaging systems. We end with a description of a bioinspired, newly developed multichannel spectral/polarimetric imaging system based on mantis shrimp vision that is highly adaptable to field application.

Full-Stokes polarization imaging method based on the self-organized grating array in fused silica

A full-Stokes polarization imaging method based on the self-organized grating array was presented. By focusing the ultra-fast laser with moderate fluence into fused silica, the self-organized grating array was fabricated, featuring the optical properties similar to wave plates. A set of four independent polarization measurements were simultaneously acquired with designed grating array mounted in the focal plane of an imaging detector. Experimental results including the device fabrication, calibration and optimization were presented. Finally, a principle verification experiment was implemented for our polarization imaging method.

Numerical study of a DoFP polarimeter based on the self-organized nanograting array

The self-organized nanograting manufactured by irradiating the transparent materials with the femtosecond laser has aroused wide interests in photonic applications in recent years. Although the mechanism of nanograting formatting has not yet been fully understood, the essential property of the optical birefringence can be precisely acquired by controlling the energy fluence of the femtosecond laser. In this paper, we proposed a novel application of the self-organized nanograting in a division-of-focal-plane polarimeter. Based on the rigid-coupled-wave algorithm, the optical characteristics of the nanograting and the polarimeter were comprehensively analyzed and discussed.

Design and Calibration of a Novel Bio-Inspired Pixelated Polarized Light Compass

Animals, such as Savannah sparrows and North American monarch butterflies, are able to obtain compass information from skylight polarization patterns to help them navigate effectively and robustly. Inspired by excellent navigation ability of animals, this paper proposes a novel image-based polarized light compass, which has the advantages of having a small size and being light weight. Firstly, the polarized light compass, which is composed of a Charge Coupled Device (CCD) camera, a pixelated polarizer array and a wide-angle lens, is introduced. Secondly, the measurement method of a skylight polarization pattern and the orientation method based on a single scattering Rayleigh model are presented. Thirdly, the error model of the sensor, mainly including the response error of CCD pixels and the installation error of the pixelated polarizer, is established. A calibration method based on iterative least squares estimation is proposed. In the outdoor environment, the skylight polarization pattern can be measured in real time by our sensor. The orientation accuracy of the sensor increases with the decrease of the solar elevation angle, and the standard deviation of orientation error is 0.15∘ at sunset. Results of outdoor experiments show that the proposed polarization navigation sensor can be used for outdoor autonomous navigation.

Bioinspired Polarization Imaging Sensors: From Circuits and Optics to Signal Processing Algorithms and Biomedical Applications: Analysis at the focal plane emulates nature's method in sensors to image and diagnose with polarized light

In this paper, we present recent work on bioinspired polarization imaging sensors and their applications in biomedicine. In particular, we focus on three different aspects of these sensors. First, we describe the electro-optical challenges in realizing a bioinspired polarization imager, and in particular, we provide a detailed description of a recent low-power complementary metal-oxide-semiconductor (CMOS) polarization imager. Second, we focus on signal processing algorithms tailored for this new class of bioinspired polarization imaging sensors, such as calibration and interpolation. Third, the emergence of these sensors has enabled rapid progress in characterizing polarization signals and environmental parameters in nature, as well as several biomedical areas, such as label-free optical neural recording, dynamic tissue strength analysis, and early diagnosis of flat cancerous lesions in a murine colorectal tumor model. We highlight results obtained from these three areas and discuss future applications for these sensors.

Patterned dual-layer achromatic micro-quarter-wave-retarder array for active polarization imaging

In this paper, we present a liquid-crystal-polymer (LCP)-based dual-layer micro-quarter-wave-retarder (MQWR) array for active polarization image sensors. The proposed MQWRs, for the first time, enable the extraction of the incident light's circularly polarized components in the whole visible regime, which correspond to the fourth parameter of Stokes vector. Compared with the previous implementations, our proposed MQWRs feature high achromaticity, making their applications no longer limited to monochromatic illumination. In addition, the presented thin structure exhibits an overall thickness of 2.43μm, leading to greatly alleviated optical cross-talk between adjacent photo-sensing pixels. Moreover, the reported superior optical performance (e.g. minor transmittance, extinction ratio) validates our optical design and optimization of the proposed MQWRs. Furthermore, the demonstrated simple fabrication recipe offers a cost-effective solution for the monolithic integration between the proposed MQWR array and the commercial solid-state image sensors, which makes the multi-spectral full Stokes polarization imaging system on a single chip feasible.

Calibration methods for division-of-focal-plane polarimeters

Division-of-focal plane (DoFP) imaging polarimeters are useful instruments for measuring polarization information for a variety of applications. Recent advances in nanofabrication have enabled the practical manufacture of DoFP sensors for the visible spectrum. These sensors are made by integrating nanowire polarization filters directly with an imaging array, and size variations of the nanowires due to fabrication can cause the optical properties of the filters to vary up to 20% across the imaging array. If left unchecked, these variations introduce significant errors when reconstructing the polarization image. Calibration methods offer a means to correct these errors. This work evaluates a scalar and matrix calibration derived from a mathematical model of the polarimeter behavior. The methods are evaluated quantitatively with an existing DoFP polarimeter under varying illumination intensity and angle of linear polarization.

Bio-inspired polarized skylight-based navigation sensors: a review

Animal senses cover a broad range of signal types and signal bandwidths and have inspired various sensors and bioinstrumentation devices for biological and medical applications. Insects, such as desert ants and honeybees, for example, utilize polarized skylight pattern-based information in their navigation activities. They reliably return to their nests and hives from places many kilometers away. The insect navigation system involves the dorsal rim area in their compound eyes and the corresponding polarization sensitive neurons in the brain. The dorsal rim area is equipped with photoreceptors, which have orthogonally arranged small hair-like structures termed microvilli. These are the specialized sensors for the detection of polarized skylight patterns (e-vector orientation). Various research groups have been working on the development of novel navigation systems inspired by polarized skylight-based navigation in animals. Their major contributions are critically reviewed. One focus of current research activities is on imitating the integration path mechanism in desert ants. The potential for simple, high performance miniaturized bioinstrumentation that can assist people in navigation will be explored.

Bilinear and bicubic interpolation methods for division of focal plane polarimeters

This paper presents bilinear and bicubic interpolation methods tailored for the division of focal plane polarization imaging sensor. The interpolation methods are targeted for a 1-Mega pixel polarization imaging sensor operating in the visible spectrum. The five interpolation methods considered in this paper are: bilinear, weighted bilinear, bicubic spline, an approximated bicubic spline and a bicubic interpolation method. The modulation transfer function analysis is applied to the different interpolation methods, and test images as well as numerical error analyses are also presented. Based on the comparison results, the full frame bicubic spline interpolation achieves the best performance for polarization images.

Fabrication of a dual-layer aluminum nanowires polarization filter array

In this paper we present a procedure for fabricating an array of micropolarization filter array via an optimized interference lithography and microfabrication procedure. The filter array is composed of two linear polarization filters offset by 45 degrees with pixel pitch of 18 microns. The individual polarization filters are composed of aluminum nanowires with 140 nm pitch, 140 nm height and 70 nm width. The maximum extinction ratio of the pixelated filters is measured to be 95 at 700 nm wavelength.

High-resolution thin "guest-host" micropolarizer arrays for visible imaging polarimetry

We report a micropolarizer array technology exploiting "guest-host" interactions in liquid crystals for visible imaging polarimetry. We demonstrate high resolution thin micropolarizer arrays with a 5 μm×5 μm pixel pitch and a thickness of 0.95 μm. With the "host" nematic liquid crystal molecules photo-aligned by sulfonic azo-dye SD1, we report averaged major principal transmittance, polarization efficiency and order parameter of 80.3%, 0.863 and 0.848, respectively across the 400 nm-700 nm visible spectrum range. The proposed fabrication technology completely removes the need for any selective etching during the fabrication/integration process of the micropolarizer array. Fully CMOS compatible, it is simple and cost-effective, requiring only spin-coating followed by a single ultraviolet-exposure through a "photoalignment master". This makes it well suited to low cost polarization imaging applications.

Signal-to-noise analysis of Stokes parameters in division of focal plane polarimeters

An analysis of the temporal noise in the Stokes parameters computed by division of focal plane polarimeters is presented. Theoretical estimations of the Stokes parameter signal-to-noise ratios for CCD polarization imaging sensors with both 4-polarizer and 2-polarizer micropolarization filter arrays are derived. The theoretical derivation is verified with measurements from an integrated polarization imaging sensor composed of a CCD imaging array and aluminum nanowire polarization filters. The measured data obtained from the CCD polarimeters matches the theoretical derivations of the temporal noise model of the Stokes parameters.

CCD polarization imaging sensor with aluminum nanowire optical filters

We report an imaging sensor capable of recording the optical properties of partially polarized light by monolithically integrating aluminum nanowire optical filters with a CCD imaging array. The imaging sensor, composed of 1000 by 1000 imaging elements with 7.4 μm pixel pitch, is covered with an array of pixel-pitch matched nanowire optical filters with four different orientations offset by 45°. The polarization imaging sensor has a signal-to-noise ratio of 45 dB and captures intensity, angle and degree of linear polarization in the visible spectrum at 40 frames per second with 300 mW of power consumption.

Dual-tier thin film polymer polarization imaging sensor

Traditional imaging systems capture and replicate the imaged environment in terms of color and intensity. One important property of light, which the human eye is blind to and is ignored by traditional imaging systems, is polarization. In this paper we present a novel, low power imaging sensor capable of recording the optical properties of partially linearly polarized light in real-time. The imaging sensor combines polymer polarization filters with a CMOS image sensor in order to compute the first three Stokes parameters at the focal plane. The imaging array contains 100 x 100 pixels and consumes 48 mW at 30 fps.

Liquid-crystal micropolarimeter array for full Stokes polarization imaging in visible spectrum

In this paper, we describe the design, modeling, fabrication, and optical characterization of the first micropolarimeter array enabling full Stokes polarization imaging in visible spectrum. The proposed micropolarimeter is fabricated by patterning a liquid-crystal (LC) layer on top of a visible-regime metal-wire-grid polarizer (MWGP) using ultraviolet sensitive sulfonic-dye-1 as the LC photoalignment material. This arrangement enables the formation of either micrometer-scale LC polarization rotators, neutral density filters or quarter wavelength retarders. These elements are in turn exploited to acquire all components of the Stokes vector, which describes all possible polarization states of light. Reported major principal transmittance of 75% and extinction ratio of 1100 demonstrate that the MWGP's superior optical characteristics are retained. The proposed liquidcrystal micropolarimeter array can be integrated on top of a complementary metal-oxide-semiconductor (CMOS) image sensor for real-time full Stokes polarization imaging.

Polarization-Analyzing CMOS Image Sensor With Monolithically Embedded Polarizer for Microchemistry Systems

This paper proposes and demonstrates a polarization-analyzing CMOS sensor based on image sensor architecture. The sensor was designed targeting applications for chiral analysis in a microchemistry system. The sensor features a monolithically embedded polarizer. Embedded polarizers with different angles were implemented to realize a real-time absolute measurement of the incident polarization angle. Although the pixel-level performance was confirmed to be limited, estimation schemes based on the variation of the polarizer angle provided a promising performance for real-time polarization measurements. An estimation scheme using 180 pixels in a 1deg step provided an estimation accuracy of 0.04deg. Polarimetric measurements of chiral solutions were also successfully performed to demonstrate the applicability of the sensor to optical chiral analysis.

Fabrication of a dual-tier thin film micropolarization array

A thin film polarization filter has been patterned and etched using reactive ion etching (RIE) in order to create 8 by 8 microns square periodic structures. The micropolarization filters retain the original extinction ratios of the unpatterned thin film. The measured extinction ratios on the micropolarization filters are approximately 1000 in the blue and green visible spectrum and approximately 100 in the red spectrum. Various gas combinations for RIE have been explored in order to determine the right concentration mix of CF(4) and O(2) that gives optimum etching rate, in terms of speed and under-etching. Theoretical explanation for the optimum etching rate has also been presented. In addition, anisotropic etching with 1 microm under cutting of a 10 microm thick film has been achieved. Experimental results for the patterned structures under polarized light are presented. The array of micropolarizers will be deposited on top of a custom made CMOS imaging sensor in order to compute the first three Stokes parameters in real time.