Polarized skylight-based heading measurements: a bio-inspired approach

Computer Vision Techniques Demonstrate Robust Orientation Measurement of the Milky Way Despite Image Motion

Many species rely on celestial cues as a reliable guide for maintaining heading while navigating. In this paper, we propose a method that extracts the Milky Way (MW) shape as an orientation cue in low-light scenarios. We also tested the method on both real and synthetic images and demonstrate that the performance of the method appears to be accurate and reliable to motion blur that might be caused by rotational vibration and stabilisation artefacts. The technique presented achieves an angular accuracy between a minimum of 0.00° and a maximum 0.08° for real night sky images, and between a minimum of 0.22° and a maximum 1.61° for synthetic images. The imaging of the MW is largely unaffected by blur. We speculate that the use of the MW as an orientation cue has evolved because, unlike individual stars, it is resilient to motion blur caused by locomotion.

Passive Polarized Vision for Autonomous Vehicles: A Review

This review article aims to address common research questions in passive polarized vision for robotics. What kind of polarization sensing can we embed into robots? Can we find our geolocation and true north heading by detecting light scattering from the sky as animals do? How should polarization images be related to the physical properties of reflecting surfaces in the context of scene understanding? This review article is divided into three main sections to address these questions, as well as to assist roboticists in identifying future directions in passive polarized vision for robotics. After an introduction, three key interconnected areas will be covered in the following sections: embedded polarization imaging; polarized vision for robotics navigation; and polarized vision for scene understanding. We will then discuss how polarized vision, a type of vision commonly used in the animal kingdom, should be implemented in robotics; this type of vision has not yet been exploited in robotics service. Passive polarized vision could be a supplemental perceptive modality of localization techniques to complement and reinforce more conventional ones.

Biomimetic Polarized Light Navigation Sensor: A Review

A polarized light sensor is applied to the front-end detection of a biomimetic polarized light navigation system, which is an important part of analyzing the atmospheric polarization mode and realizing biomimetic polarized light navigation, having received extensive attention in recent years. In this paper, biomimetic polarized light navigation in nature, the mechanism of polarized light navigation, point source sensor, imaging sensor, and a sensor based on micro nano machining technology are compared and analyzed, which provides a basis for the optimal selection of different polarized light sensors. The comparison results show that the point source sensor can be divided into basic point source sensor with simple structure and a point source sensor applied to integrated navigation. The imaging sensor can be divided into a simple time-sharing imaging sensor, a real-time amplitude splitting sensor that can detect images of multi-directional polarization angles, a real-time aperture splitting sensor that uses a light field camera, and a real-time focal plane light splitting sensor with high integration. In recent years, with the development of micro and nano machining technology, polarized light sensors are developing towards miniaturization and integration. In view of this, this paper also summarizes the latest progress of polarized light sensors based on micro and nano machining technology. Finally, this paper summarizes the possible future prospects and current challenges of polarized light sensor design, providing a reference for the feasibility selection of different polarized light sensors.

Ultraviolet-visible light compass method based on local atmospheric polarization characteristics in adverse weather conditions

Bionic polarization navigation has attracted extensive attention because of its strong anti-interference performance and no accumulation of errors over time. However, very few studies have fully considered the influence of adverse weather conditions such as cloudy and overcast weather, which play a key role in navigation accuracy. Therefore, we propose an adaptive ultraviolet-visible light compass method based on local atmospheric polarization characteristics applicable to various weather conditions. The proposed method transforms the heading determination problem into a multiclassification problem by using a weather recognition technique. Ultraviolet detection is used to weaken the depolarization effect of cloud particles and to obtain more accurate skylight polarization patterns. Then, on the basis of screening effective data, the sun direction vector is calculated by using the electric vector direction and is finally combined with the astronomical calendar to achieve navigation. The experimental results confirm that, compared to the other methods, the designed algorithm can suppress the interference of clouds better and adapt to complex weather conditions. Under cloudy and overcast conditions, the heading angle error is reduced to less than 2°.

A bio-inspired polarization navigation sensor based on artificial compound eyes

Insect compound eyes are optical systems with small volume and a compact structure. The ommatidia in the dorsal rim area of some insects have polarized vision, which can perceive the polarization pattern of the sky and provide them with navigation information. In this paper, inspired by the polarization-sensitive compound eyes of insects, a bio-inspired polarization navigation sensor based on artificial compound eyes is designed. The sensor consists of an artificial compound eye, an integrated polarization detector and an integrated circuit. The optical path of the sensor uses the lens defocus method, which can ensure that the sensor obtains redundant polarization information. The integrated polarization detector is used to obtain the polarization information of the incident light, and the integrated circuit is responsible for the calculation. To extract effective information from images, we propose a multi-threshold segmentation method to filter and classify effective pixels. We use the least squares method to fit the inherent error of the sensor and then compensate it. The indoor calibration accuracy of the sensor is ±0.3°, and the outdoor calibration accuracy is ±0.5°. The sensor can provide accurate direction information for general smart mobile devices. The size of the sensor is 4 × 4 × 2 cm, and the weight is only 15 g. The key components of the sensor can be mass-produced, and it is a miniaturized and low-cost polarization navigation sensor.

An optimized pulse coupled neural network image de-noising method for a field-programmable gate array based polarization camera

The quality of polarization images is easy to be affected by the noise in the image acquired by a polarization camera. Consequently, a de-noising method optimized with a Pulse Coupled Neural Network (PCNN) for polarization images is proposed for a Field-Programmable Gate Array (FPGA)-based polarization camera in this paper, in which the polarization image de-noising is implemented using an adaptive PCNN improved by Gray Wolf Optimization (GWO) and Bi-Dimensional Empirical Mode Decomposition (BEMD). Unlike other artificial neural networks, PCNN does not need to be trained, but the parameters of PCNN such as the exponential decay time constant, the synaptic junction strength factor, and the inherent voltage constant play a critical influence on its de-noising performance. GWO is able to start optimization by generating a set of random solutions as the first population and saves the optimized solutions of PCNN. In addition, BEMD can decompose a complicated image into different Bi-Dimensional Intrinsic Mode Functions with local stabilized characteristics according to the input source image, and the decomposition result is able to lower the complexity of heavy noise image analysis. Moreover, the circuit in the polarization camera is accomplished by FPGA so as to obtain the polarization image with higher quality synchronously. These two schemes are combined to attenuate different types of noises and improve the quality of the polarization image significantly. Compared with the state-of-the-art image de-noising algorithms, the noise in the polarization image is suppressed effectively by the proposed optimized image de-noising method according to the indices of peak signal-to-noise ratio, standard deviation, mutual information, structural similarity, and root mean square error.

Adaptive method for estimating information from a polarized skylight

The acquisition and processing of skylight polarization information forms the cornerstone in modern navigation systems that are developed by imitating certain biological mechanisms. The accuracy of skylight polarization mode information plays a major part in improving the accuracy of polarized light navigation. This paper mainly focuses on developing a methodology that can avoid the error caused by the inaccurate rotation of the polarizer and manual readings from non-electrical equipment, when the time-sequence polarization measurement system is used to obtain the skylight polarization mode information. We propose an adaptive algorithm that can obtain the pictures of angle of polarization and degree of polarization with sets of random rotation angles with no need for precise readings for the rotation angle of the polarizer. By allocating initial random values to rotation angles, a simple iterative estimation method like the Gaussian-Newton method can be used to converge calculated angle of polarization and degree of polarization values to their respective real values. The experiment results show that the proposed method can be used to estimate polarization information with high accuracy and universality under various experiment settings including both sunny and cloudy weathers. Meanwhile, the time efficiency of the proposed method is comparable to traditional methods.

Design and calibration model of a bioinspired attitude and heading reference system based on compound eye polarization compass

Insects such as honeybees are capable of fusing the information sensed by multiple sensory organs for attitude and heading determination. In this paper, inspired by the sensory fusion mechanism of insects' polarization compass and haltere, a bioinspired polarization-based attitude and heading reference system (PAHRS) is presented. The PAHRS consists of compound eye polarization compass and inertial measurement unit (IMU). By simulating multi-view structure of the dorsal rim area in insects' compound eyes, a non-coplanar 'polarization-opponent (POL)-type' architecture is adopted for the compound eye polarization compass. The polarization compass has multi-directional observation channels, which is capable of adaptively selecting the angle of polarization and obtaining the polarization vectors. Therefore, the environmental adaptability of the polarization compass can be enhanced. In addition, the integration strategy between the compound eye polarization compass and IMU is proposed. Moreover, the sources of system errors are analyzed to improve the heading angle accuracy, based on which a new calibration model is established to compensate the installation errors of the PAHRS. Finally, experiments are carried out under both clear sky and cloudy conditions. The test results show that the error root mean square of heading angle is 0.14° in clear sky, and 0.42° in partly cloudy conditions.

Limitation of Rayleigh sky model for bioinspired polarized skylight navigation in three-dimensional attitude determination

Insects such as desert ants and drosophilae can sense polarized skylight for navigation. Inspired by insects, many researchers have begun to study how to use skylight polarization patterns for attitude determination. The Rayleigh sky model has become the most widely used skylight polarization model for bioinspired polarized skylight navigation due to its simplicity and practicality. However, this is an ideal model considering only single Rayleigh scatter events, and the limitation of this model in bio-inspired attitude determination has not been paid much attention and lacks strict inference proof. To address this problem, the rotational and plane symmetry of the Rayleigh sky model are analyzed in detail, and it is theoretically proved that this model contains only single solar vector information, which contains only two independent scalar pieces of attitude information, so it is impossible to determine three Euler angles simultaneously in real-time. To further verify this conclusion, based on a designed hypothetical polarization camera, we discuss what conditions different three-dimensional attitudes must satisfy so that the polarization images taken at different 3D attitudes are the same; this indicates that multiple solutions will appear when only using the Rayleigh sky model to determine 3D attitude. In conclusion, due to its single solar vector information and the existence of multiple solutions, it is fully proved that 3D attitude cannot be determined in real time based only upon the Rayleigh sky model. Code is available at: https://github.com/HuajuLiang/HypotheticalPolarizationCamera.

Polarized skylight compass based on a soft-margin support vector machine working in cloudy conditions

The skylight polarization pattern, which is a result of the scattering of unpolarized sunlight by particles in the atmosphere, can be used by many insects for navigation. Inspired by insects, several polarization navigation sensors have been designed and combined with various heading determination methods in recent years. However, up until now, few of these studies have fully considered the influences of different meteorological conditions, which play key roles in navigation accuracy, especially in cloudy weather. Therefore, this study makes a major contribution to the study on bio-inspired heading determination by designing a skylight compass method to suppress cloud disturbances. The proposed method transforms the heading determination problem into a binary classification problem by segmentation, connected component detection, and inversion. Considering the influences of noise and meteorological conditions, the binary classification problem is solved by the soft-margin support vector machine. In addition, to verify this method, a pixelated polarization compass platform is constructed that can take polarization images at four different orientations simultaneously in real time. Finally, field experimental results show that the designed method can more effectively suppress the interference of clouds compared with other methods.

A Bio-Inspired Polarization Sensor with High Outdoor Accuracy and Central-Symmetry Calibration Method with Integrating Sphere

A bio-inspired polarization sensor with lenses for navigation was evaluated in this study. Two new calibration methods are introduced, referred to as "central-symmetry calibration" (with an integrating sphere) and "noncontinuous calibration". A comparison between the indoor calibration results obtained from different calibration methods shows that the two proposed calibration methods are more effective. The central-symmetry calibration method optimized the nonconstant calibration voltage deviations, caused by the off-axis feature of the integrating sphere, to be constant values which can be calibrated easily. The section algorithm proposed previously showed no experimental advantages until the central-symmetry calibration method was proposed. The outdoor experimental results indicated that the indoor calibration parameters did not perform very well in practice outdoor conditions. To establish the reason, four types of calibration parameters were analyzed using the replacement method. It can be concluded that three types can be easily calibrated or affect the sensor accuracy slightly. However, before the sensor is used outdoors every time, the last type must be replaced with the corresponding outdoor parameter, and the calculation needs a precise rotary table. This parameter, which is mainly affected by the spectrum of incident light, is the main factor determining the sensor accuracy. After calibration, the sensor reaches an indoor accuracy of ±0.009° and a static outdoor accuracy of ±0.05° under clear sky conditions. The dynamic outdoor experiment shows a ±0.5° heading deviation between the polarization sensor and the inertial navigation system with a ±0.06° angular accuracy.