Sensor Modeling and Calibration Method Based on Extinction Ratio Error for Camera-Based Polarization Navigation Sensor

Passive Polarized Vision for Autonomous Vehicles: A Review

This review article aims to address common research questions in passive polarized vision for robotics. What kind of polarization sensing can we embed into robots? Can we find our geolocation and true north heading by detecting light scattering from the sky as animals do? How should polarization images be related to the physical properties of reflecting surfaces in the context of scene understanding? This review article is divided into three main sections to address these questions, as well as to assist roboticists in identifying future directions in passive polarized vision for robotics. After an introduction, three key interconnected areas will be covered in the following sections: embedded polarization imaging; polarized vision for robotics navigation; and polarized vision for scene understanding. We will then discuss how polarized vision, a type of vision commonly used in the animal kingdom, should be implemented in robotics; this type of vision has not yet been exploited in robotics service. Passive polarized vision could be a supplemental perceptive modality of localization techniques to complement and reinforce more conventional ones.

Underwater biomimetic orientation method using imaging polarization sensor based on direct sunlight compensation

This paper addresses the challenge of significant interference caused by direct sunlight, which adversely affects the orientation accuracy of underwater imaging polarization sensors (IPS). A novel underwater polarization orientation method is proposed based on direct sunlight compensation. Firstly, based on the polarization transmission model at the water-air interface, the interference mechanism of the underwater direct sunlight polarization detection model was analyzed. The underwater IPS detection model based on direct sunlight compensation is constructed, which uses the weight coefficient of underwater direct sunlight to compensate for the interference on the polarization channel and improve the accuracy of underwater polarization detection models. Furthermore, the analytical solution method for the polarization state information of underwater IPS is proposed, employing the augmented Stokes vectors to construct a linear equation for solving the weight coefficients of direct sunlight and improving the computational efficiency. Finally, an underwater polarization orientation experimental platform is established, and both simulation and actual underwater experiments are conducted. Compared with the traditional methods, the proposed method reduces heading error by an average of 92.53% at different solar altitudes.

An Improved Bio-Orientation Method Based on Direct Sunlight Compensation for Imaging Polarization Sensor

Direct sunlight in complex environmental conditions severely interferes with the light intensity response for imaging Polarization Sensor (PS), leading to a reduction in polarization orientation accuracy. Addressing this issue, this article analyzes the impact mechanism of direct sunlight on polarization sensor detection in a complex environment. The direct sunlight interference factor is introduced into the intensity response model of imaging polarization detection, enhancing the accuracy of the polarization detection model. Furthermore, a polarization state information analytical solution model based on direct sunlight compensation is constructed to improve the accuracy and real-time performance of the polarization state information solution. On this basis, an improved bio-orientation method based on direct sunlight compensation for imaging polarization sensor is proposed. The outdoor dynamic reorientation experiment platform is established to validate the effectiveness of the proposed method. Compared with the traditional methods, the experimental results demonstrate a 23% to 47% improvement in the polarization orientation accuracy under various solar zenith angles.

Measurement Modeling and Performance Analysis of a Bionic Polarimetric Imaging Navigation Sensor Using Rayleigh Scattering to Generate Scattered Sunlight

The bionic polarimetric imaging navigation sensor (BPINS) is a navigation sensor that provides absolute heading, and it is of practical engineering significance to model the measurement error of BPINS. The existing BPINSs are still modeled using photodiode-based measurements rather than imaging measurements and are not modeled systematically enough. This paper proposes a measurement performance analysis method of BPINS that takes into account the geometric and polarization errors of the optical system. Firstly, the key error factors affecting the overall measurement performance of BPINS are investigated, and the Stokes vector-based measurement error model of BPINS is introduced. Secondly, based on its measurement error model, the effect of the error source on the measurement performance of BPINS is quantitatively analyzed using Rayleigh scattering to generate scattered sunlight as a known incident light source. The numerical results show that in angle of E-vector (AoE) measurement, the coordinate deviation of the principal point has a greater impact, followed by grayscale response inconsistency of CMOS and integration angle error of micro-polarization array, and finally lens attenuation; in degree of linear polarization (DoLP) measurement, the grayscale response inconsistency of CMOS has a more significant impact. This finding can accurately guide the subsequent calibration of BPINS, and the quantitative results provide an important theoretical reference for its optimal design.

Mid-Infrared Bipolar and Unipolar Linear Polarization Detections in Nb2 GeTe4 /MoS2 Heterostructures

Detecting and distinguishing light polarization states, one of the most basic elements of optical fields, have significant importance in both scientific studies and industry applications. Artificially fabricated structures, e.g., metasurfaces with anisotropic absorptions, have shown the capabilities of detecting polarization light and controlling. However, their operations mainly rely on resonant absorptions based on structural designs that are usually narrow bands. Here, a mid-infrared (MIR) broadband polarization photodetector with high PRs and wavelength-dependent polarities using a 2D anisotropic/isotropic Nb2 GeTe4 /MoS2 van der Waals (vdWs) heterostructure is demonstrated. It is shown that the photodetector exhibits high PRs of 48 and 34 at 4.6  and 11.0 µm wavelengths, respectively, and even a negative PR of -3.38 for 3.7 µm under the zero bias condition at room temperature. Such interesting results can be attributed to the superimposed effects of a photovoltaic (PV) mechanism in the Nb2 GeTe4 /MoS2 hetero-junction region and a bolometric mechanism in the MoS2 layer. Furthermore, the photodetector demonstrates its effectiveness in bipolar and unipolar polarization encoding communications and polarization imaging enabled by its unique and high PRs.

Chip-integrated metasurface full-Stokes polarimetric imaging sensor

Polarimetric imaging has a wide range of applications for uncovering features invisible to human eyes and conventional imaging sensors. Chip-integrated, fast, cost-effective, and accurate full-Stokes polarimetric imaging sensors are highly desirable in many applications, which, however, remain elusive due to fundamental material limitations. Here we present a chip-integrated Metasurface-based Full-Stokes Polarimetric Imaging sensor (MetaPolarIm) realized by integrating an ultrathin (~600 nm) metasurface polarization filter array (MPFA) onto a visible imaging sensor with CMOS compatible fabrication processes. The MPFA is featured with broadband dielectric-metal hybrid chiral metasurfaces and double-layer nanograting polarizers. This chip-integrated polarimetric imaging sensor enables single-shot full-Stokes imaging (speed limited by the CMOS imager) with the most compact form factor, records high measurement accuracy, dual-color operation (green and red) and a field of view up to 40 degrees. MetaPolarIm holds great promise to enable transformative applications in autonomous vision, industry inspection, space exploration, medical imaging and diagnosis.

Biomimetic Polarized Light Navigation Sensor: A Review

A polarized light sensor is applied to the front-end detection of a biomimetic polarized light navigation system, which is an important part of analyzing the atmospheric polarization mode and realizing biomimetic polarized light navigation, having received extensive attention in recent years. In this paper, biomimetic polarized light navigation in nature, the mechanism of polarized light navigation, point source sensor, imaging sensor, and a sensor based on micro nano machining technology are compared and analyzed, which provides a basis for the optimal selection of different polarized light sensors. The comparison results show that the point source sensor can be divided into basic point source sensor with simple structure and a point source sensor applied to integrated navigation. The imaging sensor can be divided into a simple time-sharing imaging sensor, a real-time amplitude splitting sensor that can detect images of multi-directional polarization angles, a real-time aperture splitting sensor that uses a light field camera, and a real-time focal plane light splitting sensor with high integration. In recent years, with the development of micro and nano machining technology, polarized light sensors are developing towards miniaturization and integration. In view of this, this paper also summarizes the latest progress of polarized light sensors based on micro and nano machining technology. Finally, this paper summarizes the possible future prospects and current challenges of polarized light sensor design, providing a reference for the feasibility selection of different polarized light sensors.

Efficient acquisition of Mueller matrix via spatially modulated polarimetry at low light field

Mueller polarimetry performed in low light field with high speed and accuracy is important for the diagnosis of living biological tissues. However, efficient acquisition of the Mueller matrix at low light field is challenging owing to the interference of background-noise. In this study, a spatially modulated Mueller polarimeter (SMMP) induced by a zero-order vortex quarter wave retarder is first presented to acquire the Mueller matrix rapidly using only four camera shots rather than 16 shots, as in the state of the art technique. In addition, a momentum gradient ascent algorithm is proposed to accelerate the reconstruction of the Mueller matrix. Subsequently, a novel adaptive hard thresholding filter combined with the spatial distribution characteristics of photons at different low light levels, in addition to a low-pass fast-Fourier-transform filter, is utilized to remove redundant background noise from raw-low intensity distributions. The experimental results illustrate that the proposed method is more robust to noise perturbation, and its precision is almost an order of magnitude higher than that of the classical dual-rotating retarder Mueller polarimetry at low light field.

A Multi-Mode Switching Variational Bayesian Adaptive Kalman Filter Algorithm for the SINS/PNS/GMNS Navigation System of Pelagic Ships

The ocean-going environment is complex and changeable with great uncertainty, which poses a huge challenge to the navigation ability of ships working in the pelagic ocean. In this paper, in an attempt to deal with the complex uncertain interference that the environment may bring to the strap-down inertial navigation system/polarization navigation system/geomagnetic navigation system (SINS/PNS/GMNS) integrated navigation system, the multi-mode switching variational Bayesian adaptive Kalman filter (MMS-VBAKF) algorithm is proposed. To be more specific, to identify the degrees of measurement interference more effectively, we design an interference evaluation and multi-mode switching mechanism using the original polarization information and geomagnetic information. Through this mechanism, the interference to the SINS/PNS/GMNS navigation system is divided into three cases. In case of slight interference (case SI), the variational Bayesian method is adopted directly to solve the problem that the statistical characteristics of measurement noise are unknown. By the fixed-point iteration mechanism, the statistical properties of the measurement noise and the system states can be estimated adaptively in real time. In case of interference-tolerance (case TI), the estimation of the statistical characteristics of measurement noise need to weigh the measurement information at the moment and a priori value information comprehensively. In case of excessive interference (case EI), the SINS/PNS/GMNS integrated navigation system will perform mode switching and filtering system reconstruction in advance. Then, the information fusion and navigation states estimation can be completed. Consequently, the reliability, robustness, and accuracy of the SINS/PNS/GMNS integrated navigation system can be guaranteed. Finally, the effectiveness of the algorithm is illustrated by the simulation experiments.

Measurement error model of the bio-inspired polarization imaging orientation sensor

This article studies the measurement error model and calibration method of the bio-inspired polarization imaging orientation sensor (BPIOS), which has important engineering significance for promoting bio-inspired polarization navigation. Firstly, we systematically analyzed the measurement errors in the imaging process of polarized skylight and accurately established an error model of BPIOS based on Stokes vector. Secondly, using the simulated Rayleigh skylight as the incident surface light source, the influence of multi-source factors on the measurement accuracy of BPIOS is quantitatively given for the first time. These simulation results can guide the later calibration of BPIOS. We then proposed a calibration method of BPIOS based on geometric parameters and the Mueller matrix of the optical system and conducted an indoor calibration experiment. Experimental results show that the measurement accuracy of the calibrated BPIOS can reach 0.136°. Finally, the outdoor performance of BPIOS is studied. Outdoor dynamic performance test and field compensation were performed. Outdoor results show that the heading accuracy of BPIOS is 0.667°.

Uncertainty Evaluation in Vision-Based Techniques for the Surface Analysis of Composite Material Components

In this paper, a methodology is discussed concerning the measurement of yarn’s angle of two different glass-reinforced polypropylene matrix materials, widely used in the production of automotive components. The measurement method is based on a vision system and image processing techniques for edge detection. Measurements of angles enable, if accurate, both useful suggestions for process optimization to be made, and the reliable validation of the simulation results of the thermoplastic process. Therefore, uncertainty evaluation of angle measurement is a mandatory pre-requisite. If the image acquisition and processing is considered, many aspects influence the whole accuracy of the method; the most important have been identified and their effects evaluated with reference to two different materials, which present different optical-type characteristics. The influence of piece geometry has also been taken into account, carrying out measurements on flat sheets and on a semi-spherical object, which is a reference standard shape, to verify the effect of thermoforming and to tune the process parameters. Complete uncertainty in the order of a few degrees has been obtained, which is satisfactory for purposes of simulation validation and consequent process optimization. The uncertainty budget also allowed individuation of the most relevant causes of uncertainty for measurement process improvement.

Bionic Integrated Positioning Mechanism Based on Bioinspired Polarization Compass and Inertial Navigation System

In this paper, to address the problem of positioning accumulative errors of the inertial navigation system (INS), a bionic autonomous positioning mechanism integrating INS with a bioinspired polarization compass is proposed. In addition, the bioinspired positioning system hardware and the integration model are also presented. Concerned with the technical issue of the accuracy and environmental adaptability of the integrated positioning system, the sun elevation calculating method based on the degree of polarization (DoP) and direction of polarization (E-vector) is presented. Moreover, to compensate for the latitude and longitude errors of INS, the bioinspired positioning system model combining the polarization compass and INS is established. Finally, the positioning performance of the proposed bioinspired positioning system model was validated via outdoor experiments. The results indicate that the proposed system can compensate for the position errors of INS with satisfactory performance.