Scanning Mueller polarimetric microscopy

Polarimetric Imaging for Robot Perception: A Review

In recent years, the integration of polarimetric imaging into robotic perception systems has increased significantly, driven by the accessibility of affordable polarimetric sensors. This technology complements traditional color imaging by capturing and analyzing the polarization characteristics of light. This additional information provides robots with valuable insights into object shape, material composition, and other properties, ultimately enabling more robust manipulation tasks. This review aims to provide a comprehensive analysis of the principles behind polarimetric imaging and its diverse applications within the field of robotic perception. By exploiting the polarization state of light, polarimetric imaging offers promising solutions to three key challenges in robot vision: Surface segmentation; depth estimation through polarization patterns; and 3D reconstruction using polarimetric data. This review emphasizes the practical value of polarimetric imaging in robotics by demonstrating its effectiveness in addressing real-world challenges. We then explore potential applications of this technology not only within the core robotics field but also in related areas. Through a comparative analysis, our goal is to elucidate the strengths and limitations of polarimetric imaging techniques. This analysis will contribute to a deeper understanding of its broad applicability across various domains within and beyond robotics.

Swept-wavelength null polarimetry for highly sensitive birefringence laser scanning microscopy

We have recently demonstrated a high-speed null polarimeter [Opt. Express30, 18889 (2022)10.1364/OE.454193OPEXFF1094-4087] based on passive polarization optics and using a fast swept-wavelength laser source. We report here its implementation in a laser-scanning microscope setup, enabling highly sensitive linear retardance imaging with a pixel dwell time of 10 μs. The instrument is also able to measure light depolarization induced by the sample. Images of biological samples, including cancerous tissue and cells, illustrate its performances.

Metasurface-Enabled 3-in-1 Microscopy

Edge enhancement and polarization detection are critical to image transparent or low-contrast samples. However, currently available systems are limited to performing only a single functionality. To meet the requirement of system integration, there is a pressing need for a microscope with multiple functionalities. Here, we propose and develop a microscope with three different functionalities based on spatial multiplexing and polarization splitting. A novel geometric metasurface (MS) is used to realize a spiral phase profile and two phase gradient profiles along two vertical directions, which can perform such an extremely challenging optical task. This is the first demonstration of a 3-in-1 microscope that can simultaneously obtain five images with different optical properties in an imaging plane for the same sample. Imaging experiments with different samples verify its capability to simultaneously perform edge imaging, polarimetric imaging, and conventional microscope imaging. Benefiting from the compactness and multifunctionality of the optical MS device, the integration does not increase the volume of the microscope. This approach can enable users to visualize the multiple facets of samples in real-time.

Swept-wavelength null polarimeter for high-speed weak anisotropy measurements

Null-polarimeters provide the best sensitivity to anisotropy measurements and so far have been developed for the detection of small optical activities. This paper revisits null polarimetry through an original configuration based on the concept of spectrally encoded light polarization, in order to measure, with unprecedented speed, either linear or circular retardance with the same degree of sensitivity . Using passive polarization optics and a high speed wavelength swept laser source, the achieved single-pass sensitivity was 55nrad/Hz and 45nrad/Hz for respectively linear and circular retardance considering a minimum acquisition time of 10 µs. Due to its compactness and rapidity, the method could be further implemented in laser scanning microscopes, which should be of great interest for revealing very low anisotropies in biological tissues.

Phasor map analysis to investigate Hutchinson-Gilford progeria cell under polarization-resolved optical scanning microscopy

Polarized light scanning microscopy is a non-invasive and contrast-enhancing technique to investigate anisotropic specimens and chiral organizations. However, such arrangements suffer from insensitivity to confined blend of structures at sub-diffraction level. Here for the first time, we present that the pixel-by-pixel polarization modulation converted to an image phasor approach issues an insightful view of cells to distinguish anomalous subcellular organizations. To this target, we propose an innovative robust way for identifying changes in the chromatin compaction and distortion of nucleus morphology induced by the activation of the lamin-A gene from Hutchinson–Gilford progeria syndrome that induces a strong polarization response. The phasor mapping is evaluated based on the modulation and phase image acquired from a scanning microscope compared to a confocal fluorescence modality of normal cell opposed to the progeria. The method is validated by characterizing polarization response of starch crystalline granules. Additionally, we show that the conversion of the polarization-resolved images into the phasor could further utilized for segmenting specific structures presenting various optical properties under the polarized light. In summary, image phasor analysis offers a distinctly sensitive fast and easy representation of the polarimetric contrast that can pave the way for remote diagnosis of pathological tissues in real-time.

Label-free microscopy of mitotic chromosomes using the polarization orthogonality breaking technique

We report how a recently developed polarization imaging technique, implementing micro-wave photonics and referred to as orthogonality-breaking (OB) imaging, can be adapted on a classical confocal fluorescence microscope, and is able to provide informative polarization images from a single scan of the cell sample. For instance, the comparison of the images of various cell lines at different cell-cycle stages obtained by OB polarization microscopy and fluorescence confocal images shows that an endogenous polarimetric contrast arizes with this instrument on compacted chromosomes during cell division.

Phasor approach of Mueller matrix optical scanning microscopy for biological tissue imaging

Mueller matrix microscopy is an advanced imaging technique providing a full characterization of the optical polarization fingerprint of a sample. The Lu-Chipman (LC) decomposition, a method based on the modeling of elementary polarimetric arrangements and matrix inversions, is the gold standard to extract each polarimetric component separately. However, this models the optical system as a small number of discrete optical elements and requires a priori knowledge of the order in which these elements occur. In stratified media or when the ordering is not known, the interpretation of the LC decomposition becomes difficult. In this work, we propose a new, to our knowledge, representation dedicated to the study of biological tissues that combines Mueller matrix microscopy with a phasor approach. We demonstrate that this method provides an easier and direct interpretation of the retardance images in any birefringent material without the use of mathematical assumptions regarding the structure of the sample and yields comparable contrast to the LC decomposition. By validating this approach through numerical simulations, we demonstrate that it is able to give access to localized structural information, resulting in a simple determination of the birefringent parameters at the microscopic level. We apply our novel, to our knowledge, method to typical biological tissues that are of interest in the field of biomedical diagnosis.

Polarimetric optical scanning microscopy of zebrafish embryonic development using the coherency matrix

Many of the most important resolution improvements in optical microscopy techniques are based on the reduction of scattering effects. The main benefit of polarimetry-based imaging to this end is the discrimination between scattering phenomena originating from complex systems and the experimental noise. The determination of the coherency matrix elements from the experimental Mueller matrix can take advantage of scattering measurements to obtain additional information on the structural organization of a sample. We analyze the contrast mechanisms extracted from (a) the coherency matrix elements, (b) its eigenvalues and (c) the indices of polarimetric purity at different stages of zebrafish embryos, based on previous work using Mueller matrix optical scanning microscopy. We show that the use of the coherency matrix and related decompositions leads to an improvement in the imaging contrast, without requiring any complicated algebraic operations or any a priori knowledge of the sample, in contrast to standard polarimetric methods.

Combined approach using circular intensity differential scattering microscopy under phasor map data analysis

Circular intensity differential scattering (CIDS) is based on the analysis of circular polarized light scattering and has been proven to be an interesting label-free microscopy technique sensitive to the chiral organization at the submicroscopic level. However, this approach averages the localized contrasts related to the sample polarimetric properties in the illumination volume. Additionally, the detection sensitivity suffers from the confinement of the mixture of structures, and it becomes an arduous task to discriminate the source of the signal. In this work, we show that a phasor map approach combined with CIDS microscopy has provided an intuitive view of the sample organization to recognize the presence of different molecular species in the illumination volume. The data represented in terms of polarization response mapped to a single point called a phasor also have the potential to pave the way for the analysis of large data sets. We validated this method by numerical simulations and compared the results with that of experimental data of optical devices of reference.

Review on Complete Mueller Matrix Optical Scanning Microscopy Imaging

Optical scanning microscopy techniques based on the polarization control of the light have the capability of providing non invasive label-free contrast. By comparing the polarization states of the excitation light with its transformation after interaction with the sample, the full optical properties can be summarized in a single 4×4 Mueller matrix. The main challenge of such a technique is to encode and decode the polarized light in an optimal way pixel-by-pixel and take into account the polarimetric artifacts from the optical devices composing the instrument in a rigorous calibration step. In this review, we describe the different approaches for implementing such a technique into an optical scanning microscope, that requires a high speed rate polarization control. Thus, we explore the recent advances in term of technology from the industrial to the medical applications.

Linear diattenuation imaging of biological tissues with near infrared Mueller scanning microscopy

Among the multitude of optical polarization contrasts that can be observed in complex biological specimens, linear diattenuation (LD) imaging has received little attention. It is indeed challenging to image LD with basic polarizing microscopes because it is often relatively small in comparison with linear retardance (LR). In addition, interpretation of LD images is not straightforward when experiments are conducted in the visible range because LD can be produced by both dichroism and anisotropic scattering. Mueller polarimetry is a powerful implementation of polarization sensing able to differentiate and measure the anisotropies of specimens. In this article, near infrared transmission Mueller scanning microscopy is used to image LD in thin biological specimen sections made of various proteins with unprecedented resolution and sensitivity. The near infrared spectral range makes it possible to lower the contribution of dichroism to the total linear diattenuation in order to highlight anisotropic scattering. Pixel-by-pixel comparison of LD images with LR and multiphoton images demonstrates that LD is produced by under-resolved structures that are not revealed by other means, notably within the sarcomere of skeletal muscles. LD microscopy appears as a powerful tool to provide new insights into the macro-molecular organization of biological specimens at the sub-microscopic scale without labelling.

Circular Intensity Differential Scattering for Label-Free Chromatin Characterization: A Review for Optical Microscopy

Circular Intensity Differential Scattering (CIDS) provides a differential measurement of the circular right and left polarized light and has been proven to be a gold standard label-free technique to study the molecular conformation of complex biopolymers, such as chromatin. In early works, it has been shown that the scattering component of the CIDS signal gives information from the long-range chiral organization on a scale down to 1/10th-1/20th of the excitation wavelength, leading to information related to the structure and orientation of biopolymers in situ at the nanoscale. In this paper, we review the typical methods and technologies employed for measuring this signal coming from complex macro-molecules ordering. Additionally, we include a general description of the experimental architectures employed for spectroscopic CIDS measurements, angular or spectral, and of the most recent advances in the field of optical imaging microscopy, allowing a visualization of the chromatin organization in situ.

Orthogonality-breaking polarimetric sensing modalities for selective polarization imaging

Polarimetric sensing/imaging by orthogonality breaking is a microwave-photonics-inspired optical remote sensing technique that was shown to be particularly suited to characterize dichroic samples in a direct and single-shot way. In this work, we expand the scope of this approach in order to gain sensitivity on birefringent and/or purely depolarizing materials by respectively introducing a circular or a linear polarization analyzer in the detection module. We experimentally validate the interest of these two new, to the best of our knowledge, induced orthogonality-breaking modalities in the context of infrared active imaging.

Zebrafish structural development in Mueller-matrix scanning microscopy

Zebrafish are powerful animal models for understanding biological processes and the molecular mechanisms involved in different human diseases. Advanced optical techniques based on fluorescence microscopy have become the main imaging method to characterize the development of these organisms at the microscopic level. However, the need for fluorescence probes and the consequent high light doses required to excite fluorophores can affect the biological process under observation including modification of metabolic function or phototoxicity. Here, without using any labels, we propose an implementation of a Mueller-matrix polarimeter into a commercial optical scanning microscope to characterize the polarimetric transformation of zebrafish preserved at different embryonic developmental stages. By combining the full polarimetric measurements with statistical analysis of the Lu and Chipman mathematical decomposition, we demonstrate that it is possible to quantify the structural changes of the biological organization of fixed zebrafish embryos and larvae at the cellular scale. This convenient implementation, with low light intensity requirement and cheap price, coupled with the quantitative nature of Mueller-matrix formalism, can pave the way for a better understanding of developmental biology, in which label-free techniques become a standard tool to study organisms.

Development of Birefringence Confocal Laser Scanning Microscope and its Application to Sample Measurements

A new laser microscope is developed to obtain depth-direction birefringence information of optically anisotropic samples, which cannot be obtained by a conventional polarization microscope. As a result, birefringence tomographic images are now available and the method should be helpful for sample evaluations.

Optimization of fast spectrally encoded Mueller polarimeters for real-time monitoring

In this paper, we report a generalized theoretical framework on spectrally encoded polarimeters to display in real time both linear and circular retardance as well as linear and circular diattenuation on the basis of a recent experimental work detailed in Sci. Rep.9, 3972 (2019)SRCEC32045-232210.1038/s41598-019-40467-z. The considered polarimeters use a broadband light source and wavelength-dependent retarders whose thicknesses are selected to guarantee minimal noise propagation and reduced data processing for real-time display of pure polarimetric effects.

Method to calibrate a full-Stokes polarimeter based on variable retarders

We present a calibration method for a full-Stokes polarimeter. The polarimeter uses two liquid-crystal variable retarders (LCVR) and a linear polarizer to measure the four Stokes parameters. The calibration method proposed in this paper calculates the errors in the experimental setup by fitting the experimental intensity measurements for a set of calibration samples to a theoretical polarimeter with errors. The errors calculated in the method include the axes alignment errors and the errors in the retardance values of both LCVRs. The resulting calibration parameters are verified by measuring the polarization state of a light beam passing through a rotating linear polarizer, a half-wave plate, and a quarter-wave plate and comparing with the predictions for an ideal, error-free polarimeter. It is found that an average reduction in rms error of 55.8% can be obtained with the proposed method.

Fast spectrally encoded Mueller optical scanning microscopy

Mueller microscopes enable imaging of the optical anisotropic properties of biological or non-biological samples, in phase and amplitude, at sub-micrometre scale. However, the development of Mueller microscopes poses an instrumental challenge: the production of polarimetric parameters must be sufficiently quick to ensure fast imaging, so that the evolution of these parameters can be visualised in real-time, allowing the operator to adjust the microscope while constantly monitoring them. In this report, a full Mueller scanning microscope based on spectral encoding of polarization is presented. The spectrum, collected every 10 μs for each position of the optical beam on the specimen, incorporates all the information needed to produce the full Mueller matrix, which allows simultaneous display of all the polarimetric parameters, at the unequalled rate of 1.5 Hz (for an image of 256 × 256 pixels). The design of the optical blocks allows for the real-time display of linear birefringent images which serve as guidance for the operator. In addition, the instrument has the capability to easily switch its functionality from a Mueller to a Second Harmonic Generation (SHG) microscope, providing a pixel-to-pixel matching of the images produced by the two modalities. The device performance is illustrated by imaging various unstained biological specimens.

Classification of morphologically similar algae and cyanobacteria using Mueller matrix imaging and convolutional neural networks

We present the Mueller matrix imaging system to classify morphologically similar algae based on convolutional neural networks (CNNs). The algae and cyanobacteria data set contains 10,463 Mueller matrices from eight species of algae and one species of cyanobacteria, belonging to four phyla, the shapes of which are mostly randomly oriented spheres, ovals, wheels, or rods. The CNN serves as an automatic machine with learning ability to help in extracting features from the Mueller matrix, and trains a classifier to achieve a 97% classification accuracy. We compare the performance in two ways. One way is to compare the performance of five CNNs that differ in the number of convolution layers as well as the classical principle component analysis (PCA) plus the support vector machine (SVM) method; the other way is to quantify the differences of scores between full Mueller matrix and the first matrix element m11, which does not contain polarization information under the same conditions. As the results show, deeper CNNs perform better, the best of which outperforms the conventional PCA plus SVM method by 19.66% in accuracy, and using the full Mueller matrix earns 6.56% increase of accuracy than using m11. It demonstrates that the coupling of Mueller matrix imaging and CNN may be a promising and efficient solution for the automatic classification of morphologically similar algae.

Polarization gating based on Mueller matrices

We present mathematical formulas generalizing polarization gating (PG) techniques. PG refers to a collection of imaging methods based on the combination of different controlled polarization channels. In particular, we show how using the measured Mueller matrix (MM) of a sample, a widespread number of PG configurations can be evaluated just from analytical expressions based on the MM coefficients. We also show the interest of controlling the helicity of the states of polarization used for PG-based metrology, as this parameter has an impact in the image contrast of samples. In addition, we highlight the interest of combining PG techniques with tools of data analysis related to the MM formalism, such as the well-known MM decompositions. The method discussed in this work is illustrated with the results of polarimetric measurements done on artificial phantoms and real ex-vivo tissues.