Polarized multispectral imaging in a rigid endoscope based on elastic light scattering spectroscopy

Efficient acquisition of Mueller matrix via spatially modulated polarimetry at low light field

Mueller polarimetry performed in low light field with high speed and accuracy is important for the diagnosis of living biological tissues. However, efficient acquisition of the Mueller matrix at low light field is challenging owing to the interference of background-noise. In this study, a spatially modulated Mueller polarimeter (SMMP) induced by a zero-order vortex quarter wave retarder is first presented to acquire the Mueller matrix rapidly using only four camera shots rather than 16 shots, as in the state of the art technique. In addition, a momentum gradient ascent algorithm is proposed to accelerate the reconstruction of the Mueller matrix. Subsequently, a novel adaptive hard thresholding filter combined with the spatial distribution characteristics of photons at different low light levels, in addition to a low-pass fast-Fourier-transform filter, is utilized to remove redundant background noise from raw-low intensity distributions. The experimental results illustrate that the proposed method is more robust to noise perturbation, and its precision is almost an order of magnitude higher than that of the classical dual-rotating retarder Mueller polarimetry at low light field.

Dual division of focal plane polarimeters-based collinear reflection Mueller matrix fast imaging microscope

SIGNIFICANCE

Reflection Mueller matrix imaging is suitable for characterizing the microstructure of bulk specimens and probing dynamic processes in living animals, there are always demands for speed and accuracy for such applications to avoid possible artifacts and reveal a sample's intrinsic properties.

AIM

To demonstrate a design of collinear reflection Mueller matrix fast imaging microscope based on dual division of focal plane (DoFP) polarimeters (DoFPs-CRMMM) which has high measurement speed and accuracy.

APPROACH

In DoFPs-CRMMM, to improve the measurement speed, we applied the dual DoFP polarimeters design on the collinear reflection system for the first time to achieve fast imaging in about 2 s. To improve the measurement accuracy, we improved the double-pass eigenvalue calibration method (dp-ECM) by background light correction, and explored the optimization of the set of reference samples.

RESULTS

DoFPs-CRMMM was applied to measure the standard polarization samples and monitor the tissue optical clearing process of an artificial layered bulk tissue. Results show that the system has satisfactory performance which can capture the variation of polarization properties during the dynamic process.

CONCLUSIONS

We present the establishment and demo application of DoFPs-CRMMM. The measurement speed can be further accelerated for potential applications in monitoring dynamic processes or living biomedical systems.

Polarization enhanced laparoscope for improved visualization of tissue structural changes associated with peritoneal cancer metastasis

A polarization enhanced laparoscopy (PEL) imaging system was developed to examine the feasibility of utilizing PEL to augment conventional white light laparoscopy (WLL) in the visualization of peritoneal cancer metastases. The system includes a modified tip to illuminate tissue with linearly polarized light and elements in the detection path enabling recording of corresponding images linearly co- and cross-polarized relative to the incident light. WLL and PEL images from optical tissue phantoms with features of distinct scattering cross-section confirm the enhanced sensitivity of PEL to such characteristics. Additional comparisons based on images acquired from collagen gels with different levels of fiber alignment highlight another source of PEL contrast. Finally, PEL and WLL images of ex vivo human tissue illustrate the potential of PEL to improve visualization of cancerous tissue surrounded by healthy peritoneum. Given the simplicity of the approach and its potential for seamless integration with current clinical practice, our results provide motivation for clinical translation.

Alignment-free filter array: Snapshot multispectral polarization imaging based on a Voronoi-like random photonic crystal filter

We develop a photonic crystal filter with a new structure and propose a method to realize a snapshot multispectral polarization camera by mounting the filter on a monochrome imager with no requirement for a specific alignment. The developed filter is based on the Voronoi structure, which forms multilayered photonic crystals with random wave-like structures in each of the Voronoi cells. Because the transmission characteristics of the multilayered photonic crystal can be controlled simply by changing the microstructure, there is no need to change the manufacturing process and materials for each Voronoi cell. Furthermore, the Voronoi cell is randomly distributed so that the filter can be junctioned with the imager at arbitrary positions and angles without the need to position the filter during mounting, although it requires measurement of the camera characteristics and an image restoration process after filter mounting. In this experiment, we evaluated to reconstruct spectra as well as linearly polarized components and RGB images in the visible wavelength range from a single exposure image.

Assessment of tissue polarimetric properties using Stokes polarimetric imaging with circularly polarized illumination

Tissue-depolarization and linear-retardance are the main polarization characteristics of interest for bulk tissue characterization, and are normally interpreted from Mueller polarimetry. Stokes polarimetry can be conducted using simpler instrumentation and in a shorter time. Here, we use Stokes polarimetric imaging with circularly polarized illumination to assess the circular-depolarization and linear-retardance properties of tissue. Results obtained were compared with Mueller polarimetry in transmission and reflection geometry, respectively. It is found that circular-depolarization obtained from these 2 methods is very similar in both geometries, and that linear-retardance is highly quantitatively similar for transmission geometry and qualitatively similar for reflection geometry. The majority of tissue circular-depolarization and linear-retardance image information (represented by local image contrast features) obtained from Mueller polarimetry is well preserved from Stokes polarimetry in both geometries. These findings can be referred to for further understanding tissue Stokes polarimetric data, and for further application of Stokes polarimetry under the circumstances where short acquisition time or low optical system complexity is a priority, such as polarimetric endoscopy and microscopy.

Real time complete Stokes polarimetric imager based on a linear polarizer array camera for tissue polarimetric imaging

Tissue polarimetric imaging measures Mueller matrices of tissues or Stokes vectors of the emergent light from tissues (normally using incidence with a fixed polarization state) over a field of view, and has demonstrated utility in a number of surgical and diagnostic applications. Here we introduce a compact complete Stokes polarimetric imager that can work for multiple wavelength bands with a frame-rate suitable for real-time applications. The imager was validated with standard polarizing components, and then employed as a polarization state analyzer of a Mueller imaging polarimeter and a standalone Stokes imaging polarimeter respectively to image the process of dehydration of bovine tendon tissue. The results obtained in this work suggested that the polarization properties of the samples rich of collagen fibres can change with the degree of dehydration, and therefore, dehydration of the samples prepared for polarimetric imaging (e.g. polarimetric microscopy) should be carefully controlled.

Mueller polarimetric imaging for surgical and diagnostic applications: a review

Polarization is a fundamental property of light and a powerful sensing tool that has been applied to many areas. A Mueller matrix is a complete mathematical description of the polarization characteristics of objects that interact with light, and is known as a transfer function of Stokes vectors which characterise the state of polarization of light. Mueller polarimetric imaging measures Mueller matrices over a field of view and thus allows for visualising the polarization characteristics of the objects. It has emerged as a promising technique in recent years for tissue imaging, improving image contrast and providing a unique perspective to reveal additional information that cannot be resolved by other optical imaging modalities. This review introduces the basis of the Stokes-Mueller formulism, interpretation methods of Mueller matrices into fundamental polarization properties, polarization properties of biological tissues, and considerations in the construction of Mueller polarimetric imaging devices for surgical and diagnostic applications, including primary configurations, optimization procedures, calibration methods as well as the instrument polarization properties of several widely-used biomedical optical devices. The paper also reviews recent progress in Mueller polarimetric endoscopes and fibre Mueller polarimeters, followed by the future outlook in applying the technique to surgery and diagnostics. Tissue polarization properties convey morphological, micro-structural and compositional information of tissue with great potential for label free characterization of tissue pathological changes. Recent progress in tissue polarimetric imaging and polarization resolved endoscopy paved the way for translation of polarimetric imaging to surgery and tissue diagnosis.

Optical characterization of rigid endoscopes and polarization calibration methods

Polarization imaging can reveal orthogonal information with respect to color about the structural composition of biological tissue, and with the advance of superior polarimeters its use for biomedical applications has proliferated in the last decade. Polarimetry can be used in pre-clinical and clinical settings for the early detection of cancerous tissue. Polarization-based endoscopy with the complementary near-infrared fluorescence imaging modality improves the early diagnosis of flat cancerous lesions in colorectal tumor models. With the development of new polarization sensors the need to use standard laboratory optics to create custom imaging systems increases. These additional optics can behave as polarization filters effectively degrading and modifying the original tissue's polarization signatures leading to erroneous judgments. Here, we present a framework to characterize the spectral and polarization properties of rigid endoscopes for polarization-based endoscopic imaging. We describe and evaluate two calibration schemes based on Mueller calculus to reconstruct the original polarization information. Optical limitations of the endoscopes and minimum polarimeter requirements are discussed that may be of interest to other researchers working with custom polarization-based imaging systems.

Averaged subtracted polarization imaging for endoscopic diagnostics of surface microstructures on translucent mucosae

An endoscopic image processing technique for enhancing the appearance of microstructures on translucent mucosae is described. This technique employs two pairs of co- and cross-polarization images under two different linearly polarized lights, from which the averaged subtracted polarization image (AVSPI) is calculated. Experiments were then conducted using an acrylic phantom and excised porcine stomach tissue using a manual experimental setup with ring-type lighting, two rotating polarizers, and a color camera; better results were achieved with the proposed method than with conventional color intensity image processing. An objective evaluation method that uses texture analysis was developed and used to evaluate the enhanced microstructure images. This paper introduces two types of online, rigid-type, polarimetric endoscopic implementations using a polarized ring-shaped LED and a polarimetric camera. The first type uses a beam-splitter-type color polarimetric camera, and the second uses a single-chip monochrome polarimetric camera. Microstructures on the mucosa surface were enhanced robustly with these online endoscopes regardless of the difference in the extinction ratio of each device. These results show that polarimetric endoscopy using AVSPI is both effective and practical for hardware implementation.

A high definition Mueller polarimetric endoscope for tissue characterisation

The contrast mechanism of medical endoscopy is mainly based on metrics of optical intensity and wavelength. As another fundamental property of light, polarization can not only reveal tissue scattering and absorption information from a different perspective, but can also provide insight into directional tissue birefringence properties to monitor pathological changes in collagen and elastin. Here we demonstrate a low cost wide field high definition Mueller polarimetric endoscope with minimal alterations to a rigid endoscope. We show that this novel endoscopic imaging modality is able to provide a number of image contrast mechanisms besides traditional unpolarized radiation intensity, including linear depolarization, circular depolarization, cross-polarization, directional birefringence and dichroism. This enhances tissue features of interest, and additionally reveals tissue micro-structure and composition, which is of central importance for tissue diagnosis and image guidance for surgery. The potential applications of the Mueller polarimetric endoscope include wide field early epithelial cancer diagnosis, surgical margin detection and energy-based tissue fusion monitoring, and could further benefit a wide range of endoscopic investigations through intra-operative guidance.

Polarized light imaging in biomedicine: emerging Mueller matrix methodologies for bulk tissue assessment

Polarized light point measurements and wide-field imaging have been studied for many years in an effort to develop accurate and information-rich tissue diagnostic methods. However, the extensive depolarization of polarized light in thick biological tissues has limited the success of these investigations. Recently, advances in technology and conceptual understanding have led to a significant resurgence of research activity in the promising field of bulk tissue polarimetry. In particular, with the advent of improved measurement, analysis, and interpretation methods, including Mueller matrix decomposition, new diagnostic avenues, such as quantification of microstructural anisotropy in bulk tissues, have been enabled. Further, novel technologies have improved the speed and the accuracy of polarimetric instruments for ex vivo and in vivo diagnostics. In this paper, we review some of the recent progress in tissue polarimetry, provide illustrative application examples, and offer an outlook to the future of polarized light imaging in bulk biological tissues.

Current concepts and future of noninvasive procedures for diagnosing oral squamous cell carcinoma--a systematic review

Background

Oral squamous cell carcinoma (OSCC) has a remarkably high incidence worldwide, and a fairly serious prognosis, encouraging further research into advanced technologies for noninvasive methods of making early diagnoses, ideally in primary care settings.

Objectives

Our purpose was to examine the validity of using advanced noninvasive technologies in diagnosis of OSCC by identifying and evaluating relevant published reports.

Data source

MEDLINE, EMBASE, and CINAHL were searched to identify clinical trials and other information published between 1990 and 10 June 2014; the searches of MEDLINE and EMBASE were updated to November 2014. Study selection: Studies of noninvasive methods of diagnosing OSCC, including oral brush biopsy, optical biopsy, saliva-based oral cancer diagnosis, and others were included.

Data extraction

Data were abstracted and evaluated in duplicate for possible relevance on two occasions at an interval of 2 months before being included or excluded.

Data synthesis

This study identified 163 studies of noninvasive methods for diagnosing OSCC that met the inclusion criteria. These included six studies of oral brush biopsy, 42 of saliva-based oral diagnosis, and 115 of optical biopsy. Sixty nine of these studies were assessed by the modified version of the QUADAS instrument. Saliva-based oral cancer diagnosis and optical biopsy were found to be promising noninvasive methods for diagnosing OSCC.

Limitation

The strength of evidence was rated low for accuracy outcomes because the studies did not report important details required to assess the risk for bias.

Conclusions

It is clear that screening for and early detection of cancer and pre-cancerous lesions have the potential to reduce the morbidity and mortality of this disease. Advances in technologies for saliva-based oral diagnosis and optical biopsy are promising pathways for the future development of more effective noninvasive methods for diagnosing OSCC that are easy to perform clinically in primary care settings.

Polarised stereo endoscope and narrowband detection for minimal access surgery

Polarisation imaging has the potential to provide enhanced contrast based on variations in the optical properties, such as scattering or birefringence, of the tissue of interest. Examining the signal at different wavebands in the visible spectrum also allows interrogation of different depths and structures. A stereo endoscope has been adapted to allow snapshot acquisition of orthogonal linear polarisation images to generate difference of linear polarisation images. These images are acquired in three narrow bands using a triple-bandpass filter and pair of colour cameras. The first in vivo results, acquired during a surgical procedure on a porcine subject, are presented that show wavelength dependent variations in vessel visibility and an increase in contrast under polarised detection.

Assessment of local structural disorders of the bladder wall in partial bladder outlet obstruction using polarized light imaging

Partial bladder outlet obstruction causes prominent morphological changes in the bladder wall, which leads to bladder dysfunction. In this paper, we demonstrate that polarized light imaging can be used to identify the location of obstruction induced structural changes that other imaging modalities fail to detect. We induced 2-week and 6-week partial outlet obstruction in rats, harvested obstructed bladders, then measured their retardances while distended to high pressures and compared them to controls. Our results show that the retardance of the central part of the ventral side (above the ureters) closer to the urethra can be used as a potential metric of the distending bladder obstruction.

Narrow band 3 × 3 Mueller polarimetric endoscopy

Mueller matrix polarimetric imaging has shown potential in tissue diagnosis but is challenging to implement endoscopically. In this work, a narrow band 3 × 3 Mueller matrix polarimetric endoscope was designed by rotating the endoscope to generate 0°, 45° and 90° linearly polarized illumination and positioning a rotating filter wheel in front of the camera containing three polarisers to permit polarization state analysis for backscattered light. The system was validated with a rotating linear polarizer and a diffuse reflection target. Initial measurements of 3 × 3 Mueller matrices on a rat are demonstrated, followed by matrix decomposition into the depolarization and retardance matrices for further analysis. Our work shows the feasibility of implementing polarimetric imaging in a rigid endoscope conveniently and economically in order to reveal diagnostic information.

Multispectral image alignment using a three channel endoscope in vivo during minimally invasive surgery

Sequential multispectral imaging is an acquisition technique that involves collecting images of a target at different wavelengths, to compile a spectrum for each pixel. In surgical applications it suffers from low illumination levels and motion artefacts. A three-channel rigid endoscope system has been developed that allows simultaneous recording of stereoscopic and multispectral images. Salient features on the tissue surface may be tracked during the acquisition in the stereo cameras and, using multiple camera triangulation techniques, this information used to align the multispectral images automatically even though the tissue or camera is moving. This paper describes a detailed validation of the set-up in a controlled experiment before presenting the first in vivo use of the device in a porcine minimally invasive surgical procedure. Multispectral images of the large bowel were acquired and used to extract the relative concentration of haemoglobin in the tissue despite motion due to breathing during the acquisition. Using the stereoscopic information it was also possible to overlay the multispectral information on the reconstructed 3D surface. This experiment demonstrates the ability of this system for measuring blood perfusion changes in the tissue during surgery and its potential use as a platform for other sequential imaging modalities.