Phase unwrapping using deep learning in holographic tomography

Holographic tomography (HT) is a measurement technique that generates phase images, often containing high noise levels and irregularities. Due to the nature of phase retrieval algorithms within the HT data processing, the phase has to be unwrapped before tomographic reconstruction. Conventional algorithms lack noise robustness, reliability, speed, and possible automation. In order to address these problems, this work proposes a convolutional neural network based pipeline consisting of two steps: denoising and unwrapping. Both steps are carried out under the umbrella of a U-Net architecture; however, unwrapping is aided by introducing Attention Gates (AG) and Residual Blocks (RB) to the architecture. Through the experiments, the proposed pipeline makes possible the phase unwrapping of highly irregular, noisy, and complex experimental phase images captured in HT. This work proposes phase unwrapping carried out by segmentation with a U-Net network, that is aided by a pre-processing denoising step. It also discusses the implementation of the AGs and RBs in an ablation study. What is more, this is the first deep learning based solution that is trained solely on real images acquired with HT.

Influence of Yokukansan on the refractive index of neuroblastoma cells

Yokukansan (YKS) is a traditional Japanese herbal medicine that is increasingly being studied for its effects on neurodegenerative diseases. In our study, we presented a novel methodology for a multimodal analysis of the effects of YKS on nerve cells. The measurements of 3D refractive index distribution and its changes performed by holographic tomography were supported with an investigation by Raman micro-spectroscopy and fluorescence microscopy to gather complementary morphological and chemical information about cells and YKS influence. It was shown that at the concentrations tested, YKS inhibits proliferation, possibly involving reactive oxygen species. Also substantial changes in the cell RI after few hours of YKS exposure were detected, followed by longer-term changes in cell lipid composition and chromatin state.

3D scattering microphantom sample to assess quantitative accuracy in tomographic phase microscopy techniques

In this paper we present a structurally-complex biomimetic scattering structure, fabricated with two-photon polymerization, and utilize this object in order to benchmark a computational imaging system. The phantom allows to tailor the scattering by modifying its degrees of freedom i.e. refractive index contrast and scattering layer dimensions and incorporates a 3D imaging quality test, representing a single cell within tissue. While the sample may be used with multiple 3D microscopy techniques, we demonstrate the impact of scattering on three tomographic phase microscopy (TPM) reconstruction methods. One of these methods assumes the sample to be weak-scattering, while the other two take multiple scattering into account. The study is performed at two wavelengths (visible and near-infrared), which serve as a scaling factor for the scattering phenomenon. We find that changing the wavelength from visible into near-infrared impacts the applicability of TPM reconstruction methods. As a result of reduced scattering in near-infrared region, the multiple-scattering-oriented techniques perform in fact worse than a method aimed for weak-scattering samples. This implies a necessity of selecting proper approach depending on sample's scattering characteristics even in case of subtle changes in the object-light interaction.

Near-infrared, wavelength, and illumination scanning holographic tomography

We present a holographic tomography technique in which the projections are acquired using both wavelength and illumination scanning in the near-infrared region. We show how to process the acquired data to obtain correct values of three-dimensional refractive index distributions in both single-wavelength and multi-wavelength data acquisition schemes and how to properly account for the dispersion of the sample. We perform numerical and experimental comparisons of different illumination scenarios to determine the most efficient measurement protocol. We show that the multi-wavelength protocol is advantageous in terms of signal-to-noise ratio and contrast-to-noise ratio over single-wavelength protocols, even for the same number of projections used for reconstructions. Finally, we show that this approach is suitable for providing high-quality refractive index distributions of relatively thick colon cancer samples.

Numerical refractive index correction for the stitching procedure in tomographic quantitative phase imaging

Tomographic quantitative phase imaging (QPI) lacks an absolute refractive index value baseline, which poses a problem when large dense objects extending over multiple fields of view are measured volume by volume and stitched together. Some of the measurements lack the natural baseline value that is provided by the mounting medium with a known refractive index. In this work, we discuss the problem of the refractive index (RI) baseline of individual reconstructed volumes that are deprived of access to mounting medium due to the extent of the object. The solution of this problem is provided by establishing the RI offsets based on the overlapping regions. We have proven that the process of finding the offset RI values may be justifiably reduced to the analogous procedure in the 2D baseline correction (2D-BC). Finally, we proposed the enhancement of the state-of-the-art 2D-BC procedure previously introduced in the context of 2D QPI. The processing is validated at the examples of a synthetic dataset and a liver organoid.

Method to analyze effects of low-level laser therapy on biological cells with a digital holographic microscope

Low-level laser therapy (LLLT) is a therapeutic tool that uses the photobiochemical interaction between light and tissue. Its effectiveness is controversial due to a strong dependence on dosimetric parameters. In this work, we demonstrate that digital holographic microscopy is an effective label-free imaging technique to analyze the effects of LLLT on biological cells, and we propose the full methodology to create correct synthetic aperture phase maps for further extensive, highly accurate statistical analysis. The proposed methodology has been designed to provide a basis for many other biological experiments using quantitative phase imaging. We use SHSY-5Y and HaCaT cells irradiated with different doses of red light for the experiment. The analysis shows quantitative changes in cell dry mass density and the projected cell surface in response to different radiation doses.

Off-axis image plane hologram compression in holographic tomography - metrological assessment

In this paper, we present a novel study on the impact of lossy data compression on the metrological properties of holographic tomography reconstruction of the refractive index (RI). We use a spatial bandwidth-optimized compression procedure that leverages the properties of image plane off-axis holograms and standardized compression codecs, both widely applied in research and industry. The compression procedure is tested at multiple bitrates, for four different objects and against three reconstruction algorithms. The metrological evaluation is primarily done by comparison to the reconstruction from original data using the root-mean-squared error (RMSE). We show that due to differences between objects and different noise sensitivities of the reconstruction algorithms, the rate-distortion behaviour varies, but in most cases allows for the compression below 1 bit per pixel, while maintaining an RI RMSE less than 10^-4.

Preprocessing methods for quantitative phase image stitching

Quantitative phase imaging of cell cultures and histopathological slides often requires measurements in large fields of view which is realized through the stitching of multiple high resolution phase maps. Due to the characteristic properties of phase images, careful preprocessing is crucial for maintaining the metrological value of the stitched phase image. In this work, we present various methods that address those properties. Our efforts are focused on increasing robustness to minimize error propagation in consecutive preprocessing steps.

Common-path intrinsically achromatic optical diffraction tomography

In this work we propose an open-top like common-path intrinsically achromatic optical diffraction tomography system. It operates as a total-shear interferometer and employs Ronchi-type amplitude diffraction grating, positioned in between the camera and the tube lens without an additional 4f system, generating three-beam interferograms with achromatic second harmonic. Such configuration makes the proposed system low cost, compact and immune to vibrations. We present the results of the measurements of 3D-printed cell phantom using laser diode (coherent) and superluminescent diode (partially coherent) light sources. Broadband light sources can be naturally employed without the need for any cumbersome compensation because of the intrinsic achromaticity of the interferometric recording (holograms generated by -1st and +1st conjugated diffraction orders are not affected by the illumination wavelength). The results show that the decreased coherence offers much reduced coherent noise and higher fidelity tomographic reconstruction especially when applied nonnegativity constraint regularization procedure.

Holographic tomography: techniques and biomedical applications [Invited]

Holographic tomography (HT) is an advanced label-free optical microscopic imaging method used for biological studies. HT uses digital holographic microscopy to record the complex amplitudes of a biological sample as digital holograms and then numerically reconstruct the sample's refractive index (RI) distribution in three dimensions. The RI values are a key parameter for label-free bio-examination, which correlate with metabolic activities and spatiotemporal distribution of biophysical parameters of cells and their internal organelles, tissues, and small-scale biological objects. This article provides insight on this rapidly growing HT field of research and its applications in biology. We present a review summary of the HT principle and highlight recent technical advancement in HT and its applications.

Refractive Index Changes of Cells and Cellular Compartments Upon Paraformaldehyde Fixation Acquired by Tomographic Phase Microscopy

Three-dimensional quantitative phase imaging is an emerging method, which provides the 3D distribution of the refractive index (RI) and the dry mass in live and fixed cells as well as in tissues. However, an insufficiently answered question is the influence of chemical cell fixation procedures on the results of RI reconstructions. Therefore, this work is devoted to systematic investigations on the RI in cellular organelles of live and fixed cells including nucleus, nucleolus, nucleoplasm, and cytoplasm. The research was carried out on four different cell lines using a common paraformaldehyde (PFA)-based fixation protocol. The selected cell types represent the diversity of mammalian cells and therefore the results presented provide a picture of fixation caused RI changes in a broader context. A commercial Tomocube HT-1S device was used for 3D RI acquisition. The changes in the RI values after the fixation process are detected in the reconstructed phase distributions and amount to the order of 10-3 . The RI values decrease and the observed RI changes are found to be different between various cell lines; however, all of them show the most significant loss in the nucleolus. In conclusion, our study demonstrates the evident need for standardized preparation procedures in phase tomographic measurements. © 2020 The Authors. Cytometry Part A published by Wiley Periodicals LLC. on behalf of International Society for Advancement of Cytometry.

Spatial bandwidth-optimized compression of image plane off-axis holograms with image and video codecs

Image plane off-axis holograms (IP-OAH) are the most common data captured in digital holographic microscopy and tomography. Due to increasing storage and data transmission requirements, lossy compression of such holograms has been subject of earlier investigations. However, hologram compression can not be allowed to hinder the metrological capabilities of the measurement technique itself. In this work, we present lossy and lossless IP-OAH compression approaches that are based on conventional compression codecs, but optimized with regard to bandwidth of the signal. Both approaches outperform respective conventional codecs, while the lossy approach is shown to uphold the accuracy of holographic phase measurements.

Holographic tomography with scanning of illumination: space-domain reconstruction for spatially invariant accuracy

The paper presents two novel, space-domain reconstruction algorithms for holographic tomography utilizing scanning of illumination and a fixed detector that is highly suitable for imaging of living biomedical specimens. The first proposed algorithm is an adaptation of the filtered backpropagation to the scanning illumination tomography. Its space-domain implementation enables avoiding the error-prone interpolation in the Fourier domain, which is a significant problem of the state-of-the-art tomographic algorithm. The second proposed algorithm is a modified version of the former, which ensures the spatially invariant reconstruction accuracy. The utility of the proposed algorithms is demonstrated with numerical simulations and experimental measurement of a cancer cell.

Generalized total variation iterative constraint strategy in limited angle optical diffraction tomography

Due to incompleteness of input data inherent to Limited Angle Tomography (LAT), specific additional constraints are usually employed to suppress image artifacts. In this work we demonstrate a new two-stage regularization strategy, named Generalized Total Variation Iterative Constraint (GTVIC), dedicated to semi-piecewise-constant objects. It has been successfully applied as a supplementary module for two different reconstruction algorithms: an X-ray type solver and a diffraction-wise solver. Numerical tests performed on a detailed phantom of a biological cell under conical illumination pattern show significant reduction of axial blurring in the reconstructed refractive index distribution after GTVIC is added. Analogous results were obtained with experimental data.

Novel Perspectives on the Characterization of Species-Dependent Optical Signatures of Bacterial Colonies by Digital Holography

The use of light diffraction for the microbiological diagnosis of bacterial colonies was a significant breakthrough with widespread implications for the food industry and clinical practice. We previously confirmed that optical sensors for bacterial colony light diffraction can be used for bacterial identification. This paper is focused on the novel perspectives of this method based on digital in-line holography (DIH), which is able to reconstruct the amplitude and phase properties of examined objects, as well as the amplitude and phase patterns of the optical field scattered/diffracted by the bacterial colony in any chosen observation plane behind the object from single digital hologram. Analysis of the amplitude and phase patterns inside a colony revealed its unique optical properties, which are associated with the internal structure and geometry of the bacterial colony. Moreover, on a computational level, it is possible to select the desired scattered/diffracted pattern within the entire observation volume that exhibits the largest amount of unique, differentiating bacterial features. These properties distinguish this method from the already proposed sensing techniques based on light diffraction/scattering of bacterial colonies. The reconstructed diffraction patterns have a similar spatial distribution as the recorded Fresnel patterns, previously applied for bacterial identification with over 98% accuracy, but they are characterized by both intensity and phase distributions. Our results using digital holography provide new optical discriminators of bacterial species revealed in one single step in form of new optical signatures of bacterial colonies: digital holograms, reconstructed amplitude and phase patterns, as well as diffraction patterns from all observation space, which exhibit species-dependent features. To the best of our knowledge, this is the first report on bacterial colony analysis via digital holography and our study represents an innovative approach to the subject.

Accurate approach to capillary-supported optical diffraction tomography

A new holographic data processing path for accurate quantitative tomographic reconstruction of 3D samples placed in a cylindrical capillary is proposed. The method considers strong unintentional focusing effects induced by the inner cylindrical boundary of the vessel: 1) introduction of cylindrical wave illumination of a sample, and 2) object wave deformation. The first issue is addressed by developing an arbitrary illumination tomographic reconstruction algorithm based on filtered backpropagation, while the second by a novel correction algorithm utilizing the optical rays analysis. Moreover, the processing path includes a novel holographic method for correction of spherical aberration related to refraction at a planar surface. Utility of the developed data processing path is proven with numerical simulations and experimental measurement of a specially prepared test sample.

Tomographic phase microscopy of living three-dimensional cell cultures

A successful application of self-interference digital holographic microscopy in combination with a sample-rotation-based tomography module for three-dimensional (3-D) label-free quantitative live cell imaging with subcellular resolution is demonstrated. By means of implementation of a hollow optical fiber as the sample cuvette, the observation of living cells in different 3-D matrices is enabled. The fiber delivers a stable and accurate rotation of a cell or cell cluster, providing quantitative phase data for tomographic reconstruction of the 3-D refractive index distribution with an isotropic spatial resolution. We demonstrate that it is possible to clearly distinguish and quantitatively analyze several cells grouped in a "3-D cluster" as well as subcellular organelles like the nucleoli and local internal refractive index changes.

Application of 3D digital image correlation to track displacements and strains of canvas paintings exposed to relative humidity changes

This paper introduces a methodology for tracking displacements in canvas paintings exposed to relative humidity changes. Displacements are measured by means of the 3D digital image correlation method that is followed by a postprocessing of displacement data, which allows the separation of local displacements from global displacement maps. The applicability of this methodology is tested on measurements of a model painting on canvas with introduced defects causing local inhomogeneity. The method allows the evaluation of conservation methods used for repairing canvas supports.

Noise suppressed optical diffraction tomography with autofocus correction

We propose a novel tomographic measurement approach that enables a noise suppressed characterization of microstructures. The idea of this work is based on a finding that coherent noise in the input phase data generates an artificial circular structure whose magnitude is the highest at the centre of tomographic reconstruction. This method decreases the noise level by applying an unconventional tomographic measurement configuration with an object deliberately shifted with respect to the rotation axis. This enables a spatial separation between the reconstructed sample structure and the area of the largest refractive index perturbations. The input phase data defocusing that is a by-product of the introduced modification is numerically corrected with an automatic focus correction algorithm. The proposed method is validated with simulations and experimental measurements of an optical microtip.

Degeneration of Fraunhofer diffraction on bacterial colonies due to their light focusing properties examined in the digital holographic microscope system

The degeneration of Fraunhofer diffraction conditions in the optical system with converging spherical wave illumination for bacteria species identification based on diffraction patterns is analyzed by digital holographic methods. The obtained results have shown that the colonies of analyzed bacteria species act as biological lenses with the time-dependent light focusing properties, which are characterized and monitored by means of phase retrieval from sequentially captured digital holograms. This significantly affects the location of Fraunhofer patterns observation plane, which is continuously shifted across optical axis in time.

Wide angle holographic display system with spatiotemporal multiplexing

This paper presents a wide angle holographic display system with extended viewing angle in both horizontal and vertical directions. The display is constructed from six spatial light modulators (SLM) arranged on a circle and an additional SLM used for spatiotemporal multiplexing and a viewing angle extension in two perpendicular directions. The additional SLM, that is synchronized with the SLMs on the circle is placed in the image space. This method increases effective space bandwidth product of display system data from 12.4 to 50 megapixels. The software solution based on three Nvidia graphic cards is developed and implemented in order to achieve fast and synchronized displaying. The experiments presented for both synthetic and real 3D data prove the possibility to view binocularly having good quality images reconstructed in full FoV of the display.

Extended viewing angle holographic display system with tilted SLMs in a circular configuration

This paper presents an extended viewing angle holographic display for reconstruction of real world objects in which the capture and display systems are decoupled. This is achieved by employing multiple tilted spatial light modulators (SLMs) arranged in a circular configuration. In order to prove the proper reconstruction and visual perception of holographic images the Wigner distribution function is employed. We describe both the capture system using a single static camera with a rotating object and a holographic display utilizing six tilted SLMs. The experimental results based on the reconstruction of computer generated and real world scenes are presented. The coherent noise removal procedure is described and implemented. The experiments prove the possibility to view images reconstructed in the display binocularly and with good quality.

Integrated microinterferometric sensor for in-plane displacement measurement

We present an integrated sensor based on a grating interferometer (GI) for in-plane displacement measurement in microregions of large engineering structures. The system concept and design, based on a monolithic version of Czarnek's GI, is discussed in detail. The technology chain of the GI measurement head (MH), including the master fabrication and further replication by means of hot embossing, is described. The numerical analyses of the MH by means of geometric ray tracing and scalar wave propagation are provided. They allow us to determine geometrical tolerance values as well as refractive index homogeneity and nonflatness of MH working surfaces, which provide proper beam guiding. Finally the demonstrative measurement performed with a model of the sensor is presented.

Reconstruction of refractive-index distribution in off-axis digital holography optical diffraction tomographic system

In the paper the optical diffraction tomographic system for reconstruction of the internal refractive index distribution in optical fiber utilizing grating Mach-Zehnder interferometer configuration is explored. The setup applies afocal imaging. Conventional grating application gives, however, highly aberrated object beam producing incorrect refractive-index reconstructions. The grating inherent aberrations are characterized, its influence on both image projections and refractive index reconstructions is presented. To remove aberrations and enable tomographic reconstruction a novel digital holographic algorithm, correcting optical system imaging, is developed. The algorithm uses plane wave spectrum decomposition of optical field for solving diffraction problem between parallel and tilted planes and enabling correction of imaging system aberrations. The algorithm concept was successfully proved in simulations and the experiment.