Digital holography and its multidimensional imaging applications: a review

Roadmap on computational methods in optical imaging and holography [invited]

Computational methods have been established as cornerstones in optical imaging and holography in recent years. Every year, the dependence of optical imaging and holography on computational methods is increasing significantly to the extent that optical methods and components are being completely and efficiently replaced with computational methods at low cost. This roadmap reviews the current scenario in four major areas namely incoherent digital holography, quantitative phase imaging, imaging through scattering layers, and super-resolution imaging. In addition to registering the perspectives of the modern-day architects of the above research areas, the roadmap also reports some of the latest studies on the topic. Computational codes and pseudocodes are presented for computational methods in a plug-and-play fashion for readers to not only read and understand but also practice the latest algorithms with their data. We believe that this roadmap will be a valuable tool for analyzing the current trends in computational methods to predict and prepare the future of computational methods in optical imaging and holography.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00340-024-08280-3.

In-situ detection of microplastics in the aquatic environment: A systematic literature review

Microplastics are ubiquitous in the aquatic environment and have emerged as a significant environmental issue due to their potential impacts on human health and the ecosystem. Current laboratory-based microplastic detection methods suffer from various drawbacks, including a lack of standardisation, limited spatial and temporal coverage, high costs, and time-consuming procedures. Consequently, there is a need for the development of in-situ techniques to detect and monitor microplastics to effectively identify and understand their sources, pathways, and behaviours. Herein, we adopt a systematic literature review method to assess the development and application of experimental and field technologies designed for the in-situ detection and monitoring of aquatic microplastics, without the need for sample preparation. Four scientific databases were searched in March 2023, resulting in a review of 62 relevant studies. These studies were classified into seven sensor categories and their working principles were discussed. The sensor classes include optical devices, digital holography, Raman spectroscopy, other spectroscopy, hyperspectral imaging, remote sensing, and other methods. We also looked at how data from these technologies are integrated with machine learning models to develop classifiers capable of accurately characterising the physical and chemical properties of microplastics and discriminating them from other particles. This review concluded that in-situ detection of microplastics in aquatic environments is feasible and can be achieved with high accuracy, even though the methods are still in the early stages of development. Nonetheless, further research is still needed to enhance the in-situ detection of microplastics. This includes exploring the possibility of combining various detection methods and developing robust machine-learning classifiers. Additionally, there is a recommendation for in-situ implementation of the reviewed methods to assess their effectiveness in detecting microplastics and identify their limitations.

Extending the Depth of Focus of an Infrared Microscope Using a Binary Axicon Fabricated on Barium Fluoride

Axial resolution is one of the most important characteristics of a microscope. In all microscopes, a high axial resolution is desired in order to discriminate information efficiently along the longitudinal direction. However, when studying thick samples that do not contain laterally overlapping information, a low axial resolution is desirable, as information from multiple planes can be recorded simultaneously from a single camera shot instead of plane-by-plane mechanical refocusing. In this study, we increased the focal depth of an infrared microscope non-invasively by introducing a binary axicon fabricated on a barium fluoride substrate close to the sample. Preliminary results of imaging the thick and sparse silk fibers showed an improved focal depth with a slight decrease in lateral resolution and an increase in background noise.

Acousto-optic holography for pseudo-two-dimensional dynamic light patterning

Optical systems use acousto-optic deflectors (AODs) mostly for fast angular scanning and spectral filtering of laser beams. However, AODs may transform laser light in much broader ways. When time-locked to the pulsing of low repetition rate laser amplifiers, AODs permit the holographic reconstruction of 1D and pseudo-two-dimensional (ps2D) intensity objects of rectangular shape by controlling the amplitude and phase of the light field at high (20-200 kHz) rates for microscopic light patterning. Using iterative Fourier transformations (IFTs), we searched for AOD-compatible holograms to reconstruct the given ps2D target patterns through either phase-only or complex light field modulation. We previously showed that phase-only holograms can adequately render grid-like patterns of diffraction-limited points with non-overlapping diffraction orders, while side lobes to the target pattern can be cured with an apodization mask. Dense target patterns, in contrast, are typically encumbered by apodization-resistant speckle noise. Here, we show the denoised rendering of dense ps2D objects by complex acousto-optic holograms deriving from simultaneous optimization of the amplitude and phase of the light field. Target patterns lacking ps2D symmetry, although not translatable into single holograms, were accessed by serial holography based on a segregation into ps2D-compatible components. The holograms retrieved under different regularizations were experimentally validated in an AOD random-access microscope. IFT regularizations characterized in this work extend the versatility of acousto-optic holography for fast dynamic light patterning.

Common-path digital holographic microscopy based on a volume holographic grating for quantitative phase imaging

Digital holographic microscopy (DHM) is a powerful quantitative phase imaging (QPI) technique that is capable of recording sample's phase information to enhance image contrast. In off-axis DHM, high-quality QPI images can be generated within a single recorded hologram, and the system stability can be enhanced by common-path configuration. Diffraction gratings are widely used components in common-path DHM systems; however, the presence of multiple diffraction beams leads to system power loss. Here, we propose and demonstrate implementation of a volume holographic grating (VHG) in common-path DHM, which provides single diffraction order. VHG in common-path DHM (i.e., VHG-DHM) helps in improving signal-to-noise ratio as compared to the conventional DHM. In addition, VHG, with inherently high angular selectivity, reduces image noise caused by stray light. With a simple fabrication process, it is convenient to utilize VHG to control the beam separation angle of DHM. Further, by using Bragg-matched wavelength degeneracy to avoid potential cell damaging effect in blue light, the VHG is designed for recording at a maximum sensitive wavelength of ∼488 nm, while our VHG-DHM is operated at the longer wavelength of red 632.8 nm for cell observation. Experimental results, measured by the VHG-DHM, show the measurement of target thickness ranging from 100 nm to 350 nm. In addition, stability of the system is quantitatively measured. High-contrast QPI images of human lung cancer cells are demonstrated.

Rationalized diffraction calculations for high accuracy and high speed with few bits

Diffraction calculations in few-bit formats, such as single-precision floating-point and fixed-point numbers, are important because they yield faster calculations and lower memory usage. However, these methods suffer from low accuracy owing to the loss of trailing digits. Fresnel diffraction is widely known to prevent the loss of trailing digits. However, it can only be used when the paraxial approximation is valid. In this study, a few-bit diffraction calculation method that achieves high accuracy without using any approximation is proposed. The proposed method is derived only by rationalizing the numerator of conventional formulas. Even for scenarios requiring double-precision floating-point numbers using conventional methods, the proposed method exhibits higher accuracy and faster computation time using single-precision floating-point numbers.

A dataset of digital holograms of normal and thalassemic cells

Digital holographic microscopy (DHM) is an intriguing medical diagnostic tool due to its label-free and quantitative nature, providing high-contrast images of phase samples. By capturing both intensity and phase information, DHM enables the numerical reconstruction of quantitative phase images. However, the lateral resolution is limited by the diffraction limit, which prompted the recent suggestion of microsphere-assisted DHM to enhance the DHM resolution straightforwardly. The use of such a technique as a medical diagnostic tool requires testing and validation of the proposed assays to prove their feasibility and viability. This paper publishes 760 and 609 microsphere-assisted DHM images of normal and thalassemic red blood cells obtained from a normal and thalassemic male individual, respectively.

Three-dimensional imaging in reflection phase microscopy with minimal axial scanning

Reflection phase microscopy is a valuable tool for acquiring three-dimensional (3D) images of objects due to its capability of optical sectioning. The conventional method of constructing a 3D map is capturing 2D images at each depth with a mechanical scanning finer than the optical sectioning. This not only compromises sample stability but also slows down the acquisition process, imposing limitations on its practical applications. In this study, we utilized a reflection phase microscope to acquire 2D images at depth locations significantly spaced apart, far beyond the range of optical sectioning. By employing a numerical propagation, we successfully filled the information gap between the acquisition layers, and then constructed complete 3D maps of objects with substantially reduced number of axial scans. Our experimental results also demonstrated the effectiveness of this approach in enhancing imaging speed while maintaining the accuracy of the reconstructed 3D structures. This technique has the potential to improve the applicability of reflection phase microscopy in diverse fields such as bioimaging and material science.

Quantitative Three-dimensional Label-free Digital Holographic Imaging of Cardiomyocyte Size, Ploidy, and Cell Division

Cardiac regeneration in newborn rodents depends on the ability of pre-existing cardiomyocytes to proliferate and divide. This capacity is lost within the first week of postnatal development when these cells rapidly switch from hyperplasia to hypertrophy, withdraw from the cell cycle, become binucleated, and increase in size. How these dynamic changes in size and ploidy impact cardiomyocyte proliferative potential is not well understood. In this study, we innovate the application of a commercially available digital holographic imaging microscope, the Holomonitor M4, to evaluate the proliferative responses of mononucleated diploid and binucleated tetraploid cardiomyocytes. This instrument coupled with the powerful Holomonitor App Suite software enables long-term label-free quantitative three-dimensional tracking of primary cardiomyocyte dynamics in real-time with single-cell resolution. Our digital holographic imaging results provide direct evidence that mononucleated cardiomyocytes retain significant proliferative potential as most can successfully divide with high frequency. In contrast, binucleated cardiomyocytes exhibit a blunted response to a proliferative stimulus with the majority not attempting to divide at all. Nevertheless, some binucleated cardiomyocytes were capable of complete division, suggesting that these cells still do retain limited proliferative capacity. By quantitatively tracking cardiomyocyte volume dynamics during these proliferative responses, we reveal that both mononucleated and binucleated cells reach a unique size threshold prior to attempted cell division. The absolute threshold is increased by binucleation, which may limit the ability of binucleated cardiomyocytes to divide. By defining the interrelationship between cardiomyocyte size, ploidy, and cell cycle control, we will better understand the cellular mechanisms that drive the loss of mammalian cardiac regenerative capacity after birth.

Multiplexed digital holography for fluid surface profilometry

Digital holography (DH) has been widely used for imaging and characterization of microstructures and nanostructures in materials science and biology and also has the potential to provide high-resolution, nondestructive measurement of fluid surfaces. DH setups capture the complex wavefronts of light scattered by an object or reflected from a surface, allowing the quantitative measurements of their shape and deformation. However, their use in fluid profilometry is scarce and has not been explored in much depth to the best of our knowledge. We present an alternative use for a DH setup that can measure and monitor the surface of fluid samples. Based on DH reflectometry, our modeling shows that multiple reflections from the sample and the reference interfere and generate multiple holograms of the sample, resulting in a multiplexed image of the wavefront. The individual interferograms can be isolated in the spatial frequency domain, and the fluid surface can be digitally reconstructed from them. We further show that this setup can be used to track changes in the surface of a fluid over time, such as during the formation and propagation of waves or the evaporation of surface layers.

Randomness assisted in-line holography with deep learning

We propose and demonstrate a holographic imaging scheme exploiting random illuminations for recording hologram and then applying numerical reconstruction and twin image removal. We use an in-line holographic geometry to record the hologram in terms of the second-order correlation and apply the numerical approach to reconstruct the recorded hologram. This strategy helps to reconstruct high-quality quantitative images in comparison to the conventional holography where the hologram is recorded in the intensity rather than the second-order intensity correlation. The twin image issue of the in-line holographic scheme is resolved by an unsupervised deep learning based method using an auto-encoder scheme. Proposed learning technique leverages the main characteristic of autoencoders to perform blind single-shot hologram reconstruction, and this does not require a dataset of samples with available ground truth for training and can reconstruct the hologram solely from the captured sample. Experimental results are presented for two objects, and a comparison of the reconstruction quality is given between the conventional inline holography and the one obtained with the proposed technique.

Adaptive constraints by morphological operations for single-shot digital holography

Digital holography provides access to quantitative measurement of the entire complex field, which is indispensable for the investigation of wave-matter interactions. The emerging iterative phase retrieval approach enables to solve the inverse imaging problem only from the given intensity measurements and physical constraints. However, enforcing imprecise constraints limits the reconstruction accuracy and convergence speed. Here, we propose an advanced iterative phase retrieval framework for single-shot in-line digital holography that incorporates adaptive constraints, which achieves optimized convergence behavior, high-fidelity and twin-image-free reconstruction. In conjunction with morphological operations which can extract the object structure while eliminating the irrelevant part such as artifacts and noise, adaptive constraints allow the support region to be accurately estimated and automatically updated at each iteration. Numerical reconstruction of complex-valued objects and the capability of noise immunity are investigated. The improved reconstruction performance of this approach is experimentally validated. Such flexible and versatile framework has promising applications in biomedicine, X-ray coherent diffractive imaging and wavefront sensing.

Synchronous Phase-Shifting Interference for High Precision Phase Imaging of Objects Using Common Optics

Quantitative phase imaging and measurement of surface topography and fluid dynamics for objects, especially for moving objects, is critical in various fields. Although effective, existing synchronous phase-shifting methods may introduce additional phase changes in the light field due to differences in optical paths or need specific optics to implement synchronous phase-shifting, such as the beamsplitter with additional anti-reflective coating and a micro-polarizer array. Therefore, we propose a synchronous phase-shifting method based on the Mach-Zehnder interferometer to tackle these issues in existing methods. The proposed method uses common optics to simultaneously acquire four phase-shifted digital holograms with equal optical paths for object and reference waves. Therefore, it can be used to reconstruct the phase distribution of static and dynamic objects with high precision and high resolution. In the experiment, the theoretical resolution of the proposed system was 1.064 µm while the actual resolution could achieve 1.381 µm, which was confirmed by measuring a phase-only resolution chart. Besides, the dynamic phase imaging of a moving standard object was completed to verify the proposed system's effectiveness. The experimental results show that our proposed method is suitable and promising in dynamic phase imaging and measurement of moving objects using phase-shifting digital holography.

Fringe pattern analysis to evaluate light sources and sensors in digital photoelasticity

When experimental photoelasticity images are acquired, the spectral interaction between the light source and the sensor used affect the visual information of the fringe patterns in the produced images. Such interaction can lead to fringe patterns with an overall high quality, but also can lead to images with indistinguishable fringes, and bad stress field reconstruction. We introduce a strategy to evaluate such interaction that relies on measuring the value of four handcrafted descriptors: contrast, an image descriptor that accounts simultaneously for blur and noise, a Fourier-based descriptor to measure image quality, and image entropy. The utility of the proposed strategy was validated by measuring the selected descriptors on computational photoelasticity images, and the fringe orders achieved when evaluating the stress field, from 240 spectral configurations: 24 light sources and 10 sensors. We found that high values of the selected descriptors can be related to spectral configurations that lead to better stress field reconstruction. Overall, the results show that the selected descriptors can be useful to identify bad and good spectral interactions, which could help to design better protocols for acquiring photoelasticity images.

Toward immersive communications in 6G

The sixth generation (6G) networks are expected to enable immersive communications and bridge the physical and the virtual worlds. Integrating extended reality, holography, and haptics, immersive communications will revolutionize how people work, entertain, and communicate by enabling lifelike interactions. However, the unprecedented demand for data transmission rate and the stringent requirements on latency and reliability create challenges for 6G networks to support immersive communications. In this survey article, we present the prospect of immersive communications and investigate emerging solutions to the corresponding challenges for 6G. First, we introduce use cases of immersive communications, in the fields of entertainment, education, and healthcare. Second, we present the concepts of immersive communications, including extended reality, haptic communication, and holographic communication, their basic implementation procedures, and their requirements on networks in terms of transmission rate, latency, and reliability. Third, we summarize the potential solutions to addressing the challenges from the aspects of communication, computing, and networking. Finally, we discuss future research directions and conclude this study.

Single-shot self-supervised object detection in microscopy

Object detection is a fundamental task in digital microscopy, where machine learning has made great strides in overcoming the limitations of classical approaches. The training of state-of-the-art machine-learning methods almost universally relies on vast amounts of labeled experimental data or the ability to numerically simulate realistic datasets. However, experimental data are often challenging to label and cannot be easily reproduced numerically. Here, we propose a deep-learning method, named LodeSTAR (Localization and detection from Symmetries, Translations And Rotations), that learns to detect microscopic objects with sub-pixel accuracy from a single unlabeled experimental image by exploiting the inherent roto-translational symmetries of this task. We demonstrate that LodeSTAR outperforms traditional methods in terms of accuracy, also when analyzing challenging experimental data containing densely packed cells or noisy backgrounds. Furthermore, by exploiting additional symmetries we show that LodeSTAR can measure other properties, e.g., vertical position and polarizability in holographic microscopy.

The Expanding Uses of Medical Extended Reality in the Cardiac Catheterization Laboratory: Pre-procedural Planning, Intraprocedural Guidance, and Intraprocedural Navigation

The use of innovative imaging practices in the field of interventional cardiology and electrophysiology has led to significant progress in both diagnostic and therapeutic capabilities. 3D reconstructions of 2D images allows a proceduralist to develop a superior understanding of patient anatomy. Medical extended reality (MXR) technologies employ 3D interactive images for the user to improve depth perception and spatial awareness. Although MXR procedural navigation is a relatively new concept, the potential for use within interventional cardiology and EP is significant with the eventual goal of improving patient outcomes and reducing patient harm. This review article will discuss the current landscape of MXR use in the catheterization lab including pre-procedural planning, intraprocedural planning and intraprocedural guidance in diagnostic cardiac catheterization, valvar and coronary interventions, electrophysiology studies, and device implants.

Genetic algorithm based image reconstruction applying the digital holography process with the Discrete Orthonormal Stockwell Transform technique for diagnosis of COVID-19

World Health Organization has described the real-time reverse transcription-polymerase chain reaction test method for the diagnosis of the novel coronavirus disease (COVID-19). However, the limited number of test kits, the long-term results of the tests, the high probability of the disease spreading during the test and imaging without focused images necessitate the use of alternative diagnostic methods such as chest X-ray (CXR) imaging. The storage of data obtained for the diagnosis of the disease also poses a major problem. This causes misdiagnosis and delays treatment. In this work, we propose a hybrid 3D reconstruction method of CXR images (CXRI) to detect coronavirus pneumonia and prevent misdiagnosis on CXRI. We used the digital holography technique (DHT) for obtaining a priori information of CXRI stored in created digital hologram (CDH). In this way, the elimination of the storage problem that requires high space was revealed. In addition, Discrete Orthonormal S-Transform (DOST) is applied to the reconstructed CDH image obtained by using DHT. This method is called CDH_DHT_DOST. A multiresolution spatial-frequency representation of the lung images that belong to healthy people and diseased people with the COVID-19 virus is obtained by using the CDH_DHT_DOST. Moreover, the genetic algorithm (GA) is adopted for the reconstruction process for optimization of the CDH image and then DOST is applied. This hybrid method is called CDH_GA_DOST. Finally, we compare the results obtained from CDH_DHT_DOST and CDH_GA_DOST. The results show the feasibility of reconstructing CXRI with CDH_GA_DOST. The proposed method holds promises to meet demands for the detection of the COVID-19 virus.

Combining multi-marker metabarcoding and digital holography to describe eukaryotic plankton across the Newfoundland Shelf

The planktonic diversity throughout the oceans is vital to ecosystem functioning and linked to environmental change. Plankton monitoring tools have advanced considerably with high-throughput in-situ digital cameras and genomic sequencing, opening new challenges for high-frequency observations of community composition, structure, and species discovery. Here, we combine multi-marker metabarcoding based on nuclear 18S (V4) and plastidial 16S (V4–V5) rRNA gene amplicons with a digital in-line holographic microscope to provide a synoptic diversity survey of eukaryotic plankton along the Newfoundland Shelf (Canada) during the winter transition phase of the North Atlantic bloom phenomenon. Metabarcoding revealed a rich eukaryotic diversity unidentifiable in the imaging samples, confirming the presence of ecologically important saprophytic protists which were unclassifiable in matching images, and detecting important groups unobserved or taxonomically unresolved during similar sequencing campaigns in the Northwest Atlantic Ocean. In turn, imaging analysis provided quantitative observations of widely prevalent plankton from every trophic level. Despite contrasting plankton compositions portrayed by each sampling method, both capture broad spatial differences between the northern and southern sectors of the Newfoundland Shelf and suggest complementary estimations of important features in eukaryotic assemblages. Future tasks will involve standardizing digital imaging and metabarcoding for wider use and consistent, comparable ocean observations.

Label-free single-shot imaging with on-axis phase-shifting holographic reflectance quantitative phase microscopy

Quantitative phase microscopy (QPM) has been emerged as an indispensable diagnostic and characterization tool in biomedical imaging with its characteristic nature of label-free, noninvasive, and real time imaging modality. The integration of holography to the conventional microscopy opens new advancements in QPM featuring high-resolution and quantitative three-dimensional image reconstruction. However, the holography schemes suffer in space-bandwidth and time-bandwidth issues in the off-axis and phase-shifting configuration, respectively. Here, we introduce an on-axis phase-shifting holography based QPM system with single-shot imaging capability. The technique utilizes the Fizeau interferometry scheme in combination with polarization phase-shifting and space-division multiplexing to achieve the single-shot recording of the multiple phase-shifted holograms. Moreover, the high-speed imaging capability with instantaneous recording of spatially phase shifted holograms offers the flexible utilization of the approach in dynamic quantitative phase imaging with robust phase stability. We experimentally demonstrated the validity of the approach by quantitative phase imaging and depth-resolved imaging of paramecium cells. Furthermore, the technique is applied to the phase imaging and quantitative parameter estimation of red blood cells. This integration of a Fizeau-based phase-shifting scheme to the optical microscopy enables a simple and robust tool for the investigations of engineered and biological specimen with real-time quantitative analysis.

Computational refocusing of Jones matrix polarization-sensitive optical coherence tomography and investigation of defocus-induced polarization artifacts

Here we demonstrate a long-depth-of-focus imaging method using polarization sensitive optical coherence tomography (PS-OCT). This method involves a combination of Fresnel-diffraction-model-based phase sensitive computational refocusing and Jones-matrix based PS-OCT (JM-OCT). JM-OCT measures four complex OCT images corresponding to four polarization channels. These OCT images are computationally refocused as preserving the mutual phase consistency. This method is validated using a static phantom, postmortem zebrafish, and ex vivo porcine muscle samples. All the samples demonstrated successful computationally-refocused birefringence and degree-of-polarization-uniformity (DOPU) images. We found that defocusing induces polarization artifacts, i.e., incorrectly high birefringence values and low DOPU values, which are substantially mitigated by computational refocusing.

Single-Shot On-Axis Fizeau Polarization Phase-Shifting Digital Holography for Complex-Valued Dynamic Object Imaging

Digital holography assisted with inline phase-shifting methods has the benefit of a large field of view and a high resolution, but it is limited in dynamic imaging due to sequential detection of multiple holograms. Here we propose and experimentally demonstrate a single-shot phase-shifting digital holography system based on a highly stable on-axis Fizeau-type polarization interferometry. The compact on-axis design of the system with the capability of instantaneous recording of multiple phase-shifted holograms and with robust stability features makes the technique a novel tool for the imaging of complex-valued dynamic objects. The efficacy of the approach is demonstrated experimentally by complex field imaging of various kinds of reflecting-type static and dynamic objects. Moreover, a quantitative analysis on the robust phase stability and sensitivity of the technique is evaluated by comparing the approach with conventional phase-shifting methods. The high phase stability and dynamic imaging potential of the technique are expected to make the system an ideal tool for quantitative phase imaging and real-time imaging of dynamic samples.

History and metrology applications of a game-changing technology: digital holography [Invited]

In digital holography (DH), information in the hologram is recorded and stored in digital format in discrete bits. Like its parent, holography, DH evolved over many years with periods of dormancy and revival. Almost abandoned, multiple times, unanticipated events or developments in separate industries revived it with explosive, quantum jumps, making it useful and popular to a wide audience. Although its history has been treated in many papers and books, the field is dynamic and constantly providing new opportunities. Having been born long before low-cost, fast, powerful digital computers and digital detectors were available, DH was confined to the academic world, where practical applications and commercial opportunities were few if any. Consumer demand that led to low-cost personal computers, high-resolution digital cameras, supporting software, and related products changed the situation drastically by providing every potential researcher affordable, powerful hardware and software needed to apply image processing algorithms and move DH to new practical application levels. In this paper, as part of the sixtieth anniversary of off-axis holography, we include a brief introduction to the fundamentals of DH and examine the history and evolution of DH during its periods of rise and fall. We summarize many new emerging techniques, applications, and potential future applications along with additional details for metrological examples from the authors' research.

Low-coherence quantitative differential phase-contrast microscopy using Talbot interferometry

This paper presents a simple, cost-efficient, and highly stable quantitative differential phase-contrast (PC) microscopy based on Talbot interferometry. The proposed system is composed of an optical microscope coupled with a pair of Ronchi amplitude gratings that utilizes a light-emitting diode as a low temporal coherence light source. The quantitative differential PC images of the microscopic transparent samples are reconstructed by analyzing the deformation of moiré patterns using a phase-shifting procedure. Low temporal coherence leads to eliminating speckle noise and undesirable interferences to obtain high-quality images. The spatial phase stability of the system is investigated and compared to two other common-path interferometers. Additionally, the performance of the method is verified by the experimental results of a standard resolution test target and phase biological samples.

Roadmap on Digital Holography-Based Quantitative Phase Imaging

Quantitative Phase Imaging (QPI) provides unique means for the imaging of biological or technical microstructures, merging beneficial features identified with microscopy, interferometry, holography, and numerical computations. This roadmap article reviews several digital holography-based QPI approaches developed by prominent research groups. It also briefly discusses the present and future perspectives of 2D and 3D QPI research based on digital holographic microscopy, holographic tomography, and their applications.

The Fusion of Microfluidics and Optics for On-Chip Detection and Characterization of Microalgae

It has been demonstrated that microalgae play an important role in the food, agriculture and medicine industries. Additionally, the identification and counting of the microalgae are also a critical step in evaluating water quality, and some lipid-rich microalgae species even have the potential to be an alternative to fossil fuels. However, current technologies for the detection and analysis of microalgae are costly, labor-intensive, time-consuming and throughput limited. In the past few years, microfluidic chips integrating optical components have emerged as powerful tools that can be used for the analysis of microalgae with high specificity, sensitivity and throughput. In this paper, we review recent optofluidic lab-on-chip systems and techniques used for microalgal detection and characterization. We introduce three optofluidic technologies that are based on fluorescence, Raman spectroscopy and imaging-based flow cytometry, each of which can achieve the determination of cell viability, lipid content, metabolic heterogeneity and counting. We analyze and summarize the merits and drawbacks of these micro-systems and conclude the direction of the future development of the optofluidic platforms applied in microalgal research.

Bitmap and vectorial hologram recording by using femtosecond laser pulses

In this paper, we present two approaches for recording a quasi-hologram on the steel surface by femtosecond laser pulses. The recording process is done by rotating the polarization of the laser beam by a half-wave plate or a spatial light modulator (SLM), so we can control the spatial orientation of the formed laser-induced periodic surface structures (LIPSS). Two different approaches are shown, which use vector and bitmap images to record the hologram. For the first time to our knowledge, we managed to record a hologram of a bitmap image by continuously adjusting the laser beam polarization by SLM during scanning. The developed method can substantially improve hologram recording technology by eliminating complex processing procedures, which can lead to increasing the fabrication speed and reducing the cost.

Real-time heart rate monitoring system for cardiotoxicity assessment of Daphnia magna using high-speed digital holographic microscopy

Machine vision techniques for monitoring heart rates in aquatic bioassays have been applied to cardiotoxicity assessment. However, the requisite large data sizes and long calculation times make long-term observations of heart rates difficult. In this study, we developed a real-time heart rate monitoring system for individual Daphnia magna in a water chamber mounter that immobilizes their movement in 100 mL media. Heart rates are calculated from real-time, time-resolved relative phase information from digital holograms acquired with a 200 fps camera and parallel computation using a graphics processing unit. With this system, we monitored the real-time changes in the heart rates of individual D. magna specimens exposed to H₂O₂ as a positive control for reactive oxygen species (ROS) levels in an aquatic environment for 10 h, a period long enough to observe dynamic heart rate responses to the mounting process and exposure and to establish heart rate trends. An additional group analysis was conducted to compare to conventional cardiotoxicity assessment, with results of both assessments showing that the heart rates reduced according to ROS level by H₂O₂ exposure concentration. Notably, the results of our real-time dynamic heart rate monitoring in aquatic conditions indicated that establishing a relaxation heart rate before measurements could improve the accuracy of toxicity assessment. It is believed that the system developed in this study, achieving the simultaneous measurement, analysis, and display of reconstructed results, will find wide application in other aquatic bioassays.

Mitigating ringing artifacts in diffraction calculations using average subtractions

Fourier transform-based diffraction calculations are essential for computational optics. However, the diffraction calculations can be corrupted by the introduction of strong ringing artifacts due to the introduction of zero-padding to avoid circular convolution or to control the sampling intervals. We propose a simple de-ringing method using average subtractions for application to on-axis and off-axis diffraction calculations. To verify the effectiveness of the proposed method, we compared the diffracted fields obtained using zero-padding, a flat-top window method, a mirror expansion method, and the whole and border average subtractions proposed. Furthermore, we confirmed the effectiveness of the proposed method for hologram calculations using double phase encoding and image reconstructions of inline digital holography.

Optical-Trapping Laser Techniques for Characterizing Airborne Aerosol Particles and Its Application in Chemical Aerosol Study

We present a broad assessment on the studies of optically-trapped single airborne aerosol particles, particularly chemical aerosol particles, using laser technologies. To date, extensive works have been conducted on ensembles of aerosols as well as on their analogous bulk samples, and a decent general description of airborne particles has been drawn and accepted. However, substantial discrepancies between observed and expected aerosols behavior have been reported. To fill this gap, single-particle investigation has proved to be a unique intersection leading to a clear representation of microproperties and size-dependent comportment affecting the overall aerosol behavior, under various environmental conditions. In order to achieve this objective, optical-trapping technologies allow holding and manipulating a single aerosol particle, while offering significant advantages such as contactless handling, free from sample collection and preparation, prevention of contamination, versatility to any type of aerosol, and flexibility to accommodation of various analytical systems. We review spectroscopic methods that are based on the light-particle interaction, including elastic light scattering, light absorption (cavity ring-down and photoacoustic spectroscopies), inelastic light scattering and emission (Raman, laser-induced breakdown, and laser-induced fluorescence spectroscopies), and digital holography. Laser technologies offer several benefits such as high speed, high selectivity, high accuracy, and the ability to perform in real-time, in situ. This review, in particular, discusses each method, highlights the advantages and limitations, early breakthroughs, and recent progresses that have contributed to a better understanding of single particles and particle ensembles in general.

Multimodal sound field imaging using digital holography [Invited]

Sound is an important invisible physical phenomenon that needs to be explained in several physical and biological processes, along with visual phenomena. For this purpose, multiparameter digital holography (DH) has been proposed to visualize both features simultaneously due to the phase and amplitude reconstruction properties of DH. In this paper, we present a brief review on sound field imaging techniques with special focus on the multiparameter imaging capability of DH for visualizing sound and visual features. The basic theory and several experimental results with very high-speed recordings are also presented to demonstrate sound field imaging for the audible range as well as in the ultrasound range.

Single-shot higher-order transport-of-intensity quantitative phase imaging based on computer-generated holography

The imaging quality of quantitative phase imaging (QPI) based on the transport of intensity equation (TIE) can be improved using a higher-order approximation for defocused intensity distributions. However, this requires mechanically scanning an image sensor or object along the optical axis, which in turn requires a precisely aligned optical setup. To overcome this problem, a computer-generated hologram (CGH) technique is introduced to TIE-based QPI. A CGH generating defocused point spread function is inserted in the Fourier plane of an object. The CGH acts as a lens and grating with various focal lengths and orientations, allowing multiple defocused intensity distributions to be simultaneously detected on an image sensor plane. The results of a numerical simulation and optical experiment demonstrated the feasibility of the proposed method.

Single-shot common-path off-axis digital holography: applications in bioimaging and optical metrology [Invited]

The demand for single-shot and common-path holographic systems has become increasingly important in recent years, as such systems offer various advantages compared to their counterparts. Single-shot holographic systems, for example, reduce computational complexity as only a single hologram with the object information required to process, making them more suitable for the investigation of dynamic events; and common-path holographic systems are less vibration-sensitive, compact, inexpensive, and high in temporal phase stability. We have developed a single-shot common-path off-axis digital holographic setup based on a beam splitter and pinhole. In this paper, we present a concise review of the proposed digital holographic system for several applications, including the quantitative phase imaging to investigate the morphological and quantitative parameters, as a metrological tool for testing of micro-optics, industrial inspection and measurement, and sound field imaging and visualization.

Incoherent color digital holography with computational coherent superposition for fluorescence imaging [Invited]

We present color fluorescence imaging using an incoherent digital holographic technique in which holographic multiplexing of multiple wavelengths is exploited. Self-interference incoherent digital holography with a single-path in-line configuration and the computational coherent superposition scheme are adopted to obtain color holographic three-dimensional information of self-luminous objects with a monochrome image sensor and no mechanical scanning. We perform not only simultaneous color three-dimensional sensing of multiple self-luminous objects but also color fluorescence imaging of stained biological samples. Color fluorescence imaging with an improved point spread function is also demonstrated experimentally by adopting a Fresnel incoherent correlation holography system.

Phase-retrieval Fourier microscopy of partially temporally coherent nanoantenna radiation patterns

We report an experimental technique for determining phase-resolved radiation patterns of single nanoantennas by phase-retrieval defocused imaging. A key property of nanoantennas is their ability to imprint spatial coherence, for instance, on fluorescent sources. Yet, measuring emitted wavefronts in absence of a reference field is difficult. We realize a defocused back focal plane microscope to measure phase even for partially temporally coherent light and benchmark the method using plasmonic bullseye antenna scattering. We outline the limitations of defocused imaging which are set by spectral bandwidth and antenna mode structure. This work is a first step to resolve wavefronts from fluorescence controlled by nanoantennas.

Effect of deep transfer and multi-task learning on sperm abnormality detection

Analyzing the abnormality of morphological characteristics of male human sperm has been studied for a long time mainly because it has many implications on the male infertility problem, which accounts for approximately half of the infertility problems in the world. Yet, detecting such abnormalities by embryologists has several downsides. To clarify, analyzing sperms through visual inspection of an expert embryologist is a highly subjective and biased process. Furthermore, it takes much time for a specialist to make a diagnosis. Hence, in this paper, we proposed two deep learning algorithms that are able to automate this process. The first algorithm uses a network-based deep transfer learning approach, while the second technique, named Deep Multi-task Transfer Learning (DMTL), employs a novel combination of network-based deep transfer learning and multi-task learning to classify sperm's head, vacuole, and acrosome as either normal or abnormal. This DMTL technique is capable of classifying all the aforementioned parts of the sperm in a single prediction. Moreover, this is the first time that the concept of multi-task learning has been introduced to the field of Sperm Morphology Analysis (SMA). To benchmark our algorithms, we employed a freely-available SMA dataset named MHSMA. During our experiments, our algorithms reached the state-of-the-art results on the accuracy, precision, and f_0.5, as well as other important metrics, such as the Matthews Correlation Coefficient on one, two, or all three labels. Notably, our algorithms increased the accuracy of the head, acrosome, and vacuole by 6.66%, 3.00%, and 1.33%, and reached the accuracy of 84.00%, 80.66%, and 94.00% on these labels, respectively. Consequently, our algorithms can be used in health institutions, such as fertility clinics, with further recommendations to practically improve the performance of our algorithms.

Holography applications toward medical field: An overview

Purpose:

3D Holography is a commercially available, disruptive innovation, which can be customised as per the requirements and is supporting Industry 4.0. The purpose of this paper is to study the potential applications of 3D holography in the medical field. This paper explores the concept of holography and its significant benefits in the medical field.

Methods:

The paper is derived through the study of various research papers on Holography and its applications in the medical field. The study tries to identify the direction of research &development and see how this innovative technology can be used effectively for better treatment of patients.

Results:

Holography uses digital imaging inputs and provides an extensive visualisation of the data for training doctors, surgeons and students. Holography converts information about the body into a digital format and has the potential to inform, promote and entertain the medical students and doctors. However, it needs a large amount of space for data storage and extensive software support for analysis and skills for customising. This technology seems good to solve a variety of medical issues by storing and using patient data in developing 3D holograms, which are useful to assist successful treatment and surgery. It seems useful in providing flexible solutions in the area of medical research. Finally, the paper identifies 13 significant applications of this technology in the medical field and discusses them appropriately.

Conclusion:

The paper explores holographic applications in medical research due to its extensive capability of image processing. Holographic images are non-contact 3D images having a large field of depth. A physician can now zoom the holographic image for a better view of the medical part. This innovative technology can create advancements in the diagnosis and treatment process, which can improve medical practice. It helps in quick detection of problems in various organs like brain, heart, liver, kidney etc. By using this technology, medical practitioners can see colourful organs at multiple angles with better accuracy. It opens up an innovative way of planning, testing of procedures and diagnosis. With technological developments, compact hardware and software are now available to help medical research and related applications.

Single-shot common-path off-axis dual-wavelength digital holographic microscopy

A single-shot common-path off-axis self-interference dual-wavelength digital holographic microscopic (DHM) system based on a cube beam splitter is demonstrated to expand the phase range in a stepped microstructure and for simultaneous measurement of the refractive index and physical thickness of a specimen. In the system, two laser beams with wavelengths of 532 nm and 632.8 nm are used. These laser beams are combined to transilluminate the object under study, then the object beam is divided into two beams by using a beam splitter oriented in such a way that both the beams propagate in almost the same direction, with an appropriate lateral separation between them. One of the object beams is spatially filtered at its Fourier plane, using a pinhole to generate a reference spherical beam free from the object information. The reference beam interferes with the object beam to form a digital hologram at the faceplate of the image sensor. The phase information is extracted from a single recorded digital hologram using the phase aberration compensation method that is based on principal component analysis (PCA). Owing to the common-path configuration, the system shows high temporal phase stability and it is less vibration-sensitive compared to counterparts such as a Mach-Zehnder type DHM. The performance of the dual-wavelength DHM system is verified in two different application fields by conducting the experiments using microsphere beads and living plant cells.

Fast calculation of computer-generated hologram of line-drawn objects without FFT

Although holographic display technology is one of the most promising three-dimensional (3D) display technologies for virtual and augmented reality, the enormous computational effort required to produce computer-generated holograms (CGHs) to digitally record and display 3D images presents a significant roadblock to the implementation of this technology. One of the most effective methods to implement fast CGH calculations is a diffraction calculation (e.g., angular spectrum diffraction) based on the fast-Fourier transform (FFT). Unfortunately, the computational complexity increases with increasing CGH resolution, which is what determines the size of a 3D image. Therefore, enormous calculations are still required to display a reasonably sized 3D image, even for a simple 3D image. To address this issue, we propose herein a fast CGH algorithm for 3D objects comprised of line-drawn objects at layers of different depths. An aperture formed from a continuous line at a single depth can be regarded as a series of aligned point sources of light, and the wavefront converges for a sufficiently long line. Thus, a CGH of a line-drawn object can be calculated by synthesizing converged wavefronts along the line. Numerical experiments indicate that, compared with the FFT-based method, the proposed method offers a factor-56 gain in speed for calculating 16-k-resolution CGHs from 3D objects composed of twelve line-drawn objects at different depths.

Multiwavelength three-dimensional microscopy with spatially incoherent light, based on computational coherent superposition

In this Letter, we propose spatially incoherent multiwavelength three-dimensional (3D) microscopy that exploits holographic multiplexing and is based on computational coherent superposition (CCS). The proposed microscopy generates spatially incoherent wavelength-multiplexed self-interference holograms with a multiband-pass filter and spatially and temporally incoherent light diffracted from specimens. Selective extractions of 3D spatial information at multiple wavelengths from the holograms are realized using the CCS scheme. We constructed fully mechanical-motion-free holographic multiwavelength 3D microscopy systems and conducted experiments to demonstrate the microscopy.

Design and development of volume phase holographic grating based digital holographic interferometer for label-free quantitative cell imaging

In this paper, a volume phase holographic optical element based digital holographic interferometer is designed and used for quantitative phase imaging of biological cells [white blood cells, red blood cells, platelets, and Staphylococcus aureus (S. aureus) bacteria cells]. The experimental results reveal that sharp images of the S. aureus bacteria cells of the order of ${\sim}{1}\;{\unicode{x00B5}{\rm m}}$∼1µm can be clearly seen. The volume phase holographic grating will remove the stray light from the system reaching toward the grating and will minimize the coherent noise (speckle noise). This will improve the sharpness in the image reconstructed from the recorded digital hologram.

Multiwavelength-multiplexed phase-shifting incoherent color digital holography

We propose multiwavelength-multiplexed phase-shifting incoherent color digital holography. In this technique, a monochrome image sensor records wavelength-multiplexed, phase-shifted, and incoherent holograms, and a phase-shifting interferometry technique selectively extracts object waves at multiple wavelengths from the several recorded holograms. Spatially incoherent light that contains multiple wavelengths illuminates objects, and multiwavelength-incoherent object waves are simultaneously obtained without using any wavelength filters. Its effectiveness is experimentally demonstrated for transparent and reflective objects.

Enhanced Phase Retrieval Method Based on Random Phase Modulation

The phase retrieval method based on random phase modulation can wipe out any ambiguity and stagnation problem in reconstruction. However, the two existing reconstruction algorithms for the random phase modulation method are suffering from problems. The serial algorithm from the spread-spectrum phase retrieval method can realize rapid convergence but has poor noise immunity. Although there is a parallel framework that can suppress noise, the convergence speed is slow. Here, we propose a random phase modulation phase retrieval method based on a serial–parallel cascaded reconstruction framework to simultaneously achieve quality imaging and rapid convergence. The proposed serial–parallel cascaded method uses the phased result from the serial algorithm to serve as the initialization of the subsequent parallel process. Simulations and experiments demonstrate that the superiorities of both serial and parallel algorithms are fetched by the proposed serial–parallel cascaded method. In the end, we analyze the effect of iteration numbers from the serial process on the reconstruction performance to find the optimal allocation scope of iteration numbers.

Wide area quantitative phase microscopy by spatial phase scanning digital holography

A new technique of digital holographic microscopy is introduced for large area quantitative phase microscopy, dubbed spatial phase scanning digital holography, where the object specimen in an interferometer is scanned across the tilted reference phase field, while acquiring camera frames at regular intervals. Both the large area scan and phase shift acquisition are achieved in one sweep, using a simple optomechanical system. The technique can be useful in diverse applications such as fast scans of blood smear, cell and tissue cultures, and microelectronic surface profiles.

Phase retrieval using axial diffraction patterns and a ptychographic iterative engine

We propose a phase retrieval method using axial diffraction patterns under planar and spherical wave illuminations. The proposed method uses a ptychographic iterative engine (PIE) for the phase retrieval algorithm. The proposed approach uses multiple diffraction patterns. Thus, adjusting the alignment of each diffraction pattern is mandatory, and we propose a method to adjust the alignment. In addition, a random selection of the measured diffraction patterns is used to further accelerate the convergence of the PIE-based optimization. To confirm the effectiveness of the proposed method, we compare the conventional and proposed methods using a simulation and optical experiments.

Three-dimensional microscopic imaging through scattering media based on in-line phase-shift digital holography

Microscopic three-dimensional imaging and phase quantification for objects hidden behind a scattering medium by using in-line phase-shift digital holography are proposed. A spatial resolution of 1.81 µm and highly accurate quantitative phase imaging are demonstrated for objects behind a scatter plate. Three-dimensional imaging was confirmed using objects with a depth difference of 1.32 mm. Further, imaging was performed using rat skin as a demonstration for imaging through a complex multilayer scattering medium, where a spatial resolution close to the theoretically predicted value was achieved by experiment.

Multiwavelength-selective phase-shifting digital holography without mechanical scanning

We propose multiwavelength in-line phase-shifting digital holography with a monochrome image sensor, single reference arm, and no mechanical scanning. We use phase-shifting interferometry selectively extracting wavelength information as a method to obtain multiwavelength object waves separately from wavelength-multiplexed phase-shifted holograms. By exploiting a liquid crystal on silicon spatial light modulator with a wide phase-modulation range as an electrically driven phase shifter in this interferometry, we remove mechanically moving parts during phase shifting. Its effectiveness is experimentally demonstrated.

Monitoring of photochemically induced changes in phase-modulating samples with digital holographic microscopy

This paper analyzes the performance of single-shot digital holographic microscopy for rapid characterization of static step-index structures in transparent polymer materials and for online monitoring of the photoinduced polymerization dynamics. The experiments are performed with a modified Mach-Zehnder transmission digital holographic microscope of high stability (phase accuracy of 0.69°) and of high magnification (of ≈90×). Use of near-infrared illumination allows both nondestructive examination of the manufactured samples and monitoring of optically induced processes in a photosensitive material concurrently with its excitation. The accuracy of the method for a precise sample's topography evaluation is studied on an example of microchannel sets fabricated via two-photon polymerization and is supported by reference measurements with an atomic force microscope. The applicability of the approach for dynamic measurements is proved via online monitoring of the refractive index evolution in a photoresin layer illuminated with a focused laser beam at 405 nm. High correlation between the experimental results and a kinetics model for the photopolymerization process is achieved.