On the transport of intensity technique for phase retrieval

Accelerated phase retrieval using adaptive support and statistical fringe processing of phase estimates

A technique for accelerated multiple-plane phase retrieval is demonstrated by creating adaptive support through the statistical analysis of phase estimates. Its technical advantage arises from, what we believe to be, the first time use of both phase estimates and a statistical metric, enabling the fast generation of noise-robust support masks. This results in a fourfold improvement in convergence speed when compared to the conventional multiple-plane method. Evaluating data fitting performance with fewer intensity recordings showed that using four or more recordings resulted in accurate fitting, three recordings caused overfitting, and two recordings led to underfitting for the test object waves used. In principle, the adaptive support strategy based on the statistical analysis of phase estimates may be applied to other iterative phase retrieval methods.

ICF-PR-Net: a deep phase retrieval neural network for X-ray phase contrast imaging of inertial confinement fusion capsules

X-ray phase contrast imaging (XPCI) has demonstrated capability to characterize inertial confinement fusion (ICF) capsules, and phase retrieval can reconstruct phase information from intensity images. This study introduces ICF-PR-Net, a novel deep learning-based phase retrieval method for ICF-XPCI. We numerically constructed datasets based on ICF capsule shape features, and proposed an object-image loss function to add image formation physics to network training. ICF-PR-Net outperformed traditional methods as it exhibited satisfactory robustness against strong noise and nonuniform background and was well-suited for ICF-XPCI's constrained experimental conditions and single exposure limit. Numerical and experimental results showed that ICF-PR-Net accurately retrieved the phase and absorption while maintaining retrieval quality in different situations. Overall, the ICF-PR-Net enables the diagnosis of the inner interface and electron density of capsules to address ignition-preventing problems, such as hydrodynamic instability growth.

Quantification of Hybrid Topological Spin Textures and Their Nanoscale Fluctuations in Ferrimagnets

Noncolinear spin textures, including chiral stripes and skyrmions, have shown great potential in spintronics. Basic configurations of spin textures are either Bloch or Néel types, and the intermediate hybrid type has rarely been reported. A major challenge in identifying hybrid spin textures is to quantitatively determine the hybrid angle, especially in ferrimagnets with weak net magnetization. Here, we develop an approach to quantify magnetic parameters, including chirality, saturation magnetization, domain wall width, and hybrid angle with sub-5 nm spatial resolution, based on Lorentz four-dimensional scanning transmission electron microscopy (Lorentz 4D-STEM). We find strong nanometer-scale variations in the hybrid angle and domain wall width within structurally and chemically homogeneous FeGd ferrimagnetic films. These variations fluctuate during different magnetization circles, revealing intrinsic local magnetization inhomogeneities. Furthermore, hybrid skyrmions can also be nucleated in FeGd films. These analyses demonstrate that the Lorentz 4D-STEM is a quantitative tool for exploring complex spin textures.

WRAP: A wavelet-regularised reconstruction algorithm for magnetic vector electron tomography

Magnetic vector electron tomography (VET) is a promising technique that enables better understanding of micro- and nano-magnetic phenomena through the reconstruction of 3D magnetic fields at high spatial resolution. Here we introduce WRAP (Wavelet Regularised A Program), a reconstruction algorithm for magnetic VET that directly reconstructs the magnetic vector potential A using a compressed sensing framework which regularises for sparsity in the wavelet domain. We demonstrate that using WRAP leads to a significant increase in the fidelity of the 3D reconstruction and is especially robust when dealing with very limited data; using datasets simulated with realistic noise, we compare WRAP to a conventional reconstruction algorithm and find an improvement of ca. 60% when averaged over several performance metrics. Moreover, we further validate WRAP's performance on experimental electron holography data, revealing the detailed magnetism of vortex states in a CuCo nanowire. We believe WRAP represents a major step forward in the development of magnetic VET as a tool for probing magnetism at the nanoscale.

Randomness assisted in-line holography with deep learning

We propose and demonstrate a holographic imaging scheme exploiting random illuminations for recording hologram and then applying numerical reconstruction and twin image removal. We use an in-line holographic geometry to record the hologram in terms of the second-order correlation and apply the numerical approach to reconstruct the recorded hologram. This strategy helps to reconstruct high-quality quantitative images in comparison to the conventional holography where the hologram is recorded in the intensity rather than the second-order intensity correlation. The twin image issue of the in-line holographic scheme is resolved by an unsupervised deep learning based method using an auto-encoder scheme. Proposed learning technique leverages the main characteristic of autoencoders to perform blind single-shot hologram reconstruction, and this does not require a dataset of samples with available ground truth for training and can reconstruct the hologram solely from the captured sample. Experimental results are presented for two objects, and a comparison of the reconstruction quality is given between the conventional inline holography and the one obtained with the proposed technique.

Determining the Projected Crystal Structure from Four-dimensional Scanning Transmission Electron Microscopy via the Scattering Matrix

We present a gradient-descent-based approach to determining the projected electrostatic potential from four-dimensional scanning transmission electron microscopy measurements of a periodic, crystalline material even when dynamical scattering occurs. The method solves for the scattering matrix as an intermediate step, but overcomes the so-called truncation problem that limited previous scattering-matrix-based projected structure determination methods. Gradient descent is made efficient by using analytic expressions for the gradients. Through simulated case studies, we show that iteratively improving the scattering matrix determination can significantly improve the accuracy of the projected structure determination.

Toward accurate measurement of electromagnetic field by retrieving and refining the center position of non-uniform diffraction disks in Lorentz 4D-STEM

Recent advancement in scanning transmission electron microscopy (STEM) allows the use of 4D-STEM, a technique that captures an electron diffraction pattern at each scan point in STEM, to measure electrostatic and magnetic potential and field in materials. However, accurate measurement, separation of the magnetic and electric signals, and removal of artifacts remain challenging, especially in the presence of complex non-uniform diffraction contrast within the disks. Here, based on dynamic simulations of 4D-STEM patterns built upon superstructures consisting of millions of atoms to account for different sample thickness and edge geometries, we show how the shape and intensity distribution of the central disk are affected by multiple scattering. We propose a robust refinement procedure through iteration of the spin-sensitive peak position of the disk-center in the circular Hough transform filtered images from experimental Lorentz 4D-STEM dataset after minimizing the possible artifacts, such as those due to the change of thickness, dynamic scattering, and scanning process. We verify that caution must be taken as in practice the rigid-disk-shift model used to reconstruct induction maps can easily break down due to disk-protrusion when there exists a nonconstant phase gradient or thickness within the width of the probe. Through quantitative analysis and comparing experiment with calculation the effect of the non-spin-related intensity distribution inside the disk as well as that causes the disk shift due to the intensity-protrusion can be removed, and high-quality magnetic field mapping is possible.

Multi-Illumination Single-Holographic-Exposure Lensless Fresnel (MISHELF) Microscopy: Principles and Biomedical Applications

Lensless holographic microscopy (LHM) comes out as a promising label-free technique since it supplies high-quality imaging and adaptive magnification in a lens-free, compact and cost-effective way. Compact sizes and reduced prices of LHMs make them a perfect instrument for point-of-care diagnosis and increase their usability in limited-resource laboratories, remote areas, and poor countries. LHM can provide excellent intensity and phase imaging when the twin image is removed. In that sense, multi-illumination single-holographic-exposure lensless Fresnel (MISHELF) microscopy appears as a single-shot and phase-retrieved imaging technique employing multiple illumination/detection channels and a fast-iterative phase-retrieval algorithm. In this contribution, we review MISHELF microscopy through the description of the principles, the analysis of the performance, the presentation of the microscope prototypes and the inclusion of the main biomedical applications reported so far.

Physics-informed neural network for phase imaging based on transport of intensity equation

Non-interferometric quantitative phase imaging based on Transport of Intensity Equation (TIE) has been widely used in bio-medical imaging. However, analytic TIE phase retrieval is prone to low-spatial frequency noise amplification, which is caused by the illposedness of inversion at the origin of the spectrum. There are also retrieval ambiguities resulting from the lack of sensitivity to the curl component of the Poynting vector occurring with strong absorption. Here, we establish a physics-informed neural network (PINN) to address these issues, by integrating the forward and inverse physics models into a cascaded deep neural network. We demonstrate that the proposed PINN is efficiently trained using a small set of sample data, enabling the conversion of noise-corrupted 2-shot TIE phase retrievals to high quality phase images under partially coherent LED illumination. The efficacy of the proposed approach is demonstrated by both simulation using a standard image database and experiment using human buccal epitehlial cells. In particular, high image quality (SSIM = 0.919) is achieved experimentally using a reduced size of labeled data (140 image pairs). We discuss the robustness of the proposed approach against insufficient training data, and demonstrate that the parallel architecture of PINN is efficient for transfer learning.

Nonlinear primal-dual algorithm for the phase and absorption retrieval from a single phase contrast image

We propose a nonlinear primal-dual algorithm for the retrieval of phase shift and absorption from a single x ray in-line phase contrast, or Fresnel diffraction, image. The algorithm permits us to regularize phase and absorption separately. We demonstrate that taking into account the nonlinearity in the reconstruction improves reconstruction compared with linear methods. We also demonstrate that choosing different regularizers for absorption and phase can improve the reconstructions. The use of the total variation and its generalization in a primal-dual approach allows us to exploit the sparsity of the investigated sample. On both simulated and real datasets, the proposed nonlinear primal-dual hybrid gradient (NL-PDHG) method yields reconstructions with considerably fewer artifacts and improved the normalized mean squared error compared with its linearized version.

Confinement of Skyrmions in Nanoscale FeGe Device-like Structures

Skyrmion-based devices have been proposed as a promising solution for low-energy data storage. These devices include racetrack or logic structures and require skyrmions to be confined in regions with dimensions comparable to the size of a single skyrmion. Here we examine skyrmions in FeGe device shapes using Lorentz transmission electron microscopy to reveal the consequences of skyrmion confinement in a device-like structure. Dumbbell-shaped elements were created by focused ion beam milling to provide regions where single skyrmions are confined adjacent to areas containing a skyrmion lattice. Simple block shapes of equivalent dimensions were also prepared to allow a direct comparison with skyrmion formation in a less complex, yet still confined, device geometry. The impact of applying a magnetic field and varying the temperature on the formation of skyrmions within the shapes was examined. This revealed that it is not just confinement within a small device structure that controls the position and number of skyrmions but that a complex device geometry changes the skyrmion behavior, including allowing skyrmions to form at lower applied magnetic fields than in simple shapes. The impact of edges in complex shapes is observed to be significant in changing the behavior of the magnetic textures formed. This could allow methods to be developed to control both the position and number of skyrmions within device structures.

Label-free hematology analysis method based on defocusing phase-contrast imaging under illumination of 415 nm light

Label-free imaging technology is a trending way to simplify and improve conventional hematology analysis by bypassing lengthy and laborious staining procedures. However, the existing methods do not well balance system complexity, data acquisition efficiency, and data analysis accuracy, which severely impedes their clinical translation. Here, we propose defocusing phase-contrast imaging under the illumination of 415 nm light to realize label-free hematology analysis. We have verified that the subcellular morphology of blood components can be visualized without complex staining due to the factor that defocusing can convert the second-order derivative distribution of samples' optical phase into intensity and the illumination of 415 nm light can significantly enhance the contrast. It is demonstrated that the defocusing phase-contrast images for the five leucocyte subtypes can be automatically discriminated by a trained deep-learning program with high accuracy (the mean F1 score: 0.986 and mean average precision: 0.980). Since this technique is based on a regular microscope, it simultaneously realizes low system complexity and high data acquisition efficiency with remarkable quantitative analysis ability. It supplies a label-free, reliable, easy-to-use, fast approach to simplifying and reforming the conventional way of hematology analysis.

Optical module for single-shot quantitative phase imaging based on the transport of intensity equation with field of view multiplexing

We present a cost-effective, simple, and robust method that enables single-shot quantitative phase imaging (QPI) based on the transport of intensity equation (TIE) using an add-on optical module that can be assembled into the exit port of any regular microscope. The module integrates a beamsplitter (BS) cube (placed in a non-conventional way) for duplicating the output image onto the digital sensor (field of view - FOV - multiplexing), a Stokes lens (SL) for astigmatism compensation (introduced by the BS cube), and an optical quality glass plate over one of the FOV halves for defocusing generation (needed for single-shot TIE algorithm). Altogether, the system provides two laterally separated intensity images that are simultaneously recorded and slightly defocused one to each other, thus enabling accurate QPI by conventional TIE-based algorithms in a single snapshot. The proposed optical module is first calibrated for defining the configuration providing best QPI performance and, second, experimentally validated by using different phase samples (static and dynamic ones). The proposed configuration might be integrated in a compact three-dimensional (3D) printed module and coupled to any conventional microscope for QPI of dynamic transparent samples.

Phase unwrapping using the extracted degree of coherence and phase from phase shifting interferometry systems

Current phase unwrapping methods for non-scanning interferometry systems with one wavelength are not robust in the presence of high steps while still having a limited step height and range using two wavelengths configurations. Here, a new phase unwrapping method is proposed, allowing imaging steps with a height up to 15 times the wavelength using one wavelength or up to 1500 times using two wavelengths. It is based on a one-time computational model fitting of calibration measurements that allows to extract the degree of coherence and phase from two phase-shifted images per wavelength, perform phase unwrapping and accurately reconstruct the 3D structure of the sample. The proposed method has a nanometric axial accuracy and can operate in real-time. The algorithms and methodology for one and two wavelengths are presented and confirmed experimentally.

Cryogenic Electron Microscopy on Strongly Correlated Quantum Materials

ConspectusQuantum materials refers to a class of materials with exotic properties that arise from the quantum mechanical nature of their constituent electrons, exhibiting, for example, high-temperature superconductivity, colossal magnetoresistivity, multiferroicity, and topological behavior. Quantum materials often have incompletely filled d- or f-electron shells with narrow energy bands, and the conduct of their electrons is strongly correlated. One distinct characteristic of the materials is that their electronic states are often spatially inhomogeneous and thus well suited for study using a spatially resolved electron beam with its great scattering power and sensitivity to atomic ionicity. Furthermore, most of these exotic properties only manifest at very low temperatures, posing a challenge to modern electron microscopy. It requires extraordinarily instrument stabilities at cryogenic temperatures with critical spatial, temporal, and energy resolutions in both static and dynamic manner to probe these materials. On the other hand, the ability to directly visualize the atomic, electronic and spin structures and inhomogeneities of quantum materials and correlate them to their functionalities creates enormous opportunities. At the most elementary levels of condensed matter physics, understanding the competing order of electron, spin, orbital, and lattice and their degrees of freedom, the impacts of defects and interfaces, and the site-specific quantum phenomena and phase transitions that give rise to the emergent behaviors allows us to discover and control novel materials for quantum information science and technologies.In this Account, several of our research examples are selected to highlight the use of cryogenic electron microscopy (cryo-EM) to study strongly correlated quantum materials. We focus on the critical roles of heterogeneity, interfaces, defects, and disorder in crystal structure, magnetic structure, and electronic structure to understand the physical properties of the materials that cryo-EM enables. We show how electron crystallography coupled with Bragg diffraction and diffuse scattering analysis empowers us to reveal the nature of structural modulations, lattice distortion, and phonons and how quantitative electron diffraction can be used to map the distributions of the valence electrons that bond atoms together. We exploit transformative advances in imaging capabilities including the use of femtosecond laser and ultrafast electron diffraction to probe electron-lattice interactions and photoinduced transitions beyond equilibrium of matter. We review our Lorentz phase microscopy studies to illustrate the intriguing transformations among various topological chiral spin states under applied magnetic field at various cryogenic temperatures. Finally, we show that atomically resolved imaging and electron energy-loss spectroscopy at 10 K can be used to understand interface-enhanced superconductivity. The wide range of research and progress on quantum materials at low temperature reported here may inspire and attract more researchers in this ever-expanding field of cryo-EM.

Machine learning based approach to pH imaging and classification of single cancer cells

The ability to identify different cell populations in a noninvasive manner and without the use of fluorescence labeling remains an important goal in biomedical research. Various techniques have been developed over the last decade, which mainly rely on fluorescent probes or nanoparticles. On the other hand, their applications to single-cell studies have been limited by the lengthy preparation and labeling protocols, as well as issues relating to reproducibility and sensitivity. Furthermore, some of these techniques require the cells to be fixed. Interestingly, it has been shown that different cell types exhibit a unique intracellular environment characterized by specific acidity conditions as a consequence of their distinct functions and metabolism. Here, we leverage a recently developed pH imaging modality and machine learning-based single-cell segmentation and classification to identify different cancer cell lines based on their characteristic intracellular pH. This simple method opens up the potential to perform rapid noninvasive identification of living cancer cells for early cancer diagnosis and further downstream analyses.

3D reconstruction of weakly scattering objects from 2D intensity-only measurements using the Wolf transform

A new approach to optical diffraction tomography (ODT) based on intensity measurements is presented. By applying the Wolf transform directly to intensity measurements, we observed unexpected behavior in the 3D reconstruction of the sample. Such a reconstruction does not explicitly represent a quantitative measure of the refractive index of the sample; however, it contains interesting qualitative information. This 3D reconstruction exhibits edge enhancement and contrast enhancement for nanostructures compared with the conventional 3D refractive index reconstruction and thus could be used to localize nanoparticles such as lipids inside a biological sample.

Scaling, rotation, and channeling behavior of helical and skyrmion spin textures in thin films of Te-doped Cu2OSeO3

Topologically nontrivial spin textures such as vortices, skyrmions, and monopoles are promising candidates as information carriers for future quantum information science. Their controlled manipulation including creation and annihilation remains an important challenge toward practical applications and further exploration of their emergent phenomena. Here, we report controlled evolution of the helical and skyrmion phases in thin films of multiferroic Te-doped Cu₂OSeO₃ as a function of material thickness, dopant, temperature, and magnetic field using in situ Lorentz phase microscopy. We report two previously unknown phenomena in chiral spin textures in multiferroic Cu₂OSeO₃: anisotropic scaling and channeling with a fixed-Q state. The skyrmion channeling effectively suppresses the recently reported second skyrmion phase formation at low temperature. Our study provides a viable way toward controlled manipulation of skyrmion lattices, envisaging chirality-controlled skyrmion flow circuits and enabling precise measurement of emergent electromagnetic induction and topological Hall effects in skyrmion lattices.

Quantification of Mixed Bloch-Néel Topological Spin Textures Stabilized by the Dzyaloshinskii-Moriya Interaction in Co/Pd Multilayers

The three-dimensional structure of nanoscale topological spin textures stabilized by the Dzyaloshinskii-Moriya interaction is governed by the delicate competition between the exchange, demagnetization, and anisotropy energies. The quantification of such spin textures through direct experimental methods is crucial towards understanding the fundamental physics associated with their ordering, as well as their manipulation in spintronic devices. Here, we extend the Lorentz transmission electron microscopy technique to quantify mixed Bloch-Néel chiral spin textures stabilized by the Dzyaloshinskii-Moriya interaction in Co/Pd multilayers. Analysis of the observed intensities under varied imaging conditions coupled to corroborative micromagnetic simulations yields vital parameters that dictate the stability and properties of the complex spin texture, namely, the degree of mixed Bloch-Néel character, the domain wall width, the strength of the Dzyaloshinskii-Moriya interaction, and the exchange stiffness. This approach provides the necessary framework for the application of quantitative Lorentz phase microscopy to a broad array of topological spin systems.

Do Images of Biskyrmions Show Type-II Bubbles?

The intense research effort investigating magnetic skyrmions and their applications for spintronics has yielded reports of more exotic objects including the biskyrmion, which consists of a bound pair of counter-rotating vortices of magnetization. Biskyrmions have been identified only from transmission electron microscopy images and have not been observed by other techniques, nor seen in simulations carried out under realistic conditions. Here, quantitative Lorentz transmission electron microscopy, X-ray holography, and micromagnetic simulations are combined to search for biskyrmions in MnNiGa, a material in which they have been reported. Only type-I and type-II magnetic bubbles are found and images purported to show biskyrmions can be explained as type-II bubbles viewed at an angle to their axes. It is not the magnetization but the magnetic flux density resulting from this object that forms the counter-rotating vortices.

Shock-wave imaging by density recovery from intensity measurements

A method for quantitative estimation of density variation in high-speed flow, which uses light as an interrogating tool, is described. The wavefront distortion of the interrogating beam induced by the compressible flow field is estimated quantitatively, in which the density gradient of the flow field is seen as refractive-index gradient by the probing beam. The distorted wavefront is measured quantitatively by using the cross-sectional intensities of the distorted wavefront along the optical axis. Iterative algorithms are developed using both deterministic (Gauss-Newton) and stochastic (ensemble Kalman filter) update strategies to recover unknown parameters such as the phase of the wavefront or the refractive index distribution in the flow directly from the measured intensities. With phase recovered in the first step, a ray tomography algorithm is used to obtain the refractive index and density distributions in the flow from the phase. Experiments are conducted to quantitatively visualize the shock-wave-induced flow field in a shock-tunnel facility. The reconstructed density cross sections, obtained using different reconstruction methods, are presented and compared with those obtained by solving the Navier-Stokes equation using computational fluid dynamic routines. It is observed that the iterative algorithms always outperform those depending on solution of the transport-of-intensity equation. In particular, when using the iterative algorithms, the stochastic search scheme outperforms the Gauss-Newton method.

Measurement of three-dimensional wavefronts using the Ichikawa-Lohmann-Takeda solution to the irradiance transport equation

In this paper, we use the irradiance transport equation and the Fourier transform-based experimental solution given by Ichikawa-Lohmann-Takeda. We analyze experimental factors such as the digital filter, the introduced error for the rotation and period of the Ronchi ruling, and a new method is demonstrated for the measurement of 3D wavefront information.

Quantitative phase microscopy for cellular dynamics based on transport of intensity equation

We demonstrate a simple method for quantitative phase imaging of tiny transparent objects such as living cells based on the transport of intensity equation. The experiments are performed using an inverted bright field microscope upgraded with a flipping imaging module, which enables to simultaneously create two laterally separated images with unequal defocus distances. This add-on module does not include any lenses or gratings and is cost-effective and easy-to-alignment. The validity of this method is confirmed by the measurement of microlens array and human osteoblastic cells in culture, indicating its potential in the applications of dynamically measuring living cells and other transparent specimens in a quantitative, non-invasive and label-free manner.

Optical convolution for quantitative phase retrieval using the transport of intensity equation

Propagation-based phase imaging using the transport of intensity equation (TIE) allows rapid, deterministic phase retrieval from defocused images. However, computational solutions to the TIE suffer from significant low-frequency noise artifacts and are unique up to the application of boundary conditions on the phase. We demonstrate that quantitative phase can be imaged directly at the detector for a class of pure-phase samples by appropriately patterning the illumination to solve the TIE through an optical convolution with the source. This can reduce noise artifacts, obviates the need for user-supplied boundary conditions and is demonstrated via simulation and experiment.

Evaluation of finite difference and FFT-based solutions of the transport of intensity equation

A finite difference method is proposed for solving the transport of intensity equation. Simulation results show that although slower than fast Fourier transform (FFT)-based methods, finite difference methods are able to reconstruct the phase with better accuracy due to relaxed assumptions for solving the transport of intensity equation relative to FFT methods. Finite difference methods are also more flexible than FFT methods in dealing with different boundary conditions.

Advanced Electron Holography Applied to Electromagnetic Field Study in Materials Science

Advances and applications of electron holography to the study of electromagnetic fields in various functional materials are presented. In particular, the development of split-illumination electron holography, which introduces a biprism in the illumination system of a holography electron microscope, enables highly accurate observations of electromagnetic fields and the expansion of the observable area. First, the charge distributions on insulating materials were studied by using split-illumination electron holography and including a mask in the illumination system. Second, the three-dimensional spin configurations of skyrmion lattices in a helimagnet were visualized by using a high-voltage holography electron microscope. Third, the pinning of the magnetic flux lines in a high-temperature superconductor YBa₂ Cu₃ O_7-y was analyzed by combining electron holography and scanning ion microscopy. Finally, the dynamic accumulation and collective motions of electrons around insulating biomaterial surfaces were observed by utilizing the amplitude reconstruction processes of electron holography.

Source diversity for transport of intensity phase imaging

The transport of intensity equation (TIE) is a phase retrieval method that relies on measurements of the intensity of a paraxial field under propagation between two or more closely spaced planes. A limitation of TIE is its susceptibility to low frequency noise artifacts in the reconstructed phase. Under Köhler illumination, when both illumination power and exposure time are limited, the use of larger sources can improve low-frequency performance although it introduces blurring. Appropriately combining intensity measurements taken with a diversity of source sizes can improve both low- and high-frequency performance in phase reconstruction.

Observation of stable Néel skyrmions in cobalt/palladium multilayers with Lorentz transmission electron microscopy

Néel skyrmions are of high interest due to their potential applications in a variety of spintronic devices, currently accessible in ultrathin heavy metal/ferromagnetic bilayers and multilayers with a strong Dzyaloshinskii–Moriya interaction. Here we report on the direct imaging of chiral spin structures including skyrmions in an exchange-coupled cobalt/palladium multilayer at room temperature with Lorentz transmission electron microscopy, a high-resolution technique previously suggested to exhibit no Néel skyrmion contrast. Phase retrieval methods allow us to map the internal spin structure of the skyrmion core, identifying a 25 nm central region of uniform magnetization followed by a larger region characterized by rotation from in- to out-of-plane. The formation and resolution of the internal spin structure of room temperature skyrmions without a stabilizing out-of-plane field in thick magnetic multilayers opens up a new set of tools and materials to study the physics and device applications associated with chiral ordering and skyrmions.

Néel skyrmions are spin textures with a magnetization that rotates from in- to out-of-plane with distance from its centre. Here, the authors show that Lorentz transmission electron microscopy can be used to directly image Néel skyrmions with high resolution in thick exchange-coupled magnetic multilayers.

Imaging of magnetic and electric fields by electron microscopy

Nanostructured materials become more and more a part of our daily life, partly as self-assembled particles or artificially patterned. These nanostructures often possess intrinsic magnetic and/or electric fields which determine (at least partially) their physical properties. Therefore it is important to be able to measure these fields reliably on a nanometre scale. A rather common instrument for the investigation of these fields is the transmission electron microscope as it offers high spatial resolution. The use of an electron microscope to image electric and magnetic fields on a micron down to sub-nanometre scale is treated in detail for transmission electron microscopes (TEM) and scanning transmission electron microscopes (STEM). The formation of contrast is described for the most common imaging modes, the specific advantages and disadvantages of each technique are discussed and examples are given. In addition, the experimental requirements for the use of the techniques described are listed and explained.

Quantitative phase imaging using transport of intensity equation with multiple bandpass filters

A phase imaging based on the transport of intensity equation using multiple bandpass filters is proposed. The proposed method enables us to measure a phase distribution quantitatively from through-focus intensity images obtained by using a white light source and multiple bandpass filters. The technique improves the accuracy of a phase measurement by increasing the number of intensity images obtained at different defocused positions. The feasibility of the phase measurement and the improvement in the accuracy with the increasing the through-focus images are confirmed by numerical simulations and optical experiments.

Gradient flipping algorithm: introducing non-convex constraints in wavefront reconstructions with the transport of intensity equation

The transport of intensity equation (TIE) is widely applied for recovering wave fronts from an intensity measurement and a measurement of its variation along the direction of propagation. In order to get around the problem of non-uniqueness and ill-conditionedness of the solution of the TIE in the very common case of unspecified boundary conditions or noisy data, additional constraints to the solution are necessary. Although from a numerical optimization point of view, convex constraint as imposed to by total variation minimization is preferable, we will show that in many cases non-convex constraints are necessary to overcome the low-frequency artifacts so typical for convex constraints. We will provide simulated and experimental examples that demonstrate the superiority of solutions to the TIE obtained by our recently introduced gradient flipping algorithm over a total variation constrained solution.

Phase retrieval by using the transport-of-intensity equation with Hilbert transform

Phase recovery by solving the transport-of-intensity equation (TIE) is a non-iterative and non-interferometric phase retrieval technique. From solving the TIE with conventional, one partial derivative and Hilbert transform methods for both the periodic and aperiodic samples, we demonstrate that the Hilbert transform method can provide the smoother phase images with edge enhancement and fine structures. Furthermore, compared with the images measured by optical and atomic force microscopy, the Hilbert transform method has the ability to quantitatively map out the phase images for both the periodic and aperiodic structures.

Iterative optimum frequency combination method for high efficiency phase imaging of absorptive objects based on phase transfer function

In this work, an optimum frequency combination (OFC) method is proposed to reconstruct high quality phase information of the complex light field, which is really valuable for many objects such as optical elements and cells. It is shown that the difference image between two symmetrical separated, larger defocused planes contains a lot of lower frequency components of the phase distribution and the higher frequency components can be easily observed in the difference image between two nearly focused planes. Based on the phase transfer function (PTF), our method combines different frequency components with high Signal-to-Noise Ratio (SNR) together to estimate a more accurate frequency spectrum of the object's phase distribution without any complicated linear or nonlinear regression. Then, we can directly reconstruct a high-quality phase map through inverse Fourier transform. What's more, in order to compensate the phase discrepancy resulted from strong absorption in the intensity, an iterative compensation algorithm is proposed. Both the simulation and experimental results demonstrate that our iterative OFC (IOFC) method can give a computationally efficient and noise-robust phase reconstruction for absorptive phase objects with higher accuracy and fewer defocus planes.

Experimental evaluation of the 'transport-of-intensity' equation for magnetic phase reconstruction in Lorentz transmission electron microscopy

The 'transport-of-intensity' equation (TIE) is a general phase reconstruction methodology that can be applied to Lorentz transmission electron microscopy (TEM) through the use of Fresnel-contrast (defocused) images. We present an experimental study to test the application of the TIE for quantitative magnetic mapping in Lorentz TEM without aberration correction by examining sub-micrometer sized Ni80Fe20 (Permalloy) elements. For a JEOL JEM 2100F adapted for Lorentz microscopy, we find that quantitative magnetic phase reconstructions are possible for defoci distances ranging between approximately 200 μm and 800 μm. The lower limit originates from competing sources of image intensity variations in Fresnel-contrast images, namely structural defects and diffraction contrast. The upper defocus limit is due to a numerical error in the estimation of the intensity derivative based on three images. For magnetic domains, we show quantitative reconstructions of the product of the magnetic induction vector and thickness in element sizes down to approximately 100 nm in lateral size and 5 nm thick resulting in a minimal detection of 5Tnm. Three types of magnetic structures are tested in terms of phase reconstruction: vortex cores, domain walls, and element edges. We quantify vortex core structures at a diameter of 12 nm while the structures of domain walls and element edges are characterized qualitatively. Finally, we show by image simulations that the conclusions of this experimental study are relevant to other Lorentz TEM in which spherical aberration and defocus are dominant aberrations.

Improved quantitative phase imaging in lensless microscopy by single-shot multi-wavelength illumination using a fast convergence algorithm

We report on a novel algorithm for high-resolution quantitative phase imaging in a new concept of lensless holographic microscope based on single-shot multi-wavelength illumination. This new microscope layout, reported by Noom et al. along the past year and named by us as MISHELF (initials incoming from Multi-Illumination Single-Holographic-Exposure Lensless Fresnel) microscopy, rises from the simultaneous illumination and recording of multiple diffraction patterns in the Fresnel domain. In combination with a novel and fast iterative phase retrieval algorithm, MISHELF microscopy is capable of high-resolution (micron range) phase-retrieved (twin image elimination) biological imaging of dynamic events. In this contribution, MISHELF microscopy is demonstrated through qualitative concept description, algorithm implementation, and experimental validation using both a synthetic object (resolution test target) and a biological sample (swine sperm sample) for the case of three (RGB) illumination wavelengths. The proposed method becomes in an alternative instrument improving the capabilities of existing lensless microscopes.

Transport of intensity phase imaging in the presence of curl effects induced by strongly absorbing photomasks

We report theoretical and experimental results for imaging of electromagnetic phase edge effects in lithography photomasks. Our method starts from the transport of intensity equation (TIE), which solves for phase from through-focus intensity images. Traditional TIE algorithms make an implicit assumption that the underlying in-plane power flow is curl-free. Motivated by our current study, we describe a practical situation in which this assumption breaks down. Strong absorption gradients in mask features interact with phase edges to contribute a curl to the in-plane Poynting vector, causing severe artifacts in the phase recovered. We derive how curl effects are coupled into intensity measurements and propose an iterative algorithm that not only corrects the artifacts, but also recovers missing curl components.

Ptychography--a label free, high-contrast imaging technique for live cells using quantitative phase information

Cell imaging often relies on synthetic or genetic fluorescent labels, to provide contrast which can be far from ideal for imaging cells in their in vivo state. We report on the biological application of a, label-free, high contrast microscopy technique known as ptychography, in which the image producing step is transferred from the microscope lens to a high-speed phase retrieval algorithm. We demonstrate that this technology is appropriate for label-free imaging of adherent cells and is particularly suitable for reporting cellular changes such as mitosis, apoptosis and cell differentiation. The high contrast, artefact-free, focus-free information rich images allow dividing cells to be distinguished from non-dividing cells by a greater than two-fold increase in cell contrast, and we demonstrate this technique is suitable for downstream automated cell segmentation and analysis.

Separation of electrostatic and magnetic phase shifts using a modified transport-of-intensity equation

We introduce a new approach for the separation of the electrostatic and magnetic components of the electron wave phase shift, based on the transport-of-intensity equation (TIE) formalism. We derive two separate TIE-like equations, one for each of the phase shift components. We use experimental results on FeCoB and Permalloy patterned islands to illustrate how the magnetic and electrostatic longitudinal derivatives can be computed. The main advantage of this new approach is the fact that the differences in the power spectra of the two phase components (electrostatic phase shifts often have significant power in the higher frequencies) can be accommodated by the selection of two different Tikhonov regularization parameters for the two phase reconstructions. The extra computational demands of the method are more than compensated by the improved phase reconstruction results.

Transport of intensity phase retrieval of arbitrary wave fields including vortices

The phase problem can be considered as one of the cornerstones of quantum mechanics intimately connected to the detection process and the uncertainty relation. The latter impose fundamental limits on the manifold phase reconstruction schemes invented to date, in particular, at small magnitudes of the quantum wave. Here, we show that a rigorous solution of the transport of intensity reconstruction (TIE) scheme in terms of a linear elliptic partial differential equation for the phase provides reconstructions even in the presence of wave zeros if particular boundary conditions are given. We furthermore discuss how partial coherence hampers phase reconstruction and show that a modified version of the TIE reconstructs the curl-free current density at arbitrary (in)coherence. Our results open the way for TIE-based phase retrieval of arbitrary wave fields, eventually containing zeros such as phase vortices.

High-speed transport-of-intensity phase microscopy with an electrically tunable lens

We present a high-speed transport-of-intensity equation (TIE) quantitative phase microscopy technique, named TL-TIE, by combining an electrically tunable lens with a conventional transmission microscope. This permits the specimen at different focus position to be imaged in rapid succession, with constant magnification and no physically moving parts. The simplified image stack collection significantly reduces the acquisition time, allows for the diffraction-limited through-focus intensity stack collection at 15 frames per second, making dynamic TIE phase imaging possible. The technique is demonstrated by profiling of microlens array using optimal frequency selection scheme, and time-lapse imaging of live breast cancer cells by inversion the defocused phase optical transfer function to correct the phase blurring in traditional TIE. Experimental results illustrate its outstanding capability of the technique for quantitative phase imaging, through a simple, non-interferometric, high-speed, high-resolution, and unwrapping-free approach with prosperous applications in micro-optics, life sciences and bio-photonics.

Nonlinear approaches for the single-distance phase retrieval problem involving regularizations with sparsity constraints

The phase retrieval process is a nonlinear ill-posed problem. The Fresnel diffraction patterns obtained with hard x-ray synchrotron beam can be used to retrieve the phase contrast. In this work, we present a convergence comparison of several nonlinear approaches for the phase retrieval problem involving regularizations with sparsity constraints. The phase solution is assumed to have a sparse representation with respect to an orthonormal wavelets basis. One approach uses alternatively a solution of the nonlinear problem based on the Fréchet derivative and a solution of the linear problem in wavelet coordinates with an iterative thresholding. A second method is the one proposed by Ramlau and Teschke which generalizes to a nonlinear problem the classical thresholding algorithm. The algorithms were tested on a 3D Shepp-Logan phantom corrupted by white Gaussian noise. The best simulation results are obtained by the first method for the various noise levels and initializations investigated. The reconstruction errors are significantly decreased with respect to the ones given by the classical linear phase retrieval approaches.

The Aharanov-Bohm effect, magnetic monopoles and reversal in spin-ice lattices

The proof of the Aharonov-Bohm (AB) effect has been one of the most important experiments of the last century and used as essential evidence for the theory of gauge fields. In this article, we look at its fundamental relation to the Dirac monopole and string. Despite the Dirac string being invisible to the AB effect, it can be used to study emergent quasiparticles in condensed matter settings that behave similar to the fundamental monopoles and strings between them. We utilize phase-imaging method based on the AB effect to study the ordering in a one-model system - that of frustrated spin ice - to understand the ordering processes that occur during a magnetic field reversal cycle. The reversal is linked to the propagation of monopole defects linked by flux channels, reminiscent of Dirac strings. Monopole interactions govern the defect densities within the lattice. Furthermore, we exploit these interactions to propose a new ordering method in which high degrees of ground-state ordering can be achieved in a frustrated system.

Transport-of-intensity phase imaging using Savitzky-Golay differentiation filter--theory and applications

Several existing strategies for estimating the axial intensity derivative in the transport-of-intensity equation (TIE) from multiple intensity measurements have been unified by the Savitzky-Golay differentiation filter--an equivalent convolution solution for differentiation estimation by least-squares polynomial fitting. The different viewpoint from the digital filter in signal processing not only provides great insight into the behaviors, the shortcomings, and the performance of these existing intensity derivative estimation algorithms, but more important, it also suggests a new way of improving solution strategies by extending the applications of Savitzky-Golay differentiation filter in TIE. Two novel methods for phase retrieval based on TIE are presented--the first by introducing adaptive-degree strategy in spatial domain and the second by selecting optimal spatial frequencies in Fourier domain. Numerical simulations and experiments verify that the second method outperforms the existing methods significantly, showing reliable retrieved phase with both overall contrast and fine phase variations well preserved.

Enhanced deterministic phase retrieval using a partially developed speckle field

A technique for enhanced deterministic phase retrieval using a partially developed speckle field (PDSF) and a spatial light modulator (SLM) is demonstrated experimentally. A smooth test wavefront impinges on a phase diffuser, forming a PDSF that is directed to a 4f setup. Two defocused speckle intensity measurements are recorded at the output plane corresponding to axially-propagated representations of the PDSF in the input plane. The speckle intensity measurements are then used in a conventional transport of intensity equation (TIE) to reconstruct directly the test wavefront. The PDSF in our technique increases the dynamic range of the axial intensity derivative for smooth phase objects, resulting in a more robust solution to the TIE. The SLM setup enables a fast and accurate recording of speckle intensity. Experimental results are in good agreement with those obtained using the iterative phase retrieval and digital holographic methods of wavefront reconstruction.