A multiple scattering algorithm for three dimensional phase contrast atomic electron tomography

Ghostbuster: A phase retrieval diffraction tomography algorithm for cryo-EM

Ewald sphere curvature correction, which extends beyond the projection approximation, stretches the shallow depth of field in cryo-EM reconstructions of thick particles. Here we show that even for previously assumed thin particles, reconstruction artifacts which we refer to as ghosts can appear. By retrieving the lost phases of the electron exitwaves and accounting for the first Born approximation scattering within the particle, we show that these ghosts can be effectively eliminated. Our simulations demonstrate how such ghostbusting can improve reconstructions as compared to existing state-of-the-art software. Like ptychographic cryo-EM, our Ghostbuster algorithm uses phase retrieval to improve reconstructions, but unlike the former, we do not need to modify the existing data acquisition pipelines.

Reversible phase transformations between Pb nanocrystals and a viscous liquid-like phase

Phase transformations have been a prominent topic of study for both fundamental and applied science. Solid-liquid reaction-induced phase transformations can be hard to characterize, and the transformation mechanisms are often not fully understood. Here, we report reversible phase transformations between a metal (Pb) nanocrystal and a viscous liquid-like phase unveiled by in situ liquid cell transmission electron microscopy. The reversible phase transformations are obtained by modulating the electron current density (between 1000 and 3000 electrons Å-2 s-1). The metal-organic viscous liquid-like phase exhibits short-range ordering with a preferred Pb-Pb distance of 0.5 nm. Assisted by density functional theory and molecular dynamics calculations, we show that the viscous liquid-like phase results from the reactions of Pb with the CH3O fragments from the triethylene glycol solution under electron beam irradiation. Such reversible phase transformations may find broad implementations.

Solving complex nanostructures with ptychographic atomic electron tomography

Transmission electron microscopy (TEM) is essential for determining atomic scale structures in structural biology and materials science. In structural biology, three-dimensional structures of proteins are routinely determined from thousands of identical particles using phase-contrast TEM. In materials science, three-dimensional atomic structures of complex nanomaterials have been determined using atomic electron tomography (AET). However, neither of these methods can determine the three-dimensional atomic structure of heterogeneous nanomaterials containing light elements. Here, we perform ptychographic electron tomography from 34.5 million diffraction patterns to reconstruct an atomic resolution tilt series of a double wall-carbon nanotube (DW-CNT) encapsulating a complex ZrTe sandwich structure. Class averaging the resulting tilt series images and subpixel localization of the atomic peaks reveals a Zr11Te50 structure containing a previously unobserved ZrTe2 phase in the core. The experimental realization of atomic resolution ptychographic electron tomography will allow for the structural determination of a wide range of beam-sensitive nanomaterials containing light elements.

Resolution of Virtual Depth Sectioning from Four-Dimensional Scanning Transmission Electron Microscopy

One approach to three-dimensional structure determination using the wealth of scattering data in four-dimensional (4D) scanning transmission electron microscopy (STEM) is the parallax method proposed by Ophus et al. (2019. Advanced phase reconstruction methods enabled by 4D scanning transmission electron microscopy, Microsc Microanal25, 10-11), which determines the scattering matrix and uses it to synthesize a virtual depth-sectioning reconstruction of the sample structure. Drawing on an equivalence with a hypothetical confocal imaging mode, we derive contrast transfer and point spread functions for this parallax method applied to weakly scattering objects, showing them identical to earlier depth-sectioning STEM modes when only bright field signal is used, but that improved depth resolution is possible if dark field signal can be used. Through a simulation-based study of doped Si, we show that this depth resolution is preserved for thicker samples, explore the impact of shot noise on the parallax reconstructions, discuss challenges to making use of dark field signal, and identify cases where the interpretation of the parallax reconstruction breaks down.

Determining the Projected Crystal Structure from Four-dimensional Scanning Transmission Electron Microscopy via the Scattering Matrix

We present a gradient-descent-based approach to determining the projected electrostatic potential from four-dimensional scanning transmission electron microscopy measurements of a periodic, crystalline material even when dynamical scattering occurs. The method solves for the scattering matrix as an intermediate step, but overcomes the so-called truncation problem that limited previous scattering-matrix-based projected structure determination methods. Gradient descent is made efficient by using analytic expressions for the gradients. Through simulated case studies, we show that iteratively improving the scattering matrix determination can significantly improve the accuracy of the projected structure determination.

Unified fast reconstruction algorithm for conventional, phase-contrast, and diffraction tomography

A unified method for three-dimensional reconstruction of objects from transmission images collected at multiple illumination directions is described. The method may be applicable to experimental conditions relevant to absorption-based, phase-contrast, or diffraction imaging using x rays, electrons, and other forms of penetrating radiation or matter waves. Both the phase retrieval (also known as contrast transfer function correction) and the effect of Ewald sphere curvature (in the cases with a shallow depth of field and significant in-object diffraction) are incorporated in the proposed algorithm and can be taken into account. Multiple scattering is not treated explicitly but can be mitigated as a result of angular averaging that constitutes an essential feature of the method. The corresponding numerical algorithm is based on three-dimensional gridding which allows for fast computational implementation, including a straightforward parallelization. The algorithm can be used with any scanning geometry involving plane-wave illumination. A software code implementing the proposed algorithm has been developed, tested on simulated and experimental image data, and made publicly available.

Three-dimensional bi-functional refractive index and fluorescence microscopy (BRIEF)

Fluorescence microscopy is a powerful tool for imaging biological samples with molecular specificity. In contrast, phase microscopy provides label-free measurement of the sample's refractive index (RI), which is an intrinsic optical property that quantitatively relates to cell morphology, mass, and stiffness. Conventional imaging techniques measure either the labeled fluorescence (functional) information or the label-free RI (structural) information, though it may be valuable to have both. For example, biological tissues have heterogeneous RI distributions, causing sample-induced scattering that degrades the fluorescence image quality. When both fluorescence and 3D RI are measured, one can use the RI information to digitally correct multiple-scattering effects in the fluorescence image. Here, we develop a new computational multi-modal imaging method based on epi-mode microscopy that reconstructs both 3D fluorescence and 3D RI from a single dataset. We acquire dozens of fluorescence images, each 'illuminated' by a single fluorophore, then solve an inverse problem with a multiple-scattering forward model. We experimentally demonstrate our method for epi-mode 3D RI imaging and digital correction of multiple-scattering effects in fluorescence images.

Three-dimensional electron ptychography of organic-inorganic hybrid nanostructures

Three dimensional scaffolded DNA origami with inorganic nanoparticles has been used to create tailored multidimensional nanostructures. However, the image contrast of DNA is poorer than those of the heavy nanoparticles in conventional transmission electron microscopy at high defocus so that the biological and non-biological components in 3D scaffolds cannot be simultaneously resolved using tomography of samples in a native state. We demonstrate the use of electron ptychography to recover high contrast phase information from all components in a DNA origami scaffold without staining. We further quantitatively evaluate the enhancement of contrast in comparison with conventional transmission electron microscopy. In addition, We show that for ptychography post-reconstruction focusing simplifies the workflow and reduces electron dose and beam damage.

The authors demonstrate electron ptychographic computed tomography by simultaneously recording high contrast data from both the organic- and inorganic components in a 3D DNA-origami framework hybrid nanostructure.

Ion complexation waves emerge at the curved interfaces of layered minerals

Visualizing hydrated interfaces is of widespread interest across the physical sciences and is a particularly acute need for layered minerals, whose properties are governed by the structure of the electric double layer (EDL) where mineral and solution meet. Here, we show that cryo electron microscopy and tomography enable direct imaging of the EDL at montmorillonite interfaces in monovalent electrolytes with ångstrom resolution over micron length scales. A learning-based multiple-scattering reconstruction method for cryo electron tomography reveals ions bound asymmetrically on opposite sides of curved, exfoliated layers. We observe conserved ion-density asymmetry across stacks of interacting layers in cryo electron microscopy that is associated with configurations of inner- and outer-sphere ion-water-mineral complexes that we term complexation waves. Coherent X-ray scattering confirms that complexation waves propagate at room-temperature via a competition between ion dehydration and charge interactions that are coupled across opposing sides of a layer, driving dynamic transitions between stacked and aggregated states via layer exfoliation.

The structure of hydrated interfaces is essential for understanding of geochemical processes and behavior of layered minerals. The authors show that waves of hydrated ions emerge at curved aqueous interfaces and couple mineral deformation to the chemistry of the solution.

Method for virtual optical sectioning and tomography utilizing shallow depth of field

A method is proposed for high-resolution, three-dimensional reconstruction of internal structures of objects from planar transmission images. The described approach can be used with any form of radiation or matter waves, in principle, provided that the depth of field is smaller than the thickness of the sample. The physical optics basis for the method is elucidated, and the reconstruction algorithm is presented in detail. A simulated example demonstrates an application of the method to three-dimensional electron transmission imaging of a nanoparticle under realistic radiation dose and spatial resolution constraints. It is envisaged that the method can be applicable in high-resolution transmission electron microscopy, soft x-ray microscopy, ultrasound imaging, and other areas.

A Method for High-Resolution Three-Dimensional Reconstruction with Ewald Sphere Curvature Correction from Transmission Electron Images

A method for three-dimensional reconstruction of objects from defocused images collected at multiple illumination directions in high-resolution transmission electron microscopy is presented. The method effectively corrects for the Ewald sphere curvature by taking into account the in-particle propagation of the electron beam. Numerical simulations demonstrate that the proposed method is capable of accurately reconstructing biological molecules or nanoparticles from high-resolution defocused images under conditions achievable in single-particle electron cryo-microscopy or electron tomography with realistic radiation doses, non-trivial aberrations, multiple scattering, and other experimentally relevant factors. The physics of the method is based on the well-known Diffraction Tomography formalism, but with the phase-retrieval step modified to include a conjugation of the phase (i.e., multiplication of the phase by a negative constant). At each illumination direction, numerically backpropagating the beam with the conjugated phase produces maximum contrast at the location of individual atoms in the molecule or nanoparticle. The resultant algorithm, Conjugated Holographic Reconstruction, can potentially be incorporated into established software tools for single-particle analysis, such as, for example, RELION or FREALIGN, in place of the conventional contrast transfer function correction procedure, in order to account for the Ewald sphere curvature and improve the spatial resolution of the three-dimensional reconstruction.

Simultaneous Successive Twinning Captured by Atomic Electron Tomography

Shape-controlled synthesis of multiply twinned nanostructures is heavily emphasized in nanoscience, in large part due to the desire to control the size, shape, and terminating facets of metal nanoparticles for applications in catalysis. Direct control of the size and shape of solution-grown nanoparticles relies on an understanding of how synthetic parameters alter nanoparticle structures during synthesis. However, while outcome populations can be effectively studied with standard electron microscopy methods, transient structures that appear during some synthetic routes are difficult to study using conventional high resolution imaging methods due to the high complexity of the 3D nanostructures. Here, we have studied the prevalence of transient structures during growth of multiply twinned particles and employed atomic electron tomography to reveal the atomic-scale three-dimensional structure of a Pd nanoparticle undergoing a shape transition. By identifying over 20 000 atoms within the structure and classifying them according to their local crystallographic environment, we observe a multiply twinned structure consistent with a simultaneous successive twinning from a decahedral to icosahedral structure.

Perspective: Emerging strategies for determining atomic-resolution structures of macromolecular complexes within cells

In principle, electron cryo-tomography (cryo-ET) of thin portions of cells provides high-resolution images of the three-dimensional spatial arrangement of all members of the proteome. In practice, however, radiation damage creates a tension between recording images at many different tilt angles, but at correspondingly reduced exposure levels, versus limiting the number of tilt angles in order to improve the signal-to-noise ratio (SNR). Either way, it is challenging to read the available information out at the level of atomic structure. Here, we first review work that explores the optimal strategy for data collection, which currently seems to favor the use of a limited angular range for tilting the sample or even the use of a single image to record the high-resolution information. Looking then to the future, we point to the alternative of so-called “deconvolution microscopy”, which may be applied to tilt-series or optically-sectioned, focal series data. Recording data as a focal series has the advantage that little or no translational alignment of frames might be needed, and a three-dimensional reconstruction might require only 2/3 the number of images as does standard tomography. We also point to the unexploited potential of phase plates to increase the contrast, and thus to reduce the electron exposure levels while retaining the ability align and merge the data. In turn, using much lower exposures per image could have the advantage that high-resolution information is retained throughout the full data-set, whether recorded as a tilt series or a focal series of images.

Making the Most of your Electrons: Challenges and Opportunities in Characterizing Hybrid Interfaces with STEM

Inspired by the unique architectures composed of hard and soft materials in natural and biological systems, synthetic hybrid structures and associated soft-hard interfaces have recently evoked significant interest. Soft matter is typically dominated by fluctuations even at room temperature, while hard matter (which often serves as the substrate or anchor for the soft component) is governed by rigid mechanical behavior. This dichotomy offers considerable opportunities to leverage the disparate properties offered by these components across a wide spectrum spanning from basic science to engineering insights with significant technological overtones. Such hybrid structures, which include polymer nanocomposites, DNA functionalized nanoparticle superlattices and metal organic frameworks to name a few, have delivered promising insights into the areas of catalysis, environmental remediation, optoelectronics, medicine, and beyond. The interfacial structure between these hard and soft phases exists across a variety of length scales and often strongly influence the functionality of hybrid systems. While scanning/transmission electron microscopy (S/TEM) has proven to be a valuable tool for acquiring intricate molecular and nanoscale details of these interfaces, the unusual nature of hybrid composites presents a suite of challenges that make assessing or establishing the classical structure-property relationships especially difficult. These include challenges associated with preparing electron-transparent samples and obtaining sufficient contrast to resolve the interface between dissimilar materials given the dose sensitivity of soft materials. We discuss each of these challenges and supplement a review of recent developments in the field with additional experimental investigations and simulations to present solutions for attaining a nano or atomic-level understanding of these interfaces. These solutions present a host of opportunities for investigating and understanding the role interfaces play in this unique class of functional materials.

Plankton reconstruction through robust statistical optical tomography

Plankton interact with the environment according to their size and three-dimensional (3D) structure. To study them outdoors, these translucent specimens are imaged in situ. Light projects through a specimen in each image. The specimen has a random scale, drawn from the population's size distribution and random unknown pose. The specimen appears only once before drifting away. We achieve 3D tomography using such a random ensemble to statistically estimate an average volumetric distribution of the plankton type and specimen size. To counter errors due to non-rigid deformations, we weight the data, drawing from advanced models developed for cryo-electron microscopy. The weights convey the confidence in the quality of each datum. This confidence relies on a statistical error model. We demonstrate the approach on live plankton using an underwater field microscope.

Scattering Matrix Determination in Crystalline Materials from 4D Scanning Transmission Electron Microscopy at a Single Defocus Value

Recent work has revived interest in the scattering matrix formulation of electron scattering in transmission electron microscopy as a stepping stone toward atomic-resolution structure determination in the presence of multiple scattering. We discuss ways of visualizing the scattering matrix that make its properties clear. Through a simulation-based case study incorporating shot noise, we shown how regularizing on this continuity enables the scattering matrix to be reconstructed from 4D scanning transmission electron microscopy (STEM) measurements from a single defocus value. Intriguingly, for crystalline samples, this process also yields the sample thickness to nanometer accuracy with no a priori knowledge about the sample structure. The reconstruction quality is gauged by using the reconstructed scattering matrix to simulate STEM images at defocus values different from that of the data from which it was reconstructed.

A Close Look at Molecular Self-Assembly with the Transmission Electron Microscope

Molecular self-assembly is pervasive in the formation of living and synthetic materials. Knowledge gained from research into the principles of molecular self-assembly drives innovation in the biological, chemical, and materials sciences. Self-assembly processes span a wide range of temporal and spatial domains and are often unintuitive and complex. Studying such complex processes requires an arsenal of analytical and computational tools. Within this arsenal, the transmission electron microscope stands out for its unique ability to visualize and quantify self-assembly structures and processes. This review describes the contribution that the transmission electron microscope has made to the field of molecular self-assembly. An emphasis is placed on which TEM methods are applicable to different structures and processes and how TEM can be used in combination with other experimental or computational methods. Finally, we provide an outlook on the current challenges to, and opportunities for, increasing the impact that the transmission electron microscope can have on molecular self-assembly.

Studying Reaction Mechanisms in Solution Using a Distributed Electron Microscopy Method

Electron microscopy (EM) of materials undergoing chemical reactions provides knowledge of the underlying mechanisms. However, the mechanisms are often complex and cannot be fully resolved using a single method. Here, we present a distributed electron microscopy method for studying complex reactions. The method combines information from multiple stages of the reaction and from multiple EM methods, including liquid phase EM (LP-EM), cryogenic EM (cryo-EM), and cryo-electron tomography (cryo-ET). We demonstrate this method by studying the desilication mechanism of zeolite crystals. Collectively, our data reveal that the reaction proceeds via a two-step anisotropic etching process and that the defects in curved surfaces and between the subunits in the crystal control the desilication kinetics by directing mass transport.

Upscaling X-ray nanoimaging to macroscopic specimens

Upscaling X-ray nanoimaging to macroscopic specimens has the potential for providing insights across multiple length scales, but its feasibility has long been an open question. By combining the imaging requirements and existing proof-of-principle examples in large-specimen preparation, data acquisition and reconstruction algorithms, the authors provide imaging time estimates for howX-ray nanoimaging can be scaled to macroscopic specimens. To arrive at this estimate, a phase contrast imaging model that includes plural scattering effects is used to calculate the required exposure and corresponding radiation dose. The coherent X-ray flux anticipated from upcoming diffraction-limited light sources is then considered. This imaging time estimation is in particular applied to the case of the connectomes of whole mouse brains. To image the connectome of the whole mouse brain, electron microscopy connectomics might require years, whereas optimized X-ray microscopy connectomics could reduce this to one week. Furthermore, this analysis points to challenges that need to be overcome (such as increased X-ray detector frame rate) and opportunities that advances in artificial-intelligence-based 'smart' scanning might provide. While the technical advances required are daunting, it is shown that X-ray microscopy is indeed potentially applicable to nanoimaging of millimetre- or even centimetre-size specimens.

Multibeam Electron Diffraction

One of the primary uses for transmission electron microscopy (TEM) is to measure diffraction pattern images in order to determine a crystal structure and orientation. In nanobeam electron diffraction (NBED), we scan a moderately converged electron probe over the sample to acquire thousands or even millions of sequential diffraction images, a technique that is especially appropriate for polycrystalline samples. However, due to the large Ewald sphere of TEM, excitation of Bragg peaks can be extremely sensitive to sample tilt, varying strongly for even a few degrees of sample tilt for crystalline samples. In this paper, we present multibeam electron diffraction (MBED), where multiple probe-forming apertures are used to create multiple scanning transmission electron microscopy (STEM) probes, all of which interact with the sample simultaneously. We detail designs for MBED experiments, and a method for using a focused ion beam to produce MBED apertures. We show the efficacy of the MBED technique for crystalline orientation mapping using both simulations and proof-of-principle experiments. We also show how the angular information in MBED can be used to perform 3D tomographic reconstruction of samples without needing to tilt or scan the sample multiple times. Finally, we also discuss future opportunities for the MBED method.

Comparison of distributed memory algorithms for X-ray wave propagation in inhomogeneous media

Calculations of X-ray wave propagation in large objects are needed for modeling diffractive X-ray optics and for optimization-based approaches to image reconstruction for objects that extend beyond the depth of focus. We describe three methods for calculating wave propagation with large arrays on parallel computing systems with distributed memory: (1) a full-array Fresnel multislice approach, (2) a tiling-based short-distance Fresnel multislice approach, and (3) a finite difference approach. We find that the first approach suffers from internode communication delays when the transverse array size becomes large, while the second and third approaches have similar scaling to large array size problems (with the second approach offering about three times the compute speed).