Atomic resolution convergent beam electron diffraction analysis using convolutional neural networks

Autoencoder latent space sensitivity to material structure in convergent-beam low energy electron diffraction

The convergent-beam low energy electron diffraction technique has been proposed as a novel method to gather local structural and electronic information from crystalline surfaces during low-energy electron microscopy. However, the approach suffers from high complexity of the resulting diffraction patterns. We show that Convolutional Autoencoders trained on CBLEED patterns achieve a highly structured latent space. The latent space is then used to estimate structural parameters with sub-angstrom accuracy. The low complexity of the neural networks enables real time application of the approach during experiments with low latency.

Structural degeneracy and formation of crystallographic domains in epitaxial LaFeO3 films revealed by machine-learning assisted 4D-STEM

Structural domains and domain walls, inherent in single crystalline perovskite oxides, can significantly influence the properties of the material and therefore must be considered as a vital part of the design of the epitaxial oxide thin films. We employ 4D-STEM combined with machine learning (ML) to comprehensively characterize domain structures at both high spatial resolution and over a significant spatial extent. Using orthorhombic LaFeO3 as a model system, we explore the application of unsupervised and supervised ML in domain mapping, which demonstrates robustness against experiment uncertainties. The results reveal the consequential formation of multiple domains due to the structural degeneracy when LaFeO3 film is grown on cubic SrTiO3. In situ annealing of the film shows the mechanism of domain coarsening that potentially links to phase transition of LaFeO3 at high temperatures. Moreover, synthesis of LaFeO3 on DyScO3 illustrates that a less symmetric orthorhombic substrate inhibits the formation of domain walls, thereby contributing to the mitigation of structural degeneracy. High fidelity of our approach also highlights the potential for the domain mapping of other complicated materials and thin films.

Momentum transfer resolved electron correlation microscopy

Electron correlation microscopy (ECM) characterizes local structural relaxation dynamics in fluctuating systems like supercooled liquids with nanometer spatial resolution. We have developed a new type of ECM technique that provides moderate resolution in momentum transfer or k space using five-dimensional scanning transmission electron microscopy. k-resolved ECM on a Pt57.5Cu14.7Ni5.3P22.5 metallic supercooled liquids measures rich spatial and momentum structure in the relaxation time data τ(r,k). Relaxation time maps τ(r) at each azimuthal k are independent samples of the material's underlying relaxation time distribution, and τ of radial k shows more complex behavior than the de Gennes narrowing observed in analogous X-ray experiments. We have determined the requirements for electron counts per k-pixel, number of k-pixels per speckle, and time sampling to obtain reliable k-resolved ECM data.

Machine learning in electron microscopy for advanced nanocharacterization: current developments, available tools and future outlook

In the last few years, electron microscopy has experienced a new methodological paradigm aimed to fix the bottlenecks and overcome the challenges of its analytical workflow. Machine learning and artificial intelligence are answering this call providing powerful resources towards automation, exploration, and development. In this review, we evaluate the state-of-the-art of machine learning applied to electron microscopy (and obliquely, to materials and nano-sciences). We start from the traditional imaging techniques to reach the newest higher-dimensionality ones, also covering the recent advances in spectroscopy and tomography. Additionally, the present review provides a practical guide for microscopists, and in general for material scientists, but not necessarily advanced machine learning practitioners, to straightforwardly apply the offered set of tools to their own research. To conclude, we explore the state-of-the-art of other disciplines with a broader experience in applying artificial intelligence methods to their research (e.g., high-energy physics, astronomy, Earth sciences, and even robotics, videogames, or marketing and finances), in order to narrow down the incoming future of electron microscopy, its challenges and outlook.

Large Area, High Resolution Mapping of Approximate Rotational Symmetries in a Pd77.5Cu6Si16.5 Metallic Glass Thin Film

Densely spaced four-dimensional scanning transmission electron microscopy (4D STEM) analyzed using correlation symmetry coefficients enables large area mapping of approximate rotational symmetries in amorphous materials. Here, we report the effects of Poisson noise, limited electron counts, probe coherence, reciprocal space sampling, and the probe-sample interaction volume on 4D STEM symmetry mapping experiments. These results lead to an experiment parameter envelope for high quality, high confidence 4D STEM symmetry mapping. We also establish a direct link between the symmetry coefficients and approximate rotational symmetries of nearest-neighbor atomic clusters using electron diffraction simulations from atomic models of a metallic glass. Experiments on a Pd_77.5Cu₆Si_16.5 metallic glass thin film demonstrate the ability to image the types, sizes, volume fractions, and spatial correlations amongst local rotationally symmetry regions in the glass.

Making the Most of your Electrons: Challenges and Opportunities in Characterizing Hybrid Interfaces with STEM

Inspired by the unique architectures composed of hard and soft materials in natural and biological systems, synthetic hybrid structures and associated soft-hard interfaces have recently evoked significant interest. Soft matter is typically dominated by fluctuations even at room temperature, while hard matter (which often serves as the substrate or anchor for the soft component) is governed by rigid mechanical behavior. This dichotomy offers considerable opportunities to leverage the disparate properties offered by these components across a wide spectrum spanning from basic science to engineering insights with significant technological overtones. Such hybrid structures, which include polymer nanocomposites, DNA functionalized nanoparticle superlattices and metal organic frameworks to name a few, have delivered promising insights into the areas of catalysis, environmental remediation, optoelectronics, medicine, and beyond. The interfacial structure between these hard and soft phases exists across a variety of length scales and often strongly influence the functionality of hybrid systems. While scanning/transmission electron microscopy (S/TEM) has proven to be a valuable tool for acquiring intricate molecular and nanoscale details of these interfaces, the unusual nature of hybrid composites presents a suite of challenges that make assessing or establishing the classical structure-property relationships especially difficult. These include challenges associated with preparing electron-transparent samples and obtaining sufficient contrast to resolve the interface between dissimilar materials given the dose sensitivity of soft materials. We discuss each of these challenges and supplement a review of recent developments in the field with additional experimental investigations and simulations to present solutions for attaining a nano or atomic-level understanding of these interfaces. These solutions present a host of opportunities for investigating and understanding the role interfaces play in this unique class of functional materials.

Prismatic 2.0 - Simulation software for scanning and high resolution transmission electron microscopy (STEM and HRTEM)

Scanning transmission electron microscopy (STEM), where a converged electron probe is scanned over a sample's surface and an imaging, diffraction, or spectroscopic signal is measured as a function of probe position, is an extremely powerful tool for materials characterization. The widespread adoption of hardware aberration correction, direct electron detectors, and computational imaging methods have made STEM one of the most important tools for atomic-resolution materials science. Many of these imaging methods rely on accurate imaging and diffraction simulations in order to interpret experimental results. However, STEM simulations have traditionally required large calculation times, as modeling the electron scattering requires a separate simulation for each of the typically millions of probe positions. We have created the Prismatic simulation code for fast simulation of STEM experiments with support for multi-CPU and multi-GPU (graphics processing unit) systems, using both the conventional multislice and our recently-introduced PRISM method. In this paper, we introduce Prismatic version 2.0, which adds many new algorithmic improvements, an updated graphical user interface (GUI), post-processing of simulation data, and additional operating modes such as plane-wave TEM. We review various aspects of the simulation methods and codes in detail and provide various simulation examples. Prismatic 2.0 is freely available both as an open-source package that can be run using a C++ or Python command line interface, or GUI, as well within a Docker container environment.

Electron backscattered diffraction using a new monolithic direct detector: High resolution and fast acquisition

A monolithic active pixel sensor based direct detector that is optimized for the primary beam energies in scanning electron microscopes is implemented for electron back-scattered diffraction (EBSD) applications. The high detection efficiency of the detector and its large array of pixels allow sensitive and accurate detection of Kikuchi bands arising from primary electron beam excitation energies of 4 keV to 28 keV, with the optimal contrast occurring in the range of 8-16 keV. The diffraction pattern acquisition speed is substantially improved via a sparse sampling mode, resulting from the acquisition of a reduced number of pixels on the detector. Standard inpainting algorithms are implemented to effectively estimate the information in the skipped regions in the acquired diffraction pattern. For EBSD mapping, an acquisition speed as high as 5988 scan points per second is demonstrated, with a tolerable fraction of indexed points and accuracy. The collective capabilities spanning from high angular resolution EBSD patterns to high speed pattern acquisition are achieved on the same detector, facilitating simultaneous detection modalities that enable a multitude of advanced EBSD applications, including lattice strain mapping, structural refinement, low-dose characterization, 3D-EBSD and dynamic in situ EBSD.

Denoising atomic resolution 4D scanning transmission electron microscopy data with tensor singular value decomposition

Tensor singular value decomposition (SVD) is a method to find a low-dimensional representation of data with meaningful structure in three or more dimensions. Tensor SVD has been applied to denoise atomic-resolution 4D scanning transmission electron microscopy (4D STEM) data. On data simulated from a SrTiO₃ [100] perfect crystal and a Si [110] edge dislocation, tensor SVD achieved an average peak signal-to-noise ratio (PSNR) of ~40 dB, which matches or exceeds the performance of other denoising methods, with processing times at least 100 times shorter. On experimental data from SrTiO₃ [100] and LiZnSb [112¯0]/GaSb [110] samples, tensor SVD denoises multiple GB 4D STEM data sets in ten minutes on a typical personal computer. Denoising with tensor SVD improves both convergent beam electron diffraction patterns and virtual-aperture annular dark field images.

Optimal STEM Convergence Angle Selection Using a Convolutional Neural Network and the Strehl Ratio

The selection of the correct convergence angle is essential for achieving the highest resolution imaging in scanning transmission electron microscopy (STEM). The use of poor heuristics, such as Rayleigh's quarter-phase rule, to assess probe quality and uncertainties in the measurement of the aberration function results in the incorrect selection of convergence angles and lower resolution. Here, we show that the Strehl ratio provides an accurate and efficient way to calculate criteria for evaluating the probe size for STEM. A convolutional neural network trained on the Strehl ratio is shown to outperform experienced microscopists at selecting a convergence angle from a single electron Ronchigram using simulated datasets. Generating tens of thousands of simulated Ronchigram examples, the network is trained to select convergence angles yielding probes on average 85% nearer to optimal size at millisecond speeds (0.02% of human assessment time). Qualitative assessment on experimental Ronchigrams with intentionally introduced aberrations suggests that trends in the optimal convergence angle size are well modeled but high accuracy requires a high number of training datasets. This near-immediate assessment of Ronchigrams using the Strehl ratio and machine learning highlights a viable path toward the rapid, automated alignment of aberration-corrected electron microscopes.