1
|
Yeo J, Daurer BJ, Kimanius D, Balakrishnan D, Bepler T, Tan YZ, Loh ND. Ghostbuster: A phase retrieval diffraction tomography algorithm for cryo-EM. Ultramicroscopy 2024; 262:113962. [PMID: 38642481 DOI: 10.1016/j.ultramic.2024.113962] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2023] [Revised: 03/16/2024] [Accepted: 04/01/2024] [Indexed: 04/22/2024]
Abstract
Ewald sphere curvature correction, which extends beyond the projection approximation, stretches the shallow depth of field in cryo-EM reconstructions of thick particles. Here we show that even for previously assumed thin particles, reconstruction artifacts which we refer to as ghosts can appear. By retrieving the lost phases of the electron exitwaves and accounting for the first Born approximation scattering within the particle, we show that these ghosts can be effectively eliminated. Our simulations demonstrate how such ghostbusting can improve reconstructions as compared to existing state-of-the-art software. Like ptychographic cryo-EM, our Ghostbuster algorithm uses phase retrieval to improve reconstructions, but unlike the former, we do not need to modify the existing data acquisition pipelines.
Collapse
Affiliation(s)
- Joel Yeo
- NUS Graduate School for Integrative Sciences and Engineering Programme, National University of Singapore, 119077 Singapore, Singapore; Department of Physics, National University of Singapore, 117551 Singapore, Singapore; Institute of Materials Research and Engineering (IMRE), Agency for Science, Technology and Research (A*STAR), 2 Fusionopolis Way, Innovis #08-03, 138634 Singapore, Singapore
| | - Benedikt J Daurer
- Center for Bio-Imaging Sciences, National University of Singapore, 117557 Singapore, Singapore; Diamond Light Source, Harwell Campus, Didcot, OX11 0DE, UK
| | - Dari Kimanius
- MRC Laboratory of Molecular Biology, Francis Crick Avenue, Cambridge, CB2 0QH, UK; CZ Imaging Institute, 3400 Bridge Parkway, Redwood City, CA 94065, USA
| | - Deepan Balakrishnan
- Department of Biological Sciences, National University of Singapore, 117558 Singapore, Singapore; Center for Bio-Imaging Sciences, National University of Singapore, 117557 Singapore, Singapore
| | - Tristan Bepler
- Simons Machine Learning Center, New York Structural Biology Center, New York, NY, USA
| | - Yong Zi Tan
- Department of Biological Sciences, National University of Singapore, 117558 Singapore, Singapore; Center for Bio-Imaging Sciences, National University of Singapore, 117557 Singapore, Singapore; Disease Intervention Technology Laboratory (DITL), Agency for Science, Technology and Research (A*STAR), 8A Biomedical Grove, 138648 Singapore, Singapore; Institute of Molecular and Cell Biology (IMCB), Agency for Science, Technology and Research (A*STAR), 61 Biopolis Drive, Proteos, 138673 Singapore, Singapore
| | - N Duane Loh
- NUS Graduate School for Integrative Sciences and Engineering Programme, National University of Singapore, 119077 Singapore, Singapore; Department of Physics, National University of Singapore, 117551 Singapore, Singapore; Department of Biological Sciences, National University of Singapore, 117558 Singapore, Singapore; Center for Bio-Imaging Sciences, National University of Singapore, 117557 Singapore, Singapore.
| |
Collapse
|
2
|
Yang W, Sha H, Cui J, Mao L, Yu R. Local-orbital ptychography for ultrahigh-resolution imaging. NATURE NANOTECHNOLOGY 2024; 19:612-617. [PMID: 38286877 DOI: 10.1038/s41565-023-01595-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Accepted: 12/20/2023] [Indexed: 01/31/2024]
Abstract
Technical advances paired with developments in methodology have enabled electron microscopy to reach atomic resolution. Further improving the information limit in microscopic imaging requires further improvements in methodology. Here we report a ptychographic method that describes the object as the sum of discrete atomic-orbital-like functions (for example, Gaussian functions) and the probe in terms of aberration functions. Using this method, we realize an improved information limit of microscopic imaging, reaching down to 14 pm. High-quality probes and objects contribute to superior signal-to-noise ratios at low electron doses, allowing for relaxation of the sample thickness restriction to 50 nm for dense materials. Additionally, our method has the capability to decompose the total phase into element components, revealing that the information limit is element dependent. With enhanced spatial resolution, signal-to-noise ratio and thickness threshold compared with conventional ptychography methods, our local-orbital ptychography may find applications in atomic-resolution imaging of metals, ceramics, electronic devices or beam-sensitive material.
Collapse
Affiliation(s)
- Wenfeng Yang
- School of Materials Science and Engineering, Tsinghua University, Beijing, China
- MOE Key Laboratory of Advanced Materials, Tsinghua University, Beijing, China
- State Key Laboratory of New Ceramics and Fine Processing, Tsinghua University, Beijing, China
| | - Haozhi Sha
- School of Materials Science and Engineering, Tsinghua University, Beijing, China
- MOE Key Laboratory of Advanced Materials, Tsinghua University, Beijing, China
- State Key Laboratory of New Ceramics and Fine Processing, Tsinghua University, Beijing, China
| | - Jizhe Cui
- School of Materials Science and Engineering, Tsinghua University, Beijing, China
- MOE Key Laboratory of Advanced Materials, Tsinghua University, Beijing, China
- State Key Laboratory of New Ceramics and Fine Processing, Tsinghua University, Beijing, China
| | - Liangze Mao
- School of Materials Science and Engineering, Tsinghua University, Beijing, China
- MOE Key Laboratory of Advanced Materials, Tsinghua University, Beijing, China
- State Key Laboratory of New Ceramics and Fine Processing, Tsinghua University, Beijing, China
| | - Rong Yu
- School of Materials Science and Engineering, Tsinghua University, Beijing, China.
- MOE Key Laboratory of Advanced Materials, Tsinghua University, Beijing, China.
- State Key Laboratory of New Ceramics and Fine Processing, Tsinghua University, Beijing, China.
| |
Collapse
|
3
|
Ma Y, Shi J, Guzman R, Li A, Zhou W. Aberration Correction for Large-Angle Illumination Scanning Transmission Electron Microscopy by Using Iterative Electron Ptychography Algorithms. MICROSCOPY AND MICROANALYSIS : THE OFFICIAL JOURNAL OF MICROSCOPY SOCIETY OF AMERICA, MICROBEAM ANALYSIS SOCIETY, MICROSCOPICAL SOCIETY OF CANADA 2024; 30:226-235. [PMID: 38578297 DOI: 10.1093/mam/ozae027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Revised: 01/21/2024] [Accepted: 01/24/2024] [Indexed: 04/06/2024]
Abstract
Modern aberration correctors in the scanning transmission electron microscope (STEM) have dramatically improved the attainable spatial resolution and enabled atomical structure and spectroscopic analysis even at low acceleration voltages (≤80 kV). For a large-angle illumination, achieving successful aberration correction to high angles is challenging with an aberration corrector, which limits further improvements in applications such as super-resolution, three-dimensional atomic depth resolution, or atomic surface morphology analyses. Electron ptychography based on four-dimensional STEM can provide a postprocessing strategy to overcome the current technological limitations. In this work, we have demonstrated that aberration correction for large-angle illumination is feasible by pushing the capabilities of regularized ptychographic iterative engine algorithms to reconstruct 4D data sets acquired using a relatively low-efficiency complementary metal oxide semiconductor camera. We report super resolution (0.71 Å) with large-angle illumination (50-60 mrad) and under 60 kV accelerating voltage.
Collapse
Affiliation(s)
- Yinhang Ma
- School of Physical Sciences and CAS Key Laboratory of Vacuum Physics, University of Chinese Academy of Sciences, Beijing 100190, China
| | - Jinan Shi
- School of Physical Sciences and CAS Key Laboratory of Vacuum Physics, University of Chinese Academy of Sciences, Beijing 100190, China
| | - Roger Guzman
- School of Physical Sciences and CAS Key Laboratory of Vacuum Physics, University of Chinese Academy of Sciences, Beijing 100190, China
| | - Ang Li
- School of Physical Sciences and CAS Key Laboratory of Vacuum Physics, University of Chinese Academy of Sciences, Beijing 100190, China
| | - Wu Zhou
- School of Physical Sciences and CAS Key Laboratory of Vacuum Physics, University of Chinese Academy of Sciences, Beijing 100190, China
| |
Collapse
|
4
|
Nguyen KX, Jiang Y, Lee CH, Kharel P, Zhang Y, van der Zande AM, Huang PY. Achieving sub-0.5-angstrom-resolution ptychography in an uncorrected electron microscope. Science 2024; 383:865-870. [PMID: 38386746 DOI: 10.1126/science.adl2029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Accepted: 01/19/2024] [Indexed: 02/24/2024]
Abstract
Subangstrom resolution has long been limited to aberration-corrected electron microscopy, where it is a powerful tool for understanding the atomic structure and properties of matter. Here, we demonstrate electron ptychography in an uncorrected scanning transmission electron microscope (STEM) with deep subangstrom spatial resolution down to 0.44 angstroms, exceeding the conventional resolution of aberration-corrected tools and rivaling their highest ptychographic resolutions. Our approach, which we demonstrate on twisted two-dimensional materials in a widely available commercial microscope, far surpasses prior ptychographic resolutions (1 to 5 angstroms) of uncorrected STEMs. We further show how geometric aberrations can create optimized, structured beams for dose-efficient electron ptychography. Our results demonstrate that expensive aberration correctors are no longer required for deep subangstrom resolution.
Collapse
Affiliation(s)
- Kayla X Nguyen
- Department of Materials Science and Engineering, University of Illinois Urbana-Champaign, Urbana, IL, USA
| | - Yi Jiang
- Advanced Photon Source Facility, Argonne National Laboratory, Lemont, IL, USA
| | - Chia-Hao Lee
- Department of Materials Science and Engineering, University of Illinois Urbana-Champaign, Urbana, IL, USA
| | - Priti Kharel
- Department of Chemistry, University of Illinois Urbana-Champaign, Urbana, IL, USA
| | - Yue Zhang
- Department of Mechanical Science and Engineering, University of Illinois Urbana-Champaign, Urbana, IL, USA
| | - Arend M van der Zande
- Department of Materials Science and Engineering, University of Illinois Urbana-Champaign, Urbana, IL, USA
- Department of Mechanical Science and Engineering, University of Illinois Urbana-Champaign, Urbana, IL, USA
- Materials Research Laboratory, University of Illinois Urbana-Champaign, Urbana, IL, USA
| | - Pinshane Y Huang
- Department of Materials Science and Engineering, University of Illinois Urbana-Champaign, Urbana, IL, USA
- Materials Research Laboratory, University of Illinois Urbana-Champaign, Urbana, IL, USA
| |
Collapse
|
5
|
Ribet SM, Zeltmann SE, Bustillo KC, Dhall R, Denes P, Minor AM, Dos Reis R, Dravid VP, Ophus C. Design of Electrostatic Aberration Correctors for Scanning Transmission Electron Microscopy. MICROSCOPY AND MICROANALYSIS : THE OFFICIAL JOURNAL OF MICROSCOPY SOCIETY OF AMERICA, MICROBEAM ANALYSIS SOCIETY, MICROSCOPICAL SOCIETY OF CANADA 2023; 29:1950-1960. [PMID: 37851063 DOI: 10.1093/micmic/ozad111] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Revised: 08/29/2023] [Accepted: 09/24/2023] [Indexed: 10/19/2023]
Abstract
In a scanning transmission electron microscope (STEM), producing a high-resolution image generally requires an electron beam focused to the smallest point possible. However, the magnetic lenses used to focus the beam are unavoidably imperfect, introducing aberrations that limit resolution. Modern STEMs overcome this by using hardware aberration correctors comprised of many multipole elements, but these devices are complex, expensive, and can be difficult to tune. We demonstrate a design for an electrostatic phase plate that can act as an aberration corrector. The corrector is comprised of annular segments, each of which is an independent two-terminal device that can apply a constant or ramped phase shift to a portion of the electron beam. We show the improvement in image resolution using an electrostatic corrector. Engineering criteria impose that much of the beam within the probe-forming aperture be blocked by support bars, leading to large probe tails for the corrected probe that sample the specimen beyond the central lobe. We also show how this device can be used to create other STEM beam profiles such as vortex beams and probes with a high degree of phase diversity, which improve information transfer in ptychographic reconstructions.
Collapse
Affiliation(s)
- Stephanie M Ribet
- Department of Materials Science and Engineering, Northwestern University, Evanston, IL 60208, USA
- International Institute of Nanotechnology, Northwestern University, Evanston, IL 60208, USA
- National Center for Electron Microscopy, Molecular Foundry, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA
| | - Steven E Zeltmann
- Platform for the Accelerated Realization, Analysis, and Discovery of Interface Materials (PARADIM), Cornell University, Ithaca, NY 14853, USA
- Department of Materials Science and Engineering, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Karen C Bustillo
- National Center for Electron Microscopy, Molecular Foundry, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA
| | - Rohan Dhall
- National Center for Electron Microscopy, Molecular Foundry, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA
| | - Peter Denes
- Molecular Foundry, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA
| | - Andrew M Minor
- National Center for Electron Microscopy, Molecular Foundry, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA
- Department of Materials Science and Engineering, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Roberto Dos Reis
- Department of Materials Science and Engineering, Northwestern University, Evanston, IL 60208, USA
- International Institute of Nanotechnology, Northwestern University, Evanston, IL 60208, USA
- The NUANCE Center, Northwestern University, Evanston, IL 60208, USA
| | - Vinayak P Dravid
- Department of Materials Science and Engineering, Northwestern University, Evanston, IL 60208, USA
- International Institute of Nanotechnology, Northwestern University, Evanston, IL 60208, USA
- The NUANCE Center, Northwestern University, Evanston, IL 60208, USA
| | - Colin Ophus
- National Center for Electron Microscopy, Molecular Foundry, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA
| |
Collapse
|
6
|
Huang C, Kim JS, Kirkland AI. Cryo-electron ptychography: Applications and potential in biological characterisation. Curr Opin Struct Biol 2023; 83:102730. [PMID: 37992450 DOI: 10.1016/j.sbi.2023.102730] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Revised: 09/06/2023] [Accepted: 10/16/2023] [Indexed: 11/24/2023]
Abstract
There is a clear need for developments in characterisation techniques that provide detailed information about structure-function relationships in biology. Using electron microscopy to achieve high resolution while maintaining a broad field of view remains a challenge, particularly for radiation-sensitive specimens where the signal-to-noise ratio required to maintain structural integrity is limited by low electron fluence. In this review, we explore the potential of cryogenic electron ptychography as an alternative method for characterising biological systems under low-fluence conditions. Using this method with increased information content from multiple sampled regions of interest potentially allows 3D reconstruction with far fewer particles than required in conventional cryo-electron microscopy. This is important for achieving higher resolution in systems where distributions of homogeneous single particles are difficult to obtain. We discuss the progress, limitations, and potential areas for future development of this approach for both single particle analysis and applications to heterogeneous large objects.
Collapse
Affiliation(s)
- Chen Huang
- Rosalind Franklin Institute, Harwell Science and Innovation Campus, Didcot, OX11 0QX, United Kingdom.
| | - Judy S Kim
- Rosalind Franklin Institute, Harwell Science and Innovation Campus, Didcot, OX11 0QX, United Kingdom; Department of Materials, University of Oxford, Oxford, OX1 3PH, United Kingdom
| | - Angus I Kirkland
- Rosalind Franklin Institute, Harwell Science and Innovation Campus, Didcot, OX11 0QX, United Kingdom; Department of Materials, University of Oxford, Oxford, OX1 3PH, United Kingdom
| |
Collapse
|
7
|
Pelz PM, Griffin SM, Stonemeyer S, Popple D, DeVyldere H, Ercius P, Zettl A, Scott MC, Ophus C. Solving complex nanostructures with ptychographic atomic electron tomography. Nat Commun 2023; 14:7906. [PMID: 38036516 PMCID: PMC10689721 DOI: 10.1038/s41467-023-43634-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2023] [Accepted: 11/15/2023] [Indexed: 12/02/2023] Open
Abstract
Transmission electron microscopy (TEM) is essential for determining atomic scale structures in structural biology and materials science. In structural biology, three-dimensional structures of proteins are routinely determined from thousands of identical particles using phase-contrast TEM. In materials science, three-dimensional atomic structures of complex nanomaterials have been determined using atomic electron tomography (AET). However, neither of these methods can determine the three-dimensional atomic structure of heterogeneous nanomaterials containing light elements. Here, we perform ptychographic electron tomography from 34.5 million diffraction patterns to reconstruct an atomic resolution tilt series of a double wall-carbon nanotube (DW-CNT) encapsulating a complex ZrTe sandwich structure. Class averaging the resulting tilt series images and subpixel localization of the atomic peaks reveals a Zr11Te50 structure containing a previously unobserved ZrTe2 phase in the core. The experimental realization of atomic resolution ptychographic electron tomography will allow for the structural determination of a wide range of beam-sensitive nanomaterials containing light elements.
Collapse
Affiliation(s)
- Philipp M Pelz
- Institute of Micro- and Nanostructure Research (IMN) & Center for Nanoanalysis and Electron Microscopy (CENEM), Friedrich Alexander-Universität Erlangen-Nürnberg, IZNF, 91058, Erlangen, Germany.
- Department of Materials Science and Engineering, University of California Berkeley, Berkeley, CA, 94720, USA.
- The Molecular Foundry, Lawrence Berkeley National Laboratory, Berkeley, CA, 94720, USA.
| | - Sinéad M Griffin
- The Molecular Foundry, Lawrence Berkeley National Laboratory, Berkeley, CA, 94720, USA
- Materials Sciences Division, Lawrence Berkeley National Laboratory, Berkeley, CA, 94720, USA
| | - Scott Stonemeyer
- Materials Sciences Division, Lawrence Berkeley National Laboratory, Berkeley, CA, 94720, USA
- Kavli Energy NanoSciences Institute at the University of California at Berkeley, Berkeley, CA, 94720, USA
- Department of Chemistry, University of California at Berkeley, Berkeley, CA, 94720, USA
- Department of Physics, University of California at Berkeley, Berkeley, CA, 94720, USA
| | - Derek Popple
- Materials Sciences Division, Lawrence Berkeley National Laboratory, Berkeley, CA, 94720, USA
- Kavli Energy NanoSciences Institute at the University of California at Berkeley, Berkeley, CA, 94720, USA
- Department of Chemistry, University of California at Berkeley, Berkeley, CA, 94720, USA
- Department of Physics, University of California at Berkeley, Berkeley, CA, 94720, USA
| | - Hannah DeVyldere
- Department of Materials Science and Engineering, University of California Berkeley, Berkeley, CA, 94720, USA
| | - Peter Ercius
- The Molecular Foundry, Lawrence Berkeley National Laboratory, Berkeley, CA, 94720, USA
| | - Alex Zettl
- Department of Materials Science and Engineering, University of California Berkeley, Berkeley, CA, 94720, USA
- Materials Sciences Division, Lawrence Berkeley National Laboratory, Berkeley, CA, 94720, USA
- Kavli Energy NanoSciences Institute at the University of California at Berkeley, Berkeley, CA, 94720, USA
- Department of Physics, University of California at Berkeley, Berkeley, CA, 94720, USA
| | - Mary C Scott
- Department of Materials Science and Engineering, University of California Berkeley, Berkeley, CA, 94720, USA
- The Molecular Foundry, Lawrence Berkeley National Laboratory, Berkeley, CA, 94720, USA
- Materials Sciences Division, Lawrence Berkeley National Laboratory, Berkeley, CA, 94720, USA
| | - Colin Ophus
- The Molecular Foundry, Lawrence Berkeley National Laboratory, Berkeley, CA, 94720, USA.
| |
Collapse
|
8
|
Ribet SM, Zeltmann SE, Varnavides G, Dos Reis R, Dravid VP, Ophus C. Phase Diversity in Ptychographic Reconstructions with a Programmable Phase Plate. MICROSCOPY AND MICROANALYSIS : THE OFFICIAL JOURNAL OF MICROSCOPY SOCIETY OF AMERICA, MICROBEAM ANALYSIS SOCIETY, MICROSCOPICAL SOCIETY OF CANADA 2023; 29:296-297. [PMID: 37613536 DOI: 10.1093/micmic/ozad067.137] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/25/2023]
Affiliation(s)
- Stephanie M Ribet
- Department of Materials Science and Engineering, Northwestern University, Evanston, IL, USA
- International Institute of Nanotechnology, Northwestern University, Evanston, IL, USA
- National Center for Electron Microscopy, Molecular Foundry, Lawrence Berkeley National Lab, Berkeley, CA, USA
| | - Steven E Zeltmann
- Department of Materials Science and Engineering, University of California, Berkeley, CA, USA
| | - Georgios Varnavides
- National Center for Electron Microscopy, Molecular Foundry, Lawrence Berkeley National Lab, Berkeley, CA, USA
- Miller Institute for Basic Research in Science, University of California, Berkeley, CA, USA
| | - Roberto Dos Reis
- Department of Materials Science and Engineering, Northwestern University, Evanston, IL, USA
- International Institute of Nanotechnology, Northwestern University, Evanston, IL, USA
- The NUANCE Center, Northwestern University, Evanston, IL, USA
| | - Vinayak P Dravid
- Department of Materials Science and Engineering, Northwestern University, Evanston, IL, USA
- International Institute of Nanotechnology, Northwestern University, Evanston, IL, USA
- The NUANCE Center, Northwestern University, Evanston, IL, USA
| | - Colin Ophus
- National Center for Electron Microscopy, Molecular Foundry, Lawrence Berkeley National Lab, Berkeley, CA, USA
| |
Collapse
|
9
|
Chao HY, Venkatraman K, Moniri S, Jiang Y, Tang X, Dai S, Gao W, Miao J, Chi M. In Situ and Emerging Transmission Electron Microscopy for Catalysis Research. Chem Rev 2023. [PMID: 37327473 DOI: 10.1021/acs.chemrev.2c00880] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/18/2023]
Abstract
Catalysts are the primary facilitator in many dynamic processes. Therefore, a thorough understanding of these processes has vast implications for a myriad of energy systems. The scanning/transmission electron microscope (S/TEM) is a powerful tool not only for atomic-scale characterization but also in situ catalytic experimentation. Techniques such as liquid and gas phase electron microscopy allow the observation of catalysts in an environment conducive to catalytic reactions. Correlated algorithms can greatly improve microscopy data processing and expand multidimensional data handling. Furthermore, new techniques including 4D-STEM, atomic electron tomography, cryogenic electron microscopy, and monochromated electron energy loss spectroscopy (EELS) push the boundaries of our comprehension of catalyst behavior. In this review, we discuss the existing and emergent techniques for observing catalysts using S/TEM. Challenges and opportunities highlighted aim to inspire and accelerate the use of electron microscopy to further investigate the complex interplay of catalytic systems.
Collapse
Affiliation(s)
- Hsin-Yun Chao
- Center for Nanophase Materials Sciences, One Bethel Valley Road, Building 4515, Oak Ridge, Tennessee 37831-6064, United States
| | - Kartik Venkatraman
- Center for Nanophase Materials Sciences, One Bethel Valley Road, Building 4515, Oak Ridge, Tennessee 37831-6064, United States
| | - Saman Moniri
- Department of Physics and Astronomy and California NanoSystems Institute, University of California, Los Angeles, California 90095, United States
| | - Yongjun Jiang
- Key Laboratory for Advanced Materials and Joint International Research Laboratory of Precision Chemistry and Molecular Engineering, School of Chemistry and Molecular Engineering, East China University of Science & Technology, Shanghai 200237, China
| | - Xuan Tang
- Key Laboratory for Advanced Materials and Joint International Research Laboratory of Precision Chemistry and Molecular Engineering, School of Chemistry and Molecular Engineering, East China University of Science & Technology, Shanghai 200237, China
| | - Sheng Dai
- Key Laboratory for Advanced Materials and Joint International Research Laboratory of Precision Chemistry and Molecular Engineering, School of Chemistry and Molecular Engineering, East China University of Science & Technology, Shanghai 200237, China
| | - Wenpei Gao
- School of Materials Science and Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
- Department of Materials Science and Engineering, North Carolina State University, Raleigh, North Carolina 27695, United States
| | - Jianwei Miao
- Department of Physics and Astronomy and California NanoSystems Institute, University of California, Los Angeles, California 90095, United States
| | - Miaofang Chi
- Center for Nanophase Materials Sciences, One Bethel Valley Road, Building 4515, Oak Ridge, Tennessee 37831-6064, United States
| |
Collapse
|
10
|
Schloz M, Müller J, Pekin TC, Van den Broek W, Madsen J, Susi T, Koch CT. Deep reinforcement learning for data-driven adaptive scanning in ptychography. Sci Rep 2023; 13:8732. [PMID: 37253763 PMCID: PMC10229550 DOI: 10.1038/s41598-023-35740-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2022] [Accepted: 05/23/2023] [Indexed: 06/01/2023] Open
Abstract
We present a method that lowers the dose required for an electron ptychographic reconstruction by adaptively scanning the specimen, thereby providing the required spatial information redundancy in the regions of highest importance. The proposed method is built upon a deep learning model that is trained by reinforcement learning, using prior knowledge of the specimen structure from training data sets. We show that using adaptive scanning for electron ptychography outperforms alternative low-dose ptychography experiments in terms of reconstruction resolution and quality.
Collapse
Affiliation(s)
- Marcel Schloz
- Institute of Physics and IRIS Adlershof, Humboldt Universität zu Berlin, Newtonstraße 15, 12489, Berlin, Germany.
| | - Johannes Müller
- Institute of Physics and IRIS Adlershof, Humboldt Universität zu Berlin, Newtonstraße 15, 12489, Berlin, Germany
| | - Thomas C Pekin
- Institute of Physics and IRIS Adlershof, Humboldt Universität zu Berlin, Newtonstraße 15, 12489, Berlin, Germany
| | - Wouter Van den Broek
- Institute of Physics and IRIS Adlershof, Humboldt Universität zu Berlin, Newtonstraße 15, 12489, Berlin, Germany
| | - Jacob Madsen
- Faculty of Physics, University of Vienna, Boltzmanngasse 5, 1090, Vienna, Austria
| | - Toma Susi
- Faculty of Physics, University of Vienna, Boltzmanngasse 5, 1090, Vienna, Austria
| | - Christoph T Koch
- Institute of Physics and IRIS Adlershof, Humboldt Universität zu Berlin, Newtonstraße 15, 12489, Berlin, Germany
| |
Collapse
|
11
|
Pei X, Zhou L, Huang C, Boyce M, Kim JS, Liberti E, Hu Y, Sasaki T, Nellist PD, Zhang P, Stuart DI, Kirkland AI, Wang P. Cryogenic electron ptychographic single particle analysis with wide bandwidth information transfer. Nat Commun 2023; 14:3027. [PMID: 37230988 PMCID: PMC10212999 DOI: 10.1038/s41467-023-38268-0] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2022] [Accepted: 04/22/2023] [Indexed: 05/27/2023] Open
Abstract
Advances in cryogenic transmission electron microscopy have revolutionised the determination of many macromolecular structures at atomic or near-atomic resolution. This method is based on conventional defocused phase contrast imaging. However, it has limitations of weaker contrast for small biological molecules embedded in vitreous ice, in comparison with cryo-ptychography, which shows increased contrast. Here we report a single-particle analysis based on the use of ptychographic reconstruction data, demonstrating that three dimensional reconstructions with a wide information transfer bandwidth can be recovered by Fourier domain synthesis. Our work suggests future applications in otherwise challenging single particle analyses, including small macromolecules and heterogeneous or flexible particles. In addition structure determination in situ within cells without the requirement for protein purification and expression may be possible.
Collapse
Affiliation(s)
- Xudong Pei
- National Laboratory of Solid State Microstructures, Jiangsu Key Laboratory of Artificial Functional Materials, College of Engineering and Applied Sciences and Collaborative Innovation Center of Advanced Microstructures, Nanjing University, Nanjing, China
| | - Liqi Zhou
- National Laboratory of Solid State Microstructures, Jiangsu Key Laboratory of Artificial Functional Materials, College of Engineering and Applied Sciences and Collaborative Innovation Center of Advanced Microstructures, Nanjing University, Nanjing, China
- Department of Physics, University of Warwick, Coventry, UK
| | - Chen Huang
- The Rosalind Franklin Institute, Harwell Science and Innovation Campus, Didcot, UK
| | - Mark Boyce
- Division of Structural Biology, Welcome Trust Centre for Human Genetics, University of Oxford, Oxford, UK
| | - Judy S Kim
- The Rosalind Franklin Institute, Harwell Science and Innovation Campus, Didcot, UK
- Department of Materials, University of Oxford, Oxford, UK
| | - Emanuela Liberti
- The Rosalind Franklin Institute, Harwell Science and Innovation Campus, Didcot, UK
| | - Yiming Hu
- National Laboratory of Solid State Microstructures, Jiangsu Key Laboratory of Artificial Functional Materials, College of Engineering and Applied Sciences and Collaborative Innovation Center of Advanced Microstructures, Nanjing University, Nanjing, China
| | | | | | - Peijun Zhang
- Division of Structural Biology, Welcome Trust Centre for Human Genetics, University of Oxford, Oxford, UK
- Diamond Light Source, Harwell Science and Innovation Campus, Didcot, UK
| | - David I Stuart
- Division of Structural Biology, Welcome Trust Centre for Human Genetics, University of Oxford, Oxford, UK
- Diamond Light Source, Harwell Science and Innovation Campus, Didcot, UK
| | - Angus I Kirkland
- The Rosalind Franklin Institute, Harwell Science and Innovation Campus, Didcot, UK.
- Department of Materials, University of Oxford, Oxford, UK.
- Diamond Light Source, Harwell Science and Innovation Campus, Didcot, UK.
| | - Peng Wang
- National Laboratory of Solid State Microstructures, Jiangsu Key Laboratory of Artificial Functional Materials, College of Engineering and Applied Sciences and Collaborative Innovation Center of Advanced Microstructures, Nanjing University, Nanjing, China.
- Department of Physics, University of Warwick, Coventry, UK.
| |
Collapse
|
12
|
Loetgering L, Du M, Boonzajer Flaes D, Aidukas T, Wechsler F, Penagos Molina DS, Rose M, Pelekanidis A, Eschen W, Hess J, Wilhein T, Heintzmann R, Rothhardt J, Witte S. PtyLab.m/py/jl: a cross-platform, open-source inverse modeling toolbox for conventional and Fourier ptychography. OPTICS EXPRESS 2023; 31:13763-13797. [PMID: 37157257 DOI: 10.1364/oe.485370] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
Conventional (CP) and Fourier (FP) ptychography have emerged as versatile quantitative phase imaging techniques. While the main application cases for each technique are different, namely lens-less short wavelength imaging for CP and lens-based visible light imaging for FP, both methods share a common algorithmic ground. CP and FP have in part independently evolved to include experimentally robust forward models and inversion techniques. This separation has resulted in a plethora of algorithmic extensions, some of which have not crossed the boundary from one modality to the other. Here, we present an open source, cross-platform software, called PtyLab, enabling both CP and FP data analysis in a unified framework. With this framework, we aim to facilitate and accelerate cross-pollination between the two techniques. Moreover, the availability in Matlab, Python, and Julia will set a low barrier to enter each field.
Collapse
|
13
|
Ning S, Xu W, Loh L, Lu Z, Bosman M, Zhang F, He Q. An integrated constrained gradient descent (iCGD) protocol to correct scan-positional errors for electron ptychography with high accuracy and precision. Ultramicroscopy 2023; 248:113716. [PMID: 36958156 DOI: 10.1016/j.ultramic.2023.113716] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2022] [Revised: 02/11/2023] [Accepted: 03/10/2023] [Indexed: 03/13/2023]
Abstract
Correcting scan-positional errors is critical in achieving electron ptychography with both high resolution and high precision. This is a demanding and challenging task due to the sheer number of parameters that need to be optimized. For atomic-resolution ptychographic reconstructions, we found classical refining methods for scan positions not satisfactory due to the inherent entanglement between the object and scan positions, which can produce systematic errors in the results. Here, we propose a new protocol consisting of a series of constrained gradient descent (CGD) methods to achieve better recovery of scan positions. The central idea of these CGD methods is to utilize a priori knowledge about the nature of STEM experiments and add necessary constraints to isolate different types of scan positional errors during the iterative reconstruction process. Each constraint will be introduced with the help of simulated 4D-STEM datasets with known positional errors. Then the integrated constrained gradient decent (iCGD) protocol will be demonstrated using an experimental 4D-STEM dataset of the 1H-MoS2 monolayer. We will show that the iCGD protocol can effectively address the errors of scan positions across the spectrum and help to achieve electron ptychography with high accuracy and precision.
Collapse
Affiliation(s)
- Shoucong Ning
- Department of Materials Science and Engineering, National University of Singapore, 117575, Singapore
| | - Wenhui Xu
- Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen 518055, China; Harbin Institute of Technology, Harbin 150001, China
| | - Leyi Loh
- Department of Materials Science and Engineering, National University of Singapore, 117575, Singapore
| | - Zhen Lu
- Institute of Physics, Chinese Academy of Sciences, Beijing 100190, China
| | - Michel Bosman
- Department of Materials Science and Engineering, National University of Singapore, 117575, Singapore
| | - Fucai Zhang
- Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen 518055, China
| | - Qian He
- Department of Materials Science and Engineering, National University of Singapore, 117575, Singapore.
| |
Collapse
|
14
|
Guzzi F, Gianoncelli A, Billè F, Carrato S, Kourousias G. Automatic Differentiation for Inverse Problems in X-ray Imaging and Microscopy. Life (Basel) 2023; 13:life13030629. [PMID: 36983785 PMCID: PMC10051220 DOI: 10.3390/life13030629] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2022] [Revised: 02/17/2023] [Accepted: 02/20/2023] [Indexed: 03/06/2023] Open
Abstract
Computational techniques allow breaking the limits of traditional imaging methods, such as time restrictions, resolution, and optics flaws. While simple computational methods can be enough for highly controlled microscope setups or just for previews, an increased level of complexity is instead required for advanced setups, acquisition modalities or where uncertainty is high; the need for complex computational methods clashes with rapid design and execution. In all these cases, Automatic Differentiation, one of the subtopics of Artificial Intelligence, may offer a functional solution, but only if a GPU implementation is available. In this paper, we show how a framework built to solve just one optimisation problem can be employed for many different X-ray imaging inverse problems.
Collapse
Affiliation(s)
- Francesco Guzzi
- Elettra—Sincrotrone Trieste, Strada Statale 14—km 163,500 in AREA Science Park, Basovizza, 34149 Trieste, Italy
- Correspondence:
| | - Alessandra Gianoncelli
- Elettra—Sincrotrone Trieste, Strada Statale 14—km 163,500 in AREA Science Park, Basovizza, 34149 Trieste, Italy
| | - Fulvio Billè
- Elettra—Sincrotrone Trieste, Strada Statale 14—km 163,500 in AREA Science Park, Basovizza, 34149 Trieste, Italy
| | - Sergio Carrato
- Department of Engineering and Architecture (DIA), University of Trieste, 34127 Trieste, Italy
| | - George Kourousias
- Elettra—Sincrotrone Trieste, Strada Statale 14—km 163,500 in AREA Science Park, Basovizza, 34149 Trieste, Italy
| |
Collapse
|
15
|
Wang T, Jiang S, Song P, Wang R, Yang L, Zhang T, Zheng G. Optical ptychography for biomedical imaging: recent progress and future directions [Invited]. BIOMEDICAL OPTICS EXPRESS 2023; 14:489-532. [PMID: 36874495 PMCID: PMC9979669 DOI: 10.1364/boe.480685] [Citation(s) in RCA: 10] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/10/2022] [Revised: 12/10/2022] [Accepted: 12/10/2022] [Indexed: 05/25/2023]
Abstract
Ptychography is an enabling microscopy technique for both fundamental and applied sciences. In the past decade, it has become an indispensable imaging tool in most X-ray synchrotrons and national laboratories worldwide. However, ptychography's limited resolution and throughput in the visible light regime have prevented its wide adoption in biomedical research. Recent developments in this technique have resolved these issues and offer turnkey solutions for high-throughput optical imaging with minimum hardware modifications. The demonstrated imaging throughput is now greater than that of a high-end whole slide scanner. In this review, we discuss the basic principle of ptychography and summarize the main milestones of its development. Different ptychographic implementations are categorized into four groups based on their lensless/lens-based configurations and coded-illumination/coded-detection operations. We also highlight the related biomedical applications, including digital pathology, drug screening, urinalysis, blood analysis, cytometric analysis, rare cell screening, cell culture monitoring, cell and tissue imaging in 2D and 3D, polarimetric analysis, among others. Ptychography for high-throughput optical imaging, currently in its early stages, will continue to improve in performance and expand in its applications. We conclude this review article by pointing out several directions for its future development.
Collapse
Affiliation(s)
- Tianbo Wang
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT 06269, USA
- These authors contributed equally to this work
| | - Shaowei Jiang
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT 06269, USA
- These authors contributed equally to this work
| | - Pengming Song
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT 06269, USA
- These authors contributed equally to this work
| | - Ruihai Wang
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT 06269, USA
| | - Liming Yang
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT 06269, USA
| | - Terrance Zhang
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT 06269, USA
| | - Guoan Zheng
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT 06269, USA
| |
Collapse
|
16
|
Robinson AW, Nicholls D, Wells J, Moshtaghpour A, Kirkland A, Browning ND. SIM-STEM Lab: Incorporating Compressed Sensing Theory for Fast STEM Simulation. Ultramicroscopy 2022; 242:113625. [PMID: 36183423 DOI: 10.1016/j.ultramic.2022.113625] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2021] [Revised: 07/01/2022] [Accepted: 09/24/2022] [Indexed: 12/01/2022]
Abstract
Recently it has been shown that precise dose control and an increase in the overall acquisition speed of atomic resolution scanning transmission electron microscope (STEM) images can be achieved by acquiring only a small fraction of the pixels in the image experimentally and then reconstructing the full image using an inpainting algorithm. In this paper, we apply the same inpainting approach (a form of compressed sensing) to simulated, sub-sampled atomic resolution STEM images. We find that it is possible to significantly sub-sample the area that is simulated, the number of g-vectors contributing the image, and the number of frozen phonon configurations contributing to the final image while still producing an acceptable fit to a fully sampled simulation. Here we discuss the parameters that we use and how the resulting simulations can be quantifiably compared to the full simulations. As with any Compressed Sensing methodology, care must be taken to ensure that isolated events are not excluded from the process, but the observed increase in simulation speed provides significant opportunities for real time simulations, image classification and analytics to be performed as a supplement to experiments on a microscope to be developed in the future.
Collapse
Affiliation(s)
- Alex W Robinson
- Department of Mechanical, Materials and Aerospace Engineering, University of Liverpool, Liverpool, L69 3GH, United Kingdom.
| | - Daniel Nicholls
- Department of Mechanical, Materials and Aerospace Engineering, University of Liverpool, Liverpool, L69 3GH, United Kingdom
| | - Jack Wells
- Distributed Algorithms Centre for Doctoral Training, University of Liverpool, Liverpool, L69 3GH, United Kingdom
| | - Amirafshar Moshtaghpour
- Department of Mechanical, Materials and Aerospace Engineering, University of Liverpool, Liverpool, L69 3GH, United Kingdom; Rosalind Franklin Institute, Harwell Science and Innovation Campus, Didcot, OX11 0QS, United Kingdom
| | - Angus Kirkland
- Rosalind Franklin Institute, Harwell Science and Innovation Campus, Didcot, OX11 0QS, United Kingdom; Department of Materials, University of Oxford, Oxford, OX2 6NN, United Kingdom
| | - Nigel D Browning
- Department of Mechanical, Materials and Aerospace Engineering, University of Liverpool, Liverpool, L69 3GH, United Kingdom; Physical and Computational Science Directorate, Pacific Northwest National Laboratory, Richland, WA 99352, USA; Sivananthan Laboratories, 590 Territorial Drive, Bolingbrook, IL, 60440, USA
| |
Collapse
|
17
|
Three-dimensional electron ptychography of organic-inorganic hybrid nanostructures. Nat Commun 2022; 13:4787. [PMID: 35970924 PMCID: PMC9378626 DOI: 10.1038/s41467-022-32548-x] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2021] [Accepted: 08/04/2022] [Indexed: 11/22/2022] Open
Abstract
Three dimensional scaffolded DNA origami with inorganic nanoparticles has been used to create tailored multidimensional nanostructures. However, the image contrast of DNA is poorer than those of the heavy nanoparticles in conventional transmission electron microscopy at high defocus so that the biological and non-biological components in 3D scaffolds cannot be simultaneously resolved using tomography of samples in a native state. We demonstrate the use of electron ptychography to recover high contrast phase information from all components in a DNA origami scaffold without staining. We further quantitatively evaluate the enhancement of contrast in comparison with conventional transmission electron microscopy. In addition, We show that for ptychography post-reconstruction focusing simplifies the workflow and reduces electron dose and beam damage. The authors demonstrate electron ptychographic computed tomography by simultaneously recording high contrast data from both the organic- and inorganic components in a 3D DNA-origami framework hybrid nanostructure.
Collapse
|
18
|
Automatic parameter selection for electron ptychography via Bayesian optimization. Sci Rep 2022; 12:12284. [PMID: 35854039 PMCID: PMC9296498 DOI: 10.1038/s41598-022-16041-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Accepted: 07/04/2022] [Indexed: 11/08/2022] Open
Abstract
Electron ptychography provides new opportunities to resolve atomic structures with deep sub-angstrom spatial resolution and to study electron-beam sensitive materials with high dose efficiency. In practice, obtaining accurate ptychography images requires simultaneously optimizing multiple parameters that are often selected based on trial-and-error, resulting in low-throughput experiments and preventing wider adoption. Here, we develop an automatic parameter selection framework to circumvent this problem using Bayesian optimization with Gaussian processes. With minimal prior knowledge, the workflow efficiently produces ptychographic reconstructions that are superior to those processed by experienced experts. The method also facilitates better experimental designs by exploring optimized experimental parameters from simulated data.
Collapse
|
19
|
Egerton R, Watanabe M. Spatial Resolution in Transmission Electron Microscopy. Micron 2022; 160:103304. [DOI: 10.1016/j.micron.2022.103304] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Revised: 05/05/2022] [Accepted: 05/19/2022] [Indexed: 10/18/2022]
|
20
|
Ning S, Xu W, Ma Y, Loh L, Pennycook TJ, Zhou W, Zhang F, Bosman M, Pennycook SJ, He Q, Loh ND. Accurate and Robust Calibration of the Uniform Affine Transformation Between Scan-Camera Coordinates for Atom-Resolved In-Focus 4D-STEM Datasets. MICROSCOPY AND MICROANALYSIS : THE OFFICIAL JOURNAL OF MICROSCOPY SOCIETY OF AMERICA, MICROBEAM ANALYSIS SOCIETY, MICROSCOPICAL SOCIETY OF CANADA 2022; 28:1-11. [PMID: 35260221 DOI: 10.1017/s1431927622000320] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Accurate geometrical calibration between the scan coordinates and the camera coordinates is critical in four-dimensional scanning transmission electron microscopy (4D-STEM) for both quantitative imaging and ptychographic reconstructions. For atomic-resolved, in-focus 4D-STEM datasets, we propose a hybrid method incorporating two sub-routines, namely a J-matrix method and a Fourier method, which can calibrate the uniform affine transformation between the scan-camera coordinates using raw data, without a priori knowledge of the crystal structure of the specimen. The hybrid method is found robust against scan distortions and residual probe aberrations. It is also effective even when defects are present in the specimen, or the specimen becomes relatively thick. We will demonstrate that a successful geometrical calibration with the hybrid method will lead to a more reliable recovery of both the specimen and the electron probe in a ptychographic reconstruction. We will also show that, although the elimination of local scan position errors still requires an iterative approach, the rate of convergence can be improved, and the residual errors can be further reduced if the hybrid method can be firstly applied for initial calibration. The code is made available as a simple-to-use tool to correct affine transformations of the scan-camera coordinates in 4D-STEM experiments.
Collapse
Affiliation(s)
- Shoucong Ning
- Department of Materials Science and Engineering, National University of Singapore, Singapore117575, Singapore
- Center for Bio-Imaging Sciences, National University of Singapore, Singapore117557, Singapore
| | - Wenhui Xu
- Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen518055, China
- Harbin Institute of Technology, Harbin150001, China
| | - Yinhang Ma
- School of Physical Sciences and CAS Key Laboratory of Vacuum Physics, University of Chinese Academy of Sciences, Beijing100049, China
| | - Leyi Loh
- Department of Materials Science and Engineering, National University of Singapore, Singapore117575, Singapore
| | | | - Wu Zhou
- School of Physical Sciences and CAS Key Laboratory of Vacuum Physics, University of Chinese Academy of Sciences, Beijing100049, China
| | - Fucai Zhang
- Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen518055, China
| | - Michel Bosman
- Department of Materials Science and Engineering, National University of Singapore, Singapore117575, Singapore
| | - Stephen J Pennycook
- School of Physical Sciences and CAS Key Laboratory of Vacuum Physics, University of Chinese Academy of Sciences, Beijing100049, China
| | - Qian He
- Department of Materials Science and Engineering, National University of Singapore, Singapore117575, Singapore
| | - N Duane Loh
- Center for Bio-Imaging Sciences, National University of Singapore, Singapore117557, Singapore
- Department of Physics, National University of Singapore, Singapore117551, Singapore
- Department of Biological Sciences, National University of Singapore, Singapore117557, Singapore
| |
Collapse
|
21
|
Roitman D, Shiloh R, Lu PH, Dunin-Borkowski RE, Arie A. Shaping of Electron Beams Using Sculpted Thin Films. ACS PHOTONICS 2021; 8:3394-3405. [PMID: 34938823 PMCID: PMC8679091 DOI: 10.1021/acsphotonics.1c00951] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/25/2021] [Revised: 10/31/2021] [Accepted: 11/04/2021] [Indexed: 05/04/2023]
Abstract
Electron beam shaping by sculpted thin films relies on electron-matter interactions and the wave nature of electrons. It can be used to study physical phenomena of special electron beams and to develop technological applications in electron microscopy that offer new and improved measurement techniques and increased resolution in different imaging modes. In this Perspective, we review recent applications of sculpted thin films for electron orbital angular momentum sorting, improvements in phase contrast transmission electron microscopy, and aberration correction. For the latter, we also present new results of our work toward correction of the spherical aberration of Lorentz scanning transmission electron microscopes and suggest a method to correct chromatic aberration using thin films. This review provides practical insight for researchers in the field and motivates future progress in electron microscopy.
Collapse
Affiliation(s)
- Dolev Roitman
- School
of Electrical Engineering, Fleischman Faculty of Engineering, Tel Aviv University, Tel Aviv 69978, Israel
| | - Roy Shiloh
- Physics
Department, Friedrich-Alexander-Universität
Erlangen-Nürnberg, Erlangen 91058, Germany
| | - Peng-Han Lu
- Ernst
Ruska-Centre for Microscopy and Spectroscopy with Electrons and Peter
Grünberg Institute, Forschungszentrum
Jülich, Jülich 52428, Germany
- RWTH
Aachen University, Aachen 52062, Germany
| | - Rafal E. Dunin-Borkowski
- Ernst
Ruska-Centre for Microscopy and Spectroscopy with Electrons and Peter
Grünberg Institute, Forschungszentrum
Jülich, Jülich 52428, Germany
| | - Ady Arie
- School
of Electrical Engineering, Fleischman Faculty of Engineering, Tel Aviv University, Tel Aviv 69978, Israel
| |
Collapse
|
22
|
Ribet SM, Murthy AA, Roth EW, Dos Reis R, Dravid VP. Making the Most of your Electrons: Challenges and Opportunities in Characterizing Hybrid Interfaces with STEM. MATERIALS TODAY (KIDLINGTON, ENGLAND) 2021; 50:100-115. [PMID: 35241968 PMCID: PMC8887695 DOI: 10.1016/j.mattod.2021.05.006] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
Inspired by the unique architectures composed of hard and soft materials in natural and biological systems, synthetic hybrid structures and associated soft-hard interfaces have recently evoked significant interest. Soft matter is typically dominated by fluctuations even at room temperature, while hard matter (which often serves as the substrate or anchor for the soft component) is governed by rigid mechanical behavior. This dichotomy offers considerable opportunities to leverage the disparate properties offered by these components across a wide spectrum spanning from basic science to engineering insights with significant technological overtones. Such hybrid structures, which include polymer nanocomposites, DNA functionalized nanoparticle superlattices and metal organic frameworks to name a few, have delivered promising insights into the areas of catalysis, environmental remediation, optoelectronics, medicine, and beyond. The interfacial structure between these hard and soft phases exists across a variety of length scales and often strongly influence the functionality of hybrid systems. While scanning/transmission electron microscopy (S/TEM) has proven to be a valuable tool for acquiring intricate molecular and nanoscale details of these interfaces, the unusual nature of hybrid composites presents a suite of challenges that make assessing or establishing the classical structure-property relationships especially difficult. These include challenges associated with preparing electron-transparent samples and obtaining sufficient contrast to resolve the interface between dissimilar materials given the dose sensitivity of soft materials. We discuss each of these challenges and supplement a review of recent developments in the field with additional experimental investigations and simulations to present solutions for attaining a nano or atomic-level understanding of these interfaces. These solutions present a host of opportunities for investigating and understanding the role interfaces play in this unique class of functional materials.
Collapse
Affiliation(s)
- Stephanie M Ribet
- Department of Materials Science and Engineering, Northwestern University, Evanston, IL
| | - Akshay A Murthy
- Department of Materials Science and Engineering, Northwestern University, Evanston, IL
- International Institute of Nanotechnology, Northwestern University, Evanston, IL
| | - Eric W Roth
- The NUANCE Center, Northwestern University, Evanston, IL
| | - Roberto Dos Reis
- Department of Materials Science and Engineering, Northwestern University, Evanston, IL
- The NUANCE Center, Northwestern University, Evanston, IL
| | - Vinayak P Dravid
- Department of Materials Science and Engineering, Northwestern University, Evanston, IL
- International Institute of Nanotechnology, Northwestern University, Evanston, IL
- The NUANCE Center, Northwestern University, Evanston, IL
| |
Collapse
|
23
|
Zhang Y, Lu PH, Rotunno E, Troiani F, van Schayck JP, Tavabi AH, Dunin-Borkowski RE, Grillo V, Peters PJ, Ravelli RBG. Single-particle cryo-EM: alternative schemes to improve dose efficiency. JOURNAL OF SYNCHROTRON RADIATION 2021; 28:1343-1356. [PMID: 34475283 PMCID: PMC8415325 DOI: 10.1107/s1600577521007931] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/07/2021] [Accepted: 08/02/2021] [Indexed: 06/13/2023]
Abstract
Imaging of biomolecules by ionizing radiation, such as electrons, causes radiation damage which introduces structural and compositional changes of the specimen. The total number of high-energy electrons per surface area that can be used for imaging in cryogenic electron microscopy (cryo-EM) is severely restricted due to radiation damage, resulting in low signal-to-noise ratios (SNR). High resolution details are dampened by the transfer function of the microscope and detector, and are the first to be lost as radiation damage alters the individual molecules which are presumed to be identical during averaging. As a consequence, radiation damage puts a limit on the particle size and sample heterogeneity with which electron microscopy (EM) can deal. Since a transmission EM (TEM) image is formed from the scattering process of the electron by the specimen interaction potential, radiation damage is inevitable. However, we can aim to maximize the information transfer for a given dose and increase the SNR by finding alternatives to the conventional phase-contrast cryo-EM techniques. Here some alternative transmission electron microscopy techniques are reviewed, including phase plate, multi-pass transmission electron microscopy, off-axis holography, ptychography and a quantum sorter. Their prospects for providing more or complementary structural information within the limited lifetime of the sample are discussed.
Collapse
Affiliation(s)
- Yue Zhang
- Maastricht Multimodal Molecular Imaging Institute, Division of Nanoscopy, Maastricht University, Universiteitssingel 50, Maastricht 6229 ER, The Netherlands
| | - Peng-Han Lu
- Ernst Ruska-Centre for Microscopy and Spectroscopy with Electrons and Peter Grünberg Institute, Forschungszentrum Jülich, Jülich 52425, Germany
| | - Enzo Rotunno
- CNR-Istituto Nanoscienze, Centro S3, Via G Campi 213/A, I-41125 Modena, Italy
| | - Filippo Troiani
- CNR-Istituto Nanoscienze, Centro S3, Via G Campi 213/A, I-41125 Modena, Italy
| | - J. Paul van Schayck
- Maastricht Multimodal Molecular Imaging Institute, Division of Nanoscopy, Maastricht University, Universiteitssingel 50, Maastricht 6229 ER, The Netherlands
| | - Amir H. Tavabi
- Ernst Ruska-Centre for Microscopy and Spectroscopy with Electrons and Peter Grünberg Institute, Forschungszentrum Jülich, Jülich 52425, Germany
| | - Rafal E. Dunin-Borkowski
- Ernst Ruska-Centre for Microscopy and Spectroscopy with Electrons and Peter Grünberg Institute, Forschungszentrum Jülich, Jülich 52425, Germany
| | - Vincenzo Grillo
- CNR-Istituto Nanoscienze, Centro S3, Via G Campi 213/A, I-41125 Modena, Italy
| | - Peter J. Peters
- Maastricht Multimodal Molecular Imaging Institute, Division of Nanoscopy, Maastricht University, Universiteitssingel 50, Maastricht 6229 ER, The Netherlands
| | - Raimond B. G. Ravelli
- Maastricht Multimodal Molecular Imaging Institute, Division of Nanoscopy, Maastricht University, Universiteitssingel 50, Maastricht 6229 ER, The Netherlands
| |
Collapse
|
24
|
Chen Z, Jiang Y, Shao YT, Holtz ME, Odstrčil M, Guizar-Sicairos M, Hanke I, Ganschow S, Schlom DG, Muller DA. Electron ptychography achieves atomic-resolution limits set by lattice vibrations. Science 2021; 372:826-831. [DOI: 10.1126/science.abg2533] [Citation(s) in RCA: 45] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2020] [Accepted: 04/13/2021] [Indexed: 01/30/2023]
Affiliation(s)
- Zhen Chen
- School of Applied and Engineering Physics, Cornell University, Ithaca, NY 14853, USA
| | - Yi Jiang
- Advanced Photon Source, Argonne National Laboratory, Lemont, IL 60439, USA
| | - Yu-Tsun Shao
- School of Applied and Engineering Physics, Cornell University, Ithaca, NY 14853, USA
| | - Megan E. Holtz
- Department of Materials Science and Engineering, Cornell University, Ithaca, NY, USA
| | | | | | - Isabelle Hanke
- Leibniz-Institut für Kristallzüchtung, Max-Born-Str. 2, 12489 Berlin, Germany
| | - Steffen Ganschow
- Leibniz-Institut für Kristallzüchtung, Max-Born-Str. 2, 12489 Berlin, Germany
| | - Darrell G. Schlom
- Department of Materials Science and Engineering, Cornell University, Ithaca, NY, USA
- Leibniz-Institut für Kristallzüchtung, Max-Born-Str. 2, 12489 Berlin, Germany
- Kavli Institute at Cornell for Nanoscale Science, Ithaca, NY, USA
| | - David A. Muller
- School of Applied and Engineering Physics, Cornell University, Ithaca, NY 14853, USA
- Kavli Institute at Cornell for Nanoscale Science, Ithaca, NY, USA
| |
Collapse
|
25
|
Allars F, Lu PH, Kruth M, Dunin-Borkowski RE, Rodenburg JM, Maiden AM. Efficient large field of view electron phase imaging using near-field electron ptychography with a diffuser. Ultramicroscopy 2021; 231:113257. [PMID: 33773842 DOI: 10.1016/j.ultramic.2021.113257] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2020] [Revised: 02/10/2021] [Accepted: 02/27/2021] [Indexed: 02/03/2023]
Abstract
Most implementations of ptychography on the electron microscope operate in scanning transmission (STEM) mode, where a small focussed probe beam is rapidly scanned across the sample. In this paper we introduce a different approach based on near-field ptychography, where the focussed beam is replaced by a wide-field, structured illumination, realised through a purpose-designed etched Silicon Nitride window. We show that fields of view as large as 100 μm2 can be imaged using the new approach, and that quantitative electron phase images can be reconstructed from as few as nine near-field diffraction pattern measurements.
Collapse
Affiliation(s)
- Frederick Allars
- Department of Electronic and Electrical Engineering, Sir Frederick Mappin Building, University of Sheffield, S3 7HQ, United Kingdom
| | - Peng-Han Lu
- Ernst Ruska-Centre for Microscopy and Spectroscopy with Electrons and Peter Grünberg Institute, Forschungszentrum Juelich, 52425 Juelich, Germany; RWTH Aachen University, 52074 Aachen, Germany
| | - Maximilian Kruth
- Ernst Ruska-Centre for Microscopy and Spectroscopy with Electrons and Peter Grünberg Institute, Forschungszentrum Juelich, 52425 Juelich, Germany; RWTH Aachen University, 52074 Aachen, Germany
| | - Rafal E Dunin-Borkowski
- Ernst Ruska-Centre for Microscopy and Spectroscopy with Electrons and Peter Grünberg Institute, Forschungszentrum Juelich, 52425 Juelich, Germany
| | - John M Rodenburg
- Department of Electronic and Electrical Engineering, Sir Frederick Mappin Building, University of Sheffield, S3 7HQ, United Kingdom
| | - Andrew M Maiden
- Department of Electronic and Electrical Engineering, Sir Frederick Mappin Building, University of Sheffield, S3 7HQ, United Kingdom.
| |
Collapse
|
26
|
A data reduction and compression description for high throughput time-resolved electron microscopy. Nat Commun 2021; 12:664. [PMID: 33510168 PMCID: PMC7844242 DOI: 10.1038/s41467-020-20694-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2019] [Accepted: 12/09/2020] [Indexed: 12/05/2022] Open
Abstract
Fast, direct electron detectors have significantly improved the spatio-temporal resolution of electron microscopy movies. Preserving both spatial and temporal resolution in extended observations, however, requires storing prohibitively large amounts of data. Here, we describe an efficient and flexible data reduction and compression scheme (ReCoDe) that retains both spatial and temporal resolution by preserving individual electron events. Running ReCoDe on a workstation we demonstrate on-the-fly reduction and compression of raw data streaming off a detector at 3 GB/s, for hours of uninterrupted data collection. The output was 100-fold smaller than the raw data and saved directly onto network-attached storage drives over a 10 GbE connection. We discuss calibration techniques that support electron detection and counting (e.g., estimate electron backscattering rates, false positive rates, and data compressibility), and novel data analysis methods enabled by ReCoDe (e.g., recalibration of data post acquisition, and accurate estimation of coincidence loss). The use of electron detectors with high spatio-temporal resolution is limited by the large amounts of data generated. Here, the authors describe ReCoDe, a data reduction and compression scheme, that preserves individual electron events, and enable on-the-fly reduction and compression of raw data.
Collapse
|
27
|
O'Leary CM, Martinez GT, Liberti E, Humphry MJ, Kirkland AI, Nellist PD. Contrast transfer and noise considerations in focused-probe electron ptychography. Ultramicroscopy 2020; 221:113189. [PMID: 33360480 DOI: 10.1016/j.ultramic.2020.113189] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2020] [Revised: 09/24/2020] [Accepted: 11/30/2020] [Indexed: 11/26/2022]
Abstract
Electron ptychography is a 4-D STEM phase-contrast imaging technique with applications to light-element and beam-sensitive materials. Although the electron dose (electrons incident per unit area on the sample) is the primary figure of merit for imaging beam-sensitive materials, it is also necessary to consider the contrast transfer properties of the imaging technique. Here, we explore the contrast transfer properties of electron ptychography. The contrast transfer of focused-probe, non-iterative electron ptychography using the single-side-band (SSB) method is demonstrated experimentally. The band-pass nature of the phase-contrast transfer function (PCTF) for SSB ptychography places strict limitations on the probe convergence semi-angles required to resolve specific sample features with high contrast. The PCTF of the extended ptychographic iterative engine (ePIE) is broader than that for SSB ptychography, although when both high and low spatial frequencies are transferred, band-pass filtering is required to remove image artefacts. Normalisation of the transfer function with respect to the noise level shows that the transfer window is increased while avoiding noise amplification. Avoiding algorithms containing deconvolution steps may also increase the dose-efficiency of ptychographic phase reconstructions.
Collapse
Affiliation(s)
- Colum M O'Leary
- Department of Materials, University of Oxford, Parks Rd, Oxford OX13PH, United Kingdom.
| | - Gerardo T Martinez
- Department of Materials, University of Oxford, Parks Rd, Oxford OX13PH, United Kingdom
| | - Emanuela Liberti
- Department of Materials, University of Oxford, Parks Rd, Oxford OX13PH, United Kingdom; electron Physical Science Imaging Centre (ePSIC), Diamond Light Source, Didcot OX11 0DE, United Kingdom
| | - Martin J Humphry
- Phase Focus Ltd, Electric Works, Sheffield Digital Campus, Sheffield S1 2BJ, United Kingdom
| | - Angus I Kirkland
- Department of Materials, University of Oxford, Parks Rd, Oxford OX13PH, United Kingdom; electron Physical Science Imaging Centre (ePSIC), Diamond Light Source, Didcot OX11 0DE, United Kingdom; The Rosalind Franklin Institute, Harwell Science and Innovation Campus, Didcot OX11 0FA, United Kingdom
| | - Peter D Nellist
- Department of Materials, University of Oxford, Parks Rd, Oxford OX13PH, United Kingdom
| |
Collapse
|
28
|
Blackburn AM, McLeod RA. Practical implementation of high-resolution electron ptychography and comparison with off-axis electron holography. Microscopy (Oxf) 2020; 70:131-147. [PMID: 32986121 DOI: 10.1093/jmicro/dfaa055] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2020] [Revised: 09/04/2020] [Accepted: 09/14/2020] [Indexed: 11/13/2022] Open
Abstract
Ptychography is a coherent diffractive imaging technique that can determine how an electron wave is transmitted through an object by probing it in many small overlapping regions and processing the diffraction data obtained at each point. The resulting electron transmission model describes both phase and amplitude changes to the electron wave. Ptychography has been adopted in transmission electron microscopy in recent years following advances in high-speed direct electron detectors and computer algorithms which now make the technique suitable for practical applications. Its ability to retrieve quantitative phase information at high spatial resolution makes it a plausible alternative or complement to electron holography. Furthermore, unlike off-axis electron holography, it can provide phase information without an electron bi-prism assembly or the requirement of a minimally structured region adjacent to the region of interest in the object. However, it does require a well-calibrated scanning transmission electron microscope and a well-managed workflow to manage the calibration, data acquisition and reconstruction process to yield a practical technique. Here we detail this workflow and highlight how this is greatly assisted by acquisition management software. Through experimental data and modelling we also explore the similarities and differences between high-resolution ptychography and electron holography. Both techniques show a dependence of the recovered phase on the crystalline orientation of the material which is attributable to dynamical scattering. However, the exact nature of the variation differs reflecting fundamental expectations, but nonetheless equally useful information is obtained from electron holography and the ptychographically determined object transmission function.
Collapse
Affiliation(s)
- Arthur M Blackburn
- Department of Physics and Astronomy, University of Victoria, Victoria, BC V8W 2Y2, Canada
| | - Robert A McLeod
- Nano Accessories Product Group, Hitachi High Technologies Canada, Inc., Etobicoke, ON M9W 6A4, Canada
| |
Collapse
|
29
|
Mixed-state electron ptychography enables sub-angstrom resolution imaging with picometer precision at low dose. Nat Commun 2020; 11:2994. [PMID: 32533001 PMCID: PMC7293311 DOI: 10.1038/s41467-020-16688-6] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2019] [Accepted: 05/13/2020] [Indexed: 11/08/2022] Open
Abstract
Both high resolution and high precision are required to quantitatively determine the atomic structure of complex nanostructured materials. However, for conventional imaging methods in scanning transmission electron microscopy (STEM), atomic resolution with picometer precision cannot usually be achieved for weakly-scattering samples or radiation-sensitive materials, such as 2D materials. Here, we demonstrate low-dose, sub-angstrom resolution imaging with picometer precision using mixed-state electron ptychography. We show that correctly accounting for the partial coherence of the electron beam is a prerequisite for high-quality structural reconstructions due to the intrinsic partial coherence of the electron beam. The mixed-state reconstruction gains importance especially when simultaneously pursuing high resolution, high precision and large field-of-view imaging. Compared with conventional atomic-resolution STEM imaging techniques, the mixed-state ptychographic approach simultaneously provides a four-times-faster acquisition, with double the information limit at the same dose, or up to a fifty-fold reduction in dose at the same resolution. With conventional scanning transmission electron microscopy, some sensitive materials are difficult to image with atomic resolution. The authors present a method of mixed-state electron ptychography that enables picometer precision with fast acquisition and low dosage.
Collapse
|
30
|
Zhou L, Song J, Kim JS, Pei X, Huang C, Boyce M, Mendonça L, Clare D, Siebert A, Allen CS, Liberti E, Stuart D, Pan X, Nellist PD, Zhang P, Kirkland AI, Wang P. Low-dose phase retrieval of biological specimens using cryo-electron ptychography. Nat Commun 2020; 11:2773. [PMID: 32487987 PMCID: PMC7265480 DOI: 10.1038/s41467-020-16391-6] [Citation(s) in RCA: 46] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2019] [Accepted: 04/28/2020] [Indexed: 12/25/2022] Open
Abstract
Cryo-electron microscopy is an essential tool for high-resolution structural studies of biological systems. This method relies on the use of phase contrast imaging at high defocus to improve information transfer at low spatial frequencies at the expense of higher spatial frequencies. Here we demonstrate that electron ptychography can recover the phase of the specimen with continuous information transfer across a wide range of the spatial frequency spectrum, with improved transfer at lower spatial frequencies, and as such is more efficient for phase recovery than conventional phase contrast imaging. We further show that the method can be used to study frozen-hydrated specimens of rotavirus double-layered particles and HIV-1 virus-like particles under low-dose conditions (5.7 e/Å2) and heterogeneous objects in an Adenovirus-infected cell over large fields of view (1.14 × 1.14 μm), thus making it suitable for studies of many biologically important structures.
Collapse
Affiliation(s)
- Liqi Zhou
- National Laboratory of Solid State Microstructures, Jiangsu Key Laboratory of Artificial Functional Materials, College of Engineering and Applied Sciences and Collaborative Innovation Center of Advanced Microstructures, Nanjing University, Nanjing, 210093, China
| | - Jingdong Song
- State Key Laboratory of Infectious Disease Prevention and Control, National Institute for Viral Disease Control and Prevention, Chinese Center for Disease Control and Prevention, Beijing, 100052, China
| | - Judy S Kim
- Department of Materials, University of Oxford, Parks Road, Oxford, OX1 3PH, UK
- Electron Physical Sciences Imaging Centre, Diamond Light Source Ltd., Harwell Science and Innovation Campus, Didcot, OX11 0DE, UK
- The Rosalind Franklin Institute, Harwell Campus, Didcot, OX11 0FA, UK
| | - Xudong Pei
- National Laboratory of Solid State Microstructures, Jiangsu Key Laboratory of Artificial Functional Materials, College of Engineering and Applied Sciences and Collaborative Innovation Center of Advanced Microstructures, Nanjing University, Nanjing, 210093, China
| | - Chen Huang
- Department of Materials, University of Oxford, Parks Road, Oxford, OX1 3PH, UK
- Electron Physical Sciences Imaging Centre, Diamond Light Source Ltd., Harwell Science and Innovation Campus, Didcot, OX11 0DE, UK
| | - Mark Boyce
- Division of Structural Biology, Wellcome Trust Centre for Human Genetics, University of Oxford, Oxford, OX3 7BN, UK
| | - Luiza Mendonça
- Division of Structural Biology, Wellcome Trust Centre for Human Genetics, University of Oxford, Oxford, OX3 7BN, UK
| | - Daniel Clare
- Electron Bio-Imaging Centre, Diamond Light Source, Harwell Science and Innovation Campus, Didcot, OX11 0DE, UK
| | - Alistair Siebert
- Electron Bio-Imaging Centre, Diamond Light Source, Harwell Science and Innovation Campus, Didcot, OX11 0DE, UK
| | - Christopher S Allen
- Department of Materials, University of Oxford, Parks Road, Oxford, OX1 3PH, UK
- Electron Physical Sciences Imaging Centre, Diamond Light Source Ltd., Harwell Science and Innovation Campus, Didcot, OX11 0DE, UK
| | - Emanuela Liberti
- Department of Materials, University of Oxford, Parks Road, Oxford, OX1 3PH, UK
- Electron Physical Sciences Imaging Centre, Diamond Light Source Ltd., Harwell Science and Innovation Campus, Didcot, OX11 0DE, UK
| | - David Stuart
- Division of Structural Biology, Wellcome Trust Centre for Human Genetics, University of Oxford, Oxford, OX3 7BN, UK
- Electron Bio-Imaging Centre, Diamond Light Source, Harwell Science and Innovation Campus, Didcot, OX11 0DE, UK
| | - Xiaoqing Pan
- Department of Materials Science and Engineering, and Department of Physics and Astronomy, University of California, Irvine, CA, 92697, USA
| | - Peter D Nellist
- Department of Materials, University of Oxford, Parks Road, Oxford, OX1 3PH, UK
| | - Peijun Zhang
- Division of Structural Biology, Wellcome Trust Centre for Human Genetics, University of Oxford, Oxford, OX3 7BN, UK
- Electron Bio-Imaging Centre, Diamond Light Source, Harwell Science and Innovation Campus, Didcot, OX11 0DE, UK
| | - Angus I Kirkland
- Department of Materials, University of Oxford, Parks Road, Oxford, OX1 3PH, UK.
- Electron Physical Sciences Imaging Centre, Diamond Light Source Ltd., Harwell Science and Innovation Campus, Didcot, OX11 0DE, UK.
- The Rosalind Franklin Institute, Harwell Campus, Didcot, OX11 0FA, UK.
| | - Peng Wang
- National Laboratory of Solid State Microstructures, Jiangsu Key Laboratory of Artificial Functional Materials, College of Engineering and Applied Sciences and Collaborative Innovation Center of Advanced Microstructures, Nanjing University, Nanjing, 210093, China.
| |
Collapse
|
31
|
Bücker R, Hogan-Lamarre P, Mehrabi P, Schulz EC, Bultema LA, Gevorkov Y, Brehm W, Yefanov O, Oberthür D, Kassier GH, Dwayne Miller RJ. Serial protein crystallography in an electron microscope. Nat Commun 2020; 11:996. [PMID: 32081905 PMCID: PMC7035385 DOI: 10.1038/s41467-020-14793-0] [Citation(s) in RCA: 59] [Impact Index Per Article: 14.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2019] [Accepted: 01/27/2020] [Indexed: 12/16/2022] Open
Abstract
Serial X-ray crystallography at free-electron lasers allows to solve biomolecular structures from sub-micron-sized crystals. However, beam time at these facilities is scarce, and involved sample delivery techniques are required. On the other hand, rotation electron diffraction (MicroED) has shown great potential as an alternative means for protein nano-crystallography. Here, we present a method for serial electron diffraction of protein nanocrystals combining the benefits of both approaches. In a scanning transmission electron microscope, crystals randomly dispersed on a sample grid are automatically mapped, and a diffraction pattern at fixed orientation is recorded from each at a high acquisition rate. Dose fractionation ensures minimal radiation damage effects. We demonstrate the method by solving the structure of granulovirus occlusion bodies and lysozyme to resolutions of 1.55 Å and 1.80 Å, respectively. Our method promises to provide rapid structure determination for many classes of materials with minimal sample consumption, using readily available instrumentation.
Collapse
Affiliation(s)
- Robert Bücker
- Max Planck Institute for the Structure and Dynamics of Matter, CFEL, Luruper Chaussee 149, 22761, Hamburg, Germany
| | - Pascal Hogan-Lamarre
- Max Planck Institute for the Structure and Dynamics of Matter, CFEL, Luruper Chaussee 149, 22761, Hamburg, Germany
- Departments of Chemistry and Physics, University of Toronto, 80 St. George Street, Toronto, ON, M5S 3H6, Canada
| | - Pedram Mehrabi
- Max Planck Institute for the Structure and Dynamics of Matter, CFEL, Luruper Chaussee 149, 22761, Hamburg, Germany
| | - Eike C Schulz
- Max Planck Institute for the Structure and Dynamics of Matter, CFEL, Luruper Chaussee 149, 22761, Hamburg, Germany
| | - Lindsey A Bultema
- Max Planck Institute for the Structure and Dynamics of Matter, CFEL, Luruper Chaussee 149, 22761, Hamburg, Germany
| | - Yaroslav Gevorkov
- Center for Free-Electron Laser Science, DESY, Notkestrasse 85, 22607, Hamburg, Germany
- Institute of Vision Systems, Hamburg University of Technology, Harburger Schlossstrasse 20, 21079, Hamburg, Germany
| | - Wolfgang Brehm
- Center for Free-Electron Laser Science, DESY, Notkestrasse 85, 22607, Hamburg, Germany
| | - Oleksandr Yefanov
- Center for Free-Electron Laser Science, DESY, Notkestrasse 85, 22607, Hamburg, Germany
| | - Dominik Oberthür
- Center for Free-Electron Laser Science, DESY, Notkestrasse 85, 22607, Hamburg, Germany
| | - Günther H Kassier
- Max Planck Institute for the Structure and Dynamics of Matter, CFEL, Luruper Chaussee 149, 22761, Hamburg, Germany
| | - R J Dwayne Miller
- Max Planck Institute for the Structure and Dynamics of Matter, CFEL, Luruper Chaussee 149, 22761, Hamburg, Germany.
- Departments of Chemistry and Physics, University of Toronto, 80 St. George Street, Toronto, ON, M5S 3H6, Canada.
| |
Collapse
|
32
|
Zachman MJ, Hachtel JA, Idrobo JC, Chi M. Emerging Electron Microscopy Techniques for Probing Functional Interfaces in Energy Materials. Angew Chem Int Ed Engl 2019. [DOI: 10.1002/ange.201902993] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Affiliation(s)
- Michael J. Zachman
- Center for Nanophase Materials Sciences Oak Ridge National Laboratory Oak Ridge TN 37831 USA
| | - Jordan A. Hachtel
- Center for Nanophase Materials Sciences Oak Ridge National Laboratory Oak Ridge TN 37831 USA
| | - Juan Carlos Idrobo
- Center for Nanophase Materials Sciences Oak Ridge National Laboratory Oak Ridge TN 37831 USA
| | - Miaofang Chi
- Center for Nanophase Materials Sciences Oak Ridge National Laboratory Oak Ridge TN 37831 USA
| |
Collapse
|
33
|
Zachman MJ, Hachtel JA, Idrobo JC, Chi M. Emerging Electron Microscopy Techniques for Probing Functional Interfaces in Energy Materials. Angew Chem Int Ed Engl 2019; 59:1384-1396. [PMID: 31081976 DOI: 10.1002/anie.201902993] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2019] [Revised: 05/01/2019] [Indexed: 11/10/2022]
Abstract
Interfaces play a fundamental role in many areas of chemistry. However, their localized nature requires characterization techniques with high spatial resolution in order to fully understand their structure and properties. State-of-the-art atomic resolution or in situ scanning transmission electron microscopy and electron energy-loss spectroscopy are indispensable tools for characterizing the local structure and chemistry of materials with single-atom resolution, but they are not able to measure many properties that dictate function, such as vibrational modes or charge transfer, and are limited to room-temperature samples containing no liquids. Here, we outline emerging electron microscopy techniques that are allowing these limitations to be overcome and highlight several recent studies that were enabled by these techniques. We then provide a vision for how these techniques can be paired with each other and with in situ methods to deliver new insights into the static and dynamic behavior of functional interfaces.
Collapse
Affiliation(s)
- Michael J Zachman
- Center for Nanophase Materials Sciences, Oak Ridge National Laboratory, Oak Ridge, TN, 37831, USA
| | - Jordan A Hachtel
- Center for Nanophase Materials Sciences, Oak Ridge National Laboratory, Oak Ridge, TN, 37831, USA
| | - Juan Carlos Idrobo
- Center for Nanophase Materials Sciences, Oak Ridge National Laboratory, Oak Ridge, TN, 37831, USA
| | - Miaofang Chi
- Center for Nanophase Materials Sciences, Oak Ridge National Laboratory, Oak Ridge, TN, 37831, USA
| |
Collapse
|
34
|
Van den Broek W, Schloz M, Pekin T, Pelz P, Lu PH, Kruth M, Grillo V, Dunin-Borkowski R, Miller R, Koch C. Towards Ptychography with Structured Illumination, and a Derivative-Based Reconstruction Algorithm. MICROSCOPY AND MICROANALYSIS 2019; 25:58-59. [PMID: 0 DOI: 10.1017/s1431927619001028] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/21/2023]
|
35
|
Ophus C. Four-Dimensional Scanning Transmission Electron Microscopy (4D-STEM): From Scanning Nanodiffraction to Ptychography and Beyond. MICROSCOPY AND MICROANALYSIS : THE OFFICIAL JOURNAL OF MICROSCOPY SOCIETY OF AMERICA, MICROBEAM ANALYSIS SOCIETY, MICROSCOPICAL SOCIETY OF CANADA 2019; 25:563-582. [PMID: 31084643 DOI: 10.1017/s1431927619000497] [Citation(s) in RCA: 261] [Impact Index Per Article: 52.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/21/2023]
Abstract
Scanning transmission electron microscopy (STEM) is widely used for imaging, diffraction, and spectroscopy of materials down to atomic resolution. Recent advances in detector technology and computational methods have enabled many experiments that record a full image of the STEM probe for many probe positions, either in diffraction space or real space. In this paper, we review the use of these four-dimensional STEM experiments for virtual diffraction imaging, phase, orientation and strain mapping, measurements of medium-range order, thickness and tilt of samples, and phase contrast imaging methods, including differential phase contrast, ptychography, and others.
Collapse
Affiliation(s)
- Colin Ophus
- National Center for Electron Microscopy, Molecular Foundry, Lawrence Berkeley National Laboratory,1 Cyclotron Road, Berkeley, CA,USA
| |
Collapse
|
36
|
Song J, Allen CS, Gao S, Huang C, Sawada H, Pan X, Warner J, Wang P, Kirkland AI. Atomic Resolution Defocused Electron Ptychography at Low Dose with a Fast, Direct Electron Detector. Sci Rep 2019; 9:3919. [PMID: 30850641 PMCID: PMC6408533 DOI: 10.1038/s41598-019-40413-z] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2018] [Accepted: 02/14/2019] [Indexed: 01/16/2023] Open
Abstract
Electron ptychography has recently attracted considerable interest for high resolution phase-sensitive imaging. However, to date studies have been mainly limited to radiation resistant samples as the electron dose required to record a ptychographic dataset is too high for use with beam-sensitive materials. Here we report defocused electron ptychography using a fast, direct-counting detector to reconstruct the transmission function, which is in turn related to the electrostatic potential of a two-dimensional material at atomic resolution under various low dose conditions.
Collapse
Affiliation(s)
- Jiamei Song
- College of Engineering and Applied Sciences, Nanjing University, Nanjing, 210093, People's Republic of China
| | - Christopher S Allen
- Department of Materials, University of Oxford, Parks Road, Oxford, OX1 3PH, UK.,Electron Physical Sciences Imaging Centre, Diamond Lightsource Ltd., Didcot, OX11 0DE, UK
| | - Si Gao
- College of Engineering and Applied Sciences, Nanjing University, Nanjing, 210093, People's Republic of China
| | - Chen Huang
- Department of Materials, University of Oxford, Parks Road, Oxford, OX1 3PH, UK.,Electron Physical Sciences Imaging Centre, Diamond Lightsource Ltd., Didcot, OX11 0DE, UK
| | - Hidetaka Sawada
- JEOL Ltd, 1-2 Mushashino, 3-Chome, Akishima, Tokyo, 196, Japan
| | - Xiaoqing Pan
- Department of Materials Science and Engineering, and Department of Physics and Astronomy, University of California, Irvine, CA, 92697, USA
| | - Jamie Warner
- Department of Materials, University of Oxford, Parks Road, Oxford, OX1 3PH, UK
| | - Peng Wang
- College of Engineering and Applied Sciences, Nanjing University, Nanjing, 210093, People's Republic of China.
| | - Angus I Kirkland
- Department of Materials, University of Oxford, Parks Road, Oxford, OX1 3PH, UK.,Electron Physical Sciences Imaging Centre, Diamond Lightsource Ltd., Didcot, OX11 0DE, UK
| |
Collapse
|
37
|
Melo LGA, Hitchcock AP. Electron beam damage of perfluorosulfonic acid studied by soft X-ray spectromicroscopy. Micron 2019; 121:8-20. [PMID: 30875488 DOI: 10.1016/j.micron.2019.02.006] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2018] [Revised: 02/08/2019] [Accepted: 02/19/2019] [Indexed: 10/27/2022]
Abstract
Scanning transmission X-ray microscopy (STXM) was used to study chemical changes to perfluorosulfonic acid (PFSA) spun cast thin films as a function of dose imparted by exposure of a 200 kV electron beam in a Transmission Electron Microscope (TEM). The relationship between electron beam fluence and absorbed dose was calibrated using a modified version of a protocol based on the positive to negative lithography transition in PMMA [Leontowich et al, J. Synchrotron Rad. 19 (2012) 976]. STXM was used to characterize and quantify the chemical changes caused by electron irradiation of PFSA under several different conditions. The critical dose for CF2-CF2 amorphization was used to explore the effects of the sample environment on electron beam damage. Use of a silicon nitride substrate was found to increase the CF2-CF2 amorphization critical dose by ∼x2 from that for free-standing PFSA films. Freestanding PFSA and PMMA films were damaged by 200 kV electrons at ∼100 K and then the damage was measured by STXM at 300 K (RT). The lithography cross-over dose for PMMA was found to be ∼2x higher when the PMMA thin film was electron irradiated at 120 K rather than at 300 K. The critical dose for CF2-CF2 amorphization in PFSA irradiated at 120 K followed by warming and delayed measurement by STXM at 300 K was found to be ∼2x larger than at 300 K. To place these results in the context of the use of electron microscopy to study PFSA ionomer in fuel cell systems, an exposure of 300 e-/nm2 at 300 K (which corresponds to an absorbed dose of ∼20 MGy) amorphizes ∼10% of the CF2-CF2 bonds in PFSA. At this dose level, the spatial resolution for TEM imaging of PFSA is limited to 3.5 nm by radiation damage, if one is using a direct electron detector with DQE = 1. This work recommends caution about 2D and 3D morphological information of PFSA materials based on TEM studies which use fluences higher than 300 e-/nm2.
Collapse
Affiliation(s)
- Lis G A Melo
- Dept. Chemistry and Chemical Biology, McMaster University, Hamilton, ON, L8S4M1, Canada.
| | - Adam P Hitchcock
- Dept. Chemistry and Chemical Biology, McMaster University, Hamilton, ON, L8S4M1, Canada
| |
Collapse
|
38
|
Pennycook TJ, Martinez GT, Nellist PD, Meyer JC. High dose efficiency atomic resolution imaging via electron ptychography. Ultramicroscopy 2019; 196:131-135. [PMID: 30366318 DOI: 10.1016/j.ultramic.2018.10.005] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2018] [Revised: 10/09/2018] [Accepted: 10/17/2018] [Indexed: 10/28/2022]
|
39
|
Srivastava M, Freed JH. Singular Value Decomposition Method To Determine Distance Distributions in Pulsed Dipolar Electron Spin Resonance: II. Estimating Uncertainty. J Phys Chem A 2018; 123:359-370. [PMID: 30525624 DOI: 10.1021/acs.jpca.8b07673] [Citation(s) in RCA: 26] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
This paper is a continuation of the method introduced by Srivastava and Freed (2017) that is a new method based on truncated singular value decomposition (TSVD) for obtaining physical results from experimental signals without any need for Tikhonov regularization or other similar methods that require a regularization parameter. We show here how to estimate the uncertainty in the SVD-generated solutions. The uncertainty in the solution may be obtained by finding the minimum and maximum values over which the solution remains converged. These are obtained from the optimum range of singular value contributions, where the width of this region depends on the solution point location (e.g., distance) and the signal-to-noise ratio (SNR) of the signal. The uncertainty levels typically found are very small with substantial SNR of the (denoised) signal, emphasizing the reliability of the method. With poorer SNR, the method is still satisfactory but with greater uncertainty, as expected. Pulsed dipolar electron spin resonance spectroscopy experiments are used as an example, but this TSVD approach is general and thus applicable to any similar experimental method wherein singular matrix inversion is needed to obtain the physically relevant result. We show that the Srivastava-Freed TSVD method along with the estimate of uncertainty can be effectively applied to pulsed dipolar electron spin resonance signals with SNR > 30, and even for a weak signal (e.g., SNR ≈ 3) reliable results are obtained by this method, provided the signal is first denoised using wavelet transforms (WavPDS).
Collapse
|
40
|
Yasin FS, Harvey TR, Chess JJ, Pierce JS, Ophus C, Ercius P, McMorran BJ. Probing Light Atoms at Subnanometer Resolution: Realization of Scanning Transmission Electron Microscope Holography. NANO LETTERS 2018; 18:7118-7123. [PMID: 30265544 DOI: 10.1021/acs.nanolett.8b03166] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/21/2023]
Abstract
Atomic resolution imaging of light elements in electron-transparent materials has long been a challenge. Biomolecular materials, for example, are rapidly altered by incident electrons. We demonstrate a scanning transmission electron microscopy (STEM) technique, called STEM holography, capable of efficient structural analysis of beam-sensitive nanomaterials. STEM holography measures the absolute phase and amplitude of electrons passed through a specimen via interference with a vacuum reference wave. We use an amplitude-dividing nanofabricated grating to prepare multiple beams focused at the sample. We configure the postspecimen microscope imaging system to overlap the beams, forming an interference pattern. We record and analyze the pattern at each 2D-raster-scan-position, reconstructing the complex object wave. As a demonstration, we image gold nanoparticles on an amorphous carbon substrate at 2.4 Å resolution. STEM holography offers higher contrast of the carbon while maintaining gold atomic lattice resolution compared to high angle annular dark field STEM.
Collapse
Affiliation(s)
- Fehmi S Yasin
- Department of Physics , 1274 University of Oregon , Eugene , Oregon 97403 , United States
| | - Tyler R Harvey
- Department of Physics , 1274 University of Oregon , Eugene , Oregon 97403 , United States
- IV. Physicalisches Insitut , Georg-August-Universität Göttingen , Friedrich-Hund-Platz 1 , 37077 Göttingen , Germany
| | - Jordan J Chess
- Department of Physics , 1274 University of Oregon , Eugene , Oregon 97403 , United States
| | - Jordan S Pierce
- Department of Physics , 1274 University of Oregon , Eugene , Oregon 97403 , United States
| | - Colin Ophus
- National Center for Electron Microscopy , Lawrence Berkeley National Laboratory , Berkeley , California 94720 , United States
| | - Peter Ercius
- National Center for Electron Microscopy , Lawrence Berkeley National Laboratory , Berkeley , California 94720 , United States
| | - Benjamin J McMorran
- Department of Physics , 1274 University of Oregon , Eugene , Oregon 97403 , United States
| |
Collapse
|
41
|
Electron ptychography of 2D materials to deep sub-ångström resolution. Nature 2018; 559:343-349. [DOI: 10.1038/s41586-018-0298-5] [Citation(s) in RCA: 310] [Impact Index Per Article: 51.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2018] [Accepted: 05/24/2018] [Indexed: 11/08/2022]
|
42
|
Pryor A, Ophus C, Miao J. A streaming multi-GPU implementation of image simulation algorithms for scanning transmission electron microscopy. ACTA ACUST UNITED AC 2017; 3:15. [PMID: 29104852 PMCID: PMC5656717 DOI: 10.1186/s40679-017-0048-z] [Citation(s) in RCA: 62] [Impact Index Per Article: 8.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2017] [Accepted: 10/13/2017] [Indexed: 11/25/2022]
Abstract
Simulation of atomic-resolution image formation in scanning transmission electron microscopy can require significant computation times using traditional methods. A recently developed method, termed plane-wave reciprocal-space interpolated scattering matrix (PRISM), demonstrates potential for significant acceleration of such simulations with negligible loss of accuracy. Here, we present a software package called Prismatic for parallelized simulation of image formation in scanning transmission electron microscopy (STEM) using both the PRISM and multislice methods. By distributing the workload between multiple CUDA-enabled GPUs and multicore processors, accelerations as high as 1000 × for PRISM and 15 × for multislice are achieved relative to traditional multislice implementations using a single 4-GPU machine. We demonstrate a potentially important application of Prismatic, using it to compute images for atomic electron tomography at sufficient speeds to include in the reconstruction pipeline. Prismatic is freely available both as an open-source CUDA/C++ package with a graphical user interface and as a Python package, PyPrismatic.
Collapse
Affiliation(s)
- Alan Pryor
- Department of Physics and Astronomy and California NanoSystems Institute, University of California at Los Angeles, Los Angeles, CA 90095 USA
| | - Colin Ophus
- National Center for Electron Microscopy, Molecular Foundry, Lawrence Berkeley National Laboratory, Berkeley, CA 94720 USA
| | - Jianwei Miao
- Department of Physics and Astronomy and California NanoSystems Institute, University of California at Los Angeles, Los Angeles, CA 90095 USA
| |
Collapse
|