1
|
Botifoll M, Pinto-Huguet I, Arbiol J. Machine learning in electron microscopy for advanced nanocharacterization: current developments, available tools and future outlook. NANOSCALE HORIZONS 2022; 7:1427-1477. [PMID: 36239693 DOI: 10.1039/d2nh00377e] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
In the last few years, electron microscopy has experienced a new methodological paradigm aimed to fix the bottlenecks and overcome the challenges of its analytical workflow. Machine learning and artificial intelligence are answering this call providing powerful resources towards automation, exploration, and development. In this review, we evaluate the state-of-the-art of machine learning applied to electron microscopy (and obliquely, to materials and nano-sciences). We start from the traditional imaging techniques to reach the newest higher-dimensionality ones, also covering the recent advances in spectroscopy and tomography. Additionally, the present review provides a practical guide for microscopists, and in general for material scientists, but not necessarily advanced machine learning practitioners, to straightforwardly apply the offered set of tools to their own research. To conclude, we explore the state-of-the-art of other disciplines with a broader experience in applying artificial intelligence methods to their research (e.g., high-energy physics, astronomy, Earth sciences, and even robotics, videogames, or marketing and finances), in order to narrow down the incoming future of electron microscopy, its challenges and outlook.
Collapse
Affiliation(s)
- Marc Botifoll
- Catalan Institute of Nanoscience and Nanotechnology (ICN2), CSIC and BIST, Campus UAB, Bellaterra, 08193 Barcelona, Catalonia, Spain.
| | - Ivan Pinto-Huguet
- Catalan Institute of Nanoscience and Nanotechnology (ICN2), CSIC and BIST, Campus UAB, Bellaterra, 08193 Barcelona, Catalonia, Spain.
| | - Jordi Arbiol
- Catalan Institute of Nanoscience and Nanotechnology (ICN2), CSIC and BIST, Campus UAB, Bellaterra, 08193 Barcelona, Catalonia, Spain.
- ICREA, Pg. Lluís Companys 23, 08010 Barcelona, Catalonia, Spain
| |
Collapse
|
2
|
Yao L, Ou Z, Luo B, Xu C, Chen Q. Machine Learning to Reveal Nanoparticle Dynamics from Liquid-Phase TEM Videos. ACS CENTRAL SCIENCE 2020; 6:1421-1430. [PMID: 32875083 PMCID: PMC7453571 DOI: 10.1021/acscentsci.0c00430] [Citation(s) in RCA: 66] [Impact Index Per Article: 16.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/10/2020] [Indexed: 05/08/2023]
Abstract
Liquid-phase transmission electron microscopy (TEM) has been recently applied to materials chemistry to gain fundamental understanding of various reaction and phase transition dynamics at nanometer resolution. However, quantitative extraction of physical and chemical parameters from the liquid-phase TEM videos remains bottlenecked by the lack of automated analysis methods compatible with the videos' high noisiness and spatial heterogeneity. Here, we integrate, for the first time, liquid-phase TEM imaging with our customized analysis framework based on a machine learning model called U-Net neural network. This combination is made possible by our workflow to generate simulated TEM images as the training data with well-defined ground truth. We apply this framework to three typical systems of colloidal nanoparticles, concerning their diffusion and interaction, reaction kinetics, and assembly dynamics, all resolved in real-time and real-space by liquid-phase TEM. A diversity of properties for differently shaped anisotropic nanoparticles are mapped, including the anisotropic interaction landscape of nanoprisms, curvature-dependent and staged etching profiles of nanorods, and an unexpected kinetic law of first-order chaining assembly of concave nanocubes. These systems representing properties at the nanoscale are otherwise experimentally inaccessible. Compared to the prevalent image segmentation methods, U-Net shows a superior capability to predict the position and shape boundary of nanoparticles from highly noisy and fluctuating background-a challenge common and sometimes inevitable in liquid-phase TEM videos. We expect our framework to push the potency of liquid-phase TEM to its full quantitative level and to shed insights, in high-throughput and statistically significant fashion, on the nanoscale dynamics of synthetic and biological nanomaterials.
Collapse
Affiliation(s)
- Lehan Yao
- Department
of Materials Science and Engineering, Materials Research Laboratory, Beckman Institute
for Advanced Science and Technology, and Department of Chemistry, University of Illinois at Urbana−Champaign, Urbana, Illinois 61801, United States
| | - Zihao Ou
- Department
of Materials Science and Engineering, Materials Research Laboratory, Beckman Institute
for Advanced Science and Technology, and Department of Chemistry, University of Illinois at Urbana−Champaign, Urbana, Illinois 61801, United States
| | - Binbin Luo
- Department
of Materials Science and Engineering, Materials Research Laboratory, Beckman Institute
for Advanced Science and Technology, and Department of Chemistry, University of Illinois at Urbana−Champaign, Urbana, Illinois 61801, United States
| | - Cong Xu
- Department
of Materials Science and Engineering, Materials Research Laboratory, Beckman Institute
for Advanced Science and Technology, and Department of Chemistry, University of Illinois at Urbana−Champaign, Urbana, Illinois 61801, United States
| | - Qian Chen
- Department
of Materials Science and Engineering, Materials Research Laboratory, Beckman Institute
for Advanced Science and Technology, and Department of Chemistry, University of Illinois at Urbana−Champaign, Urbana, Illinois 61801, United States
- E-mail:
| |
Collapse
|
3
|
In-situ electron microscopy mapping of an order-disorder transition in a superionic conductor. Nat Commun 2019; 10:1505. [PMID: 30944324 PMCID: PMC6447557 DOI: 10.1038/s41467-019-09502-5] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2018] [Accepted: 03/13/2019] [Indexed: 11/08/2022] Open
Abstract
Solid-solid phase transitions are processes ripe for the discovery of correlated atomic motion in crystals. Here, we monitor an order-disorder transition in real-time in nanoparticles of the super-ionic solid, Cu2-xSe. The use of in-situ high-resolution transmission electron microscopy allows the spatiotemporal evolution of the phase transition within a single nanoparticle to be monitored at the atomic level. The high spatial resolution reveals that cation disorder is nucleated at low co-ordination, high energy sites of the nanoparticle where cationic vacancy layers intersect with surface facets. Time-dependent evolution of the reciprocal lattice of individual nanoparticles shows that the initiation of cation disorder is accompanied by a ~3% compression of the anionic lattice, establishing a correlation between these two structural features of the lattice. The spatiotemporal insights gained here advance understanding of order-disorder transitions, ionic structure and transport, and the role of nanoparticle surfaces in phase transitions.
Collapse
|
4
|
Wang X, Yang J, Andrei CM, Soleymani L, Grandfield K. Biomineralization of calcium phosphate revealed by in situ liquid-phase electron microscopy. Commun Chem 2018. [DOI: 10.1038/s42004-018-0081-4] [Citation(s) in RCA: 26] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022] Open
|
5
|
Park JH, Schneider NM, Steingart DA, Deligianni H, Kodambaka S, Ross FM. Control of Growth Front Evolution by Bi Additives during ZnAu Electrodeposition. NANO LETTERS 2018; 18:1093-1098. [PMID: 29309157 DOI: 10.1021/acs.nanolett.7b04640] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
The performance of many electrochemical energy storage systems can be compromised by the formation of metal dendrites during charging. Additives in the electrolyte represent a useful strategy to mitigate dendrite formation, but understanding the mechanisms involved requires knowledge of the nanoscale effects of additives during electrochemical deposition. Here we quantify the effects of an inorganic additive on the morphology of an evolving electrochemical growth front, using liquid cell electron microscopy to provide the necessary spatial and temporal resolution. We examine deposition of ZnAu on Au in the presence of Bi additive, and show that low concentrations of Bi delay but do not prevent the formation of growth front instabilities. We describe a model in which Bi segregates at the growth front and promotes the surface diffusion and relaxation of Zn, allowing better coverage of the initial Au electrode surface. A more precise knowledge of the mechanism of inorganic additive effects may help in designing electrolyte chemistry for battery and other applications where morphology control is essential.
Collapse
Affiliation(s)
- Jeung Hun Park
- IBM T. J. Watson Research Center , 1101 Kitchawan Road, Yorktown Heights, New York 10598, United States
- Department of Mechanical and Aerospace Engineering, and Andlinger Center for Energy and the Environment, Princeton University , 86 Olden Street, Princeton, New Jersey 08544, United States
- Department of Materials Science and Engineering, University of California Los Angeles , 410 Westwood Plaza, Los Angeles, California 90095, United States
| | - Nicholas M Schneider
- Department of Mechanical Engineering and Applied Mechanics, University of Pennsylvania , 220 South 33rd Street, Philadelphia, Pennsylvania 19147, United States
| | - Daniel A Steingart
- Department of Mechanical and Aerospace Engineering, and Andlinger Center for Energy and the Environment, Princeton University , 86 Olden Street, Princeton, New Jersey 08544, United States
| | - Hariklia Deligianni
- IBM T. J. Watson Research Center , 1101 Kitchawan Road, Yorktown Heights, New York 10598, United States
| | - Suneel Kodambaka
- Department of Materials Science and Engineering, University of California Los Angeles , 410 Westwood Plaza, Los Angeles, California 90095, United States
| | - Frances M Ross
- IBM T. J. Watson Research Center , 1101 Kitchawan Road, Yorktown Heights, New York 10598, United States
| |
Collapse
|
6
|
Nanoscale evolution of interface morphology during electrodeposition. Nat Commun 2017; 8:2174. [PMID: 29259183 PMCID: PMC5736733 DOI: 10.1038/s41467-017-02364-9] [Citation(s) in RCA: 34] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2017] [Accepted: 11/23/2017] [Indexed: 11/30/2022] Open
Abstract
Control of interfacial morphology in electrochemical processes is essential for applications ranging from nanomanufacturing to batteries. Here, we quantify the evolution of an electrochemical growth front, using liquid cell electron microscopy to access unexplored length and time scales. During galvanostatic deposition of copper from an acidic electrolyte, we find that the growth front initially evolves consistent with kinetic roughening theory. Subsequently, it roughens more rapidly, consistent with diffusion-limited growth physics. However, the onset of roughening is strongly delayed compared to expectations, suggesting the importance of lateral diffusion of ions. Based on these growth regimes, we discuss morphological control and demonstrate the effects of two strategies, pulse plating and the use of electrolyte additives. Understanding structure evolution during electrochemical growth is crucial in materials processing and design of devices such as batteries. Here, the authors image copper during electrodeposition to provide strategies for controlling interface morphology.
Collapse
|