1
|
Ge M, Pan Y, Liu X, Zhao Z, Su D. Automatic center identification of electron diffraction with multi-scale transformer networks. Ultramicroscopy 2024; 259:113926. [PMID: 38310650 DOI: 10.1016/j.ultramic.2024.113926] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Revised: 12/08/2023] [Accepted: 01/21/2024] [Indexed: 02/06/2024]
Abstract
Selected area electron diffraction (SAED) is a widely used technique for characterizing the structure and measuring lattice parameters of materials. An autonomous analytic method has become an urgent demand for the large-scale SAED data produced from in-situ experiments. In this work, we realize the automatic processing for center identification with a proposed deep segmentation model named the multi-scale Transformer (MS-Trans) network. This algorithm enables robust segmentation of the central spots by combining a novel gated axial-attention module and multi-scale feature fusion. The proposed MS-Trans model shows high precision and robustness, enabling autonomous processing of SAED patterns without any prior knowledge. The application on in-situ SAED data of the oxidation process of FeNi alloy demonstrates its capability of implementing autonomous quantitative processing. © 2017 Elsevier Inc. All rights reserved.
Collapse
Affiliation(s)
- Mengshu Ge
- Beijing National Laboratory for Condensed Matter Physics, Institute of Physics, Chinese Academy of Sciences, Beijing, 100190, China
| | - Yue Pan
- Beijing National Laboratory for Condensed Matter Physics, Institute of Physics, Chinese Academy of Sciences, Beijing, 100190, China
| | - Xiaozhi Liu
- Beijing National Laboratory for Condensed Matter Physics, Institute of Physics, Chinese Academy of Sciences, Beijing, 100190, China
| | - Zhicheng Zhao
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, 100876, China; Beijing Key Laboratory of Network System and Network Culture, Beijing University of Posts and Telecommunications, Beijing, 100876, China.
| | - Dong Su
- Beijing National Laboratory for Condensed Matter Physics, Institute of Physics, Chinese Academy of Sciences, Beijing, 100190, China.
| |
Collapse
|
2
|
Ra M, Boo Y, Jeong JM, Batts-Etseg J, Jeong J, Lee W. Classification of crystal structures using electron diffraction patterns with a deep convolutional neural network. RSC Adv 2021; 11:38307-38315. [PMID: 35493237 PMCID: PMC9043913 DOI: 10.1039/d1ra07156d] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2021] [Accepted: 11/14/2021] [Indexed: 12/03/2022] Open
Abstract
Investigations have been made to explore the applicability of an off-the-shelf deep convolutional neural network (DCNN) architecture, residual neural network (ResNet), to the classification of the crystal structure of materials using electron diffraction patterns without prior knowledge of the material systems under consideration. The dataset required for training and validating the ResNet architectures was obtained by the computer simulation of the selected area electron diffraction (SAD) in transmission electron microscopy. Acceleration voltages, zone axes, and camera lengths were used as variables and crystal information format (CIF) files obtained from open crystal data repositories were used as inputs. The cubic crystal system was chosen as a model system and five space groups of 213, 221, 225, 227, and 229 in the cubic system were selected for the test and validation, based on the distinguishability of the SAD patterns. The simulated diffraction patterns were regrouped and labeled from the viewpoint of computer vision, i.e., the way how the neural network recognizes the two-dimensional representation of three-dimensional lattice structure of crystals, for improved training and classification efficiency. Comparison of the various ResNet architectures with varying number of layers demonstrated that the ResNet101 architecture could classify the space groups with the validation accuracy of 92.607%. The off-the-shelf deep convolutional neural network architecture, ResNet, could classify the space group of materials with cubic crystal structures with the prediction accuracy of 92.607%, using the selected area electron diffraction patterns.![]()
Collapse
Affiliation(s)
- Moonsoo Ra
- LightVision Inc., 20 Seongsuil-ro 12-gil, Seongdong-gu, Seoul 04793, Republic of Korea
| | - Younggun Boo
- LightVision Inc., 20 Seongsuil-ro 12-gil, Seongdong-gu, Seoul 04793, Republic of Korea
| | - Jae Min Jeong
- School of Materials Science and Engineering, Changwon National University, 20 Changwondaehak-ro, Changwon-si, Gyeongsangnam-do 51140, Republic of Korea
| | - Jargalsaikhan Batts-Etseg
- School of Materials Science and Engineering, Changwon National University, 20 Changwondaehak-ro, Changwon-si, Gyeongsangnam-do 51140, Republic of Korea
| | - Jinha Jeong
- LightVision Inc., 20 Seongsuil-ro 12-gil, Seongdong-gu, Seoul 04793, Republic of Korea
- TRIZ Center, Hanyang University, 222 Wangsimni-ro, Seongdong-gu, Seoul 04763, Republic of Korea
| | - Woong Lee
- School of Materials Science and Engineering, Changwon National University, 20 Changwondaehak-ro, Changwon-si, Gyeongsangnam-do 51140, Republic of Korea
| |
Collapse
|
3
|
Mompiou F, Xie RX. pycotem: An open source toolbox for online crystal defect characterization from TEM imaging and diffraction. J Microsc 2020; 282:84-97. [PMID: 33200816 DOI: 10.1111/jmi.12982] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2020] [Revised: 10/27/2020] [Accepted: 11/10/2020] [Indexed: 11/30/2022]
Abstract
We present a series of tools working together that facilitate the determination of dislocation Burgers vectors and slip planes, interface plane normals and misorientation between two crystals from a series of Transmission Electron Microscopy (TEM) micrographs and diffraction patterns. To that purpose, we developed graphical user interface programs that allow crystal orientation determination from spot diffraction patterns taken at various tilt angles or from Kikuchi patterns crystal representation from stereographic projection plots and determination of geometrical features from series of conventional images taken at different tilt angles. We present working examples that allow a faster and easier way to analyse data that can especially be retrieved during in situ straining experiments where dislocations and grain boundaries need to be characterized. More generally, these tools target material scientists interested in daily microstructural characterization in TEM.
Collapse
Affiliation(s)
| | - Rui-Xun Xie
- Key Laboratory of Advanced Materials (MOE), School of Materials Science and Engineering, Tsinghua University, Beijing, People's Republic of China
| |
Collapse
|
4
|
Xie RX, Zhang WZ. τompas: a free and integrated tool for online crystallographic analysis in transmission electron microscopy. J Appl Crystallogr 2020. [DOI: 10.1107/s1600576720000801] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022] Open
Abstract
τompas (TEM online multi-purpose analyzing system) is a free and integrated software tool designed to perform online crystallographic analysis in transmission electron microscopy (TEM) experiments. By using sample holder tilt angles as input, τompas can simultaneously simulate pole figures, Kikuchi patterns and feature projections, providing graphical views of the sample crystallography. These simulations are further employed to navigate sample tilting and to quickly interpret experimental Kikuchi patterns and images by image matching, giving self-consistent indices of features and crystal orientations. These functions are integrated with mouse operations to improve work efficiency. τompas is distributed as a small cross-platform program that can be installed on a microscope computer to cooperate with other tools.
Collapse
|
5
|
Zhang Y, Yan R, Sun T, Ma Y. A simple program for fast tilting electron-beam sensitive crystals to zone axes. Ultramicroscopy 2020; 211:112941. [PMID: 32004972 DOI: 10.1016/j.ultramic.2020.112941] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2019] [Revised: 12/30/2019] [Accepted: 01/19/2020] [Indexed: 11/16/2022]
Abstract
Tilting crystals to proper zone axes is a necessary but tedious work in taking selected area electron diffraction patterns (SAED) and high-resolution images using transmission electron microscope (TEM). This process not only costs a lot of time but also limits the application of TEM in electron-beam sensitive materials. Therefore, it is desirable to develop a simple method for tilting crystals from random orientations to a specific zone axis quickly. Herein, we describe a novel program, Zones, which can index the electron diffraction pattern and calculate the tilting angles of a double-tilt sample holder from the current orientation to a desired zone axis. It can also bring crystals that are slightly deviated from a zone axis to the exact zone with the help of Laue ring in the diffraction pattern. This program has been successfully applied to studies of zeolites and metal-organic frameworks (MOFs), known as being electron-beam sensitive. The program shows its power not only in saving the operator's time but also in preventing the crystals from quick beam damages.
Collapse
Affiliation(s)
- Y Zhang
- School of Physical Science and Technology, ShanghaiTech University, Shanghai 201210, China
| | - R Yan
- School of Physical Science and Technology, ShanghaiTech University, Shanghai 201210, China
| | - T Sun
- School of Physical Science and Technology, ShanghaiTech University, Shanghai 201210, China
| | - Y Ma
- School of Physical Science and Technology, ShanghaiTech University, Shanghai 201210, China.
| |
Collapse
|
6
|
Lábár JL, Das PP. Pattern Center and Distortion Determined from Faint, Diffuse Electron Diffraction Rings from Amorphous Materials. MICROSCOPY AND MICROANALYSIS : THE OFFICIAL JOURNAL OF MICROSCOPY SOCIETY OF AMERICA, MICROBEAM ANALYSIS SOCIETY, MICROSCOPICAL SOCIETY OF CANADA 2017; 23:647-660. [PMID: 28434432 DOI: 10.1017/s1431927617000435] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Diffuse rings from amorphous materials sit on a steep background resulting in a monotonically decreasing intensity over scattering vector length, frequently with no clear local maximum that could be used to determine the center of the ring. The novelty of the method reported here is that it successful processes such weak patterns. It is based on separating the angular dependence of the positions of the maxima on the azimuthal angle in the measured two-dimensional pattern for a manually preselected peak. Both pattern center and elliptical distortion are simultaneously refined from this angular dependence. Both steps are based on nonlinear least square fitting, using the Levenberg-Marquardt method. It can be successfully applied to any amorphous patterns provided they were recorded with experimental conditions that facilitate dividing them into sectors with acceptable statistics. Patterns with the center shifted to the camera corner (recording a quadrant of a ring) can also be reliably evaluated, keeping precalibrated values of the elliptical distortion fixed during the fit. Finally, the limited number of counts in any pattern is overcome by cumulating many patterns (from equivalent areas) into a single pattern. Eliminating false effects is facilitated by masking out unwanted parts of any recorded pattern from processing.
Collapse
Affiliation(s)
- János L Lábár
- 1Centre for Energy Research,Institute of Technical Physics and Materials Science,Hungarian Academy of Sciences,H-1121 Budapest,Konkoly-Thege M. u. 29-33,Hungary
| | - Partha P Das
- 2Electron Crystallography Solutions,Orense 8,28032 Madrid,Spain
| |
Collapse
|
7
|
Klinger M, Jäger A. Crystallographic Tool Box ( CrysTBox): automated tools for transmission electron microscopists and crystallographers. J Appl Crystallogr 2015; 48:2012-2018. [PMID: 26664349 PMCID: PMC4665667 DOI: 10.1107/s1600576715017252] [Citation(s) in RCA: 98] [Impact Index Per Article: 10.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2015] [Accepted: 09/15/2015] [Indexed: 11/10/2022] Open
Abstract
Three tools for an automated analysis of electron diffraction pattern and crystallographic visualization are presented. Firstly, diffractGUI determines the zone axis from selected area diffraction, convergent beam diffraction or nanodiffraction patterns and allows for indexing of individual reflections. Secondly, ringGUI identifies crystallographic planes corresponding to the depicted rings in the ring diffraction pattern and can select the sample material from a list of candidates. Both diffractGUI and ringGUI employ methods of computer vision for a fast, robust and accurate analysis. Thirdly, cellViewer is an intuitive visualization tool which is also helpful for crystallographic calculations or educational purposes. diffractGUI and cellViewer can be used together during a transmission electron microscopy session to determine the sample holder tilts required to reach a desired zone axis. All the tools offer a graphical user interface. The toolbox is distributed as a standalone application, so it can be installed on the microscope computer and launched directly from DigitalMicrograph (Gatan Inc.).
Collapse
Affiliation(s)
- Miloslav Klinger
- Laboratory of Nanostructures and Nanomaterials, Institute of Physics of the ASCR, Na Slovance 2, 182 21 Prague 8, Czech Republic
| | - Aleš Jäger
- Laboratory of Nanostructures and Nanomaterials, Institute of Physics of the ASCR, Na Slovance 2, 182 21 Prague 8, Czech Republic
| |
Collapse
|
8
|
Kim B, Levard C, Murayama M, Brown GE, Hochella MF. Integrated approaches of x-ray absorption spectroscopic and electron microscopic techniques on zinc speciation and characterization in a final sewage sludge product. JOURNAL OF ENVIRONMENTAL QUALITY 2014; 43:908-916. [PMID: 25602819 DOI: 10.2134/jeq2013.10.0418] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
Integration of complementary techniques can be powerful for the investigation of metal speciation and characterization in complex and heterogeneous environmental samples, such as sewage sludge products. In the present study, we combined analytical transmission electron microscopy (TEM)-based techniques with X-ray absorption spectroscopy (XAS) to identify and characterize nanocrystalline zinc sulfide (ZnS), considered to be the dominant Zn-containing phase in the final stage of sewage sludge material of a full-scale municipal wastewater treatment plant. We also developed sample preparation procedures to preserve the organic and sulfur-rich nature of sewage sludge matrices for microscopic and spectroscopic analyses. Analytical TEM results indicate individual ZnS nanocrystals to be in the size range of 2.5 to 7.5 nm in diameter, forming aggregates of a few hundred nanometers. Observed lattice spacings match sphalerite. The ratio of S to Zn for the ZnS nanocrystals is estimated to be 1.4, suggesting that S is present in excess. The XAS results on the Zn speciation in the bulk sludge material also support the TEM observation that approximately 80% of the total Zn has the local structure of a 3-nm ZnS nanoparticle reference material. Because sewage sludge is frequently used as a soil amendment on agricultural lands, future studies that investigate the oxidative dissolution rate of ZnS nanoparticles as a function of size and aggregation state and the change of Zn speciation during post sludge-processing and soil residency are warranted to help determine the bioavailability of sludge-born Zn in the soil environment.
Collapse
|
9
|
Licea YE, Amaya SL, Echavarría A, Bettini J, Eon JG, Palacio LA, Faro AC. Simultaneous tetralin HDA and dibenzothiophene HDS reactions on NiMo bulk sulphide catalysts obtained from mixed oxides. Catal Sci Technol 2014. [DOI: 10.1039/c3cy00801k] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
Large selectivity differences were found between supported and unsupported NiMoS catalysts in dibenzothiophene HDS and tetralin HDA.
Collapse
Affiliation(s)
- Yordy E. Licea
- Instituto de Química
- Universidade Federal de Rio de Janeiro
- Rio de Janeiro, Brasil
| | - Sandra L. Amaya
- Grupo Catalizadores y Adsorbentes
- Universidad de Antioquia
- Medellín, Colombia
| | - Adriana Echavarría
- Grupo Catalizadores y Adsorbentes
- Universidad de Antioquia
- Medellín, Colombia
| | - Jefferson Bettini
- Laboratório Nacional de Nanotecnologia
- Centro Nacional de Pesquisa em Energia e Materiais
- Campinas, Brasil
| | - Jean G. Eon
- Instituto de Química
- Universidade Federal de Rio de Janeiro
- Rio de Janeiro, Brasil
| | - Luz A. Palacio
- Instituto de Química
- Universidade do Estado de Rio de Janeiro
- Rio de Janeiro, Brasil
| | - Arnaldo C. Faro
- Instituto de Química
- Universidade Federal de Rio de Janeiro
- Rio de Janeiro, Brasil
| |
Collapse
|