1
|
Del-Pozo-Bueno D, Kepaptsoglou D, Ramasse QM, Peiró F, Estradé S. Machine Learning Data Augmentation Strategy for Electron Energy Loss Spectroscopy: Generative Adversarial Networks. Microsc Microanal 2024; 30:278-293. [PMID: 38684097 DOI: 10.1093/mam/ozae014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/29/2023] [Revised: 08/01/2023] [Accepted: 02/12/2024] [Indexed: 05/02/2024]
Abstract
Recent advances in machine learning (ML) have highlighted a novel challenge concerning the quality and quantity of data required to effectively train algorithms in supervised ML procedures. This article introduces a data augmentation (DA) strategy for electron energy loss spectroscopy (EELS) data, employing generative adversarial networks (GANs). We present an innovative approach, called the data augmentation generative adversarial network (DAG), which facilitates data generation from a very limited number of spectra, around 100. Throughout this study, we explore the optimal configuration for GANs to produce realistic spectra. Notably, our DAG generates realistic spectra, and the spectra produced by the generator are successfully used in real-world applications to train classifiers based on artificial neural networks (ANNs) and support vector machines (SVMs) that have been successful in classifying experimental EEL spectra.
Collapse
Affiliation(s)
- Daniel Del-Pozo-Bueno
- LENS-MIND, Departament d'Enginyeria Electrònica i Biomèdica, Universitat de Barcelona, 1-11 Martí i Franquès, 08028 Barcelona, Spain
- Institute of Nanoscience and Nanotechnology (IN2UB), Universitat de Barcelona, 1-11 Martí i Franquès, 08028 Barcelona, Spain
| | - Demie Kepaptsoglou
- SuperSTEM Laboratory, Sci-Tech Daresbury Campus, Keckwick Lane, Daresbury WA4 4AD, UK
- School of Physics, Engineering and Technology, University of York, Newton way, YO10 5DD Heslington, UK
| | - Quentin M Ramasse
- SuperSTEM Laboratory, Sci-Tech Daresbury Campus, Keckwick Lane, Daresbury WA4 4AD, UK
- Schools of Chemical and Process Engineering & Physics and Astronomy, Woodhouse Lane, University of Leeds, LS2 9JT Leeds, UK
| | - Francesca Peiró
- LENS-MIND, Departament d'Enginyeria Electrònica i Biomèdica, Universitat de Barcelona, 1-11 Martí i Franquès, 08028 Barcelona, Spain
- Institute of Nanoscience and Nanotechnology (IN2UB), Universitat de Barcelona, 1-11 Martí i Franquès, 08028 Barcelona, Spain
| | - Sònia Estradé
- LENS-MIND, Departament d'Enginyeria Electrònica i Biomèdica, Universitat de Barcelona, 1-11 Martí i Franquès, 08028 Barcelona, Spain
- Institute of Nanoscience and Nanotechnology (IN2UB), Universitat de Barcelona, 1-11 Martí i Franquès, 08028 Barcelona, Spain
| |
Collapse
|
2
|
Del-Pozo-Bueno D, Kepaptsoglou D, Peiró F, Estradé S. Comparative of machine learning classification strategies for electron energy loss spectroscopy: Support vector machines and artificial neural networks. Ultramicroscopy 2023; 253:113828. [PMID: 37556961 DOI: 10.1016/j.ultramic.2023.113828] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2023] [Revised: 07/26/2023] [Accepted: 08/02/2023] [Indexed: 08/11/2023]
Abstract
Machine Learning (ML) strategies applied to Scanning and conventional Transmission Electron Microscopy have become a valuable tool for analyzing the large volumes of data generated by various S/TEM techniques. In this work, we focus on Electron Energy Loss Spectroscopy (EELS) and study two ML techniques for classifying spectra in detail: Support Vector Machines (SVM) and Artificial Neural Networks (ANN). Firstly, we systematically analyze the optimal configurations and architectures for ANN classifiers using random search and the tree-structured Parzen estimator methods. Secondly, a new kernel strategy is introduced for the soft-margin SVMs, the cosine kernel, which offers a significant advantage over the previously studied kernels and other ML classification strategies. This kernel allows us to bypass the normalization of EEL spectra, achieving accurate classification. This result is highly relevant for the EELS community since we also assess the impact of common normalization techniques on our spectra using Uniform Manifold Approximation and Projection (UMAP), revealing a strong bias introduced in the spectra once normalized. In order to evaluate and study both classification strategies, we focus on determining the oxidation state of transition metals through their EEL spectra, examining which feature is more suitable for oxidation state classification: the oxygen K peak or the transition metal white lines. Subsequently, we compare the resistance to energy loss shifts for both classifiers and present a strategy to improve their resistance. The results of this study suggest the use of soft-margin SVMs for simpler EELS classification tasks with a limited number of spectra, as they provide performance comparable to ANNs while requiring lower computational resources and reduced training times. Conversely, ANNs are better suited for handling complex classification problems with extensive training data.
Collapse
Affiliation(s)
- Daniel Del-Pozo-Bueno
- Departament d'Enginyeria Electrònica i Biomèdica, LENS-MIND, Universitat de Barcelona, Barcelona 08028, Spain; Institute of Nanoscience and Nanotechnology (IN2UB), Universitat de Barcelona, Barcelona 08028, Spain.
| | - Demie Kepaptsoglou
- SuperSTEM, Sci-Tech Daresbury Campus, Daresbury WA4 4AD, UK; School of Physics, Engineering and Technology, University of York, Heslington YO10 5DD, UK
| | - Francesca Peiró
- Departament d'Enginyeria Electrònica i Biomèdica, LENS-MIND, Universitat de Barcelona, Barcelona 08028, Spain; Institute of Nanoscience and Nanotechnology (IN2UB), Universitat de Barcelona, Barcelona 08028, Spain
| | - Sònia Estradé
- Departament d'Enginyeria Electrònica i Biomèdica, LENS-MIND, Universitat de Barcelona, Barcelona 08028, Spain; Institute of Nanoscience and Nanotechnology (IN2UB), Universitat de Barcelona, Barcelona 08028, Spain
| |
Collapse
|
3
|
Del-Pozo-Bueno D, Varela M, Estrader M, López-Ortega A, Roca AG, Nogués J, Peiró F, Estradé S. Direct Evidence of a Graded Magnetic Interface in Bimagnetic Core/Shell Nanoparticles Using Electron Magnetic Circular Dichroism (EMCD). Nano Lett 2021; 21:6923-6930. [PMID: 34370953 DOI: 10.1021/acs.nanolett.1c02089] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Interfaces play a crucial role in composite magnetic materials and particularly in bimagnetic core/shell nanoparticles. However, resolving the microscopic magnetic structure of these nanoparticles is rather complex. Here, we investigate the local magnetization of antiferromagnetic/ferrimagnetic FeO/Fe3O4 core/shell nanocubes by electron magnetic circular dichroism (EMCD). The electron energy-loss spectroscopy (EELS) compositional analysis of the samples shows the presence of an oxidation gradient at the interface between the FeO core and the Fe3O4 shell. The EMCD measurements show that the nanoparticles are composed of four different zones with distinct magnetic moment in a concentric, onion-type, structure. These magnetic areas correlate spatially with the oxidation and composition gradient with the magnetic moment being largest at the surface and decreasing toward the core. The results show that the combination of EELS compositional mapping and EMCD can provide very valuable information on the inner magnetic structure and its correlation to the microstructure of magnetic nanoparticles.
Collapse
Affiliation(s)
- Daniel Del-Pozo-Bueno
- LENS-MIND, Department Enginyeries Electrònica i Biomèdica, Universitat de Barcelona, Martí i Franques 1, E-08028 Barcelona, Spain
- Institute of Nanoscience and Nanotechnology of the University of Barcelona (IN2UB), Avenida Diagonal 645, E-08028 Barcelona, Spain
| | - María Varela
- Departamento de Física de Materiales e Instituto Pluridisciplinar, Universidad Complutense de Madrid (UCM), 28040 Madrid, Spain
| | - Marta Estrader
- Institute of Nanoscience and Nanotechnology of the University of Barcelona (IN2UB), Avenida Diagonal 645, E-08028 Barcelona, Spain
- Departament de Química Inorgànica i Orgànica, Universitat de Barcelona, Martí i Franques 1, E-08028 Barcelona, Spain
| | - Alberto López-Ortega
- Departamento de Ciencias, Universidad Pública de Navarra, 31006 Pamplona, Spain
- Institute for Advanced Materials and Mathematics INAMAT, Universidad Pública de Navarra, 31006 Pamplona, Spain
| | - Alejandro G Roca
- Catalan Institute of Nanoscience and Nanotechnology (ICN2), CSIC and BIST, Campus UAB, Bellaterra, 08193 Barcelona, Spain
| | - Josep Nogués
- Catalan Institute of Nanoscience and Nanotechnology (ICN2), CSIC and BIST, Campus UAB, Bellaterra, 08193 Barcelona, Spain
- ICREA, Pg. Lluís Companys 23, E-08010 Barcelona, Spain
| | - Francesca Peiró
- LENS-MIND, Department Enginyeries Electrònica i Biomèdica, Universitat de Barcelona, Martí i Franques 1, E-08028 Barcelona, Spain
- Institute of Nanoscience and Nanotechnology of the University of Barcelona (IN2UB), Avenida Diagonal 645, E-08028 Barcelona, Spain
| | - Sònia Estradé
- LENS-MIND, Department Enginyeries Electrònica i Biomèdica, Universitat de Barcelona, Martí i Franques 1, E-08028 Barcelona, Spain
- Institute of Nanoscience and Nanotechnology of the University of Barcelona (IN2UB), Avenida Diagonal 645, E-08028 Barcelona, Spain
| |
Collapse
|
4
|
Del-Pozo-Bueno D, Peiró F, Estradé S. Support vector machine for EELS oxidation state determination. Ultramicroscopy 2020; 221:113190. [PMID: 33321423 DOI: 10.1016/j.ultramic.2020.113190] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2020] [Revised: 11/03/2020] [Accepted: 12/06/2020] [Indexed: 11/26/2022]
Abstract
Electron Energy-Loss Spectroscopy (EELS) is a powerful and versatile spectroscopic technique used to study the composition and local optoelectronic properties of nanometric materials. Currently, this technique is generating large amounts of spectra per experiment, producing a huge quantity of data to analyse. Several strategies can be applied in order to classify these data to map physical properties at the nanoscale. In the present study, the Support Vector Machine (SVM) algorithm is applied to EELS, and its effectiveness identifying EEL spectra is assessed. Our results evidence the capacity of SVM to determine the oxidation state of iron and manganese in iron and manganese oxides, based on the ELNES of the white lines of the transition metal. The SVM algorithm is first trained with given datasets and then the resulting models are tested through noisy test data sets. We demonstrate that SVM exhibits a very good performance classifying these EEL spectra, despite the usual level of noise and instrumental energy shifts.
Collapse
Affiliation(s)
- D Del-Pozo-Bueno
- LENS-MIND, Dept. Enginyeries Electrònica i Biomèdica, Universitat de Barcelona, Martí i Franquès 1, E-08028 Barcelona, Spain; Institute of Nanoscience and Nanotechnology (IN2UB), Universitat de Barcelona (UB), E-08028 Barcelona, Spain.
| | - F Peiró
- LENS-MIND, Dept. Enginyeries Electrònica i Biomèdica, Universitat de Barcelona, Martí i Franquès 1, E-08028 Barcelona, Spain; Institute of Nanoscience and Nanotechnology (IN2UB), Universitat de Barcelona (UB), E-08028 Barcelona, Spain
| | - S Estradé
- LENS-MIND, Dept. Enginyeries Electrònica i Biomèdica, Universitat de Barcelona, Martí i Franquès 1, E-08028 Barcelona, Spain; Institute of Nanoscience and Nanotechnology (IN2UB), Universitat de Barcelona (UB), E-08028 Barcelona, Spain
| |
Collapse
|
5
|
Muro-Cruces J, Roca AG, López-Ortega A, Fantechi E, Del-Pozo-Bueno D, Estradé S, Peiró F, Sepúlveda B, Pineider F, Sangregorio C, Nogues J. Precise Size Control of the Growth of Fe 3O 4 Nanocubes over a Wide Size Range Using a Rationally Designed One-Pot Synthesis. ACS Nano 2019; 13:7716-7728. [PMID: 31173684 DOI: 10.1021/acsnano.9b01281] [Citation(s) in RCA: 43] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
The physicochemical properties of spinel oxide magnetic nanoparticles depend critically on both their size and shape. In particular, spinel oxide nanocrystals with cubic morphology have shown superior properties in comparison to their spherical counterparts in a variety of fields, like, for example, biomedicine. Therefore, having an accurate control over the nanoparticle shape and size, while preserving the crystallinity, becomes crucial for many applications. However, despite the increasing interest in spinel oxide nanocubes there are relatively few studies on this morphology due to the difficulty to synthesize perfectly defined cubic nanostructures, especially below 20 nm. Here we present a rationally designed synthesis pathway based on the thermal decomposition of iron(III) acetylacetonate to obtain high quality nanocubes over a wide range of sizes. This pathway enables the synthesis of monodisperse Fe3O4 nanocubes with edge length in the 9-80 nm range, with excellent cubic morphology and high crystallinity by only minor adjustments in the synthesis parameters. The accurate size control provides evidence that even 1-2 nm size variations can be critical in determining the functional properties, for example, for improved nuclear magnetic resonance T2 contrast or enhanced magnetic hyperthermia. The rationale behind the changes introduced in the synthesis procedure (e.g., the use of three solvents or adding Na-oleate) is carefully discussed. The versatility of this synthesis route is demonstrated by expanding its capability to grow other spinel oxides such as Co-ferrites, Mn-ferrites, and Mn3O4 of different sizes. The simplicity and adaptability of this synthesis scheme may ease the development of complex oxide nanocubes for a wide variety of applications.
Collapse
Affiliation(s)
- Javier Muro-Cruces
- Catalan Institute of Nanoscience and Nanotechnology (ICN2), CSIC and BIST , Campus UAB , Bellaterra , 08193 Barcelona , Spain
- Universitat Autònoma de Barcelona , 08193 Bellaterra , Spain
| | - Alejandro G Roca
- Catalan Institute of Nanoscience and Nanotechnology (ICN2), CSIC and BIST , Campus UAB , Bellaterra , 08193 Barcelona , Spain
| | - Alberto López-Ortega
- Instituto de Nanociencia, Nanotecnología y Materiales Moleculares and Depto. de Física Aplicada , Universidad de Castilla-La Mancha , Campus de la Fábrica de Armas , 45071 Toledo , Spain
| | - Elvira Fantechi
- Dipartimento di Chimica e Chimica Industriale and INSTM , University of Pisa , Via G. Moruzzi 13 , 56124 Pisa , Italy
| | - Daniel Del-Pozo-Bueno
- LENS-MIND-IN2UB, Dept. Enginyeries Electrònica i Biomèdica , Universitat de Barcelona , Martí i Franquès 1 , E-08028 Barcelona , Spain
| | - Sònia Estradé
- LENS-MIND-IN2UB, Dept. Enginyeries Electrònica i Biomèdica , Universitat de Barcelona , Martí i Franquès 1 , E-08028 Barcelona , Spain
| | - Francesca Peiró
- LENS-MIND-IN2UB, Dept. Enginyeries Electrònica i Biomèdica , Universitat de Barcelona , Martí i Franquès 1 , E-08028 Barcelona , Spain
| | - Borja Sepúlveda
- Catalan Institute of Nanoscience and Nanotechnology (ICN2), CSIC and BIST , Campus UAB , Bellaterra , 08193 Barcelona , Spain
| | - Francesco Pineider
- Dipartimento di Chimica e Chimica Industriale and INSTM , University of Pisa , Via G. Moruzzi 13 , 56124 Pisa , Italy
| | - Claudio Sangregorio
- Dipartimento di Chimica and INSTM , Università degli studi di Firenze , Via della Lastruccia 3 , Sesto Fiorentino (FI) I-50019 , Italy
- ICCOM-CNR , Via Madonna del Piano, 10 , Sesto Fiorentino (FI) I-50019 , Italy
| | - Josep Nogues
- Catalan Institute of Nanoscience and Nanotechnology (ICN2), CSIC and BIST , Campus UAB , Bellaterra , 08193 Barcelona , Spain
- ICREA , Pg. Lluís Companys 23 , 08010 Barcelona , Spain
| |
Collapse
|