1
|
Zhang Y, Cheng L, Pan A, Hu C, Wu K. Phase Transformation Temperature Prediction in Steels via Machine Learning. MATERIALS (BASEL, SWITZERLAND) 2024; 17:1117. [PMID: 38473589 DOI: 10.3390/ma17051117] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/13/2024] [Revised: 02/15/2024] [Accepted: 02/19/2024] [Indexed: 03/14/2024]
Abstract
The phase transformation temperature plays an important role in the design, production and heat treatment process of steels. In the present work, an improved version of the gradient-boosting method LightGBM has been utilized to study the influencing factors of the four phase transformation temperatures, namely Ac1, Ac3, the martensite transformation start (MS) temperature and the bainitic transformation start (BS) temperature. The effects of the alloying element were discussed in detail by comparing their influencing mechanisms on different phase transformation temperatures. The training accuracy was significantly improved by further introducing appropriate features related to atomic parameters. The melting temperature and coefficient of linear thermal expansion of the pure metals corresponding to the alloying elements, atomic Waber-Cromer pseudopotential radii and valence electron number were the top four among the eighteen atomic parameters used to improve the trained model performance. The training and prediction processes were analyzed using a partial dependence plot (PDP) and Shapley additive explanation (SHAP) methods to reveal the relationships between the features and phase transformation temperature.
Collapse
Affiliation(s)
- Yupeng Zhang
- The State Key Laboratory of Refractories and Metallurgy, Hubei Province Key Laboratory of Systems Science on Metallurgical Processing, International Research Institute for Steel Technology, Collaborative Center on Advanced Steels, Wuhan University of Science and Technology, Wuhan 430081, China
| | - Lin Cheng
- The State Key Laboratory of Refractories and Metallurgy, Hubei Province Key Laboratory of Systems Science on Metallurgical Processing, International Research Institute for Steel Technology, Collaborative Center on Advanced Steels, Wuhan University of Science and Technology, Wuhan 430081, China
| | - Aonan Pan
- The State Key Laboratory of Refractories and Metallurgy, Hubei Province Key Laboratory of Systems Science on Metallurgical Processing, International Research Institute for Steel Technology, Collaborative Center on Advanced Steels, Wuhan University of Science and Technology, Wuhan 430081, China
| | - Chengyang Hu
- The State Key Laboratory of Refractories and Metallurgy, Hubei Province Key Laboratory of Systems Science on Metallurgical Processing, International Research Institute for Steel Technology, Collaborative Center on Advanced Steels, Wuhan University of Science and Technology, Wuhan 430081, China
| | - Kaiming Wu
- The State Key Laboratory of Refractories and Metallurgy, Hubei Province Key Laboratory of Systems Science on Metallurgical Processing, International Research Institute for Steel Technology, Collaborative Center on Advanced Steels, Wuhan University of Science and Technology, Wuhan 430081, China
| |
Collapse
|
2
|
Kong JF, Ren Y, Tey MSN, Ho P, Khoo KH, Chen X, Soumyanarayanan A. Quantifying the Magnetic Interactions Governing Chiral Spin Textures Using Deep Neural Networks. ACS APPLIED MATERIALS & INTERFACES 2024; 16:1025-1032. [PMID: 38156820 DOI: 10.1021/acsami.3c12655] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/03/2024]
Abstract
The interplay of magnetic interactions in chiral multilayer films gives rise to nanoscale topological spin textures that form attractive elements for next-generation computing. Quantifying these interactions requires several specialized, time-consuming, and resource-intensive experimental techniques. Imaging of ambient domain configurations presents a promising avenue for high-throughput extraction of parent magnetic interactions. Here, we present a machine learning (ML)-based approach to simultaneously determine the key magnetic interactions─symmetric exchange, chiral exchange, and anisotropy─governing the chiral domain phenomenology in multilayers, using a single binarized image of domain configurations. Our convolutional neural network model, trained and validated on over 10,000 domain images, achieved R2 > 0.85 in predicting the parameters and independently learned the physical interdependencies between magnetic parameters. When applied to microscopy data acquired across samples, our model-predicted parameter trends are consistent with those of independent experimental measurements. These results establish ML-driven techniques as valuable, high-throughput complements to conventional determination of magnetic interactions and serve to accelerate materials and device development for nanoscale electronics.
Collapse
Affiliation(s)
- Jian Feng Kong
- Agency for Science, Technology & Research (A*STAR), Institute of High Performance Computing, Singapore 138632, Singapore
| | - Yuhua Ren
- Department of Physics, National University of Singapore, Singapore 117551, Singapore
| | - M S Nicholas Tey
- Agency for Science, Technology & Research (A*STAR), Institute of Materials Research & Engineering, Singapore 138634, Singapore
| | - Pin Ho
- Agency for Science, Technology & Research (A*STAR), Institute of Materials Research & Engineering, Singapore 138634, Singapore
| | - Khoong Hong Khoo
- Agency for Science, Technology & Research (A*STAR), Institute of High Performance Computing, Singapore 138632, Singapore
| | - Xiaoye Chen
- Agency for Science, Technology & Research (A*STAR), Institute of Materials Research & Engineering, Singapore 138634, Singapore
| | - Anjan Soumyanarayanan
- Department of Physics, National University of Singapore, Singapore 117551, Singapore
| |
Collapse
|
3
|
Gu A, Cincio L, Coles PJ. Practical Hamiltonian learning with unitary dynamics and Gibbs states. Nat Commun 2024; 15:312. [PMID: 38191523 PMCID: PMC10774402 DOI: 10.1038/s41467-023-44008-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2022] [Accepted: 11/24/2023] [Indexed: 01/10/2024] Open
Abstract
We study the problem of learning the parameters for the Hamiltonian of a quantum many-body system, given limited access to the system. In this work, we build upon recent approaches to Hamiltonian learning via derivative estimation. We propose a protocol that improves the scaling dependence of prior works, particularly with respect to parameters relating to the structure of the Hamiltonian (e.g., its locality k). Furthermore, by deriving exact bounds on the performance of our protocol, we are able to provide a precise numerical prescription for theoretically optimal settings of hyperparameters in our learning protocol, such as the maximum evolution time (when learning with unitary dynamics) or minimum temperature (when learning with Gibbs states). Thanks to these improvements, our protocol has practical scaling for large problems: we demonstrate this with a numerical simulation of our protocol on an 80-qubit system.
Collapse
Affiliation(s)
- Andi Gu
- Department of Physics, University of California, Berkeley, Berkeley, CA, USA.
- Harvard Quantum Initiative, Harvard University, Cambridge, MA, 02138, USA.
- Theoretical Division, Los Alamos National Laboratory, Los Alamos, NM, 87545, USA.
| | - Lukasz Cincio
- Theoretical Division, Los Alamos National Laboratory, Los Alamos, NM, 87545, USA
| | - Patrick J Coles
- Theoretical Division, Los Alamos National Laboratory, Los Alamos, NM, 87545, USA
- Normal Computing Corporation, New York, NY, USA
| |
Collapse
|
4
|
Tian Z, Zhang S, Chern GW. Machine learning for structure-property mapping of Ising models: Scalability and limitations. Phys Rev E 2023; 108:065304. [PMID: 38243546 DOI: 10.1103/physreve.108.065304] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Accepted: 11/27/2023] [Indexed: 01/21/2024]
Abstract
We present a scalable machine learning (ML) framework for predicting intensive properties and particularly classifying phases of Ising models. Scalability and transferability are central to the unprecedented computational efficiency of ML methods. In general, linear-scaling computation can be achieved through the divide-and-conquer approach, and the locality of physical properties is key to partitioning the system into subdomains that can be solved separately. Based on the locality assumption, ML model is developed for the prediction of intensive properties of a finite-size block. Predictions of large-scale systems can then be obtained by averaging results of the ML model from randomly sampled blocks of the system. We show that the applicability of this approach depends on whether the block-size of the ML model is greater than the characteristic length scale of the system. In particular, in the case of phase identification across a critical point, the accuracy of the ML prediction is limited by the diverging correlation length. We obtain an intriguing scaling relation between the prediction accuracy and the ratio of ML block size over the spin-spin correlation length. Implications for practical applications are also discussed. While the two-dimensional Ising model is used to demonstrate the proposed approach, the ML framework can be generalized to other many-body or condensed-matter systems.
Collapse
Affiliation(s)
- Zhongzheng Tian
- Department of Physics, University of Virginia, Charlottesville, Virginia 22904, USA
| | - Sheng Zhang
- Department of Physics, University of Virginia, Charlottesville, Virginia 22904, USA
| | - Gia-Wei Chern
- Department of Physics, University of Virginia, Charlottesville, Virginia 22904, USA
| |
Collapse
|
5
|
Huang HY, Tong Y, Fang D, Su Y. Learning Many-Body Hamiltonians with Heisenberg-Limited Scaling. PHYSICAL REVIEW LETTERS 2023; 130:200403. [PMID: 37267566 DOI: 10.1103/physrevlett.130.200403] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/03/2022] [Accepted: 04/18/2023] [Indexed: 06/04/2023]
Abstract
Learning a many-body Hamiltonian from its dynamics is a fundamental problem in physics. In this Letter, we propose the first algorithm to achieve the Heisenberg limit for learning an interacting N-qubit local Hamiltonian. After a total evolution time of O(ε^{-1}), the proposed algorithm can efficiently estimate any parameter in the N-qubit Hamiltonian to ε error with high probability. Our algorithm uses ideas from quantum simulation to decouple the unknown N-qubit Hamiltonian H into noninteracting patches and learns H using a quantum-enhanced divide-and-conquer approach. The proposed algorithm is robust against state preparation and measurement error, does not require eigenstates or thermal states, and only uses polylog(ε^{-1}) experiments. In contrast, the best existing algorithms require O(ε^{-2}) experiments and total evolution time. We prove a matching lower bound to establish the asymptotic optimality of our algorithm.
Collapse
Affiliation(s)
- Hsin-Yuan Huang
- Institute for Quantum Information and Matter, California Institute of Technology, Pasadena, California 91125, USA
| | - Yu Tong
- Institute for Quantum Information and Matter, California Institute of Technology, Pasadena, California 91125, USA
- Department of Mathematics, University of California, Berkeley, California 94720, USA
| | - Di Fang
- Department of Mathematics, University of California, Berkeley, California 94720, USA
- Simons Institute for the Theory of Computing, University of California, Berkeley, California 94720, USA
| | - Yuan Su
- Microsoft Quantum, Redmond, Washington 98052, USA
| |
Collapse
|
6
|
Chen X, Araujo FA, Riou M, Torrejon J, Ravelosona D, Kang W, Zhao W, Grollier J, Querlioz D. Forecasting the outcome of spintronic experiments with Neural Ordinary Differential Equations. Nat Commun 2022; 13:1016. [PMID: 35197449 PMCID: PMC8866480 DOI: 10.1038/s41467-022-28571-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2021] [Accepted: 01/19/2022] [Indexed: 11/09/2022] Open
Abstract
Deep learning has an increasing impact to assist research, allowing, for example, the discovery of novel materials. Until now, however, these artificial intelligence techniques have fallen short of discovering the full differential equation of an experimental physical system. Here we show that a dynamical neural network, trained on a minimal amount of data, can predict the behavior of spintronic devices with high accuracy and an extremely efficient simulation time, compared to the micromagnetic simulations that are usually employed to model them. For this purpose, we re-frame the formalism of Neural Ordinary Differential Equations to the constraints of spintronics: few measured outputs, multiple inputs and internal parameters. We demonstrate with Neural Ordinary Differential Equations an acceleration factor over 200 compared to micromagnetic simulations for a complex problem - the simulation of a reservoir computer made of magnetic skyrmions (20 minutes compared to three days). In a second realization, we show that we can predict the noisy response of experimental spintronic nano-oscillators to varying inputs after training Neural Ordinary Differential Equations on five milliseconds of their measured response to a different set of inputs. Neural Ordinary Differential Equations can therefore constitute a disruptive tool for developing spintronic applications in complement to micromagnetic simulations, which are time-consuming and cannot fit experiments when noise or imperfections are present. Our approach can also be generalized to other electronic devices involving dynamics.
Collapse
Affiliation(s)
- Xing Chen
- Fert Beijing Institute, MIIT Key Laboratory of Spintronics, School of Integrated Circuit Science and Engineering, Beihang University, 100191, Beijing, China
- Université Paris-Saclay, CNRS, Centre de Nanosciences et de Nanotechnologies, Palaiseau, France
| | - Flavio Abreu Araujo
- Institute of Condensed Matter and Nanosciences, Université catholique de Louvain, Place Croix du Sud 1, Louvain-la-Neuve, 1348, Belgium
- Unité Mixte de Physique, CNRS, Thales, Université Paris-Saclay, Palaiseau, France
| | - Mathieu Riou
- Unité Mixte de Physique, CNRS, Thales, Université Paris-Saclay, Palaiseau, France
| | - Jacob Torrejon
- Unité Mixte de Physique, CNRS, Thales, Université Paris-Saclay, Palaiseau, France
| | - Dafiné Ravelosona
- Université Paris-Saclay, CNRS, Centre de Nanosciences et de Nanotechnologies, Palaiseau, France
| | - Wang Kang
- Fert Beijing Institute, MIIT Key Laboratory of Spintronics, School of Integrated Circuit Science and Engineering, Beihang University, 100191, Beijing, China
| | - Weisheng Zhao
- Fert Beijing Institute, MIIT Key Laboratory of Spintronics, School of Integrated Circuit Science and Engineering, Beihang University, 100191, Beijing, China
| | - Julie Grollier
- Unité Mixte de Physique, CNRS, Thales, Université Paris-Saclay, Palaiseau, France
| | - Damien Querlioz
- Université Paris-Saclay, CNRS, Centre de Nanosciences et de Nanotechnologies, Palaiseau, France.
| |
Collapse
|
7
|
Lu S, Zhou Q, Guo Y, Wang J. On-the-fly interpretable machine learning for rapid discovery of two-dimensional ferromagnets with high Curie temperature. Chem 2021. [DOI: 10.1016/j.chempr.2021.11.009] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/30/2023]
|
8
|
Lee DB, Yoon HG, Park SM, Choi JW, Kwon HY, Won C. Estimating the effective fields of spin configurations using a deep learning technique. Sci Rep 2021; 11:22937. [PMID: 34824339 PMCID: PMC8616938 DOI: 10.1038/s41598-021-02374-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2021] [Accepted: 11/15/2021] [Indexed: 11/09/2022] Open
Abstract
The properties of complicated magnetic domain structures induced by various spin-spin interactions in magnetic systems have been extensively investigated in recent years. To understand the statistical and dynamic properties of complex magnetic structures, it is crucial to obtain information on the effective field distribution over the structure, which is not directly provided by magnetization. In this study, we use a deep learning technique to estimate the effective fields of spin configurations. We construct a deep neural network and train it with spin configuration datasets generated by Monte Carlo simulation. We show that the trained network can successfully estimate the magnetic effective field even though we do not offer explicit Hamiltonian parameter values. The estimated effective field information is highly applicable; it is utilized to reduce noise, correct defects in the magnetization data, generate spin configurations, estimate external field responses, and interpret experimental images.
Collapse
Affiliation(s)
- D B Lee
- Department of Physics, Kyung Hee University, Seoul, 02447, South Korea
| | - H G Yoon
- Department of Physics, Kyung Hee University, Seoul, 02447, South Korea
| | - S M Park
- Department of Physics, Kyung Hee University, Seoul, 02447, South Korea
| | - J W Choi
- Center for Spintronics, Korea Institute of Science and Technology, Seoul, 02792, South Korea
| | - H Y Kwon
- Center for Spintronics, Korea Institute of Science and Technology, Seoul, 02792, South Korea.
| | - C Won
- Department of Physics, Kyung Hee University, Seoul, 02447, South Korea.
| |
Collapse
|
9
|
Suh Y, Lee J, Simadiris P, Yan X, Sett S, Li L, Rabbi KF, Miljkovic N, Won Y. A Deep Learning Perspective on Dropwise Condensation. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2021; 8:e2101794. [PMID: 34561960 PMCID: PMC8596129 DOI: 10.1002/advs.202101794] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/29/2021] [Revised: 07/14/2021] [Indexed: 05/29/2023]
Abstract
Condensation is ubiquitous in nature and industry. Heterogeneous condensation on surfaces is typified by the continuous cycle of droplet nucleation, growth, and departure. Central to the mechanistic understanding of the thermofluidic processes governing condensation is the rapid and high-fidelity extraction of interpretable physical descriptors from the highly transient droplet population. However, extracting quantifiable measures out of dynamic objects with conventional imaging technologies poses a challenge to researchers. Here, an intelligent vision-based framework is demonstrated that unites classical thermofluidic imaging techniques with deep learning to fundamentally address this challenge. The deep learning framework can autonomously harness physical descriptors and quantify thermal performance at extreme spatio-temporal resolutions of 300 nm and 200 ms, respectively. The data-centric analysis conclusively shows that contrary to classical understanding, the overall condensation performance is governed by a key tradeoff between heat transfer rate per individual droplet and droplet population density. The vision-based approach presents a powerful tool for the study of not only phase-change processes but also any nucleation-based process within and beyond the thermal science community through the harnessing of big data.
Collapse
Affiliation(s)
- Youngjoon Suh
- Department of Mechanical and Aerospace EngineeringUniversity of California, Irvine5200 Engineering HallIrvineCA92617–2700USA
| | - Jonggyu Lee
- Department of Mechanical and Aerospace EngineeringUniversity of California, Irvine5200 Engineering HallIrvineCA92617–2700USA
| | - Peter Simadiris
- Department of Mechanical and Aerospace EngineeringUniversity of California, Irvine5200 Engineering HallIrvineCA92617–2700USA
| | - Xiao Yan
- Department of Mechanical Science and EngineeringUniversity of Illinois at Urbana‐ChampaignUrbanaIL61801USA
| | - Soumyadip Sett
- Department of Mechanical Science and EngineeringUniversity of Illinois at Urbana‐ChampaignUrbanaIL61801USA
| | - Longnan Li
- Department of Mechanical Science and EngineeringUniversity of Illinois at Urbana‐ChampaignUrbanaIL61801USA
| | - Kazi Fazle Rabbi
- Department of Mechanical Science and EngineeringUniversity of Illinois at Urbana‐ChampaignUrbanaIL61801USA
| | - Nenad Miljkovic
- Department of Mechanical Science and EngineeringUniversity of Illinois at Urbana‐ChampaignUrbanaIL61801USA
- Department of Electrical and Computer EngineeringUniversity of Illinois at Urbana‐ChampaignUrbanaIL61801USA
- Materials Research LaboratoryUniversity of Illinois at Urbana‐ChampaignUrbanaIL61801USA
- International Institute for Carbon Neutral Energy Research (WPI‐12CNER)Kyushu University744 Moto‐oka, Nishi‐kuFukuoka819‐0395Japan
| | - Yoonjin Won
- Department of Mechanical and Aerospace EngineeringUniversity of California, Irvine5200 Engineering HallIrvineCA92617–2700USA
| |
Collapse
|
10
|
Kwon HY, Yoon HG, Park SM, Lee DB, Choi JW, Won C. Magnetic State Generation using Hamiltonian Guided Variational Autoencoder with Spin Structure Stabilization. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2021; 8:e2004795. [PMID: 34105288 PMCID: PMC8188203 DOI: 10.1002/advs.202004795] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/12/2020] [Revised: 01/30/2021] [Indexed: 05/15/2023]
Abstract
Numerical generation of physical states is essential to all scientific research fields. The role of a numerical generator is not limited to understanding experimental results; it can also be employed to predict or investigate characteristics of uncharted systems. A variational autoencoder model is devised and applied to a magnetic system to generate energetically stable magnetic states with low local deformation. The spin structure stabilization is made possible by taking the explicit magnetic Hamiltonian into account to minimize energy in the training process. A significant advantage of the model is that the generator can create a long-range ordered ground state of spin configuration by increasing the role of stabilization even if the ground states are not necessarily included in the training process. It is expected that the proposed Hamiltonian-guided generative model can bring about great advances in numerical approaches used in various scientific research fields.
Collapse
Affiliation(s)
- Hee Young Kwon
- Center for SpintronicsKorea Institute of Science and TechnologySeoul02792South Korea
| | - Han Gyu Yoon
- Department of PhysicsKyung Hee UniversitySeoul02447South Korea
| | - Sung Min Park
- Department of PhysicsKyung Hee UniversitySeoul02447South Korea
| | - Doo Bong Lee
- Department of PhysicsKyung Hee UniversitySeoul02447South Korea
| | - Jun Woo Choi
- Center for SpintronicsKorea Institute of Science and TechnologySeoul02792South Korea
| | - Changyeon Won
- Department of PhysicsKyung Hee UniversitySeoul02447South Korea
| |
Collapse
|