A new active learning approach for global optimization of atomic clusters

Active-learning for global optimization of Ni-Ceria nanoparticles: The case of Ce4-xNixO8- x (x = 1, 2, 3)

Ni-CeO2 nanoparticles (NPs) are promising nanocatalysts for water splitting and water gas shift reactions due to the ability of ceria to temporarily donate oxygen to the catalytic reaction and accept oxygen after the reaction is completed. Therefore, elucidating how different properties of the Ni-Ceria NPs relate to the activity and selectivity of the catalytic reaction, is of crucial importance for the development of novel catalysts. In this work the active learning (AL) method based on machine learning regression and its uncertainty is used for the global optimization of Ce(4-x)NixO(8-x) (x = 1, 2, 3) nanoparticles, employing density functional theory calculations. Additionally, further investigation of the NPs by mass-scaled parallel-tempering Born-Oppenheimer molecular dynamics resulted in the same putative global minimum structures found by AL, demonstrating the robustness of our AL search to learn from small datasets and assist in the global optimization of complex electronic structure systems.

Reinforcement learning for in silico determination of adsorbate-substrate structures

Reinforcement learning (RL) methods have helped to define the state of the art in the field of modern artificial intelligence, mostly after the breakthrough involving AlphaGo and the discovery of novel algorithms. In this work, we present a RL method, based on Q-learning, for the structural determination of adsorbate@substrate models in silico, where the minimization of the energy landscape resulting from adsorbate interactions with a substrate is made by actions on states (translations and rotations) chosen from an agent's policy. The proposed RL method is implemented in an early version of the reinforcement learning software for materials design and discovery (RLMaterial), developed in Python3.x. RLMaterial interfaces with deMon2k, DFTB+, ORCA, and Quantum Espresso codes to compute the adsorbate@substrate energies. The RL method was applied for the structural determination of (i) the amino acid glycine and (ii) 2-amino-acetaldehyde, both interacting with a boron nitride (BN) monolayer, (iii) host-guest interactions between phenylboronic acid and β-cyclodextrin and (iv) ammonia on naphthalene. Density functional tight binding calculations were used to build the complex search surfaces with a reasonably low computational cost for systems (i)-(iii) and DFT for system (iv). Artificial neural network and gradient boosting regression techniques were employed to approximate the Q-matrix or Q-table for better decision making (policy) on next actions. Finally, we have developed a transfer-learning protocol within the RL framework that allows learning from one chemical system and transferring the experience to another, as well as from different DFT or DFTB levels.

How important is the amount of exact exchange for spin-state energy ordering in DFT? Case study of molybdenum carbide cluster, Mo4C2

Since the form of the exact functional in density functional theory is unknown, we must rely on density functional approximations (DFAs). In the past, very promising results have been reported by combining semi-local DFAs with exact, i.e. Hartree-Fock, exchange. However, the spin-state energy ordering and the predictions of global minima structures are particularly sensitive to the choice of the hybrid functional and to the amount of exact exchange. This has been already qualitatively described for single conformations, reactions, and a limited number of conformations. Here, we have analyzed the mixing of exact exchange in exchange functionals for a set of several hundred isomers of the transition metal carbide, Mo4C2. The analysis of the calculated energies and charges using PBE0-type functional with varying amounts of exact exchange yields the following insights: (1) The sensitivity of spin-energy splitting is strongly correlated with the amount of exact exchange mixing. (2) Spin contamination is exacerbated when correlation is omitted from the exchange-correlation functional. (3) There is not one ideal value for the exact exchange mixing which can be used to parametrize or choose among the functionals. Calculated energies and electronic structures are influenced by exact exchange at a different magnitude within a given distribution; therefore, to extend the application range of hybrid functionals to the full periodic table the spin-energy splitting energies should be investigated.

QMLMaterial─A Quantum Machine Learning Software for Material Design and Discovery

Structural elucidation of chemical compounds is challenging experimentally, and theoretical chemistry methods have added important insight into molecules, nanoparticles, alloys, and materials geometries and properties. However, finding the optimum structures is a bottleneck due to the huge search space, and global search algorithms have been used successfully for this purpose. In this work, we present the quantum machine learning software/agent for materials design and discovery (QMLMaterial), intended for automatic structural determination in silico for several chemical systems: atomic clusters, atomic clusters and the spin multiplicity together, doping in clusters or solids, vacancies in clusters or solids, adsorption of molecules or adsorbents on surfaces, and finally atomic clusters on solid surfaces/materials or encapsulated in porous materials. QMLMaterial is an artificial intelligence (AI) software based on the active learning method, which uses machine learning regression algorithms and their uncertainties for decision making on the next unexplored structures to be computed, increasing the probability of finding the global minimum with few calculations as more data is obtained. The software has different acquisition functions for decision making (e.g., expected improvement and lower confidence bound). Also, the Gaussian process is available in the AI framework for regression, where the uncertainty is obtained analytically from Bayesian statistics. For the artificial neural network and support vector regressor algorithms, the uncertainty can be obtained by K-fold cross-validation or nonparametric bootstrap resampling methods. The software is interfaced with several quantum chemistry codes and atomic descriptors, such as the many-body tensor representation. QMLMaterial's capabilities are highlighted in the current work by its applications in the following systems: Na20, Mo6C3 (where the spin multiplicity was considered), H2O@CeNi3O5, Mg8@graphene, Na3Mg3@CNT (carbon nanotube).

GAMaterial-A genetic-algorithm software for material design and discovery

Genetic algorithms (GAs) are stochastic global search methods inspired by biological evolution. They have been used extensively in chemistry and materials science coupled with theoretical methods, ranging from force-fields to high-throughput first-principles methods. The methodology allows an accurate and automated structural determination for molecules, atomic clusters, nanoparticles, and solid surfaces, fundamental to understanding chemical processes in catalysis and environmental sciences, for instance. In this work, we propose a new genetic algorithm software, GAMaterial, implemented in Python3.x, that performs global searches to elucidate the structures of atomic clusters, doped clusters or materials and atomic clusters on surfaces. For all these applications, it is possible to accelerate the GA search by using machine learning (ML), the ML@GA method, to build subsequent populations. Results for ML@GA applied for the dopant distributions in atomic clusters are presented. The GAMaterial software was applied for the automatic structural search for the Ti₆ O₁₂ cluster, doping Al in Si₁₁ (4Al@Si₁₁ ) and Na₁₀ supported on graphene (Na₁₀ @graphene), where DFTB calculations were used to sample the complex search surfaces with reasonably low computational cost. Finally, the global search by GA of the Mo₈ C₄ cluster was considered, where DFT calculations were made with the deMon2k code, which is interfaced with GAMaterial.

A new active learning approach for adsorbate-substrate structural elucidation in silico

Adsorbate interactions with substrates (e.g. surfaces and nanoparticles) are fundamental for several technologies, such as functional materials, supramolecular chemistry, and solvent interactions. However, modeling these kinds of systems in silico, such as finding the optimum adsorption geometry and energy, is challenging, due to the huge number of possibilities of assembling the adsorbate on the surface. In the current work, we have developed an artificial intelligence (AI) approach based on an active learning (AL) method for adsorption optimization on the surface of materials. AL uses machine learning (ML) regression algorithms and their uncertainties to make a decision (based on a policy) for the next unexplored structures to be computed, increasing, though, the probability of finding the global minimum with a small number of calculations. The methodology allows an accurate and automated structural elucidation of the adsorbate on the surface, based on the minimization of the total electronic energy. The new AL method for adsorption optimization was developed and implemented in the quantum machine learning software/agent for material design and discovery (QMLMaterial) program and was applied for C₆₀@TiO₂ anatase (101). It marks another software extension with a new feature in addition to the automatic structural elucidation of defects in materials and of nanoparticles as well. SCC-DFTB calculations were used to build the complex search surfaces with a reasonably low computational cost. An artificial neural network (NN) was employed in the AL framework evaluated together with two uncertainty quantification methods: K-fold cross-validation and non-parametric bootstrap (BS) resampling. Also, two different acquisition functions for decision-making were used: expected improvement (EI) and the lower confidence bound (LCB).

Multiscale molecular modelling: from electronic structure to dynamics of nanosystems and beyond

Important contemporary biological and materials problems often depend on interactions that span orders of magnitude differences in spatial and temporal dimensions. This Tutorial Review attempts to provide an introduction to such fascinating problems through a series of case studies, aimed at beginning researchers, graduate students, postdocs and more senior colleagues who are changing direction to focus on multiscale aspects of their research. The choice of specific examples is highly personal, with examples either chosen from our own work or outstanding multiscale efforts from the literature. I start with various embedding schemes, as exemplified by polarizable continuum models, 3-D RISM, molecular DFT and frozen-density embedding. Next, QM/MM (quantum mechanical/molecular mechanical) techniques are the workhorse of pm-to-nm/ps-to-ns simulations; examples are drawn from enzymes and from nanocatalysis for oil-sands upgrading. Using polarizable force-fields in the QM/MM framework represents a burgeoning subfield; with examples from ion channels and electron dynamics in molecules subject to strong external fields, probing the atto-second dynamics of the electrons with RT-TDDFT (real-time - time-dependent density functional theory) eventually coupled with nuclear motion through the Ehrenfest approximation. This is followed by a section on coarse graining, bridging dimensions from atoms to cells. The penultimate chapter gives a quick overview of multiscale approaches that extend into the meso- and macro-scales, building on atomistic and coarse-grained techniques to enter the world of materials engineering, on the one hand, and cell biology, on the other. A final chapter gives just a glimpse of the burgeoning impact of machine learning on the structure-dynamics front. I aim to capture the excitement of contemporary leading-edge breakthroughs in the description of physico-chemical systems and processes in complex environments, with only enough historical content to provide context and aid the next generation of methodological development. While I aim also for a clear description of the essence of methodological breakthroughs, equations are kept to a minimum and detailed formalism and implementation details are left to the references. My approach is very selective (case studies) rather than exhaustive. I think that these case studies should provide fodder to build as complete a reference tree on multiscale modelling as the reader may wish, through forward and backward citation analysis. I hope that my choices of cases will excite interest in newcomers and help to fuel the growth of multiscale modelling in general.

Automatic structural elucidation of vacancies in materials by active learning

The artificial intelligence method based on active learning for the automatic structural elucidation of vacancies in materials. This is implemented in the quantum machine learning software/agent for material design and discovery (QMLMaterial).