1
|
Larocca M, Ju N, García-Martín D, Coles PJ, Cerezo M. Theory of overparametrization in quantum neural networks. NATURE COMPUTATIONAL SCIENCE 2023; 3:542-551. [PMID: 38177434 DOI: 10.1038/s43588-023-00467-6] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/11/2022] [Accepted: 05/12/2023] [Indexed: 01/06/2024]
Abstract
The prospect of achieving quantum advantage with quantum neural networks (QNNs) is exciting. Understanding how QNN properties (for example, the number of parameters M) affect the loss landscape is crucial to designing scalable QNN architectures. Here we rigorously analyze the overparametrization phenomenon in QNNs, defining overparametrization as the regime where the QNN has more than a critical number of parameters Mc allowing it to explore all relevant directions in state space. Our main results show that the dimension of the Lie algebra obtained from the generators of the QNN is an upper bound for Mc, and for the maximal rank that the quantum Fisher information and Hessian matrices can reach. Underparametrized QNNs have spurious local minima in the loss landscape that start disappearing when M ≥ Mc. Thus, the overparametrization onset corresponds to a computational phase transition where the QNN trainability is greatly improved. We then connect the notion of overparametrization to the QNN capacity, so that when a QNN is overparametrized, its capacity achieves its maximum possible value.
Collapse
Affiliation(s)
- Martín Larocca
- Theoretical Division, Los Alamos National Laboratory, Los Alamos, NM, USA.
- Departamento de Física 'J. J. Giambiagi' and IFIBA, FCEyN, Universidad de Buenos Aires, Buenos Aires, Argentina.
| | - Nathan Ju
- Theoretical Division, Los Alamos National Laboratory, Los Alamos, NM, USA
| | - Diego García-Martín
- Theoretical Division, Los Alamos National Laboratory, Los Alamos, NM, USA
- Barcelona Supercomputing Center, Barcelona, Spain
- Instituto de Física Teórica, UAM-CSIC, Madrid, Spain
| | - Patrick J Coles
- Theoretical Division, Los Alamos National Laboratory, Los Alamos, NM, USA
| | - Marco Cerezo
- Theoretical Division, Los Alamos National Laboratory, Los Alamos, NM, USA
- Information Sciences, Los Alamos National Laboratory, Los Alamos, NM, USA
- Center for Nonlinear Studies, Los Alamos National Laboratory, Los Alamos, NM, USA
| |
Collapse
|
2
|
Rabitz H, Russell B, Ho TS. The Surprising Ease of Finding Optimal Solutions for Controlling Nonlinear Phenomena in Quantum and Classical Complex Systems. J Phys Chem A 2023; 127:4224-4236. [PMID: 37142303 DOI: 10.1021/acs.jpca.3c01896] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/06/2023]
Abstract
This Perspective addresses the often observed surprising ease of achieving optimal control of nonlinear phenomena in quantum and classical complex systems. The circumstances involved are wide-ranging, with scenarios including manipulation of atomic scale processes, maximization of chemical and material properties or synthesis yields, Nature's optimization of species' populations by natural selection, and directed evolution. Natural evolution will mainly be discussed in terms of laboratory experiments with microorganisms, and the field is also distinct from the other domains where a scientist specifies the goal(s) and oversees the control process. We use the word "control" in reference to all of the available variables, regardless of the circumstance. The empirical observations on the ease of achieving at least good, if not excellent, control in diverse domains of science raise the question of why this occurs despite the generally inherent complexity of the systems in each scenario. The key to addressing the question lies in examining the associated control landscape, which is defined as the optimization objective as a function of the control variables that can be as diverse as the phenomena under consideration. Controls may range from laser pulses, chemical reagents, chemical processing conditions, out to nucleic acids in the genome and more. This Perspective presents a conjecture, based on present findings, that the systematics of readily finding good outcomes from controlled phenomena may be unified through consideration of control landscapes with the same common set of three underlying assumptions─the existence of an optimal solution, the ability for local movement on the landscape, and the availability of sufficient control resources─whose validity needs assessment in each scenario. In practice, many cases permit using myopic gradient-like algorithms while other circumstances utilize algorithms having some elements of stochasticity or introduced noise, depending on whether the landscape is locally smooth or rough. The overarching observation is that only relatively short searches are required despite the common high dimensionality of the available controls in typical scenarios.
Collapse
Affiliation(s)
- Herschel Rabitz
- Department of Chemistry, Princeton University, Princeton, New Jersey 08544, United States
| | - Benjamin Russell
- Department of Chemistry, Princeton University, Princeton, New Jersey 08544, United States
| | - Tak-San Ho
- Department of Chemistry, Princeton University, Princeton, New Jersey 08544, United States
| |
Collapse
|
3
|
Freeze JG, Kelly HR, Batista VS. Search for Catalysts by Inverse Design: Artificial Intelligence, Mountain Climbers, and Alchemists. Chem Rev 2019; 119:6595-6612. [PMID: 31059236 DOI: 10.1021/acs.chemrev.8b00759] [Citation(s) in RCA: 100] [Impact Index Per Article: 16.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
Abstract
In silico catalyst design is a grand challenge of chemistry. Traditional computational approaches have been limited by the need to compute properties for an intractably large number of possible catalysts. Recently, inverse design methods have emerged, starting from a desired property and optimizing a corresponding chemical structure. Techniques used for exploring chemical space include gradient-based optimization, alchemical transformations, and machine learning. Though the application of these methods to catalysis is in its early stages, further development will allow for robust computational catalyst design. This review provides an overview of the evolution of inverse design approaches and their relevance to catalysis. The strengths and limitations of existing techniques are highlighted, and suggestions for future research are provided.
Collapse
Affiliation(s)
- Jessica G Freeze
- Department of Chemistry , Yale University , New Haven , Connecticut 06520 , United States.,Energy Sciences Institute , Yale University , West Haven , Connecticut 06516 , United States
| | - H Ray Kelly
- Department of Chemistry , Yale University , New Haven , Connecticut 06520 , United States.,Energy Sciences Institute , Yale University , West Haven , Connecticut 06516 , United States
| | - Victor S Batista
- Energy Sciences Institute , Yale University , West Haven , Connecticut 06516 , United States.,Department of Chemistry , Yale University , P.O. Box 208107 , New Haven , Connecticut 06520 , United States
| |
Collapse
|
4
|
Soley MB, Markmann A, Batista VS. Classical Optimal Control for Energy Minimization Based On Diffeomorphic Modulation under Observable-Response-Preserving Homotopy. J Chem Theory Comput 2018; 14:3351-3362. [DOI: 10.1021/acs.jctc.8b00124] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Affiliation(s)
- Micheline B. Soley
- Department of Chemistry, Yale University, P.O.
Box 208107, New Haven, Connecticut 06520-8107, United States
- Energy Sciences Institute, Yale University, P.O.
Box 27394, West Haven, Connecticut 06516-7394, United States
| | - Andreas Markmann
- Department of Chemistry, Yale University, P.O.
Box 208107, New Haven, Connecticut 06520-8107, United States
- Energy Sciences Institute, Yale University, P.O.
Box 27394, West Haven, Connecticut 06516-7394, United States
| | - Victor S. Batista
- Department of Chemistry, Yale University, P.O.
Box 208107, New Haven, Connecticut 06520-8107, United States
- Energy Sciences Institute, Yale University, P.O.
Box 27394, West Haven, Connecticut 06516-7394, United States
| |
Collapse
|
5
|
Russell B, Rabitz H. Common foundations of optimal control across the sciences: evidence of a free lunch. PHILOSOPHICAL TRANSACTIONS. SERIES A, MATHEMATICAL, PHYSICAL, AND ENGINEERING SCIENCES 2017; 375:rsta.2016.0210. [PMID: 28115607 PMCID: PMC5311431 DOI: 10.1098/rsta.2016.0210] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 11/20/2016] [Indexed: 05/22/2023]
Abstract
A common goal in the sciences is optimization of an objective function by selecting control variables such that a desired outcome is achieved. This scenario can be expressed in terms of a control landscape of an objective considered as a function of the control variables. At the most basic level, it is known that the vast majority of quantum control landscapes possess no traps, whose presence would hinder reaching the objective. This paper reviews and extends the quantum control landscape assessment, presenting evidence that the same highly favourable landscape features exist in many other domains of science. The implications of this broader evidence are discussed. Specifically, control landscape examples from quantum mechanics, chemistry and evolutionary biology are presented. Despite the obvious differences, commonalities between these areas are highlighted within a unified mathematical framework. This mathematical framework is driven by the wide-ranging experimental evidence on the ease of finding optimal controls (in terms of the required algorithmic search effort beyond the laboratory set-up overhead). The full scope and implications of this observed common control behaviour pose an open question for assessment in further work.This article is part of the themed issue 'Horizons of cybernetical physics'.
Collapse
Affiliation(s)
- Benjamin Russell
- Department of Chemistry, Princeton University, Princeton, NJ 08540, USA
| | - Herschel Rabitz
- Department of Chemistry, Princeton University, Princeton, NJ 08540, USA
| |
Collapse
|
6
|
Shu CC, Edwalds M, Shabani A, Ho TS, Rabitz H. Hessian facilitated analysis of optimally controlled quantum dynamics of systems with coupled primary and secondary states. Phys Chem Chem Phys 2015; 17:18621-8. [PMID: 26119871 DOI: 10.1039/c5cp02660a] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
The efficacy of optimal control of quantum dynamics depends on the topology and associated local structure of the underlying control landscape defined as the objective as a function of the control field. A commonly studied control objective involves maximization of the transition probability for steering the quantum system from one state to another state. This paper invokes landscape Hessian analysis performed at an optimal solution to gain insight into the controlled dynamics, where the Hessian is the second-order functional derivative of the control objective with respect to the control field. Specifically, we consider a quantum system composed of coupled primary and secondary subspaces of energy levels with the initial and target states lying in the primary subspace. The primary and secondary subspaces may arise in various scenarios, for example, respectively, as sub-manifolds of ground and excited electronic states of a poly-atomic molecule, with each possessing a set of rotational-vibrational levels. The control field may engage the system through electric dipole transitions that occur either (I) only in the primary subspace, (II) between the two subspaces, or (III) only in the secondary subspace. Important insights about the resultant dynamics in each case are revealed in the structural patterns of the corresponding Hessian. The Fourier spectrum of the Hessian is shown to often be complementary to mechanistic insights provided by the optimal control field and population dynamics.
Collapse
Affiliation(s)
- Chuan-Cun Shu
- Department of Chemistry, Princeton University, Princeton, New Jersey 08544, USA.
| | | | | | | | | |
Collapse
|
7
|
Joe-Wong C, Ho TS, Rabitz H, Wu R. Topology of classical molecular optimal control landscapes for multi-target objectives. J Chem Phys 2015; 142:154115. [PMID: 25903874 DOI: 10.1063/1.4918274] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/13/2023] Open
Abstract
This paper considers laser-driven optimal control of an ensemble of non-interacting molecules whose dynamics lie in classical phase space. The molecules evolve independently under control to distinct final states. We consider a control landscape defined in terms of multi-target (MT) molecular states and analyze the landscape as a functional of the control field. The topology of the MT control landscape is assessed through its gradient and Hessian with respect to the control. Under particular assumptions, the MT control landscape is found to be free of traps that could hinder reaching the objective. The Hessian associated with an optimal control field is shown to have finite rank, indicating an inherent degree of robustness to control noise. Both the absence of traps and rank of the Hessian are shown to be analogous to the situation of specifying multiple targets for an ensemble of quantum states. Numerical simulations are presented to illustrate the classical landscape principles and further characterize the system behavior as the control field is optimized.
Collapse
Affiliation(s)
- Carlee Joe-Wong
- Program in Applied and Computational Mathematics, Princeton University, Princeton, New Jersey 08544-1000, USA
| | - Tak-San Ho
- Department of Chemistry, Princeton University, Princeton, New Jersey 08544-1009, USA
| | - Herschel Rabitz
- Department of Chemistry, Princeton University, Princeton, New Jersey 08544-1009, USA
| | - Rebing Wu
- Department of Automation, Tsinghua University, Beijing, People's Republic of China
| |
Collapse
|
8
|
Soley M, Markmann A, Batista VS. Steered quantum dynamics for energy minimization. J Phys Chem B 2015; 119:715-27. [PMID: 25122515 DOI: 10.1021/jp5046723] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
We introduce a quantum optimal control algorithm for energy minimization that combines the diffeomorphic modulation under observable response preserving homotopy (D-MORPH) gradient and the Broyden Fletcher Goldfarb Shanno (BFGS) iterative scheme for nonlinear optimization. An extended set of controls defining the time-dependent mass, dipole moment, and external perturbational field are optimized to find an effective Hamiltonian that steers the dynamics of the system into the global minimum without getting trapped into local minima. The algorithm is illustrated as applied to energy minimization on rugged surfaces and golf potentials comparable to those previously explored for testing quantum annealing methodologies.
Collapse
Affiliation(s)
- Micheline Soley
- Department of Chemistry, Yale University , P.O. Box 208107, New Haven, Connecticut 06520-8107, United States
| | | | | |
Collapse
|
9
|
Chenel A, Meier C, Dive G, Desouter-Lecomte M. Optimal control of a Cope rearrangement by coupling the reaction path to a dissipative bath or a second active mode. J Chem Phys 2015; 142:024307. [DOI: 10.1063/1.4905200] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
|
10
|
Nanduri A, Shir OM, Donovan A, Ho TS, Rabitz H. Exploring the complexity of quantum control optimization trajectories. Phys Chem Chem Phys 2015; 17:334-47. [PMID: 25377547 DOI: 10.1039/c4cp03853c] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
The control of quantum system dynamics is generally performed by seeking a suitable applied field. The physical objective as a functional of the field forms the quantum control landscape, whose topology, under certain conditions, has been shown to contain no critical point suboptimal traps, thereby enabling effective searches for fields that give the global maximum of the objective. This paper addresses the structure of the landscape as a complement to topological critical point features. Recent work showed that landscape structure is highly favorable for optimization of state-to-state transition probabilities, in that gradient-based control trajectories to the global maximum value are nearly straight paths. The landscape structure is codified in the metric R ≥ 1.0, defined as the ratio of the length of the control trajectory to the Euclidean distance between the initial and optimal controls. A value of R = 1 would indicate an exactly straight trajectory to the optimal observable value. This paper extends the state-to-state transition probability results to the quantum ensemble and unitary transformation control landscapes. Again, nearly straight trajectories predominate, and we demonstrate that R can take values approaching 1.0 with high precision. However, the interplay of optimization trajectories with critical saddle submanifolds is found to influence landscape structure. A fundamental relationship necessary for perfectly straight gradient-based control trajectories is derived, wherein the gradient on the quantum control landscape must be an eigenfunction of the Hessian. This relation is an indicator of landscape structure and may provide a means to identify physical conditions when control trajectories can achieve perfect linearity. The collective favorable landscape topology and structure provide a foundation to understand why optimal quantum control can be readily achieved.
Collapse
Affiliation(s)
- Arun Nanduri
- Department of Chemistry, Princeton University, Princeton, NJ 08544, USA.
| | | | | | | | | |
Collapse
|
11
|
Joe-Wong C, Ho TS, Long R, Rabitz H, Wu R. Topology of classical molecular optimal control landscapes in phase space. J Chem Phys 2013; 138:124114. [PMID: 23556716 DOI: 10.1063/1.4797498] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022] Open
Abstract
Optimal control of molecular dynamics is commonly expressed from a quantum mechanical perspective. However, in most contexts the preponderance of molecular dynamics studies utilize classical mechanical models. This paper treats laser-driven optimal control of molecular dynamics in a classical framework. We consider the objective of steering a molecular system from an initial point in phase space to a target point, subject to the dynamic constraint of Hamilton's equations. The classical control landscape corresponding to this objective is a functional of the control field, and the topology of the landscape is analyzed through its gradient and Hessian with respect to the control. Under specific assumptions on the regularity of the control fields, the classical control landscape is found to be free of traps that could hinder reaching the objective. The Hessian associated with an optimal control field is shown to have finite rank, indicating the presence of an inherent degree of robustness to control noise. Extensive numerical simulations are performed to illustrate the theoretical principles on (a) a model diatomic molecule, (b) two coupled Morse oscillators, and (c) a chaotic system with a coupled quartic oscillator, confirming the absence of traps in the classical control landscape. We compare the classical formulation with the mathematically analogous quantum state-to-state transition probability control landscape.
Collapse
Affiliation(s)
- Carlee Joe-Wong
- Department of Mathematics, Princeton University, Princeton, New Jersey 08544-1000, USA
| | | | | | | | | |
Collapse
|