Active learning machine learns to create new quantum experiments

Assessment of ChatGPT-3.5's Knowledge in Oncology: Comparative Study with ASCO-SEP Benchmarks

BACKGROUND

ChatGPT (Open AI) is a state-of-the-art large language model that uses artificial intelligence (AI) to address questions across diverse topics. The American Society of Clinical Oncology Self-Evaluation Program (ASCO-SEP) created a comprehensive educational program to help physicians keep up to date with the many rapid advances in the field. The question bank consists of multiple choice questions addressing the many facets of cancer care, including diagnosis, treatment, and supportive care. As ChatGPT applications rapidly expand, it becomes vital to ascertain if the knowledge of ChatGPT-3.5 matches the established standards that oncologists are recommended to follow.

OBJECTIVE

This study aims to evaluate whether ChatGPT-3.5's knowledge aligns with the established benchmarks that oncologists are expected to adhere to. This will furnish us with a deeper understanding of the potential applications of this tool as a support for clinical decision-making.

METHODS

We conducted a systematic assessment of the performance of ChatGPT-3.5 on the ASCO-SEP, the leading educational and assessment tool for medical oncologists in training and practice. Over 1000 multiple choice questions covering the spectrum of cancer care were extracted. Questions were categorized by cancer type or discipline, with subcategorization as treatment, diagnosis, or other. Answers were scored as correct if ChatGPT-3.5 selected the answer as defined by ASCO-SEP.

RESULTS

Overall, ChatGPT-3.5 achieved a score of 56.1% (583/1040) for the correct answers provided. The program demonstrated varying levels of accuracy across cancer types or disciplines. The highest accuracy was observed in questions related to developmental therapeutics (8/10; 80% correct), while the lowest accuracy was observed in questions related to gastrointestinal cancer (102/209; 48.8% correct). There was no significant difference in the program's performance across the predefined subcategories of diagnosis, treatment, and other (P=.16, which is greater than .05).

CONCLUSIONS

This study evaluated ChatGPT-3.5's oncology knowledge using the ASCO-SEP, aiming to address uncertainties regarding AI tools like ChatGPT in clinical decision-making. Our findings suggest that while ChatGPT-3.5 offers a hopeful outlook for AI in oncology, its present performance in ASCO-SEP tests necessitates further refinement to reach the requisite competency levels. Future assessments could explore ChatGPT's clinical decision support capabilities with real-world clinical scenarios, its ease of integration into medical workflows, and its potential to foster interdisciplinary collaboration and patient engagement in health care settings.

Darwinian evolution has become dogma; AI can rescue what is salvageable

Artificial Intelligence (AI), as an academic discipline, is traceable to the mid-1950s but it is currently exploding in applications with successes and concerns. AI can be defined as intelligence demonstrated by computers, with intelligence difficult to define but it must include concepts of ability to learn, reason, and generalize from a vast amount of information and, we propose, to infer meaning. The type of AI known as general AI, has strong, but unrealized potential both for assessing and also for solving major problems with the scientific theory of Darwinian evolution, including its modern variants and for origin of life studies. Specifically, AI should be applied first to evaluate the strengths and weaknesses of the assumptions and empirical information underpinning theories of the origin of life and probability of its evolution. AI should then be applied to assess the scientific validity of the theory of how abundant life came to be on earth.

Convolutional neural networks for mode on-demand high finesse optical resonator design

We demonstrate the use of machine learning through convolutional neural networks to solve inverse design problems of optical resonator engineering. The neural network finds a harmonic modulation of a spherical mirror to generate a resonator mode with a given target topology ("mode on-demand"). The procedure allows us to optimize the shape of mirrors to achieve a significantly enhanced coupling strength and cooperativity between a resonator photon and a quantum emitter located at the center of the resonator. In a second example, a double-peak mode is designed which would enhance the interaction between two quantum emitters, e.g., for quantum information processing.

Scientific discovery in the age of artificial intelligence

Artificial intelligence (AI) is being increasingly integrated into scientific discovery to augment and accelerate research, helping scientists to generate hypotheses, design experiments, collect and interpret large datasets, and gain insights that might not have been possible using traditional scientific methods alone. Here we examine breakthroughs over the past decade that include self-supervised learning, which allows models to be trained on vast amounts of unlabelled data, and geometric deep learning, which leverages knowledge about the structure of scientific data to enhance model accuracy and efficiency. Generative AI methods can create designs, such as small-molecule drugs and proteins, by analysing diverse data modalities, including images and sequences. We discuss how these methods can help scientists throughout the scientific process and the central issues that remain despite such advances. Both developers and users of AI toolsneed a better understanding of when such approaches need improvement, and challenges posed by poor data quality and stewardship remain. These issues cut across scientific disciplines and require developing foundational algorithmic approaches that can contribute to scientific understanding or acquire it autonomously, making them critical areas of focus for AI innovation.

Artificial Intelligence and Advanced Materials

Artificial intelligence (AI) is gaining strength, and materials science can both contribute to and profit from it. In a simultaneous progress race, new materials, systems, and processes can be devised and optimized thanks to machine learning (ML) techniques, and such progress can be turned into innovative computing platforms. Future materials scientists will profit from understanding how ML can boost the conception of advanced materials. This review covers aspects of computation from the fundamentals to directions taken and repercussions produced by computation to account for the origins, procedures, and applications of AI. ML and its methods are reviewed to provide basic knowledge of its implementation and its potential. The materials and systems used to implement AI with electric charges are finding serious competition from other information-carrying and processing agents. The impact these techniques have on the inception of new advanced materials is so deep that a new paradigm is developing where implicit knowledge is being mined to conceive materials and systems for functions instead of finding applications to found materials. How far this trend can be carried is hard to fathom, as exemplified by the power to discover unheard of materials or physical laws buried in data.

Active learning applied to automated physical systems increases the rate of discovery

Active machine learning is widely used in computational studies where repeated numerical simulations can be conducted on high performance computers without human intervention. But translation of these active learning methods to physical systems has proven more difficult and the accelerated pace of discoveries aided by these methods remains as yet unrealized. Through the presentation of a general active learning framework and its application to large-scale boundary layer wind tunnel experiments, we demonstrate that the active learning framework used so successfully in computational studies is directly applicable to the investigation of physical experimental systems and the corresponding improvements in the rate of discovery can be transformative. We specifically show that, for our wind tunnel experiments, we are able to achieve in approximately 300 experiments a learning objective that would be impossible using traditional methods.

Noise Prediction and Reduction of Single Electron Spin by Deep-Learning-Enhanced Feedforward Control

Noise-induced control imperfection is an important problem in applications of diamond-based nanoscale sensing, where measurement-based strategies are generally utilized to correct low-frequency noises in realtime. However, the spin-state readout requires a long time due to the low photon-detection efficiency. This inevitably introduces a delay in the noise-reduction process and limits its performance. Here we introduce the deep learning approach to relax this restriction by predicting the trend of noise and compensating for the delay. We experimentally implement feedforward quantum control of the nitrogen-vacancy center in diamond to protect its spin coherence and improve the sensing performance against noise. The new approach effectively enhances the decoherence time of the electron spin, which enables exploration of more physics from its resonant spectroscopy. A theoretical model is provided to explain the improvement. This scheme could be applied in general sensing schemes and extended to other quantum systems.

Efficient design of peptide-binding polymers using active learning approaches

Active learning (AL) has become a subject of active recent research both in industry and academia as an efficient approach for rapid design and discovery of novel chemicals, materials, and polymers. Herein, we have assessed the applicability of AL for the discovery of polymeric micelle formulations for poorly soluble drugs. We were motivated by the key advantages of this approach making it a desirable strategy for rational design of drug delivery systems due toto its ability to (i) employ relatively small datasets for model development, (ii) iterate between model development and model assessment using small external datasets that can be either generated in focused experimental studies or formed from subsets of the initial training data, and (iii) progressively evolve models towards increasingly more reliable predictions and the identification of novel chemicals with the desired properties. In this study, we compared various AL protocols for their effectiveness in finding biologically active molecules using synthetic datasets. We have investigated the dependency of AL performance on the size of the initial training set, the relative complexity of the task, and the choice of the initial training dataset. We found that AL techniques as applied to regression modeling offer no benefits over random search, while AL used for classification tasks performs better than models built for randomly selected training sets but still quite far from perfect. Using the best performing AL protocol,. Finally, the best performing AL approach was employed to discover and experimentally validate novel binding polymers for a case study of asialoglycoprotein receptor (ASGPR).

How a Minimal Learning Agent can Infer the Existence of Unobserved Variables in a Complex Environment

According to a mainstream position in contemporary cognitive science and philosophy, the use of abstract compositional concepts is amongst the most characteristic indicators of meaningful deliberative thought in an organism or agent. In this article, we show how the ability to develop and utilise abstract conceptual structures can be achieved by a particular kind of learning agent. More specifically, we provide and motivate a concrete operational definition of what it means for these agents to be in possession of abstract concepts, before presenting an explicit example of a minimal architecture that supports this capability. We then proceed to demonstrate how the existence of abstract conceptual structures can be operationally useful in the process of employing previously acquired knowledge in the face of new experiences, thereby vindicating the natural conjecture that the cognitive functions of abstraction and generalisation are closely related.

Biology and medicine in the landscape of quantum advantages

Quantum computing holds substantial potential for applications in biology and medicine, spanning from the simulation of biomolecules to machine learning methods for subtyping cancers on the basis of clinical features. This potential is encapsulated by the concept of a quantum advantage, which is contingent on a reduction in the consumption of a computational resource, such as time, space or data. Here, we distill the concept of a quantum advantage into a simple framework to aid researchers in biology and medicine pursuing the development of quantum applications. We then apply this framework to a wide variety of computational problems relevant to these domains in an effort to (i) assess the potential of practical advantages in specific application areas and (ii) identify gaps that may be addressed with novel quantum approaches. In doing so, we provide an extensive survey of the intersection of biology and medicine with the current landscape of quantum algorithms and their potential advantages. While we endeavour to identify specific computational problems that may admit practical advantages throughout this work, the rapid pace of change in the fields of quantum computing, classical algorithms and biological research implies that this intersection will remain highly dynamic for the foreseeable future.

On scientific understanding with artificial intelligence

An oracle that correctly predicts the outcome of every particle physics experiment, the products of every possible chemical reaction or the function of every protein would revolutionize science and technology. However, scientists would not be entirely satisfied because they would want to comprehend how the oracle made these predictions. This is scientific understanding, one of the main aims of science. With the increase in the available computational power and advances in artificial intelligence, a natural question arises: how can advanced computational systems, and specifically artificial intelligence, contribute to new scientific understanding or gain it autonomously? Trying to answer this question, we adopted a definition of 'scientific understanding' from the philosophy of science that enabled us to overview the scattered literature on the topic and, combined with dozens of anecdotes from scientists, map out three dimensions of computer-assisted scientific understanding. For each dimension, we review the existing state of the art and discuss future developments. We hope that this Perspective will inspire and focus research directions in this multidisciplinary emerging field.

Inverse design of high degree of freedom meta-atoms based on machine learning and genetic algorithm methods

Since inverse design is an ill-conditioned problem of mapping from low dimensions to high dimensions, inverse design is challenging, especially for design problems with many degrees of freedom (DOFs). Traditional deep learning methods and optimization methods cannot readily calculate the inverse design of meta-atoms with high DOFs. In this paper, a new method combining deep learning and genetic algorithm (GA) methods is proposed to realize the inverse design of meta-atoms with high DOFs. In this method, a predicting neural network (PNN) and a variational autoencoder (VAE) generation model are constructed and trained. The generative model is used to constrain and compress the large design space, so that the GA can jump out of the local optimal solution and find the global optimal solution. The predicting model is used to quickly evaluate the fitness value of each offspring in the GA. With the assistance of these two machine learning models, the GA can find the optimal design of meta-atoms. This approach can realize, on demand, inverse design of meta-atoms, and opens the way for the optimization of procedures in other fields.

Probing the limits of quantum theory with quantum information at subnuclear scales

Modern quantum engineering techniques enabled successful foundational tests of quantum mechanics. Yet, the universal validity of quantum postulates is an open question. Here we propose a new theoretical framework of Q-data tests, which recognizes the established validity of quantum theory, but allows for more general—‘post-quantum’—scenarios in certain physical regimes. It can accommodate a large class of models with modified quantum wave dynamics, correlations beyond entanglement or general probabilistic postulates. We discuss its experimental implementation suited to probe the nature of strong nuclear interactions. In contrast to the present accelerator experiments, it shifts the focus from high-luminosity beam physics to individual particle coherent control.

Extract the Degradation Information in Squeezed States with Machine Learning

In order to leverage the full power of quantum noise squeezing with unavoidable decoherence, a complete understanding of the degradation in the purity of squeezed light is demanded. By implementing machine-learning architecture with a convolutional neural network, we illustrate a fast, robust, and precise quantum state tomography for continuous variables, through the experimentally measured data generated from the balanced homodyne detectors. Compared with the maximum likelihood estimation method, which suffers from time-consuming and overfitting problems, a well-trained machine fed with squeezed vacuum and squeezed thermal states can complete the task of reconstruction of the density matrix in less than one second. Moreover, the resulting fidelity remains as high as 0.99 even when the antisqueezing level is higher than 20 dB. Compared with the phase noise and loss mechanisms coupled from the environment and surrounding vacuum, experimentally, the degradation information is unveiled with machine learning for low and high noisy scenarios, i.e., with the antisqueezing levels at 12 dB and 18 dB, respectively. Our neural network enhanced quantum state tomography provides the metrics to give physical descriptions of every feature observed in the quantum state with a single scan measurement just by varying the local oscillator phase from 0 to 2π and paves a way of exploring large-scale quantum systems in real time.

Variational quantum reinforcement learning via evolutionary optimization

Recent advances in classical reinforcement learning (RL) and quantum computation point to a promising direction for performing RL on a quantum computer. However, potential applications in quantum RL are limited by the number of qubits available in modern quantum devices. Here, we present two frameworks for deep quantum RL tasks using gradient-free evolutionary optimization. First, we apply the amplitude encoding scheme to the Cart-Pole problem, where we demonstrate the quantum advantage of parameter saving using amplitude encoding. Second, we propose a hybrid framework where the quantum RL agents are equipped with a hybrid tensor network-variational quantum circuit (TN-VQC) architecture to handle inputs of dimensions exceeding the number of qubits. This allows us to perform quantum RL in the MiniGrid environment with 147-dimensional inputs. The hybrid TN-VQC architecture provides a natural way to perform efficient compression of the input dimension, enabling further quantum RL applications on noisy intermediate-scale quantum devices.

Patent Portfolio Analysis of the Synergy between Machine Learning and Photonics

Machine learning in photonics has potential in many industries. However, research on patent portfolios is still lacking. The purpose of this study was to assess the status of machine learning in photonics technology and patent portfolios and investigate major assignees to generate a better understanding of the developmental trends of machine learning in photonics. This can provide governments and industry with a resource for planning strategic development. I used data-mining methods (correspondence analysis and K-means clustering) to explore competing technological and strategic-group relationships within the field of machine learning in photonics. The data were granted patents in the USPTO database from 2019 to 2020. The results reveal that patents were primarily in image data processing, electronic digital data processing, wireless communication networks, and healthcare informatics and diagnosis. I assessed the relative technological advantages of various assignees and propose policy recommendations for technology development.

Autonomous materials synthesis via hierarchical active learning of nonequilibrium phase diagrams

Autonomous experimentation enabled by artificial intelligence offers a new paradigm for accelerating scientific discovery. Nonequilibrium materials synthesis is emblematic of complex, resource-intensive experimentation whose acceleration would be a watershed for materials discovery. We demonstrate accelerated exploration of metastable materials through hierarchical autonomous experimentation governed by the Scientific Autonomous Reasoning Agent (SARA). SARA integrates robotic materials synthesis using lateral gradient laser spike annealing and optical characterization along with a hierarchy of AI methods to map out processing phase diagrams. Efficient exploration of the multidimensional parameter space is achieved with nested active learning cycles built upon advanced machine learning models that incorporate the underlying physics of the experiments and end-to-end uncertainty quantification. We demonstrate SARA’s performance by autonomously mapping synthesis phase boundaries for the Bi₂O₃ system, leading to orders-of-magnitude acceleration in the establishment of a synthesis phase diagram that includes conditions for stabilizing δ-Bi₂O₃ at room temperature, a critical development for electrochemical technologies.

Quantum Optical Experiments Modeled by Long Short-Term Memory

We demonstrate how machine learning is able to model experiments in quantum physics. Quantum entanglement is a cornerstone for upcoming quantum technologies, such as quantum computation and quantum cryptography. Of particular interest are complex quantum states with more than two particles and a large number of entangled quantum levels. Given such a multiparticle high-dimensional quantum state, it is usually impossible to reconstruct an experimental setup that produces it. To search for interesting experiments, one thus has to randomly create millions of setups on a computer and calculate the respective output states. In this work, we show that machine learning models can provide significant improvement over random search. We demonstrate that a long short-term memory (LSTM) neural network can successfully learn to model quantum experiments by correctly predicting output state characteristics for given setups without the necessity of computing the states themselves. This approach not only allows for faster search, but is also an essential step towards the automated design of multiparticle high-dimensional quantum experiments using generative machine learning models.

Learning the Effective Spin Hamiltonian of a Quantum Magnet

To understand the intriguing many-body states and effects in the correlated quantum materials, inference of the microscopic effective Hamiltonian from experiments constitutes an important yet very challenging inverse problem. Here we propose an unbiased and efficient approach learning the effective Hamiltonian through the many-body analysis of the measured thermal data. Our approach combines the strategies including the automatic gradient and Bayesian optimization with the thermodynamics many-body solvers including the exact diagonalization and the tensor renormalization group methods. We showcase the accuracy and powerfulness of the Hamiltonian learning by applying it firstly to the thermal data generated from a given spin model, and then to realistic experimental data measured in the spin-chain compound copper nitrate and triangular-lattice magnet TmMgGaO4. The present automatic approach constitutes a unified framework of many-body thermal data analysis in the studies of quantum magnets and strongly correlated materials in general.

Quantum-accessible reinforcement learning beyond strictly epochal environments

In recent years, quantum-enhanced machine learning has emerged as a particularly fruitful application of quantum algorithms, covering aspects of supervised, unsupervised and reinforcement learning. Reinforcement learning offers numerous options of how quantum theory can be applied, and is arguably the least explored, from a quantum perspective. Here, an agent explores an environment and tries to find a behavior optimizing some figure of merit. Some of the first approaches investigated settings where this exploration can be sped-up, by considering quantum analogs of classical environments, which can then be queried in superposition. If the environments have a strict periodic structure in time (i.e. are strictly episodic), such environments can be effectively converted to conventional oracles encountered in quantum information. However, in general environments, we obtain scenarios that generalize standard oracle tasks. In this work, we consider one such generalization, where the environment is not strictly episodic, which is mapped to an oracle identification setting with a changing oracle. We analyze this case and show that standard amplitude-amplification techniques can, with minor modifications, still be applied to achieve quadratic speed-ups. In addition, we prove that an algorithm based on Grover iterations is optimal for oracle identification even if the oracle changes over time in a way that the "rewarded space" is monotonically increasing. This result constitutes one of the first generalizations of quantum-accessible reinforcement learning.

Information-Theoretic Bounds on Quantum Advantage in Machine Learning

We study the performance of classical and quantum machine learning (ML) models in predicting outcomes of physical experiments. The experiments depend on an input parameter x and involve execution of a (possibly unknown) quantum process E. Our figure of merit is the number of runs of E required to achieve a desired prediction performance. We consider classical ML models that perform a measurement and record the classical outcome after each run of E, and quantum ML models that can access E coherently to acquire quantum data; the classical or quantum data are then used to predict the outcomes of future experiments. We prove that for any input distribution D(x), a classical ML model can provide accurate predictions on average by accessing E a number of times comparable to the optimal quantum ML model. In contrast, for achieving an accurate prediction on all inputs, we prove that the exponential quantum advantage is possible. For example, to predict the expectations of all Pauli observables in an n-qubit system ρ, classical ML models require 2^{Ω(n)} copies of ρ, but we present a quantum ML model using only O(n) copies. Our results clarify where the quantum advantage is possible and highlight the potential for classical ML models to address challenging quantum problems in physics and chemistry.

Experimental quantum speed-up in reinforcement learning agents

As the field of artificial intelligence advances, the demand for algorithms that can learn quickly and efficiently increases. An important paradigm within artificial intelligence is reinforcement learning [1], where decision-making entities called agents interact with environments and learn by updating their behaviour based on obtained feedback. The crucial question for practical applications is how fast agents learn [2]. While various works have made use of quantum mechanics to speed up the agent’s decision-making process [3, 4], a reduction in learning time has not been demonstrated yet. Here, we present a reinforcement learning experiment where the learning process of an agent is sped up by utilizing a quantum communication channel with the environment. We further show that combining this scenario with classical communication enables the evaluation of such an improvement, and additionally allows for optimal control of the learning progress. We implement this learning protocol on a compact and fully tuneable integrated nanophotonic processor. The device interfaces with telecom-wavelength photons and features a fast active feedback mechanism, allowing us to demonstrate the agent’s systematic quantum ad-vantage in a setup that could be readily integrated within future large-scale quantum communication networks.

Tailor-made unitary operations using dielectric metasurfaces

Qubit operation belonging to unitary transformation is the fundamental operation to realize quantum computing and information processing. Here, we show that the complex and flexible light-matter interaction between dielectric metasurfaces and incident light can be used to perform arbitrary U(2) operations. By incorporating both coherent spatial-mode operation together with two polarizations on a single metasurface, we further extend the discussion to single-photon two-qubit U(4) operations. We believe the efficient usage of metasurfaces as a potential compact platform can simplify optical qubit operation from bulky systems into conceptually subwavelength elements.

Quantum Reinforcement Learning with Quantum Photonics

Quantum machine learning has emerged as a promising paradigm that could accelerate machine learning calculations. Inside this field, quantum reinforcement learning aims at designing and building quantum agents that may exchange information with their environment and adapt to it, with the aim of achieving some goal. Different quantum platforms have been considered for quantum machine learning and specifically for quantum reinforcement learning. Here, we review the field of quantum reinforcement learning and its implementation with quantum photonics. This quantum technology may enhance quantum computation and communication, as well as machine learning, via the fruitful marriage between these previously unrelated fields.

Reinforcement Learning Approach to Nonequilibrium Quantum Thermodynamics

We use a reinforcement learning approach to reduce entropy production in a closed quantum system brought out of equilibrium. Our strategy makes use of an external control Hamiltonian and a policy gradient technique. Our approach bears no dependence on the quantitative tool chosen to characterize the degree of thermodynamic irreversibility induced by the dynamical process being considered, requires little knowledge of the dynamics itself, and does not need the tracking of the quantum state of the system during the evolution, thus embodying an experimentally nondemanding approach to the control of nonequilibrium quantum thermodynamics. We successfully apply our methods to the case of single- and two-particle systems subjected to time-dependent driving potentials.

The Raspberry Pi auto-aligner: Machine learning for automated alignment of laser beams

We present a novel solution to automated beam alignment optimization. This device is based on a Raspberry Pi computer, stepper motors, commercial optomechanics and electronic devices, and the open-source machine learning algorithm M-LOOP. We provide schematic drawings for the custom hardware necessary to operate the device and discuss diagnostic techniques to determine the performance. The beam auto-aligning device has been used to improve the alignment of a laser beam into a single-mode optical fiber from manually optimized fiber alignment, with an iteration time of typically 20 minutes. We present example data of one such measurement to illustrate device performance.

Artificial intelligence for photonics and photonic materials

Artificial intelligence (AI) is the most important new methodology in scientific research since the adoption of quantum mechanics and it is providing exciting results in numerous fields of science and technology. In this review we summarize research and discuss future opportunities for AI in the domains of photonics, nanophotonics, plasmonics and photonic materials discovery, including metamaterials.

Reinforcement learning decoders for fault-tolerant quantum computation

Topological error correcting codes, and particularly the surface code, currently provide the most feasible road-map towards large-scale fault-tolerant quantum computation. As such, obtaining fast and flexible decoding algorithms for these codes, within the experimentally realistic and challenging context of faulty syndrome measurements, without requiring any final read-out of the physical qubits, is of critical importance. In this work, we show that the problem of decoding such codes can be naturally reformulated as a process of repeated interactions between a decoding agent and a code environment, to which the machinery of reinforcement learning can be applied to obtain decoding agents. While in principle this framework can be instantiated with environments modelling circuit level noise, we take a first step towards this goal by using deepQ learning to obtain decoding agents for a variety of simplified phenomenological noise models, which yield faulty syndrome measurements without including the propagation of errors which arise in full circuit level noise models.

Emerging Complexity in Distributed Intelligent Systems

Distributed intelligent systems (DIS) appear where natural intelligence agents (humans) and artificial intelligence agents (algorithms) interact, exchanging data and decisions and learning how to evolve toward a better quality of solutions. The networked dynamics of distributed natural and artificial intelligence agents leads to emerging complexity different from the ones observed before. In this study, we review and systematize different approaches in the distributed intelligence field, including the quantum domain. A definition and mathematical model of DIS (as a new class of systems) and its components, including a general model of DIS dynamics, are introduced. In particular, the suggested new model of DIS contains both natural (humans) and artificial (computer programs, chatbots, etc.) intelligence agents, which take into account their interactions and communications. We present the case study of domain-oriented DIS based on different agents' classes and show that DIS dynamics shows complexity effects observed in other well-studied complex systems. We examine our model by means of the platform of personal self-adaptive educational assistants (avatars), especially designed in our University. Avatars interact with each other and with their owners. Our experiment allows finding an answer to the vital question: How quickly will DIS adapt to owners' preferences so that they are satisfied? We introduce and examine in detail learning time as a function of network topology. We have shown that DIS has an intrinsic source of complexity that needs to be addressed while developing predictable and trustworthy systems of natural and artificial intelligence agents. Remarkably, our research and findings promoted the improvement of the educational process at our university in the presence of COVID-19 pandemic conditions.

Data analysis and modeling pipelines for controlled networked social science experiments

There is large interest in networked social science experiments for understanding human behavior at-scale. Significant effort is required to perform data analytics on experimental outputs and for computational modeling of custom experiments. Moreover, experiments and modeling are often performed in a cycle, enabling iterative experimental refinement and data modeling to uncover interesting insights and to generate/refute hypotheses about social behaviors. The current practice for social analysts is to develop tailor-made computer programs and analytical scripts for experiments and modeling. This often leads to inefficiencies and duplication of effort. In this work, we propose a pipeline framework to take a significant step towards overcoming these challenges. Our contribution is to describe the design and implementation of a software system to automate many of the steps involved in analyzing social science experimental data, building models to capture the behavior of human subjects, and providing data to test hypotheses. The proposed pipeline framework consists of formal models, formal algorithms, and theoretical models as the basis for the design and implementation. We propose a formal data model, such that if an experiment can be described in terms of this model, then our pipeline software can be used to analyze data efficiently. The merits of the proposed pipeline framework is elaborated by several case studies of networked social science experiments.

On the convergence of projective-simulation-based reinforcement learning in Markov decision processes

In recent years, the interest in leveraging quantum effects for enhancing machine learning tasks has significantly increased. Many algorithms speeding up supervised and unsupervised learning were established. The first framework in which ways to exploit quantum resources specifically for the broader context of reinforcement learning were found is projective simulation. Projective simulation presents an agent-based reinforcement learning approach designed in a manner which may support quantum walk-based speedups. Although classical variants of projective simulation have been benchmarked against common reinforcement learning algorithms, very few formal theoretical analyses have been provided for its performance in standard learning scenarios. In this paper, we provide a detailed formal discussion of the properties of this model. Specifically, we prove that one version of the projective simulation model, understood as a reinforcement learning approach, converges to optimal behavior in a large class of Markov decision processes. This proof shows that a physically inspired approach to reinforcement learning can guarantee to converge.

Setting Up Experimental Bell Tests with Reinforcement Learning

Finding optical setups producing measurement results with a targeted probability distribution is hard, as a priori the number of possible experimental implementations grows exponentially with the number of modes and the number of devices. To tackle this complexity, we introduce a method combining reinforcement learning and simulated annealing enabling the automated design of optical experiments producing results with the desired probability distributions. We illustrate the relevance of our method by applying it to a probability distribution favouring high violations of the Bell-Clauser-Horne-Shimony-Holt (CHSH) inequality. As a result, we propose new unintuitive experiments leading to higher Bell-CHSH inequality violations than the best currently known setups. Our method might positively impact the usefulness of photonic experiments for device-independent quantum information processing.

Neural Networks for Detecting Multimode Wigner Negativity

The characterization of quantum features in large Hilbert spaces is a crucial requirement for testing quantum protocols. In the continuous variable encoding, quantum homodyne tomography requires an amount of measurement that increases exponentially with the number of involved modes, which practically makes the protocol intractable even with few modes. Here, we introduce a new technique, based on a machine learning protocol with artificial neural networks, that allows us to directly detect negativity of the Wigner function for multimode quantum states. We test the procedure on a whole class of numerically simulated multimode quantum states for which the Wigner function is known analytically. We demonstrate that the method is fast, accurate, and more robust than conventional methods when limited amounts of data are available. Moreover, the method is applied to an experimental multimode quantum state, for which an additional test of resilience to losses is carried out.

Accelerated knowledge discovery from omics data by optimal experimental design

How to design experiments that accelerate knowledge discovery on complex biological landscapes remains a tantalizing question. We present an optimal experimental design method (coined OPEX) to identify informative omics experiments using machine learning models for both experimental space exploration and model training. OPEX-guided exploration of Escherichia coli’s populations exposed to biocide and antibiotic combinations lead to more accurate predictive models of gene expression with 44% less data. Analysis of the proposed experiments shows that broad exploration of the experimental space followed by fine-tuning emerges as the optimal strategy. Additionally, analysis of the experimental data reveals 29 cases of cross-stress protection and 4 cases of cross-stress vulnerability. Further validation reveals the central role of chaperones, stress response proteins and transport pumps in cross-stress exposure. This work demonstrates how active learning can be used to guide omics data collection for training predictive models, making evidence-driven decisions and accelerating knowledge discovery in life sciences.

How to design experiments that accelerate knowledge discovery on complex biological landscapes remains a tantalizing question. Here, the authors present OPEX, an optimal experimental design method to identify informative omics experiments for both experimental space exploration and model training.

Applications of a neural network to detect the percolating transitions in a system with variable radius of defects

We systematically study the percolation phase transition at the change of concentration of the chaotic defects (pores) in an extended system where the disordered defects additionally have a variable random radius, using the methods of a neural network (NN). Two important parameters appear in such a material: the average value and the variance of the random pore radius, which leads to significant change in the properties of the phase transition compared with conventional percolation. To train a network, we use the spatial structure of a disordered environment (feature class), and the output (label class) indicates the state of the percolation transition. We found high accuracy of the transition prediction (except the narrow threshold area) by the trained network already in the two-dimensional case. We have also employed such a technique for the extended three-dimensional (3D) percolation system. Our simulations showed the high accuracy of prediction in the percolation transition in 3D case too. The considered approach opens up interesting perspectives for using NN to identify the phase transitions in real percolating nanomaterials with a complex cluster structure.

Computer-Inspired Concept for High-Dimensional Multipartite Quantum Gates

An open question in quantum optics is how to manipulate and control complex quantum states in an experimentally feasible way. Here we present concepts for transformations of high-dimensional multiphotonic quantum systems. The proposals rely on two new ideas: (i) a novel high-dimensional quantum nondemolition measurement, (ii) the encoding and decoding of the entire quantum transformation in an ancillary state for sharing the necessary quantum information between the involved parties. Many solutions can readily be performed in laboratories around the world and thereby we identify important pathways for experimental research in the near future. The concepts have been found using the computer algorithm melvin for designing computer-inspired quantum experiments. As opposed to the field of machine learning, here the human learns new scientific concepts by interpreting and analyzing the results presented by the machine. This demonstrates that computer algorithms can inspire new ideas in science, which has a widely unexplored potential that goes far beyond experimental quantum information science.

Quantum machine learning and quantum biomimetics: A perspective

Quantum machine learning has emerged as an exciting and promising paradigm inside quantum technologies. It may permit, on the one hand, to carry out more efficient machine learning calculations by means of quantum devices, while, on the other hand, to employ machine learning techniques to better control quantum systems. Inside quantum machine learning, quantum reinforcement learning aims at developing ‘intelligent’ quantum agents that may interact with the outer world and adapt to it, with the strategy of achieving some final goal. Another paradigm inside quantum machine learning is that of quantum autoencoders, which may allow one for employing fewer resources in a quantum device via a training process. Moreover, the field of quantum biomimetics aims at establishing analogies between biological and quantum systems, to look for previously inadvertent connections that may enable useful applications. Two recent examples are the concepts of quantum artificial life, as well as of quantum memristors. In this Perspective, we give an overview of these topics, describing the related research carried out by the scientific community.

Fiber directional position sensor based on multimode interference imaging and machine learning

A fiber directional position sensor based on multimode interference and image processing by machine learning is presented. Upon single-mode injection, light in multimode fiber generates a multi-ring-shaped interference pattern at the end facet, which is susceptible to the amplitude and direction of the fiber distortions. The fiber is mounted on an automatic translation stage, with repeating movement in four directions. The images are captured from an infrared camera and fed to a machine-learning program to train, validate, and test the fiber conditions. As a result, accuracy over 97% is achieved in recognizing fiber positions in these four directions, each with 10 classes, totaling an 8 mm span. The number of images taken for each class is merely 320. Detailed investigation reveals that the system can achieve over 60% accuracy in recognizing positions on a 5 µm resolution with a larger dataset, approaching the limit of the chosen translation stage.

Machine Learning-Based Classification of Vector Vortex Beams

Structured light is attracting significant attention for its diverse applications in both classical and quantum optics. The so-called vector vortex beams display peculiar properties in both contexts due to the nontrivial correlations between optical polarization and orbital angular momentum. Here we demonstrate a new, flexible experimental approach to the classification of vortex vector beams. We first describe a platform for generating arbitrary complex vector vortex beams inspired to photonic quantum walks. We then exploit recent machine learning methods-namely, convolutional neural networks and principal component analysis-to recognize and classify specific polarization patterns. Our study demonstrates the significant advantages resulting from the use of machine learning-based protocols for the construction and characterization of high-dimensional resources for quantum protocols.

Computational predictive approaches for interaction and structure of aptamers

Aptamers are short single-strand sequences that can bind to their specific targets with high affinity and specificity. Usually, aptamers are selected experimentally via systematic evolution of ligands by exponential enrichment (SELEX), an evolutionary process that consists of multiple cycles of selection and amplification. The SELEX process is expensive, time-consuming, and its success rates are relatively low. To overcome these difficulties, in recent years, several computational techniques have been developed in aptamer sciences that bring together different disciplines and branches of technologies. In this paper, a complementary review on computational predictive approaches of the aptamer has been organized. Generally, the computational prediction approaches of aptamer have been proposed to carry out in two main categories: interaction-based prediction and structure-based predictions. Furthermore, the available software packages and toolkits in this scope were reviewed. The aim of describing computational methods and tools in aptamer science is that aptamer scientists might take advantage of these computational techniques to develop more accurate and more sensitive aptamers.