Open problems in artificial life

Fundamental constraints to the logic of living systems

It has been argued that the historical nature of evolution makes it a highly path-dependent process. Under this view, the outcome of evolutionary dynamics could have resulted in organisms with different forms and functions. At the same time, there is ample evidence that convergence and constraints strongly limit the domain of the potential design principles that evolution can achieve. Are these limitations relevant in shaping the fabric of the possible? Here, we argue that fundamental constraints are associated with the logic of living matter. We illustrate this idea by considering the thermodynamic properties of living systems, the linear nature of molecular information, the cellular nature of the building blocks of life, multicellularity and development, the threshold nature of computations in cognitive systems and the discrete nature of the architecture of ecosystems. In all these examples, we present available evidence and suggest potential avenues towards a well-defined theoretical formulation.

Open-Endedness in Genelife

We explore the open-ended nature of evolution in Genelife, an evolutionary extension of Conway's Game of Life cellular automaton in which "live" cell states are endowed at birth with a genome that affects their local dynamics and can be inherited. Both genetic sequences and locally connected spatial patterns are analyzed for novelty, keeping track of all new structures, and innovation is quantified using activity statistics. The impacts of both spatial symmetry breaking with nontotalistic rules and superimposed density regulation of the live state proliferation on the open-ended nature of the evolution are explored. Conditions are found where both genetic and spatial patterns exhibit open-ended innovation. This innovation appears to fall short of functional biological innovation, however, and potential reasons for this are discussed.

On the Open-Endedness of Detecting Open-Endedness

We argue that attempting to quantify open-endedness misses the point: The nature of open-endedness is such that an open-ended system will eventually move outside its current model of behavior, and hence outside any measure based on that model. This presents a challenge for analyzing Artificial Life systems, leading us to conclude that the focus should be on understanding the mechanisms underlying open-endedness, not simply on attempting to quantify it. To demonstrate this, we apply several measures to eight long experimental runs of the spatial version of the Stringmol automata chemistry. These experiments were originally designed to examine the hypothesis that spatial structure provides a defense against parasites. The runs successfully show this defense, but also show a range of innovative, and possibly open-ended, behaviors involved in countering a parasitic arms race. Commencing with system-generic measures, we develop and use a variety of measures dedicated to analyzing some of these innovations. We argue that a process of analysis, starting with system-generic measures but going on to system-specific measures, will be needed wherever the phenomenon of open-endedness is involved.

Kuhnian Lessons for the Study of Open-Ended Evolution

Kuhnian philosophy of science implies that progress in the study of open-ended evolution (OEE) would be accelerated if the OEE science community were to agree on some examples of striking success in OEE science. This article recounts the important role of scientific paradigms and scientific exemplars in creating the productivity of what Kuhn, in The Structure of Scientific Revolutions, calls "normal" science, and it describes how the study of OEE today would benefit from exhibiting more of the hallmarks of normal science. The article concludes by describing five proposed projects that would help create a consensus in the OEE community on some good examples of the scientific study of OEE.

Evolved Open-Endedness in Cultural Evolution: A New Dimension in Open-Ended Evolution Research

The goal of Artificial Life research, as articulated by Chris Langton, is "to contribute to theoretical biology by locating life-as-we-know-it within the larger picture of life-as-it-could-be." The study and pursuit of open-ended evolution in artificial evolutionary systems exemplify this goal. However, open-ended evolution research is hampered by two fundamental issues: the struggle to replicate open-endedness in an artificial evolutionary system and our assumption that we only have one system (genetic evolution) from which to draw inspiration. We argue not only that cultural evolution should be seen as another real-world example of an open-ended evolutionary system but that the unique qualities seen in cultural evolution provide us with a new perspective from which we can assess the fundamental properties of, and ask new questions about, open-ended evolutionary systems, especially with regard to evolved open-endedness and transitions from bounded to unbounded evolution. Here we provide an overview of culture as an evolutionary system, highlight the interesting case of human cultural evolution as an open-ended evolutionary system, and contextualize cultural evolution by developing a new framework of (evolved) open-ended evolution. We go on to provide a set of new questions that can be asked once we consider cultural evolution within the framework of open-ended evolution and introduce new insights that we may be able to gain about evolved open-endedness as a result of asking these questions.

The Ethics of Life as It Could Be: Do We Have Moral Obligations to Artificial Life?

The field of Artificial Life studies the nature of the living state by modeling and synthesizing living systems. Such systems, under certain conditions, may come to deserve moral consideration similar to that given to nonhuman vertebrates or even human beings. The fact that these systems are nonhuman and evolve in a potentially radically different substrate should not be seen as an insurmountable obstacle to their potentially having rights, if they are sufficiently sophisticated in other respects. Nor should the fact that they owe their existence to us be seen as reducing their status as targets of moral concern. On the contrary, creators of Artificial Life may have special obligations to their creations, resembling those of an owner to their pet or a parent to their child. For a field that aims to create artificial life-forms with increasing levels of sophistication, it is crucial to consider the possible ethical implications of our activities, with an eye toward assessing potential moral obligations for which we should be prepared. If Artificial Life is larger than life, then the ethics of artificial beings should be larger than human ethics.

Open-endedness in synthetic biology: A route to continual innovation for biological design

Design in synthetic biology is typically goal oriented, aiming to repurpose or optimize existing biological functions, augmenting biology with new-to-nature capabilities, or creating life-like systems from scratch. While the field has seen many advances, bottlenecks in the complexity of the systems built are emerging and designs that function in the lab often fail when used in real-world contexts. Here, we propose an open-ended approach to biological design, with the novelty of designed biology being at least as important as how well it fulfils its goal. Rather than solely focusing on optimization toward a single best design, designing with novelty in mind may allow us to move beyond the diminishing returns we see in performance for most engineered biology. Research from the artificial life community has demonstrated that embracing novelty can automatically generate innovative and unexpected solutions to challenging problems beyond local optima. Synthetic biology offers the ideal playground to explore more creative approaches to biological design.

Simulating emergence of novelties using agent-based models

Understanding the growth and evolution of social networks is an important area of study, as these networks form the foundation for many popular online services such as social networking sites (SNS) and online games. However, previous models developed to explain the growth mechanisms of these networks have struggled to accurately reproduce certain behaviors that are frequently observed in real data, such as waves of novelty, in which new individuals or topics receive more attention than existing ones for a short period of time. In this study, we introduce a new model that incorporates context information into existing agent-based models in order to more accurately capture the structure and growth dynamics of these networks. Context information is introduced through labels based on the timing of appearance and relationships with antecedent agents. New agents are first added to the network when they are called by existing agents, and at this time they are also given a label. Agents added to the network at the same time by the same agent will have the same label. These labels are used to classify agents and give them different selection probabilities. This newly introduced selection probability creates a mechanism in which new agents receive attention beyond preferential attachment. By comparing the results of our model with real data on ten metrics, we demonstrate that it is able to produce behavior that more closely resembles real data. This improved understanding of the dynamics of social networks has important implications for designing effective interventions, including strategies for user acquisition and retention.

How Turing parasites expand the computational landscape of digital life

Why are living systems complex? Why does the biosphere contain living beings with complexity features beyond those of the simplest replicators? What kind of evolutionary pressures result in more complex life forms? These are key questions that pervade the problem of how complexity arises in evolution. One particular way of tackling this is grounded in an algorithmic description of life: living organisms can be seen as systems that extract and process information from their surroundings to reduce uncertainty. Here we take this computational approach using a simple bit string model of coevolving agents and their parasites. While agents try to predict their worlds, parasites do the same with their hosts. The result of this process is that, to escape their parasites, the host agents expand their computational complexity despite the cost of maintaining it. This, in turn, is followed by increasingly complex parasitic counterparts. Such arms races display several qualitative phases, from monotonous to punctuated evolution or even ecological collapse. Our minimal model illustrates the relevance of parasites in providing an active mechanism for expanding living complexity beyond simple replicators, suggesting that parasitic agents are likely to be a major evolutionary driver for biological complexity.

The Typical Set and Entropy in Stochastic Systems with Arbitrary Phase Space Growth

The existence of the typical set is key for data compression strategies and for the emergence of robust statistical observables in macroscopic physical systems. Standard approaches derive its existence from a restricted set of dynamical constraints. However, given its central role underlying the emergence of stable, almost deterministic statistical patterns, a question arises whether typical sets exist in much more general scenarios. We demonstrate here that the typical set can be defined and characterized from general forms of entropy for a much wider class of stochastic processes than was previously thought. This includes processes showing arbitrary path dependence, long range correlations or dynamic sampling spaces, suggesting that typicality is a generic property of stochastic processes, regardless of their complexity. We argue that the potential emergence of robust properties in complex stochastic systems provided by the existence of typical sets has special relevance to biological systems.

Molecular Information Theory Meets Protein Folding

We propose an application of molecular information theory to analyze the folding of single domain proteins. We analyze results from various areas of protein science, such as sequence-based potentials, reduced amino acid alphabets, backbone configurational entropy, secondary structure content, residue burial layers, and mutational studies of protein stability changes. We found that the average information contained in the sequences of evolved proteins is very close to the average information needed to specify a fold ∼2.2 ± 0.3 bits/(site·operation). The effective alphabet size in evolved proteins equals the effective number of conformations of a residue in the compact unfolded state at around 5. We calculated an energy-to-information conversion efficiency upon folding of around 50%, lower than the theoretical limit of 70%, but much higher than human-built macroscopic machines. We propose a simple mapping between molecular information theory and energy landscape theory and explore the connections between sequence evolution, configurational entropy, and the energetics of protein folding.

How Organisms Come to Know the World: Fundamental Limits on Artificial General Intelligence

Artificial intelligence has made tremendous advances since its inception about seventy years ago. Self-driving cars, programs beating experts at complex games, and smart robots capable of assisting people that need care are just some among the successful examples of machine intelligence. This kind of progress might entice us to envision a society populated by autonomous robots capable of performing the same tasks humans do in the near future. This prospect seems limited only by the power and complexity of current computational devices, which is improving fast. However, there are several significant obstacles on this path. General intelligence involves situational reasoning, taking perspectives, choosing goals, and an ability to deal with ambiguous information. We observe that all of these characteristics are connected to the ability of identifying and exploiting new affordances—opportunities (or impediments) on the path of an agent to achieve its goals. A general example of an affordance is the use of an object in the hands of an agent. We show that it is impossible to predefine a list of such uses. Therefore, they cannot be treated algorithmically. This means that “AI agents” and organisms differ in their ability to leverage new affordances. Only organisms can do this. This implies that true AGI is not achievable in the current algorithmic frame of AI research. It also has important consequences for the theory of evolution. We argue that organismic agency is strictly required for truly open-ended evolution through radical emergence. We discuss the diverse ramifications of this argument, not only in AI research and evolution, but also for the philosophy of science.

Continuous Cell-Free Replication and Evolution of Artificial Genomic DNA in a Compartmentalized Gene Expression System

In all living organisms, genomic DNA continuously replicates by the proteins encoded in itself and undergoes evolution through many generations of replication. This continuous replication coupled with gene expression and the resultant evolution are fundamental functions of living things, but they have not previously been reconstituted in cell-free systems. In this study, we combined an artificial DNA replication scheme with a reconstituted gene expression system and microcompartmentalization to realize these functions. Circular DNA replicated through rolling-circle replication followed by homologous recombination catalyzed by the proteins, phi29 DNA polymerase, and Cre recombinase expressed from the DNA. We encapsulated the system in microscale water-in-oil droplets and performed serial dilution cycles. Isolated circular DNAs at Round 30 accumulated several common mutations, and the isolated DNA clones exhibited higher replication abilities than the original DNA due to its improved ability as a replication template, increased polymerase activity, and a reduced inhibitory effect of polymerization by the recombinase. The artificial genomic DNA, which continuously replicates using self-encoded proteins and autonomously improves its sequence, provides a useful starting point for the development of more complex artificial cells.

The Multiple Paths to Multiple Life

We argue for multiple forms of life realized through multiple different historical pathways. From this perspective, there have been multiple origins of life on Earth—life is not a universal homology. By broadening the class of originations, we significantly expand the data set for searching for life. Through a computational analogy, the origin of life describes both the origin of hardware (physical substrate) and software (evolved function). Like all information-processing systems, adaptive systems possess a nested hierarchy of levels, a level of function optimization (e.g., fitness maximization), a level of constraints (e.g., energy requirements), and a level of materials (e.g., DNA or RNA genome and cells). The functions essential to life are realized by different substrates with different efficiencies. The functional level allows us to identify multiple origins of life by searching for key principles of optimization in different material form, including the prebiotic origin of proto-cells, the emergence of culture, economic, and legal institutions, and the reproduction of software agents.

Radiolysis generates a complex organosynthetic chemical network

The architectural features of cellular life and its ecologies at larger scales are built upon foundational networks of reactions between molecules that avoid a collapse to equilibrium. The search for life’s origins is, in some respects, a search for biotic network attributes in abiotic chemical systems. Radiation chemistry has long been employed to model prebiotic reaction networks, and here we report network-level analyses carried out on a compiled database of radiolysis reactions, acquired by the scientific community over decades of research. The resulting network shows robust connections between abundant geochemical reservoirs and the production of carboxylic acids, amino acids, and ribonucleotide precursors—the chemistry of which is predominantly dependent on radicals. Moreover, the network exhibits the following measurable attributes associated with biological systems: (1) the species connectivity histogram exhibits a heterogeneous (heavy-tailed) distribution, (2) overlapping families of closed-loop cycles, and (3) a hierarchical arrangement of chemical species with a bottom-heavy energy-size spectrum. The latter attribute is implicated with stability and entropy production in complex systems, notably in ecology where it is known as a trophic pyramid. Radiolysis is implicated as a driver of abiotic chemical organization and could provide insights about the complex and perhaps radical-dependent mechanisms associated with life’s origins.

Self-Organization and Artificial Life

Self-organization can be broadly defined as the ability of a system to display ordered spatiotemporal patterns solely as the result of the interactions among the system components. Processes of this kind characterize both living and artificial systems, making self-organization a concept that is at the basis of several disciplines, from physics to biology and engineering. Placed at the frontiers between disciplines, artificial life (ALife) has heavily borrowed concepts and tools from the study of self-organization, providing mechanistic interpretations of lifelike phenomena as well as useful constructivist approaches to artificial system design. Despite its broad usage within ALife, the concept of self-organization has been often excessively stretched or misinterpreted, calling for a clarification that could help with tracing the borders between what can and cannot be considered self-organization. In this review, we discuss the fundamental aspects of self-organization and list the main usages within three primary ALife domains, namely "soft" (mathematical/computational modeling), "hard" (physical robots), and "wet" (chemical/biological systems) ALife. We also provide a classification to locate this research. Finally, we discuss the usefulness of self-organization and related concepts within ALife studies, point to perspectives and challenges for future research, and list open questions. We hope that this work will motivate discussions related to self-organization in ALife and related fields.

A new biological definition of life

Here we have proposed a new biological definition of life based on the function and reproduction of existing genes and creation of new ones, which is applicable to both unicellular and multicellular organisms. First, we coined a new term "genetic information metabolism" comprising functioning, reproduction, and creation of genes and their distribution among living and non-living carriers of genetic information. Encompassing this concept, life is defined as organized matter that provides genetic information metabolism. Additionally, we have articulated the general biological function of life as Tetz biological law: "General biological function of life is to provide genetic information metabolism" and formulated novel definition of life: "Life is an organized matter that provides genetic information metabolism". New definition of life and Tetz biological law allow to distinguish in a new way living and non-living objects on Earth and other planets based on providing genetic information metabolism.

Percolation clusters of organics in interstellar ice grains as the incubators of life

Biomolecules can be synthesized in interstellar ice grains subject to UV radiation and cosmic rays. I show that on time scales of ≳10⁶ years, these processes lead to the formation of large percolation clusters of organic molecules. Some of these clusters would have ended up on proto-planets where large, loosely bound aggregates of clusters (superclusters) would have formed. The interior regions of such superclusters provided for chemical micro-environments that are filtered versions of the outside environment. I argue that models for abiogenesis are more likely to work when considered inside such micro-environments. As the supercluster breaks up, biochemical systems in such micro-environments gradually become subject to a less filtered environment, allowing them to get adapted to the more complex outside environment. A particular system originating from a particular location on some supercluster would have been the first to get adapted to the raw outside environment and survive there, thereby becoming the first microbe. A collision of a microbe-containing proto-planet with the Moon could have led to fragments veering off back into space, microbes in small fragments would have been able to survive a subsequent impact with the Earth.

Hidden Concepts in the History and Philosophy of Origins-of-Life Studies: a Workshop Report

In this review, we describe some of the central philosophical issues facing origins-of-life research and provide a targeted history of the developments that have led to the multidisciplinary field of origins-of-life studies. We outline these issues and developments to guide researchers and students from all fields. With respect to philosophy, we provide brief summaries of debates with respect to (1) definitions (or theories) of life, what life is and how research should be conducted in the absence of an accepted theory of life, (2) the distinctions between synthetic, historical, and universal projects in origins-of-life studies, issues with strategies for inferring the origins of life, such as (3) the nature of the first living entities (the "bottom up" approach) and (4) how to infer the nature of the last universal common ancestor (the "top down" approach), and (5) the status of origins of life as a science. Each of these debates influences the others. Although there are clusters of researchers that agree on some answers to these issues, each of these debates is still open. With respect to history, we outline several independent paths that have led to some of the approaches now prevalent in origins-of-life studies. These include one path from early views of life through the scientific revolutions brought about by Linnaeus (von Linn.), Wöhler, Miller, and others. In this approach, new theories, tools, and evidence guide new thoughts about the nature of life and its origin. We also describe another family of paths motivated by a" circularity" approach to life, which is guided by such thinkers as Maturana & Varela, Gánti, Rosen, and others. These views echo ideas developed by Kant and Aristotle, though they do so using modern science in ways that produce exciting avenues of investigation. By exploring the history of these ideas, we can see how many of the issues that currently interest us have been guided by the contexts in which the ideas were developed. The disciplinary backgrounds of each of these scholars has influenced the questions they sought to answer, the experiments they envisioned, and the kinds of data they collected. We conclude by encouraging scientists and scholars in the humanities and social sciences to explore ways in which they can interact to provide a deeper understanding of the conceptual assumptions, structure, and history of origins-of-life research. This may be useful to help frame future research agendas and bring awareness to the multifaceted issues facing this challenging scientific question.

Open-Ended Evolution and Open-Endedness: Editorial Introduction to the Open-Ended Evolution I Special Issue

Nature's spectacular inventiveness, reflected in the enormous diversity of form and function displayed by the biosphere, is a feature of life that distinguishes living most strongly from nonliving. It is, therefore, not surprising that this aspect of life should become a central focus of artificial life. We have known since Darwin that the diversity is produced dynamically, through the process of evolution; this has led life's creative productivity to be called Open-Ended Evolution (OEE) in the field. This article introduces the first of two special issues on current research on OEE and on the more general concept of open-endedness. Most of the papers presented in these special issues are elaborations of work presented at the Third Workshop on Open-Ended Evolution, held in Tokyo as part of the 2018 Conference on Artificial Life.

Open-Endedness for the Sake of Open-Endedness

Natural evolution keeps inventing new complex and intricate forms and behaviors. Digital evolution and genetic algorithms fail to create the same kind of complexity, not just because we still lack the computational resources to rival nature, but because (it has been argued) we have not understood in principle how to create open-ended evolving systems. Much effort has been made to define such open-endedness so as to create forms of increasing complexity indefinitely. Here, however, a simple evolving computational system that satisfies all such requirements is presented. Doing so reveals a shortcoming in the definitions for open-ended evolution. The goal to create models that rival biological complexity remains. This work suggests that our current definitions allow for even simple models to pass as open-ended, and that our definitions of complexity and diversity are more important for the quest of open-ended evolution than the fact that something runs indefinitely.

Evolved Open-Endedness, Not Open-Ended Evolution

Open-endedness is often considered a prerequisite property of the whole evolutionary system and its dynamical behaviors. In the actual history of evolution on Earth, however, there are many examples showing that open-endedness is rather a consequence of evolution. We suggest that this view, which we call evolved open-endedness (EOE), be incorporated more into research on open-ended evolution. This view should allow for systematic investigation of more nuanced, more concrete research questions about open-endedness and its relationship with adaptation and sustainability.

On the Potential for Open-Endedness in Neural Networks

Natural evolution gives the impression of leading to an open-ended process of increasing diversity and complexity. If our goal is to produce such open-endedness artificially, this suggests an approach driven by evolutionary metaphor. On the other hand, techniques from machine learning and artificial intelligence are often considered too narrow to provide the sort of exploratory dynamics associated with evolution. In this article, we hope to bridge that gap by reviewing common barriers to open-endedness in the evolution-inspired approach and how they are dealt with in the evolutionary case-collapse of diversity, saturation of complexity, and failure to form new kinds of individuality. We then show how these problems map onto similar ones in the machine learning approach, and discuss how the same insights and solutions that alleviated those barriers in evolutionary approaches can be ported over. At the same time, the form these issues take in the machine learning formulation suggests new ways to analyze and resolve barriers to open-endedness. Ultimately, we hope to inspire researchers to be able to interchangeably use evolutionary and gradient-descent-based machine learning methods to approach the design and creation of open-ended systems.

Why Open-Endedness Matters

Rather than acting as a review or analysis of the field, this essay focuses squarely on the motivations for investigating open-endedness and the opportunities it opens up. It begins by contemplating the awesome accomplishments of evolution in nature and the profound implications if such a process could be ignited on a computer. Some of the milestones in our understanding so far are then discussed, finally closing by highlighting the grand challenge of formalizing open-endedness as a computational process that can be encoded as an algorithm. The main contribution is to articulate why open-endedness deserves a place alongside artificial intelligence as one of the great computational challenges, and opportunities, of our time.

Zipf's Law, unbounded complexity and open-ended evolution

A major problem for evolutionary theory is understanding the so-called open-ended nature of evolutionary change, from its definition to its origins. Open-ended evolution (OEE) refers to the unbounded increase in complexity that seems to characterize evolution on multiple scales. This property seems to be a characteristic feature of biological and technological evolution and is strongly tied to the generative potential associated with combinatorics, which allows the system to grow and expand their available state spaces. Interestingly, many complex systems presumably displaying OEE, from language to proteins, share a common statistical property: the presence of Zipf's Law. Given an inventory of basic items (such as words or protein domains) required to build more complex structures (sentences or proteins) Zipf's Law tells us that most of these elements are rare whereas a few of them are extremely common. Using algorithmic information theory, in this paper we provide a fundamental definition for open-endedness, which can be understood as postulates. Its statistical counterpart, based on standard Shannon information theory, has the structure of a variational problem which is shown to lead to Zipf's Law as the expected consequence of an evolutionary process displaying OEE. We further explore the problem of information conservation through an OEE process and we conclude that statistical information (standard Shannon information) is not conserved, resulting in the paradoxical situation in which the increase of information content has the effect of erasing itself. We prove that this paradox is solved if we consider non-statistical forms of information. This last result implies that standard information theory may not be a suitable theoretical framework to explore the persistence and increase of the information content in OEE systems.

Embodied Evolution in Collective Robotics: A Review

This article provides an overview of evolutionary robotics techniques applied to online distributed evolution for robot collectives, namely, embodied evolution. It provides a definition of embodied evolution as well as a thorough description of the underlying concepts and mechanisms. This article also presents a comprehensive summary of research published in the field since its inception around the year 2000, providing various perspectives to identify the major trends. In particular, we identify a shift from considering embodied evolution as a parallel search method within small robot collectives (fewer than 10 robots) to embodied evolution as an online distributed learning method for designing collective behaviors in swarm-like collectives. This article concludes with a discussion of applications and open questions, providing a milestone for past and an inspiration for future research.

Undecidability and Irreducibility Conditions for Open-Ended Evolution and Emergence

Is undecidability a requirement for open-ended evolution (OEE)? Using methods derived from algorithmic complexity theory, we propose robust computational definitions of open-ended evolution and the adaptability of computable dynamical systems. Within this framework, we show that decidability imposes absolute limits on the stable growth of complexity in computable dynamical systems. Conversely, systems that exhibit (strong) open-ended evolution must be undecidable, establishing undecidability as a requirement for such systems. Complexity is assessed in terms of three measures: sophistication, coarse sophistication, and busy beaver logical depth. These three complexity measures assign low complexity values to random (incompressible) objects. As time grows, the stated complexity measures allow for the existence of complex states during the evolution of a computable dynamical system. We show, however, that finding these states involves undecidable computations. We conjecture that for similar complexity measures that assign low complexity values, decidability imposes comparable limits on the stable growth of complexity, and that such behavior is necessary for nontrivial evolutionary systems. We show that the undecidability of adapted states imposes novel and unpredictable behavior on the individuals or populations being modeled. Such behavior is irreducible. Finally, we offer an example of a system, first proposed by Chaitin, that exhibits strong OEE.

The Grand Challenges Discourse: Transforming Identity Work in Science and Science Policy

This article analyzes the concept of "grand challenges" as part of a shift in how scientists and policymakers frame and communicate their respective agendas. The history of the grand challenges discourse helps to understand how identity work in science and science policy has been transformed in recent decades. Furthermore, the question is raised whether this discourse is only an indicator, or also a factor in this transformation. Building on conceptual history and historical semantics, the two parts of the article reconstruct two discursive shifts. First, the observation that in scientific communication references to "problems" are increasingly substituted by references to "challenges" indicates a broader cultural trend of how attitudes towards what is problematic have shifted in the last decades. Second, as the grand challenges discourse is rooted in the sphere of sports and competition, it introduces a specific new set of societal values and practices into the spheres of science and technology. The article concludes that this process can be characterized as the sportification of science, which contributes to self-mobilization and, ultimately, to self-optimization of the participating scientists, engineers, and policymakers.

Biomimetic molecular design tools that learn, evolve, and adapt

A dominant hallmark of living systems is their ability to adapt to changes in the environment by learning and evolving. Nature does this so superbly that intensive research efforts are now attempting to mimic biological processes. Initially this biomimicry involved developing synthetic methods to generate complex bioactive natural products. Recent work is attempting to understand how molecular machines operate so their principles can be copied, and learning how to employ biomimetic evolution and learning methods to solve complex problems in science, medicine and engineering. Automation, robotics, artificial intelligence, and evolutionary algorithms are now converging to generate what might broadly be called in silico-based adaptive evolution of materials. These methods are being applied to organic chemistry to systematize reactions, create synthesis robots to carry out unit operations, and to devise closed loop flow self-optimizing chemical synthesis systems. Most scientific innovations and technologies pass through the well-known "S curve", with slow beginning, an almost exponential growth in capability, and a stable applications period. Adaptive, evolving, machine learning-based molecular design and optimization methods are approaching the period of very rapid growth and their impact is already being described as potentially disruptive. This paper describes new developments in biomimetic adaptive, evolving, learning computational molecular design methods and their potential impacts in chemistry, engineering, and medicine.

Formal Definitions of Unbounded Evolution and Innovation Reveal Universal Mechanisms for Open-Ended Evolution in Dynamical Systems

Open-ended evolution (OEE) is relevant to a variety of biological, artificial and technological systems, but has been challenging to reproduce in silico. Most theoretical efforts focus on key aspects of open-ended evolution as it appears in biology. We recast the problem as a more general one in dynamical systems theory, providing simple criteria for open-ended evolution based on two hallmark features: unbounded evolution and innovation. We define unbounded evolution as patterns that are non-repeating within the expected Poincare recurrence time of an isolated system, and innovation as trajectories not observed in isolated systems. As a case study, we implement novel variants of cellular automata (CA) where the update rules are allowed to vary with time in three alternative ways. Each is capable of generating conditions for open-ended evolution, but vary in their ability to do so. We find that state-dependent dynamics, regarded as a hallmark of life, statistically out-performs other candidate mechanisms, and is the only mechanism to produce open-ended evolution in a scalable manner, essential to the notion of ongoing evolution. This analysis suggests a new framework for unifying mechanisms for generating OEE with features distinctive to life and its artifacts, with broad applicability to biological and artificial systems.

How evolution learns to generalise: Using the principles of learning theory to understand the evolution of developmental organisation

One of the most intriguing questions in evolution is how organisms exhibit suitable phenotypic variation to rapidly adapt in novel selective environments. Such variability is crucial for evolvability, but poorly understood. In particular, how can natural selection favour developmental organisations that facilitate adaptive evolution in previously unseen environments? Such a capacity suggests foresight that is incompatible with the short-sighted concept of natural selection. A potential resolution is provided by the idea that evolution may discover and exploit information not only about the particular phenotypes selected in the past, but their underlying structural regularities: new phenotypes, with the same underlying regularities, but novel particulars, may then be useful in new environments. If true, we still need to understand the conditions in which natural selection will discover such deep regularities rather than exploiting ‘quick fixes’ (i.e., fixes that provide adaptive phenotypes in the short term, but limit future evolvability). Here we argue that the ability of evolution to discover such regularities is formally analogous to learning principles, familiar in humans and machines, that enable generalisation from past experience. Conversely, natural selection that fails to enhance evolvability is directly analogous to the learning problem of over-fitting and the subsequent failure to generalise. We support the conclusion that evolving systems and learning systems are different instantiations of the same algorithmic principles by showing that existing results from the learning domain can be transferred to the evolution domain. Specifically, we show that conditions that alleviate over-fitting in learning systems successfully predict which biological conditions (e.g., environmental variation, regularity, noise or a pressure for developmental simplicity) enhance evolvability. This equivalence provides access to a well-developed theoretical framework from learning theory that enables a characterisation of the general conditions for the evolution of evolvability.

A striking feature of evolving organisms is their ability to acquire novel characteristics that help them adapt in new environments. The origin and the conditions of such ability remain elusive and is a long-standing question in evolutionary biology. Recent theory suggests that organisms can evolve designs that help them generate novel features that are more likely to be beneficial. Specifically, this is possible when the environments that organisms are exposed to share common regularities. However, the organisms develop robust designs that tend to produce what had been selected in the past and might be inflexible for future environments. The resolution comes from a recent theory introduced by Watson and Szathmáry that suggests a deep analogy between learning and evolution. Accordingly, here we utilise learning theory to explain the conditions that lead to more evolvable designs. We successfully demonstrate this by equating evolvability to the way humans and machines generalise to previously-unseen situations. Specifically, we show that the same conditions that enhance generalisation in learning systems have biological analogues and help us understand why environmental noise and the reproductive and maintenance costs of gene-regulatory connections can lead to more evolvable designs.

Defining and simulating open-ended novelty: requirements, guidelines, and challenges

The open-endedness of a system is often defined as a continual production of novelty. Here we pin down this concept more fully by defining several types of novelty that a system may exhibit, classified as variation, innovation, and emergence. We then provide a meta-model for including levels of structure in a system's model. From there, we define an architecture suitable for building simulations of open-ended novelty-generating systems and discuss how previously proposed systems fit into this framework. We discuss the design principles applicable to those systems and close with some challenges for the community.

Computational Social Creativity

This article reviews the development of computational models of creativity where social interactions are central. We refer to this area as computational social creativity. Its context is described, including the broader study of creativity, the computational modeling of other social phenomena, and computational models of individual creativity. Computational modeling has been applied to a number of areas of social creativity and has the potential to contribute to our understanding of creativity. A number of requirements for computational models of social creativity are common in artificial life and computational social science simulations. Three key themes are identified: (1) computational social creativity research has a critical role to play in understanding creativity as a social phenomenon and advancing computational creativity by making clear epistemological contributions in ways that would be challenging for other approaches; (2) the methodologies developed in artificial life and computational social science carry over directly to computational social creativity; and (3) the combination of computational social creativity with individual models of creativity presents significant opportunities and poses interesting challenges for the development of integrated models of creativity that have yet to be realized.

Toy models for macroevolutionary patterns and trends

Many models have been used to simplify and operationalize the subtle but complex mechanisms of biological evolution. Toy models are gross simplifications that nevertheless attempt to retain major essential features of evolution, bridging the gap between empirical reality and formal theoretical understanding. In this paper, we examine thirteen models which describe evolution that also qualify as such toy models, including the tree of life, branching processes, adaptive ratchets, fitness landscapes, and the role of nonlinear avalanches in evolutionary dynamics. Such toy models are intended to capture features such as evolutionary trends, coupled evolutionary dynamics of phenotype and genotype, adaptive change, branching, and evolutionary transience. The models discussed herein are applied to specific evolutionary contexts in various ways that simplify the complexity inherent in evolving populations. While toy models are overly simplistic, they also provide sufficient dynamics for capturing the fundamental mechanism(s) of evolution. Toy models might also be used to aid in high-throughput data analysis and the understanding of cultural evolutionary trends. This paper should serve as an introductory guide to the toy modeling of evolutionary complexity.

Combining environment-driven adaptation and task-driven optimisation in evolutionary robotics

Embodied evolutionary robotics is a sub-field of evolutionary robotics that employs evolutionary algorithms on the robotic hardware itself, during the operational period, i.e., in an on-line fashion. This enables robotic systems that continuously adapt, and are therefore capable of (re-)adjusting themselves to previously unknown or dynamically changing conditions autonomously, without human oversight. This paper addresses one of the major challenges that such systems face, viz. that the robots must satisfy two sets of requirements. Firstly, they must continue to operate reliably in their environment (viability), and secondly they must competently perform user-specified tasks (usefulness). The solution we propose exploits the fact that evolutionary methods have two basic selection mechanisms–survivor selection and parent selection. This allows evolution to tackle the two sets of requirements separately: survivor selection is driven by the environment and parent selection is based on task-performance. This idea is elaborated in the Multi-Objective aNd open-Ended Evolution (monee) framework, which we experimentally validate. Experiments with robotic swarms of 100 simulated e-pucks show that monee does indeed promote task-driven behaviour without compromising environmental adaptation. We also investigate an extension of the parent selection process with a ‘market mechanism’ that can ensure equitable distribution of effort over multiple tasks, a particularly pressing issue if the environment promotes specialisation in single tasks.

Toward metabolic robotics: insights from modeling embodied cognition in a biomechatronic symbiont

We present a novel example of a biomechatronic hybrid system. The living component of the system, embedded within microbial fuel cells, relies on the availability of food and water in order to produce electrical energy. The latter is essential to the operations of the mechatronic component, responsible for finding and collecting food and water, and for the execution of work. In simulation, we explore the behavioral and cognitive consequences of this symbiotic relation. In particular we highlight the importance of the integration of sensorimotor and metabolic signals within an evolutionary perspective, in order to create sound cognitive living technology.

Living in living cities

This article presents an overview of current and potential applications of living technology to some urban problems. Living technology can be described as technology that exhibits the core features of living systems. These features can be useful to solve dynamic problems. In particular, urban problems concerning mobility, logistics, telecommunications, governance, safety, sustainability, and society and culture are presented, and solutions involving living technology are reviewed. A methodology for developing living technology is mentioned, and supraoptimal public transportation systems are used as a case study to illustrate the benefits of urban living technology. Finally, the usefulness of describing cities as living systems is discussed.

Analysis of competition between transformation pathways in the functioning of biotic abstract dual automata

Properties of avenues of transformation and their mutualism with forms of organization in dynamic systems are essential for understanding the evolution of prebiotic order. We have analyzed competition between two avenues of transformation in an A↔B system, using the simulation approach called BiADA (Biotic Abstract Dual Automata). We discuss means of avoiding common pitfalls of abstract system modeling and benefits of BiADA-based simulations. We describe the effect of the availability of free energy, energy sink magnitude, and autocatalysis on the evolution of energy flux and order in the system. Results indicate that prebiotic competition between avenues of transformation was more stringent in energy-limited environments. We predict that in such conditions the efficiency of autocatalysis during competition between alternative system states will increase for systems with forms of organization having short half-lives and thus information that is time-sensitive to energy starvation. Our results also offer a potential solution to Manfred Eigen's error catastrophe dilemma. In the conditions discussed above, the exponential growth of quasi species is curbed through the removal of less competitive "genetic" variants via energy starvation. We propose that one of the most important achievements (and selective edges) of a dynamic network during competition in energy-limited or energy-variable environments was the capacity to correlate the internal energy flux and the need for free energy with the availability of free energy in the environment.

Biotic Abstract Dual Automata (BiADA): a novel tool for studying the evolution of porebiotic order (and the origin of life)

Biotic Abstract Dual Automata (BiADA), a novel simulation concept for studying the evolution of prebiotic order, has four main attributes. (1) The energy of each form of organization is the sum of two stocks: entropy-associated energy (E(s)) and free energy (E(g)), with dissimilar meaning, energy conductive, and energy exchange properties; (2) E(s) and E(g) have user-defined absolute values and are not derived from the relative thermodynamic parameters standard entropy and standard Gibbs free energy; (3) BiADA analyzes changes in both units of transformation and units of organization; and (4) BiADA-based models analyze forward and reverse transformations separately and the brut production of forms of organization. We discuss quantitative relationships between energy, information, and order parameters proposed in BiADA-based simulations. The example we show is that of a simple system with two forms of organization. The model monitors the energy flow and budget, the evolution of order and information capacity, and the energy cost of producing and maintaining the system's state. We show the effect of six prebiotic factors on the evolution of order and energy dissipative potential of the system. These are the initial state of the system, energy availability, the intrinsic energy conductivity, catalysis of "A to B" transformations, B autocatalysis, and the terminal heat sink. We discuss benefits of employing BiADA principles in the study of the origin of order in more complex networks.

Is there an optimal level of open-endedness in prebiotic evolution?

In this paper we explore the question of whether there is an optimal set up for a putative prebiotic system leading to open-ended evolution (OEE) of the events unfolding within this system. We do so by proposing two key innovations. First, we introduce a new index that measures OEE as a function of the likelihood of events unfolding within a universe given its initial conditions. Next, we apply this index to a variant of the graded autocatalysis replication domain (GARD) model, Segre et al. (P Natl Acad Sci USA 97(8):4112-4117, 2000; Markovitch and Lancet Artif Life 18(3), 2012), and use it to study--under a unified and concise prebiotic evolutionary framework--both a variety of initial conditions of the universe and the OEE of species that evolve from them.