Intrinsically motivated collective motion

Active many-particle systems and the emergent behavior of dense ant collectives

This article discusses recent work with fire ants,Solenopisis invicta, to illustrate the use of the framework of active matter as a base to rationalize their complex collective behavior. We review much of the work that physicists have done on the group dynamics of these ants, and compare their behavior to two minimal models of active matter, and to the behavior of the synthetic systems that have served to test and drive these models.

Emergence of intelligent collective motion in a group of agents with memory

Intelligent agents collect and process information from their dynamically evolving neighborhood to efficiently navigate through it. However, agent-level intelligence does not guarantee that at the level of a collective; a common example is the jamming we observe in traffic flows. In this study, we ask: how and when do the interactions between intelligent agents translate to desirable or intelligent collective outcomes? To explore this question, we choose a collective consisting of two kinds of agents with opposing desired directions of movement. Agents in this collective are minimally intelligent: they possess only a single facet of intelligence, viz., memory, where the agents remember how well they were able to travel in their desired directions and make up for their non-optimal past. We find that dynamics due to the agent's memory influences the collective, giving rise to diverse outcomes at the level of the group: from those that are undesirable to those that can be called "intelligent." When memory is short term, local rearrangement of agents leads to the formation of symmetrically jammed arrangements that take longer to unjam. However, when agents remember across longer time-scales, their dynamics become sensitive to small differences in their movement history. This gives rise to heterogeneity in the movement that causes agents to unjam more readily and form lanes.

Perspectives on adaptive dynamical systems

Adaptivity is a dynamical feature that is omnipresent in nature, socio-economics, and technology. For example, adaptive couplings appear in various real-world systems, such as the power grid, social, and neural networks, and they form the backbone of closed-loop control strategies and machine learning algorithms. In this article, we provide an interdisciplinary perspective on adaptive systems. We reflect on the notion and terminology of adaptivity in different disciplines and discuss which role adaptivity plays for various fields. We highlight common open challenges and give perspectives on future research directions, looking to inspire interdisciplinary approaches.

Optimal foraging strategies for mutually avoiding competitors

Many animals are known to exhibit foraging patterns where the distances they travel in a given direction are drawn from a heavy-tailed Lévy distribution. Previous studies have shown that, under sparse and random resource conditions, solitary non-destructive (with regenerating resources) foragers perform a maximally efficient search with Lévy exponent μ equal to 2, while for destructive foragers, efficiency decreases with μ monotonically and there is no optimal μ. However, in nature, there also exist situations where multiple foragers, displaying avoidance behavior, interact with each other competitively. To understand the effects of such competition, we develop a stochastic agent-based simulation that models competitive foraging among mutually avoiding individuals by incorporating an avoidance zone, or territory, of a certain size around each forager which is not accessible for foraging by other competitors. For non-destructive foraging, our results show that with increasing size of the territory and number of agents the optimal Lévy exponent is still approximately 2 while the overall efficiency of the search decreases. At low values of the Lévy exponent, however, increasing territory size actually increases efficiency. For destructive foraging, we show that certain kinds of avoidance can lead to qualitatively different behavior from solitary foraging, such as the existence of an optimal search with 1<μ<2. Finally, we show that the variance among the efficiencies of the agents increases with increasing Lévy exponent for both solitary and competing foragers, suggesting that reducing variance might be a selective pressure for foragers adopting lower values of μ. Taken together, our results suggest that, for multiple foragers, mutual avoidance and efficiency variance among individuals can lead to optimal Lévy searches with exponents different from those for solitary foragers.

Environmental Path-Entropy and Collective Motion

Inspired by the swarming or flocking of animal systems we study groups of agents moving in unbounded 2D space. Individual trajectories derive from a "bottom-up" principle: individuals reorient to maximize their future path entropy over environmental states. This can be seen as a proxy for keeping options open, a principle that may confer evolutionary fitness in an uncertain world. We find an ordered (coaligned) state naturally emerges, as well as disordered states or rotating clusters; similar phenotypes are observed in birds, insects, and fish, respectively. The ordered state exhibits an order-disorder transition under two forms of noise: (i) standard additive orientational noise, applied to the postdecision orientations and (ii) "cognitive" noise, overlaid onto each individual's model of the future paths of other agents. Unusually, the order increases at low noise, before later decreasing through the order-disorder transition as the noise increases further.

Stochasticity may generate coherent motion in bird flocks

Murmurations along with other forms of flocking have come to epitomize collective animal movements. Most studies into these stunning aerial displays have aimed to understand how coherent motion may emerge from simple behavioral rules and behavioral correlations. These studies may now need revision because recently it has been shown that flocking birds, like swarming insects, behave on the average as if they are trapped in elastic potential wells. Here I show, somewhat paradoxically, how coherent motion can be generated by variations in the intensity of multiplicative noise which causes the shape of a potential well to change, thereby shifting the positions and strengths of centres of attraction. Each bird, irrespective of its position in the flock will respond in a similar way to such changes, giving the impression that the flock behaves as one, and typically resulting in scale-free correlations. I thereby show how correlations can be an emergent property of noisy, confining potential wells. I also show how such wells can lead to high density borders, a characteristic of flocks, and I show how they can account for the complex patterns of collective escape patterns of starling flocks under predation. I suggest swarming and flocking do not constitute two distinctly different kinds of collective behavior but rather that insects are residing in relatively stable potential wells whilst birds are residing in unstable potential wells. It is shown how, dependent upon individual perceptual capabilities, bird flocks can be poised at criticality.

Functional duality in group criticality via ambiguous interactions

Critical phenomena are wildly observed in living systems. If the system is at criticality, it can quickly transfer information and achieve optimal response to external stimuli. Especially, animal collective behavior has numerous critical properties, which are related to other research regions, such as the brain system. Although the critical phenomena influencing collective behavior have been extensively studied, two important aspects require clarification. First, these critical phenomena never occur on a single scale but are instead nested from the micro- to macro-levels (e.g., from a Lévy walk to scale-free correlation). Second, the functional role of group criticality is unclear. To elucidate these aspects, the ambiguous interaction model is constructed in this study; this model has a common framework and is a natural extension of previous representative models (such as the Boids and Vicsek models). We demonstrate that our model can explain the nested criticality of collective behavior across several scales (considering scale-free correlation, super diffusion, Lévy walks, and 1/f fluctuation for relative velocities). Our model can also explain the relationship between scale-free correlation and group turns. To examine this relation, we propose a new method, applying partial information decomposition (PID) to two scale-free induced subgroups. Using PID, we construct information flows between two scale-free induced subgroups and find that coupling of the group morphology (i.e., the velocity distributions) and its fluctuation power (i.e., the fluctuation distributions) likely enable rapid group turning. Thus, the flock morphology may help its internal fluctuation convert to dynamic behavior. Our result sheds new light on the role of group morphology, which is relatively unheeded, retaining the importance of fluctuation dynamics in group criticality.

Effects of shady environments on fish collective behavior

Despite significant efforts devoted to understanding the underlying complexity and emergence of collective movement in animal groups, the role of different external settings on this type of movement remains largely unexplored. Here, by combining time series analysis and complex network tools, we present an extensive investigation of the effects of shady environments on the behavior of a fish species (Silver Carp Hypophthalmichthys molitrix) within earthen ponds. We find that shade encourages fish residence during daylight hours, but the degree of preference for shade varies substantially among trials and ponds. Silver Carp are much slower and exhibit lower persistence in their speeds when under shade than out of it during daytime and nighttime, with fish displaying the highest persistence degree and speeds at night. Furthermore, our research shows that shade affects fish schooling behavior by reducing their polarization, number of interactions among individuals, and the stability among local neighbors; however, fish keep a higher local degree of order when under shade compared to nighttime positions.

Alignment with neighbours enables escape from dead ends in flocking models

Coordinated movement in animal groups (flocks, schools, herds, etc.) is a classic and well-studied form of collective behaviour. Most theoretical studies consider agents in unobstructed spaces; however, many animals move in often complicated environments and must navigate around and through obstacles. Here we consider simulated agents behaving according to typical flocking rules, with the addition of repulsion from obstacles, and study their collective behaviour in environments with concave obstacles (dead ends). We find that groups of such agents heading for a goal can spontaneously escape dead ends without wall-following or other specialized behaviours, in what we term 'flocking escapes'. The mechanism arises when agents align with one another while heading away from the goal, forming a self-stable cluster that persists long enough to exit the obstacle and avoids becoming trapped again when turning back towards the goal. Solitary agents under the same conditions are never observed to escape. We show that alignment with neighbours reduces the effective turning speed of the group while letting individuals maintain high manoeuvrability when needed. The relative robustness of flocking escapes in our studies suggests that this emergent behaviour may be relevant for a variety of animal species.

Spontaneous response of a self-organized fish school to a predator

While the collective movements of fish schools evading predators in nature are complex, they can be fundamentally represented by simplified mathematical models. Here we develop a numerical model, which considers self-propelled particles subject to phenomenological behavioural rules and the hydrodynamic interactions between individuals. We introduce a predator in this model, to study the spontaneous response of a group of simulated fish to the threat. A self-organized fish school with a milling pattern is considered, which was expected to be efficient to evade the threat of predators. Four different attack tactics are adopted by the predator. We find that the simulated fish form transiently smaller structures as some prey individuals split from the main group, but eventually they will re-organize, sometimes into sub groups when the simulated predator approaches the fish school unidirectionally or take a reciprocating action. As the predator is programmed to target the centroid, the school ends in a gradually enlarging circle. For the fourth tactic, as the predator chases its nearest prey, the fish school's response varies with the predator's delay factor. Moreover, the average speed of the group and the distance between individuals have also been studied, both demonstrating that the fish school is able to respond spontaneously to the predator's invasion. We demonstrate that the currently adopted model can predict prey-predator interactions.

Fluctuation-Induced Phase Separation in Metric and Topological Models of Collective Motion

We study the role of noise on the nature of the transition to collective motion in dry active matter. Starting from field theories that predict a continuous transition at the deterministic level, we show that fluctuations induce a density-dependent shift of the onset of order, which in turn changes the nature of the transition into a phase-separation scenario. Our results apply to a range of systems, including models in which particles interact with their "topological" neighbors that have been believed so far to exhibit a continuous onset of order. Our analytical predictions are confirmed by numerical simulations of fluctuating hydrodynamics and microscopic models.

Learned emergence in selfish collective motion

To understand the collective motion of many individuals, we often rely on agent-based models with rules that may be computationally complex and involved. For biologically inspired systems in particular, this raises questions about whether the imposed rules are necessarily an accurate reflection of what is being followed. The basic premise of updating one's state according to some underlying motivation is well suited to the realm of reservoir computing; however, entire swarms of individuals are yet to be tasked with learning movement in this framework. This work focuses on the specific case of many selfish individuals simultaneously optimizing their domains in a manner conducive to reducing their personal risk of predation. Using an echo state network and data generated from the agent-based model, we show that, with an appropriate representation of input and output states, this selfish movement can be learned. This suggests that a more sophisticated neural network, such as a brain, could also learn this behavior and provides an avenue to further the search for realistic movement rules in systems of autonomous individuals.