Bidirectional interactions facilitate the integration of a robot into a shoal of zebrafish Danio rerio

Quantifying the biomimicry gap in biohybrid robot-fish pairs

Biohybrid systems in which robotic lures interact with animals have become compelling tools for probing and identifying the mechanisms underlying collective animal behavior. One key challenge lies in the transfer of social interaction models from simulations to reality, using robotics to validate the modeling hypotheses. This challenge arises in bridging what we term the 'biomimicry gap', which is caused by imperfect robotic replicas, communication cues and physics constraints not incorporated in the simulations, that may elicit unrealistic behavioral responses in animals. In this work, we used a biomimetic lure of a rummy-nose tetra fish (Hemigrammus rhodostomus) and a neural network (NN) model for generating biomimetic social interactions. Through experiments with a biohybrid pair comprising a fish and the robotic lure, a pair of real fish, and simulations of pairs of fish, we demonstrate that our biohybrid system generates social interactions mirroring those of genuine fish pairs. Our analyses highlight that: 1) the lure and NN maintain minimal deviation in real-world interactions compared to simulations and fish-only experiments, 2) our NN controls the robot efficiently in real-time, and 3) a comprehensive validation is crucial to bridge the biomimicry gap, ensuring realistic biohybrid systems.

Predicting the long-term collective behaviour of fish pairs with deep learning

Modern computing has enhanced our understanding of how social interactions shape collective behaviour in animal societies. Although analytical models dominate in studying collective behaviour, this study introduces a deep learning model to assess social interactions in the fish species Hemigrammus rhodostomus. We compare the results of our deep learning approach with experiments and with the results of a state-of-the-art analytical model. To that end, we propose a systematic methodology to assess the faithfulness of a collective motion model, exploiting a set of stringent individual and collective spatio-temporal observables. We demonstrate that machine learning (ML) models of social interactions can directly compete with their analytical counterparts in reproducing subtle experimental observables. Moreover, this work emphasizes the need for consistent validation across different timescales, and identifies key design aspects that enable our deep learning approach to capture both short- and long-term dynamics. We also show that our approach can be extended to larger groups without any retraining, and to other fish species, while retaining the same architecture of the deep learning network. Finally, we discuss the added value of ML in the context of the study of collective motion in animal groups and its potential as a complementary approach to analytical models.

Proactivity of fish and leadership of self-propelled robotic fish during interaction

Fish interacting with biomimetic robotic fish is beneficial for animal behavior research, particularly in the study of collective behavior. Compared with passive-dragging robotic fish, self-propelled robotic fish floats in water, and its movement matches the flow field formed by the caudal fin oscillation, leading to more realistic interaction with animals. In this paper, we propose a self-propelled koi-mimicking robotic fish entity, develop a system for robotic fish and koi fish interaction, and conduct extensive experiments on quantity variation and parameter variation. The results showed that fish exhibited significantly lower proactivity when alone, and the most proactive case is one robotic fish interacting with two real fish. The experiments on parameter variation indicated that fish may respond more proactivity to robotic fish that swim with high frequency and low amplitude, but may also move together with high-frequency and high-amplitude swimming robotic fish. These findings could provide insights into fish collective behavior, guide the design of further fish-robot interaction experiments, and suggest directions for future improvements in goal-oriented robotic fish platforms.

Social Integrating Robots Suggest Mitigation Strategies for Ecosystem Decay

We develop here a novel hypothesis that may generate a general research framework of how autonomous robots may act as a future contingency to counteract the ongoing ecological mass extinction process. We showcase several research projects that have undertaken first steps to generate the required prerequisites for such a technology-based conservation biology approach. Our main idea is to stabilise and support broken ecosystems by introducing artificial members, robots, that are able to blend into the ecosystem's regulatory feedback loops and can modulate natural organisms' local densities through participation in those feedback loops. These robots are able to inject information that can be gathered using technology and to help the system in processing available information with technology. In order to understand the key principles of how these robots are capable of modulating the behaviour of large populations of living organisms based on interacting with just a few individuals, we develop novel mathematical models that focus on important behavioural feedback loops. These loops produce relevant group-level effects, allowing for robotic modulation of collective decision making in social organisms. A general understanding of such systems through mathematical models is necessary for designing future organism-interacting robots in an informed and structured way, which maximises the desired output from a minimum of intervention. Such models also help to unveil the commonalities and specificities of the individual implementations and allow predicting the outcomes of microscopic behavioural mechanisms on the ultimate macroscopic-level effects. We found that very similar models of interaction can be successfully used in multiple very different organism groups and behaviour types (honeybee aggregation, fish shoaling, and plant growth). Here we also report experimental data from biohybrid systems of robots and living organisms. Our mathematical models serve as building blocks for a deep understanding of these biohybrid systems. Only if the effects of autonomous robots onto the environment can be sufficiently well predicted can such robotic systems leave the safe space of the lab and can be applied in the wild to be able to unfold their ecosystem-stabilising potential.

Behavioral Teleporting of Individual Ethograms onto Inanimate Robots: Experiments on Social Interactions in Live Zebrafish

Social behavior is widespread in the animal kingdom, and it remarkably influences human personal and professional lives. However, a thorough understanding of the mechanisms underlying social behavior is elusive. Integrating the seemingly different fields of robotics and preclinical research could bring new insight on social behavior. Toward this aim, we established "behavioral teleporting" as an experimental solution to independently manipulate multiple factors underpinning social interactions. Behavioral teleporting consists of real-time transfer of the complete ethogram of a live zebrafish onto a remotely-located robotic replica. Through parallel and simultaneous behavioral teleporting, we studied the interaction between two live fish swimming in remotely-located tanks: each live fish interacted with an inanimate robot that mirrored the behavior of the other fish, and the morphology of each robot was independently tailored. Our results indicate that behavioral teleporting can preserve natural interaction between two live animals, while allowing fine control over morphological features that modulate social behavior.

Zebrafish exhibit associative learning for an aversive robotic stimulus

Zebrafish have quickly emerged as a species of choice in preclinical research, holding promise to advance the field of behavioral pharmacology through high-throughput experiments. Besides biological and heuristic considerations, zebrafish also constitute a fundamental tool that fosters the replacement of mammals with less sentient experimental subjects. Notwithstanding these features, experimental paradigms to investigate emotional and cognitive domains in zebrafish are still limited. Studies on emotional memories have provided sound methodologies to investigate fear conditioning in zebrafish, but these protocols may still benefit from a reconsideration of the independent variables adopted to elicit aversion. Here, we designed a fear-conditioning paradigm in which wild-type zebrafish were familiarized over six training sessions with an empty compartment and a fear-eliciting one. The fearful stimulus was represented by three zebrafish replicas exhibiting a fully synchronized and polarized motion as they were maneuvered along 3D trajectories by a robotic platform. When allowed to freely swim between the two compartments in the absence of the robotic stimulus (test session), zebrafish displayed a marked avoidance of the stimulus-paired one. To investigate whether fear conditioning was modulated by psychoactive compounds, two groups of zebrafish were administered ethanol (0.25% and 1.00%, ethanol/water, by volume) a few minutes before the test session. We observed that ethanol administration abolished the conditioned avoidance of the stimulus-paired compartment. Ultimately, this study confirms that robotic stimuli may be used in the design of fear-conditioning paradigms, which are sensitive to pharmacological manipulations.

A data-driven method for reconstructing and modelling social interactions in moving animal groups

Group-living organisms that collectively migrate range from cells and bacteria to human crowds, and include swarms of insects, schools of fish, and flocks of birds or ungulates. Unveiling the behavioural and cognitive mechanisms by which these groups coordinate their movements is a challenging task. These mechanisms take place at the individual scale and can be described as a combination of interactions between individuals and interactions between these individuals and the physical obstacles in the environment. Thanks to the development of novel tracking techniques that provide large and accurate datasets, the main characteristics of individual and collective behavioural patterns can be quantified with an unprecedented level of precision. However, in a large number of studies, social interactions are usually described by force map methods that only have a limited capacity of explanation and prediction, being rarely suitable for a direct implementation in a concise and explicit mathematical model. Here, we present a general method to extract the interactions between individuals that are involved in the coordination of collective movements in groups of organisms. We then apply this method to characterize social interactions in two species of shoaling fish, the rummy-nose tetra (Hemigrammus rhodostomus) and the zebrafish (Danio rerio), which both present a burst-and-coast motion. From the detailed quantitative description of individual-level interactions, it is thus possible to develop a quantitative model of the emergent dynamics observed at the group level, whose predictions can be checked against experimental results. This method can be applied to a wide range of biological and social systems. This article is part of the theme issue 'Multi-scale analysis and modelling of collective migration in biological systems'.

Strategies to modulate zebrafish collective dynamics with a closed-loop biomimetic robotic system

The objective of this study is to integrate biomimetic robots into small groups of zebrafish and to modulate their collective behaviours. A possible approach is to have the robots behave like sheepdogs. In this case, the robots would behave like a different species than the fish and would present different relevant behaviours. In this study, we explore different strategies that use biomimetic zebrafish behaviours. In past work, we have shown that robots biomimicking zebrafish can be socially integrated into zebrafish groups. We have also shown that a fish-like robot can modulate the rotation choice of zebrafish groups in a circular set-up. Here, we further study the modulation capabilities of such robots in a more complex set-up. To do this, we exploit zebrafish social behaviours we identified in previous studies. We first modulate collective departure by replicating the leadership mechanisms with the robot in a set-up composed of two rooms connected by a corridor. Then, we test different behavioural strategies to drive the fish groups towards a predefined target room. To drive the biohybrid groups towards a predefined choice, they have to adopt some specific fish-like behaviours. The first strategy is based on a single robot using the initiation behaviour. In this case, the robot keeps trying to initiate a group transition towards the target room. The second strategy is based on two robots, one initiating and one staying in the target room as a social attractant. The third strategy is based on a single robot behaving like a zebrafish but staying in the target room as a social attractant. The fourth strategy uses two robots behaving like zebrafish but staying in the target room. We conclude that robots can modulate zebrafish group behaviour by adopting strategies based on existing fish behaviours. Under these conditions, robots enable the testing of hypotheses about the behaviours of fish.