Closed-loop interactions between a shoal of zebrafish and a group of robotic fish in a circular corridor

Quantifying the biomimicry gap in biohybrid robot-fish pairs

Biohybrid systems in which robotic lures interact with animals have become compelling tools for probing and identifying the mechanisms underlying collective animal behavior. One key challenge lies in the transfer of social interaction models from simulations to reality, using robotics to validate the modeling hypotheses. This challenge arises in bridging what we term the 'biomimicry gap', which is caused by imperfect robotic replicas, communication cues and physics constraints not incorporated in the simulations, that may elicit unrealistic behavioral responses in animals. In this work, we used a biomimetic lure of a rummy-nose tetra fish (Hemigrammus rhodostomus) and a neural network (NN) model for generating biomimetic social interactions. Through experiments with a biohybrid pair comprising a fish and the robotic lure, a pair of real fish, and simulations of pairs of fish, we demonstrate that our biohybrid system generates social interactions mirroring those of genuine fish pairs. Our analyses highlight that: 1) the lure and NN maintain minimal deviation in real-world interactions compared to simulations and fish-only experiments, 2) our NN controls the robot efficiently in real-time, and 3) a comprehensive validation is crucial to bridge the biomimicry gap, ensuring realistic biohybrid systems.

Ethorobotic rats for rodent behavioral research: design considerations

The development of robots as tools for biological research, sometimes termed "biorobotics", has grown rapidly in recent years, fueled by the proliferation of miniaturized computation and advanced manufacturing techniques. Much of this work is focused on the use of robots as biomechanical models for natural systems. But, increasingly, biomimetic robots are being employed to interact directly with animals, as component parts of ethology studies in the field and behavioral neuroscience studies in the laboratory. While it has been possible to mechanize and automate animal behavior experiments for decades, only recently has there been the prospect of creating at-scale robotic animals containing the sensing, autonomy and actuation necessary for complex, life-like interaction. This not only opens up new avenues of enquiry, but also provides important ways to improve animal welfare, both by reducing or replacing the use of animal subjects, and by minimizing animal distress (if robots are used judiciously). This article will discuss the current state of the art in robotic lab rats, providing perspective on where research could be directed to enable the safe and effective use of biorobotic animals.

Proactivity of fish and leadership of self-propelled robotic fish during interaction

Fish interacting with biomimetic robotic fish is beneficial for animal behavior research, particularly in the study of collective behavior. Compared with passive-dragging robotic fish, self-propelled robotic fish floats in water, and its movement matches the flow field formed by the caudal fin oscillation, leading to more realistic interaction with animals. In this paper, we propose a self-propelled koi-mimicking robotic fish entity, develop a system for robotic fish and koi fish interaction, and conduct extensive experiments on quantity variation and parameter variation. The results showed that fish exhibited significantly lower proactivity when alone, and the most proactive case is one robotic fish interacting with two real fish. The experiments on parameter variation indicated that fish may respond more proactivity to robotic fish that swim with high frequency and low amplitude, but may also move together with high-frequency and high-amplitude swimming robotic fish. These findings could provide insights into fish collective behavior, guide the design of further fish-robot interaction experiments, and suggest directions for future improvements in goal-oriented robotic fish platforms.

A Bioinspired Cownose Ray Robot for Seabed Exploration

This article presents the design and the experimental tests of a bioinspired robot mimicking the cownose ray. These fish swim by moving their large and flat pectoral fins, creating a wave that pushes backward the surrounding water so that the fish is propelled forward due to momentum conservation. The robot inspired by these animals has a rigid central body, housing motors, batteries, and electronics, and flexible pectoral fins made of silicone rubber. Each of them is actuated by a servomotor driving a link inside the leading edge, and the traveling wave is reproduced thanks to the flexibility of the fin itself. In addition to the pectoral fins, two small rigid caudal fins are present to improve the robot's maneuverability. The robot has been designed, built, and tested underwater, and the experiments have shown that the locomotion principle is valid and that the robot is able to swim forward, perform left and right turns, and do floating or diving maneuvers.

Evolutionary Dynamics of Division of Labor Games for Underwater Searching Tasks

Division of labor in self-organized groups is a problem of both theoretical significance and application value. Many application problems in the real world require efficient task allocation. We propose a model combining bio-inspiration and evolutionary game theory. This research model theoretically analyzes the problem of target search in unknown areas for multi-robot systems. If the robot’s operating area is underwater, the problem becomes more complicated due to its information sharing restrictions. Additionally, it drives strategy updates and calculates the fixed probability of relevant strategies, using evolutionary game theory and the commonly used Fermi function. Our study estimates the fixed probability under arbitrary selection intensity and the fixed probability and time under weak selection for the two-player game model. In the multi-player game, we get these results for weak selection, which is conducive to the coexistence of the two strategies. Moreover, the conducted simulations confirm our analysis. These results help to understand and design effective mechanisms in which self-organizing collective dynamics appears in the form of maximizing the benefits of multi-agent systems in the case of the asymmetric game.

A Minimally Invasive Approach Towards “Ecosystem Hacking” With Honeybees

Honey bees live in colonies of thousands of individuals, that not only need to collaborate with each other but also to interact intensively with their ecosystem. A small group of robots operating in a honey bee colony and interacting with the queen bee, a central colony element, has the potential to change the collective behavior of the entire colony and thus also improve its interaction with the surrounding ecosystem. Such a system can be used to study and understand many elements of bee behavior within hives that have not been adequately researched. We discuss here the applicability of this technology for ecosystem protection: A novel paradigm of a minimally invasive form of conservation through “Ecosystem Hacking”. We discuss the necessary requirements for such technology and show experimental data on the dynamics of the natural queen’s court, initial designs of biomimetic robotic surrogates of court bees, and a multi-agent model of the queen bee court system. Our model is intended to serve as an AI-enhanceable coordination software for future robotic court bee surrogates and as a hardware controller for generating nature-like behavior patterns for such a robotic ensemble. It is the first step towards a team of robots working in a bio-compatible way to study honey bees and to increase their pollination performance, thus achieving a stabilizing effect at the ecosystem level.

Marimo actuated rover systems

Background

The potential to directly harness photosynthesis to make actuators, biosensors and bioprocessors has been previously demonstrated in the literature. Herein, this capability has been expanded to more advanced systems — Marimo Actuated Rover Systems (MARS) — which are capable of autonomous, solar powered, movement.

Results

We demonstrate this ability is both a practical and viable alternative to conventional mobile platforms for exploration and dynamic environmental monitoring. Prototypes have been successfully tested to measure their speed of travel and ability to automatically bypass obstacles. Further, MARS is electromagnetically silent, thus avoiding the background noise generated by conventional electro/mechanical platforms which reduces instrument sensitivity. The cost of MARS is significantly lower than platforms based on conventional technology.

Conclusions

An autonomous, low-cost, lightweight, compact size, photosynthetically powered rover is reported. The potential for further system enhancements are identified and under development.

Supplementary Information

The online version contains supplementary material available at (10.1186/s13036-021-00279-0).

Unveiling social distancing mechanisms via a fish-robot hybrid interaction

Pathogen transmission is a major limit of social species. Social distancing, a behavioural-based response to diseases, has been regularly reported in nature. However, the identification of distinctive stimuli associated with an infectious disease represents a challenging task for host species, whose cognitive mechanisms are still poorly understood. Herein, the social fish Paracheirodon innesi, was selected as model organism to investigate animal abilities in exploiting visual information to identify and promote social distancing towards potentially infected conspecifics. To address this, a robotic fish replica mimicking a healthy P. innesi subject, and another mimicking P. innesi with morphological and/or locomotion anomalies were developed. P. innesi individuals were attracted by the healthy fish replica, while they avoided the fish replica with morphological abnormalities, as well as the fish replica with an intact appearance, but performing locomotion anomalies (both symptoms associated with a microsporidian parasite infesting P. innesi and other fish). Furthermore, the fish replica presenting both morphology and locomotion anomalies in conjunction, triggered a significantly stronger social distancing response. This confirms the hypothesis that group living animals overgeneralize cues that can be related with a disease to minimize transmission, and highlights the important role of visual cues in infection risk contexts. This study prompts more attention on the role of behavioural-based strategies to avoid pathogen/parasite diffusion, and can be used to optimize computational approaches to model disease dynamics.

Social Integrating Robots Suggest Mitigation Strategies for Ecosystem Decay

We develop here a novel hypothesis that may generate a general research framework of how autonomous robots may act as a future contingency to counteract the ongoing ecological mass extinction process. We showcase several research projects that have undertaken first steps to generate the required prerequisites for such a technology-based conservation biology approach. Our main idea is to stabilise and support broken ecosystems by introducing artificial members, robots, that are able to blend into the ecosystem's regulatory feedback loops and can modulate natural organisms' local densities through participation in those feedback loops. These robots are able to inject information that can be gathered using technology and to help the system in processing available information with technology. In order to understand the key principles of how these robots are capable of modulating the behaviour of large populations of living organisms based on interacting with just a few individuals, we develop novel mathematical models that focus on important behavioural feedback loops. These loops produce relevant group-level effects, allowing for robotic modulation of collective decision making in social organisms. A general understanding of such systems through mathematical models is necessary for designing future organism-interacting robots in an informed and structured way, which maximises the desired output from a minimum of intervention. Such models also help to unveil the commonalities and specificities of the individual implementations and allow predicting the outcomes of microscopic behavioural mechanisms on the ultimate macroscopic-level effects. We found that very similar models of interaction can be successfully used in multiple very different organism groups and behaviour types (honeybee aggregation, fish shoaling, and plant growth). Here we also report experimental data from biohybrid systems of robots and living organisms. Our mathematical models serve as building blocks for a deep understanding of these biohybrid systems. Only if the effects of autonomous robots onto the environment can be sufficiently well predicted can such robotic systems leave the safe space of the lab and can be applied in the wild to be able to unfold their ecosystem-stabilising potential.

Model-based feedback control of live zebrafish behavior via interaction with a robotic replica

The possibility of regulating the behavior of live animals using biologically-inspired robots has attracted the interest of biologists and engineers for over twenty-five years. From early work on insects to recent endeavors on mammals, we have witnessed fascinating applications that have pushed forward our understanding of animal behavior along new directions. Despite significant progress, most of the research has focused on open-loop control systems, in which robots execute predetermined actions, independent of the animal behavior. We integrate mathematical modeling of social behavior toward the design of realistic feedback laws for robots to interact with a live animal. In particular, we leverage recent advancements in data-driven modeling of zebrafish behavior. Ultimately, we establish a novel robotic platform that allows real-time actuation of a biologically-inspired 3D-printed zebrafish replica to implement model-based control of animal behavior. We demonstrate our approach through a series of experiments, designed to elucidate the appraisal of the replica by live subjects with respect to conspecifics and to quantify the biological value of closed-loop control.

Beetle-robot hybrid interaction: sex, lateralization and mating experience modulate behavioural responses to robotic cues in the larger grain borer Prostephanus truncatus (Horn)

Ethorobotics, a new fascinating field of biorobotics, proposes the use of robotic replicas as an advanced method for investigating animal behaviour. This novel research approach can also encourage the development of advanced bioinspired robots. In the present study, we investigated the pushing behaviour, a particular display occurring in several beetle species, such as the larger grain borer, Prostephanus truncatus, during both male-female and male-male contexts. We developed a robotic apparatus actuating female and male-mimicking dummies to study if sex, mating experience and asymmetries of robotic cues can modulate the escalation of pushing behaviour. Results showed that the time needed by P. truncatus to react to female-smelling biomimetic dummies was chiefly affected by their mating experience and the dummy odour. This was likely due to reduce waste of costly sperm in mated males during the subsequent sexual interactions. The pushing behaviour was performed longer and with a higher number of acts when virgin females were approached from their right side. More and longer pushing acts were noted when virgin males were approached from their left side. Dedicated neural circuits would likely act in opposite direction in females and males producing population-level lateralized sensory-motor displays, which may be evolved to promote male approaches from the left side of females, thus improving short-distance sex recognition. Overall, this study provides new insights on the behavioural ecology of stored-product beetles, as well as on self-organization and decentralized decision making that can be exploited to develop bioinspired algorithms for task optimization, involving real-world scenarios.

Strategies to modulate zebrafish collective dynamics with a closed-loop biomimetic robotic system

The objective of this study is to integrate biomimetic robots into small groups of zebrafish and to modulate their collective behaviours. A possible approach is to have the robots behave like sheepdogs. In this case, the robots would behave like a different species than the fish and would present different relevant behaviours. In this study, we explore different strategies that use biomimetic zebrafish behaviours. In past work, we have shown that robots biomimicking zebrafish can be socially integrated into zebrafish groups. We have also shown that a fish-like robot can modulate the rotation choice of zebrafish groups in a circular set-up. Here, we further study the modulation capabilities of such robots in a more complex set-up. To do this, we exploit zebrafish social behaviours we identified in previous studies. We first modulate collective departure by replicating the leadership mechanisms with the robot in a set-up composed of two rooms connected by a corridor. Then, we test different behavioural strategies to drive the fish groups towards a predefined target room. To drive the biohybrid groups towards a predefined choice, they have to adopt some specific fish-like behaviours. The first strategy is based on a single robot using the initiation behaviour. In this case, the robot keeps trying to initiate a group transition towards the target room. The second strategy is based on two robots, one initiating and one staying in the target room as a social attractant. The third strategy is based on a single robot behaving like a zebrafish but staying in the target room as a social attractant. The fourth strategy uses two robots behaving like zebrafish but staying in the target room. We conclude that robots can modulate zebrafish group behaviour by adopting strategies based on existing fish behaviours. Under these conditions, robots enable the testing of hypotheses about the behaviours of fish.

Guppies Prefer to Follow Large (Robot) Leaders Irrespective of Own Size

Body size is often assumed to determine how successfully an individual can lead others with larger individuals being better leaders than smaller ones. But even if larger individuals are more readily followed, body size often correlates with specific behavioral patterns and it is thus unclear whether larger individuals are more often followed than smaller ones because of their size or because they behave in a certain way. To control for behavioral differences among differentially-sized leaders, we used biomimetic robotic fish (Robofish) of different sizes. Live guppies (Poecilia reticulata) are known to interact with Robofish in a similar way as with live conspecifics. Consequently, Robofish may serve as a conspecific-like leader that provides standardized behaviors irrespective of its size. We asked whether larger Robofish leaders are preferentially followed and whether the preferences of followers depend on own body size or risk-taking behavior ("boldness"). We found that live female guppies followed larger Robofish leaders in closer proximity than smaller ones and this pattern was independent of the followers' own body size as well as risk-taking behavior. Our study shows a "bigger is better" pattern in leadership that is independent of behavioral differences among differentially-sized leaders, followers' own size and risk-taking behavior.

A review on animal-robot interaction: from bio-hybrid organisms to mixed societies

Living organisms are far superior to state-of-the-art robots as they have evolved a wide number of capabilities that far encompass our most advanced technologies. The merging of biological and artificial world, both physically and cognitively, represents a new trend in robotics that provides promising prospects to revolutionize the paradigms of conventional bio-inspired design as well as biological research. In this review, a comprehensive definition of animal-robot interactive technologies is given. They can be at animal level, by augmenting physical or mental capabilities through an integrated technology, or at group level, in which real animals interact with robotic conspecifics. Furthermore, an overview of the current state of the art and the recent trends in this novel context is provided. Bio-hybrid organisms represent a promising research area allowing us to understand how a biological apparatus (e.g. muscular and/or neural) works, thanks to the interaction with the integrated technologies. Furthermore, by using artificial agents, it is possible to shed light on social behaviours characterizing mixed societies. The robots can be used to manipulate groups of living organisms to understand self-organization and the evolution of cooperative behaviour and communication.

Zebrafish Adjust Their Behavior in Response to an Interactive Robotic Predator

Zebrafish (Danio rerio) constitutes a valuable experimental species for the study of the biological determinants of emotional responses, such as fear and anxiety. Fear-related test paradigms traditionally entail the interaction between focal subjects and live predators, which may show inconsistent behavior throughout the experiment. To address this technical challenge, robotic stimuli are now frequently integrated in behavioral studies, yielding repeatable, customizable, and controllable experimental conditions. While most of the research has focused on open-loop control where robotic stimuli are preprogrammed to execute a priori known actions, recent work has explored the possibility of two-way interactions between robotic stimuli and live subjects. Here, we demonstrate a "closed-loop control" system to investigate fear response of zebrafish in which the response of the robotic stimulus is determined in real-time through a finite-state Markov chain constructed from independent observations on the interactions between zebrafish and their predator. Specifically, we designed a 3D-printed robotic replica of the zebrafish allopatric predator red tiger Oscar fish (Astronotus ocellatus), instrumented to interact in real-time with live subjects. We investigated the role of closed-loop control in modulating fear response in zebrafish through the analysis of the focal fish ethogram and the information-theoretic quantification of the interaction between the subject and the replica. Our results indicate that closed-loop control elicits consistent fear response in zebrafish and that zebrafish quickly adjust their behavior to avoid the predator's attacks. The augmented degree of interactivity afforded by the Markov-chain-dependent actuation of the replica constitutes a fundamental advancement in the study of animal-robot interactions and offers a new means for the development of experimental paradigms to study fear.

Robots mediating interactions between animals for interspecies collective behaviors

Self-organized collective behavior has been analyzed in diverse types of gregarious animals. Such collective intelligence emerges from the synergy between individuals, which behave at their own time and spatial scales and without global rules. Recently, robots have been developed to collaborate with animal groups in the pursuit of better understanding their decision-making processes. These biohybrid systems make cooperative relationships between artificial systems and animals possible, which can yield new capabilities in the resulting mixed group. However, robots are currently tailor-made to successfully engage with one animal species at a time. This limits the possibilities of introducing distinct species-dependent perceptual capabilities and types of behaviors in the same system. Here, we show that robots socially integrated into animal groups of honeybees and zebrafish, each one located in a different city, allowing these two species to interact. This interspecific information transfer is demonstrated by collective decisions that emerge between the two autonomous robotic systems and the two animal groups. The robots enable this biohybrid system to function at any distance and operates in water and air with multiple sensorimotor properties across species barriers and ecosystems. These results demonstrate the feasibility of generating and controlling behavioral patterns in biohybrid groups of multiple species. Such interspecies connections between diverse robotic systems and animal species may open the door for new forms of artificial collective intelligence, where the unrivaled perceptual capabilities of the animals and their brains can be used to enhance autonomous decision-making, which could find applications in selective "rewiring" of ecosystems.

Encoding lateralization of jump kinematics and eye use in a locust via bio-robotic artifacts

The effect of previous exposure to lateral sensory stimuli in shaping the response to subsequent symmetric stimuli represents an important overlooked issue in neuroethology, with special reference to arthropods. In this research, we investigated the hypothesis to 'programme' jumping escape direction as well as surveillance orientation in young and adult individuals of Locusta migratoria as an adaptive consequence of prior exposure to directional-biased predator approaches generated by a robotic leopard gecko representing Eublepharis macularius The manipulation of the jumping escape direction was successfully achieved in young locusts, although young L. migratoria did not exhibit innately lateralized jumping escapes. Jumping escape direction was also successfully manipulated in adult locusts, which exhibited innate lateralized jumping escape at the individual level. The innate lateralization of each instar of L. migratoria in using a preferential eye during surveillance was not affected by prior lateralized exposure to the robotic gecko. Our results indicate a high plasticity of the escape motor outputs that are occurring almost in real time with the perceived stimuli, making them greatly adaptable and compliant to environmental changes in order to be effective and reliable. In addition, surveillance lateralization innately occurs at population level in each instar of L. migratoria Therefore, its low forgeability by environmental factors would avoid disorganization at swarm level and improve swarm coordination during group tasks. These findings are consistent with the fact that, as in vertebrates, in insects the right hemisphere is specialized in controlling fear and escape functions.

Using a robotic fish to investigate individual differences in social responsiveness in the guppy

Responding towards the actions of others is one of the most important behavioural traits whenever animals of the same species interact. Mutual influences among interacting individuals may modulate the social responsiveness seen and thus make it often difficult to study the level and individual variation in responsiveness. Here, open-loop biomimetic robots that provide standardized, non-interactive social cues can be a useful tool. These robots are not affected by the live animal's actions but are assumed to still represent valuable and biologically relevant social cues. As this assumption is crucial for the use of biomimetic robots in behavioural studies, we hypothesized (i) that meaningful social interactions can be assumed if live animals maintain individual differences in responsiveness when interacting with both a biomimetic robot and a live partner. Furthermore, to study the level of individual variation in social responsiveness, we hypothesized (ii) that individual differences should be maintained over the course of multiple tests with the robot. We investigated the response of live guppies (Poecilia reticulata) when allowed to interact either with a biomimetic open-loop-controlled fish robot-'Robofish'-or with a live companion. Furthermore, we investigated the responses of live guppies when tested three times with Robofish. We found that responses of live guppies towards Robofish were weaker compared with those of a live companion, most likely as a result of the non-interactive open-loop behaviour of Robofish. Guppies, however, were consistent in their individual responses between a live companion and Robofish, and similar individual differences in response towards Robofish were maintained over repeated testing even though habituation to the test environment was detectable. Biomimetic robots like Robofish are therefore a useful tool for the study of social responsiveness in guppies and possibly other small fish species.