Fish–Robot Interactions: Robot Fish in Animal Behavioral Studies

The evolution of social timing

Sociality and timing are tightly interrelated in human interaction as seen in turn-taking or synchronised dance movements. Sociality and timing also show in communicative acts of other species that might be pleasurable, but also necessary for survival. Sociality and timing often co-occur, but their shared phylogenetic trajectory is unknown: How, when, and why did they become so tightly linked? Answering these questions is complicated by several constraints; these include the use of divergent operational definitions across fields and species, the focus on diverse mechanistic explanations (e.g., physiological, neural, or cognitive), and the frequent adoption of anthropocentric theories and methodologies in comparative research. These limitations hinder the development of an integrative framework on the evolutionary trajectory of social timing and make comparative studies not as fruitful as they could be. Here, we outline a theoretical and empirical framework to test contrasting hypotheses on the evolution of social timing with species-appropriate paradigms and consistent definitions. To facilitate future research, we introduce an initial set of representative species and empirical hypotheses. The proposed framework aims at building and contrasting evolutionary trees of social timing toward and beyond the crucial branch represented by our own lineage. Given the integration of cross-species and quantitative approaches, this research line might lead to an integrated empirical-theoretical paradigm and, as a long-term goal, explain why humans are such socially coordinated animals.

A Bioinspired Cownose Ray Robot for Seabed Exploration

This article presents the design and the experimental tests of a bioinspired robot mimicking the cownose ray. These fish swim by moving their large and flat pectoral fins, creating a wave that pushes backward the surrounding water so that the fish is propelled forward due to momentum conservation. The robot inspired by these animals has a rigid central body, housing motors, batteries, and electronics, and flexible pectoral fins made of silicone rubber. Each of them is actuated by a servomotor driving a link inside the leading edge, and the traveling wave is reproduced thanks to the flexibility of the fin itself. In addition to the pectoral fins, two small rigid caudal fins are present to improve the robot's maneuverability. The robot has been designed, built, and tested underwater, and the experiments have shown that the locomotion principle is valid and that the robot is able to swim forward, perform left and right turns, and do floating or diving maneuvers.

Model-based feedback control of live zebrafish behavior via interaction with a robotic replica

The possibility of regulating the behavior of live animals using biologically-inspired robots has attracted the interest of biologists and engineers for over twenty-five years. From early work on insects to recent endeavors on mammals, we have witnessed fascinating applications that have pushed forward our understanding of animal behavior along new directions. Despite significant progress, most of the research has focused on open-loop control systems, in which robots execute predetermined actions, independent of the animal behavior. We integrate mathematical modeling of social behavior toward the design of realistic feedback laws for robots to interact with a live animal. In particular, we leverage recent advancements in data-driven modeling of zebrafish behavior. Ultimately, we establish a novel robotic platform that allows real-time actuation of a biologically-inspired 3D-printed zebrafish replica to implement model-based control of animal behavior. We demonstrate our approach through a series of experiments, designed to elucidate the appraisal of the replica by live subjects with respect to conspecifics and to quantify the biological value of closed-loop control.

Exploration of underwater life with an acoustically controlled soft robotic fish

Closeup exploration of underwater life requires new forms of interaction, using biomimetic creatures that are capable of agile swimming maneuvers, equipped with cameras, and supported by remote human operation. Current robotic prototypes do not provide adequate platforms for studying marine life in their natural habitats. This work presents the design, fabrication, control, and oceanic testing of a soft robotic fish that can swim in three dimensions to continuously record the aquatic life it is following or engaging. Using a miniaturized acoustic communication module, a diver can direct the fish by sending commands such as speed, turning angle, and dynamic vertical diving. This work builds on previous generations of robotic fish that were restricted to one plane in shallow water and lacked remote control. Experimental results gathered from tests along coral reefs in the Pacific Ocean show that the robotic fish can successfully navigate around aquatic life at depths ranging from 0 to 18 meters. Furthermore, our robotic fish exhibits a lifelike undulating tail motion enabled by a soft robotic actuator design that can potentially facilitate a more natural integration into the ocean environment. We believe that our study advances beyond what is currently achievable using traditional thruster-based and tethered autonomous underwater vehicles, demonstrating methods that can be used in the future for studying the interactions of aquatic life and ocean dynamics.

Guppies Prefer to Follow Large (Robot) Leaders Irrespective of Own Size

Body size is often assumed to determine how successfully an individual can lead others with larger individuals being better leaders than smaller ones. But even if larger individuals are more readily followed, body size often correlates with specific behavioral patterns and it is thus unclear whether larger individuals are more often followed than smaller ones because of their size or because they behave in a certain way. To control for behavioral differences among differentially-sized leaders, we used biomimetic robotic fish (Robofish) of different sizes. Live guppies (Poecilia reticulata) are known to interact with Robofish in a similar way as with live conspecifics. Consequently, Robofish may serve as a conspecific-like leader that provides standardized behaviors irrespective of its size. We asked whether larger Robofish leaders are preferentially followed and whether the preferences of followers depend on own body size or risk-taking behavior ("boldness"). We found that live female guppies followed larger Robofish leaders in closer proximity than smaller ones and this pattern was independent of the followers' own body size as well as risk-taking behavior. Our study shows a "bigger is better" pattern in leadership that is independent of behavioral differences among differentially-sized leaders, followers' own size and risk-taking behavior.

Zebrafish Adjust Their Behavior in Response to an Interactive Robotic Predator

Zebrafish (Danio rerio) constitutes a valuable experimental species for the study of the biological determinants of emotional responses, such as fear and anxiety. Fear-related test paradigms traditionally entail the interaction between focal subjects and live predators, which may show inconsistent behavior throughout the experiment. To address this technical challenge, robotic stimuli are now frequently integrated in behavioral studies, yielding repeatable, customizable, and controllable experimental conditions. While most of the research has focused on open-loop control where robotic stimuli are preprogrammed to execute a priori known actions, recent work has explored the possibility of two-way interactions between robotic stimuli and live subjects. Here, we demonstrate a "closed-loop control" system to investigate fear response of zebrafish in which the response of the robotic stimulus is determined in real-time through a finite-state Markov chain constructed from independent observations on the interactions between zebrafish and their predator. Specifically, we designed a 3D-printed robotic replica of the zebrafish allopatric predator red tiger Oscar fish (Astronotus ocellatus), instrumented to interact in real-time with live subjects. We investigated the role of closed-loop control in modulating fear response in zebrafish through the analysis of the focal fish ethogram and the information-theoretic quantification of the interaction between the subject and the replica. Our results indicate that closed-loop control elicits consistent fear response in zebrafish and that zebrafish quickly adjust their behavior to avoid the predator's attacks. The augmented degree of interactivity afforded by the Markov-chain-dependent actuation of the replica constitutes a fundamental advancement in the study of animal-robot interactions and offers a new means for the development of experimental paradigms to study fear.

Using a robotic fish to investigate individual differences in social responsiveness in the guppy

Responding towards the actions of others is one of the most important behavioural traits whenever animals of the same species interact. Mutual influences among interacting individuals may modulate the social responsiveness seen and thus make it often difficult to study the level and individual variation in responsiveness. Here, open-loop biomimetic robots that provide standardized, non-interactive social cues can be a useful tool. These robots are not affected by the live animal's actions but are assumed to still represent valuable and biologically relevant social cues. As this assumption is crucial for the use of biomimetic robots in behavioural studies, we hypothesized (i) that meaningful social interactions can be assumed if live animals maintain individual differences in responsiveness when interacting with both a biomimetic robot and a live partner. Furthermore, to study the level of individual variation in social responsiveness, we hypothesized (ii) that individual differences should be maintained over the course of multiple tests with the robot. We investigated the response of live guppies (Poecilia reticulata) when allowed to interact either with a biomimetic open-loop-controlled fish robot-'Robofish'-or with a live companion. Furthermore, we investigated the responses of live guppies when tested three times with Robofish. We found that responses of live guppies towards Robofish were weaker compared with those of a live companion, most likely as a result of the non-interactive open-loop behaviour of Robofish. Guppies, however, were consistent in their individual responses between a live companion and Robofish, and similar individual differences in response towards Robofish were maintained over repeated testing even though habituation to the test environment was detectable. Biomimetic robots like Robofish are therefore a useful tool for the study of social responsiveness in guppies and possibly other small fish species.

Design and assessment of a flexible fish robot actuated by shape memory alloys

In this paper, we present a fish-like underwater robot inspired by the black bass fish. This robot is composed of a deformable structure and muscle-like linear actuators based on shape memory alloy wires. Such actuators are used to bend a continuous structure representing the backbone of the fish. The prototype is also equipped with a bio-inspired synthetic skin made of liquid silicone rubber and Lycra microfiber mesh. We present the mechatronics of the prototype and its control scheme, which take advantage of flex sensors for proprioception. Experiments under different conditions (in air and in water) assess the effectiveness of the mechatronics design and demonstrate that a relatively simple PID controller provides high precision of the muscles' position control. Here, the implementation of biomimetic kinematics and silent actuation technology in bio-inspired underwater robotics are demonstrated. Progress in this technology could provide multiple applications, including fish farming, coastal protection and live animal monitoring where silent robotics are necessary.

Insights into the Social Behavior of Surface and Cave-Dwelling Fish (Poecilia mexicana) in Light and Darkness through the Use of a Biomimetic Robot

Biomimetic robots (BRs) are becoming more common in behavioral research and, if they are accepted as conspecifics, allow for new forms of experimental manipulations of social interactions. Nevertheless, it is often not clear which cues emanating from a BR are actually used as communicative signals and how species or populations with different sensory makeups react to specific types of BRs. We herein present results from experiments using two populations of livebearing fishes that differ in their sensory capabilities. In the South of Mexico, surface-dwelling mollies (Poecilia mexicana) successfully invaded caves and adapted to dark conditions. While almost without pigment, these cave mollies possess smaller but still functional eyes. Although previous studies found cave mollies to show reduced shoaling preferences with conspecifics in light compared to surface mollies, it is assumed that they possess specialized adaptations to maintain some kind of sociality also in their dark habitats. By testing surface- and cave-dwelling mollies with RoboFish, a BR made for use in laboratory experiments with guppies and sticklebacks, we asked to what extent visual and non-visual cues play a role in their social behavior. Both cave- and surface-dwelling mollies followed the BR as well as a live companion when tested in light. However, when tested in darkness, only surface-dwelling fish were attracted by a live conspecific, whereas cave-dwelling fish were not. Neither cave- nor surface-dwelling mollies were attracted to RoboFish in darkness. This is the first study to use BRs for the investigation of social behavior in mollies and to compare responses to BRs both in light and darkness. As our RoboFish is accepted as conspecific by both used populations of the Atlantic molly only under light conditions but not in darkness, we argue that our replica is providing mostly visual cues.

Three-dimensional scoring of zebrafish behavior unveils biological phenomena hidden by two-dimensional analyses

The study of zebrafish behavior represents a cornerstone upon which basic researchers promise to advance knowledge in life sciences. Although zebrafish swim in a three-dimensional (3D) space, their behavior in the lab is almost exclusively scored in two dimensions, whereby zebrafish are recorded using a single camera providing 2D videos. Whether this dimensional reduction preserves the reliability of data has not been addressed. Here we show that, compared to a 3D observation, 2D data are flawed by over-reporting and under-reporting of locomotory differences. Specifically, we first reconstructed 3D trajectories through the integration of synchronous information derived from two cameras, and then compared them with the original 2D views in classical experimental paradigms assessing shoaling tendency, fear, anxiety, and general locomotion. Our results suggest that traditional behavioral scoring of individual zebrafish performed in 2D may undermine data integrity, thereby requiring a general reconsideration of scoring zebrafish behavior to incorporate a 3D approach. We then demonstrate that, compared to 2D, a 3D approach requires a reduced number of subjects to achieve the same degree of validity. We anticipate these findings to largely benefit animal welfare by reducing the number of experimental subjects, without affecting statistical power.

RoboFish: increased acceptance of interactive robotic fish with realistic eyes and natural motion patterns by live Trinidadian guppies

In recent years, simple biomimetic robots have been increasingly used in biological studies to investigate social behavior, for example collective movement. Nevertheless, a big challenge in developing biomimetic robots is the acceptance of the robotic agents by live animals. In this contribution, we describe our recent advances with regard to the acceptance of our biomimetic RoboFish by live Trinidadian guppies (Poecilia reticulata). We provide a detailed technical description of the RoboFish system and show the effect of different appearance, motion patterns and interaction modes on the acceptance of the artificial fish replica. Our results indicate that realistic eye dummies along with natural motion patterns significantly improve the acceptance level of the RoboFish. Through the interactive behaviors, our system can be adjusted to imitate different individual characteristics of live animals, which further increases the bandwidth of possible applications of our RoboFish for the study of animal behavior.