1
|
DeLellis P, Cadolini E, Croce A, Yang Y, di Bernardo M, Porfiri M. Model-based feedback control of live zebrafish behavior via interaction with a robotic replica. IEEE T ROBOT 2021; 36:28-41. [PMID: 33746643 DOI: 10.1109/tro.2019.2943066] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
The possibility of regulating the behavior of live animals using biologically-inspired robots has attracted the interest of biologists and engineers for over twenty-five years. From early work on insects to recent endeavors on mammals, we have witnessed fascinating applications that have pushed forward our understanding of animal behavior along new directions. Despite significant progress, most of the research has focused on open-loop control systems, in which robots execute predetermined actions, independent of the animal behavior. We integrate mathematical modeling of social behavior toward the design of realistic feedback laws for robots to interact with a live animal. In particular, we leverage recent advancements in data-driven modeling of zebrafish behavior. Ultimately, we establish a novel robotic platform that allows real-time actuation of a biologically-inspired 3D-printed zebrafish replica to implement model-based control of animal behavior. We demonstrate our approach through a series of experiments, designed to elucidate the appraisal of the replica by live subjects with respect to conspecifics and to quantify the biological value of closed-loop control.
Collapse
Affiliation(s)
- Pietro DeLellis
- Department of Electrical Electrical Engineering and Information Technology, University of Naples Federico II. Department of Mechanical and Aerospace Engineering, New York University Tandon School of Engineering
| | - Edoardo Cadolini
- Department of Electrical Electrical Engineering and Information Technology, University of Naples Federico II. Department of Mechanical and Aerospace Engineering, New York University Tandon School of Engineering
| | - Arrigo Croce
- Department of Electrical Electrical Engineering and Information Technology, University of Naples Federico II. Department of Mechanical and Aerospace Engineering, New York University Tandon School of Engineering
| | - Yanpeng Yang
- Department of Mechanical and Aerospace Engineering, New York University Tandon School of Engineering. Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, School of Mechanical Engineering, Tianjin University, Tianjin, China
| | - Mario di Bernardo
- Department of Electrical Electrical Engineering and Information Technology, University of Naples Federico II. Department of Engineering Mathematics of the University of Bristol, U.K
| | - Maurizio Porfiri
- Department of Mechanical and Aerospace Engineering, New York University Tandon School of Engineering. Department of Biomedical Engineering, New York University Tandon School of Engineering
| |
Collapse
|
2
|
Chemtob Y, Cazenille L, Bonnet F, Gribovskiy A, Mondada F, Halloy J. Strategies to modulate zebrafish collective dynamics with a closed-loop biomimetic robotic system. BIOINSPIRATION & BIOMIMETICS 2020; 15:046004. [PMID: 32252047 DOI: 10.1088/1748-3190/ab8706] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
The objective of this study is to integrate biomimetic robots into small groups of zebrafish and to modulate their collective behaviours. A possible approach is to have the robots behave like sheepdogs. In this case, the robots would behave like a different species than the fish and would present different relevant behaviours. In this study, we explore different strategies that use biomimetic zebrafish behaviours. In past work, we have shown that robots biomimicking zebrafish can be socially integrated into zebrafish groups. We have also shown that a fish-like robot can modulate the rotation choice of zebrafish groups in a circular set-up. Here, we further study the modulation capabilities of such robots in a more complex set-up. To do this, we exploit zebrafish social behaviours we identified in previous studies. We first modulate collective departure by replicating the leadership mechanisms with the robot in a set-up composed of two rooms connected by a corridor. Then, we test different behavioural strategies to drive the fish groups towards a predefined target room. To drive the biohybrid groups towards a predefined choice, they have to adopt some specific fish-like behaviours. The first strategy is based on a single robot using the initiation behaviour. In this case, the robot keeps trying to initiate a group transition towards the target room. The second strategy is based on two robots, one initiating and one staying in the target room as a social attractant. The third strategy is based on a single robot behaving like a zebrafish but staying in the target room as a social attractant. The fourth strategy uses two robots behaving like zebrafish but staying in the target room. We conclude that robots can modulate zebrafish group behaviour by adopting strategies based on existing fish behaviours. Under these conditions, robots enable the testing of hypotheses about the behaviours of fish.
Collapse
Affiliation(s)
- Yohann Chemtob
- Univ Paris Diderot, Sorbonne Paris Cité, LIED, UMR 8236, 75013, Paris, France
| | | | | | | | | | | |
Collapse
|
3
|
Papaspyros V, Bonnet F, Collignon B, Mondada F. Bidirectional interactions facilitate the integration of a robot into a shoal of zebrafish Danio rerio. PLoS One 2019; 14:e0220559. [PMID: 31430290 PMCID: PMC6701756 DOI: 10.1371/journal.pone.0220559] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2019] [Accepted: 07/18/2019] [Indexed: 11/21/2022] Open
Abstract
Many studies on collective animal behavior seek to identify the individual rules that underlie collective patterns. However, it was not until the recent advancements of micro-electronic and embedded systems that scientists were able to create mixed groups of sensor-rich robots and animals and study collective interactions from the within a bio-hybrid group. In recent work, scientists showed that a robot-controlled lure is capable of influencing the collective decisions of zebrafish Danio rerio shoals moving in a ring and a two-room setup. Here, we study a closely related topic, that is, the collective behavior patterns that emerge when different behavioral models are reproduced through the use of a robotic lure. We design a behavioral model that alternates between obeying and disobeying the collective motion decisions in order to become socially accepted by the shoal members. Subsequently, we compare it against two extreme cases: a reactive and an imposing decision model. For this, we use spatial, directional and information theoretic metrics to measure the degree of integration of the robotic agent. We show that our model leads to similar information flow as in freely roaming shoals of zebrafish and exhibits leadership skills more often than the open-loop models. Thus, in order for the robot to achieve higher degrees of integration in the zebrafish shoal, it must, like any other shoal member, be bidirectionally involved in the decision making process. These findings provide insight on the ability to form mixed societies of animals and robots and yield promising results on the degree to which a robot can influence the collective decision making.
Collapse
Affiliation(s)
- Vaios Papaspyros
- Biorobotics Laboratory, Institute of Bioengineering, École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| | - Frank Bonnet
- Biorobotics Laboratory, Institute of Bioengineering, École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| | - Bertrand Collignon
- Biorobotics Laboratory, Institute of Bioengineering, École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
- Unit of Social Ecology (USE), Université libre de Bruxelles (ULB), Bruxelles, Belgium
| | - Francesco Mondada
- Biorobotics Laboratory, Institute of Bioengineering, École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| |
Collapse
|
4
|
Romano D, Donati E, Benelli G, Stefanini C. A review on animal-robot interaction: from bio-hybrid organisms to mixed societies. BIOLOGICAL CYBERNETICS 2019; 113:201-225. [PMID: 30430234 DOI: 10.1007/s00422-018-0787-5] [Citation(s) in RCA: 76] [Impact Index Per Article: 15.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/25/2017] [Accepted: 10/19/2018] [Indexed: 05/28/2023]
Abstract
Living organisms are far superior to state-of-the-art robots as they have evolved a wide number of capabilities that far encompass our most advanced technologies. The merging of biological and artificial world, both physically and cognitively, represents a new trend in robotics that provides promising prospects to revolutionize the paradigms of conventional bio-inspired design as well as biological research. In this review, a comprehensive definition of animal-robot interactive technologies is given. They can be at animal level, by augmenting physical or mental capabilities through an integrated technology, or at group level, in which real animals interact with robotic conspecifics. Furthermore, an overview of the current state of the art and the recent trends in this novel context is provided. Bio-hybrid organisms represent a promising research area allowing us to understand how a biological apparatus (e.g. muscular and/or neural) works, thanks to the interaction with the integrated technologies. Furthermore, by using artificial agents, it is possible to shed light on social behaviours characterizing mixed societies. The robots can be used to manipulate groups of living organisms to understand self-organization and the evolution of cooperative behaviour and communication.
Collapse
Affiliation(s)
- Donato Romano
- The BioRobotics Institute, Sant'Anna School of Advanced Studies, Viale Rinaldo Piaggio 34, 56025, Pontedera, PI, Italy.
| | - Elisa Donati
- The Institute of Neuroinformatics, University of Zurich/ETH, Winterthurerstrasse 190, 8057, Zurich, Switzerland
| | - Giovanni Benelli
- The BioRobotics Institute, Sant'Anna School of Advanced Studies, Viale Rinaldo Piaggio 34, 56025, Pontedera, PI, Italy
- Department of Agriculture, Food and Environment, University of Pisa, Via del Borghetto 80, 56124, Pisa, Italy
| | - Cesare Stefanini
- The BioRobotics Institute, Sant'Anna School of Advanced Studies, Viale Rinaldo Piaggio 34, 56025, Pontedera, PI, Italy
- HEIC Center, BME Department, Khalifa University, PO Box 127788, Abu Dhabi, UAE
| |
Collapse
|
5
|
Bonnet F, Mills R, Szopek M, Schönwetter-Fuchs S, Halloy J, Bogdan S, Correia L, Mondada F, Schmickl T. Robots mediating interactions between animals for interspecies collective behaviors. Sci Robot 2019; 4:4/28/eaau7897. [PMID: 33137747 DOI: 10.1126/scirobotics.aau7897] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2018] [Accepted: 02/06/2019] [Indexed: 12/30/2022]
Abstract
Self-organized collective behavior has been analyzed in diverse types of gregarious animals. Such collective intelligence emerges from the synergy between individuals, which behave at their own time and spatial scales and without global rules. Recently, robots have been developed to collaborate with animal groups in the pursuit of better understanding their decision-making processes. These biohybrid systems make cooperative relationships between artificial systems and animals possible, which can yield new capabilities in the resulting mixed group. However, robots are currently tailor-made to successfully engage with one animal species at a time. This limits the possibilities of introducing distinct species-dependent perceptual capabilities and types of behaviors in the same system. Here, we show that robots socially integrated into animal groups of honeybees and zebrafish, each one located in a different city, allowing these two species to interact. This interspecific information transfer is demonstrated by collective decisions that emerge between the two autonomous robotic systems and the two animal groups. The robots enable this biohybrid system to function at any distance and operates in water and air with multiple sensorimotor properties across species barriers and ecosystems. These results demonstrate the feasibility of generating and controlling behavioral patterns in biohybrid groups of multiple species. Such interspecies connections between diverse robotic systems and animal species may open the door for new forms of artificial collective intelligence, where the unrivaled perceptual capabilities of the animals and their brains can be used to enhance autonomous decision-making, which could find applications in selective "rewiring" of ecosystems.
Collapse
Affiliation(s)
- Frank Bonnet
- Robotic Systems Laboratory, École Polytechnique Fédérale de Lausanne, EPFL STI IMT LSRO, ME B3 30 (Bâtiment ME), Station 9 1015 Lausanne, Switzerland.
| | - Rob Mills
- BioISI, Faculdade de Ciências da Universidade de Lisboa, 1749-016 Lisbon, Portugal
| | - Martina Szopek
- Artificial Life Laboratory of the Institute of Biology, Karl-Franzens University Graz, Universitätsplatz 2, 8010 Graz, Austria
| | - Sarah Schönwetter-Fuchs
- Artificial Life Laboratory of the Institute of Biology, Karl-Franzens University Graz, Universitätsplatz 2, 8010 Graz, Austria
| | - José Halloy
- Univ Paris Diderot, Sorbonne Paris Cité, LIED UMR 8236, 75013 Paris, France
| | - Stjepan Bogdan
- Laboratory for Robotics and Intelligent Control Systems, Faculty of Electrical Engineering and Computing, University of Zagreb, Unska 3, 10000 Zagreb, Croatia
| | - Luís Correia
- BioISI, Faculdade de Ciências da Universidade de Lisboa, 1749-016 Lisbon, Portugal
| | - Francesco Mondada
- Robotic Systems Laboratory, École Polytechnique Fédérale de Lausanne, EPFL STI IMT LSRO, ME B3 30 (Bâtiment ME), Station 9 1015 Lausanne, Switzerland
| | - Thomas Schmickl
- Artificial Life Laboratory of the Institute of Biology, Karl-Franzens University Graz, Universitätsplatz 2, 8010 Graz, Austria
| |
Collapse
|