1
|
Zada D, Schulze L, Yu JH, Tarabishi P, Napoli JL, Milan J, Lovett-Barron M. Development of neural circuits for social motion perception in schooling fish. Curr Biol 2024; 34:3380-3391.e5. [PMID: 39025069 PMCID: PMC11419698 DOI: 10.1016/j.cub.2024.06.049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2024] [Revised: 05/15/2024] [Accepted: 06/20/2024] [Indexed: 07/20/2024]
Abstract
The collective behavior of animal groups emerges from the interactions among individuals. These social interactions produce the coordinated movements of bird flocks and fish schools, but little is known about their developmental emergence and neurobiological foundations. By characterizing the visually based schooling behavior of the micro glassfish Danionella cerebrum, we found that social development progresses sequentially, with animals first acquiring the ability to aggregate, followed by postural alignment with social partners. This social maturation was accompanied by the development of neural populations in the midbrain that were preferentially driven by visual stimuli that resemble the shape and movements of schooling fish. Furthermore, social isolation over the course of development impaired both schooling behavior and the neural encoding of social motion in adults. This work demonstrates that neural populations selective for the form and motion of conspecifics emerge with the experience-dependent development of collective movement.
Collapse
Affiliation(s)
- David Zada
- Department of Neurobiology, School of Biological Sciences. University of California, San Diego, La Jolla, CA 92093, USA
| | - Lisanne Schulze
- Department of Neurobiology, School of Biological Sciences. University of California, San Diego, La Jolla, CA 92093, USA
| | - Jo-Hsien Yu
- Department of Neurobiology, School of Biological Sciences. University of California, San Diego, La Jolla, CA 92093, USA
| | - Princess Tarabishi
- Department of Neurobiology, School of Biological Sciences. University of California, San Diego, La Jolla, CA 92093, USA
| | - Julia L Napoli
- Department of Neurobiology, School of Biological Sciences. University of California, San Diego, La Jolla, CA 92093, USA
| | - Jimjohn Milan
- Department of Neurobiology, School of Biological Sciences. University of California, San Diego, La Jolla, CA 92093, USA
| | - Matthew Lovett-Barron
- Department of Neurobiology, School of Biological Sciences. University of California, San Diego, La Jolla, CA 92093, USA.
| |
Collapse
|
2
|
Josephine Stednitz S, Lesak A, Fecker AL, Painter P, Washbourne P, Mazzucato L, Scott EK. Probabilistic modeling reveals coordinated social interaction states and their multisensory bases. ARXIV 2024:arXiv:2408.01683v1. [PMID: 39130202 PMCID: PMC11312628] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 08/13/2024]
Abstract
Social behavior across animal species ranges from simple pairwise interactions to thousands of individuals coordinating goal-directed movements. Regardless of the scale, these interactions are governed by the interplay between multimodal sensory information and the internal state of each animal. Here, we investigate how animals use multiple sensory modalities to guide social behavior in the highly social zebrafish (Danio rerio) and uncover the complex features of pairwise interactions early in development. To identify distinct behaviors and understand how they vary over time, we developed a new hidden Markov model with constrained linear-model emissions to automatically classify states of coordinated interaction, using the movements of one animal to predict those of another. We discovered that social behaviors alternate between two interaction states within a single experimental session, distinguished by unique movements and timescales. Long-range interactions, akin to shoaling, rely on vision, while mechanosensation underlies rapid synchronized movements and parallel swimming, precursors of schooling. Altogether, we observe spontaneous interactions in pairs of fish, develop novel hidden Markov modeling to reveal two fundamental interaction modes, and identify the sensory systems involved in each. Our modeling approach to pairwise social interactions has broad applicability to a wide variety of naturalistic behaviors and species and solves the challenge of detecting transient couplings between quasi-periodic time series.
Collapse
Affiliation(s)
| | - Andrew Lesak
- Institute of Neuroscience, University of Oregon, Eugene, OR, USA
| | - Adeline L Fecker
- Institute of Neuroscience, University of Oregon, Eugene, OR, USA
| | | | - Phil Washbourne
- Institute of Neuroscience, University of Oregon, Eugene, OR, USA
| | - Luca Mazzucato
- Institute of Neuroscience, University of Oregon, Eugene, OR, USA
| | - Ethan K Scott
- Department of Anatomy & Physiology, University of Melbourne, Parkville, VIC, Australia
- Queensland Brain Institute, University of Queensland, St Lucia, QLD, Australia
| |
Collapse
|
3
|
Yuan AE, Shou W. A rigorous and versatile statistical test for correlations between stationary time series. PLoS Biol 2024; 22:e3002758. [PMID: 39146390 PMCID: PMC11398661 DOI: 10.1371/journal.pbio.3002758] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2023] [Revised: 09/13/2024] [Accepted: 07/17/2024] [Indexed: 08/17/2024] Open
Abstract
In disciplines from biology to climate science, a routine task is to compute a correlation between a pair of time series and determine whether the correlation is statistically significant (i.e., unlikely under the null hypothesis that the time series are independent). This problem is challenging because time series typically exhibit autocorrelation and thus cannot be properly analyzed with the standard iid-oriented statistical tests. Although there are well-known parametric tests for time series, these are designed for linear correlation statistics and thus not suitable for the increasingly popular nonlinear correlation statistics. There are also nonparametric tests that can be used with any correlation statistic, but for these, the conditions that guarantee correct false positive rates are either restrictive or unclear. Here, we describe the truncated time-shift (TTS) test, a nonparametric procedure to test for dependence between 2 time series. We prove that this test correctly controls the false positive rate as long as one of the time series is stationary, a minimally restrictive requirement among current tests. The TTS test is versatile because it can be used with any correlation statistic. Using synthetic data, we demonstrate that this test performs correctly even while other tests suffer high false positive rates. In simulation examples, simple guidelines for parameter choices allow high statistical power to be achieved with sufficient data. We apply the test to datasets from climatology, animal behavior, and microbiome science, verifying previously discovered dependence relationships and detecting additional relationships.
Collapse
Affiliation(s)
- Alex E Yuan
- Molecular and Cellular Biology PhD program, University of Washington, Seattle, Washington, United States of America
- Fred Hutchinson Cancer Center, Seattle, Washington, United States of America
| | - Wenying Shou
- Centre for Life's Origins and Evolution, Department of Genetics, Evolution and Environment, University College London, London, United Kingdom
| |
Collapse
|
4
|
Papaspyros V, Theraulaz G, Sire C, Mondada F. Quantifying the biomimicry gap in biohybrid robot-fish pairs. BIOINSPIRATION & BIOMIMETICS 2024; 19:046020. [PMID: 38866031 DOI: 10.1088/1748-3190/ad577a] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/17/2024] [Accepted: 06/12/2024] [Indexed: 06/14/2024]
Abstract
Biohybrid systems in which robotic lures interact with animals have become compelling tools for probing and identifying the mechanisms underlying collective animal behavior. One key challenge lies in the transfer of social interaction models from simulations to reality, using robotics to validate the modeling hypotheses. This challenge arises in bridging what we term the 'biomimicry gap', which is caused by imperfect robotic replicas, communication cues and physics constraints not incorporated in the simulations, that may elicit unrealistic behavioral responses in animals. In this work, we used a biomimetic lure of a rummy-nose tetra fish (Hemigrammus rhodostomus) and a neural network (NN) model for generating biomimetic social interactions. Through experiments with a biohybrid pair comprising a fish and the robotic lure, a pair of real fish, and simulations of pairs of fish, we demonstrate that our biohybrid system generates social interactions mirroring those of genuine fish pairs. Our analyses highlight that: 1) the lure and NN maintain minimal deviation in real-world interactions compared to simulations and fish-only experiments, 2) our NN controls the robot efficiently in real-time, and 3) a comprehensive validation is crucial to bridge the biomimicry gap, ensuring realistic biohybrid systems.
Collapse
Affiliation(s)
- Vaios Papaspyros
- Mobile Robotic Systems (MOBOTS) group, School of Computer Science, École Polytechnique Fédérale de Lausanne (EPFL), CH-1015 Lausanne, Switzerland
| | - Guy Theraulaz
- Centre de Recherches sur la Cognition Animale, Centre de Biologie Intégrative, CNRS, Université de Toulouse III-Paul Sabatier, 31062 Toulouse, France
| | - Clément Sire
- Laboratoire de Physique Théorique, CNRS, Université de Toulouse III-Paul Sabatier, 31062 Toulouse, France
| | - Francesco Mondada
- Mobile Robotic Systems (MOBOTS) group, School of Computer Science, École Polytechnique Fédérale de Lausanne (EPFL), CH-1015 Lausanne, Switzerland
| |
Collapse
|
5
|
Xiao Y, Lei X, Zheng Z, Xiang Y, Liu YY, Peng X. Perception of motion salience shapes the emergence of collective motions. Nat Commun 2024; 15:4779. [PMID: 38839782 PMCID: PMC11153630 DOI: 10.1038/s41467-024-49151-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2023] [Accepted: 05/24/2024] [Indexed: 06/07/2024] Open
Abstract
Despite the profound implications of self-organization in animal groups for collective behaviors, understanding the fundamental principles and applying them to swarm robotics remains incomplete. Here we propose a heuristic measure of perception of motion salience (MS) to quantify relative motion changes of neighbors from first-person view. Leveraging three large bird-flocking datasets, we explore how this perception of MS relates to the structure of leader-follower (LF) relations, and further perform an individual-level correlation analysis between past perception of MS and future change rate of velocity consensus. We observe prevalence of the positive correlations in real flocks, which demonstrates that individuals will accelerate the convergence of velocity with neighbors who have higher MS. This empirical finding motivates us to introduce the concept of adaptive MS-based (AMS) interaction in swarm model. Finally, we implement AMS in a swarm of ~102 miniature robots. Swarm experiments show the significant advantage of AMS in enhancing self-organization of the swarm for smooth evacuations from confined environments.
Collapse
Affiliation(s)
- Yandong Xiao
- College of System Engineering, National University of Defense Technology, Changsha, Hunan, China.
| | - Xiaokang Lei
- College of Information and Control Engineering, Xi'an University of Architecture and Technology, Xi'an, Shaanxi, China
| | - Zhicheng Zheng
- School of Marine Science and Technology, Northwestern Polytechnical University, Xi'an, Shaanxi, China
| | - Yalun Xiang
- School of Marine Science and Technology, Northwestern Polytechnical University, Xi'an, Shaanxi, China
| | - Yang-Yu Liu
- Channing Division of Network Medicine, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
- Center for Artificial Intelligence and Modeling, The Carl R. Woese Institute for Genomic Biology, University of Illinois at Urbana-Champaign, Champaign, IL, USA
| | - Xingguang Peng
- School of Marine Science and Technology, Northwestern Polytechnical University, Xi'an, Shaanxi, China.
| |
Collapse
|
6
|
Schaerf TM, Wilson ADM, Welch M, Ward AJW. Collective order and group structure of shoaling fish subject to differing risk-level treatments with a sympatric predator. ROYAL SOCIETY OPEN SCIENCE 2024; 11:231511. [PMID: 39100626 PMCID: PMC11296334 DOI: 10.1098/rsos.231511] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/05/2023] [Revised: 02/09/2024] [Accepted: 02/27/2024] [Indexed: 08/06/2024]
Abstract
It is imperative for individuals to exhibit flexible behaviour according to ecological context, such as available resources or predation threat. Manipulative studies on responses to threat often focus on behaviour in the presence of a single indicator for the potential of predation, whereas in the wild perception of threat will probably be more nuanced. Here, we examine the collective behaviour of eastern mosquitofish (Gambusia holbrooki) subject to five differing threat scenarios relating to the presence and hunger state of a jade perch (Scortum barcoo). Across threat scenarios, groups exhibit unique behavioural profiles that differ in the durations that particular collective states are maintained, the probability of transitions between states, the size and duration of persistence of spatially defined subgroups, and the patterns of collective order of these subgroups. Under the greatest level of threat, subgroups of consistent membership persist for longer durations. Group-level behaviours, and their differences, are interconnected with differences in estimates of the underlying rules of interaction thought to govern collective motion. The responses of the group are shown to be specific to the details of a potential threat, rather than a binary response to the presence or absence of some form of threat.
Collapse
Affiliation(s)
- Timothy M. Schaerf
- School of Science and Technology, University of New England, Armidale, New South Wales, Australia
| | - Alexander D. M. Wilson
- School of Life and Environmental Sciences, University of Sydney, Sydney, New South Wales, Australia
- School of Biological and Marine Sciences, University of Plymouth, DevonPL4 8AA, UK
| | - Mitchell Welch
- School of Science and Technology, University of New England, Armidale, New South Wales, Australia
| | - Ashley J. W. Ward
- School of Life and Environmental Sciences, University of Sydney, Sydney, New South Wales, Australia
| |
Collapse
|
7
|
Puy A, Gimeno E, Torrents J, Bartashevich P, Miguel MC, Pastor-Satorras R, Romanczuk P. Selective social interactions and speed-induced leadership in schooling fish. Proc Natl Acad Sci U S A 2024; 121:e2309733121. [PMID: 38662546 PMCID: PMC11067465 DOI: 10.1073/pnas.2309733121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Accepted: 03/27/2024] [Indexed: 05/05/2024] Open
Abstract
Animals moving together in groups are believed to interact among each other with effective social forces, such as attraction, repulsion, and alignment. Such forces can be inferred using "force maps," i.e., by analyzing the dependency of the acceleration of a focal individual on relevant variables. Here, we introduce a force map technique suitable for the analysis of the alignment forces experienced by individuals. After validating it using an agent-based model, we apply the force map to experimental data of schooling fish. We observe signatures of an effective alignment force with faster neighbors and an unexpected antialignment with slower neighbors. Instead of an explicit antialignment behavior, we suggest that the observed pattern is the result of a selective attention mechanism, where fish pay less attention to slower neighbors. This mechanism implies the existence of temporal leadership interactions based on relative speeds between neighbors. We present support for this hypothesis both from agent-based modeling as well as from exploring leader-follower relationships in the experimental data.
Collapse
Affiliation(s)
- Andreu Puy
- Departament de Física, Universitat Politècnica de Catalunya, Barcelona08034, Spain
| | - Elisabet Gimeno
- Departament de Física, Universitat Politècnica de Catalunya, Barcelona08034, Spain
- Departament de Física de la Matèria Condensada, Universitat de Barcelona, Barcelona08028, Spain
| | - Jordi Torrents
- Departament de Física, Universitat Politècnica de Catalunya, Barcelona08034, Spain
- Departament de Física de la Matèria Condensada, Universitat de Barcelona, Barcelona08028, Spain
| | - Palina Bartashevich
- Institute for Theoretical Biology, Department of Biology, Humboldt-Universität zu Berlin, Berlin10115, Germany
- Excellence Cluster Science of Intelligence, Technische Universität Berlin, Berlin10587, Germany
| | - M. Carmen Miguel
- Departament de Física de la Matèria Condensada, Universitat de Barcelona, Barcelona08028, Spain
- Institute of Complex Systems (UBICS), Universitat de Barcelona, Barcelona08028, Spain
| | | | - Pawel Romanczuk
- Institute for Theoretical Biology, Department of Biology, Humboldt-Universität zu Berlin, Berlin10115, Germany
- Excellence Cluster Science of Intelligence, Technische Universität Berlin, Berlin10587, Germany
- Bernstein Center for Computational Neuroscience, Berlin10115, Germany
| |
Collapse
|
8
|
Zampetaki A, Yang Y, Löwen H, Royall CP. Dynamical order and many-body correlations in zebrafish show that three is a crowd. Nat Commun 2024; 15:2591. [PMID: 38519478 PMCID: PMC10959973 DOI: 10.1038/s41467-024-46426-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Accepted: 02/27/2024] [Indexed: 03/25/2024] Open
Abstract
Zebrafish constitute a convenient laboratory-based biological system for studying collective behavior. It is possible to interpret a group of zebrafish as a system of interacting agents and to apply methods developed for the analysis of systems of active and even passive particles. Here, we consider the effect of group size. We focus on two- and many-body spatial correlations and dynamical order parameters to investigate the multistate behavior. For geometric reasons, the smallest group of fish which can exhibit this multistate behavior consisting of schooling, milling and swarming is three. We find that states exhibited by groups of three fish are similar to those of much larger groups, indicating that there is nothing more than a gradual change in weighting between the different states as the system size changes. Remarkably, when we consider small groups of fish sampled from a larger group, we find very little difference in the occupancy of the state with respect to isolated groups, nor is there much change in the spatial correlations between the fish. This indicates that fish interact predominantly with their nearest neighbors, perceiving the rest of the group as a fluctuating background. Therefore, the behavior of a crowd of fish is already apparent in groups of three fish.
Collapse
Affiliation(s)
- Alexandra Zampetaki
- Institute for Applied Physics, TU Wien, A-1040, Wien, Austria.
- Institut für Theoretische Physik: Weiche Materie, Heinrich-Heine-Universität, 40225, Düsseldorf, Germany.
| | - Yushi Yang
- HH Wills Physics Laboratory, Tyndall Avenue, Bristol, BS8 1TL, UK.
| | - Hartmut Löwen
- Institut für Theoretische Physik: Weiche Materie, Heinrich-Heine-Universität, 40225, Düsseldorf, Germany
| | - C Patrick Royall
- Gulliver, UMR CNRS 7083, ESPCI Paris, Université PSL, 75005, Paris, France.
| |
Collapse
|
9
|
Papaspyros V, Escobedo R, Alahi A, Theraulaz G, Sire C, Mondada F. Predicting the long-term collective behaviour of fish pairs with deep learning. J R Soc Interface 2024; 21:20230630. [PMID: 38442859 PMCID: PMC10914514 DOI: 10.1098/rsif.2023.0630] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2023] [Accepted: 02/06/2024] [Indexed: 03/07/2024] Open
Abstract
Modern computing has enhanced our understanding of how social interactions shape collective behaviour in animal societies. Although analytical models dominate in studying collective behaviour, this study introduces a deep learning model to assess social interactions in the fish species Hemigrammus rhodostomus. We compare the results of our deep learning approach with experiments and with the results of a state-of-the-art analytical model. To that end, we propose a systematic methodology to assess the faithfulness of a collective motion model, exploiting a set of stringent individual and collective spatio-temporal observables. We demonstrate that machine learning (ML) models of social interactions can directly compete with their analytical counterparts in reproducing subtle experimental observables. Moreover, this work emphasizes the need for consistent validation across different timescales, and identifies key design aspects that enable our deep learning approach to capture both short- and long-term dynamics. We also show that our approach can be extended to larger groups without any retraining, and to other fish species, while retaining the same architecture of the deep learning network. Finally, we discuss the added value of ML in the context of the study of collective motion in animal groups and its potential as a complementary approach to analytical models.
Collapse
Affiliation(s)
- Vaios Papaspyros
- Mobile Robotic Systems (Mobots) group, Institute of Electrical and Micro Engineering, École Polytechnique Fédérale de Lausanne (EPFL), CH-1015 Lausanne, Switzerland
| | - Ramón Escobedo
- Centre de Recherches sur la Cognition Animale, Centre de Biologie Intégrative, CNRS, Université de Toulouse III – Paul Sabatier, 31062 Toulouse, France
| | - Alexandre Alahi
- VITA group, Civil Engineering Institute, École Polytechnique Fédérale de Lausanne (EPFL), CH-1015 Lausanne, Switzerland
| | - Guy Theraulaz
- Centre de Recherches sur la Cognition Animale, Centre de Biologie Intégrative, CNRS, Université de Toulouse III – Paul Sabatier, 31062 Toulouse, France
| | - Clément Sire
- Laboratoire de Physique Théorique, CNRS, Université de Toulouse III – Paul Sabatier, 31062 Toulouse, France
| | - Francesco Mondada
- Mobile Robotic Systems (Mobots) group, Institute of Electrical and Micro Engineering, École Polytechnique Fédérale de Lausanne (EPFL), CH-1015 Lausanne, Switzerland
| |
Collapse
|
10
|
Li B, Liang W, Fu S, Fu C, Cai Z, Munson A, Shi H. Swimming behavior affects ingestion of microplastics by fish. AQUATIC TOXICOLOGY (AMSTERDAM, NETHERLANDS) 2024; 266:106798. [PMID: 38104508 DOI: 10.1016/j.aquatox.2023.106798] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/12/2023] [Revised: 11/29/2023] [Accepted: 12/08/2023] [Indexed: 12/19/2023]
Abstract
Microplastics (< 5 mm) are widely found in organisms and have the potential harm to ecosystems. Despite their widespread prevalence in environments, there is high individual varation in the abundance of microplastics found in individuals of the same species. In the present study, juvenile cichlid fish (Chindongo demasoni) were chosen to determine the ingestion personality for microplastics in the laboratory. The visible implant fluorescent tags were used for individual recognition. The fish were fed with microplastic fiber, pellet, and food for comparison. Our results showed that the observation of the behaviors of fish could be successfully matched with subsequent measurements for each individual through the tag method in microplastic research. The difference in the abundance of fiber (0-27 items/ind.) among fish individuals was also observed in our study. Meanwhile, the abundance of fiber showed a positive correlation with the average speed and covered area of fish, which indicates the degree of activity of fish. Moreover, fish with higher speed or a front position had higher capturing times for pellet. Our results suggest that the swimming behaviors of fish affect their ingestion of microplastics, and active fish had a higher likelihood of ingesting microplastics, which might be one of the reasons for the common phenomena, i.e., great individual differences observed in microplastic studies.
Collapse
Affiliation(s)
- Bowen Li
- State Key Laboratory of Estuarine and Coastal Research, East China Normal University, Shanghai 200241, China; State Environmental Protection Key Laboratory of Environmental Pollution Health Risk Assessment, Research Group of Emerging Contaminants, South China Institute of Environmental Sciences, Ministry of Ecology and Environment, Guangzhou 510655, China
| | - Weiwenhui Liang
- State Key Laboratory of Estuarine and Coastal Research, East China Normal University, Shanghai 200241, China
| | - Shijian Fu
- Laboratory of Evolutionary Physiology and Behavior, Chongqing Key Laboratory of Animal Biology, Chongqing Normal University, Chongqing 401331, China
| | - Cheng Fu
- Laboratory of Evolutionary Physiology and Behavior, Chongqing Key Laboratory of Animal Biology, Chongqing Normal University, Chongqing 401331, China
| | - Zonghui Cai
- Faculty of Engineering, University of Toyama, Toyama-shi 930-8555, Japan
| | - Amelia Munson
- Institute of Biodiversity, Animal Health and Comparative Medicine, University of Glasgow, Glasgow G12 8QQ, United Kingdom
| | - Huahong Shi
- State Key Laboratory of Estuarine and Coastal Research, East China Normal University, Shanghai 200241, China.
| |
Collapse
|
11
|
Trucco A. Applying collective motion models to study discordant individual behaviours within a school of fish. ROYAL SOCIETY OPEN SCIENCE 2023; 10:231618. [PMID: 38077215 PMCID: PMC10698483 DOI: 10.1098/rsos.231618] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Accepted: 11/16/2023] [Indexed: 01/11/2024]
Abstract
Computational models of collective motion successfully reproduce the most common behaviours of a school of fish, using only a few elementary interactions between individuals. However, their ability to also reproduce individual behaviours that are discordant from those of the group has not yet been adequately investigated. In this paper, a self-propelled particle model using three interaction zones is considered in relation to the counter-rotation of an individual: a phenomenon observable in real schools of fish milling in a torus, when an individual moves in the same torus but in the opposite direction for a certain period of time. This study shows that the interactions of repulsion, orientation and attraction between individuals moving at constant speed in a three-dimensional space, with asynchronous updating, can generate temporary counter-rotations. The analysis of such events sheds light on the mechanisms that start the counter-rotation and those that end it. Although the contribution of the repulsion interaction is often significant to start and terminate the counter-rotation, it does not prove to be decisive. Indeed, it is observed that even when interactions between individuals are limited to attraction alone, temporary counter-rotations of individuals occur, provided the fish density along the circumference is not uniform. Some of these conclusions, deduced from the simulations performed, are visually consistent with what is observed in some underwater video recordings of milling schools of fish.
Collapse
Affiliation(s)
- Andrea Trucco
- Department of Electrical, Electronic, Telecommunications Engineering, and Naval Architecture (DITEN), University of Genoa, 16145 Genoa, Italy
- Consorzio Nazionale Interuniversitario per le Telecomunicazioni (CNIT), 16145 Genoa, Italy
| |
Collapse
|
12
|
Mudaliar RK, Schaerf TM. An examination of force maps targeted at orientation interactions in moving groups. PLoS One 2023; 18:e0286810. [PMID: 37676869 PMCID: PMC10484433 DOI: 10.1371/journal.pone.0286810] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Accepted: 05/23/2023] [Indexed: 09/09/2023] Open
Abstract
Force mapping is an established method for inferring the underlying interaction rules thought to govern collective motion from trajectory data. Here we examine the ability of force maps to reconstruct interactions that govern individual's tendency to orient, or align, their heading within a moving group, one of the primary factors thought to drive collective motion, using data from three established general collective motion models. Specifically, our force maps extract how individuals adjust their direction of motion on average as a function of the distance to neighbours and relative alignment in heading with these neighbours, or in more detail as a function of the relative coordinates and relative headings of neighbours. We also examine the association between plots of local alignment and underlying alignment rules. We find that the simpler force maps that examined changes in heading as a function of neighbour distances and differences in heading can qualitatively reconstruct the form of orientation interactions, but also overestimate the spatial range over which these interactions apply. More complex force maps that examine heading changes as a function of the relative coordinates of neighbours (in two spatial dimensions), can also reveal underlying orientation interactions in some cases, but are relatively harder to interpret. Responses to neighbours in both the simpler and more complex force maps are affected by group-level patterns of motion. We also find a correlation between the sizes of regions of high alignment in local alignment plots and the size of the region over which alignment rules apply when only an alignment interaction rule is in action. However, when data derived from more complex models is analysed, the shapes of regions of high alignment are clearly influenced by emergent patterns of motion, and these regions of high alignment can appear even when there is no explicit direct mechanism that governs alignment.
Collapse
Affiliation(s)
- Rajnesh K. Mudaliar
- School of Mathematical and Computing Science, Fiji National University, Ba, Fiji
- School of Science and Technology, University of New England, Armidale, NSW, Australia
| | - Timothy M. Schaerf
- School of Science and Technology, University of New England, Armidale, NSW, Australia
| |
Collapse
|
13
|
Romero-Ferrero F, Heras FJH, Rance D, de Polavieja GG. A study of transfer of information in animal collectives using deep learning tools. Philos Trans R Soc Lond B Biol Sci 2023; 378:20220073. [PMID: 36802786 PMCID: PMC9939271 DOI: 10.1098/rstb.2022.0073] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/21/2023] Open
Abstract
We studied how the interactions among animals in a collective allow for the transfer of information. We performed laboratory experiments to study how zebrafish in a collective follow a subset of trained animals that move towards a light when it turns on because they expect food at that location. We built some deep learning tools to distinguish from video which are the trained and the naïve animals and to detect when each animal reacts to the light turning on. These tools gave us the data to build a model of interactions that we designed to have a balance between transparency and accuracy. The model finds a low-dimensional function that describes how a naïve animal weights neighbours depending on focal and neighbour variables. According to this low-dimensional function, neighbour speed plays an important role in the interactions. Specifically, a naïve animal weights more a neighbour in front than to the sides or behind, and more so the faster the neighbour is moving; and if the neighbour moves fast enough, the differences coming from the neighbour's relative position largely disappear. From the lens of decision-making, neighbour speed acts as confidence measure about where to go. This article is part of a discussion meeting issue 'Collective behaviour through time'.
Collapse
Affiliation(s)
| | | | - Dean Rance
- Champalimaud Research, Champalimaud Foundation, 1400-038 Lisbon, Portugal
| | | |
Collapse
|
14
|
Quera V, Beltran FS, Gimeno E, Dolado R. Motion leadership and local interaction in two species of freshwater fish (Danio rerio and Hyphessobrycon herbertaxelrodi). JOURNAL OF FISH BIOLOGY 2023; 102:856-869. [PMID: 36647918 DOI: 10.1111/jfb.15315] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Accepted: 01/10/2023] [Indexed: 06/17/2023]
Abstract
The authors studied momentary motion leadership in small groups of black neon tetra (Hyphessobrycon herbertaxelrodi) and zebrafish (Danio rerio), its relationship with local interaction parameters, such as the acceleration and turning angle of the individuals, and the relative locations of the individuals within the group. The purpose was to know whether leadership tended to be monopolised by certain individuals or whether it was equitably shared between them and if there were differences in leadership sharing between these two species, which are known to have different degrees of cohesion and polarisation. The authors filmed groups of two, three, four and eight fishes of each species and tracked their individual motion by image analysis and trajectory extraction. In both species, motion leadership was not monopolized but egalitarian and very short lived, with leadership shifts distributed randomly over time. The duration of leadership episodes decreased as group size increased and was longer in black neon tetra than in zebrafish. Momentary leaders did not tend to be in the front positions, but closer to the centre of the group. Acceleration and turning angle were more extreme in zebrafish than in black neon tetra and in the momentary leaders than the followers in both species. In general, these differences between species and between leaders/followers were qualitatively similar with some differences in detail, indicating that the relationship between motion leadership and local interaction parameters is likely to conform to a general physical law.
Collapse
Affiliation(s)
- Vicenç Quera
- Institute of Neurosciences (NeuroUB), Quantitative Psychology Unit, University of Barcelona, Barcelona, Spain
| | - Francesc S Beltran
- Institute of Neurosciences (NeuroUB), Quantitative Psychology Unit, University of Barcelona, Barcelona, Spain
| | - Elisabet Gimeno
- Institute of Neurosciences (NeuroUB), Quantitative Psychology Unit, University of Barcelona, Barcelona, Spain
| | - Ruth Dolado
- Institute of Neurosciences (NeuroUB), Quantitative Psychology Unit, University of Barcelona, Barcelona, Spain
| |
Collapse
|
15
|
Eguiraun H, Martinez I. Entropy and Fractal Techniques for Monitoring Fish Behaviour and Welfare in Aquacultural Precision Fish Farming-A Review. ENTROPY (BASEL, SWITZERLAND) 2023; 25:e25040559. [PMID: 37190348 PMCID: PMC10137457 DOI: 10.3390/e25040559] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Revised: 03/19/2023] [Accepted: 03/22/2023] [Indexed: 05/17/2023]
Abstract
In a non-linear system, such as a biological system, the change of the output (e.g., behaviour) is not proportional to the change of the input (e.g., exposure to stressors). In addition, biological systems also change over time, i.e., they are dynamic. Non-linear dynamical analyses of biological systems have revealed hidden structures and patterns of behaviour that are not discernible by classical methods. Entropy analyses can quantify their degree of predictability and the directionality of individual interactions, while fractal dimension (FD) analyses can expose patterns of behaviour within apparently random ones. The incorporation of these techniques into the architecture of precision fish farming (PFF) and intelligent aquaculture (IA) is becoming increasingly necessary to understand and predict the evolution of the status of farmed fish. This review summarizes recent works on the application of entropy and FD techniques to selected individual and collective fish behaviours influenced by the number of fish, tagging, pain, preying/feed search, fear/anxiety (and its modulation) and positive emotional contagion (the social contagion of positive emotions). Furthermore, it presents an investigation of collective and individual interactions in shoals, an exposure of the dynamics of inter-individual relationships and hierarchies, and the identification of individuals in groups. While most of the works have been carried out using model species, we believe that they have clear applications in PFF. The review ends by describing some of the major challenges in the field, two of which are, unsurprisingly, the acquisition of high-quality, reliable raw data and the construction of large, reliable databases of non-linear behavioural data for different species and farming conditions.
Collapse
Affiliation(s)
- Harkaitz Eguiraun
- Department of Graphic Design & Engineering Projects, Faculty of Engineering in Bilbao, University of the Basque Country UPV/EHU, 48013 Bilbao, Bizkaia, Spain
- Research Center for Experimental Marine Biology and Biotechnology-Plentziako Itsas Estazioa (PiE-UPV/EHU), University of the Basque Country (UPV/EHU), 48620 Plentzia, Bizkaia, Spain
| | - Iciar Martinez
- Research Center for Experimental Marine Biology and Biotechnology-Plentziako Itsas Estazioa (PiE-UPV/EHU), University of the Basque Country (UPV/EHU), 48620 Plentzia, Bizkaia, Spain
- Department of Zoology and Animal Cell Biology, Faculty of Science and Technology, University of the Basque Country (UPV/EHU), 48940 Leioa, Bizkaia, Spain
- IKERBASQUE, Basque Foundation for Science, 48009 Bilbao, Bizkaia, Spain
| |
Collapse
|
16
|
Multi-view Tracking, Re-ID, and Social Network Analysis of a Flock of Visually Similar Birds in an Outdoor Aviary. Int J Comput Vis 2023. [DOI: 10.1007/s11263-023-01768-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/08/2023]
|
17
|
Jiang M, Zhou A, Chen R, Yang Y, Dong H, Wang W. Collective motions of fish originate from balanced local perceptual interactions and individual stochastics. Phys Rev E 2023; 107:024411. [PMID: 36932600 DOI: 10.1103/physreve.107.024411] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Accepted: 01/23/2023] [Indexed: 06/18/2023]
Abstract
The movement of a group of biological individuals, such as fish schools, can evolve from disordered motions to synergistic movements or even ordered patterns. However, the physical origins behind such emergent phenomena of complex systems remain elusive. Here, we established a high-precision protocol for studying the collective behavior of biological groups in quasi-two-dimensional systems. Based on our video recording of ∼600h of fish movements, we extracted a force map of the interactions between fish from their trajectories using the convolution neural network. Presumably, this force implies the fish's perception of the surrounding individuals, the environment, and their response to social information. Interestingly, the fish in our experiments were predominantly in a seemingly disordered swarm state, but their local interactions were clearly specific. Combining such local interactions with the inherent stochasticity of the fish movements, we reproduced the collective motions of the fish through simulations. We demonstrated that a delicate balance between the specific local force and the intrinsic stochasticity is essential for ordered movements. This study presents implications for self-organized systems that use basic physical characterization to produce higher-level sophistication.
Collapse
Affiliation(s)
- Mingjie Jiang
- Kuang Yaming Honors School, Nanjing University, Nanjing 210023, China
| | - Anyu Zhou
- Kuang Yaming Honors School, Nanjing University, Nanjing 210023, China
- School of Physics, National Laboratory of Solid State Microstructure, and Collaborative Innovation Center of Advanced Microstructures, Nanjing University, Nanjing 210093, China
| | - Runping Chen
- Kuang Yaming Honors School, Nanjing University, Nanjing 210023, China
| | - Yuqin Yang
- Kuang Yaming Honors School, Nanjing University, Nanjing 210023, China
| | - Hao Dong
- Kuang Yaming Honors School, Nanjing University, Nanjing 210023, China
- Institute for Brain Sciences, Nanjing University, Nanjing 210023, China
- State Key Laboratory of Analytical Chemistry for Life Science, Nanjing University, Nanjing 210023, China
| | - Wei Wang
- School of Physics, National Laboratory of Solid State Microstructure, and Collaborative Innovation Center of Advanced Microstructures, Nanjing University, Nanjing 210093, China
- Institute for Brain Sciences, Nanjing University, Nanjing 210023, China
| |
Collapse
|
18
|
Bleichman I, Yadav P, Ayali A. Visual processing and collective motion-related decision-making in desert locusts. Proc Biol Sci 2023; 290:20221862. [PMID: 36651041 PMCID: PMC9845972 DOI: 10.1098/rspb.2022.1862] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/19/2023] Open
Abstract
Collectively moving groups of animals rely on the decision-making of locally interacting individuals in order to maintain swarm cohesion. However, the complex and noisy visual environment poses a major challenge to the extraction and processing of relevant information. We addressed this challenge by studying swarming-related decision-making in desert locust last-instar nymphs. Controlled visual stimuli, in the form of random dot kinematograms, were presented to tethered locust nymphs in a trackball set-up, while monitoring movement trajectory and walking parameters. In a complementary set of experiments, the neurophysiological basis of the observed behavioural responses was explored. Our results suggest that locusts use filtering and discrimination upon encountering multiple stimuli simultaneously. Specifically, we show that locusts are sensitive to differences in speed at the individual conspecific level, and to movement coherence at the group level, and may use these to filter out non-relevant stimuli. The locusts also discriminate and assign different weights to different stimuli, with an observed interactive effect of stimulus size, relative abundance and motion direction. Our findings provide insights into the cognitive abilities of locusts in the domain of decision-making and visual-based collective motion, and support locusts as a model for investigating sensory-motor integration and motion-related decision-making in the intricate swarm environment.
Collapse
Affiliation(s)
| | - Pratibha Yadav
- School of Zoology, Tel Aviv University, 6997801 Israel,Sagol School of Neuroscience, Tel Aviv University, 6997801 Israel
| | - Amir Ayali
- School of Zoology, Tel Aviv University, 6997801 Israel,Sagol School of Neuroscience, Tel Aviv University, 6997801 Israel
| |
Collapse
|
19
|
Geng Y, Yates C, Peterson RT. Social behavioral profiling by unsupervised deep learning reveals a stimulative effect of dopamine D3 agonists on zebrafish sociality. CELL REPORTS METHODS 2023; 3:100381. [PMID: 36814839 PMCID: PMC9939379 DOI: 10.1016/j.crmeth.2022.100381] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/23/2022] [Revised: 11/15/2022] [Accepted: 12/12/2022] [Indexed: 01/07/2023]
Abstract
It has been a major challenge to systematically evaluate and compare how pharmacological perturbations influence social behavioral outcomes. Although some pharmacological agents are known to alter social behavior, precise description and quantification of such effects have proven difficult. We developed a scalable social behavioral assay for zebrafish named ZeChat based on unsupervised deep learning to characterize sociality at high resolution. High-dimensional and dynamic social behavioral phenotypes are automatically classified using this method. By screening a neuroactive compound library, we found that different classes of chemicals evoke distinct patterns of social behavioral fingerprints. By examining these patterns, we discovered that dopamine D3 agonists possess a social stimulative effect on zebrafish. The D3 agonists pramipexole, piribedil, and 7-hydroxy-DPAT-HBr rescued social deficits in a valproic-acid-induced zebrafish autism model. The ZeChat platform provides a promising approach for dissecting the pharmacology of social behavior and discovering novel social-modulatory compounds.
Collapse
Affiliation(s)
- Yijie Geng
- Department of Pharmacology and Toxicology, College of Pharmacy, University of Utah, Salt Lake City, UT 84112, USA
| | - Christopher Yates
- Department of Pharmacology and Toxicology, College of Pharmacy, University of Utah, Salt Lake City, UT 84112, USA
| | - Randall T. Peterson
- Department of Pharmacology and Toxicology, College of Pharmacy, University of Utah, Salt Lake City, UT 84112, USA
| |
Collapse
|
20
|
Individual and collective behaviour of fish subject to differing risk-level treatments with a sympatric predator. Behav Ecol Sociobiol 2022. [DOI: 10.1007/s00265-022-03269-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
21
|
Xiao J, Yuan G, He J, Fang K, Wang Z. Graph attention mechanism based reinforcement learning for multi-agent flocking control in communication-restricted environment. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.11.059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
22
|
Shoeibi A, Moridian P, Khodatars M, Ghassemi N, Jafari M, Alizadehsani R, Kong Y, Gorriz JM, Ramírez J, Khosravi A, Nahavandi S, Acharya UR. An overview of deep learning techniques for epileptic seizures detection and prediction based on neuroimaging modalities: Methods, challenges, and future works. Comput Biol Med 2022; 149:106053. [DOI: 10.1016/j.compbiomed.2022.106053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2022] [Revised: 08/17/2022] [Accepted: 08/17/2022] [Indexed: 02/01/2023]
|
23
|
Kappel JM, Förster D, Slangewal K, Shainer I, Svara F, Donovan JC, Sherman S, Januszewski M, Baier H, Larsch J. Visual recognition of social signals by a tectothalamic neural circuit. Nature 2022; 608:146-152. [PMID: 35831500 PMCID: PMC9352588 DOI: 10.1038/s41586-022-04925-5] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Accepted: 06/02/2022] [Indexed: 12/23/2022]
Abstract
Social affiliation emerges from individual-level behavioural rules that are driven by conspecific signals1-5. Long-distance attraction and short-distance repulsion, for example, are rules that jointly set a preferred interanimal distance in swarms6-8. However, little is known about their perceptual mechanisms and executive neural circuits3. Here we trace the neuronal response to self-like biological motion9,10, a visual trigger for affiliation in developing zebrafish2,11. Unbiased activity mapping and targeted volumetric two-photon calcium imaging revealed 21 activity hotspots distributed throughout the brain as well as clustered biological-motion-tuned neurons in a multimodal, socially activated nucleus of the dorsal thalamus. Individual dorsal thalamus neurons encode local acceleration of visual stimuli mimicking typical fish kinetics but are insensitive to global or continuous motion. Electron microscopic reconstruction of dorsal thalamus neurons revealed synaptic input from the optic tectum and projections into hypothalamic areas with conserved social function12-14. Ablation of the optic tectum or dorsal thalamus selectively disrupted social attraction without affecting short-distance repulsion. This tectothalamic pathway thus serves visual recognition of conspecifics, and dissociates neuronal control of attraction from repulsion during social affiliation, revealing a circuit underpinning collective behaviour.
Collapse
Affiliation(s)
- Johannes M Kappel
- Max Planck Institute for Biological Intelligence (formerly Max Planck Institute of Neurobiology), Planegg, Germany
| | - Dominique Förster
- Max Planck Institute for Biological Intelligence (formerly Max Planck Institute of Neurobiology), Planegg, Germany
| | - Katja Slangewal
- Max Planck Institute for Biological Intelligence (formerly Max Planck Institute of Neurobiology), Planegg, Germany
- Centre for the Advanced Study of Collective Behaviour, University of Konstanz, Konstanz, Germany
| | - Inbal Shainer
- Max Planck Institute for Biological Intelligence (formerly Max Planck Institute of Neurobiology), Planegg, Germany
| | - Fabian Svara
- Max Planck Institute for Biological Intelligence (formerly Max Planck Institute of Neurobiology), Planegg, Germany
- Max Planck Institute for Neurobiology of Behavior - caesar, Bonn, Germany
| | - Joseph C Donovan
- Max Planck Institute for Biological Intelligence (formerly Max Planck Institute of Neurobiology), Planegg, Germany
| | - Shachar Sherman
- Max Planck Institute for Biological Intelligence (formerly Max Planck Institute of Neurobiology), Planegg, Germany
| | | | - Herwig Baier
- Max Planck Institute for Biological Intelligence (formerly Max Planck Institute of Neurobiology), Planegg, Germany.
| | - Johannes Larsch
- Max Planck Institute for Biological Intelligence (formerly Max Planck Institute of Neurobiology), Planegg, Germany.
| |
Collapse
|
24
|
Selective interaction and its effect on collective motion. Sci Rep 2022; 12:8601. [PMID: 35597774 PMCID: PMC9124219 DOI: 10.1038/s41598-022-12525-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2021] [Accepted: 05/09/2022] [Indexed: 11/29/2022] Open
Abstract
Plenty of empirical evidence on biological swarms reveal that interaction between individuals is selective. Each individual’s neighbor is selected based on one or more featured factors. Based on the self-propelled model, we develop a general probability neighbor selection framework to study the effect of four typical featured factors (i.e., distance, bearing, orientation change and bearing change). In this work, two common cases are involved to comprehensively analyze the impact of the four featured factors on the collective motion. One is the flocking, the other is the responsivity to stimulus. The impact of different selection strengths of the featured factors on both cases are investigated. The effect of noise on flocking and different stimulus intensities on responsivity to stimulus are analyzed. This study allows us to get the insight of selective interaction and suggests the potential solution to overcome the trade-off between flocking and responsivity quality.
Collapse
|
25
|
Signaroli M, Lana A, Martorell-Barceló M, Sanllehi J, Barcelo-Serra M, Aspillaga E, Mulet J, Alós J. Measuring inter-individual differences in behavioural types of gilthead seabreams in the laboratory using deep learning. PeerJ 2022; 10:e13396. [PMID: 35539012 PMCID: PMC9080431 DOI: 10.7717/peerj.13396] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2021] [Accepted: 04/16/2022] [Indexed: 01/14/2023] Open
Abstract
Deep learning allows us to automatize the acquisition of large amounts of behavioural animal data with applications for fisheries and aquaculture. In this work, we have trained an image-based deep learning algorithm, the Faster R-CNN (Faster region-based convolutional neural network), to automatically detect and track the gilthead seabream, Sparus aurata, to search for individual differences in behaviour. We collected videos using a novel Raspberry Pi high throughput recording system attached to individual experimental behavioural arenas. From the continuous recording during behavioural assays, we acquired and labelled a total of 14,000 images and used them, along with data augmentation techniques, to train the network. Then, we evaluated the performance of our network at different training levels, increasing the number of images and applying data augmentation. For every validation step, we processed more than 52,000 images, with and without the presence of the gilthead seabream, in normal and altered (i.e., after the introduction of a non-familiar object to test for explorative behaviour) behavioural arenas. The final and best version of the neural network, trained with all the images and with data augmentation, reached an accuracy of 92,79% ± 6.78% [89.24-96.34] of correct classification and 10.25 ± 61.59 pixels [6.59-13.91] of fish positioning error. Our recording system based on a Raspberry Pi and a trained convolutional neural network provides a valuable non-invasive tool to automatically track fish movements in experimental arenas and, using the trajectories obtained during behavioural tests, to assay behavioural types.
Collapse
Affiliation(s)
- Marco Signaroli
- Fish Ecology Group, Instituto Mediterráneo de Estudios Avanzados, IMEDEA (CSIC-UIB), Esporles, Illes Balears, Spain
| | - Arancha Lana
- Fish Ecology Group, Instituto Mediterráneo de Estudios Avanzados, IMEDEA (CSIC-UIB), Esporles, Illes Balears, Spain
| | - Martina Martorell-Barceló
- Fish Ecology Group, Instituto Mediterráneo de Estudios Avanzados, IMEDEA (CSIC-UIB), Esporles, Illes Balears, Spain
| | - Javier Sanllehi
- Fish Ecology Group, Instituto Mediterráneo de Estudios Avanzados, IMEDEA (CSIC-UIB), Esporles, Illes Balears, Spain
| | - Margarida Barcelo-Serra
- Fish Ecology Group, Instituto Mediterráneo de Estudios Avanzados, IMEDEA (CSIC-UIB), Esporles, Illes Balears, Spain
| | - Eneko Aspillaga
- Fish Ecology Group, Instituto Mediterráneo de Estudios Avanzados, IMEDEA (CSIC-UIB), Esporles, Illes Balears, Spain
| | - Júlia Mulet
- Fish Ecology Group, Instituto Mediterráneo de Estudios Avanzados, IMEDEA (CSIC-UIB), Esporles, Illes Balears, Spain
| | - Josep Alós
- Fish Ecology Group, Instituto Mediterráneo de Estudios Avanzados, IMEDEA (CSIC-UIB), Esporles, Illes Balears, Spain
| |
Collapse
|
26
|
LaChance J, Suh K, Clausen J, Cohen DJ. Learning the rules of collective cell migration using deep attention networks. PLoS Comput Biol 2022; 18:e1009293. [PMID: 35476698 PMCID: PMC9106212 DOI: 10.1371/journal.pcbi.1009293] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2021] [Revised: 05/13/2022] [Accepted: 03/23/2022] [Indexed: 11/18/2022] Open
Abstract
Collective, coordinated cellular motions underpin key processes in all multicellular organisms, yet it has been difficult to simultaneously express the ‘rules’ behind these motions in clear, interpretable forms that effectively capture high-dimensional cell-cell interaction dynamics in a manner that is intuitive to the researcher. Here we apply deep attention networks to analyze several canonical living tissues systems and present the underlying collective migration rules for each tissue type using only cell migration trajectory data. We use these networks to learn the behaviors of key tissue types with distinct collective behaviors—epithelial, endothelial, and metastatic breast cancer cells—and show how the results complement traditional biophysical approaches. In particular, we present attention maps indicating the relative influence of neighboring cells to the learned turning decisions of a ‘focal cell’–the primary cell of interest in a collective setting. Colloquially, we refer to this learned relative influence as ‘attention’, as it serves as a proxy for the physical parameters modifying the focal cell’s future motion as a function of each neighbor cell. These attention networks reveal distinct patterns of influence and attention unique to each model tissue. Endothelial cells exhibit tightly focused attention on their immediate forward-most neighbors, while cells in more expansile epithelial tissues are more broadly influenced by neighbors in a relatively large forward sector. Attention maps of ensembles of more mesenchymal, metastatic cells reveal completely symmetric attention patterns, indicating the lack of any particular coordination or direction of interest. Moreover, we show how attention networks are capable of detecting and learning how these rules change based on biophysical context, such as location within the tissue and cellular crowding. That these results require only cellular trajectories and no modeling assumptions highlights the potential of attention networks for providing further biological insights into complex cellular systems. Collective behaviors are crucial to the function of multicellular life, with large-scale, coordinated cell migration enabling processes spanning organ formation to coordinated skin healing. However, we lack effective tools to discover and cleanly express collective rules at the level of an individual cell. Here, we employ a carefully structured neural network to extract collective information directly from cell trajectory data. The network is trained on data from various systems, including canonical collective cell systems (HUVEC and MDCK cells) which display visually distinct forms of collective motion, and metastatic cancer cells (MDA-MB-231) which are highly uncoordinated. Using these trained networks, we can produce attention maps for each system, which indicate how a cell within a tissue takes in information from its surrounding neighbors, as a function of weights assigned to those neighbors. Thus for a cell type in which cells tend to follow the path of the cell in front, the attention maps will display high weights for cells spatially forward of the focal cell. We present results in terms of additional metrics, such as accuracy plots and number of interacting cells, and encourage future development of improved metrics.
Collapse
Affiliation(s)
- Julienne LaChance
- Department of Mechanical and Aerospace Engineering, Princeton University, Princeton, New Jersey, United States of America
| | - Kevin Suh
- Department of Chemical and Biological Engineering, Princeton University, Princeton, New Jersey, United States of America
| | - Jens Clausen
- Department of Mechanical and Aerospace Engineering, Princeton University, Princeton, New Jersey, United States of America
| | - Daniel J. Cohen
- Department of Mechanical and Aerospace Engineering, Princeton University, Princeton, New Jersey, United States of America
- Department of Chemical and Biological Engineering, Princeton University, Princeton, New Jersey, United States of America
- * E-mail:
| |
Collapse
|
27
|
Yang Y, Turci F, Kague E, Hammond CL, Russo J, Royall CP. Dominating lengthscales of zebrafish collective behaviour. PLoS Comput Biol 2022; 18:e1009394. [PMID: 35025883 PMCID: PMC8797201 DOI: 10.1371/journal.pcbi.1009394] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2021] [Revised: 01/28/2022] [Accepted: 12/09/2021] [Indexed: 11/19/2022] Open
Abstract
Collective behaviour in living systems is observed across many scales, from bacteria to insects, to fish shoals. Zebrafish have emerged as a model system amenable to laboratory study. Here we report a three-dimensional study of the collective dynamics of fifty zebrafish. We observed the emergence of collective behaviour changing between ordered to randomised, upon adaptation to new environmental conditions. We quantify the spatial and temporal correlation functions of the fish and identify two length scales, the persistence length and the nearest neighbour distance, that capture the essence of the behavioural changes. The ratio of the two length scales correlates robustly with the polarisation of collective motion that we explain with a reductionist model of self-propelled particles with alignment interactions.
Collapse
Affiliation(s)
- Yushi Yang
- Bristol Centre for Functional Nanomaterials, University of Bristol, Bristol, United Kingdom
- H.H. Wills Physics Laboratory, University of Bristol, Bristol, United Kingdom
- * E-mail:
| | - Francesco Turci
- H.H. Wills Physics Laboratory, University of Bristol, Bristol, United Kingdom
| | - Erika Kague
- Department of Physiology, Pharmacology, and Neuroscience, Medical Sciences, University of Bristol, Bristol, United Kingdom
| | - Chrissy L. Hammond
- Department of Physiology, Pharmacology, and Neuroscience, Medical Sciences, University of Bristol, Bristol, United Kingdom
| | - John Russo
- Department of Physics, Sapienza Università di Roma, Rome, Italy
| | - C. Patrick Royall
- H.H. Wills Physics Laboratory, University of Bristol, Bristol, United Kingdom
- Gulliver UMR CNRS 7083, ESPCI Paris, Università PSL, Paris, France
- School of Chemistry, University of Bristol, Bristol, United Kingdom
| |
Collapse
|
28
|
Systematic Analysis of Emergent Collective Motion Produced by a 3D Hybrid Zonal Model. Bull Math Biol 2021; 84:16. [PMID: 34921628 DOI: 10.1007/s11538-021-00977-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2021] [Accepted: 11/18/2021] [Indexed: 10/19/2022]
Abstract
Emergent patterns of collective motion are thought to arise from local rules of interaction that govern how individuals adjust their velocity in response to the relative locations and velocities of near neighbours. Many models of collective motion apply rules of interaction over a metric scale, based on the distances to neighbouring group members. However, empirical work suggests that some species apply interactions over a topological scale, based on distance determined neighbour rank. Here, we modify an important metric model of collective motion (Couzin et al. in J Theor Biol 218(1):1-11, 2002), so that interactions relating to orienting movements with neighbours and attraction towards more distant neighbours operate over topological scales. We examine the emergent group movement patterns generated by the model as the numbers of neighbours that contribute to orientation- and attraction-based velocity adjustments vary. Like the metric form of the model, simulated groups can fragment (when interactions are influenced by less than 10-15% of the group), swarm and move in parallel, but milling does not occur. The model also generates other cohesive group movements including cases where groups exhibit directed motion without strong overall alignment of individuals. Multiple emergent states are possible for the same set of underlying model parameters in some cases, suggesting sensitivity to initial conditions, and there is evidence that emergent states of the system depend on the history of the system. Groups that do not fragment tend to stay relatively compact in terms of neighbour distances. Even if a group does fragment, individuals remain relatively close to near neighbours, avoiding complete isolation.
Collapse
|
29
|
Harpaz R, Nguyen MN, Bahl A, Engert F. Precise visuomotor transformations underlying collective behavior in larval zebrafish. Nat Commun 2021; 12:6578. [PMID: 34772934 PMCID: PMC8590009 DOI: 10.1038/s41467-021-26748-0] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2021] [Accepted: 10/19/2021] [Indexed: 12/21/2022] Open
Abstract
Complex schooling behaviors result from local interactions among individuals. Yet, how sensory signals from neighbors are analyzed in the visuomotor stream of animals is poorly understood. Here, we studied aggregation behavior in larval zebrafish and found that over development larvae transition from overdispersed groups to tight shoals. Using a virtual reality assay, we characterized the algorithms fish use to transform visual inputs from neighbors into movement decisions. We found that young larvae turn away from virtual neighbors by integrating and averaging retina-wide visual occupancy within each eye, and by using a winner-take-all strategy for binocular integration. As fish mature, their responses expand to include attraction to virtual neighbors, which is based on similar algorithms of visual integration. Using model simulations, we show that the observed algorithms accurately predict group structure over development. These findings allow us to make testable predictions regarding the neuronal circuits underlying collective behavior in zebrafish.
Collapse
Affiliation(s)
- Roy Harpaz
- Department of Molecular and Cellular Biology, Harvard University, Cambridge, 02138, USA.
- Center for Brain Science, Harvard University, Cambridge, MA, 02138, USA.
| | - Minh Nguyet Nguyen
- Solomon H. Snyder Department of Neuroscience, Johns Hopkins University, Baltimore, MD, 21205, USA
| | - Armin Bahl
- Centre for the Advanced Study of Collective Behaviour, University of Konstanz, Konstanz, 78464, Germany
| | - Florian Engert
- Department of Molecular and Cellular Biology, Harvard University, Cambridge, 02138, USA
- Center for Brain Science, Harvard University, Cambridge, MA, 02138, USA
| |
Collapse
|
30
|
Harpaz R, Aspiras AC, Chambule S, Tseng S, Bind MA, Engert F, Fishman MC, Bahl A. Collective behavior emerges from genetically controlled simple behavioral motifs in zebrafish. SCIENCE ADVANCES 2021; 7:eabi7460. [PMID: 34613782 PMCID: PMC8494438 DOI: 10.1126/sciadv.abi7460] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/29/2021] [Accepted: 08/13/2021] [Indexed: 06/13/2023]
Abstract
It is not understood how changes in the genetic makeup of individuals alter the behavior of groups of animals. Here, we find that, even at early larval stages, zebrafish regulate their proximity and alignment with each other. Two simple visual responses, one that measures relative visual field occupancy and one that accounts for global visual motion, suffice to account for the group behavior that emerges. Mutations in genes known to affect social behavior in humans perturb these simple reflexes in individual larval zebrafish and change their emergent collective behaviors in the predicted fashion. Model simulations show that changes in these two responses in individual mutant animals predict well the distinctive collective patterns that emerge in a group. Hence, group behaviors reflect in part genetically defined primitive sensorimotor “motifs,” which are evident even in young larvae.
Collapse
Affiliation(s)
- Roy Harpaz
- Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA 02138, USA
- Center for Brain Science, Harvard University, Cambridge, MA 02138, USA
| | - Ariel C. Aspiras
- Harvard Department of Stem Cell and Regenerative Biology, Harvard University, Cambridge, MA 02138, USA
| | - Sydney Chambule
- Harvard Department of Stem Cell and Regenerative Biology, Harvard University, Cambridge, MA 02138, USA
| | - Sierra Tseng
- Harvard Department of Stem Cell and Regenerative Biology, Harvard University, Cambridge, MA 02138, USA
| | - Marie-Abèle Bind
- Biostatistics Center, Massachusetts General Hospital, Boston, MA 02114, USA
| | - Florian Engert
- Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA 02138, USA
- Center for Brain Science, Harvard University, Cambridge, MA 02138, USA
| | - Mark C. Fishman
- Harvard Department of Stem Cell and Regenerative Biology, Harvard University, Cambridge, MA 02138, USA
| | - Armin Bahl
- Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA 02138, USA
- Center for Brain Science, Harvard University, Cambridge, MA 02138, USA
- Centre for the Advanced Study of Collective Behaviour, University of Konstanz, Konstanz 78464, Germany
| |
Collapse
|
31
|
Katunin P, Zhou J, Shehata OM, Peden AA, Cadby A, Nikolaev A. An Open-Source Framework for Automated High-Throughput Cell Biology Experiments. Front Cell Dev Biol 2021; 9:697584. [PMID: 34631697 PMCID: PMC8498207 DOI: 10.3389/fcell.2021.697584] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2021] [Accepted: 08/19/2021] [Indexed: 12/12/2022] Open
Abstract
Modern data analysis methods, such as optimization algorithms or deep learning have been successfully applied to a number of biotechnological and medical questions. For these methods to be efficient, a large number of high-quality and reproducible experiments needs to be conducted, requiring a high degree of automation. Here, we present an open-source hardware and low-cost framework that allows for automatic high-throughput generation of large amounts of cell biology data. Our design consists of an epifluorescent microscope with automated XY stage for moving a multiwell plate containing cells and a perfusion manifold allowing programmed application of up to eight different solutions. Our system is very flexible and can be adapted easily for individual experimental needs. To demonstrate the utility of the system, we have used it to perform high-throughput Ca2+ imaging and large-scale fluorescent labeling experiments.
Collapse
Affiliation(s)
- Pavel Katunin
- Fresco Labs, London, United Kingdom
- Information Technologies and Programming Faculty, ITMO University, St. Petersburg, Russia
| | - Jianbo Zhou
- Department of Biomedical Sciences, University of Sheffield, Sheffield, United Kingdom
| | - Ola M Shehata
- Department of Biomedical Sciences, University of Sheffield, Sheffield, United Kingdom
| | - Andrew A Peden
- Department of Biomedical Sciences, University of Sheffield, Sheffield, United Kingdom
| | - Ashley Cadby
- Department of Physics and Astronomy, University of Sheffield, Sheffield, United Kingdom
| | - Anton Nikolaev
- Department of Biomedical Sciences, University of Sheffield, Sheffield, United Kingdom
| |
Collapse
|
32
|
Unraveling hidden interactions in complex systems with deep learning. Sci Rep 2021; 11:12804. [PMID: 34140551 PMCID: PMC8211832 DOI: 10.1038/s41598-021-91878-w] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2021] [Accepted: 05/26/2021] [Indexed: 11/08/2022] Open
Abstract
Rich phenomena from complex systems have long intrigued researchers, and yet modeling system micro-dynamics and inferring the forms of interaction remain challenging for conventional data-driven approaches, being generally established by scientists with human ingenuity. In this study, we propose AgentNet, a model-free data-driven framework consisting of deep neural networks to reveal and analyze the hidden interactions in complex systems from observed data alone. AgentNet utilizes a graph attention network with novel variable-wise attention to model the interaction between individual agents, and employs various encoders and decoders that can be selectively applied to any desired system. Our model successfully captured a wide variety of simulated complex systems, namely cellular automata (discrete), the Vicsek model (continuous), and active Ornstein-Uhlenbeck particles (non-Markovian) in which, notably, AgentNet's visualized attention values coincided with the true variable-wise interaction strengths and exhibited collective behavior that was absent in the training data. A demonstration with empirical data from a flock of birds showed that AgentNet could identify hidden interaction ranges exhibited by real birds, which cannot be detected by conventional velocity correlation analysis. We expect our framework to open a novel path to investigating complex systems and to provide insight into general process-driven modeling.
Collapse
|
33
|
Mann RP. Optimal use of simplified social information in sequential decision-making. J R Soc Interface 2021; 18:20210082. [PMID: 34062101 DOI: 10.1098/rsif.2021.0082] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Social animals can improve their decisions by attending to those made by others. The benefit of this social information must be balanced against the costs of obtaining and processing it. Previous work has focused on rational agents that respond optimally to a sequence of prior decisions. However, full decision sequences are potentially costly to perceive and process. As such, animals may rely on simpler social information, which will affect the social behaviour they exhibit. Here, I derive the optimal policy for agents responding to simplified forms of social information. I show how the behaviour of agents attending to the aggregate number of previous choices differs from those attending to just the most recent prior decision, and I propose a hybrid strategy that provides a highly accurate approximation to the optimal policy with the full sequence. Finally, I analyse the evolutionary stability of each strategy, showing that the hybrid strategy dominates when cognitive costs are low but non-zero, while attending to the most recent decision is dominant when costs are high. These results show that agents can employ highly effective social decision-making rules without requiring unrealistic cognitive capacities, and indicate likely ecological variation in the social information different animals attend to.
Collapse
Affiliation(s)
- Richard P Mann
- Department of Statistics, School of Mathematics, University of Leeds, Leeds, UK
| |
Collapse
|
34
|
Welch M, Schaerf TM, Murphy A. Collective states and their transitions in football. PLoS One 2021; 16:e0251970. [PMID: 34029340 PMCID: PMC8143424 DOI: 10.1371/journal.pone.0251970] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2020] [Accepted: 04/10/2021] [Indexed: 11/24/2022] Open
Abstract
Movement, positioning and coordination of player formations is a key aspect for the performance of teams within field-based sports. The increased availability of player tracking data has given rise to numerous studies that focus on the relationship between simple descriptive statistics surrounding team formation and performance. While these existing approaches have provided a high-level a view of team-based spatial formations, there is limited research on the nature of collective movement across players within teams and the establishment of stable collective states within game play. This study draws inspiration from the analysis of collective movement in nature, such as that observed within schools of fish and flocking birds, to explore the existence of collective states within the phases of play in soccer. Order parameters and metrics describing group motion and shape are derived from player movement tracks to uncover the nature of the team's collective states and transitions. This represents a unique addition to the current body of work around the analysis of player movement in team sports. The results from this study demonstrate that sequences of ordered collective behaviours exist with relatively rapid transitions between highly aligned polar and un-ordered swarm behaviours (and vice-versa). Defensive phases of play have a higher proportion of ordered team movement than attacking phases, indicating that movements linked with attacking tactics, such as player dispersion to generate passing and shooting opportunities leads to lower overall collective order. Exploration within this study suggests that defensive tactics, such as reducing the depth or width to close passing opportunities, allows for higher team movement speeds and increased levels of collective order. This study provides a novel view of player movement by visualising the collective states present across the phases of play in football.
Collapse
Affiliation(s)
- Mitchell Welch
- School of Science and Technology, University of New England, Armidale, New South Wales, Australia
| | - Timothy M. Schaerf
- School of Science and Technology, University of New England, Armidale, New South Wales, Australia
| | - Aron Murphy
- School of Science and Technology, University of New England, Armidale, New South Wales, Australia
- Faculty of Medicine, Nursing and Midwifery & Health, University of Notre Dame Australia, Sydney, New South Wales, Australia
| |
Collapse
|
35
|
Parallel Fish School Tracking Based on Multiple Appearance Feature Detection. SENSORS 2021; 21:s21103476. [PMID: 34067562 PMCID: PMC8156864 DOI: 10.3390/s21103476] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/31/2021] [Revised: 05/10/2021] [Accepted: 05/13/2021] [Indexed: 11/18/2022]
Abstract
A parallel fish school tracking based on multiple-feature fish detection has been proposed in this paper to obtain accurate movement trajectories of a large number of zebrafish. Zebrafish are widely adapted in many fields as an excellent model organism. Due to the non-rigid body, similar appearance, rapid transition, and frequent occlusions, vision-based behavioral monitoring is still a challenge. A multiple appearance feature based fish detection scheme was developed by examining the fish head and center of the fish body based on shape index features. The proposed fish detection has the advantage of locating individual fishes from occlusions and estimating their motion states, which could ensure the stability of tracking multiple fishes. Moreover, a parallel tracking scheme was developed based on the SORT framework by fusing multiple features of individual fish and motion states. The proposed method was evaluated in seven video clips taken under different conditions. These videos contained various scales of fishes, different arena sizes, different frame rates, and various image resolutions. The maximal number of tracking targets reached 100 individuals. The correct tracking ratio was 98.60% to 99.86%, and the correct identification ratio ranged from 97.73% to 100%. The experimental results demonstrate that the proposed method is superior to advanced deep learning-based methods. Nevertheless, this method has real-time tracking ability, which can acquire online trajectory data without high-cost hardware configuration.
Collapse
|
36
|
|
37
|
Schaerf TM, Herbert-Read JE, Ward AJW. A statistical method for identifying different rules of interaction between individuals in moving animal groups. J R Soc Interface 2021; 18:20200925. [PMID: 33784885 DOI: 10.1098/rsif.2020.0925] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022] Open
Abstract
The emergent patterns of collective motion are thought to arise from application of individual-level rules that govern how individuals adjust their velocity as a function of the relative position and behaviours of their neighbours. Empirical studies have sought to determine such rules of interaction applied by 'average' individuals by aggregating data from multiple individuals across multiple trajectory sets. In reality, some individuals within a group may interact differently from others, and such individual differences can have an effect on overall group movement. However, comparisons of rules of interaction used by individuals in different contexts have been largely qualitative. Here we introduce a set of randomization methods designed to determine statistical differences in the rules of interaction between individuals. We apply these methods to a case study of leaders and followers in pairs of freely exploring eastern mosquitofish (Gambusia holbrooki). We find that each of the randomization methods is reliable in terms of: repeatability of p-values, consistency in identification of significant differences and similarity between distributions of randomization-based test statistics. We observe convergence of the distributions of randomization-based test statistics across repeat calculations, and resolution of any ambiguities regarding significant differences as the number of randomization iterations increases.
Collapse
Affiliation(s)
- T M Schaerf
- School of Science and Technology, University of New England, Armidale, New South Wales 2351, Australia
| | - J E Herbert-Read
- Department of Zoology, University of Cambridge, Cambridge CB2 3EJ, UK.,Aquatic Ecology, University of Lund, Lund 223 62, Sweden
| | - A J W Ward
- Animal Behaviour Lab, School of Life and Environmental Sciences, University of Sydney, Sydney, New South Wales 2006, Australia
| |
Collapse
|
38
|
Mudaliar RK, Schaerf TM. Examination of an averaging method for estimating repulsion and attraction interactions in moving groups. PLoS One 2020; 15:e0243631. [PMID: 33296438 PMCID: PMC7725364 DOI: 10.1371/journal.pone.0243631] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2020] [Accepted: 11/24/2020] [Indexed: 02/07/2023] Open
Abstract
Groups of animals coordinate remarkable, coherent, movement patterns during periods of collective motion. Such movement patterns include the toroidal mills seen in fish shoals, highly aligned parallel motion like that of flocks of migrating birds, and the swarming of insects. Since the 1970's a wide range of collective motion models have been studied that prescribe rules of interaction between individuals, and that are capable of generating emergent patterns that are visually similar to those seen in real animal group. This does not necessarily mean that real animals apply exactly the same interactions as those prescribed in models. In more recent work, researchers have sought to infer the rules of interaction of real animals directly from tracking data, by using a number of techniques, including averaging methods. In one of the simplest formulations, the averaging methods determine the mean changes in the components of the velocity of an individual over time as a function of the relative coordinates of group mates. The averaging methods can also be used to estimate other closely related quantities including the mean relative direction of motion of group mates as a function of their relative coordinates. Since these methods for extracting interaction rules and related quantities from trajectory data are relatively new, the accuracy of these methods has had limited inspection. In this paper, we examine the ability of an averaging method to reveal prescribed rules of interaction from data generated by two individual based models for collective motion. Our work suggests that an averaging method can capture the qualitative features of underlying interactions from trajectory data alone, including repulsion and attraction effects evident in changes in speed and direction of motion, and the presence of a blind zone. However, our work also illustrates that the output from a simple averaging method can be affected by emergent group level patterns of movement, and the sizes of the regions over which repulsion and attraction effects are apparent can be distorted depending on how individuals combine interactions with multiple group mates.
Collapse
Affiliation(s)
- Rajnesh K. Mudaliar
- School of Science and Technology, University of New England, Armidale, NSW, Australia
- School of Mathematical and Computing Science, Fiji National University, Suva, Fiji
| | - Timothy M. Schaerf
- School of Science and Technology, University of New England, Armidale, NSW, Australia
| |
Collapse
|
39
|
Maekawa T, Ohara K, Zhang Y, Fukutomi M, Matsumoto S, Matsumura K, Shidara H, Yamazaki SJ, Fujisawa R, Ide K, Nagaya N, Yamazaki K, Koike S, Miyatake T, Kimura KD, Ogawa H, Takahashi S, Yoda K. Deep learning-assisted comparative analysis of animal trajectories with DeepHL. Nat Commun 2020; 11:5316. [PMID: 33082335 PMCID: PMC7576204 DOI: 10.1038/s41467-020-19105-0] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2019] [Accepted: 09/25/2020] [Indexed: 11/09/2022] Open
Abstract
A comparative analysis of animal behavior (e.g., male vs. female groups) has been widely used to elucidate behavior specific to one group since pre-Darwinian times. However, big data generated by new sensing technologies, e.g., GPS, makes it difficult for them to contrast group differences manually. This study introduces DeepHL, a deep learning-assisted platform for the comparative analysis of animal movement data, i.e., trajectories. This software uses a deep neural network based on an attention mechanism to automatically detect segments in trajectories that are characteristic of one group. It then highlights these segments in visualized trajectories, enabling biologists to focus on these segments, and helps them reveal the underlying meaning of the highlighted segments to facilitate formulating new hypotheses. We tested the platform on a variety of trajectories of worms, insects, mice, bears, and seabirds across a scale from millimeters to hundreds of kilometers, revealing new movement features of these animals.
Collapse
Affiliation(s)
- Takuya Maekawa
- Graduate School of Information Science and Technology, Osaka University, Osaka, Japan.
| | - Kazuya Ohara
- Graduate School of Information Science and Technology, Osaka University, Osaka, Japan
| | - Yizhe Zhang
- Graduate School of Information Science and Technology, Osaka University, Osaka, Japan
| | | | - Sakiko Matsumoto
- Graduate School of Environmental Studies, Nagoya University, Nagoya, Japan
| | - Kentarou Matsumura
- Graduate School of Environmental and Life Science, Okayama University, Okayama, Japan
| | - Hisashi Shidara
- Department of Biological Sciences, Hokkaido University, Hokkaido, Japan
| | | | - Ryusuke Fujisawa
- Graduate School of Computer Science and Systems Engineering, Kyushu Institute of Technology, Iizuka, Japan
| | - Kaoru Ide
- Graduate School of Brain Science, Doshisha University, Kyotanabe, Japan
| | - Naohisa Nagaya
- Department of Intelligent Systems, Kyoto Sangyo University, Kyoto, Japan
| | - Koji Yamazaki
- Department of Forest Science, Tokyo University of Agriculture, Tokyo, Japan
| | - Shinsuke Koike
- Graduate School of Agriculture, Tokyo University of Agriculture and Technology, Tokyo, Japan
| | - Takahisa Miyatake
- Graduate School of Environmental and Life Science, Okayama University, Okayama, Japan
| | - Koutarou D Kimura
- Graduate School of Science, Osaka University, Osaka, Japan
- Graduate School of Science, Nagoya City University, Nagoya, Japan
| | - Hiroto Ogawa
- Department of Biological Sciences, Hokkaido University, Hokkaido, Japan
| | - Susumu Takahashi
- Graduate School of Brain Science, Doshisha University, Kyotanabe, Japan
| | - Ken Yoda
- Graduate School of Environmental Studies, Nagoya University, Nagoya, Japan
| |
Collapse
|
40
|
Pilkiewicz KR, Lemasson BH, Rowland MA, Hein A, Sun J, Berdahl A, Mayo ML, Moehlis J, Porfiri M, Fernández-Juricic E, Garnier S, Bollt EM, Carlson JM, Tarampi MR, Macuga KL, Rossi L, Shen CC. Decoding collective communications using information theory tools. J R Soc Interface 2020; 17:20190563. [PMID: 32183638 PMCID: PMC7115225 DOI: 10.1098/rsif.2019.0563] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2019] [Accepted: 02/28/2020] [Indexed: 02/03/2023] Open
Abstract
Organisms have evolved sensory mechanisms to extract pertinent information from their environment, enabling them to assess their situation and act accordingly. For social organisms travelling in groups, like the fish in a school or the birds in a flock, sharing information can further improve their situational awareness and reaction times. Data on the benefits and costs of social coordination, however, have largely allowed our understanding of why collective behaviours have evolved to outpace our mechanistic knowledge of how they arise. Recent studies have begun to correct this imbalance through fine-scale analyses of group movement data. One approach that has received renewed attention is the use of information theoretic (IT) tools like mutual information, transfer entropy and causation entropy, which can help identify causal interactions in the type of complex, dynamical patterns often on display when organisms act collectively. Yet, there is a communications gap between studies focused on the ecological constraints and solutions of collective action with those demonstrating the promise of IT tools in this arena. We attempt to bridge this divide through a series of ecologically motivated examples designed to illustrate the benefits and challenges of using IT tools to extract deeper insights into the interaction patterns governing group-level dynamics. We summarize some of the approaches taken thus far to circumvent existing challenges in this area and we conclude with an optimistic, yet cautionary perspective.
Collapse
Affiliation(s)
- K. R. Pilkiewicz
- Environmental Laboratory, U.S. Army Engineer Research and Development Center (EL-ERDC), Vicksburg, MS, USA
| | | | - M. A. Rowland
- Environmental Laboratory, U.S. Army Engineer Research and Development Center (EL-ERDC), Vicksburg, MS, USA
| | - A. Hein
- National Oceanic and Atmospheric Administration, Santa Cruz, CA, USA
- University of California, Santa Cruz, CA, USA
| | - J. Sun
- Department of Mathematics, Clarkson University, Potsdam, NY, USA
| | - A. Berdahl
- School of Aquatic and Fishery Sciences, University of Washington, Seattle, WA, USA
| | - M. L. Mayo
- Environmental Laboratory, U.S. Army Engineer Research and Development Center (EL-ERDC), Vicksburg, MS, USA
| | - J. Moehlis
- Department of Mechanical Engineering, University of California, Santa Barbara, CA, USA
| | - M. Porfiri
- Department of Mechanical and Aerospace Engineering and Department of Biomedical Engineering, New York University Tandon School of Engineering, Brooklyn, NY, USA
| | | | - S. Garnier
- Department of Biological Sciences, New Jersey Institute of Technology, Newark, NJ, USA
| | - E. M. Bollt
- Department of Mathematics, Clarkson University, Potsdam, NY, USA
| | - J. M. Carlson
- Department of Physics, University of California, Santa Barbara, CA, USA
| | - M. R. Tarampi
- Department of Psychology, University of Hartford, West Hartford, CT, USA
| | - K. L. Macuga
- School of Psychological Science, Oregon State University, Corvallis, OR, USA
| | - L. Rossi
- Department of Mathematical Sciences, University of Delaware, Newark, DE, USA
| | - C.-C. Shen
- Department of Computer and Information Sciences, University of Delaware, Newark, DE, USA
| |
Collapse
|
41
|
Tang W, Davidson JD, Zhang G, Conen KE, Fang J, Serluca F, Li J, Xiong X, Coble M, Tsai T, Molind G, Fawcett CH, Sanchez E, Zhu P, Couzin ID, Fishman MC. Genetic Control of Collective Behavior in Zebrafish. iScience 2020; 23:100942. [PMID: 32179471 PMCID: PMC7068127 DOI: 10.1016/j.isci.2020.100942] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2019] [Revised: 01/17/2020] [Accepted: 02/21/2020] [Indexed: 01/02/2023] Open
Abstract
Many animals, including humans, have evolved to live and move in groups. In humans, disrupted social interactions are a fundamental feature of many psychiatric disorders. However, we know little about how genes regulate social behavior. Zebrafish may serve as a powerful model to explore this question. By comparing the behavior of wild-type fish with 90 mutant lines, we show that mutations of genes associated with human psychiatric disorders can alter the collective behavior of adult zebrafish. We identify three categories of behavioral variation across mutants: "scattered," in which fish show reduced cohesion; "coordinated," in which fish swim more in aligned schools; and "huddled," in which fish form dense but disordered groups. Changes in individual interaction rules can explain these differences. This work demonstrates how emergent patterns in animal groups can be altered by genetic changes in individuals and establishes a framework for understanding the fundamentals of social information processing.
Collapse
Affiliation(s)
- Wenlong Tang
- Novartis Institutes for BioMedical Research, 181 Massachusetts Avenue, Cambridge, MA 02139, USA
| | - Jacob D Davidson
- Department of Collective Behavior, Max Planck Institute of Animal Behavior, Universitätstraße 10, 78764 Konstanz, Germany; Centre for the Advanced Study of Collective Behavior, University of Konstanz, Universitätstraße 10, 78764 Konstanz, Germany; Department of Biology, University of Konstanz, Universitätstraße 10, 78764 Konstanz, Germany
| | - Guoqiang Zhang
- Novartis Institutes for BioMedical Research, 181 Massachusetts Avenue, Cambridge, MA 02139, USA
| | - Katherine E Conen
- Department of Collective Behavior, Max Planck Institute of Animal Behavior, Universitätstraße 10, 78764 Konstanz, Germany; Centre for the Advanced Study of Collective Behavior, University of Konstanz, Universitätstraße 10, 78764 Konstanz, Germany; Department of Biology, University of Konstanz, Universitätstraße 10, 78764 Konstanz, Germany
| | - Jian Fang
- Novartis Institutes for BioMedical Research, 181 Massachusetts Avenue, Cambridge, MA 02139, USA
| | - Fabrizio Serluca
- Novartis Institutes for BioMedical Research, 181 Massachusetts Avenue, Cambridge, MA 02139, USA
| | - Jingyao Li
- Novartis Institutes for BioMedical Research, 181 Massachusetts Avenue, Cambridge, MA 02139, USA
| | - Xiaorui Xiong
- Novartis Institutes for BioMedical Research, 181 Massachusetts Avenue, Cambridge, MA 02139, USA
| | - Matthew Coble
- Novartis Institutes for BioMedical Research, 181 Massachusetts Avenue, Cambridge, MA 02139, USA
| | - Tingwei Tsai
- Novartis Institutes for BioMedical Research, 181 Massachusetts Avenue, Cambridge, MA 02139, USA
| | - Gregory Molind
- Novartis Institutes for BioMedical Research, 181 Massachusetts Avenue, Cambridge, MA 02139, USA
| | - Caroline H Fawcett
- Novartis Institutes for BioMedical Research, 181 Massachusetts Avenue, Cambridge, MA 02139, USA
| | - Ellen Sanchez
- Novartis Institutes for BioMedical Research, 181 Massachusetts Avenue, Cambridge, MA 02139, USA
| | - Peixin Zhu
- Novartis Institutes for BioMedical Research, 181 Massachusetts Avenue, Cambridge, MA 02139, USA
| | - Iain D Couzin
- Department of Collective Behavior, Max Planck Institute of Animal Behavior, Universitätstraße 10, 78764 Konstanz, Germany; Centre for the Advanced Study of Collective Behavior, University of Konstanz, Universitätstraße 10, 78764 Konstanz, Germany; Department of Biology, University of Konstanz, Universitätstraße 10, 78764 Konstanz, Germany.
| | - Mark C Fishman
- Department of Stem Cell and Regenerative Biology, Harvard University, 7 Divinity Avenue, Cambridge, MA 02138, USA.
| |
Collapse
|
42
|
Silva-Rodrigues JF, Patrício-Rodrigues CF, de Sousa-Xavier V, Augusto PM, Fernandes AC, Farinho AR, Martins JP, Teodoro RO. Peripheral axonal ensheathment is regulated by RalA GTPase and the exocyst complex. Development 2020; 147:dev.174540. [PMID: 31969325 DOI: 10.1242/dev.174540] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2018] [Accepted: 01/14/2020] [Indexed: 12/21/2022]
Abstract
Axon ensheathment is fundamental for fast impulse conduction and the normal physiological functioning of the nervous system. Defects in axonal insulation lead to debilitating conditions, but, despite its importance, the molecular players responsible are poorly defined. Here, we identify RalA GTPase as a key player in axon ensheathment in Drosophila larval peripheral nerves. We demonstrate through genetic analysis that RalA action through the exocyst complex is required in wrapping glial cells to regulate their growth and development. We suggest that the RalA-exocyst pathway controls the targeting of secretory vesicles for membrane growth or for the secretion of a wrapping glia-derived factor that itself regulates growth. In summary, our findings provide a new molecular understanding of the process by which axons are ensheathed in vivo, a process that is crucial for normal neuronal function.
Collapse
Affiliation(s)
- Joana F Silva-Rodrigues
- CEDOC, Chronic Diseases Research Centre, NOVA Medical School - Faculdade de Ciências Médicas, Universidade Nova de Lisboa, 1150-082 Lisboa, Portugal
| | - Cátia F Patrício-Rodrigues
- CEDOC, Chronic Diseases Research Centre, NOVA Medical School - Faculdade de Ciências Médicas, Universidade Nova de Lisboa, 1150-082 Lisboa, Portugal
| | - Vicente de Sousa-Xavier
- CEDOC, Chronic Diseases Research Centre, NOVA Medical School - Faculdade de Ciências Médicas, Universidade Nova de Lisboa, 1150-082 Lisboa, Portugal
| | - Pedro M Augusto
- CEDOC, Chronic Diseases Research Centre, NOVA Medical School - Faculdade de Ciências Médicas, Universidade Nova de Lisboa, 1150-082 Lisboa, Portugal
| | - Ana C Fernandes
- CEDOC, Chronic Diseases Research Centre, NOVA Medical School - Faculdade de Ciências Médicas, Universidade Nova de Lisboa, 1150-082 Lisboa, Portugal
| | - Ana R Farinho
- CEDOC, Chronic Diseases Research Centre, NOVA Medical School - Faculdade de Ciências Médicas, Universidade Nova de Lisboa, 1150-082 Lisboa, Portugal
| | - João P Martins
- CEDOC, Chronic Diseases Research Centre, NOVA Medical School - Faculdade de Ciências Médicas, Universidade Nova de Lisboa, 1150-082 Lisboa, Portugal.,Instituto de Medicina Molecular, Faculdade de Medicina da Universidade de Lisboa, Avenida Professor Egas Moniz, 1649-028 Lisboa, Portugal
| | - Rita O Teodoro
- CEDOC, Chronic Diseases Research Centre, NOVA Medical School - Faculdade de Ciências Médicas, Universidade Nova de Lisboa, 1150-082 Lisboa, Portugal
| |
Collapse
|
43
|
|