Quantifying the movement, behaviour and environmental context of group-living animals using drones and computer vision

Understanding collective behavior through neurobiology

A variety of organisms exhibit collective movement, including schooling fish and flocking birds, where coordinated behavior emerges from the interactions between group members. Despite the prevalence of collective movement in nature, little is known about the neural mechanisms producing each individual's behavior within the group. Here we discuss how a neurobiological approach can enrich our understanding of collective behavior by determining the mechanisms by which individuals interact. We provide examples of sensory systems for social communication during collective movement, highlight recent discoveries about neural systems for detecting the position and actions of social partners, and discuss opportunities for future research. Understanding the neurobiology of collective behavior can provide insight into how nervous systems function in a dynamic social world.

Modelling animal social networks: New solutions and future directions

Research Highlight: Ross, C. T., McElreath, R., & Redhead, D. (2023). Modelling animal network data in R using STRAND. Journal of Animal Ecology. https://doi.org/10.1111/1365-2656.14021. One of the most important insights in ecology over the past decade has been that the social connections among animals affect a wide range of ecological and evolutionary processes. However, despite over 20 years of study effort on this topic, generating knowledge from data on social associations and interactions remains fraught with problems. Redhead et al. present an R package-STRAND-that extends the current animal social network analysis toolbox in two ways. First, they provide a simple R interfaces to implement generative network models, which are an alternative to regression approaches that draw inference by simulating the data-generating process. Second, they implement these models in a Bayesian framework, allowing uncertainty in the observation process to be carried through to hypothesis testing. STRAND therefore fills an important gap for hypothesis testing using network data. However, major challenges remain, and while STRAND represents an important advance, generating robust results continues to require careful study design, considerations in terms of statistical methods and a plurality of approaches.

Fantastic beasts and how to study them: rethinking experimental animal behavior

Humans have been trying to understand animal behavior at least since recorded history. Recent rapid development of new technologies has allowed us to make significant progress in understanding the physiological and molecular mechanisms underlying behavior, a key goal of neuroethology. However, there is a tradeoff when studying animal behavior and its underlying biological mechanisms: common behavior protocols in the laboratory are designed to be replicable and controlled, but they often fail to encompass the variability and breadth of natural behavior. This Commentary proposes a framework of 10 key questions that aim to guide researchers in incorporating a rich natural context into their experimental design or in choosing a new animal study system. The 10 questions cover overarching experimental considerations that can provide a template for interspecies comparisons, enable us to develop studies in new model organisms and unlock new experiments in our quest to understand behavior.

Advances in biologging can identify nuanced energetic costs and gains in predators

Foraging is a key driver of animal movement patterns, with specific challenges for predators which must search for mobile prey. These patterns are increasingly impacted by global changes, principally in land use and climate. Understanding the degree of flexibility in predator foraging and social strategies is pertinent to wildlife conservation under global change, including potential top-down effects on wider ecosystems. Here we propose key future research directions to better understand foraging strategies and social flexibility in predators. In particular, rapid continued advances in biologging technology are helping to record and understand dynamic behavioural and movement responses of animals to environmental changes, and their energetic consequences. Data collection can be optimised by calibrating behavioural interpretation methods in captive settings and strategic tagging decisions within and between social groups. Importantly, many species' social systems are increasingly being found to be more flexible than originally described in the literature, which may be more readily detectable through biologging approaches than behavioural observation. Integrating the effects of the physical landscape and biotic interactions will be key to explaining and predicting animal movements and energetic balance in a changing world.

replicAnt: a pipeline for generating annotated images of animals in complex environments using Unreal Engine

Deep learning-based computer vision methods are transforming animal behavioural research. Transfer learning has enabled work in non-model species, but still requires hand-annotation of example footage, and is only performant in well-defined conditions. To help overcome these limitations, we developed replicAnt, a configurable pipeline implemented in Unreal Engine 5 and Python, designed to generate large and variable training datasets on consumer-grade hardware. replicAnt places 3D animal models into complex, procedurally generated environments, from which automatically annotated images can be exported. We demonstrate that synthetic data generated with replicAnt can significantly reduce the hand-annotation required to achieve benchmark performance in common applications such as animal detection, tracking, pose-estimation, and semantic segmentation. We also show that it increases the subject-specificity and domain-invariance of the trained networks, thereby conferring robustness. In some applications, replicAnt may even remove the need for hand-annotation altogether. It thus represents a significant step towards porting deep learning-based computer vision tools to the field.

Elephants and algorithms: a review of the current and future role of AI in elephant monitoring

Artificial intelligence (AI) and machine learning (ML) present revolutionary opportunities to enhance our understanding of animal behaviour and conservation strategies. Using elephants, a crucial species in Africa and Asia's protected areas, as our focal point, we delve into the role of AI and ML in their conservation. Given the increasing amounts of data gathered from a variety of sensors like cameras, microphones, geophones, drones and satellites, the challenge lies in managing and interpreting this vast data. New AI and ML techniques offer solutions to streamline this process, helping us extract vital information that might otherwise be overlooked. This paper focuses on the different AI-driven monitoring methods and their potential for improving elephant conservation. Collaborative efforts between AI experts and ecological researchers are essential in leveraging these innovative technologies for enhanced wildlife conservation, setting a precedent for numerous other species.

The role of hydrodynamics in collective motions of fish schools and bioinspired underwater robots

Collective behaviour defines the lives of many animal species on the Earth. Underwater swarms span several orders of magnitude in size, from coral larvae and krill to tunas and dolphins. Agent-based algorithms have modelled collective movements of animal groups by use of social forces, which approximate the behaviour of individual animals. But details of how swarming individuals interact with the fluid environment are often under-examined. How do fluid forces shape aquatic swarms? How do fish use their flow-sensing capabilities to coordinate with their schooling mates? We propose viewing underwater collective behaviour from the framework of fluid stigmergy, which considers both physical interactions and information transfer in fluid environments. Understanding the role of hydrodynamics in aquatic collectives requires multi-disciplinary efforts across fluid mechanics, biology and biomimetic robotics. To facilitate future collaborations, we synthesize key studies in these fields.

Mechanisms of group-hunting in vertebrates

Group-hunting is ubiquitous across animal taxa and has received considerable attention in the context of its functions. By contrast much less is known about the mechanisms by which grouping predators hunt their prey. This is primarily due to a lack of experimental manipulation alongside logistical difficulties quantifying the behaviour of multiple predators at high spatiotemporal resolution as they search, select, and capture wild prey. However, the use of new remote-sensing technologies and a broadening of the focal taxa beyond apex predators provides researchers with a great opportunity to discern accurately how multiple predators hunt together and not just whether doing so provides hunters with a per capita benefit. We incorporate many ideas from collective behaviour and locomotion throughout this review to make testable predictions for future researchers and pay particular attention to the role that computer simulation can play in a feedback loop with empirical data collection. Our review of the literature showed that the breadth of predator:prey size ratios among the taxa that can be considered to hunt as a group is very large (<100 to >102 ). We therefore synthesised the literature with respect to these predator:prey ratios and found that they promoted different hunting mechanisms. Additionally, these different hunting mechanisms are also related to particular stages of the hunt (search, selection, capture) and thus we structure our review in accordance with these two factors (stage of the hunt and predator:prey size ratio). We identify several novel group-hunting mechanisms which are largely untested, particularly under field conditions, and we also highlight a range of potential study organisms that are amenable to experimental testing of these mechanisms in connection with tracking technology. We believe that a combination of new hypotheses, study systems and methodological approaches should help push the field of group-hunting in new directions.

Fine-scale collective movements reveal present, past and future dynamics of a multilevel society in Przewalski's horses

Studying animal societies needs detailed observation of many individuals, but technological advances offer new opportunities in this field. Here, we present a state-of-the-art drone observation of a multilevel herd of Przewalski's horses, consisting of harems (one-male, multifemale groups). We track, in high spatio-temporal resolution, the movements of 238 individually identified horses on drone videos, and combine movement analyses with demographic data from two decades of population monitoring. Analysis of collective movements reveals how the structure of the herd's social network is related to kinship and familiarity of individuals. The network centrality of harems is related to their age and how long the harem stallions have kept harems previously. Harems of genetically related stallions are closer to each other in the network, and female exchange is more frequent between closer harems. High movement similarity of females from different harems predicts becoming harem mates in the future. Our results show that only a few minutes of fine-scale movement tracking combined with high throughput data driven analysis can reveal the structure of a society, reconstruct past group dynamics and predict future ones.

Multi-Object Tracking in Heterogeneous environments (MOTHe) for animal video recordings

Aerial imagery and video recordings of animals are used for many areas of research such as animal behaviour, behavioural neuroscience and field biology. Many automated methods are being developed to extract data from such high-resolution videos. Most of the available tools are developed for videos taken under idealised laboratory conditions. Therefore, the task of animal detection and tracking for videos taken in natural settings remains challenging due to heterogeneous environments. Methods that are useful for field conditions are often difficult to implement and thus remain inaccessible to empirical researchers. To address this gap, we present an open-source package called Multi-Object Tracking in Heterogeneous environments (MOTHe), a Python-based application that uses a basic convolutional neural network for object detection. MOTHe offers a graphical interface to automate the various steps related to animal tracking such as training data generation, animal detection in complex backgrounds and visually tracking animals in the videos. Users can also generate training data and train a new model which can be used for object detection tasks for a completely new dataset. MOTHe doesn't require any sophisticated infrastructure and can be run on basic desktop computing units. We demonstrate MOTHe on six video clips in varying background conditions. These videos are from two species in their natural habitat-wasp colonies on their nests (up to 12 individuals per colony) and antelope herds in four different habitats (up to 156 individuals in a herd). Using MOTHe, we are able to detect and track individuals in all these videos. MOTHe is available as an open-source GitHub repository with a detailed user guide and demonstrations at: https://github.com/tee-lab/MOTHe-GUI.

Camera Trap Methods and Drone Thermal Surveillance Provide Reliable, Comparable Density Estimates of Large, Free-Ranging Ungulates

Camera traps and drone surveys both leverage advancing technologies to study dynamic wildlife populations with little disturbance. Both techniques entail strengths and weaknesses, and common camera trap methods can be confounded by unrealistic assumptions and prerequisite conditions. We compared three methods to estimate the population density of white-tailed deer (Odocoileus virgnianus) in a section of Pilot Mountain State Park, NC, USA: (1) camera trapping using mark-resight ratios or (2) N-mixture modeling and (3) aerial thermal videography from a drone platform. All three methods yielded similar density estimates, suggesting that they converged on an accurate estimate. We also included environmental covariates in the N-mixture modeling to explore spatial habitat use, and we fit models for each season to understand temporal changes in population density. Deer occurred in greater densities on warmer, south-facing slopes in the autumn and winter and on cooler north-facing slopes and in areas with flatter terrain in the summer. Seasonal density estimates over two years suggested an annual cycle of higher densities in autumn and winter than in summer, indicating that the region may function as a refuge during the hunting season.

ViewShedR: a new open-source tool for cumulative, subtractive and elevated line-of-sight analysis

Many environmental and ecological studies require line of sight (LOS) and/or viewshed analyses. While tools for performing these analyses from digital elevation models (DEMs) are widespread, they are either too restrictive, inaccessible or pricey and difficult to use. This methodological gap is potentially imperative for scholars using solutions like telemetry tracking systems or spatial ecology landscape mapping. Here we present ViewShedR-a free, open-source and intuitive graphical user-interface application for performing LOS calculations, including cumulative, subtractive (areas covered by towers A + B or by A but not by B, respectively), and elevated-target analyses. ViewShedR is implemented in the widely used R environment, thus facilitating usage and further modification by end-users. We provide two working examples for ViewShedR in the context of permanent animal-tracking systems requiring simultaneous tag-detection by multiple towers (receivers): first, the ATLAS system for terrestrial animals in the Harod Valley, Israel; and second, an acoustic telemetry array for marine animals in the Dry Tortugas, Florida. ViewShedR allowed effective tower deployment and finding partially detected tagged animals in the ATLAS system. Similarly, it allowed us to identify reception shadows cast by islands in the marine array. We hope ViewShedR will facilitate deployment of tower arrays for tracking, communication networks and other ecological applications.