1
|
Tanigaki K, Otsuka R, Li A, Hatano Y, Wei Y, Koyama S, Yoda K, Maekawa T. Automatic recording of rare behaviors of wild animals using video bio-loggers with on-board light-weight outlier detector. PNAS NEXUS 2024; 3:pgad447. [PMID: 38229952 PMCID: PMC10791039 DOI: 10.1093/pnasnexus/pgad447] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Accepted: 12/04/2023] [Indexed: 01/18/2024]
Abstract
Rare behaviors displayed by wild animals can generate new hypotheses; however, observing such behaviors may be challenging. While recent technological advancements, such as bio-loggers, may assist in documenting rare behaviors, the limited running time of battery-powered bio-loggers is insufficient to record rare behaviors when employing high-cost sensors (e.g. video cameras). In this study, we propose an artificial intelligence (AI)-enabled bio-logger that automatically detects outlier readings from always-on low-cost sensors, e.g. accelerometers, indicative of rare behaviors in target animals, without supervision by researchers, subsequently activating high-cost sensors to record only these behaviors. We implemented an on-board outlier detector via knowledge distillation by building a lightweight outlier classifier supervised by a high-cost outlier behavior detector trained in an unsupervised manner. The efficacy of AI bio-loggers has been demonstrated on seabirds, where videos and sensor data captured by the bio-loggers have enabled the identification of some rare behaviors, facilitating analyses of their frequency, and potential factors underlying these behaviors. This approach offers a means of documenting previously overlooked rare behaviors, augmenting our understanding of animal behavior.
Collapse
Affiliation(s)
- Kei Tanigaki
- Graduate School of Information Science and Technology, Osaka University, Suita, 565-0871 Osaka, Japan
| | - Ryoma Otsuka
- Graduate School of Information Science and Technology, Osaka University, Suita, 565-0871 Osaka, Japan
| | - Aiyi Li
- Graduate School of Information Science and Technology, Osaka University, Suita, 565-0871 Osaka, Japan
| | - Yota Hatano
- Graduate School of Engineering Science, Osaka University, Toyonaka, 560-8531 Osaka, Japan
| | - Yuanzhou Wei
- Graduate School of Frontier Biosciences, Osaka University, Suita, 565-0871 Osaka, Japan
| | - Shiho Koyama
- Graduate School of Environmental Studies, Nagoya University, Nagoya, 464-8601 Aichi, Japan
| | - Ken Yoda
- Graduate School of Environmental Studies, Nagoya University, Nagoya, 464-8601 Aichi, Japan
| | - Takuya Maekawa
- Graduate School of Information Science and Technology, Osaka University, Suita, 565-0871 Osaka, Japan
| |
Collapse
|
2
|
Pérez-Jorge S, Oliveira C, Rivas EI, Prieto R, Cascão I, Wensveen PJ, Miller PJO, Silva MA. Predictive model of sperm whale prey capture attempts from time-depth data. MOVEMENT ECOLOGY 2023; 11:33. [PMID: 37291674 DOI: 10.1186/s40462-023-00393-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/06/2023] [Accepted: 05/11/2023] [Indexed: 06/10/2023]
Abstract
BACKGROUND High-resolution sound and movement recording tags offer unprecedented insights into the fine-scale foraging behaviour of cetaceans, especially echolocating odontocetes, enabling the estimation of a series of foraging metrics. However, these tags are expensive, making them inaccessible to most researchers. Time-Depth Recorders (TDRs), which have been widely used to study diving and foraging behaviour of marine mammals, offer a more affordable alternative. Unfortunately, data collected by TDRs are bi-dimensional (time and depth only), so quantifying foraging effort from those data is challenging. METHODS A predictive model of the foraging effort of sperm whales (Physeter macrocephalus) was developed to identify prey capture attempts (PCAs) from time-depth data. Data from high-resolution acoustic and movement recording tags deployed on 12 sperm whales were downsampled to 1 Hz to match the typical TDR sampling resolution and used to predict the number of buzzes (i.e., rapid series of echolocation clicks indicative of PCAs). Generalized linear mixed models were built for dive segments of different durations (30, 60, 180 and 300 s) using multiple dive metrics as potential predictors of PCAs. RESULTS Average depth, variance of depth and variance of vertical velocity were the best predictors of the number of buzzes. Sensitivity analysis showed that models with segments of 180 s had the best overall predictive performance, with a good area under the curve value (0.78 ± 0.05), high sensitivity (0.93 ± 0.06) and high specificity (0.64 ± 0.14). Models using 180 s segments had a small difference between observed and predicted number of buzzes per dive, with a median of 4 buzzes, representing a difference in predicted buzzes of 30%. CONCLUSIONS These results demonstrate that it is possible to obtain a fine-scale, accurate index of sperm whale PCAs from time-depth data alone. This work helps leveraging the potential of time-depth data for studying the foraging ecology of sperm whales and the possibility of applying this approach to a wide range of echolocating cetaceans. The development of accurate foraging indices from low-cost, easily accessible TDR data would contribute to democratize this type of research, promote long-term studies of various species in several locations, and enable analyses of historical datasets to investigate changes in cetacean foraging activity.
Collapse
Affiliation(s)
- Sergi Pérez-Jorge
- Institute of Marine Sciences - OKEANOS & Institute of Marine Research - IMAR, University of the Azores, Horta, Portugal.
| | - Cláudia Oliveira
- Institute of Marine Sciences - OKEANOS & Institute of Marine Research - IMAR, University of the Azores, Horta, Portugal
| | | | - Rui Prieto
- Institute of Marine Sciences - OKEANOS & Institute of Marine Research - IMAR, University of the Azores, Horta, Portugal
| | - Irma Cascão
- Institute of Marine Sciences - OKEANOS & Institute of Marine Research - IMAR, University of the Azores, Horta, Portugal
| | - Paul J Wensveen
- Faculty of Life and Environmental Sciences, University of Iceland, Reykjavik, Iceland
| | - Patrick J O Miller
- Sea Mammal Research Unit, School of Biology, University of St Andrews, St Andrews, Scotland
| | - Mónica A Silva
- Institute of Marine Sciences - OKEANOS & Institute of Marine Research - IMAR, University of the Azores, Horta, Portugal
| |
Collapse
|
3
|
Allegue H, Réale D, Picard B, Guinet C. Track and dive-based movement metrics do not predict the number of prey encountered by a marine predator. MOVEMENT ECOLOGY 2023; 11:3. [PMID: 36681811 PMCID: PMC9862577 DOI: 10.1186/s40462-022-00361-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/18/2022] [Accepted: 12/17/2022] [Indexed: 06/08/2023]
Abstract
BACKGROUND Studying animal movement in the context of the optimal foraging theory has led to the development of simple movement metrics for inferring feeding activity. Yet, the predictive capacity of these metrics in natural environments has been given little attention, raising serious questions of the validity of these metrics. The aim of this study is to test whether simple continuous movement metrics predict feeding intensity in a marine predator, the southern elephant seal (SES; Mirounga leonine), and investigate potential factors influencing the predictive capacity of these metrics. METHODS We equipped 21 female SES from the Kerguelen Archipelago with loggers and recorded their movements during post-breeding foraging trips at sea. From accelerometry, we estimated the number of prey encounter events (nPEE) and used it as a reference for feeding intensity. We also extracted several track- and dive-based movement metrics and evaluated how well they explain and predict the variance in nPEE. We conducted our analysis at two temporal scales (dive and day), with two dive profile resolutions (high at 1 Hz and low with five dive segments), and two types of models (linear models and regression trees). RESULTS We found that none of the movement metrics predict nPEE with satisfactory power. The vertical transit rates (primarily the ascent rate) during dives had the best predictive performance among all metrics. Dive metrics performed better than track metrics and all metrics performed on average better at the scale of days than the scale of dives. However, the performance of the models at the scale of days showed higher variability among individuals suggesting distinct foraging tactics. Dive-based metrics performed better when computed from high-resolution dive profiles than low-resolution dive profiles. Finally, regression trees produced more accurate predictions than linear models. CONCLUSIONS Our study reveals that simple movement metrics do not predict feeding activity in free-ranging marine predators. This could emerge from differences between individuals, temporal scales, and the data resolution used, among many other factors. We conclude that these simple metrics should be avoided or carefully tested a priori with the studied species and the ecological context to account for significant influencing factors.
Collapse
Affiliation(s)
- Hassen Allegue
- Département des Sciences Biologiques, Université du Québec à Montréal, Montréal, QC, Canada.
| | - Denis Réale
- Département des Sciences Biologiques, Université du Québec à Montréal, Montréal, QC, Canada
| | - Baptiste Picard
- Centre d'Etudes Biologiques de Chizé, UMR7372 CNRS-La Rochelle Université, Villiers en Bois, France
| | - Christophe Guinet
- Centre d'Etudes Biologiques de Chizé, UMR7372 CNRS-La Rochelle Université, Villiers en Bois, France
| |
Collapse
|
4
|
Speakman CN, Lloyd ST, Camprasse ECM, Hoskins AJ, Hindell MA, Costa DP, Arnould JPY. Intertrip consistency in hunting behavior improves foraging success and efficiency in a marine top predator. Ecol Evol 2021; 11:4428-4441. [PMID: 33976820 PMCID: PMC8093728 DOI: 10.1002/ece3.7337] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Revised: 01/26/2021] [Accepted: 01/29/2021] [Indexed: 11/11/2022] Open
Abstract
Substantial variation in foraging strategies can exist within populations, even those typically regarded as generalists. Specializations arise from the consistent exploitation of a narrow behavioral, spatial or dietary niche over time, which may reduce intraspecific competition and influence adaptability to environmental change. However, few studies have investigated whether behavioral consistency confers benefits at the individual and/or population level. While still recovering from commercial sealing overexploitation, Australian fur seals (AUFS; Arctocephalus pusillus doriferus) represent the largest marine predator biomass in south-eastern Australia. During lactation, female AUFS adopt a central-place foraging strategy and are, thus, vulnerable to changes in prey availability. The present study investigated the population-level repeatability and individual consistency in foraging behavior of 34 lactating female AUFS at a south-east Australian breeding colony between 2006 and 2019. Additionally, the influence of individual-level behavioral consistency on indices of foraging success and efficiency during benthic diving was determined. Low to moderate population-level repeatability was observed across foraging behaviors, with the greatest repeatability in the mean bearing and modal dive depth. Individual-level consistency was greatest for the proportion of benthic diving, total distance travelled, and trip duration. Indices of benthic foraging success and efficiency were positively influenced by consistency in the proportion of benthic diving, trip duration and dive rate but not influenced by consistency in bearing to most distal point, dive depth or foraging site fidelity. The results of the present study provide evidence of the benefits of consistency for individuals, which may have flow-on effects at the population level.
Collapse
Affiliation(s)
- Cassie N. Speakman
- School of Life and Environmental SciencesDeakin UniversityBurwoodVic.Australia
| | - Sebastian T. Lloyd
- School of Life and Environmental SciencesDeakin UniversityBurwoodVic.Australia
| | | | | | - Mark A. Hindell
- Institute for Marine and Antarctic StudiesUniversity of TasmaniaHobartTasAustralia
| | - Daniel P. Costa
- Ecology and Evolutionary Biology DepartmentUniversity of California Santa CruzSanta CruzCAUSA
| | - John P. Y. Arnould
- School of Life and Environmental SciencesDeakin UniversityBurwoodVic.Australia
| |
Collapse
|
5
|
Machine learning enables improved runtime and precision for bio-loggers on seabirds. Commun Biol 2020; 3:633. [PMID: 33127951 PMCID: PMC7603325 DOI: 10.1038/s42003-020-01356-8] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2020] [Accepted: 10/07/2020] [Indexed: 01/23/2023] Open
Abstract
Unravelling the secrets of wild animals is one of the biggest challenges in ecology, with bio-logging (i.e., the use of animal-borne loggers or bio-loggers) playing a pivotal role in tackling this challenge. Bio-logging allows us to observe many aspects of animals’ lives, including their behaviours, physiology, social interactions, and external environment. However, bio-loggers have short runtimes when collecting data from resource-intensive (high-cost) sensors. This study proposes using AI on board video-loggers in order to use low-cost sensors (e.g., accelerometers) to automatically detect and record complex target behaviours that are of interest, reserving their devices’ limited resources for just those moments. We demonstrate our method on bio-loggers attached to seabirds including gulls and shearwaters, where it captured target videos with 15 times the precision of a baseline periodic-sampling method. Our work will provide motivation for more widespread adoption of AI in bio-loggers, helping us to shed light onto until now hidden aspects of animals’ lives. Joseph Korpela et al. demonstrate the use of machine-learning assisted bio-loggers on black-tailed gulls and streaked shearwaters. As video recording is only activated through variations in movement detected by low-cost accelerometers, this method represents improvements to runtime and precision over existing bio-logging technology.
Collapse
|
6
|
Environmental influences on foraging effort, success and efficiency in female Australian fur seals. Sci Rep 2020; 10:17710. [PMID: 33077806 PMCID: PMC7572486 DOI: 10.1038/s41598-020-73579-y] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2020] [Accepted: 09/16/2020] [Indexed: 11/08/2022] Open
Abstract
Understanding the factors which influence foraging behaviour and success in marine mammals is crucial to predicting how their populations may respond to environmental change. The Australian fur seal (Arctocephalus pusillus doriferus, AUFS) is a predominantly benthic forager on the shallow continental shelf of Bass Strait, and represents the greatest biomass of marine predators in south-eastern Australia. The south-east Australian region is experiencing rapid oceanic warming, predicted to lead to substantial alterations in prey diversity, distribution and abundance. In the present study, foraging effort and indices of foraging success and efficiency were investigated in 138 adult female AUFS (970 foraging trips) during the winters of 1998–2019. Large scale climate conditions had a strong influence on foraging effort, foraging success and efficiency. Foraging effort and foraging success were also strongly influenced by winter chlorophyll-a concentrations and sea-surface height anomalies in Bass Strait. The results suggest increasing foraging effort and decreasing foraging success and efficiency under anticipated environmental conditions, which may have population-level impacts.
Collapse
|
7
|
Heerah K, Cox SL, Blevin P, Guinet C, Charrassin JB. Validation of Dive Foraging Indices Using Archived and Transmitted Acceleration Data: The Case of the Weddell Seal. Front Ecol Evol 2019. [DOI: 10.3389/fevo.2019.00030] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023] Open
|
8
|
Mattern T, McPherson MD, Ellenberg U, van Heezik Y, Seddon PJ. High definition video loggers provide new insights into behaviour, physiology, and the oceanic habitat of a marine predator, the yellow-eyed penguin. PeerJ 2018; 6:e5459. [PMID: 30258706 PMCID: PMC6151119 DOI: 10.7717/peerj.5459] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2018] [Accepted: 07/24/2018] [Indexed: 11/24/2022] Open
Abstract
Camera loggers are increasingly used to examine behavioural aspects of free-ranging animals. However, often video loggers are deployed with a focus on specific behavioural traits utilizing small cameras with a limited field of view, poor light performance and video quality. Yet rapid developments in consumer electronics provide new devices with much improved visual data allowing a wider scope for studies employing this novel methodology. We developed a camera logger that records full HD video through a wide-angle lens, providing high resolution footage with a greater field of view than other camera loggers. The main goal was to assess the suitability of this type of camera for the analysis of various aspects of the foraging ecology of a marine predator, the yellow-eyed penguin in New Zealand. Frame-by-frame analysis allowed accurate timing of prey pursuits and time spent over certain seafloor types. The recorded video footage showed that prey species were associated with certain seafloor types, revealed different predator evasion strategies by benthic fishes, and highlighted varying energetic consequences for penguins pursuing certain types of prey. Other aspects that could be analysed were the timing of breathing intervals between dives and observe exhalation events during prey pursuits, a previously undescribed behaviour. Screen overlays facilitated analysis of flipper angles and beat frequencies throughout various stages of the dive cycle. Flipper movement analysis confirmed decreasing effort during descent phases as the bird gained depth, and that ascent was principally passive. Breathing episodes between dives were short (<1 s) while the majority of the time was devoted to subsurface scanning with a submerged head. Video data recorded on free-ranging animals not only provide a wealth of information recorded from a single deployment but also necessitate new approaches with regards to analysis of visual data. Here, we demonstrate the diversity of information that can be gleaned from video logger data, if devices with high video resolution and wide field of view are utilized.
Collapse
Affiliation(s)
- Thomas Mattern
- Department of Zoology, University of Otago, Dunedin, Otago, New Zealand.,Global Penguin Society, Puerto Madryn, Chubut, Argentina
| | | | - Ursula Ellenberg
- Global Penguin Society, Puerto Madryn, Chubut, Argentina.,Department of Ecology, Environment and Evolution, La Trobe University, Melbourne, Victoria, Australia
| | | | - Philipp J Seddon
- Department of Zoology, University of Otago, Dunedin, Otago, New Zealand
| |
Collapse
|
9
|
Mattern T, McPherson MD, Ellenberg U, van Heezik Y, Seddon PJ. High definition video loggers provide new insights into behaviour, physiology, and the oceanic habitat of a marine predator, the yellow-eyed penguin. PeerJ 2018; 6:e5459. [PMID: 30258706 DOI: 10.7287/peerj.preprints.2765v2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2018] [Accepted: 07/24/2018] [Indexed: 05/27/2023] Open
Abstract
Camera loggers are increasingly used to examine behavioural aspects of free-ranging animals. However, often video loggers are deployed with a focus on specific behavioural traits utilizing small cameras with a limited field of view, poor light performance and video quality. Yet rapid developments in consumer electronics provide new devices with much improved visual data allowing a wider scope for studies employing this novel methodology. We developed a camera logger that records full HD video through a wide-angle lens, providing high resolution footage with a greater field of view than other camera loggers. The main goal was to assess the suitability of this type of camera for the analysis of various aspects of the foraging ecology of a marine predator, the yellow-eyed penguin in New Zealand. Frame-by-frame analysis allowed accurate timing of prey pursuits and time spent over certain seafloor types. The recorded video footage showed that prey species were associated with certain seafloor types, revealed different predator evasion strategies by benthic fishes, and highlighted varying energetic consequences for penguins pursuing certain types of prey. Other aspects that could be analysed were the timing of breathing intervals between dives and observe exhalation events during prey pursuits, a previously undescribed behaviour. Screen overlays facilitated analysis of flipper angles and beat frequencies throughout various stages of the dive cycle. Flipper movement analysis confirmed decreasing effort during descent phases as the bird gained depth, and that ascent was principally passive. Breathing episodes between dives were short (<1 s) while the majority of the time was devoted to subsurface scanning with a submerged head. Video data recorded on free-ranging animals not only provide a wealth of information recorded from a single deployment but also necessitate new approaches with regards to analysis of visual data. Here, we demonstrate the diversity of information that can be gleaned from video logger data, if devices with high video resolution and wide field of view are utilized.
Collapse
Affiliation(s)
- Thomas Mattern
- Department of Zoology, University of Otago, Dunedin, Otago, New Zealand
- Global Penguin Society, Puerto Madryn, Chubut, Argentina
| | | | - Ursula Ellenberg
- Global Penguin Society, Puerto Madryn, Chubut, Argentina
- Department of Ecology, Environment and Evolution, La Trobe University, Melbourne, Victoria, Australia
| | | | - Philipp J Seddon
- Department of Zoology, University of Otago, Dunedin, Otago, New Zealand
| |
Collapse
|
10
|
Carter MID, Bennett KA, Embling CB, Hosegood PJ, Russell DJF. Navigating uncertain waters: a critical review of inferring foraging behaviour from location and dive data in pinnipeds. MOVEMENT ECOLOGY 2016; 4:25. [PMID: 27800161 PMCID: PMC5080796 DOI: 10.1186/s40462-016-0090-9] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/25/2016] [Accepted: 10/17/2016] [Indexed: 05/09/2023]
Abstract
In the last thirty years, the emergence and progression of biologging technology has led to great advances in marine predator ecology. Large databases of location and dive observations from biologging devices have been compiled for an increasing number of diving predator species (such as pinnipeds, sea turtles, seabirds and cetaceans), enabling complex questions about animal activity budgets and habitat use to be addressed. Central to answering these questions is our ability to correctly identify and quantify the frequency of essential behaviours, such as foraging. Despite technological advances that have increased the quality and resolution of location and dive data, accurately interpreting behaviour from such data remains a challenge, and analytical methods are only beginning to unlock the full potential of existing datasets. This review evaluates both traditional and emerging methods and presents a starting platform of options for future studies of marine predator foraging ecology, particularly from location and two-dimensional (time-depth) dive data. We outline the different devices and data types available, discuss the limitations and advantages of commonly-used analytical techniques, and highlight key areas for future research. We focus our review on pinnipeds - one of the most studied taxa of marine predators - but offer insights that will be applicable to other air-breathing marine predator tracking studies. We highlight that traditionally-used methods for inferring foraging from location and dive data, such as first-passage time and dive shape analysis, have important caveats and limitations depending on the nature of the data and the research question. We suggest that more holistic statistical techniques, such as state-space models, which can synthesise multiple track, dive and environmental metrics whilst simultaneously accounting for measurement error, offer more robust alternatives. Finally, we identify a need for more research to elucidate the role of physical oceanography, device effects, study animal selection, and developmental stages in predator behaviour and data interpretation.
Collapse
Affiliation(s)
- Matt Ian Daniel Carter
- Marine Biology & Ecology Research Centre, School of Marine Science & Engineering, Plymouth University, PL4 8AA Plymouth, UK
| | - Kimberley A. Bennett
- School of Science, Engineering & Technology, Abertay University, DD1 1HG Dundee, UK
| | - Clare B. Embling
- Marine Biology & Ecology Research Centre, School of Marine Science & Engineering, Plymouth University, PL4 8AA Plymouth, UK
| | - Philip J. Hosegood
- Centre for Coast and Ocean Science & Engineering, School of Marine Science & Engineering, Plymouth University, PL4 8AA Plymouth, UK
| | - Debbie J. F. Russell
- Sea Mammal Research Unit, University of St. Andrews, KY16 8LB St. Andrews, UK
- Centre for Research into Ecological and Environmental Modelling, University of St. Andrews, KY16 9LZ St. Andrews, UK
| |
Collapse
|