1
|
Madhusudhana S, Klinck H, Symes LB. Extensive data engineering to the rescue: building a multi-species katydid detector from unbalanced, atypical training datasets. Philos Trans R Soc Lond B Biol Sci 2024; 379:20230444. [PMID: 38705172 PMCID: PMC11070257 DOI: 10.1098/rstb.2023.0444] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2023] [Accepted: 02/21/2024] [Indexed: 05/07/2024] Open
Abstract
Passive acoustic monitoring (PAM) is a powerful tool for studying ecosystems. However, its effective application in tropical environments, particularly for insects, poses distinct challenges. Neotropical katydids produce complex species-specific calls, spanning mere milliseconds to seconds and spread across broad audible and ultrasonic frequencies. However, subtle differences in inter-pulse intervals or central frequencies are often the only discriminatory traits. These extremities, coupled with low source levels and susceptibility to masking by ambient noise, challenge species identification in PAM recordings. This study aimed to develop a deep learning-based solution to automate the recognition of 31 katydid species of interest in a biodiverse Panamanian forest with over 80 katydid species. Besides the innate challenges, our efforts were also encumbered by a limited and imbalanced initial training dataset comprising domain-mismatched recordings. To overcome these, we applied rigorous data engineering, improving input variance through controlled playback re-recordings and by employing physics-based data augmentation techniques, and tuning signal-processing, model and training parameters to produce a custom well-fit solution. Methods developed here are incorporated into Koogu, an open-source Python-based toolbox for developing deep learning-based bioacoustic analysis solutions. The parametric implementations offer a valuable resource, enhancing the capabilities of PAM for studying insects in tropical ecosystems. This article is part of the theme issue 'Towards a toolkit for global insect biodiversity monitoring'.
Collapse
Affiliation(s)
- Shyam Madhusudhana
- Centre for Marine Science and Technology, Curtin University, Perth, Western Australia 6845, Australia
- K. Lisa Yang Center for Conservation Bioacoustics, Cornell Lab of Ornithology, Cornell University, Ithaca, NY 14853-0001, USA
| | - Holger Klinck
- K. Lisa Yang Center for Conservation Bioacoustics, Cornell Lab of Ornithology, Cornell University, Ithaca, NY 14853-0001, USA
| | - Laurel B. Symes
- K. Lisa Yang Center for Conservation Bioacoustics, Cornell Lab of Ornithology, Cornell University, Ithaca, NY 14853-0001, USA
- Smithsonian Tropical Research Institute, Balboa, Ancón, Panama City 0843-03092, Republic of Panama
| |
Collapse
|
2
|
van Klink R, Sheard JK, Høye TT, Roslin T, Do Nascimento LA, Bauer S. Towards a toolkit for global insect biodiversity monitoring. Philos Trans R Soc Lond B Biol Sci 2024; 379:20230101. [PMID: 38705179 PMCID: PMC11070268 DOI: 10.1098/rstb.2023.0101] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2024] [Accepted: 03/28/2024] [Indexed: 05/07/2024] Open
Abstract
Insects are the most diverse group of animals on Earth, yet our knowledge of their diversity, ecology and population trends remains abysmally poor. Four major technological approaches are coming to fruition for use in insect monitoring and ecological research-molecular methods, computer vision, autonomous acoustic monitoring and radar-based remote sensing-each of which has seen major advances over the past years. Together, they have the potential to revolutionize insect ecology, and to make all-taxa, fine-grained insect monitoring feasible across the globe. So far, advances within and among technologies have largely taken place in isolation, and parallel efforts among projects have led to redundancy and a methodological sprawl; yet, given the commonalities in their goals and approaches, increased collaboration among projects and integration across technologies could provide unprecedented improvements in taxonomic and spatio-temporal resolution and coverage. This theme issue showcases recent developments and state-of-the-art applications of these technologies, and outlines the way forward regarding data processing, cost-effectiveness, meaningful trend analysis, technological integration and open data requirements. Together, these papers set the stage for the future of automated insect monitoring. This article is part of the theme issue 'Towards a toolkit for global insect biodiversity monitoring'.
Collapse
Affiliation(s)
- Roel van Klink
- German Centre for Integrative Biodiversity Research Halle-Jena-Leipzig, Puschstrasse 4, Leipzig 04103, Germany
- Department of Computer Science, Martin-Luther-University Halle-Wittenberg, Von-Seckendorff-Platz 1 06120 Halle, Germany
| | - Julie Koch Sheard
- German Centre for Integrative Biodiversity Research Halle-Jena-Leipzig, Puschstrasse 4, Leipzig 04103, Germany
- Department of Ecosystem Services, Helmholtz-Centre for Environmental Research - UFZ, Permoserstr. 15, Leipzig 04318, Germany
- Friedrich Schiller University Jena, Institute of Biodiversity, Dornburger Straße 159, Jena 07743, Germany
- Department of Biology, Animal Ecology, University of Marburg, Karl-von-Frisch-Straße 8, Marburg 35043, Germany
| | - Toke T. Høye
- Department of Ecoscience, Aarhus University, C. F. Møllers Allé 8, Aarhus C 8000, Denmark
- Arctic Research Centre, Aarhus University, Ole Worms Allé 1, Aarhus C 8000, Denmark
| | - Tomas Roslin
- Department of Ecology, Swedish University of Agricultural Sciences (SLU), Ulls väg 18B, Uppsala 75651, Sweden
- Organismal and Evolutionary Biology Research Programme, Faculty of Biological and Environmental Sciences, FI-00014 University of Helsinki, Helsinki, Finland
| | - Leandro A. Do Nascimento
- Science Department, biometrio.earth, Dr.-Schoenemann-Str. 38, Saarbrücken 66123 Deutschland, Germany
| | - Silke Bauer
- Swiss Federal Research Institute WSL, Zürcherstrasse 111, Birmensdorf CH-8903, Switzerland
- Swiss Ornithological Institute, Seerose 1, Sempach 6204, Switzerland
- Institute for Biodiversity and Ecosystem Dynamics, Sciencepark 904, Amsterdam 1098 XH, The Netherlands
- Department of Environmental Systems Science, ETH Zürich, Universitätstrasse 16 Zürich 8092, Switzerland
| |
Collapse
|
3
|
Do Nascimento LA, Pérez-Granados C, Alencar JBR, Beard KH. Time and habitat structure shape insect acoustic activity in the Amazon. Philos Trans R Soc Lond B Biol Sci 2024; 379:20230112. [PMID: 38705178 PMCID: PMC11070253 DOI: 10.1098/rstb.2023.0112] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2023] [Accepted: 03/28/2024] [Indexed: 05/07/2024] Open
Abstract
Insects are the most diverse animal taxon on Earth and play a key role in ecosystem functioning. However, they are often neglected by ecological surveys owing to the difficulties involved in monitoring this small and hyper-diverse taxon. With technological advances in biomonitoring and analytical methods, these shortcomings may finally be addressed. Here, we performed passive acoustic monitoring at 141 sites (eight habitats) to investigate insect acoustic activity in the Viruá National Park, Brazil. We first describe the frequency range occupied by three soniferous insect groups (cicadas, crickets and katydids) to calculate the acoustic evenness index (AEI). Then, we assess how AEI varies spatially and temporally among habitat types, and finally we investigate the relationship between vegetation structure variables and AEI for each insect category. Overall, crickets occupied lower and narrower frequency bands than cicadas and katydids. AEI values varied among insect categories and across space and time. The highest acoustic activity occurred before sunrise and the lowest acoustic activity was recorded in pastures. Canopy cover was positively associated with cricket acoustic activity but not with katydids. Our findings contribute to a better understanding of the role of time, habitat and vegetation structure in shaping insect activity within diverse Amazonian ecosystems. This article is part of the theme issue 'Towards a toolkit for global insect biodiversity monitoring'.
Collapse
Affiliation(s)
| | | | - Janderson B. Rodrigues Alencar
- Instituto Nacional de Pesquisas da Amazônia, Programa de Pós-Graduação em Ciências Biológicas (Entomologia), 69067-375 Manaus, Amazonas, Brazil
| | - Karen H. Beard
- Department of Wildland Resources and Ecology Center, Utah State University, 84322-5230 Logan, UT, USA
| |
Collapse
|