Management of acoustic metadata for bioacoustics

Listening to animal behavior to understand changing ecosystems

Interpreting sound gives powerful insight into the health of ecosystems. Beyond detecting the presence of wildlife, bioacoustic signals can reveal their behavior. However, behavioral bioacoustic information is underused because identifying the function and context of animals' sounds remains challenging. A growing acoustic toolbox is allowing researchers to begin decoding bioacoustic signals by linking individual and population-level sensing. Yet, studies integrating acoustic tools for behavioral insight across levels of biological organization remain scarce. We aim to catalyze the emerging field of behavioral bioacoustics by synthesizing recent successes and rising analytical, logistical, and ethical challenges. Because behavior typically represents animals' first response to environmental change, we posit that behavioral bioacoustics will provide theoretical and applied insights into animals' adaptations to global change.

Silbido profundo: An open source package for the use of deep learning to detect odontocete whistles

This work presents an open-source matlab software package for exploiting recent advances in extracting tonal signals from large acoustic data sets. A whistle extraction algorithm published by Li, Liu, Palmer, Fleishman, Gillespie, Nosal, Shiu, Klinck, Cholewiak, Helble, and Roch [(2020). Proceedings of the International Joint Conference on Neural Networks, July 19-24, Glasgow, Scotland, p. 10] is incorporated into silbido, an established software package for extraction of cetacean tonal calls. The precision and recall of the new system were over 96% and nearly 80%, respectively, when applied to a whistle extraction task on a challenging two-species subset of a conference-benchmark data set. A second data set was examined to assess whether the algorithm generalized to data that were collected across different recording devices and locations. These data included 487 h of weakly labeled, towed array data collected in the Pacific Ocean on two National Oceanographic and Atmospheric Administration (NOAA) cruises. Labels for these data consisted of regions of toothed whale presence for at least 15 species that were based on visual and acoustic observations and not limited to whistles. Although the lack of per whistle-level annotations prevented measurement of precision and recall, there was strong concurrence of automatic detections and the NOAA annotations, suggesting that the algorithm generalizes well to new data.

Key Issues for Realizing Open Ecoacoustic Monitoring in Australia

Many organizations are attempting to scale ecoacoustic monitoring for conservation but are hampered at the stages of data management and analysis. We reviewed current ecoacoustic hardware, software, and standards, and conducted workshops with 23 participants across 10 organizations in Australia to learn about their current practices, and to identify key trends and challenges in their use of ecoacoustics data. We found no existing metadata schemas that contain enough ecoacoustics terms for current practice, and no standard approaches to annotation. There was a strong need for free acoustics data storage, discoverable learning resources, and interoperability with other ecological modeling tools. In parallel, there were tensions regarding intellectual property management, and siloed approaches to studying species within organizations across different regions and between organizations doing similar work. This research contributes directly to the development of an open ecoacoustics platform to enable the sharing of data, analyses, and tools for environmental conservation.

Using context to train time-domain echolocation click detectors

This work demonstrates the effectiveness of using humans in the loop processes for constructing large training sets for machine learning tasks. A corpus of over 57 000 toothed whale echolocation clicks was developed by using a permissive energy-based echolocation detector followed by a machine-assisted quality control process that exploits contextual cues. Subsets of these data were used to train feed forward neural networks that detected over 850 000 echolocation clicks that were validated using the same quality control process. It is shown that this network architecture performs well in a variety of contexts and is evaluated against a withheld data set that was collected nearly five years apart from the development data at a location over 600 km distant. The system was capable of finding echolocation bouts that were missed by human analysts, and the patterns of error in the classifier consist primarily of anthropogenic sources that were not included as counter-training examples. In the absence of such events, typical false positive rates are under ten events per hour even at low thresholds.

Automatic detection and classification of baleen whale social calls using convolutional neural networks

Passive acoustic monitoring has proven to be an indispensable tool for many aspects of baleen whale research. Manual detection of whale calls on these large data sets demands extensive manual labor. Automated whale call detectors offer a more efficient approach and have been developed for many species and call types. However, calls with a large level of variability such as fin whale (Balaenoptera physalus) 40 Hz call and blue whale (B. musculus) D call have been challenging to detect automatically and hence no practical automated detector exists for these two call types. Using a modular approach consisting of faster region-based convolutional neural network followed by a convolutional neural network, we have created automated detectors for 40 Hz calls and D calls. Both detectors were tested on recordings with high- and low density of calls and, when selecting for detections with high classification scores, they were shown to have precision ranging from 54% to 57% with recall ranging from 72% to 78% for 40 Hz and precision ranging from 62% to 64% with recall ranging from 70 to 73% for D calls. As these two call types are produced by both sexes, using them in long-term studies would remove sex-bias in estimates of temporal presence and movement patterns.

Repositories for Taxonomic Data: Where We Are and What is Missing

Natural history collections are leading successful large-scale projects of specimen digitization (images, metadata, DNA barcodes), thereby transforming taxonomy into a big data science. Yet, little effort has been directed towards safeguarding and subsequently mobilizing the considerable amount of original data generated during the process of naming 15,000-20,000 species every year. From the perspective of alpha-taxonomists, we provide a review of the properties and diversity of taxonomic data, assess their volume and use, and establish criteria for optimizing data repositories. We surveyed 4113 alpha-taxonomic studies in representative journals for 2002, 2010, and 2018, and found an increasing yet comparatively limited use of molecular data in species diagnosis and description. In 2018, of the 2661 papers published in specialized taxonomic journals, molecular data were widely used in mycology (94%), regularly in vertebrates (53%), but rarely in botany (15%) and entomology (10%). Images play an important role in taxonomic research on all taxa, with photographs used in >80% and drawings in 58% of the surveyed papers. The use of omics (high-throughput) approaches or 3D documentation is still rare. Improved archiving strategies for metabarcoding consensus reads, genome and transcriptome assemblies, and chemical and metabolomic data could help to mobilize the wealth of high-throughput data for alpha-taxonomy. Because long-term-ideally perpetual-data storage is of particular importance for taxonomy, energy footprint reduction via less storage-demanding formats is a priority if their information content suffices for the purpose of taxonomic studies. Whereas taxonomic assignments are quasifacts for most biological disciplines, they remain hypotheses pertaining to evolutionary relatedness of individuals for alpha-taxonomy. For this reason, an improved reuse of taxonomic data, including machine-learning-based species identification and delimitation pipelines, requires a cyberspecimen approach-linking data via unique specimen identifiers, and thereby making them findable, accessible, interoperable, and reusable for taxonomic research. This poses both qualitative challenges to adapt the existing infrastructure of data centers to a specimen-centered concept and quantitative challenges to host and connect an estimated $ \le $2 million images produced per year by alpha-taxonomic studies, plus many millions of images from digitization campaigns. Of the 30,000-40,000 taxonomists globally, many are thought to be nonprofessionals, and capturing the data for online storage and reuse therefore requires low-complexity submission workflows and cost-free repository use. Expert taxonomists are the main stakeholders able to identify and formalize the needs of the discipline; their expertise is needed to implement the envisioned virtual collections of cyberspecimens. [Big data; cyberspecimen; new species; omics; repositories; specimen identifier; taxonomy; taxonomic data.].

Bioacoustics in cognitive research: Applications, considerations, and recommendations

The multifaceted ability to produce, transmit, receive, and respond to acoustic signals is widespread in animals and forms the basis of the interdisciplinary science of bioacoustics. Bioacoustics research methods, including sound recording and playback experiments, are applicable in cognitive research that centers around the processing of information from the acoustic environment. We provide an overview of bioacoustics techniques in the context of cognitive studies and make the case for the importance of bioacoustics in the study of cognition by outlining some of the major cognitive processes in which acoustic signals are involved. We also describe key considerations associated with the recording of sound and its use in cognitive applications. Based on these considerations, we provide a set of recommendations for best practices in the recording and use of acoustic signals in cognitive studies. Our aim is to demonstrate that acoustic recordings and stimuli are valuable tools for cognitive researchers when used appropriately. In doing so, we hope to stimulate opportunities for innovative cognitive research that incorporates robust recording protocols. This article is categorized under: Neuroscience > Cognition Psychology > Theory and Methods Neuroscience > Behavior Neuroscience > Cognition.

Comparison of fin whale 20 Hz call detections by deep-water mobile autonomous and stationary recorders

Acoustically equipped deep-water mobile autonomous platforms can be used to survey for marine mammals over intermediate spatiotemporal scales. Direct comparisons to fixed recorders are necessary to evaluate these tools as passive acoustic monitoring platforms. One glider and two drifting deep-water floats were simultaneously deployed within a deep-water cabled hydrophone array to quantitatively assess their survey capabilities. The glider was able to follow a pre-defined track while float movement was somewhat unpredictable. Fin whale (Balaenoptera physalus) 20 Hz pulses were recorded by all hydrophones throughout the two-week deployment. Calls were identified using a template detector, which performed similarly across recorder types. The glider data contained up to 78% fewer detections per hour due to increased low-frequency flow noise present during glider descents. The glider performed comparably to the floats and fixed recorders at coarser temporal scales; hourly and daily presence of detections did not vary by recorder type. Flow noise was related to glider speed through water and dive state. Glider speeds through water of 25 cm/s or less are suggested to minimize flow noise and the importance of glider ballasting, detector characterization, and normalization by effort when interpreting glider-collected data and applying it to marine mammal density estimation are discussed.

Machine learning in acoustics: Theory and applications

Acoustic data provide scientific and engineering insights in fields ranging from biology and communications to ocean and Earth science. We survey the recent advances and transformative potential of machine learning (ML), including deep learning, in the field of acoustics. ML is a broad family of techniques, which are often based in statistics, for automatically detecting and utilizing patterns in data. Relative to conventional acoustics and signal processing, ML is data-driven. Given sufficient training data, ML can discover complex relationships between features and desired labels or actions, or between features themselves. With large volumes of training data, ML can discover models describing complex acoustic phenomena such as human speech and reverberation. ML in acoustics is rapidly developing with compelling results and significant future promise. We first introduce ML, then highlight ML developments in four acoustics research areas: source localization in speech processing, source localization in ocean acoustics, bioacoustics, and environmental sounds in everyday scenes.

Autonomous sound recording outperforms human observation for sampling birds: a systematic map and user guide

Autonomous sound recording techniques have gained considerable traction in the last decade, but the question remains whether they can replace human observation surveys to sample sonant animals. For birds in particular, survey methods have been tested extensively using point counts and sound recording surveys. Here, we review the latest evidence for this taxon within the frame of a systematic map. We compare sampling effectiveness of these two survey methods, the output variables they produce, and their practicality. When assessed against the standard of point counts, autonomous sound recording proves to be a powerful tool that samples at least as many species. This technology can monitor birds in an exhaustive, standardized, and verifiable way. Moreover, sound recorders give access to entire soundscapes from which new data types can be derived (vocal activity, acoustic indices). Variables such as abundance, density, occupancy, or species richness can be obtained to yield data sets that are comparable to and compatible with point counts. Finally, autonomous sound recorders allow investigations at high temporal and spatial resolution and coverage, which are more cost effective and cannot be achieved by human observations alone, even though small-scale studies might be more cost effective when carried out with point counts. Sound recorders can be deployed in many places, they are more scalable and reliable, making them the better choice for bird surveys in an increasingly data-driven time. We provide an overview of currently available recorders and discuss their specifications to guide future study designs.

Autonomous marine environmental monitoring: Application in decommissioned oil fields

Hundreds of Oil & Gas Industry structures in the marine environment are approaching decommissioning. In most areas decommissioning operations will need to be supported by environmental assessment and monitoring, potentially over the life of any structures left in place. This requirement will have a considerable cost for industry and the public. Here we review approaches for the assessment of the primary operating environments associated with decommissioning - namely structures, pipelines, cuttings piles, the general seabed environment and the water column - and show that already available marine autonomous systems (MAS) offer a wide range of solutions for this major monitoring challenge. Data of direct relevance to decommissioning can be collected using acoustic, visual, and oceanographic sensors deployed on MAS. We suggest that there is considerable potential for both cost savings and a substantial improvement in the temporal and spatial resolution of environmental monitoring. We summarise the trade-offs between MAS and current conventional approaches to marine environmental monitoring. MAS have the potential to successfully carry out much of the monitoring associated with decommissioning and to offer viable alternatives where a direct match for the conventional approach is not possible.