An annotated dataset of bioacoustic sensing and features of mosquitoes

Reshaping Bioacoustics Event Detection: Leveraging Few-Shot Learning (FSL) with Transductive Inference and Data Augmentation

Bioacoustic event detection is a demanding endeavor involving recognizing and classifying the sounds animals make in their natural habitats. Traditional supervised learning requires a large amount of labeled data, which are hard to come by in bioacoustics. This paper presents a few-shot learning (FSL) method incorporating transductive inference and data augmentation to address the issues of too few labeled events and small volumes of recordings. Here, transductive inference iteratively alters class prototypes and feature extractors to seize essential patterns, whereas data augmentation applies SpecAugment on Mel spectrogram features to augment training data. The proposed approach is evaluated by using the Detecting and Classifying Acoustic Scenes and Events (DCASE) 2022 and 2021 datasets. Extensive experimental results demonstrate that all components of the proposed method achieve significant F-score improvements of 27% and 10%, for the DCASE-2022 and DCASE-2021 datasets, respectively, compared to recent advanced approaches. Moreover, our method is helpful in FSL tasks because it effectively adapts to sounds from various animal species, recordings, and durations.

Field evaluation of an automated mosquito surveillance system which classifies Aedes and Culex mosquitoes by genus and sex

BACKGROUND

Mosquito-borne diseases are a major concern for public and veterinary health authorities, highlighting the importance of effective vector surveillance and control programs. Traditional surveillance methods are labor-intensive and do not provide high temporal resolution, which may hinder a full assessment of the risk of mosquito-borne pathogen transmission. Emerging technologies for automated remote mosquito monitoring have the potential to address these limitations; however, few studies have tested the performance of such systems in the field.

METHODS

In the present work, an optical sensor coupled to the entrance of a standard mosquito suction trap was used to record 14,067 mosquito flights of Aedes and Culex genera at four temperature regimes in the laboratory, and the resulting dataset was used to train a machine learning (ML) model. The trap, sensor, and ML model, which form the core of an automated mosquito surveillance system, were tested in the field for two classification purposes: to discriminate Aedes and Culex mosquitoes from other insects that enter the trap and to classify the target mosquitoes by genus and sex. The field performance of the system was assessed using balanced accuracy and regression metrics by comparing the classifications made by the system with those made by the manual inspection of the trap.

RESULTS

The field system discriminated the target mosquitoes (Aedes and Culex genera) with a balanced accuracy of 95.5% and classified the genus and sex of those mosquitoes with a balanced accuracy of 88.8%. An analysis of the daily and seasonal temporal dynamics of Aedes and Culex mosquito populations was also performed using the time-stamped classifications from the system.

CONCLUSIONS

This study reports results for automated mosquito genus and sex classification using an optical sensor coupled to a mosquito trap in the field with highly balanced accuracy. The compatibility of the sensor with commercial mosquito traps enables the sensor to be integrated into conventional mosquito surveillance methods to provide accurate automatic monitoring with high temporal resolution of Aedes and Culex mosquitoes, two of the most concerning genera in terms of arbovirus transmission.

Automated differentiation of mixed populations of free-flying female mosquitoes under semi-field conditions

Great advances in automated identification systems, or 'smart traps', that differentiate insect species have been made in recent years, yet demonstrations of field-ready devices under free-flight conditions remain rare. Here, we describe the results of mixed-species identification of female mosquitoes using an advanced optoacoustic smart trap design under free-flying conditions. Point-of-capture classification was assessed using mixed populations of congeneric (Aedes albopictus and Aedes aegypti) and non-congeneric (Ae. aegypti and Anopheles stephensi) container-inhabiting species of medical importance. Culex quinquefasciatus, also common in container habitats, was included as a third species in all assessments. At the aggregate level, mixed collections of non-congeneric species (Ae. aegypti, Cx. quinquefasciatus, and An. stephensi) could be classified at accuracies exceeding 90% (% error = 3.7-7.1%). Conversely, error rates increased when analysing individual replicates (mean % error = 48.6; 95% CI 8.1-68.6) representative of daily trap captures and at the aggregate level when Ae. albopictus was released in the presence of Ae. aegypti and Cx. quinquefasciatus (% error = 7.8-31.2%). These findings highlight the many challenges yet to be overcome but also the potential operational utility of optoacoustic surveillance in low diversity settings typical of urban environments.

Optimal 2D audio features estimation for a lightweight application in mosquitoes species: Ecoacoustics detection and classification purposes

Mosquitoes are the vector of diseases that kill more than one million people per year worldwide. Surveillance systems are essential for understanding their complex ecology and behaviour. This is fundamental for predicting disease risk caused by mosquitoes and formulating effective control strategies against mosquito-borne diseases such as malaria, dengue, and Zika. Mosquito populations vary heterogeneously in urban and rural landscapes, fluctuating with seasonal and climatic trends and human activity. Several approaches provide environmental data for mosquito mapping and risk prediction. However, they rely traditionally upon labour-intensive techniques such as manual traps. This paper presents the optimal audio features for mosquito identification using ecoacoustics signals to automatically identify different mosquito species from their wingbeat sounds based on popular audio features. The audio selection method uses Density-Based Spatial Clustering of Applications with Noise (DBSCAN) and Silhouette coefficient to evaluate the clusters in the data through the optimal-combined audio features. To classify the mosquito species and distinguish them from environmental-urban noise, the method comprises the Gaussian Mixture Model (GMM) and Gibbs approach for Aedes aegypti, and Culex quinquefasciatus, using the acoustic recordings of their wingbeat signals. Finally, comparing GMM and Gibbs, the two have very similar accuracy, but the classification time is much faster for Gibbs sampling, making it a good candidate for a lightweight solution. These are essential when deploying the described models to monitor mosquito vectors in the wild with Internet of Things (IoT) technologies.

A Review of Automated Bioacoustics and General Acoustics Classification Research

Automated bioacoustics classification has received increasing attention from the research community in recent years due its cross-disciplinary nature and its diverse application. Applications in bioacoustics classification range from smart acoustic sensor networks that investigate the effects of acoustic vocalizations on species to context-aware edge devices that anticipate changes in their environment adapt their sensing and processing accordingly. The research described here is an in-depth survey of the current state of bioacoustics classification and monitoring. The survey examines bioacoustics classification alongside general acoustics to provide a representative picture of the research landscape. The survey reviewed 124 studies spanning eight years of research. The survey identifies the key application areas in bioacoustics research and the techniques used in audio transformation and feature extraction. The survey also examines the classification algorithms used in bioacoustics systems. Lastly, the survey examines current challenges, possible opportunities, and future directions in bioacoustics.

A Low-Cost Multi-Purpose IoT Sensor for Biologging and Soundscape Activities

The rapid expansion in miniaturization, usability, energy efficiency, and affordability of Internet of Things (IoT) sensors, integrated with innovations in smart capability, is greatly increasing opportunities in ground-level monitoring of ecosystems at a specific scale using sensor grids. Surrounding sound is a powerful data source for investigating urban and non-urban ecosystem health, and researchers commonly use robust but expensive passive sensors as monitoring equipment to capture it. This paper comprehensively describes the hardware behind our low-cost, small multipurpose prototype, capable of monitoring different environments (e.g., remote locations) with onboard processing power. The device consists of a printed circuit board, microprocessor, local memory, environmental sensor, microphones, optical sensors and LoRa (Long Range) communication systems. The device was successfully used in different use cases, from monitoring mosquitoes enhanced with optical sensors to ocean activities using a hydrophone.