Can Machine Learning Assist Locating the Excitation of Snore Sound? A Review

Automatically detecting OSAHS patients based on transfer learning and model fusion

Objective. Snoring is the most typical symptom of obstructive sleep apnea hypopnea syndrome (OSAHS) that can be used to develop a non-invasive approach for automatically detecting OSAHS patients.Approach. In this work, a model based on transfer learning and model fusion was applied to classify simple snorers and OSAHS patients. Three kinds of basic models were constructed based on pretrained Visual Geometry Group-16 (VGG16), pretrained audio neural networks (PANN), and Mel-frequency cepstral coefficient (MFCC). The XGBoost was used to select features based on feature importance, the majority voting strategy was applied to fuse these basic models and leave-one-subject-out cross validation was used to evaluate the proposed model.Main results. The results show that the fused model embedded with top-5 VGG16 features, top-5 PANN features, and MFCC feature can correctly identify OSAHS patients (AHI > 5) with 100% accuracy.Significance. The proposed fused model provides a good classification performance with lower computational cost and higher robustness that makes detecting OSAHS patients at home possible.

The Voice of the Body: Why AI Should Listen to It and an Archive

The sound generated by body carries important information about our health status physically and psychologically. In the past decades, we have witnessed a plethora of successes achieved in the field of body sound analysis. Nevertheless, the fundamentals of this young field are still not well established. In particular, publicly accessible databases are rarely developed, which dramatically restrains a sustainable research. To this end, we are launching and continuously calling for participation from the global scientific community to contribute to the Voice of the Body (VoB) archive. We aim to build an open access platform to collect the well-established body sound databases in a well standardized way. Moreover, we hope to organize a series of challenges to promote the development of audio-driven methods for healthcare via the proposed VoB. We believe that VoB can help break the walls between different subjects toward an era of Medicine 4.0 enriched by audio intelligence.

A Review of Automated Bioacoustics and General Acoustics Classification Research

Automated bioacoustics classification has received increasing attention from the research community in recent years due its cross-disciplinary nature and its diverse application. Applications in bioacoustics classification range from smart acoustic sensor networks that investigate the effects of acoustic vocalizations on species to context-aware edge devices that anticipate changes in their environment adapt their sensing and processing accordingly. The research described here is an in-depth survey of the current state of bioacoustics classification and monitoring. The survey examines bioacoustics classification alongside general acoustics to provide a representative picture of the research landscape. The survey reviewed 124 studies spanning eight years of research. The survey identifies the key application areas in bioacoustics research and the techniques used in audio transformation and feature extraction. The survey also examines the classification algorithms used in bioacoustics systems. Lastly, the survey examines current challenges, possible opportunities, and future directions in bioacoustics.

Identification of Characteristic Points in Multivariate Physiological Signals by Sensor Fusion and Multi-Task Deep Networks

Identification of characteristic points in physiological signals, such as the peak of the R wave in the electrocardiogram and the peak of the systolic wave of the photopletismogram, is a fundamental step for the quantification of clinical parameters, such as the pulse transit time. In this work, we presented a novel neural architecture, called eMTUnet, to automate point identification in multivariate signals acquired with a chest-worn device. The eMTUnet consists of a single deep network capable of performing three tasks simultaneously: (i) localization in time of characteristic points (labeling task), (ii) evaluation of the quality of signals (classification task); (iii) estimation of the reliability of classification (reliability task). Preliminary results in overnight monitoring showcased the ability to detect characteristic points in the four signals with a recall index of about 1.00, 0.90, 0.90, and 0.80, respectively. The accuracy of the signal quality classification was about 0.90, on average over four different classes. The average confidence of the correctly classified signals, against the misclassifications, was 0.93 vs. 0.52, proving the worthiness of the confidence index, which may better qualify the point identification. From the achieved outcomes, we point out that high-quality segmentation and classification are both ensured, which brings the use of a multi-modal framework, composed of wearable sensors and artificial intelligence, incrementally closer to clinical translation.

Computer Audition for Fighting the SARS-CoV-2 Corona Crisis-Introducing the Multitask Speech Corpus for COVID-19

Computer audition (CA) has experienced a fast development in the past decades by leveraging advanced signal processing and machine learning techniques. In particular, for its noninvasive and ubiquitous character by nature, CA-based applications in healthcare have increasingly attracted attention in recent years. During the tough time of the global crisis caused by the coronavirus disease 2019 (COVID-19), scientists and engineers in data science have collaborated to think of novel ways in prevention, diagnosis, treatment, tracking, and management of this global pandemic. On the one hand, we have witnessed the power of 5G, Internet of Things, big data, computer vision, and artificial intelligence in applications of epidemiology modeling, drug and/or vaccine finding and designing, fast CT screening, and quarantine management. On the other hand, relevant studies in exploring the capacity of CA are extremely lacking and underestimated. To this end, we propose a novel multitask speech corpus for COVID-19 research usage. We collected 51 confirmed COVID-19 patients' in-the-wild speech data in Wuhan city, China. We define three main tasks in this corpus, i.e., three-category classification tasks for evaluating the physical and/or mental status of patients, i.e., sleep quality, fatigue, and anxiety. The benchmarks are given by using both classic machine learning methods and state-of-the-art deep learning techniques. We believe this study and corpus cannot only facilitate the ongoing research on using data science to fight against COVID-19, but also the monitoring of contagious diseases for general purpose.

Transferring Cross-Corpus Knowledge: An Investigation on Data Augmentation for Heart Sound Classification

Human auscultation has been regarded as a cheap, convenient and efficient method for the diagnosis of cardiovascular diseases. Nevertheless, training professional auscultation skills needs tremendous efforts and is time-consuming. Computer audition (CA) that leverages the power of advanced machine learning and signal processing technologies has increasingly attracted contributions to the field of automatic heart sound classification. While previous studies have shown promising results in CA based heart sound classification with the 'shuffle split' method, machine learning for heart sound classification decreases in accuracy with a cross-corpus test dataset. We investigate this problem with a cross-corpus evaluation using the PhysioNet CinC Challenge 2016 Dataset and propose a new combination of data augmentation techniques that leads to a CNN robust for such cross-corpus evaluation. Compared with the baseline, which is given without augmentation, our data augmentation techniques combined improve by 20.0 % the sensitivity and by 7.9 % the specificity on average across 6 databases, which is a significant difference on 4 out of these (p < .05 by one-tailed z-test).