Signal feature extraction by multi-scale PCA and its application to respiratory sound classification

Digital Pulmonology Practice with Phonopulmography Leveraging Artificial Intelligence: Future Perspectives Using Dual Microwave Acoustic Sensing and Imaging

Respiratory disorders, being one of the leading causes of disability worldwide, account for constant evolution in management technologies, resulting in the incorporation of artificial intelligence (AI) in the recording and analysis of lung sounds to aid diagnosis in clinical pulmonology practice. Although lung sound auscultation is a common clinical practice, its use in diagnosis is limited due to its high variability and subjectivity. We review the origin of lung sounds, various auscultation and processing methods over the years and their clinical applications to understand the potential for a lung sound auscultation and analysis device. Respiratory sounds result from the intra-pulmonary collision of molecules contained in the air, leading to turbulent flow and subsequent sound production. These sounds have been recorded via an electronic stethoscope and analyzed using back-propagation neural networks, wavelet transform models, Gaussian mixture models and recently with machine learning and deep learning models with possible use in asthma, COVID-19, asbestosis and interstitial lung disease. The purpose of this review was to summarize lung sound physiology, recording technologies and diagnostics methods using AI for digital pulmonology practice. Future research and development in recording and analyzing respiratory sounds in real time could revolutionize clinical practice for both the patients and the healthcare personnel.

A smartphone-based algorithm comprising cough analysis and patient-reported symptoms identifies acute exacerbations of asthma: a prospective, double blind, diagnostic accuracy study

Objective: Early and accurate recognition of asthma exacerbations reduces the duration and risk of hospitalization. Current diagnostic methods depend upon patient recognition of symptoms, expert clinical examination, or measures of lung function. Here, we aimed to develop and test the accuracy of a smartphone-based diagnostic algorithm that analyses five cough events and five patient-reported features (age, fever, acute or productive cough and wheeze) to detect asthma exacerbations.Methods: We conducted a double-blind, prospective, diagnostic accuracy study comparing the algorithm with expert clinical opinion and formal lung function testing. Results: One hundred nineteen participants >12 years with a physician-diagnosed history of asthma were recruited from a hospital in Perth, Western Australia: 46 with clinically confirmed asthma exacerbations, 73 with controlled asthma. The groups were similar in median age (54yr versus 60yr, p=0.72) and sex (female 76% versus 70%, p=0.5). The algorithm's positive percent agreement (PPA) with the expert clinical diagnosis of asthma exacerbations was 89% [95% CI: 76%, 96%]. The negative percent agreement (NPA) was 84% [95% CI: 73%, 91%]. The algorithm's performance for asthma exacerbations diagnosis exceeded its performance as a detector of patient-reported wheeze (sensitivity, 63.7%). Patient-reported wheeze in isolation was an insensitive marker of asthma exacerbations (PPA=53.8%, NPA=49%). Conclusions: Our diagnostic algorithm accurately detected the presence of an asthma exacerbation as a point-of-care test without requiring clinical examination or lung function testing. This method could improve the accuracy of telehealth consultations and might be helpful in Asthma Action Plans and patient-initiated therapy.

Abnormal Respiratory Sounds Classification Using Deep CNN Through Artificial Noise Addition

Respiratory sound (RS) attributes and their analyses structure a fundamental piece of pneumonic pathology, and it gives symptomatic data regarding a patient's lung. A couple of decades back, doctors depended on their hearing to distinguish symptomatic signs in lung audios by utilizing the typical stethoscope, which is usually considered a cheap and secure method for examining the patients. Lung disease is the third most ordinary cause of death worldwide, so; it is essential to classify the RS abnormality accurately to overcome the death rate. In this research, we have applied Fourier analysis for the visual inspection of abnormal respiratory sounds. Spectrum analysis was done through Artificial Noise Addition (ANA) in conjunction with different deep convolutional neural networks (CNN) to classify the seven abnormal respiratory sounds—both continuous (CAS) and discontinuous (DAS). The proposed framework contains an adaptive mechanism of adding a similar type of noise to unhealthy respiratory sounds. ANA makes sound features enough reach to be identified more accurately than the respiratory sounds without ANA. The obtained results using the proposed framework are superior to previous techniques since we simultaneously considered the seven different abnormal respiratory sound classes.

Identifying acute exacerbations of chronic obstructive pulmonary disease using patient-reported symptoms and cough feature analysis

Acute exacerbations of chronic obstructive pulmonary disease (AECOPD) are commonly encountered in the primary care setting, though the accurate and timely diagnosis is problematic. Using technology like that employed in speech recognition technology, we developed a smartphone-based algorithm for rapid and accurate diagnosis of AECOPD. The algorithm incorporates patient-reported features (age, fever, and new cough), audio data from five coughs and can be deployed by novice users. We compared the accuracy of the algorithm to expert clinical assessment. In patients with known COPD, the algorithm correctly identified the presence of AECOPD in 82.6% (95% CI: 72.9–89.9%) of subjects (n = 86). The absence of AECOPD was correctly identified in 91.0% (95% CI: 82.4–96.3%) of individuals (n = 78). The diagnostic agreement was maintained in milder cases of AECOPD (PPA: 79.2%, 95% CI: 68.0–87.8%), who typically comprise the cohort presenting to primary care. The algorithm may aid early identification of AECOPD and be incorporated in patient self-management plans.

Multi-Time-Scale Features for Accurate Respiratory Sound Classification

The COVID-19 pandemic has amplified the urgency of the developments in computer-assisted medicine and, in particular, the need for automated tools supporting the clinical diagnosis and assessment of respiratory symptoms. This need was already clear to the scientific community, which launched an international challenge in 2017 at the International Conference on Biomedical Health Informatics (ICBHI) for the implementation of accurate algorithms for the classification of respiratory sound. In this work, we present a framework for respiratory sound classification based on two different kinds of features: (i) short-term features which summarize sound properties on a time scale of tenths of a second and (ii) long-term features which assess sounds properties on a time scale of seconds. Using the publicly available dataset provided by ICBHI, we cross-validated the classification performance of a neural network model over 6895 respiratory cycles and 126 subjects. The proposed model reached an accuracy of 85%±3% and an precision of 80%±8%, which compare well with the body of literature. The robustness of the predictions was assessed by comparison with state-of-the-art machine learning tools, such as the support vector machine, Random Forest and deep neural networks. The model presented here is therefore suitable for large-scale applications and for adoption in clinical practice. Finally, an interesting observation is that both short-term and long-term features are necessary for accurate classification, which could be the subject of future studies related to its clinical interpretation.

Non-contact incipient fault diagnosis method of fixed-axis gearbox based on CEEMDAN

Gearbox plays most essential role in the modern machinery for transmitting the required torque along with motion and contributes to wide range of applications. Any failure in gearbox components affects the productivity and efficiency of the system. Most machine breakdowns related to gears are a result of improper operating conditions and loading, hence lead to failure of the whole mechanism. Ensemble Empirical Mode Decomposition (EEMD) comprises advancement and valuable addition in Empirical Mode Decomposition (EMD) and has been widely used in fault detection of rotating machines. However, intrinsic mode functions (IMFs) produced by EEMD often carry the residual noise. Also, the produced IMFs are different in number due to addition of white Gaussian noise, which leads to final averaging problem. To alleviate these drawbacks, Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN) was previously presented. This paper describes and presents the implementation of CEEMDAN for fault diagnosis of simulated local defects using sound signals in a fixed-axis gearbox. Statistical parameters are extracted from decomposed sound signals for different simulated faults. Results show the effectiveness of CEEMDAN over EEMD in order to obtain more accurate IMFs and fault severity.

Automatic adventitious respiratory sound analysis: A systematic review

Background

Automatic detection or classification of adventitious sounds is useful to assist physicians in diagnosing or monitoring diseases such as asthma, Chronic Obstructive Pulmonary Disease (COPD), and pneumonia. While computerised respiratory sound analysis, specifically for the detection or classification of adventitious sounds, has recently been the focus of an increasing number of studies, a standardised approach and comparison has not been well established.

Objective

To provide a review of existing algorithms for the detection or classification of adventitious respiratory sounds. This systematic review provides a complete summary of methods used in the literature to give a baseline for future works.

Data sources

A systematic review of English articles published between 1938 and 2016, searched using the Scopus (1938-2016) and IEEExplore (1984-2016) databases. Additional articles were further obtained by references listed in the articles found. Search terms included adventitious sound detection, adventitious sound classification, abnormal respiratory sound detection, abnormal respiratory sound classification, wheeze detection, wheeze classification, crackle detection, crackle classification, rhonchi detection, rhonchi classification, stridor detection, stridor classification, pleural rub detection, pleural rub classification, squawk detection, and squawk classification.

Study selection

Only articles were included that focused on adventitious sound detection or classification, based on respiratory sounds, with performance reported and sufficient information provided to be approximately repeated.

Data extraction

Investigators extracted data about the adventitious sound type analysed, approach and level of analysis, instrumentation or data source, location of sensor, amount of data obtained, data management, features, methods, and performance achieved.

Data synthesis

A total of 77 reports from the literature were included in this review. 55 (71.43%) of the studies focused on wheeze, 40 (51.95%) on crackle, 9 (11.69%) on stridor, 9 (11.69%) on rhonchi, and 18 (23.38%) on other sounds such as pleural rub, squawk, as well as the pathology. Instrumentation used to collect data included microphones, stethoscopes, and accelerometers. Several references obtained data from online repositories or book audio CD companions. Detection or classification methods used varied from empirically determined thresholds to more complex machine learning techniques. Performance reported in the surveyed works were converted to accuracy measures for data synthesis.

Limitations

Direct comparison of the performance of surveyed works cannot be performed as the input data used by each was different. A standard validation method has not been established, resulting in different works using different methods and performance measure definitions.

Conclusion

A review of the literature was performed to summarise different analysis approaches, features, and methods used for the analysis. The performance of recent studies showed a high agreement with conventional non-automatic identification. This suggests that automated adventitious sound detection or classification is a promising solution to overcome the limitations of conventional auscultation and to assist in the monitoring of relevant diseases.

The attractor recurrent neural network based on fuzzy functions: An effective model for the classification of lung abnormalities

The respiratory system dynamic is of high significance when it comes to the detection of lung abnormalities, which highlights the importance of presenting a reliable model for it. In this paper, we introduce a novel dynamic modelling method for the characterization of the lung sounds (LS), based on the attractor recurrent neural network (ARNN). The ARNN structure allows the development of an effective LS model. Additionally, it has the capability to reproduce the distinctive features of the lung sounds using its formed attractors. Furthermore, a novel ARNN topology based on fuzzy functions (FFs-ARNN) is developed. Given the utility of the recurrent quantification analysis (RQA) as a tool to assess the nature of complex systems, it was used to evaluate the performance of both the ARNN and the FFs-ARNN models. The experimental results demonstrate the effectiveness of the proposed approaches for multichannel LS analysis. In particular, a classification accuracy of 91% was achieved using FFs-ARNN with sequences of RQA features.

Wavelet PCA for automatic identification of walking with and without an exoskeleton on a treadmill using pressure and accelerometer sensors

Nowadays portable devices with more number of sensors are used for gait assessment and monitoring for elderly and disabled. However, the problem with using multiple sensors is that if they are placed on the same platform or base, there could be cross talk between them, which could change the signal amplitude or add noise to the signal. Hence, this study uses wavelet PCA as a signal processing technique to separate the original sensor signal from the signal obtained from the sensors through the integrated unit to compare the two types of walking (with and without an exoskeleton). This comparison using wavelet PCA will enable the researchers to obtain accurate sensor data and compare and analyze the data in order to further improve the design of compact portable devices used to monitor and assess the gait in stroke or paralyzed subjects. The advantage of designing such systems is that they can also be used to assess and monitor the gait of the stroke subjects at home, which will save them time and efforts to visit the laboratory or clinic.

Multiparametric modeling of the ineffective efforts in assisted ventilation within an ICU

In the context of assisted ventilation in ICU, it is of vital importance to keep a high synchronization between the patient's attempt to breath and the assisted ventilation event, so that the patient receives the ventilation support requested. In this work, experimental equipment is employed, which allows for unobtrusive and continuous monitoring of a multiple relevant bioparameters. These are meant to guide the medical professionals in appropriately adapting the treatment and fine-tune the ventilation. However, synchronization phenomena of different origin (neurological, mechanical, ventilation parameters) may occur, which vary among patients, and during the course of monitoring of a single patient, the timely recognition of which is challenging even for experts. The dynamics and complex causal relations among bioparameters and the ventilation synchronization are not well studied. The purpose of this work is to elaborate on a methodology toward modeling the ventilation synchronization failures based on the evolution of monitored bioparameters. Principal component analysis is employed for the transformation into a small number of features and the investigation of repeating patterns and clusters within measurements. Using these features, nonlinear prediction models based on support vector machines regression are explored, in terms of what past knowledge is required and what is the future horizon that can be predicted. The proposed model shows good correlation (over 0.74) with the actual outputs, constituting an encouraging step toward understanding of ICU ventilation dynamic phenomena.

Artificial intelligence techniques used in respiratory sound analysis--a systematic review

Artificial intelligence (AI) has recently been established as an alternative method to many conventional methods. The implementation of AI techniques for respiratory sound analysis can assist medical professionals in the diagnosis of lung pathologies. This article highlights the importance of AI techniques in the implementation of computer-based respiratory sound analysis. Articles on computer-based respiratory sound analysis using AI techniques were identified by searches conducted on various electronic resources, such as the IEEE, Springer, Elsevier, PubMed, and ACM digital library databases. Brief descriptions of the types of respiratory sounds and their respective characteristics are provided. We then analyzed each of the previous studies to determine the specific respiratory sounds/pathology analyzed, the number of subjects, the signal processing method used, the AI techniques used, and the performance of the AI technique used in the analysis of respiratory sounds. A detailed description of each of these studies is provided. In conclusion, this article provides recommendations for further advancements in respiratory sound analysis.

Automatic Differentiation of Normal and Continuous Adventitious Respiratory Sounds Using Ensemble Empirical Mode Decomposition and Instantaneous Frequency

Differentiating normal from adventitious respiratory sounds (RS) is a major challenge in the diagnosis of pulmonary diseases. Particularly, continuous adventitious sounds (CAS) are of clinical interest because they reflect the severity of certain diseases. This study presents a new classifier that automatically distinguishes normal sounds from CAS. It is based on the multiscale analysis of instantaneous frequency (IF) and envelope (IE) calculated after ensemble empirical mode decomposition (EEMD). These techniques have two major advantages over previous techniques: high temporal resolution is achieved by calculating IF-IE and a priori knowledge of signal characteristics is not required for EEMD. The classifier is based on the fact that the IF dispersion of RS signals markedly decreases when CAS appear in respiratory cycles. Therefore, CAS were detected by using a moving window to calculate the dispersion of IF sequences. The study dataset contained 1494 RS segments extracted from 870 inspiratory cycles recorded from 30 patients with asthma. All cycles and their RS segments were previously classified as containing normal sounds or CAS by a highly experienced physician to obtain a gold standard classification. A support vector machine classifier was trained and tested using an iterative procedure in which the dataset was randomly divided into training (65%) and testing (35%) sets inside a loop. The SVM classifier was also tested on 4592 simulated CAS cycles. High total accuracy was obtained with both recorded (94.6% ± 0.3%) and simulated (92.8% ± 3.6%) signals. We conclude that the proposed method is promising for RS analysis and classification.

Proposing a Business Model in Healthcare Industry

In modern-day developing countries, there are certain key problems in the healthcare system that adds to a patient’s confusion. An example of these difficulties relates to choosing an appropriate medical specialty and among specialists. Owing to the lack of structural healthcare services, there is the need for guidance in selecting the most appropriate diagnosis and medicine for patients with various symptoms or physical disabilities, the need to educate patients on self-treatment procedures, the need to reduce the high cost of treatment and diagnosis, the need to address boring procedures of diagnosis and treatment, the lack of adequate strategic planning due to the absence of valuable information about patients, the problems connected with unnecessary traffic congestion, and many more. Together, these problems create a great opportunity for the expert analysts to ameliorate the healthcare system in these countries by applying new methods, such as using web-based programs and data mining (DM). This article focuses on the use of software, healthcare data warehouse and the application of DM to generate models for solving the aforementioned problems.

Computer-aided diagnosis of pneumonia in patients with chronic obstructive pulmonary disease

BACKGROUND

Early diagnosis of pneumonia and discrimination between this disease and chronic obstructive pulmonary disease (COPD) exacerbations in patients with COPD are crucial for optimal clinical management and treatment.

OBJECTIVES

To examine the use of computerized analysis of respiratory sounds, a hybrid system based on principal component analysis (PCA) and probabilistic neural networks (PNNs), to aid the detection of coexisting pneumonia in patients with COPD.

METHODS AND MATERIALS

A convenience sample of 58 patients with COPD (25 patients hospitalized for community-acquired pneumonia and 33 owing to acute exacerbation of COPD) was studied. Auscultations were performed by the patients themselves on their suprasternal notch. Short-time Fourier transform analysis was used to extract features from the recorded respiratory sounds, PCA was selected for dimensionality reduction and a PNN was trained as classifier. 10-Fold cross-validation and receiver operating characteristic curve analysis were used to estimate the system performance.

RESULTS

Based on the cross-validation results, a sensitivity and a specificity of 72% and 81.8%, respectively, were achieved in validation data. The operating point was selected to maximize the specificity and sensitivity pair in the training set.

DISCUSSION

The results strongly suggest that electronic self-auscultation at a single location (suprasternal notch) can support diagnosis of pneumonia in patients with COPD.

CONCLUSIONS

A simple, cost-effective method has been proposed to aid decision-making in areas with no radiological facilities available and in resource-constrained settings, and could have a great diagnostic impact on telemedicine applications.

Estimation of instantaneous frequency from empirical mode decomposition on respiratory sounds analysis

Instantaneous frequency (IF) calculated by empirical mode decomposition (EMD) provides a novel approach to analyze respiratory sounds (RS). Traditionally, RS have been analyzed using classical time-frequency distributions, such as short-time Fourier transform (STFT) or wavelet transform (WT). However, EMD has become a powerful tool for nonlinear and non-stationary data analysis. IF estimated by EMD has two major advantages: its high temporal resolution and the fact that a priori knowledge of the signal characteristics is not required. In this study, we have estimated IF by EMD on real RS signals in order to identify continuous adventitious sounds (CAS), such as wheezes, within inspiratory sounds cycles. We show that there are differences in IF distribution among frequency scales of RS signal when CAS are within RS. Therefore, a new method for RS analysis and classification may be developed by combining both EMD and IF.