Neonatal Heart and Lung Sound Quality Assessment for Robust Heart and Breathing Rate Estimation for Telehealth Applications

NeoSSNet: Real-Time Neonatal Chest Sound Separation Using Deep Learning

Goal: Auscultation for neonates is a simple and non-invasive method of diagnosing cardiovascular and respiratory disease. However, obtaining high-quality chest sounds containing only heart or lung sounds is non-trivial. Hence, this study introduces a new deep-learning model named NeoSSNet and evaluates its performance in neonatal chest sound separation with previous methods. Methods: We propose a masked-based architecture similar to Conv-TasNet. The encoder and decoder consist of 1D convolution and 1D transposed convolution, while the mask generator consists of a convolution and transformer architecture. The input chest sounds were first encoded as a sequence of tokens using 1D convolution. The tokens were then passed to the mask generator to generate two masks, one for heart sounds and one for lung sounds. Each mask is then applied to the input token sequence. Lastly, the tokens are converted back to waveforms using 1D transposed convolution. Results: Our proposed model showed superior results compared to the previous methods based on objective distortion measures, ranging from a 2.01 dB improvement to a 5.06 dB improvement. The proposed model is also significantly faster than the previous methods, with at least a 17-time improvement. Conclusions: The proposed model could be a suitable preprocessing step for any health monitoring system where only the heart sound or lung sound is desired.

Quality Indices and Outcomes of a Neonatology Telerounding Program in a Level II Neonatal Intensive Care Unit: Single-Center Experience during the COVID-19 Pandemic

OBJECTIVE

The objective of this program evaluation was to describe the outcomes of daily neonatologist telerounding with the onsite advanced practice provider (APP) in a Level II neonatal intensive care unit (NICU), before and during the coronavirus disease 2019 (COVID-19) pandemic.

STUDY DESIGN

Bedside telerounding occurred with an onsite APP using a telehealth cart and paired Bluetooth stethoscope. Data collected by longitudinal and cross-sectional surveys and chart review before (May 2019-February 2020) and during (March 2020-February 2021) the COVID-19 pandemic were analyzed using descriptive statistics and thematic analysis.

RESULTS

A total of 258 patients were admitted to the Level II NICU before (May 2019-February 2020) and during (March 2020-February 2021) the COVID-19 pandemic. Demographic characteristics and outcomes, including breastfeeding at discharge and length of stay were similar pre- and postonset of the COVID-19 pandemic. Postrounding surveys by 10 (response rate 83%) neonatologists indicated parents were present in 80 (77%) of rounds and video was at least somewhat helpful in 94% of cases. Cross-sectional survey responses of 23 neonatologists and APPs (response rate 62%) indicated satisfaction with the program. Common themes on qualitative analysis of open-ended survey responses were "need for goodness of fit" and "another set of eyes" and "opportunities for use."

CONCLUSION

Daily telerounding with neonatologists and APPs in a Level II NICU supported neonatal care. Quality metrics and clinical outcomes are described with no differences seen before and during the COVID-19 pandemic.

KEY POINTS

· Little is known about Level II NICU quality metrics and outcomes.. · Daily bedside telerounding with neonatologists and APPs is described.. · Telerounding supported neonatal care before and during the COVID-19 pandemic.. · Neonatologists found visual exam helpful in the majority of cases.. · No differences in NICU clinical outcomes were seen during the COVID-19 pandemic..

A deep learning framework for noninvasive fetal ECG signal extraction

Introduction: The availability of proactive techniques for health monitoring is essential to reducing fetal mortality and avoiding complications in fetal wellbeing. In harsh circumstances such as pandemics, earthquakes, and low-resource settings, the incompetence of many healthcare systems worldwide in providing essential services, especially for pregnant women, is critical. Being able to continuously monitor the fetus in hospitals and homes in a direct and fast manner is very important in such conditions. Methods: Monitoring the health of the baby can potentially be accomplished through the computation of vital bio-signal measures using a clear fetal electrocardiogram (ECG) signal. The aim of this study is to develop a framework to detect and identify the R-peaks of the fetal ECG directly from a 12 channel abdominal composite signal. Thus, signals were recorded noninvasively from 70 pregnant (healthy and with health conditions) women with no records of fetal abnormalities. The proposed model employs a recurrent neural network architecture to robustly detect the fetal ECG R-peaks. Results: To test the proposed framework, we performed both subject-dependent (5-fold cross-validation) and independent (leave-one-subject-out) tests. The proposed framework achieved average accuracy values of 94.2% and 88.8%, respectively. More specifically, the leave-one-subject-out test accuracy was 86.7% during the challenging period of vernix caseosa layer formation. Furthermore, we computed the fetal heart rate from the detected R-peaks, and the demonstrated results highlight the robustness of the proposed framework. Discussion: This work has the potential to cater to the critical industry of maternal and fetal healthcare as well as advance related applications.

Monaural cardiopulmonary sound separation via complex-valued deep autoencoder and cyclostationarity

Objective.Cardiopulmonary auscultation is promising to get smart due to the emerging of electronic stethoscopes. Cardiac and lung sounds often appear mixed at both time and frequency domain, hence deteriorating the auscultation quality and the further diagnosis performance. The conventional cardiopulmonary sound separation methods may be challenged by the diversity in cardiac/lung sounds. In this study, the data-driven feature learning advantage of deep autoencoder and the common quasi-cyclostationarity characteristic are exploited for monaural separation.Approach.Different from most of the existing separation methods that only handle the amplitude of short-time Fourier transform (STFT) spectrum, a complex-valued U-net (CUnet) with deep autoencoder structure, is built to fully exploit both the amplitude and phase information. As a common characteristic of cardiopulmonary sounds, quasi-cyclostationarity of cardiac sound is involved in the loss function for training.Main results. In experiments to separate cardiac/lung sounds for heart valve disorder auscultation, the averaged achieved signal distortion ratio (SDR), signal interference ratio (SIR), and signal artifact ratio (SAR) in cardiac sounds are 7.84 dB, 21.72 dB, and 8.06 dB, respectively. The detection accuracy of aortic stenosis can be raised from 92.21% to 97.90%.Significance. The proposed method can promote the cardiopulmonary sound separation performance, and may improve the detection accuracy for cardiopulmonary diseases.

Model for Predicting Complications of Hemodialysis Patients Using Data From the Internet of Medical Things and Electronic Medical Records

Intelligent models for predicting hemodialysis-related complications, i.e., hypotension and the deterioration of the quality or obstruction of the AV fistula, based on machine learning (ML) methods were established to offer early warnings to medical staff and give them enough time to provide pre-emptive treatment. A novel integration platform collected data from the Internet of Medical Things (IoMT) at a dialysis center and inspection results from electronic medical records (EMR) to train ML algorithms and build models. The selection of the feature parameters was implemented using Pearson's correlation method. Then, the eXtreme Gradient Boost (XGBoost) algorithm was chosen to create the predictive models and optimize the feature choice. 75% of collected data are used as a training dataset and the other 25% are used as a testing dataset. We adopted the prediction precision and recall rate of hypotension and AV fistula obstruction to measure the effectiveness of the predictive models. These rates were sufficiently high at approximately 71%-90%. In the context of hemodialysis, hypotension and the deterioration of the quality or obstruction of the arteriovenous (AV) fistula affect treatment quality and patient safety and may lead to a poor prognosis. Our prediction models with high accuracies can provide excellent references and signals for clinical healthcare service providers. Clinical and Translational Impact Statement-With the integrated dataset collected from IoMT and EMR, the superior predictive results of our models for complications of hemodialysis patients are demonstrated. We believe, after enough clinical tests are implemented as planned, these models can assist the healthcare team in making appropriate preparations in advance or adjusting the medical procedures to avoid these adverseevents.

Artificial intelligence-driven wearable technologies for neonatal cardiorespiratory monitoring: Part 1 wearable technology

With the development of Artificial Intelligence techniques, smart health monitoring is becoming more popular. In this study, we investigate the trend of wearable sensors being adopted and developed in neonatal cardiorespiratory monitoring. We performed a search of papers published from the year 2000 onwards. We then reviewed the advances in sensor technologies and wearable modalities for this application. Common wearable modalities included clothing (39%); chest/abdominal belts (25%); and adhesive patches (15%). Popular singular physiological information from sensors included electrocardiogram (15%), breathing (24%), oxygen saturation and photoplethysmography (13%). Many studies (46%) incorporated a combination of these signals. There has been extensive research in neonatal cardiorespiratory monitoring using both single and multi-parameter systems. Poor data quality is a common issue and further research into combining multi-sensor information to alleviate this should be investigated. IMPACT STATEMENT: State-of-the-art review of sensor technology for wearable neonatal cardiorespiratory monitoring. Review of the designs for wearable neonatal cardiorespiratory monitoring. The use of multi-sensor information to improve physiological data quality has been limited in past research. Several sensor technologies have been implemented and tested on adults that have yet to be explored in the newborn population.

Edge-Enabled Heart Rate Estimation from Multisensor PPG Signals

Heart rate (HR) estimation from multisensor PPG signals suffers from the dilemma of inconsistent computation results, due to the prevalence of bio-artifacts (BAs). Furthermore, advancements in edge computing have shown promising results from capturing and processing diversified types of sensing signals using the devices of Internet of Medical Things (IoMT). In this paper, an edge-enabled method is proposed to estimate HRs accurately and with low latency from multisensor PPG signals captured by bilateral IoMT devices. First, we design a real-world edge network with several resource-constrained devices, divided into collection edge nodes and computing edge nodes. Second, a self-iteration RR interval calculation method, at the collection edge nodes, is proposed leveraging the inherent frequency spectrum feature of PPG signals and preliminarily eliminating the influence of BAs on HR estimation. Meanwhile, this part also reduces the volume of sent data from IoMT devices to compute edge nodes. Afterward, at the computing edge nodes, a heart rate pool with an unsupervised abnormal detection method is proposed to estimate the average HR. Experimental results show that the proposed method outperforms traditional approaches which rely on a single PPG signal, attaining better results in terms of the consistency and accuracy for HR estimation. Furthermore, at the designed edge network, our proposed method processes a 30 s PPG signal to obtain an HR, consuming only 4.24 s of computation time. Hence, the proposed method is of significant value for the low-latency applications in the field of IoMT healthcare and fitness management.

Artificial intelligence-driven wearable technologies for neonatal cardiorespiratory monitoring. Part 2: artificial intelligence

BACKGROUND

With the development of Artificial Intelligence (AI) techniques, smart health monitoring, particularly neonatal cardiorespiratory monitoring with wearable devices, is becoming more popular. To this end, it is crucial to investigate the trend of AI and wearable sensors being developed in this domain.

METHODS

We performed a review of papers published in IEEE Xplore, Scopus, and PubMed from the year 2000 onwards, to understand the use of AI for neonatal cardiorespiratory monitoring with wearable technologies. We reviewed the advances in AI development for this application and potential future directions. For this review, we assimilated machine learning (ML) algorithms developed for neonatal cardiorespiratory monitoring, designed a taxonomy, and categorised the methods based on their learning capabilities and performance.

RESULTS

For AI related to wearable technologies for neonatal cardio-respiratory monitoring, 63% of studies utilised traditional ML techniques and 35% utilised deep learning techniques, including 6% that applied transfer learning on pre-trained models.

CONCLUSIONS

A detailed review of AI methods for neonatal cardiorespiratory wearable sensors is presented along with their advantages and disadvantages. Hierarchical models and suggestions for future developments are highlighted to translate these AI technologies into patient benefit.

IMPACT

State-of-the-art review in artificial intelligence used for wearable neonatal cardiorespiratory monitoring. Taxonomy design for artificial intelligence methods. Comparative study of AI methods based on their advantages and disadvantages.

SPRSound: Open-Source SJTU Paediatric Respiratory Sound Database

It has proved that the auscultation of respiratory sound has advantage in early respiratory diagnosis. Various methods have been raised to perform automatic respiratory sound analysis to reduce subjective diagnosis and physicians' workload. However, these methods highly rely on the quality of respiratory sound database. In this work, we have developed the first open-access paediatric respiratory sound database, SPRSound. The database consists of 2,683 records and 9,089 respiratory sound events from 292 participants. Accurate label is important to achieve a good prediction for adventitious respiratory sound classification problem. A custom-made sound label annotation software (SoundAnn) has been developed to perform sound editing, sound annotation, and quality assurance evaluation. A team of 11 experienced paediatric physicians is involved in the entire process to establish golden standard reference for the dataset. To verify the robustness and accuracy of the classification model, we have investigated the effects of different feature extraction methods and machine learning classifiers on the classification performance of our dataset. As such, we have achieved a score of 75.22%, 61.57%, 56.71%, and 37.84% for the four different classification challenges at the event level and record level.

Prediction of Neonatal Respiratory Distress in Term Babies at Birth from Digital Stethoscope Recorded Chest Sounds

Neonatal respiratory distress is a common condition that if left untreated, can lead to short- and long-term complications. This paper investigates the usage of digital stethoscope recorded chest sounds taken within 1 min post-delivery, to enable early detection and prediction of neonatal respiratory distress. Fifty-one term newborns were included in this study, 9 of whom developed respiratory distress. For each newborn, 1 min anterior and posterior recordings were taken. These recordings were pre-processed to remove noisy segments and obtain high-quality heart and lung sounds. The random undersampling boosting (RUSBoost) classifier was then trained on a variety of features, such as power and vital sign features extracted from the heart and lung sounds. The RUSBoost algorithm produced specificity, sensitivity, and accuracy results of 85.0%, 66.7% and 81.8%, respectively. Clinical relevance--- This paper investigates the feasibility of digital stethoscope recorded chest sounds for early detection of respiratory distress in term newborn babies, to enable timely treatment and management.

Assessing Hemorrhagic Shock Severity Using the Second Heart Sound Determined from Phonocardiogram: A Novel Approach

Introduction: Hemorrhagic shock (HS) is a severe medical emergency. Early diagnosis of HS is important for clinical treatment. In this paper, we report a flexible material-based heart sound monitoring device which can evaluate the degree of HS through a phonocardiogram (PCG) change. Methods: Progressive hemorrhage treatments (H1, H2, and H3 stage) were used in swine to build animal models. The PCG sensor was mounted on the chest of the swine. Routine monitoring was used at the same time. Results: This study showed that arterial blood pressure decreased significantly from the H1 phase, while second heart sound amplitude (S2A) and energy (S2E) decreased significantly from the H2 phase. Both S2A and S2E correlated well with BP (p < 0.001). The heart rate, pulse pressure variation and serum hemoglobin level significantly changed in the H3 stage (p < 0.05). Discussion: The change of second heart sound (S2) was at the H2 stage and was earlier than routine monitoring methods. Therefore, PCG change may be a new indicator for the early detection of HS severity.

Automated Assessment of the Quality of Phonocardographic Recordings through Signal-to-Noise Ratio for Home Monitoring Applications

The signal quality limits the applicability of phonocardiography at the patients’ domicile. This work proposes the signal-to-noise ratio of the recorded signal as its main quality metrics. Moreover, we define the minimum acceptable values of the signal-to-noise ratio that warrantee an accuracy of the derived parameters acceptable in clinics. We considered 25 original heart sounds recordings, which we corrupted by adding noise to decrease their signal-to-noise ratio. We found that a signal-to-noise ratio equal to or higher than 14 dB warrants an uncertainty of the estimate of the valve closure latencies below 1 ms. This accuracy is higher than that required by most clinical applications. We validated the proposed method against a public database, obtaining results comparable to those obtained on our sample population. In conclusion, we defined (a) the signal-to-noise ratio of the phonocardiographic signal as the preferred metric to evaluate its quality and (b) the minimum values of the signal-to-noise ratio required to obtain an uncertainty of the latency of heart sound components compatible with clinical applications. We believe these results are crucial for the development of home monitoring systems aimed at preventing acute episodes of heart failure and that can be safely operated by naïve users.