1
|
Kallonen A, Juutinen M, Värri A, Carrault G, Pladys P, Beuchée A. Early detection of late-onset neonatal sepsis from noninvasive biosignals using deep learning: A multicenter prospective development and validation study. Int J Med Inform 2024; 184:105366. [PMID: 38330522 DOI: 10.1016/j.ijmedinf.2024.105366] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2023] [Revised: 01/15/2024] [Accepted: 01/31/2024] [Indexed: 02/10/2024]
Abstract
BACKGROUND Neonatal sepsis is responsible for significant morbidity and mortality worldwide. Its accurate and timely diagnosis is hindered by vague symptoms and the urgent necessity for early antibiotic intervention. The gold standard for diagnosing the condition is the identification of a pathogenic organism from normally sterile sites via laboratory testing. However, this method is resource-intensive and cannot be conducted continuously. OBJECTIVE This study aimed to predict the onset of late-onset sepsis (LOS) with good diagnostic value as early as possible using non-invasive biosignal measurements from neonatal intensive care unit (NICU) monitors. METHODS In this prospective multicenter study, we developed a multimodal machine learning algorithm based on a convolutional neural network (CNN) structure that uses the power spectral density (PSD) of recorded biosignals to predict the onset of LOS. This approach aimed to discern LOS-related pathogenic spectral signatures without labor-intensive manual artifact removal. RESULTS The model achieved an area under the receiver operating characteristic score of 0.810 (95 % CI 0.698-0.922) on the validation dataset. With an optimal operating point, LOS detection had 83 % sensitivity and 73 % specificity. The median early detection was 44 h before clinical suspicion. The results highlighted the additive importance of electrocardiogram and respiratory impedance (RESP) signals in improving predictive accuracy. According to a more detailed analysis, the predictive power arose from the morphology of the electrocardiogram's R-wave and sudden changes in the RESP signal. CONCLUSION Raw biosignals from NICU monitors, in conjunction with PSD transformation, as input to the CNN, can provide state-of-the-art prediction performance for LOS without the need for artifact removal. To the knowledge of the authors, this is the first study to highlight the independent and additive predictive potential of electrocardiogram R-wave morphology and concurrent, sudden changes in the RESP waveform in predicting the onset of LOS using non-invasive biosignals.
Collapse
|
2
|
Prud'Homm J, Lemoine F, Abbas M, Carrault G, Somme D, Le Bouquin Jeannès R. A priori acceptability of a multimodal system for the early detection of frailty in older adults. Ing Rech Biomed 2023. [DOI: 10.1016/j.irbm.2023.100775] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/30/2023]
|
3
|
Taoum A, Bisiaux A, Tilquin F, Le Guillou Y, Carrault G. Validity of Ultra-Short-Term HRV Analysis Using PPG-A Preliminary Study. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22207995. [PMID: 36298346 PMCID: PMC9611389 DOI: 10.3390/s22207995] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/14/2022] [Revised: 10/17/2022] [Accepted: 10/18/2022] [Indexed: 05/26/2023]
Abstract
Continuous measurement of heart rate variability (HRV) in the short and ultra-short-term using wearable devices allows monitoring of physiological status and prevention of diseases. This study aims to evaluate the agreement of HRV features between a commercial device (Bora Band, Biosency) measuring photoplethysmography (PPG) and reference electrocardiography (ECG) and to assess the validity of ultra-short-term HRV as a surrogate for short-term HRV features. PPG and ECG recordings were acquired from 5 healthy subjects over 18 nights in total. HRV features include time-domain, frequency-domain, nonlinear, and visibility graph features and are extracted from 5 min 30 s and 1 min 30 s duration PPG recordings. The extracted features are compared with reference features of 5 min 30 s duration ECG recordings using repeated-measures correlation, Bland-Altman plots with 95% limits of agreements, Cliff's delta, and an equivalence test. Results showed agreement between PPG recordings and ECG reference recordings for 37 out of 48 HRV features in short-term durations. Sixteen of the forty-eight HRV features were valid and retained very strong correlations, negligible to small bias, with statistical equivalence in the ultra-short recordings (1 min 30 s). The current study concludes that the Bora Band provides valid and reliable measurement of HRV features in short and ultra-short duration recordings.
Collapse
|
4
|
Wu F, Wu J, Kong Y, Yang C, Yang G, Shu H, Carrault G, Senhadji L. Convolutional Modulation Theory: A bridge between Convolutional Neural Networks and Signal Modulation Theory. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.09.088] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
5
|
Ribeiro M, Castro L, Carrault G, Pladys P, Costa-Santos C, Henriques T. Evolution of Heart Rate Complexity Indices in the Early Detection of Neonatal Sepsis. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:367-372. [PMID: 36085905 DOI: 10.1109/embc48229.2022.9871274] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Despite advances in prenatal health care, neonatal sepsis remains a major cause of neonatal mortality. Early diagnosis and adequate treatment are essential to reduce morbidity and mortality related to this disease. In this paper, we propose a new method to detect neonatal sepsis based on heart rate (HR) complexity measures (entropy and compression indices) that takes into consideration neonatal gestational age. First, the percentile curves were computed for all the complexity indices using data from 118 control neonates. Eight indices were computed: the sample entropy (SampEn) and three indices to quantify the multiscale entropy (MSE) curve - the sum, the slope, and the product of the previous two - and the compression ratio (CR), using the bzip2 compressor, as well as the same three indices but related to the multiscale compression (MSC) curve. Then, the corresponding percentile was estimated for 23 sepsis neonates. Results show a significant decrease in the entropy indices SampEn and MSEsum and in the MSCslope a day before the detection of sepsis by the clinicians. The indices CR and MSCsum increased before the antibiotic take. These results imply that sepsis causes a random, uncorrelated pattern on the HR signal. Future studies should include a bigger data set to calculate a compound index comprising information of other physiological signals. Clinical Relevance - Prompt and accurate diagnosis of neona-tal sepsis is essential for the successful clinical management of neonates and significantly reduce morbidity and mortality. Complexity measures applied to the HR time series appear to detect sepsis in neonates starting one day before the clinical detection.
Collapse
|
6
|
Cabon S, Met-Montot B, Porée F, Rosec O, Simon A, Carrault G. Extraction of Premature Newborns' Spontaneous Cries in the Real Context of Neonatal Intensive Care Units. SENSORS 2022; 22:s22051823. [PMID: 35270967 PMCID: PMC8915127 DOI: 10.3390/s22051823] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/22/2021] [Revised: 02/21/2022] [Accepted: 02/22/2022] [Indexed: 11/29/2022]
Abstract
Cry analysis is an important tool to evaluate the development of preterm infants. However, the context of Neonatal Intensive Care Units is challenging, since a wide variety of sounds can occur (e.g., alarms and adult voices). In this paper, a method to extract cries is proposed. It is based on an initial segmentation between silence and sound events, followed by feature extraction on the resulting audio segments and a cry and non-cry classification. A database of 198 cry events coming from 21 newborns and 439 non-cry events was created. Then, a set of features—including Mel-Frequency Cepstral Coefficients—issued from principal component analysis, was computed to describe each audio segment. For the first time in cry analysis, noise was handled using harmonic plus noise analysis. Several machine learning models have been compared. The K-Nearest Neighbours approach showed the best results with a precision of 92.9%. To test the approach in a monitoring application, 412 h of recordings were automatically processed. The cries automatically selected were replayed and a precision of 92.2% was obtained. The impact of errors on the fundamental frequency characterisation was also studied. Results show that despite a difficult context, automatic cry extraction for non-invasive monitoring of vocal development of preterm infants is achievable.
Collapse
|
7
|
Cabon S, Weber R, Simon A, Pladys P, Poree F, Carrault G. Functional age estimation through neonatal motion characterization using continuous video recordings. IEEE J Biomed Health Inform 2022; PP. [PMID: 37015599 DOI: 10.1109/jbhi.2022.3230061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
The follow-up of the development of the premature baby is a major component of its clinical care since it has been shown that it can reveal a pathology. However, no method allowing an automated and continuous monitoring of this development has been proposed. Within the framework of the Digi-NewB European project, our team wishes to offer new clinical indices qualifying the maturation of newborns. In this study, we propose a new method to characterize motor activity from video recordings. For this purpose, we have chosen to characterize the motion temporal organization by drawing inspiration from sleep organization. Thus, we propose a fully automatic process allowing to extract motion features and to combine them to estimate a functional age. By investigating two datasets, one of 28.5 hours (manually annotated) from 33 newborns and one of 4,920 hours from 46 newborns, we show that the proposed approach is relevant for monitoring in clinical routine and that the extracted features reflect the maturation of preterm newborns. Indeed, a compact and interpretable model using gestational age and three motion features (mean duration of intervals with motion, total percentage of time spent in motion and number of intervals without motion) was designed to predict post-menstrual age of newborns and showed an admissible mean absolute error of 1.3 weeks. While the temporal organization of motion was not studied clinically due to a lack of technological means, these results open the door to new developments, new investigations and new knowledge on the evolution of motion in newborns.
Collapse
|
8
|
Lazazzera R, Laguna P, Gil E, Carrault G. Proposal for a Home Sleep Monitoring Platform Employing a Smart Glove. SENSORS 2021; 21:s21237976. [PMID: 34883979 PMCID: PMC8659764 DOI: 10.3390/s21237976] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/19/2021] [Revised: 11/21/2021] [Accepted: 11/23/2021] [Indexed: 11/16/2022]
Abstract
The present paper proposes the design of a sleep monitoring platform. It consists of an entire sleep monitoring system based on a smart glove sensor called UpNEA worn during the night for signals acquisition, a mobile application, and a remote server called AeneA for cloud computing. UpNEA acquires a 3-axis accelerometer signal, a photoplethysmography (PPG), and a peripheral oxygen saturation (SpO2) signal from the index finger. Overnight recordings are sent from the hardware to a mobile application and then transferred to AeneA. After cloud computing, the results are shown in a web application, accessible for the user and the clinician. The AeneA sleep monitoring activity performs different tasks: sleep stages classification and oxygen desaturation assessment; heart rate and respiration rate estimation; tachycardia, bradycardia, atrial fibrillation, and premature ventricular contraction detection; and apnea and hypopnea identification and classification. The PPG breathing rate estimation algorithm showed an absolute median error of 0.5 breaths per minute for the 32 s window and 0.2 for the 64 s window. The apnea and hypopnea detection algorithm showed an accuracy (Acc) of 75.1%, by windowing the PPG in one-minute segments. The classification task revealed 92.6% Acc in separating central from obstructive apnea, 83.7% in separating central apnea from central hypopnea and 82.7% in separating obstructive apnea from obstructive hypopnea. The novelty of the integrated algorithms and the top-notch cloud computing products deployed, encourage the production of the proposed solution for home sleep monitoring.
Collapse
|
9
|
Msaad S, Dillenseger JL, Cormier G, Carrault G. Detection of changes in the behaviour of the elderly person. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:6995-6998. [PMID: 34892713 DOI: 10.1109/embc46164.2021.9630971] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
In this paper, we propose a solution for detecting changes in the behaviour of the elderly person based on the monitoring of activities of daily living (ADL). The elderly person's daily routine is characterized by the following five indexes: 1) percentage of time lying down, 2) percentage of time sitting, 3) percentage of time standing, 4) percentage of time absent from home, and 5) number of falls during the day. In our framework, these indexes are computed using characteristics extracted from depth and thermal data. We hypothesize that elderly persons have a well-defined, regular life routine, organized around their environment, habits, and social relations. Then, given the indexes values, a day is defined as routine or non-routine day. Thus, looking for changes of day type allows to detect changes in a person's routine. The method has been tested on a database of depth and thermal images recorded in a nursing home over an 85 days period. These tests proved the reliability of the proposed method.
Collapse
|
10
|
Msaad S, Dillenseger JL, Carrault G. Interest of the minimum edit distance to detect behaviour change of the elderly person. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:7377-7380. [PMID: 34892802 DOI: 10.1109/embc46164.2021.9629665] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
In this article, a solution to detect the change of behaviour of the elderly person based on the person's activities of daily living is proposed. This work is based on the hypothesis that the person attaches importance to a rhythmic sequence of days and activities per day. The day of the elderly person is described by a succession of activities, and each activity is associated to a posture (lying down, sitting, standing, absent). Postures are estimated from image analysis measured by thermal or depth cameras in order to preserve the anonymity of the person. The change in posture succession is calculated using the minimum edit distance with respect to the routine day. The number of permutations/inversions reflects the change in the person's behaviour. The method was tested on two elderly persons recorded by thermal and depth cameras during 85 days in a retirement home. It is shown that for a person with a life change behaviour, the average number of permutations and interquartile range, before and after changes, are 41 [28], [48] and 57 [55-62] respectively compared to the learned routine day. The Wilcoxon test confirmed the significant difference between these two periods.Clinical Relevance- Monitoring the daily routine provides indicators for detecting changes in the behaviour of an elderly person.
Collapse
|
11
|
Dagard J, Mazille-Orfanos N, Georgi N, Dechicha I, Carrault G, Pladys P, Beuchée A. Correction to: Criteria for assessing the quality of clinical practice guidelines in paediatrics and neonatology: a mixed-method study. BMC Med Inform Decis Mak 2021; 21:277. [PMID: 34610838 PMCID: PMC8491369 DOI: 10.1186/s12911-021-01641-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
|
12
|
Dagard J, Mazille-Orfanos N, Georgi N, Dechicha I, Carrault G, Pladys P, Beuchée A. Criteria for assessing the quality of clinical practice guidelines in paediatrics and neonatology: a mixed-method study. BMC Med Inform Decis Mak 2021; 21:269. [PMID: 34548068 PMCID: PMC8456649 DOI: 10.1186/s12911-021-01628-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2020] [Accepted: 09/08/2021] [Indexed: 11/25/2022] Open
Abstract
Background Evidenced-based practice is a key component of quality care. This study aims to explore users’ expectations concerning paediatric local clinical practice guidelines. Methods A mixed method approach was applied, including material from quantitative questionnaire and semi-structured interviews. Data were analysed using descriptive statistics and qualitative content analysis. Data were analysed with constant comparative method. Qualitative data were parsed and categorized to identify themes related to decision-making. Results A total of 83 physicians answered the survey (response rate 83%). 98% of the participants wanted protocols based on international guidelines, 80% expected a therapeutic content. 24 semi-structured interviews were conducted to understand implementation processes, barriers and facilitators. Qualitative analysis revealed 5 emerging themes: improvement of local clinical practice guidelines, patterns of usage, reasons for non-implementation, alternative sources and perspectives. Conclusion Some criteria should be considered for the redaction of local clinical practice guidelines: focus on therapeutic, ease of access, establish local clinical practice guidelines based on international guidelines adapted to the local setting, document references and include trainees such as residents in the redaction. Supplementary Information The online version contains supplementary material available at 10.1186/s12911-021-01628-1.
Collapse
|
13
|
Leon C, Cabon S, Patural H, Gascoin G, Flamant C, Roue JM, Favrais G, Beuchee A, Pladys P, Carrault G. Evaluation of maturation in preterm infants through an ensemble machine learning algorithm using physiological signals. IEEE J Biomed Health Inform 2021; 26:400-410. [PMID: 34185652 DOI: 10.1109/jbhi.2021.3093096] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
This study was designed to test if heart rate variability (HRV) data from preterm and full-term infants could be used to estimate their functional maturational age (FMA), using a machine learning model. We propose that the FMA, and its deviation from the postmenstrual age (PMA) of the infants could inform physicians about the progress of the maturation of the infants. The HRV data was acquired from 50 healthy infants, born between 25 and 41 weeks of gestational age, who did not present any signs of abnormal maturation relative to their age group during the period of observation. The HRV features were used as input for a machine learning model that uses filtering and genetic algorithms for feature selection, and an ensemble machine learning (EML) algorithm, which combines linear and random forest regressions, to produce as output a FMA. Using HRV data, the FMA had a mean absolute error of 0.93 weeks, 95% CI [0.78, 1.08], compared to the PMA. These results demonstrate that HRV features of newborn infants can be used by an EML model to estimate their FMA. This method was also generalized using respiration rate variability (RRV) and bradycardia data, obtaining similar results. The FMA, predicted either by HRV, RRV or bradycardia, and its deviation from the true PMA of the infants, could be used as a surrogate measure of the maturational age of the infants, which could potentially be monitored non-invasively and in real-time in the setting of neonatal intensive care units.
Collapse
|
14
|
Taoum A, Chaudru S, DE Müllenheim PY, Congnard F, Emily M, Noury-Desvaux B, Bickert S, Carrault G, Mahé G, LE Faucheur A. Comparison of Activity Monitors Accuracy in Assessing Intermittent Outdoor Walking. Med Sci Sports Exerc 2021; 53:1303-1314. [PMID: 33731660 DOI: 10.1249/mss.0000000000002587] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
Abstract
PURPOSE This study aimed to determine and compare the accuracy of different activity monitors in assessing intermittent outdoor walking in both healthy and clinical populations through the development and validation of processing methodologies. METHODS In study 1, an automated algorithm was implemented and tested for the detection of short (≤1 min) walking and stopping bouts during prescribed walking protocols performed by healthy subjects in environments with low and high levels of obstruction. The following parameters obtained from activity monitors were tested, with different recording epochs0.1s/0.033s/1s/3s/10s and wearing locationsscapula/hip/wrist/ankle: GlobalSat DG100 (GS) and Qstarz BT-Q1000XT/-Q1000eX (QS) speed; ActiGraph wGT3X+ (AG) vector magnitude (VM) raw data, VM counts, and steps; and StepWatch3 (SW) steps. Furthermore, linear mixed models were developed to estimate walking speeds and distances from the monitors parameters. Study 2 validated the performance of the activity monitors and processing methodologies in a clinical population showing profile of intermittent walking due to functional limitations during outdoor walking sessions. RESULTS In study 1, GS1s, scapula, QS1s, scapula/wrist speed, and AG0.033s, hip VM raw data provided the highest bout detection rates (>96.7%) and the lowest root mean square errors in speed (≤0.4 km·h-1) and distance (<18 m) estimation. Using SW3s, ankle steps, the root mean square error for walking/stopping duration estimation reached 13.6 min using proprietary software and 0.98 min using our algorithm (total recording duration, 282 min). In study 2, using AG0.033s, hip VM raw data, the bout detection rate (95% confidence interval) reached 100% (99%-100%), and the mean (SD) absolute percentage errors in speed and distance estimation were 9% (6.6%) and 12.5% (7.9%), respectively. CONCLUSIONS GPS receivers and AG demonstrated high performance in assessing intermittent outdoor walking in both healthy and clinical populations.
Collapse
|
15
|
Doyen M, Hernández AI, Flamant C, Defontaine A, Favrais G, Altuve M, Laviolle B, Beuchée A, Carrault G, Pladys P. Early bradycardia detection and therapeutic interventions in preterm infant monitoring. Sci Rep 2021; 11:10486. [PMID: 34006917 PMCID: PMC8131388 DOI: 10.1038/s41598-021-89468-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2020] [Accepted: 04/13/2021] [Indexed: 11/09/2022] Open
Abstract
In very preterm infants, cardio-respiratory events and associated hypoxemia occurring during early postnatal life have been associated with risks of retinopathy, growth alteration and neurodevelopment impairment. These events are commonly detected by continuous cardio-respiratory monitoring in neonatal intensive care units (NICU), through the associated bradycardia. NICU nurse interventions are mainly triggered by these alarms. In this work, we acquired data from 52 preterm infants during NICU monitoring, in order to propose an early bradycardia detector which is based on a decentralized fusion of three detectors. The main objective is to improve automatic detection under real-life conditions without altering performance with respect to that of a monitor commonly used in NICU. We used heart rate lower than 80 bpm during at least 10 sec to define bradycardia. With this definition we observed a high rate of false alarms (64%) in real-life and that 29% of the relevant alarms were not followed by manual interventions. Concerning the proposed detection method, when compared to current monitors, it provided a significant decrease of the detection delay of 2.9 seconds, without alteration of the sensitivity (97.6% vs 95.2%) and false alarm rate (63.7% vs 64.1%). We expect that such an early detection will improve the response of the newborn to the intervention and allow for the development of new automatic therapeutic strategies which could complement manual intervention and decrease the sepsis risk.
Collapse
|
16
|
Weber R, Cabon S, Simon A, Poree F, Carrault G. Preterm Newborn Presence Detection in Incubator and Open Bed Using Deep Transfer Learning. IEEE J Biomed Health Inform 2021; 25:1419-1428. [PMID: 33646962 DOI: 10.1109/jbhi.2021.3062617] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Video-based motion analysis recently appeared to be a promising approach in neonatal intensive care units for monitoring the state of preterm newborns since it is contact-less and noninvasive. However it is important to remove periods when the newborn is absent or an adult is present from the analysis. In this paper, we propose a method for automatic detection of preterm newborn presence in incubator and open bed. We learn a specific model for each bed type as the camera placement differs a lot and the encountered situations are different between both. We break the problem down into two binary classifications based on deep transfer learning that are fused afterwards: newborn presence detection on the one hand and adult presence detection on the other hand. Moreover, we adopt a strategy of decision intervals fusion in order to take advantage of temporal consistency. We test three deep neural network that were pre-trained on ImageNet: VGG16, MobileNetV2 and InceptionV3. Two classifiers are compared: support vector machine and a small neural network. Our experiments are conducted on a database of 120 newborns. The whole method is evaluated on a subset of 25 newborns including 66 days of video recordings. In incubator, we reach a balanced accuracy of 86%. In open bed, the performance is lower because of a much wider variety of situations whereas less data are available.
Collapse
|
17
|
Leon C, Carrault G, Pladys P, Beuchee A. Early Detection of Late Onset Sepsis in Premature Infants Using Visibility Graph Analysis of Heart Rate Variability. IEEE J Biomed Health Inform 2021; 25:1006-1017. [PMID: 32881699 DOI: 10.1109/jbhi.2020.3021662] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
OBJECTIVE This study was designed to test the diagnostic value of visibility graph features derived from the heart rate time series to predict late onset sepsis (LOS) in preterm infants using machine learning. METHODS The heart rate variability (HRV) data was acquired from 49 premature newborns hospitalized in neonatal intensive care units (NICU). The LOS group consisted of patients who received more than five days of antibiotics, at least 72 hours after birth. The control group consisted of infants who did not receive antibiotics. HRV features in the days prior to the start of antibiotics (LOS group) or in a randomly selected period (control group) were compared against a baseline value calculated during a calibration period. After automatic feature selection, four machine learning algorithms were trained. All the tests were done using two variants of the feature set: one only included traditional HRV features, and the other additionally included visibility graph features. Performance was studied using area under the receiver operating characteristics curve (AUROC). RESULTS The best performance for detecting LOS was obtained with logistic regression, using the feature set including visibility graph features, with AUROC of 87.7% during the six hours preceding the start of antibiotics, and with predictive potential (AUROC above 70%) as early as 42 h before start of antibiotics. CONCLUSION These results demonstrate the usefulness of introducing visibility graph indexes in HRV analysis for sepsis prediction in newborns. SIGNIFICANCE The method proposed the possibility of non-invasive, real-time monitoring of risk of LOS in a NICU setting.
Collapse
|
18
|
Cabon S, Porée F, Cuffel G, Rosec O, Geslin F, Pladys P, Simon A, Carrault G. Voxyvi: A system for long-term audio and video acquisitions in neonatal intensive care units. Early Hum Dev 2021; 153:105303. [PMID: 33453631 DOI: 10.1016/j.earlhumdev.2020.105303] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/27/2020] [Revised: 11/04/2020] [Accepted: 12/21/2020] [Indexed: 11/18/2022]
Abstract
BACKGROUND In the European Union, 300,000 newborn babies are born prematurely every year. Their care is ensured in Neonatal Intensive Care Units (NICU) where vital signs are constantly monitored. In addition, other descriptors such as motion, facial and vocal activities have been shown to be essential to assess neurobehavioral development. AIM In the scope of the European project Digi-NewB, we aimed to develop and evaluate a new audio-video device designed to non-invasively acquire multi-modal data (audio, video and thermal images), while fitting the wide variety of bedding environment in NICU. METHODS Firstly, a multimodal system and associated software and guidelines to collect data in neonatal intensive care unit were proposed. Secondly, methods for post-evaluation of the acquisition phase were developed, including the study of clinician feedback and a qualitative analysis of the data. RESULTS The deployment of 19 acquisition devices in six French hospitals allowed to record more than 500 newborns of different gestational and postmenstrual ages. After the acquisition phase, clinical feedback was mostly positive. In addition, quality of more than 300 recordings was inspected and showed that 77% of the data is exploitable. In depth, the percentage of sole presence of the newborn was estimated at 62% within recordings. CONCLUSIONS This study demonstrates that audio-video acquisitions are feasible on a large scale in real life in NICU. The experience also allowed us to make a clear observation of the requirements and challenges that will have to be overcome in order to set up audio-video monitoring methods.
Collapse
|
19
|
Barrero A, Le Cunuder A, Carrault G, Carré F, Schnell F, Le Douairon Lahaye S. Modeling Stress-Recovery Status Through Heart Rate Changes Along a Cycling Grand Tour. Front Neurosci 2020; 14:576308. [PMID: 33343278 PMCID: PMC7738620 DOI: 10.3389/fnins.2020.576308] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2020] [Accepted: 10/26/2020] [Indexed: 11/13/2022] Open
Abstract
Background Heart rate (HR) and HR variability (HRV) indices are established tools to detect abnormal recovery status in athletes. A low HR and vagally mediated HRV index change between supine and standing positions reflected a maladaptive training stress-recovery status. Objectives Our study was focused on a female multistage cycling event. Its overall aim was twofold: (1) quantify the correlation between (a) the change in HR and HRV indices during an active orthostatic test and (b) subjective/objective fatigue, physical load, and training level indicators; and (2) formulate a model predicting the stress-recovery status as indexed by ΔRR¯ and ΔLnRMSSD (defined as the difference between standing and supine mean RR intervals and LnRMSSD, respectively), based on subjective/objective fatigue indicators, physical load, and training levels. Methods Ten female cyclists traveled the route of the 2017 Tour de France, comprising 21 stages of 200 km on average. From 4 days before the beginning of the event itself, and until 1 day after its completion, every morning, each cyclist was subjected to HR and HRV measurements, first at rest in a supine position and then in a standing position. The correlation between HR and HRV indices and subjective/objective fatigue, physical load, and training level indicators was then computed. Finally, several multivariable linear models were tested to analyze the relationships between HR and HRV indices, fatigue, workload, and training level indicators. Results HR changes appeared as a reliable indicator of stress-recovery status. Fatigue, training level, and ΔRR¯ displayed a linear relationship. Among a large number of linear models tested, the best one to predict stress-recovery status was the following: ΔRR¯=1,249.37+12.32V̇O2max + 0.36 km⋅week–1−8.83 HRmax−5.8 RPE−28.41 perceived fatigue with an adjusted R2 = 0.322. Conclusion The proposed model can help to directly assess the adaptation status of an athlete from RR measurements and thus to anticipate a decrease in performance due to fatigue, particularly during a multistage endurance event.
Collapse
|
20
|
Georgi N, Kuchenbuch M, Beuchee A, Pladys P, Carrault G. Smartphone-Based Clinical Pathways in Pediatrics: A Case Study. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:5661-5664. [PMID: 33019261 DOI: 10.1109/embc44109.2020.9176421] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Evidence-based medicine is a major evolution in the way medical practice and reasoning are structured. This approach aims at guiding patient care through rigorous, explicit and judicious evidences. In this contribution, we present the case study of the deployment of a smartphone-based system to manage clinical pathways and its impact during two years in the pediatric department of the university hospital of Rennes, France. We also tackle smartphone acceptability and easiness of use by pediatricians.
Collapse
|
21
|
Msaad S, Cormier G, Carrault G. Detecting falls and estimation of daily habits with depth images using machine learning algorithms. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:2163-2166. [PMID: 33018435 DOI: 10.1109/embc44109.2020.9175601] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Different approaches have been proposed in the literature to detect the fall of an elderly person. In this paper, we propose a fall detection method based on the classification of parameters extracted from depth images. Three supervised learning methods are compared: decision tree, K-Nearest Neighbors (K-NN) and Random Forests (RF). The methods have been tested on a database of depth images recorded in a nursing home over a period of 43 days. The Random Forests based method yields the best results, achieving 93% sensitivity and 100% specificity when we restrict our study around the bed. Furthermore, this paper also proposes a 37 days follow-up of the person, to try and estimate his or her daily habits.
Collapse
|
22
|
Lazazzera R, Deviaene M, Varon C, Buyse B, Testelmans D, Laguna P, Gil E, Carrault G. Detection and Classification of Sleep Apnea and Hypopnea Using PPG and SpO 2 Signals. IEEE Trans Biomed Eng 2020; 68:1496-1506. [PMID: 32997622 DOI: 10.1109/tbme.2020.3028041] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
In this work, a detection and classification method for sleep apnea and hypopnea, using photopletysmography (PPG) and peripheral oxygen saturation (SpO 2) signals, is proposed. The detector consists of two parts: one that detects reductions in amplitude fluctuation of PPG (DAP)and one that detects oxygen desaturations. To further differentiate among sleep disordered breathing events (SDBE), the pulse rate variability (PRV) was extracted from the PPG signal, and then used to extract features that enhance the sympatho-vagal arousals during apneas and hypopneas. A classification was performed to discriminate between central and obstructive events, apneas and hypopneas. The algorithms were tested on 96 overnight signals recorded at the UZ Leuven hospital, annotated by clinical experts, and from patients without any kind of co-morbidity. An accuracy of 75.1% for the detection of apneas and hypopneas, in one-minute segments,was reached. The classification of the detected events showed 92.6% accuracy in separating central from obstructive apnea, 83.7% for central apnea and central hypopnea and 82.7% for obstructive apnea and obstructive hypopnea. The low implementation cost showed a potential for the proposed method of being used as screening device, in ambulatory scenarios.
Collapse
|
23
|
Weber R, Simon A, Poree F, Carrault G. Deep transfer learning for video-based detection of newborn presence in incubator. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:2147-2150. [PMID: 33018431 DOI: 10.1109/embc44109.2020.9175952] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Preterm newborns are prone to late-onset sepsis, leading to a high risk of mortality. Video-based analysis of motion is a promising non-invasive approach because the behavior of the newborn is related to his physiological state. But it is needed to analyze only images where the newborn is solely present in incubator. In this context, we propose a method for video-based detection of newborn presence. We use deep transfer learning: bottleneck features are extracted from a pre-trained deep neural network and then a classifier is trained with these features on our database. Moreover, we propose a strategy that allows to take advantage of temporal consistency. On a database of 11 newborns with 56 days of video recordings, the results show a balanced accuracy of 80%.
Collapse
|
24
|
Nault S, Creuze V, Al-Omar S, Levasseur A, Nadeau C, Samson N, Imane R, Tremblay S, Carrault G, Pladys P, Praud JP. Cardiorespiratory Alterations in a Newborn Ovine Model of Systemic Inflammation Induced by Lipopolysaccharide Injection. Front Physiol 2020; 11:585. [PMID: 32625107 PMCID: PMC7311791 DOI: 10.3389/fphys.2020.00585] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2019] [Accepted: 05/11/2020] [Indexed: 12/14/2022] Open
Abstract
Although it is well known that neonatal sepsis can induce important alterations in cardiorespiratory control, their detailed early features and the mechanisms involved remain poorly understood. As a first step in resolving this issue, the main goal of this study was to characterize these alterations more extensively by setting up a full-term newborn lamb model of systemic inflammation using lipopolysaccharide (LPS) injection. Two 6-h polysomnographic recordings were performed on two consecutive days on eight full-term lambs: the first after an IV saline injection (control condition, CTRL); the second, after an IV injection of 2.5 μg/kg Escherichia coli LPS 0127:B8 (LPS condition). Rectal temperature, locomotor activity, state of alertness, arterial blood gases, respiratory frequency and heart rate, mean arterial blood pressure, apneas and cardiac decelerations, and heart-rate and respiratory-rate variability (HRV and RRV) were assessed. LPS injection decreased locomotor activity (p = 0.03) and active wakefulness (p = 0.01) compared to the CTRL. In addition, LPS injection led to a biphasic increase in rectal temperature (p = 0.01 at ∼30 and 180 min) and in respiratory frequency and heart rate (p = 0.0005 and 0.005, respectively), and to an increase in cardiac decelerations (p = 0.05). An overall decrease in HRV and RRV was also observed. Interestingly, the novel analysis of the representations of the horizontal and vertical visibility network yielded the most statistically significant alterations in HRV structure, suggesting its potential clinical importance for providing an earlier diagnosis of neonatal bacterial sepsis. A second goal was to assess whether the reflexivity of the autonomic nervous system was altered after LPS injection by studying the cardiorespiratory components of the laryngeal and pulmonary chemoreflexes. No difference was found. Lastly, preliminary results provide proof of principle that brainstem inflammation (increased IL-8 and TNF-α mRNA expression) can be shown 6 h after LPS injection. In conclusion, this full-term lamb model of systemic inflammation reproduces several important aspects of neonatal bacterial sepsis and paves the way for studies in preterm lambs aiming to assess both the effect of prematurity and the central neural mechanisms of cardiorespiratory control alterations observed during neonatal sepsis.
Collapse
|
25
|
Khreis S, Ge D, Rahman HA, Carrault G. Breathing Rate Estimation Using Kalman Smoother With Electrocardiogram and Photoplethysmogram. IEEE Trans Biomed Eng 2020; 67:893-904. [DOI: 10.1109/tbme.2019.2923448] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|