1
|
Shafiezadeh S, Duma GM, Mento G, Danieli A, Antoniazzi L, Del Popolo Cristaldi F, Bonanni P, Testolin A. Calibrating Deep Learning Classifiers for Patient-Independent Electroencephalogram Seizure Forecasting. SENSORS (BASEL, SWITZERLAND) 2024; 24:2863. [PMID: 38732969 PMCID: PMC11086106 DOI: 10.3390/s24092863] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/19/2024] [Revised: 04/26/2024] [Accepted: 04/29/2024] [Indexed: 05/13/2024]
Abstract
The recent scientific literature abounds in proposals of seizure forecasting methods that exploit machine learning to automatically analyze electroencephalogram (EEG) signals. Deep learning algorithms seem to achieve a particularly remarkable performance, suggesting that the implementation of clinical devices for seizure prediction might be within reach. However, most of the research evaluated the robustness of automatic forecasting methods through randomized cross-validation techniques, while clinical applications require much more stringent validation based on patient-independent testing. In this study, we show that automatic seizure forecasting can be performed, to some extent, even on independent patients who have never been seen during the training phase, thanks to the implementation of a simple calibration pipeline that can fine-tune deep learning models, even on a single epileptic event recorded from a new patient. We evaluate our calibration procedure using two datasets containing EEG signals recorded from a large cohort of epileptic subjects, demonstrating that the forecast accuracy of deep learning methods can increase on average by more than 20%, and that performance improves systematically in all independent patients. We further show that our calibration procedure works best for deep learning models, but can also be successfully applied to machine learning algorithms based on engineered signal features. Although our method still requires at least one epileptic event per patient to calibrate the forecasting model, we conclude that focusing on realistic validation methods allows to more reliably compare different machine learning approaches for seizure prediction, enabling the implementation of robust and effective forecasting systems that can be used in daily healthcare practice.
Collapse
Affiliation(s)
- Sina Shafiezadeh
- Department of General Psychology, University of Padova, 35131 Padova, Italy; (G.M.); (F.D.P.C.)
| | - Gian Marco Duma
- Epilepsy and Clinical Neurophysiology Unit, Scientific Institute, IRCCS E. Medea, 31015 Conegliano, Italy; (G.M.D.); (A.D.); (L.A.); (P.B.)
| | - Giovanni Mento
- Department of General Psychology, University of Padova, 35131 Padova, Italy; (G.M.); (F.D.P.C.)
- Padova Neuroscience Center, University of Padova, 35131 Padova, Italy
| | - Alberto Danieli
- Epilepsy and Clinical Neurophysiology Unit, Scientific Institute, IRCCS E. Medea, 31015 Conegliano, Italy; (G.M.D.); (A.D.); (L.A.); (P.B.)
| | - Lisa Antoniazzi
- Epilepsy and Clinical Neurophysiology Unit, Scientific Institute, IRCCS E. Medea, 31015 Conegliano, Italy; (G.M.D.); (A.D.); (L.A.); (P.B.)
| | | | - Paolo Bonanni
- Epilepsy and Clinical Neurophysiology Unit, Scientific Institute, IRCCS E. Medea, 31015 Conegliano, Italy; (G.M.D.); (A.D.); (L.A.); (P.B.)
| | - Alberto Testolin
- Department of General Psychology, University of Padova, 35131 Padova, Italy; (G.M.); (F.D.P.C.)
- Department of Mathematics, University of Padova, 35131 Padova, Italy
| |
Collapse
|
2
|
Krejzar Z, Sila D, Waldauf P, Kuriscak E, Mokrejs P, Spatenkova V. Impact of frailty, biomarkers and basic biochemical parameters on outcomes of comatose patients in status epilepticus: a single-center prospective pilot study. BMC Neurol 2024; 24:46. [PMID: 38279084 PMCID: PMC10811840 DOI: 10.1186/s12883-024-03537-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2023] [Accepted: 01/14/2024] [Indexed: 01/28/2024] Open
Abstract
BACKGROUND Status epilepticus (SE) is a severe acute condition in neurocritical care with high mortality. Searching for risk factors affecting the prognosis in SE remains a significant issue. The primary study's aim was to test the predictive values of the Clinical Frailty Scale (CFS) and the Modified 11-item Frailty Index (mFI-11), the biomarkers and basic biochemical parameters collected at ICU on the Glasgow Outcome Scale (GOS) assessed at hospital discharge (hosp), and three months later (3 M), in comatose patients with SE. The secondary aim was to focus on the association between the patient's state at admission and the duration of mechanical ventilation, the ICU, and hospital stay. METHODS In two years single-centre prospective pilot study enrolling 30 adult neurocritical care patients with SE classified as Convulsive SE, A.1 category according to the International League Against Epilepsy (ILAE) Task Force without an-/hypoxic encephalopathy, we evaluated predictive powers of CFS, mFI-11, admission Status Epilepticus Severity Score (STESS), serum protein S100, serum Troponin T and basic biochemical parameters on prognosticating GOS using univariate linear regression, logistic regression and Receiver Operating Characteristic (ROC) analysis. RESULTS Our study included 60% males, with a mean age of 57 ± 16 years (44-68) and a mean BMI of 27 ± 5.6. We found CFS, mFI-11, STESS, and age statistically associated with GOS at hospital discharge and three months later. Among the biomarkers, serum troponin T level affected GOS hosp (p = 0.027). Serum C-reactive protein significance in prognosticating GOS was found by logistic regression (hosp p = 0.008; 3 M p = 0.004), and serum calcium by linear regression (hosp p = 0.028; 3 M p = 0.015). In relation to secondary outcomes, we found associations between the length of hospital stay and each of the following: age (p = 0.03), STESS (p = 0.009), and serum troponin T (p = 0.029) parameters. CONCLUSIONS This pilot study found promising predictive powers of two frailty scores, namely CFS and mFI-11, which were comparable to age and STESS predictors regarding the GOS at hospital discharge and three months later in ICU patients with SE. Among biomarkers and biochemical parameters, only serum troponin T level affected GOS at hospital discharge.
Collapse
Affiliation(s)
- Zdenek Krejzar
- Department of Neurology, First Faculty of Medicine, Charles University in Prague, Katerinska 1660/32, Prague 2, 121 08, Czech Republic
- Centrum of Anaesthesiology, Resuscitation and Intensive Care, Regional Hospital, Husova 357/10, Liberec, 46001, Czech Republic
| | - David Sila
- Centrum of Anaesthesiology, Resuscitation and Intensive Care, Regional Hospital, Husova 357/10, Liberec, 46001, Czech Republic
- Emergency Medical Services, Klasterni 954/5, Liberec, 460 01, Czech Republic
- Faculty of Health Studies, Technical University in Liberec, Studentska 1402/2, 461 17, Liberec 1, Czech Republic
| | - Petr Waldauf
- Department of Anaesthesiology and Resuscitation, Third Faculty of Medicine, Charles University in Prague, Ruska 10, Prague, 100 00, Czechia
- University Hospital Kralovske Vinohrady, 110 34 Prague 10, Srobarova, 1050, Czech Republic
| | - Eduard Kuriscak
- Institute of Physiology, First Faculty of Medicine, Charles University in Prague, Albertov 5, Prague, 128 00, Czech Republic
| | - Petr Mokrejs
- Department of Neurology, First Faculty of Medicine, Charles University in Prague, Katerinska 1660/32, Prague 2, 121 08, Czech Republic
- Emergency Medical Services, Klasterni 954/5, Liberec, 460 01, Czech Republic
| | - Vera Spatenkova
- Faculty of Health Studies, Technical University in Liberec, Studentska 1402/2, 461 17, Liberec 1, Czech Republic.
- Department of Anaesthesiology and Resuscitation, Third Faculty of Medicine, Charles University in Prague, Ruska 10, Prague, 100 00, Czechia.
- University Hospital Kralovske Vinohrady, 110 34 Prague 10, Srobarova, 1050, Czech Republic.
- Institute of Physiology, First Faculty of Medicine, Charles University in Prague, Albertov 5, Prague, 128 00, Czech Republic.
- Neurocenter, Neurointensive Care Unit, Regional Hospital, Husova 357/10, Liberec, 46001, Czech Republic.
| |
Collapse
|