1
|
Biondi A, Dursun E, Viana PF, Laiou P, Richardson MP. New wearable and portable EEG modalities in epilepsy: The views of hospital-based healthcare professionals. Epilepsy Behav 2024; 159:109990. [PMID: 39181111 DOI: 10.1016/j.yebeh.2024.109990] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/31/2024] [Revised: 08/06/2024] [Accepted: 08/06/2024] [Indexed: 08/27/2024]
Abstract
BACKGROUND Novel mobile and portable EEG solutions, designed for short and long-term monitoring of individuals with epilepsy have been developed in recent years but, they are underutilized, lacking full integration into clinical routine. Exploring the opinions of hospital-based healthcare professionals regarding their potential application, technical requirements and value would be crucial for future device development and increase their clinical application. PURPOSE To evaluate professionals' opinions on novel EEG systems, focusing on their potential application in various clinical settings, professionals' interest in non-invasive solutions for ultra-long monitoring of people with epilepsy (PWE) and factors which could increase future use of novel EEG systems. MATERIALS AND METHODS We conducted an online survey where Hospital-based professionals shared opinions on potential advantages, clinical value, and key features of novel wearable EEG systems in five different clinical settings. Additionally, insights were gathered on the need for future research and, the need for additional information about devices from companies and researchers. RESULTS Respondents (n = 40) prioritized high performance, data quality, easy patient mobility, and comfort as crucial features for novel devices. Advantages were highlighted, including more natural settings, reduced application time, earlier epilepsy diagnosis, and decreased support requirements. Novel EEG devices were seen as valuable for epilepsy diagnosis, seizure monitoring, automatic seizure documentation, seizure alarms, and seizure forecasting. Interest in integrating these new systems into clinical practice was high, particularly for supervising drug-resistant epilepsy, reducing SUDEP, and detecting nocturnal seizures. Professionals emphasized the need for more research studies and highlighted the need for increased information from companies and researchers. CONCLUSIONS Professionals underscore specific technical and practical features, along with potential clinical advantages and value of novel EEG devices that could drive their development. While interest in integrating these solutions in clinical practice exists, further validation studies and enhanced communication between researchers, companies, and clinicians are crucial for overcoming potential scepticism and facilitating widespread adoption.
Collapse
Affiliation(s)
- Andrea Biondi
- Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK.
| | - Eren Dursun
- Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - Pedro F Viana
- Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK; Faculty of Medicine, University of Lisbon, Lisbon, Portugal
| | - Petroula Laiou
- Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - Mark P Richardson
- Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| |
Collapse
|
2
|
Dan J, Pale U, Amirshahi A, Cappelletti W, Ingolfsson TM, Wang X, Cossettini A, Bernini A, Benini L, Beniczky S, Atienza D, Ryvlin P. SzCORE: Seizure Community Open-Source Research Evaluation framework for the validation of electroencephalography-based automated seizure detection algorithms. Epilepsia 2024. [PMID: 39292446 DOI: 10.1111/epi.18113] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Revised: 08/21/2024] [Accepted: 08/21/2024] [Indexed: 09/19/2024]
Abstract
The need for high-quality automated seizure detection algorithms based on electroencephalography (EEG) becomes ever more pressing with the increasing use of ambulatory and long-term EEG monitoring. Heterogeneity in validation methods of these algorithms influences the reported results and makes comprehensive evaluation and comparison challenging. This heterogeneity concerns in particular the choice of datasets, evaluation methodologies, and performance metrics. In this paper, we propose a unified framework designed to establish standardization in the validation of EEG-based seizure detection algorithms. Based on existing guidelines and recommendations, the framework introduces a set of recommendations and standards related to datasets, file formats, EEG data input content, seizure annotation input and output, cross-validation strategies, and performance metrics. We also propose the EEG 10-20 seizure detection benchmark, a machine-learning benchmark based on public datasets converted to a standardized format. This benchmark defines the machine-learning task as well as reporting metrics. We illustrate the use of the benchmark by evaluating a set of existing seizure detection algorithms. The SzCORE (Seizure Community Open-Source Research Evaluation) framework and benchmark are made publicly available along with an open-source software library to facilitate research use, while enabling rigorous evaluation of the clinical significance of the algorithms, fostering a collective effort to more optimally detect seizures to improve the lives of people with epilepsy.
Collapse
Affiliation(s)
- Jonathan Dan
- Embedded Systems Laboratory, EPFL, Lausanne, Switzerland
| | - Una Pale
- Embedded Systems Laboratory, EPFL, Lausanne, Switzerland
| | | | | | | | - Xiaying Wang
- Integrated Systems Laboratory, ETH Zürich, Zürich, Switzerland
- Research Department, Swiss University of Traditional Chinese Medicine, Zurzach, Switzerland
| | | | - Adriano Bernini
- Service of Neurology, Centre Hospitalier Universitaire Vaudois, Lausanne, Switzerland
| | - Luca Benini
- Integrated Systems Laboratory, ETH Zürich, Zürich, Switzerland
- Department of Electrical, Electronic, and Information Engineering, University of Bologna, Bologna, Italy
| | - Sándor Beniczky
- Aarhus University Hospital and Danish Epilepsy Center, Aarhus University, Dianalund, Denmark
| | - David Atienza
- Embedded Systems Laboratory, EPFL, Lausanne, Switzerland
| | - Philippe Ryvlin
- Service of Neurology, Centre Hospitalier Universitaire Vaudois, Lausanne, Switzerland
| |
Collapse
|
3
|
Vander T, Bikmullina R, Froimovich N, Stroganova T, Nissenkorn A, Gilboa T, Eliashiv D, Ekstein D, Medvedovsky M. Economic aspects of prolonged home video-EEG monitoring: a simulation study. COST EFFECTIVENESS AND RESOURCE ALLOCATION 2024; 22:59. [PMID: 39127662 DOI: 10.1186/s12962-024-00568-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Accepted: 07/26/2024] [Indexed: 08/12/2024] Open
Abstract
INTRODUCTION Video EEG monitoring (VEM) is an important tool for characterizing clinical events suspected as seizures. It is also used for pre-surgical workups in patients with drug-resistant epilepsy (DRE). In-hospital VEM high cost, long admission waiting periods and some other inconveniences led to an interest in home VEM (HVEM). However, because antiseizure medications cannot be reduced at home, HVEM may require longer monitoring. While the economic aspect is one of the main motivations for HVEM, the cost of HVEM lasting several weeks has not been assessed. METHODS We modeled the cost of HVEM for 8 weeks and compared it to the cost of 1-week in-hospital VEM. Additionally, we modeled the per-patient cost for a combination of HVEM and in-hospital VEM, considering that if in a proportion of patients HVEM fails to achieve its goal, they should undergo in-hospital VEM with drug reduction. RESULTS The average cost of HVEM up to 4-6 weeks of monitoring was lower than that for the 1-week in-hospital VEM. Combining the 3-week HVEM with 1-week in-hospital VEM (if needed) reduced the per-patient cost by 6.6-28.6% as compared to the situation when all the patients with DRE were referred to the in-hospital VEM. CONCLUSIONS A prolonged intermittent HVEM can be cost-effective, especially if the minimal seizure frequency is about one seizure per week. The study findings support directing efforts into clinical trials and technology development.
Collapse
Affiliation(s)
- Tatiana Vander
- Herzfeld Geriatric Rehabilitation Medical Center, Gedera, Israel.
- The Faculty of Medicine, Hebrew University of Jerusalem, Jerusalem, Israel.
| | - Rozaliya Bikmullina
- Department of Clinical Neurophysiology, HUS Diagnostic Center, Helsinki University Central Hospital, Helsinki, Finland
| | - Naomi Froimovich
- Department of Neurology and Agnes Ginges Center for Human Neurogenetics, Hadassah Medical Organization, Jerusalem, Israel
| | - Tatiana Stroganova
- MEG-Center, Moscow State University of Psychology and Education, Moscow, Russia
| | - Andreea Nissenkorn
- The Neuropediatric Unit, Division of Pediatrics, Wolfson Medical Center, Holon, Israel
- The Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Tal Gilboa
- The Faculty of Medicine, Hebrew University of Jerusalem, Jerusalem, Israel
- The Pediatric Neurology Unit, Hadassah Medical Organization, Jerusalem, Israel
| | - Dawn Eliashiv
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA
| | - Dana Ekstein
- The Faculty of Medicine, Hebrew University of Jerusalem, Jerusalem, Israel
- Department of Neurology and Agnes Ginges Center for Human Neurogenetics, Hadassah Medical Organization, Jerusalem, Israel
| | - Mordekhay Medvedovsky
- The Faculty of Medicine, Hebrew University of Jerusalem, Jerusalem, Israel
- Department of Neurology and Agnes Ginges Center for Human Neurogenetics, Hadassah Medical Organization, Jerusalem, Israel
| |
Collapse
|
4
|
Lucas A, Revell A, Davis KA. Artificial intelligence in epilepsy - applications and pathways to the clinic. Nat Rev Neurol 2024; 20:319-336. [PMID: 38720105 DOI: 10.1038/s41582-024-00965-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/16/2024] [Indexed: 06/06/2024]
Abstract
Artificial intelligence (AI) is rapidly transforming health care, and its applications in epilepsy have increased exponentially over the past decade. Integration of AI into epilepsy management promises to revolutionize the diagnosis and treatment of this complex disorder. However, translation of AI into neurology clinical practice has not yet been successful, emphasizing the need to consider progress to date and assess challenges and limitations of AI. In this Review, we provide an overview of AI applications that have been developed in epilepsy using a variety of data modalities: neuroimaging, electroencephalography, electronic health records, medical devices and multimodal data integration. For each, we consider potential applications, including seizure detection and prediction, seizure lateralization, localization of the seizure-onset zone and assessment for surgical or neurostimulation interventions, and review the performance of AI tools developed to date. We also discuss methodological considerations and challenges that must be addressed to successfully integrate AI into clinical practice. Our goal is to provide an overview of the current state of the field and provide guidance for leveraging AI in future to improve management of epilepsy.
Collapse
Affiliation(s)
- Alfredo Lucas
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, USA
| | - Andrew Revell
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Kathryn A Davis
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
- Department of Neurology, University of Pennsylvania, Philadelphia, PA, USA.
| |
Collapse
|
5
|
Saeedinia SA, Jahed-Motlagh MR, Tafakhori A, Kasabov NK. Diagnostic biomarker discovery from brain EEG data using LSTM, reservoir-SNN, and NeuCube methods in a pilot study comparing epilepsy and migraine. Sci Rep 2024; 14:10667. [PMID: 38724576 PMCID: PMC11082192 DOI: 10.1038/s41598-024-60996-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2023] [Accepted: 04/30/2024] [Indexed: 05/12/2024] Open
Abstract
The study introduces a new online spike encoding algorithm for spiking neural networks (SNN) and suggests new methods for learning and identifying diagnostic biomarkers using three prominent deep learning neural network models: deep BiLSTM, reservoir SNN, and NeuCube. EEG data from datasets related to epilepsy, migraine, and healthy subjects are employed. Results reveal that BiLSTM hidden neurons capture biological significance, while reservoir SNN activities and NeuCube spiking dynamics identify EEG channels as diagnostic biomarkers. BiLSTM and reservoir SNN achieve 90 and 85% classification accuracy, while NeuCube achieves 97%, all methods pinpointing potential biomarkers like T6, F7, C4, and F8. The research bears implications for refining online EEG classification, analysis, and early brain state diagnosis, enhancing AI models with interpretability and discovery. The proposed techniques hold promise for streamlined brain-computer interfaces and clinical applications, representing a significant advancement in pattern discovery across the three most popular neural network methods for addressing a crucial problem. Further research is planned to study how early can these diagnostic biomarkers predict an onset of brain states.
Collapse
Affiliation(s)
| | | | - Abbas Tafakhori
- Department of Neurology, School of Medicine, Iranian Center of Neurological Research, Tehran University of Medical Sciences, Tehran, Iran
| | - Nikola Kirilov Kasabov
- School of Engineering, Computing and Mathematical Sciences, Auckland University of Technology, Auckland, New Zealand.
- Institute for Information and Communication Technology, Bulgarian Academy of Sciences, Sofia, Bulgaria.
- Computer Science and Engineering Department, Dalian University, Dalian, China.
| |
Collapse
|
6
|
Bernini A, Dan J, Ryvlin P. Ambulatory seizure detection. Curr Opin Neurol 2024; 37:99-104. [PMID: 38328946 DOI: 10.1097/wco.0000000000001248] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/09/2024]
Abstract
PURPOSE OF REVIEW To review recent advances in the field of seizure detection in ambulatory patients with epilepsy. RECENT FINDINGS Recent studies have shown that wrist or arm wearable sensors, using 3D-accelerometry, electrodermal activity or photoplethysmography, in isolation or in combination, can reliably detect focal-to-bilateral and generalized tonic-clonic seizures (GTCS), with a sensitivity over 90%, and false alarm rates varying from 0.1 to 1.2 per day. A headband EEG has also demonstrated a high sensitivity for detecting and help monitoring generalized absence seizures. In contrast, no appropriate solution is yet available to detect focal seizures, though some promising findings were reported using ECG-based heart rate variability biomarkers and subcutaneous EEG. SUMMARY Several FDA and/or EU-certified solutions are available to detect GTCS and trigger an alarm with acceptable rates of false alarms. However, data are still missing regarding the impact of such intervention on patients' safety. Noninvasive solutions to reliably detect focal seizures in ambulatory patients, based on either EEG or non-EEG biosignals, remain to be developed. To this end, a number of challenges need to be addressed, including the performance, but also the transparency and interpretability of machine learning algorithms.
Collapse
Affiliation(s)
- Adriano Bernini
- Department of Clinical Neurosciences, Lausanne University Hospital (CHUV), University of Lausanne
| | - Jonathan Dan
- Embedded Systems Laboratory, Swiss Federal Institute of Technology of Lausanne (EPFL), Lausanne, Switzerland
| | - Philippe Ryvlin
- Department of Clinical Neurosciences, Lausanne University Hospital (CHUV), University of Lausanne
| |
Collapse
|
7
|
Jeppesen J, Lin K, Melo HM, Pavei J, Marques JLB, Beniczky S, Walz R. Detection of seizures with ictal tachycardia, using heart rate variability and patient adaptive logistic regression machine learning methods: A hospital-based validation study. Epileptic Disord 2024; 26:199-208. [PMID: 38334223 DOI: 10.1002/epd2.20196] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2023] [Revised: 12/19/2023] [Accepted: 01/08/2024] [Indexed: 02/10/2024]
Abstract
OBJECTIVE Automated seizure detection of focal epileptic seizures is needed for objective seizure quantification to optimize the treatment of patients with epilepsy. Heart rate variability (HRV)-based seizure detection using patient-adaptive threshold with logistic regression machine learning (LRML) methods has presented promising performance in a study with a Danish patient cohort. The objective of this study was to assess the generalizability of the novel LRML seizure detection algorithm by validating it in a dataset recorded from long-term video-EEG monitoring (LTM) in a Brazilian patient cohort. METHODS Ictal and inter-ictal ECG-data epochs recorded during LTM were analyzed retrospectively. Thirty-four patients had 107 seizures (79 focal, 28 generalized tonic-clonic [GTC] including focal-to-bilateral-tonic-clonic seizures) eligible for analysis, with a total of 185.5 h recording. Because HRV-based seizure detection is only suitable in patients with marked ictal autonomic change, patients with >50 beats/min change in heart rate during seizures were selected as responders. The patient-adaptive LRML seizure detection algorithm was applied to all elected ECG data, and results were computed separately for responders and non-responders. RESULTS The patient-adaptive LRML seizure detection algorithm yielded a sensitivity of 84.8% (95% CI: 75.6-93.9) with a false alarm rate of .25/24 h in the responder group (22 patients, 59 seizures). Twenty-five of the 26 GTC seizures were detected (96.2%), and 25 of the 33 focal seizures without bilateral convulsions were detected (75.8%). SIGNIFICANCE The study confirms in a new, independent external dataset the good performance of seizure detection from a previous study and suggests that the method is generalizable. This method seems useful for detecting both generalized and focal epileptic seizures. The algorithm can be embedded in a wearable seizure detection system to alert patients and caregivers of seizures and generate objective seizure counts helping to optimize the treatment of the patients.
Collapse
Affiliation(s)
- Jesper Jeppesen
- Department of Clinical Neurophysiology, Aarhus University Hospital, Aarhus, Denmark
- Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
| | - Katia Lin
- Medical Sciences Post-graduate Program, Federal University of Santa Catarina (UFSC), Florianópolis, SC, Brazil
- Neurology Division, Federal University of Santa Catarina (UFSC), Florianópolis, SC, Brazil
- Center for Applied Neurosciences (CeNAp), Federal University of Santa Catarina (UFSC), Florianópolis, SC, Brazil
| | | | - Jonatas Pavei
- Institute of Biomedical Engineering, Federal University of Santa Catarina, Florianópolis, SC, Brazil
| | - Jefferson Luiz Brum Marques
- Center for Applied Neurosciences (CeNAp), Federal University of Santa Catarina (UFSC), Florianópolis, SC, Brazil
- Institute of Biomedical Engineering, Federal University of Santa Catarina, Florianópolis, SC, Brazil
| | - Sándor Beniczky
- Department of Clinical Neurophysiology, Aarhus University Hospital, Aarhus, Denmark
- Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
- Department of Clinical Neurophysiology, Danish Epilepsy Centre, Dianalund, Denmark
| | - Roger Walz
- Medical Sciences Post-graduate Program, Federal University of Santa Catarina (UFSC), Florianópolis, SC, Brazil
- Neurology Division, Federal University of Santa Catarina (UFSC), Florianópolis, SC, Brazil
- Center for Applied Neurosciences (CeNAp), Federal University of Santa Catarina (UFSC), Florianópolis, SC, Brazil
- Graduate Program in Neuroscience, UFSC, Florianópolis, SC, Brazil
| |
Collapse
|
8
|
Kouka M, Cuesta-Frau D, Moltó-Gallego V. Slope Entropy Characterisation: An Asymmetric Approach to Threshold Parameters Role Analysis. ENTROPY (BASEL, SWITZERLAND) 2024; 26:82. [PMID: 38248207 PMCID: PMC10814979 DOI: 10.3390/e26010082] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 01/15/2024] [Accepted: 01/15/2024] [Indexed: 01/23/2024]
Abstract
Slope Entropy (SlpEn) is a novel method recently proposed in the field of time series entropy estimation. In addition to the well-known embedded dimension parameter, m, used in other methods, it applies two additional thresholds, denoted as δ and γ, to derive a symbolic representation of a data subsequence. The original paper introducing SlpEn provided some guidelines for recommended specific values of these two parameters, which have been successfully followed in subsequent studies. However, a deeper understanding of the role of these thresholds is necessary to explore the potential for further SlpEn optimisations. Some works have already addressed the role of δ, but in this paper, we extend this investigation to include the role of γ and explore the impact of using an asymmetric scheme to select threshold values. We conduct a comparative analysis between the standard SlpEn method as initially proposed and an optimised version obtained through a grid search to maximise signal classification performance based on SlpEn. The results confirm that the optimised version achieves higher time series classification accuracy, albeit at the cost of significantly increased computational complexity.
Collapse
Affiliation(s)
- Mahdy Kouka
- Department of System Informatics and Computers, Universitat Politècnica de València, 03801 Alcoy, Spain; (M.K.); (V.M.-G.)
| | - David Cuesta-Frau
- Department of System Informatics and Computers, Universitat Politècnica de València, 03801 Alcoy, Spain; (M.K.); (V.M.-G.)
- Technological Institute of Informatics, Universitat Politècnica de València, 03801 Alcoy, Spain
| | - Vicent Moltó-Gallego
- Department of System Informatics and Computers, Universitat Politècnica de València, 03801 Alcoy, Spain; (M.K.); (V.M.-G.)
| |
Collapse
|
9
|
Wong S, Simmons A, Rivera-Villicana J, Barnett S, Sivathamboo S, Perucca P, Kwan P, Kuhlmann L, Vasa R, O'Brien TJ. EEG based automated seizure detection - A survey of medical professionals. Epilepsy Behav 2023; 149:109518. [PMID: 37952416 DOI: 10.1016/j.yebeh.2023.109518] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/14/2023] [Revised: 10/29/2023] [Accepted: 11/02/2023] [Indexed: 11/14/2023]
Abstract
Diagnosing and managing seizures presents substantial challenges for clinicians caring for patients with epilepsy. Although machine learning (ML) has been proposed for automated seizure detection using EEG data, there is little evidence of these technologies being broadly adopted in clinical practice. Moreover, there is a noticeable lack of surveys investigating this topic from the perspective of medical practitioners, which limits the understanding of the obstacles for the development of effective automated seizure detection. Besides the issue of generalisability and replicability seen in a small amount of studies, obstacles to the adoption of automated seizure detection remain largely unknown. To understand the obstacles preventing the application of seizure detection tools in clinical practice, we conducted a survey targeting medical professionals involved in the management of epilepsy. Our study aimed to gather insights on various factors such as the clinical utility, professional sentiment, benchmark requirements, and perceived barriers associated with the use of automated seizure detection tools. Our key findings are: I) The minimum acceptable sensitivity reported by most of our respondents (80%) seems achievable based on studies reported from most currently available ML-based EEG seizure detection algorithms, but replication studies often fail to meet this minimum. II) Respondents are receptive to the adoption of ML seizure detection tools and willing to spend time in training. III) The top three barriers for usage of such tools in clinical practice are related to availability, lack of training, and the blackbox nature of ML algorithms. Based on our findings, we developed a guide that can serve as a basis for developing ML-based seizure detection tools that meet the requirements of medical professionals, and foster the integration of these tools into clinical practice.
Collapse
Affiliation(s)
- Sheng Wong
- Applied Artificial Intelligence Institute, Deakin University, Burwood, Victoria, Australia.
| | - Anj Simmons
- Applied Artificial Intelligence Institute, Deakin University, Burwood, Victoria, Australia
| | | | - Scott Barnett
- Applied Artificial Intelligence Institute, Deakin University, Burwood, Victoria, Australia
| | - Shobi Sivathamboo
- Department of Neuroscience, Central Clinical School, Monash University, Melbourne, Victoria, Australia; Department of Neurology, Alfred Health, Melbourne, Victoria, Australia; Department of Medicine, The Royal Melbourne Hospital, The University of Melbourne, Parkville, Victoria, Australia; Department of Neurology, The Royal Melbourne Hospital, Parkville, Victoria, Australia
| | - Piero Perucca
- Department of Neurology, Alfred Health, Melbourne, Victoria, Australia; Department of Medicine, The Royal Melbourne Hospital, The University of Melbourne, Parkville, Victoria, Australia; Department of Neurology, The Royal Melbourne Hospital, Parkville, Victoria, Australia; Epilepsy Research Centre, Department of Medicine (Austin Health), The University of Melbourne, Heidelberg, Victoria, Australia; Bladin-Berkovic Comprehensive Epilepsy Program, Austin Health, Heidelberg, Victoria, Australia
| | - Patrick Kwan
- Department of Neuroscience, Central Clinical School, Monash University, Melbourne, Victoria, Australia; Department of Neurology, Alfred Health, Melbourne, Victoria, Australia; Department of Medicine, The Royal Melbourne Hospital, The University of Melbourne, Parkville, Victoria, Australia; Department of Neurology, The Royal Melbourne Hospital, Parkville, Victoria, Australia
| | - Levin Kuhlmann
- Department of Data Science and AI, Faculty of IT, Monash University, Clayton, Victoria, Australia; Department of Medicine, St Vincent's Hospital, The University of Melbourne, Melbourne, Victoria, Australia
| | - Rajesh Vasa
- Applied Artificial Intelligence Institute, Deakin University, Burwood, Victoria, Australia
| | - Terence J O'Brien
- Department of Neuroscience, Central Clinical School, Monash University, Melbourne, Victoria, Australia; Department of Neurology, Alfred Health, Melbourne, Victoria, Australia; Department of Medicine, The Royal Melbourne Hospital, The University of Melbourne, Parkville, Victoria, Australia; Department of Neurology, The Royal Melbourne Hospital, Parkville, Victoria, Australia
| |
Collapse
|
10
|
Wong S, Simmons A, Villicana JR, Barnett S. Estimating Patient-Level Uncertainty in Seizure Detection Using Group-Specific Out-of-Distribution Detection Technique. SENSORS (BASEL, SWITZERLAND) 2023; 23:8375. [PMID: 37896469 PMCID: PMC10611125 DOI: 10.3390/s23208375] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Revised: 09/29/2023] [Accepted: 10/05/2023] [Indexed: 10/29/2023]
Abstract
Epilepsy is a chronic neurological disorder affecting around 1% of the global population, characterized by recurrent epileptic seizures. Accurate diagnosis and treatment are crucial for reducing mortality rates. Recent advancements in machine learning (ML) algorithms have shown potential in aiding clinicians with seizure detection in electroencephalography (EEG) data. However, these algorithms face significant challenges due to the patient-specific variability in seizure patterns and the limited availability of high-quality EEG data for training, causing erratic predictions. These erratic predictions are harmful, especially for high-stake domains in healthcare, negatively affecting patients. Therefore, ensuring safety in AI is of the utmost importance. In this study, we propose a novel ensemble method for uncertainty quantification to identify patients with low-confidence predictions in ML-based seizure detection algorithms. Our approach aims to mitigate high-risk predictions in previously unseen seizure patients, thereby enhancing the robustness of existing seizure detection algorithms. Additionally, our method can be implemented with most of the deep learning (DL) models. We evaluated the proposed method against established uncertainty detection techniques, demonstrating its effectiveness in identifying patients for whom the model's predictions are less certain. Our proposed method managed to achieve 87%, 89% and 75% in accuracy, specificity and sensitivity, respectively. This study represents a novel attempt to improve the reliability and robustness of DL algorithms in the domain of seizure detection. This study underscores the value of integrating uncertainty quantification into ML algorithms for seizure detection, offering clinicians a practical tool to gauge the applicability of ML models for individual patients.
Collapse
Affiliation(s)
- Sheng Wong
- Applied Artificial Intelligence Institute, Deakin University, Burwood, VIC 3125, Australia
| | - Anj Simmons
- Applied Artificial Intelligence Institute, Deakin University, Burwood, VIC 3125, Australia
| | | | - Scott Barnett
- Applied Artificial Intelligence Institute, Deakin University, Burwood, VIC 3125, Australia
| |
Collapse
|
11
|
Abreu M, Carmo AS, Peralta AR, Sá F, Plácido da Silva H, Bentes C, Fred AL. PreEpiSeizures: description and outcomes of physiological data acquisition using wearable devices during video-EEG monitoring in people with epilepsy. Front Physiol 2023; 14:1248899. [PMID: 37881691 PMCID: PMC10597694 DOI: 10.3389/fphys.2023.1248899] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2023] [Accepted: 09/04/2023] [Indexed: 10/27/2023] Open
Abstract
The PreEpiSeizures project was created to better understand epilepsy and seizures through wearable technologies. The motivation was to capture physiological information related to epileptic seizures, besides Electroencephalography (EEG) during video-EEG monitorings. If other physiological signals have reliable information of epileptic seizures, unobtrusive wearable technology could be used to monitor epilepsy in daily life. The development of wearable solutions for epilepsy is limited by the nonexistence of datasets which could validate these solutions. Three different form factors were developed and deployed, and the signal quality was assessed for all acquired biosignals. The wearable data acquisition was performed during the video-EEG of patients with epilepsy. The results achieved so far include 59 patients from 2 hospitals totaling 2,721 h of wearable data and 348 seizures. Besides the wearable data, the Electrocardiogram of the hospital is also useable, totalling 5,838 h of hospital data. The quality ECG signals collected with the proposed wearable is equated with the hospital system, and all other biosignals also achieved state-of-the-art quality. During the data acquisition, 18 challenges were identified, and are presented alongside their possible solutions. Though this is an ongoing work, there were many lessons learned which could help to predict possible problems in wearable data collections and also contribute to the epilepsy community with new physiological information. This work contributes with original wearable data and results relevant to epilepsy research, and discusses relevant challenges that impact wearable health monitoring.
Collapse
Affiliation(s)
- Mariana Abreu
- Instituto de Telecomunicações, Lisboa, Portugal
- Departamento de Bioengenharia, Instituto Superior Técnico, Universidade de Lisboa, Lisboa, Portugal
| | - Ana Sofia Carmo
- Instituto de Telecomunicações, Lisboa, Portugal
- Departamento de Bioengenharia, Instituto Superior Técnico, Universidade de Lisboa, Lisboa, Portugal
| | - Ana Rita Peralta
- Lab EEG-Sono, Centro Hospitalar Universitário Lisboa Norte, Hospital de Santa Maria, Lisboa, Portugal
| | - Francisca Sá
- Departamento Neurologia, Centro Hospitalar Lisboa Ocidental, Hospital Egas Moniz, Lisboa, Portugal
| | - Hugo Plácido da Silva
- Instituto de Telecomunicações, Lisboa, Portugal
- Departamento de Bioengenharia, Instituto Superior Técnico, Universidade de Lisboa, Lisboa, Portugal
- Lisbon Unit for Learning and Intelligent Systems (LUMLIS), A Unit of the European Laboratory for Learning and Intelligent Systems (ELLIS), Lisboa, Portugal
| | - Carla Bentes
- Lab EEG-Sono, Centro Hospitalar Universitário Lisboa Norte, Hospital de Santa Maria, Lisboa, Portugal
| | - Ana Luísa Fred
- Instituto de Telecomunicações, Lisboa, Portugal
- Departamento de Bioengenharia, Instituto Superior Técnico, Universidade de Lisboa, Lisboa, Portugal
| |
Collapse
|
12
|
Segal G, Keidar N, Lotan RM, Romano Y, Herskovitz M, Yaniv Y. Utilizing risk-controlling prediction calibration to reduce false alarm rates in epileptic seizure prediction. Front Neurosci 2023; 17:1184990. [PMID: 37790590 PMCID: PMC10543660 DOI: 10.3389/fnins.2023.1184990] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2023] [Accepted: 08/25/2023] [Indexed: 10/05/2023] Open
Abstract
Introduction Epilepsy is a neurological disease characterized by sudden, unprovoked seizures. The unexpected nature of epileptic seizures is a major component of the disease burden. Predicting seizure onset and alarming patients may allow timely intervention, which would improve clinical outcomes and patient quality of life. Currently, algorithms aiming to predict seizures suffer from a high false alarm rate, rendering them unsuitable for clinical use. Methods We adopted here a risk-controlling prediction calibration method called Learn then Test to reduce false alarm rates of seizure prediction. This method calibrates the output of a "black-box" model to meet a specified false alarm rate requirement. The method was initially validated on synthetic data and subsequently tested on publicly available electroencephalogram (EEG) records from 15 patients with epilepsy by calibrating the outputs of a deep learning model. Results and discussion Validation showed that the calibration method rigorously controlled the false alarm rate at a user-desired level after our adaptation. Real data testing showed an average of 92% reduction in the false alarm rate, at the cost of missing four of nine seizures of six patients. Better-performing prediction models combined with the proposed method may facilitate the clinical use of real-time seizure prediction systems.
Collapse
Affiliation(s)
- Galya Segal
- Laboratory of Bioenergetic and Bioelectric Systems, Biomedical Engineering Faculty, Technion-Israel Institute of Technology (IIT), Haifa, Israel
- Faculty of Medicine, Technion-Israel Institute of Technology (IIT), Haifa, Israel
| | - Noam Keidar
- Laboratory of Bioenergetic and Bioelectric Systems, Biomedical Engineering Faculty, Technion-Israel Institute of Technology (IIT), Haifa, Israel
| | - Roy Maor Lotan
- Computer Science Department, Technion-Israel Institute of Technology (IIT), Haifa, Israel
- Electrical and Computer Engineering Department, Technion-Israel Institute of Technology (IIT), Haifa, Israel
| | - Yaniv Romano
- Computer Science Department, Technion-Israel Institute of Technology (IIT), Haifa, Israel
- Electrical and Computer Engineering Department, Technion-Israel Institute of Technology (IIT), Haifa, Israel
| | - Moshe Herskovitz
- Faculty of Medicine, Technion-Israel Institute of Technology (IIT), Haifa, Israel
- Department of Neurology, Rambam Health Care Campus, Haifa, Israel
| | - Yael Yaniv
- Laboratory of Bioenergetic and Bioelectric Systems, Biomedical Engineering Faculty, Technion-Israel Institute of Technology (IIT), Haifa, Israel
| |
Collapse
|