Refining epileptogenic high-frequency oscillations using deep learning: a reverse engineering approach

Networks through the lens of high-frequency oscillations

To date, there is no neurophysiologic or neuroimaging biomarker that can accurately delineate the epileptogenic network. High-frequency oscillations (HFO) have been proposed as biomarkers for epileptogenesis and the epileptogenic network. The pathological HFO have been associated with areas of seizure onset and epileptogenic tissue. Several studies have demonstrated that the resection of areas with high rates of pathological HFO is associated with favorable postoperative outcomes. Recent studies have demonstrated the spatiotemporal organization of HFO into networks and their potential role in defining epileptogenic networks. Our review will present the existing literature on HFO-associated networks, specifically focusing on their role in defining epileptogenic networks and their potential significance in surgical planning.

Self-Supervised Data-Driven Approach Defines Pathological High-Frequency Oscillations in Human

Objective

Interictal high-frequency oscillations (HFOs) are a promising neurophysiological biomarker of the epileptogenic zone (EZ). However, objective criteria for distinguishing pathological from physiological HFOs remain elusive, hindering clinical application. We investigated whether the distinct mechanisms underlying pathological and physiological HFOs are encapsulated in their signal morphology in intracranial EEG (iEEG) recordings and whether this mechanism-driven distinction could be simulated by a deep generative model.

Methods

In a retrospective cohort of 185 epilepsy patients who underwent iEEG monitoring, we analyzed 686,410 HFOs across 18,265 brain contacts. To learn morphological characteristics, each event was transformed into a time-frequency plot and input into a variational autoencoder. We characterized latent space clusters containing morphologically defined putative pathological HFOs (mpHFOs) using interpretability analysis, including latent space disentanglement and time-domain perturbation.

Results

mpHFOs showed strong associations with expert-defined spikes and were predominantly located within the seizure onset zone (SOZ). Discovered novel pathological features included high power in the gamma (30-80 Hz) and ripple (>80 Hz) bands centered on the event. These characteristics were consistent across multiple variables, including institution, electrode type, and patient demographics. Predicting 12-month postoperative seizure outcomes using the resection ratio of mpHFOs outperformed unclassified HFOs (F1=0.72 vs. 0.68) and matched current clinical standards using SOZ resection (F1=0.74). Combining mpHFO data with demographic and SOZ resection status further improved prediction accuracy (F1=0.83).

Interpretation

Our data-driven approach yielded a novel, explainable definition of pathological HFOs, which has the potential to further enhance the clinical use of HFOs for EZ delineation.

Machine learning for (non-)epileptic tissue detection from the intraoperative electrocorticogram

OBJECTIVE

Clinical visual intraoperative electrocorticography (ioECoG) reading intends to localize epileptic tissue and improve epilepsy surgery outcome. We aimed to understand whether machine learning (ML) could complement ioECoG reading, how subgroups affected performance, and which ioECoG features were most important.

METHODS

We included 91 ioECoG-guided epilepsy surgery patients with Engel 1A outcome. We allocated 71 training and 20 test set patients. We trained an extra trees classifier (ETC) with 14 spectral features to classify ioECoG channels as covering resected or non-resected tissue. We compared the ETC's performance with clinical ioECoG reading and assessed whether patient subgroups affected performance. Explainable artificial intelligence (xAI) unveiled the most important ioECoG features learnt by the ETC.

RESULTS

The ETC outperformed clinical reading in five test set patients, was inferior in six, and both were inconclusive in nine. The ETC performed best in the tumor subgroup (area under ROC curve: 0.84 [95%CI 0.79-0.89]). xAI revealed predictors of resected (relative theta, alpha, and fast ripple power) and non-resected tissue (relative beta and gamma power).

CONCLUSIONS

Combinations of subtle spectral ioECoG changes, imperceptible by the human eye, can aid healthy and pathological tissue discrimination.

SIGNIFICANCE

ML with spectral ioECoG features can support, rather than replace, clinical ioECoG reading, particularly in tumors.

WONOEP 2022: Neurotechnology for the diagnosis of epilepsy

Epilepsy's myriad causes and clinical presentations ensure that accurate diagnoses and targeted treatments remain a challenge. Advanced neurotechnologies are needed to better characterize individual patients across multiple modalities and analytical techniques. At the XVIth Workshop on Neurobiology of Epilepsy: Early Onset Epilepsies: Neurobiology and Novel Therapeutic Strategies (WONOEP 2022), the session on "advanced tools" highlighted a range of approaches, from molecular phenotyping of genetic epilepsy models and resected tissue samples to imaging-guided localization of epileptogenic tissue for surgical resection of focal malformations. These tools integrate cutting edge research, clinical data acquisition, and advanced computational methods to leverage the rich information contained within increasingly large datasets. A number of common challenges and opportunities emerged, including the need for multidisciplinary collaboration, multimodal integration, potential ethical challenges, and the multistage path to clinical translation. Despite these challenges, advanced epilepsy neurotechnologies offer the potential to improve our understanding of the underlying causes of epilepsy and our capacity to provide patient-specific treatment.

Artificial intelligence in epilepsy - applications and pathways to the clinic

Artificial intelligence (AI) is rapidly transforming health care, and its applications in epilepsy have increased exponentially over the past decade. Integration of AI into epilepsy management promises to revolutionize the diagnosis and treatment of this complex disorder. However, translation of AI into neurology clinical practice has not yet been successful, emphasizing the need to consider progress to date and assess challenges and limitations of AI. In this Review, we provide an overview of AI applications that have been developed in epilepsy using a variety of data modalities: neuroimaging, electroencephalography, electronic health records, medical devices and multimodal data integration. For each, we consider potential applications, including seizure detection and prediction, seizure lateralization, localization of the seizure-onset zone and assessment for surgical or neurostimulation interventions, and review the performance of AI tools developed to date. We also discuss methodological considerations and challenges that must be addressed to successfully integrate AI into clinical practice. Our goal is to provide an overview of the current state of the field and provide guidance for leveraging AI in future to improve management of epilepsy.

PyHFO: lightweight deep learning-powered end-to-end high-frequency oscillations analysis application

Objective. This study aims to develop and validate an end-to-end software platform, PyHFO, that streamlines the application of deep learning (DL) methodologies in detecting neurophysiological biomarkers for epileptogenic zones from EEG recordings.Approach. We introduced PyHFO, which enables time-efficient high-frequency oscillation (HFO) detection algorithms like short-term energy and Montreal Neurological Institute and Hospital detectors. It incorporates DL models for artifact and HFO with spike classification, designed to operate efficiently on standard computer hardware.Main results. The validation of PyHFO was conducted on three separate datasets: the first comprised solely of grid/strip electrodes, the second a combination of grid/strip and depth electrodes, and the third derived from rodent studies, which sampled the neocortex and hippocampus using depth electrodes. PyHFO demonstrated an ability to handle datasets efficiently, with optimization techniques enabling it to achieve speeds up to 50 times faster than traditional HFO detection applications. Users have the flexibility to employ our pre-trained DL model or use their EEG data for custom model training.Significance. PyHFO successfully bridges the computational challenge faced in applying DL techniques to EEG data analysis in epilepsy studies, presenting a feasible solution for both clinical and research settings. By offering a user-friendly and computationally efficient platform, PyHFO paves the way for broader adoption of advanced EEG data analysis tools in clinical practice and fosters potential for large-scale research collaborations.

PolypMixNet: Enhancing semi-supervised polyp segmentation with polyp-aware augmentation

BACKGROUND

AI-assisted polyp segmentation in colonoscopy plays a crucial role in enabling prompt diagnosis and treatment of colorectal cancer. However, the lack of sufficient annotated data poses a significant challenge for supervised learning approaches. Existing semi-supervised learning methods also suffer from performance degradation, mainly due to task-specific characteristics, such as class imbalance in polyp segmentation.

PURPOSE

The purpose of this work is to develop an effective semi-supervised learning framework for accurate polyp segmentation in colonoscopy, addressing limited annotated data and class imbalance challenges.

METHODS

We proposed PolypMixNet, a semi-supervised framework, for colorectal polyp segmentation, utilizing novel augmentation techniques and a Mean Teacher architecture to improve model performance. PolypMixNet introduces the polyp-aware mixup (PolypMix) algorithm and incorporates dual-level consistency regularization. PolypMix addresses the class imbalance in colonoscopy datasets and enhances the diversity of training data. By performing a polyp-aware mixup on unlabeled samples, it generates mixed images with polyp context along with their artificial labels. A polyp-directed soft pseudo-labeling (PDSPL) mechanism was proposed to generate high-quality pseudo labels and eliminate the dilution of lesion features caused by mixup operations. To ensure consistency in the training phase, we introduce the PolypMix prediction consistency (PMPC) loss and PolypMix attention consistency (PMAC) loss, enforcing consistency at both image and feature levels. Code is available at https://github.com/YChienHung/PolypMix.

RESULTS

PolypMixNet was evaluated on four public colonoscopy datasets, achieving 88.97% Dice and 88.85% mIoU on the benchmark dataset of Kvasir-SEG. In scenarios where the labeled training data is limited to 15%, PolypMixNet outperforms the state-of-the-art semi-supervised approaches with a 2.88-point improvement in Dice. It also shows the ability to reach performance comparable to the fully supervised counterpart. Additionally, we conducted extensive ablation studies to validate the effectiveness of each module and highlight the superiority of our proposed approach.

CONCLUSION

PolypMixNet effectively addresses the challenges posed by limited annotated data and unbalanced class distributions in polyp segmentation. By leveraging unlabeled data and incorporating novel augmentation and consistency regularization techniques, our method achieves state-of-the-art performance. We believe that the insights and contributions presented in this work will pave the way for further advancements in semi-supervised polyp segmentation and inspire future research in the medical imaging domain.

Optimizing detection and deep learning-based classification of pathological high-frequency oscillations in epilepsy

OBJECTIVE

This study aimed to explore sensitive detection methods for pathological high-frequency oscillations (HFOs) to improve seizure outcomes in epilepsy surgery.

METHODS

We analyzed interictal HFOs (80-500 Hz) in 15 children with medication-resistant focal epilepsy who underwent chronic intracranial electroencephalogram via subdural grids. The HFOs were assessed using the short-term energy (STE) and Montreal Neurological Institute (MNI) detectors and examined for spike association and time-frequency plot characteristics. A deep learning (DL)-based classification was applied to purify pathological HFOs. Postoperative seizure outcomes were correlated with HFO-resection ratios to determine the optimal HFO detection method.

RESULTS

The MNI detector identified a higher percentage of pathological HFOs than the STE detector, but some pathological HFOs were detected only by the STE detector. HFOs detected by both detectors had the highest spike association rate. The Union detector, which detects HFOs identified by either the MNI or STE detector, outperformed other detectors in predicting postoperative seizure outcomes using HFO-resection ratios before and after DL-based purification.

CONCLUSIONS

HFOs detected by standard automated detectors displayed different signal and morphological characteristics. DL-based classification effectively purified pathological HFOs.

SIGNIFICANCE

Enhancing the detection and classification methods of HFOs will improve their utility in predicting postoperative seizure outcomes.

Optimizing Detection and Deep Learning-based Classification of Pathological High-Frequency Oscillations in Epilepsy

Objective

This study aimed to explore sensitive detection methods and deep learning (DL)-based classification for pathological high-frequency oscillations (HFOs).

Methods

We analyzed interictal HFOs (80-500 Hz) in 15 children with medication-resistant focal epilepsy who underwent resection after chronic intracranial electroencephalogram via subdural grids. The HFOs were assessed using the short-term energy (STE) and Montreal Neurological Institute (MNI) detectors and examined for pathological features based on spike association and time-frequency plot characteristics. A DL-based classification was applied to purify pathological HFOs. Postoperative seizure outcomes were correlated with HFO-resection ratios to determine the optimal HFO detection method.

Results

The MNI detector identified a higher percentage of pathological HFOs than the STE detector, but some pathological HFOs were detected only by the STE detector. HFOs detected by both detectors exhibited the most pathological features. The Union detector, which detects HFOs identified by either the MNI or STE detector, outperformed other detectors in predicting postoperative seizure outcomes using HFO-resection ratios before and after DL-based purification.

Conclusions

HFOs detected by standard automated detectors displayed different signal and morphological characteristics. DL-based classification effectively purified pathological HFOs.

Significance

Enhancing the detection and classification methods of HFOs will improve their utility in predicting postoperative seizure outcomes.

HIGHLIGHTS

HFOs detected by the MNI detector showed different traits and higher pathological bias than those detected by the STE detectorHFOs detected by both MNI and STE detectors (the Intersection HFOs) were deemed the most pathologicalA deep learning-based classification was able to distill pathological HFOs, regard-less of the initial HFO detection methods.

Characterizing physiological high-frequency oscillations using deep learning

Objective.Intracranially-recorded interictal high-frequency oscillations (HFOs) have been proposed as a promising spatial biomarker of the epileptogenic zone. However, HFOs can also be recorded in the healthy brain regions, which complicates the interpretation of HFOs. The present study aimed to characterize salient features of physiological HFOs using deep learning (DL).Approach.We studied children with neocortical epilepsy who underwent intracranial strip/grid evaluation. Time-series EEG data were transformed into DL training inputs. The eloquent cortex (EC) was defined by functional cortical mapping and used as a DL label. Morphological characteristics of HFOs obtained from EC (ecHFOs) were distilled and interpreted through a novel weakly supervised DL model.Main results.A total of 63 379 interictal intracranially-recorded HFOs from 18 children were analyzed. The ecHFOs had lower amplitude throughout the 80-500 Hz frequency band around the HFO onset and also had a lower signal amplitude in the low frequency band throughout a one-second time window than non-ecHFOs, resembling a bell-shaped template in the time-frequency map. A minority of ecHFOs were HFOs with spikes (22.9%). Such morphological characteristics were confirmed to influence DL model prediction via perturbation analyses. Using the resection ratio (removed HFOs/detected HFOs) of non-ecHFOs, the prediction of postoperative seizure outcomes improved compared to using uncorrected HFOs (area under the ROC curve of 0.82, increased from 0.76).Significance.We characterized salient features of physiological HFOs using a DL algorithm. Our results suggested that this DL-based HFO classification, once trained, might help separate physiological from pathological HFOs, and efficiently guide surgical resection using HFOs.

Deep learning in neuroimaging data analysis: Applications, challenges, and solutions

Methods for the analysis of neuroimaging data have advanced significantly since the beginning of neuroscience as a scientific discipline. Today, sophisticated statistical procedures allow us to examine complex multivariate patterns, however most of them are still constrained by assuming inherent linearity of neural processes. Here, we discuss a group of machine learning methods, called deep learning, which have drawn much attention in and outside the field of neuroscience in recent years and hold the potential to surpass the mentioned limitations. Firstly, we describe and explain the essential concepts in deep learning: the structure and the computational operations that allow deep models to learn. After that, we move to the most common applications of deep learning in neuroimaging data analysis: prediction of outcome, interpretation of internal representations, generation of synthetic data and segmentation. In the next section we present issues that deep learning poses, which concerns multidimensionality and multimodality of data, overfitting and computational cost, and propose possible solutions. Lastly, we discuss the current reach of DL usage in all the common applications in neuroimaging data analysis, where we consider the promise of multimodality, capability of processing raw data, and advanced visualization strategies. We identify research gaps, such as focusing on a limited number of criterion variables and the lack of a well-defined strategy for choosing architecture and hyperparameters. Furthermore, we talk about the possibility of conducting research with constructs that have been ignored so far or/and moving toward frameworks, such as RDoC, the potential of transfer learning and generation of synthetic data.

Clinical neuroscience and neurotechnology: An amazing symbiosis

In the last decades, clinical neuroscience found a novel ally in neurotechnologies, devices able to record and stimulate electrical activity in the nervous system. These technologies improved the ability to diagnose and treat neural disorders. Neurotechnologies are concurrently enabling a deeper understanding of healthy and pathological dynamics of the nervous system through stimulation and recordings during brain implants. On the other hand, clinical neurosciences are not only driving neuroengineering toward the most relevant clinical issues, but are also shaping the neurotechnologies thanks to clinical advancements. For instance, understanding the etiology of a disease informs the location of a therapeutic stimulation, but also the way stimulation patterns should be designed to be more effective/naturalistic. Here, we describe cases of fruitful integration such as Deep Brain Stimulation and cortical interfaces to highlight how this symbiosis between clinical neuroscience and neurotechnology is closer to a novel integrated framework than to a simple interdisciplinary interaction.

Automatic Detection of High-Frequency Oscillations Based on an End-to-End Bi-Branch Neural Network and Clinical Cross-Validation

Accurate identification of high-frequency oscillation (HFO) is an important prerequisite for precise localization of epileptic foci and good prognosis of drug-refractory epilepsy. Exploring a high-performance automatic detection method for HFOs can effectively help clinicians reduce the error rate and reduce manpower. Due to the limited analysis perspective and simple model design, it is difficult to meet the requirements of clinical application by the existing methods. Therefore, an end-to-end bi-branch fusion model is proposed to automatically detect HFOs. With the filtered band-pass signal (signal branch) and time-frequency image (TFpic branch) as the input of the model, two backbone networks for deep feature extraction are established, respectively. Specifically, a hybrid model based on ResNet1d and long short-term memory (LSTM) is designed for signal branch, which can focus on both the features in time and space dimension, while a ResNet2d with a Convolutional Block Attention Module (CBAM) is constructed for TFpic branch, by which more attention is paid to useful information of TF images. Then the outputs of two branches are fused to realize end-to-end automatic identification of HFOs. Our method is verified on 5 patients with intractable epilepsy. In intravalidation, the proposed method obtained high sensitivity of 94.62%, specificity of 92.7%, and F1-score of 93.33%, and in cross-validation, our method achieved high sensitivity of 92.00%, specificity of 88.26%, and F1-score of 89.11% on average. The results show that the proposed method outperforms the existing detection paradigms of either single signal or single time-frequency diagram strategy. In addition, the average kappa coefficient of visual analysis and automatic detection results is 0.795. The method shows strong generalization ability and high degree of consistency with the gold standard meanwhile. Therefore, it has great potential to be a clinical assistant tool.