Multimodal data analysis of epileptic EEG and rs-fMRI via deep learning and edge computing

A Review of EEG-based Localization of Epileptic Seizure Foci: Common Points with Multimodal Fusion of Brain Data

Unexpected seizures significantly decrease the quality of life in epileptic patients. Seizure attacks are caused by hyperexcitability and anatomical lesions of special regions of the brain, and cognitive impairments and memory deficits are their most common concomitant effects. In addition to seizure reduction treatments, medical rehabilitation involving brain-computer interfaces and neurofeedback can improve cognition and quality of life in patients with focal epilepsy in most cases, in particular when resective epilepsy surgery has been considered treatment in drug-resistant epilepsy. Source estimation and precise localization of epileptic foci can improve such rehabilitation and treatment. Electroencephalography (EEG) monitoring and multimodal noninvasive neuroimaging techniques such as ictal/interictal single-photon emission computerized tomography (SPECT) imaging and structural magnetic resonance imaging are common practices for the localization of epileptic foci and have been studied in several kinds of researches. In this article, we review the most recent research on EEG-based localization of seizure foci and discuss various methods, their advantages, limitations, and challenges with a focus on model-based data processing and machine learning algorithms. In addition, we survey whether combined analysis of EEG monitoring and neuroimaging techniques, which is known as multimodal brain data fusion, can potentially increase the precision of the seizure foci localization. To this end, we further review and summarize the key parameters and challenges of processing, fusion, and analysis of multiple source data, in the framework of model-based signal processing, for the development of a multimodal brain data analyzing system. This article has the potential to be used as a valuable resource for neuroscience researchers for the development of EEG-based rehabilitation systems based on multimodal data analysis related to focal epilepsy.

A Glimpse into the AI-Driven Advances in Neurobiology and Neurologic Diseases

Recent developments in AI, especially in machine learning and deep learning, have opened new avenues for research and clinical practice in neurology [...].

A Novel Framework for Data Assessment That Uses Edge Technology to Improve the Detection of Communicable Diseases

Spreading quickly throughout populations, whether animal or human-borne, infectious illnesses provide serious risks and difficulties. Controlling their spread and averting disinformation requires effective risk assessment and epidemic identification. Technology-enabled data analysis on diseases allows for quick solutions to these problems. A Combinational Data Assessment Scheme intended to accelerate disease detection is presented in this paper. The suggested strategy avoids duplicate data replication by sharing data among edge devices. It uses indexed data gathering to improve early detection by using tree classifiers to discern between various kinds of information. Both data similarity and index measurements are considered throughout the data analysis stage to minimize assessment errors. Accurate risk detection and assessment based on information kind and sharing frequency are ensured by comparing non-linear accumulations with accurate shared edge data. The suggested system exhibits high accuracy, low mistakes, and decreased data repetition to improve overall effectiveness in illness detection and risk reduction.

Multimodal audio-visual robot fusing 3D CNN and CRNN for player behavior recognition and prediction in basketball matches

Introduction

Intelligent robots play a crucial role in enhancing efficiency, reducing costs, and improving safety in the logistics industry. However, traditional path planning methods often struggle to adapt to dynamic environments, leading to issues such as collisions and conflicts. This study aims to address the challenges of path planning and control for logistics robots in complex environments.

Methods

The proposed method integrates information from different perception modalities to achieve more accurate path planning and obstacle avoidance control, thereby enhancing the autonomy and reliability of logistics robots. Firstly, a 3D convolutional neural network (CNN) is employed to learn the feature representation of objects in the environment for object recognition. Next, long short-term memory (LSTM) is used to model spatio-temporal features and predict the behavior and trajectory of dynamic obstacles. This enables the robot to accurately predict the future position of obstacles in complex environments, reducing collision risks. Finally, the Dijkstra algorithm is applied for path planning and control decisions to ensure the robot selects the optimal path in various scenarios.

Results

Experimental results demonstrate the effectiveness of the proposed method in terms of path planning accuracy and obstacle avoidance performance. The method outperforms traditional approaches, showing significant improvements in both aspects.

Discussion

The intelligent path planning and control scheme presented in this paper enhances the practicality of logistics robots in complex environments, thereby promoting efficiency and safety in the logistics industry.

Reducing pediatric total-body PET/CT imaging scan time with multimodal artificial intelligence technology

OBJECTIVES

This study aims to decrease the scan time and enhance image quality in pediatric total-body PET imaging by utilizing multimodal artificial intelligence techniques.

METHODS

A total of 270 pediatric patients who underwent total-body PET/CT scans with a uEXPLORER at the Sun Yat-sen University Cancer Center were retrospectively enrolled. 18F-fluorodeoxyglucose (18F-FDG) was administered at a dose of 3.7 MBq/kg with an acquisition time of 600 s. Short-term scan PET images (acquired within 6, 15, 30, 60 and 150 s) were obtained by truncating the list-mode data. A three-dimensional (3D) neural network was developed with a residual network as the basic structure, fusing low-dose CT images as prior information, which were fed to the network at different scales. The short-term PET images and low-dose CT images were processed by the multimodal 3D network to generate full-length, high-dose PET images. The nonlocal means method and the same 3D network without the fused CT information were used as reference methods. The performance of the network model was evaluated by quantitative and qualitative analyses.

RESULTS

Multimodal artificial intelligence techniques can significantly improve PET image quality. When fused with prior CT information, the anatomical information of the images was enhanced, and 60 s of scan data produced images of quality comparable to that of the full-time data.

CONCLUSION

Multimodal artificial intelligence techniques can effectively improve the quality of pediatric total-body PET/CT images acquired using ultrashort scan times. This has the potential to decrease the use of sedation, enhance guardian confidence, and reduce the probability of motion artifacts.

A comparative study of machine learning methods for classifying ERP scalp distribution

Objective. Machine learning (ML) methods are used in different fields for classification and regression purposes with different applications. These methods are also used with various non-invasive brain signals, including Electroencephalography (EEG) signals to detect some patterns in the brain signals. ML methods are considered critical tools for EEG analysis since could overcome some of the limitations in the traditional methods of EEG analysis such as Event-related potentials (ERPs) analysis. The goal of this paper was to apply ML classification methods on ERP scalp distribution to investigate the performance of these methods in identifying numerical information carried in different finger-numeral configurations (FNCs). FNCs in their three forms of montring, counting, and non-canonical counting are used for communication, counting, and doing arithmetic across the world between children and even adults. Studies have shown the relationship between perceptual and semantic processing of FNCs, and neural differences in visually identifying different types of FNCs.Approach.A publicly available 32-channel EEG dataset recorded for 38 participants while they were shown a picture of an FNC (i.e., three categories and four numbers of 1,2,3, and 4) was used. EEG data were pre-processed and ERP scalp distribution of different FNCs was classified across time by six ML methods, including support vector machine, linear discriminant analysis, naïve Bayes, decision tree, K-nearest neighbor, and neural network. The classification was conducted in two conditions: classifying all FNCs together (i.e., 12 classes) and classifying FNCs of each category separately (i.e., 4 classes).Results.The support vector machine had the highest classification accuracy for both conditions. For classifying all FNCs together, the K-nearest neighbor was the next in line; however, the neural network could retrieve numerical information from the FNCs for category-specific classification.Significance.The significance of this study is in exploring the application of multiple ML methods in recognizing numerical information contained in ERP scalp distribution of different finger-numeral configurations.

Deep Learning Aided Neuroimaging and Brain Regulation

Currently, deep learning aided medical imaging is becoming the hot spot of AI frontier application and the future development trend of precision neuroscience. This review aimed to render comprehensive and informative insights into the recent progress of deep learning and its applications in medical imaging for brain monitoring and regulation. The article starts by providing an overview of the current methods for brain imaging, highlighting their limitations and introducing the potential benefits of using deep learning techniques to overcome these limitations. Then, we further delve into the details of deep learning, explaining the basic concepts and providing examples of how it can be used in medical imaging. One of the key strengths is its thorough discussion of the different types of deep learning models that can be used in medical imaging including convolutional neural networks (CNNs), recurrent neural networks (RNNs), and generative adversarial network (GAN) assisted magnetic resonance imaging (MRI), positron emission tomography (PET)/computed tomography (CT), electroencephalography (EEG)/magnetoencephalography (MEG), optical imaging, and other imaging modalities. Overall, our review on deep learning aided medical imaging for brain monitoring and regulation provides a referrable glance for the intersection of deep learning aided neuroimaging and brain regulation.

Task-Based and Resting-State Functional MRI in Observing Eloquent Cerebral Areas Personalized for Epilepsy and Surgical Oncology Patients: A Review of the Current Evidence

Functional magnetic resonance imaging (fMRI) is among the newest techniques of advanced neuroimaging that offer the opportunity for neuroradiologists, neurophysiologists, neuro-oncologists, and neurosurgeons to pre-operatively plan and manage different types of brain lesions. Furthermore, it plays a fundamental role in the personalized evaluation of patients with brain tumors or patients with an epileptic focus for preoperative planning. While the implementation of task-based fMRI has increased in recent years, the existing resources and evidence related to this technique are limited. We have, therefore, conducted a comprehensive review of the available resources to compile a detailed resource for physicians who specialize in managing patients with brain tumors and seizure disorders. This review contributes to the existing literature because it highlights the lack of studies on fMRI and its precise role and applicability in observing eloquent cerebral areas in surgical oncology and epilepsy patients, which we believe is underreported. Taking these considerations into account would help to better understand the role of this advanced neuroimaging technique and, ultimately, improve patient life expectancy and quality of life.

A transformer model for learning spatiotemporal contextual representation in fMRI data

Representation learning is a core component in data-driven modeling of various complex phenomena. Learning a contextually informative representation can especially benefit the analysis of fMRI data because of the complexities and dynamic dependencies present in such datasets. In this work, we propose a framework based on transformer models to learn an embedding of the fMRI data by taking the spatiotemporal contextual information in the data into account. This approach takes the multivariate BOLD time series of the regions of the brain as well as their functional connectivity network simultaneously as the input to create a set of meaningful features that can in turn be used in various downstream tasks such as classification, feature extraction, and statistical analysis. The proposed spatiotemporal framework uses the attention mechanism as well as the graph convolution neural network to jointly inject the contextual information regarding the dynamics in time series data and their connectivity into the representation. We demonstrate the benefits of this framework by applying it to two resting-state fMRI datasets, and provide further discussion on various aspects and advantages of it over a number of other commonly adopted architectures.

Epilepsy seizure prediction with few-shot learning method

Epileptic seizures prediction and timely alarms allow the patient to take effective and preventive actions. In this paper, a convolutional neural network (CNN) is proposed to diagnose the preictal period. Our goal is for those epileptic patients in whom seizures occur late and it is very challenging to record the preictal signal for them. In the previous works, generalized methods were inevitably used for this group of patients which were not very accurate. Our approach to solve this problem is to provide a few-shot learning method. This method, having the previous knowledge, is trained with only a small number of samples, learns new tasks and reduces the efforts to collect more data. Evaluation results for three patients from the CHB–MIT database, for a 10-min seizure prediction horizon (SPH) and a 20-min seizure occurrence period (SOP), averaged sensitivity of 95.70% and a false prediction rate (FPR) of 0.057/h and for the 5-min prediction horizon and the 25-min seizure occurrence period averaged sensitivity of 98.52% and a false prediction rate of (FPR) of 0.045/h. The proposed few-shot learning method, based on previous knowledge gained from the generalizable method, is regulated with a few new patient samples for the patient. Our results show that the accuracy obtained in this method is higher than the generalizable methods.

Decoding Intracranial EEG With Machine Learning: A Systematic Review

Advances in intracranial electroencephalography (iEEG) and neurophysiology have enabled the study of previously inaccessible brain regions with high fidelity temporal and spatial resolution. Studies of iEEG have revealed a rich neural code subserving healthy brain function and which fails in disease states. Machine learning (ML), a form of artificial intelligence, is a modern tool that may be able to better decode complex neural signals and enhance interpretation of these data. To date, a number of publications have applied ML to iEEG, but clinician awareness of these techniques and their relevance to neurosurgery, has been limited. The present work presents a review of existing applications of ML techniques in iEEG data, discusses the relative merits and limitations of the various approaches, and examines potential avenues for clinical translation in neurosurgery. One-hundred-seven articles examining artificial intelligence applications to iEEG were identified from 3 databases. Clinical applications of ML from these articles were categorized into 4 domains: i) seizure analysis, ii) motor tasks, iii) cognitive assessment, and iv) sleep staging. The review revealed that supervised algorithms were most commonly used across studies and often leveraged publicly available timeseries datasets. We conclude with recommendations for future work and potential clinical applications.

The Bilateral Precuneus as a Potential Neuroimaging Biomarker for Right Temporal Lobe Epilepsy: A Support Vector Machine Analysis

Background and Objective

While evidence has demonstrated that the default-mode network (DMN) plays a key role in the broad-scale cognitive problems that occur in right temporal lobe epilepsy (rTLE), little is known about alterations in the network homogeneity (NH) of the DMN in TLE. In this study, we used the NH method to investigate the NH of the DMN in TLE at rest, and an support vector machine (SVM) method for the diagnosis of rTLE.

Methods

A total of 43 rTLE cases and 42 healthy controls (HCs) underwent resting-state functional magnetic resonance imaging (rs-fMRI). Imaging data were analyzed with the NH and SVM methods.

Results

rTLE patients have a decreased NH in the right inferior temporal gyrus (ITG) and left middle temporal gyrus (MTG), but increased NH in the bilateral precuneus (PCu) and right inferior parietal lobe (IPL), compared with HCs. We found that rTLE had a longer performance reaction time (RT). No significant correlation was found between abnormal NH values and clinical variables of the patients. The SVM results showed that increased NH in the bilateral PCu as a diagnostic biomarker distinguished rTLE from HCs with an accuracy of 74.12% (63/85), a sensitivity 72.01% (31/43), and a specificity 72.81% (31/42).

Conclusion

These findings suggest that abnormal NH of the DMN exists in rTLE, and highlights the significance of the DMN in the pathophysiology of cognitive problems occurring in rTLE, and the bilateral PCu as a neuroimaging diagnostic biomarker for rTLE.

Construction of Knowledge Graph of 3D Clothing Design Resources Based on Multimodal Clustering Network

The construction of 3D design model is a hotspot of applied research in the fields of clothing functional design system teaching and display. The simple 3D clothing visualization postprocessing lacks interactive functions, which is a hot issue that needs to be solved urgently at present. Based on analyzing the existing clothing modeling technology, template technology, and fusion technology, and based on the multimodal clustering network theory, this paper proposes a 3D clothing design resource knowledge graph modeling method with multiple fusion of features and templates. The position of each joint point is converted into the coordinate system centered on the torso point in advance and normalized to avoid the problem that the relative position of the camera and the collector cannot be determined, and the shape of different collectors is different. The paper provides a multimodal clustering network intelligence method, illustrates the interoperability of users switching between different design networks in the seamless connection movement, and combines the hybrid intelligence algorithm with the fuzzy logic interpretation algorithm to solve the problems in the field of 3D clothing design service quality. During the simulation process, the research scheme builds a logical multimodal clustering network framework, which integrates compatibility access and global access partition fusion of style templates to achieve information extraction of clothing parts. The experimental results show that the realistic 3D clothing modeling can be achieved by layering the 3D clothing map, contour features, clothing size features, and color texture features with the modeling template. The developed ActiveX control is mounted on MSN, and the system is compatible. The performance and integration rate reached 77.1% and 89.7%, respectively, which effectively strengthened the practical role of the 3D clothing design system.

A polygenic stacking classifier revealed the complicated platelet transcriptomic landscape of adult immune thrombocytopenia

Immune thrombocytopenia (ITP) is an autoimmune disease with the typical symptom of a low platelet count in blood. ITP demonstrated age and sex biases in both occurrences and prognosis, and adult ITP was mainly induced by the living environments. The current diagnosis guideline lacks the integration of molecular heterogenicity. This study recruited the largest cohort of platelet transcriptome samples. A comprehensive procedure of feature selection, feature engineering, and stacking classification was carried out to detect the ITP biomarkers using RNA sequencing (RNA-seq) transcriptomes. The 40 detected biomarkers were loaded to train the final ITP detection model, with an overall accuracy 0.974. The biomarkers suggested that ITP onset may be associated with various transcribed components, including protein-coding genes, long intergenic non-coding RNA (lincRNA) genes, and pseudogenes with apparent transcriptions. The delivered ITP detection model may also be utilized as a complementary ITP diagnosis tool. The code and the example dataset is freely available on http://www.healthinformaticslab.org/supp/resources.php

Foundations of Lesion Detection Using Machine Learning in Clinical Neuroimaging

This chapter describes technical considerations and current and future clinical applications of lesion detection using machine learning in the clinical setting. Lesion detection is central to neuroradiology and precedes all further processes which include but are not limited to lesion characterization, quantification, longitudinal disease assessment, prognosis, and prediction of treatment response. A number of machine learning algorithms focusing on lesion detection have been developed or are currently under development which may either support or extend the imaging process. Examples include machine learning applications in stroke, aneurysms, multiple sclerosis, neuro-oncology, neurodegeneration, and epilepsy.

File System Support for Privacy-Preserving Analysis and Forensics in Low-Bandwidth Edge Environments

In this paper, we present initial results from our distributed edge systems research in the domain of sustainable harvesting of common good resources in the Arctic Ocean. Specifically, we are developing a digital platform for real-time privacy-preserving sustainability management in the domain of commercial fishery surveillance operations. This is in response to potentially privacy-infringing mandates from some governments to combat overfishing and other sustainability challenges. Our approach is to deploy sensory devices and distributed artificial intelligence algorithms on mobile, offshore fishing vessels and at mainland central control centers. To facilitate this, we need a novel data plane supporting efficient, available, secure, tamper-proof, and compliant data management in this weakly connected offshore environment. We have built our first prototype of Dorvu, a novel distributed file system in this context. Our devised architecture, the design trade-offs among conflicting properties, and our initial experiences are further detailed in this paper.

Accurate lateralization and classification of MRI-negative 18F-FDG-PET-positive temporal lobe epilepsy using double inversion recovery and machine-learning

OBJECTIVE

The main objective of this study was to determine the ability of double inversion recovery (DIR) data coupled with machine-learning algorithms to distinguish normal individuals from epileptic subjects and to identify the laterality of the focus side in MRI-negative, PET-positive temporal lobe epilepsy (TLE) patients.

MATERIALS AND METHODS

We used whole-brain DIR data as the input features with which to train a linear support-vector machine model in 63 participants who underwent high-resolution structural MRI and DIR scans. The subjects included 20 left TLE patients, 19 right TLE patients, and 24 healthy controls (HCs).

RESULTS

Using the DIR data, we achieved a robust accuracy of 87.30% for discriminating among the left TLE, right TLE, and HC groups as well as 84.61%, 97.72%, and 93.02% prediction accuracies for distinguishing left TLE from right TLE, HC from right TLE, and HC from left TLE, respectively.

INTERPRETATION

Our experimental results suggest that DIR data coupled with machine-learning algorithms provide a promising approach to identifying MRI-negative TLE patients, especially when fluorodeoxyglucose-PET is not available.

Application of Artificial Intelligence in the MRI Classification Task of Human Brain Neurological and Psychiatric Diseases: A Scoping Review

Artificial intelligence (AI) for medical imaging is a technology with great potential. An in-depth understanding of the principles and applications of magnetic resonance imaging (MRI), machine learning (ML), and deep learning (DL) is fundamental for developing AI-based algorithms that can meet the requirements of clinical diagnosis and have excellent quality and efficiency. Moreover, a more comprehensive understanding of applications and opportunities would help to implement AI-based methods in an ethical and sustainable manner. This review first summarizes recent research advances in ML and DL techniques for classifying human brain magnetic resonance images. Then, the application of ML and DL methods to six typical neurological and psychiatric diseases is summarized, including Alzheimer's disease (AD), Parkinson's disease (PD), major depressive disorder (MDD), schizophrenia (SCZ), attention-deficit/hyperactivity disorder (ADHD), and autism spectrum disorder (ASD). Finally, the limitations of the existing research are discussed, and possible future research directions are proposed.

Clinical Application of Machine Learning Models for Brain Imaging in Epilepsy: A Review

Epilepsy is a common neurological disorder characterized by recurrent and disabling seizures. An increasing number of clinical and experimental applications of machine learning (ML) methods for epilepsy and other neurological and psychiatric disorders are available. ML methods have the potential to provide a reliable and optimal performance for clinical diagnoses, prediction, and personalized medicine by using mathematical algorithms and computational approaches. There are now several applications of ML for epilepsy, including neuroimaging analyses. For precise and reliable clinical applications in epilepsy and neuroimaging, the diverse ML methodologies should be examined and validated. We review the clinical applications of ML models for brain imaging in epilepsy obtained from a PubMed database search in February 2021. We first present an overview of typical neuroimaging modalities and ML models used in the epilepsy studies and then focus on the existing applications of ML models for brain imaging in epilepsy based on the following clinical aspects: (i) distinguishing individuals with epilepsy from healthy controls, (ii) lateralization of the temporal lobe epilepsy focus, (iii) the identification of epileptogenic foci, (iv) the prediction of clinical outcomes, and (v) brain-age prediction. We address the practical problems and challenges described in the literature and suggest some future research directions.

A Review on Machine Learning for EEG Signal Processing in Bioengineering

Electroencephalography (EEG) has been a staple method for identifying certain health conditions in patients since its discovery. Due to the many different types of classifiers available to use, the analysis methods are also equally numerous. In this review, we will be examining specifically machine learning methods that have been developed for EEG analysis with bioengineering applications. We reviewed literature from 1988 to 2018 to capture previous and current classification methods for EEG in multiple applications. From this information, we are able to determine the overall effectiveness of each machine learning method as well as the key characteristics. We have found that all the primary methods used in machine learning have been applied in some form in EEG classification. This ranges from Naive-Bayes to Decision Tree/Random Forest, to Support Vector Machine (SVM). Supervised learning methods are on average of higher accuracy than their unsupervised counterparts. This includes SVM and KNN. While each of the methods individually is limited in their accuracy in their respective applications, there is hope that the combination of methods when implemented properly has a higher overall classification accuracy. This paper provides a comprehensive overview of Machine Learning applications used in EEG analysis. It also gives an overview of each of the methods and general applications that each is best suited to.

Artificial intelligence for clinical decision support in neurology

Artificial intelligence is one of the most exciting methodological shifts in our era. It holds the potential to transform healthcare as we know it, to a system where humans and machines work together to provide better treatment for our patients. It is now clear that cutting edge artificial intelligence models in conjunction with high-quality clinical data will lead to improved prognostic and diagnostic models in neurological disease, facilitating expert-level clinical decision tools across healthcare settings. Despite the clinical promise of artificial intelligence, machine and deep-learning algorithms are not a one-size-fits-all solution for all types of clinical data and questions. In this article, we provide an overview of the core concepts of artificial intelligence, particularly contemporary deep-learning methods, to give clinician and neuroscience researchers an appreciation of how artificial intelligence can be harnessed to support clinical decisions. We clarify and emphasize the data quality and the human expertise needed to build robust clinical artificial intelligence models in neurology. As artificial intelligence is a rapidly evolving field, we take the opportunity to iterate important ethical principles to guide the field of medicine is it moves into an artificial intelligence enhanced future.