Automated Detection of Juvenile Myoclonic Epilepsy using CNN based Transfer Learning in Diffusion MRI

A Comprehensive Review on Synergy of Multi-Modal Data and AI Technologies in Medical Diagnosis

Disease diagnosis represents a critical and arduous endeavor within the medical field. Artificial intelligence (AI) techniques, spanning from machine learning and deep learning to large model paradigms, stand poised to significantly augment physicians in rendering more evidence-based decisions, thus presenting a pioneering solution for clinical practice. Traditionally, the amalgamation of diverse medical data modalities (e.g., image, text, speech, genetic data, physiological signals) is imperative to facilitate a comprehensive disease analysis, a topic of burgeoning interest among both researchers and clinicians in recent times. Hence, there exists a pressing need to synthesize the latest strides in multi-modal data and AI technologies in the realm of medical diagnosis. In this paper, we narrow our focus to five specific disorders (Alzheimer's disease, breast cancer, depression, heart disease, epilepsy), elucidating advanced endeavors in their diagnosis and treatment through the lens of artificial intelligence. Our survey not only delineates detailed diagnostic methodologies across varying modalities but also underscores commonly utilized public datasets, the intricacies of feature engineering, prevalent classification models, and envisaged challenges for future endeavors. In essence, our research endeavors to contribute to the advancement of diagnostic methodologies, furnishing invaluable insights for clinical decision making.

An Integrated Multi-Channel Deep Neural Network for Mesial Temporal Lobe Epilepsy Identification Using Multi-Modal Medical Data

Epilepsy is a chronic brain disease with recurrent seizures. Mesial temporal lobe epilepsy (MTLE) is the most common pathological cause of epilepsy. With the development of computer-aided diagnosis technology, there are many auxiliary diagnostic approaches based on deep learning algorithms. However, the causes of epilepsy are complex, and distinguishing different types of epilepsy accurately is challenging with a single mode of examination. In this study, our aim is to assess the combination of multi-modal epilepsy medical information from structural MRI, PET image, typical clinical symptoms and personal demographic and cognitive data (PDC) by adopting a multi-channel 3D deep convolutional neural network and pre-training PET images. The results show better diagnosis accuracy than using one single type of medical data alone. These findings reveal the potential of a deep neural network in multi-modal medical data fusion.

O’Brien T, Perucca P, Ge Z, Anderson A. Applications for Deep Learning in Epilepsy Genetic Research

Epilepsy is a group of brain disorders characterised by an enduring predisposition to generate unprovoked seizures. Fuelled by advances in sequencing technologies and computational approaches, more than 900 genes have now been implicated in epilepsy. The development and optimisation of tools and methods for analysing the vast quantity of genomic data is a rapidly evolving area of research. Deep learning (DL) is a subset of machine learning (ML) that brings opportunity for novel investigative strategies that can be harnessed to gain new insights into the genomic risk of people with epilepsy. DL is being harnessed to address limitations in accuracy of long-read sequencing technologies, which improve on short-read methods. Tools that predict the functional consequence of genetic variation can represent breaking ground in addressing critical knowledge gaps, while methods that integrate independent but complimentary data enhance the predictive power of genetic data. We provide an overview of these DL tools and discuss how they may be applied to the analysis of genetic data for epilepsy research.

White matter structural connectivity as a biomarker for detecting juvenile myoclonic epilepsy by transferred deep convolutional neural networks with varying transfer rates

Objective. By detecting abnormal white matter changes, diffusion magnetic resonance imaging (MRI) contributes to the detection of juvenile myoclonic epilepsy (JME). In addition, deep learning has greatly improved the detection performance of various brain disorders. However, there is almost no previous study effectively detecting JME by a deep learning approach with diffusion MRI.Approach. In this study, the white matter structural connectivity was generated by tracking the white matter fibers in detail based on Q-ball imaging and neurite orientation dispersion and density imaging. Four advanced deep convolutional neural networks (CNNs) were deployed by using the transfer learning approach, in which the transfer rate searching strategy was proposed to achieve the best detection performance.Main results. Our results showed: (a) Compared to normal control, the white matter' neurite density of JME was significantly decreased. The most significantly abnormal fiber tracts between the two groups were found to be cortico-cortical connection tracts. (b) The proposed transfer rate searching approach contributed to find each CNN's best performance, in which the best JME detection accuracy of 92.2% was achieved by using the Inception_resnet_v2 network with a 16% transfer rate.Significance. The results revealed: (a) Through detection of the abnormal white matter changes, the white matter structural connectivity can be used as a useful biomarker for detecting JME, which helps to characterize the pathophysiology of epilepsy. (b) The proposed transfer rate, as a new hyperparameter, promotes the CNNs transfer learning performance in detecting JME.

Clinical Application of Machine Learning Models for Brain Imaging in Epilepsy: A Review

Epilepsy is a common neurological disorder characterized by recurrent and disabling seizures. An increasing number of clinical and experimental applications of machine learning (ML) methods for epilepsy and other neurological and psychiatric disorders are available. ML methods have the potential to provide a reliable and optimal performance for clinical diagnoses, prediction, and personalized medicine by using mathematical algorithms and computational approaches. There are now several applications of ML for epilepsy, including neuroimaging analyses. For precise and reliable clinical applications in epilepsy and neuroimaging, the diverse ML methodologies should be examined and validated. We review the clinical applications of ML models for brain imaging in epilepsy obtained from a PubMed database search in February 2021. We first present an overview of typical neuroimaging modalities and ML models used in the epilepsy studies and then focus on the existing applications of ML models for brain imaging in epilepsy based on the following clinical aspects: (i) distinguishing individuals with epilepsy from healthy controls, (ii) lateralization of the temporal lobe epilepsy focus, (iii) the identification of epileptogenic foci, (iv) the prediction of clinical outcomes, and (v) brain-age prediction. We address the practical problems and challenges described in the literature and suggest some future research directions.

Transfer Learning in Magnetic Resonance Brain Imaging: A Systematic Review

(1) Background: Transfer learning refers to machine learning techniques that focus on acquiring knowledge from related tasks to improve generalization in the tasks of interest. In magnetic resonance imaging (MRI), transfer learning is important for developing strategies that address the variation in MR images from different imaging protocols or scanners. Additionally, transfer learning is beneficial for reutilizing machine learning models that were trained to solve different (but related) tasks to the task of interest. The aim of this review is to identify research directions, gaps in knowledge, applications, and widely used strategies among the transfer learning approaches applied in MR brain imaging; (2) Methods: We performed a systematic literature search for articles that applied transfer learning to MR brain imaging tasks. We screened 433 studies for their relevance, and we categorized and extracted relevant information, including task type, application, availability of labels, and machine learning methods. Furthermore, we closely examined brain MRI-specific transfer learning approaches and other methods that tackled issues relevant to medical imaging, including privacy, unseen target domains, and unlabeled data; (3) Results: We found 129 articles that applied transfer learning to MR brain imaging tasks. The most frequent applications were dementia-related classification tasks and brain tumor segmentation. The majority of articles utilized transfer learning techniques based on convolutional neural networks (CNNs). Only a few approaches utilized clearly brain MRI-specific methodology, and considered privacy issues, unseen target domains, or unlabeled data. We proposed a new categorization to group specific, widely-used approaches such as pretraining and fine-tuning CNNs; (4) Discussion: There is increasing interest in transfer learning for brain MRI. Well-known public datasets have clearly contributed to the popularity of Alzheimer's diagnostics/prognostics and tumor segmentation as applications. Likewise, the availability of pretrained CNNs has promoted their utilization. Finally, the majority of the surveyed studies did not examine in detail the interpretation of their strategies after applying transfer learning, and did not compare their approach with other transfer learning approaches.