Objective Detection of Eloquent Axonal Pathways to Minimize Postoperative Deficits in Pediatric Epilepsy Surgery using Diffusion Tractography and Convolutional Neural Networks

Quantitative phenotyping of verbal and non-verbal cognitive impairment using diffusion-weighted MRI connectome: Preliminary study of the crowding effect in children with left hemispheric epilepsy

The "crowding" effect (CE), wherein verbal functions are preserved presumably at the expense of nonverbal functions, which diminish following inter-hemispheric transfer of language functions, is recognized as a specific aspect of functional reorganization, offering an insight about neural plasticity in children with neural insult to the dominant hemisphere. CE is hypothesized as a marker for language preservation or improvement after left-hemispheric injury, yet it remains challenging to fully discern it in preoperative evaluation. We present a novel DWI connectome (DWIC) approach to predict the presence of CE in 24 drug-resistant epilepsy (DRE) patients with a left-hemispheric focus and 29 young healthy controls. Psychometry-driven DWIC analysis was applied to create verbal and non-verbal modular networks. Local efficiency (LE) was assessed at individual regions of the two networks and its Z-score was compared to predict the presence of CE. Compared with a traditional organization (TO) group, wherein verbal functions are adversely affected, while non-verbal functions are preserved, the CE group showed significantly higher Z-scores in verbal network and significantly lower Z-scores in non-verbal network, corresponding to network reorganization in CE. A larger number of antiseizure drugs was significantly associated with more decreased Z-score in the right non-verbal network of the CE group and left verbal network of the TO group. These findings hold great potential to identify DRE patients whose verbal/language skills may over time be preserved due to effective inter-hemispheric reorganization and identify those whose verbal/language impairments may persist due to lack of inter-hemispheric reorganization.

Anat-SFSeg: Anatomically-guided superficial fiber segmentation with point-cloud deep learning

Diffusion magnetic resonance imaging (dMRI) tractography is a critical technique to map the brain's structural connectivity. Accurate segmentation of white matter, particularly the superficial white matter (SWM), is essential for neuroscience and clinical research. However, it is challenging to segment SWM due to the short adjacent gyri connection in a U-shaped pattern. In this work, we propose an Anatomically-guided Superficial Fiber Segmentation (Anat-SFSeg) framework to improve the performance on SWM segmentation. The framework consists of a unique fiber anatomical descriptor (named FiberAnatMap) and a deep learning network based on point-cloud data. The spatial coordinates of fibers represented as point clouds, as well as the anatomical features at both the individual and group levels, are fed into a neural network. The network is trained on Human Connectome Project (HCP) datasets and tested on the subjects with a range of cognitive impairment levels. One new metric named fiber anatomical region proportion (FARP), quantifies the ratio of fibers in the defined brain regions and enables the comparison with other methods. Another metric named anatomical region fiber count (ARFC), represents the average fiber number in each cluster for the assessment of inter-subject differences. The experimental results demonstrate that Anat-SFSeg achieves the highest accuracy on HCP datasets and exhibits great generalization on clinical datasets. Diffusion tensor metrics and ARFC show disorder severity associated alterations in patients with Alzheimer's disease (AD) and mild cognitive impairments (MCI). Correlations with cognitive grades show that these metrics are potential neuroimaging biomarkers for AD. Furthermore, Anat-SFSeg could be utilized to explore other neurodegenerative, neurodevelopmental or psychiatric disorders.

Tractography-based automated identification of the retinogeniculate visual pathway with novel microstructure-informed supervised contrastive learning

The retinogeniculate visual pathway (RGVP) is responsible for carrying visual information from the retina to the lateral geniculate nucleus. Identification and visualization of the RGVP are important in studying the anatomy of the visual system and can inform the treatment of related brain diseases. Diffusion MRI (dMRI) tractography is an advanced imaging method that uniquely enables in vivo mapping of the 3D trajectory of the RGVP. Currently, identification of the RGVP from tractography data relies on expert (manual) selection of tractography streamlines, which is time-consuming, has high clinical and expert labor costs, and is affected by inter-observer variability. In this paper, we present a novel deep learning framework, DeepRGVP , to enable fast and accurate identification of the RGVP from dMRI tractography data. We design a novel microstructure-informed supervised contrastive learning method that leverages both streamline label and tissue microstructure information to determine positive and negative pairs. We propose a simple and successful streamline-level data augmentation method to address highly imbalanced training data, where the number of RGVP streamlines is much lower than that of non-RGVP streamlines. We perform comparisons with several state-of-the-art deep learning methods that were designed for tractography parcellation, and we show superior RGVP identification results using DeepRGVP. In addition, we demonstrate a good generalizability of DeepRGVP to dMRI tractography data from neurosurgical patients with pituitary tumors and we show DeepRGVP can successfully identify RGVPs despite the effect of lesions affecting the RGVPs. Overall, our study shows the high potential of using deep learning to automatically identify the RGVP.

Supervised tractogram filtering using Geometric Deep Learning

A tractogram is a virtual representation of the brain white matter. It is composed of millions of virtual fibers, encoded as 3D polylines, which approximate the white matter axonal pathways. To date, tractograms are the most accurate white matter representation and thus are used for tasks like presurgical planning and investigations of neuroplasticity, brain disorders, or brain networks. However, it is a well-known issue that a large portion of tractogram fibers is not anatomically plausible and can be considered artifacts of the tracking procedure. With Verifyber, we tackle the problem of filtering out such non-plausible fibers using a novel fully-supervised learning approach. Differently from other approaches based on signal reconstruction and/or brain topology regularization, we guide our method with the existing anatomical knowledge of the white matter. Using tractograms annotated according to anatomical principles, we train our model, Verifyber, to classify fibers as either anatomically plausible or non-plausible. The proposed Verifyber model is an original Geometric Deep Learning method that can deal with variable size fibers, while being invariant to fiber orientation. Our model considers each fiber as a graph of points, and by learning features of the edges between consecutive points via the proposed sequence Edge Convolution, it can capture the underlying anatomical properties. The output filtering results highly accurate and robust across an extensive set of experiments, and fast; with a 12GB GPU, filtering a tractogram of 1M fibers requires less than a minute.

Deep learning in neuroimaging of epilepsy

In recent years, artificial intelligence, particularly deep learning (DL), has demonstrated utility in diverse areas of medicine. DL uses neural networks to automatically learn features from the raw data while this is not possible with conventional machine learning. It is helpful for the assessment of patients with epilepsy and whilst most published studies have been aimed at the automatic detection and prediction of seizures from electroencephalographic records, there is a growing number of investigations that use neuroimaging modalities (structural and functional magnetic resonance imaging, diffusion-weighted imaging and positron emission tomography) as input data. We review the application of DL to neuroimaging (sMRI, fMRI, DWI and PET) of focal epilepsy, specifically presurgical evaluation of drug-refractory epilepsy. First, a brief theoretical overview of artificial neural networks and deep learning is presented. Next, we review applications of deep learning to neuroimaging of epilepsy: diagnosis and lateralization, automated detection of lesion, presurgical evaluation and prediction of postsurgical outcome. Finally, the limitations, challenges and possible future directions in the application of these methods in the study of epilepsies are discussed. This approach could become an essential tool in clinical practice, particularly in the evaluation of images considered negative by visual inspection, in individualized treatments, and in the approach to epilepsy as a network disorder. However, greater multicenter collaboration is required to achieve the collection of sufficient data with the required quality together with the open access availability of the developed codes and tools.

Deep Learning Methods for Identification of White Matter Fiber Tracts: Review of State-of-the-Art and Future Prospective

Quantitative analysis of white matter fiber tracts from diffusion Magnetic Resonance Imaging (dMRI) data is of great significance in health and disease. For example, analysis of fiber tracts related to anatomically meaningful fiber bundles is highly demanded in pre-surgical and treatment planning, and the surgery outcome depends on accurate segmentation of the desired tracts. Currently, this process is mainly done through time-consuming manual identification performed by neuro-anatomical experts. However, there is a broad interest in automating the pipeline such that it is fast, accurate, and easy to apply in clinical settings and also eliminates the intra-reader variabilities. Following the advancements in medical image analysis using deep learning techniques, there has been a growing interest in using these techniques for the task of tract identification as well. Recent reports on this application show that deep learning-based tract identification approaches outperform existing state-of-the-art methods. This paper presents a review of current tract identification approaches based on deep neural networks. First, we review the recent deep learning methods for tract identification. Next, we compare them with respect to their performance, training process, and network properties. Finally, we end with a critical discussion of open challenges and possible directions for future works.

Deep fiber clustering: Anatomically informed fiber clustering with self-supervised deep learning for fast and effective tractography parcellation

White matter fiber clustering is an important strategy for white matter parcellation, which enables quantitative analysis of brain connections in health and disease. In combination with expert neuroanatomical labeling, data-driven white matter fiber clustering is a powerful tool for creating atlases that can model white matter anatomy across individuals. While widely used fiber clustering approaches have shown good performance using classical unsupervised machine learning techniques, recent advances in deep learning reveal a promising direction toward fast and effective fiber clustering. In this work, we propose a novel deep learning framework for white matter fiber clustering, Deep Fiber Clustering (DFC), which solves the unsupervised clustering problem as a self-supervised learning task with a domain-specific pretext task to predict pairwise fiber distances. This process learns a high-dimensional embedding feature representation for each fiber, regardless of the order of fiber points reconstructed during tractography. We design a novel network architecture that represents input fibers as point clouds and allows the incorporation of additional sources of input information from gray matter parcellation. Thus, DFC makes use of combined information about white matter fiber geometry and gray matter anatomy to improve the anatomical coherence of fiber clusters. In addition, DFC conducts outlier removal naturally by rejecting fibers with low cluster assignment probability. We evaluate DFC on three independently acquired cohorts, including data from 220 individuals across genders, ages (young and elderly adults), and different health conditions (healthy control and multiple neuropsychiatric disorders). We compare DFC to several state-of-the-art white matter fiber clustering algorithms. Experimental results demonstrate superior performance of DFC in terms of cluster compactness, generalization ability, anatomical coherence, and computational efficiency.

Computational approaches for the reconstruction of optic nerve fibers along the visual pathway from medical images: a comprehensive review

Optic never fibers in the visual pathway play significant roles in vision formation. Damages of optic nerve fibers are biomarkers for the diagnosis of various ophthalmological and neurological diseases; also, there is a need to prevent the optic nerve fibers from getting damaged in neurosurgery and radiation therapy. Reconstruction of optic nerve fibers from medical images can facilitate all these clinical applications. Although many computational methods are developed for the reconstruction of optic nerve fibers, a comprehensive review of these methods is still lacking. This paper described both the two strategies for optic nerve fiber reconstruction applied in existing studies, i.e., image segmentation and fiber tracking. In comparison to image segmentation, fiber tracking can delineate more detailed structures of optic nerve fibers. For each strategy, both conventional and AI-based approaches were introduced, and the latter usually demonstrates better performance than the former. From the review, we concluded that AI-based methods are the trend for optic nerve fiber reconstruction and some new techniques like generative AI can help address the current challenges in optic nerve fiber reconstruction.

Recent Advances in Explainable Artificial Intelligence for Magnetic Resonance Imaging

Advances in artificial intelligence (AI), especially deep learning (DL), have facilitated magnetic resonance imaging (MRI) data analysis, enabling AI-assisted medical image diagnoses and prognoses. However, most of the DL models are considered as "black boxes". There is an unmet need to demystify DL models so domain experts can trust these high-performance DL models. This has resulted in a sub-domain of AI research called explainable artificial intelligence (XAI). In the last decade, many experts have dedicated their efforts to developing novel XAI methods that are competent at visualizing and explaining the logic behind data-driven DL models. However, XAI techniques are still in their infancy for medical MRI image analysis. This study aims to outline the XAI applications that are able to interpret DL models for MRI data analysis. We first introduce several common MRI data modalities. Then, a brief history of DL models is discussed. Next, we highlight XAI frameworks and elaborate on the principles of multiple popular XAI methods. Moreover, studies on XAI applications in MRI image analysis are reviewed across the tissues/organs of the human body. A quantitative analysis is conducted to reveal the insights of MRI researchers on these XAI techniques. Finally, evaluations of XAI methods are discussed. This survey presents recent advances in the XAI domain for explaining the DL models that have been utilized in MRI applications.

[A research on epilepsy source localization from scalp electroencephalograph based on patient-specific head model and multi-dipole model]

Accurate source localization of the epileptogenic zone (EZ) is the primary condition of surgical removal of EZ. The traditional localization results based on three-dimensional ball model or standard head model may cause errors. This study intended to localize the EZ by using the patient-specific head model and multi-dipole algorithms using spikes during sleep. Then the current density distribution on the cortex was computed and used to construct the phase transfer entropy functional connectivity network between different brain areas to obtain the localization of EZ. The experiment result showed that our improved methods could reach the accuracy of 89.27% and the number of implanted electrodes could be reduced by (19.34 ± 7.15)%. This work can not only improve the accuracy of EZ localization, but also reduce the additional injury and potential risk caused by preoperative examination and surgical operation, and provide a more intuitive and effective reference for neurosurgeons to make surgical plans.

Superficial white matter analysis: An efficient point-cloud-based deep learning framework with supervised contrastive learning for consistent tractography parcellation across populations and dMRI acquisitions

Diffusion MRI tractography is an advanced imaging technique that enables in vivo mapping of the brain's white matter connections. White matter parcellation classifies tractography streamlines into clusters or anatomically meaningful tracts. It enables quantification and visualization of whole-brain tractography. Currently, most parcellation methods focus on the deep white matter (DWM), whereas fewer methods address the superficial white matter (SWM) due to its complexity. We propose a novel two-stage deep-learning-based framework, Superficial White Matter Analysis (SupWMA), that performs an efficient and consistent parcellation of 198 SWM clusters from whole-brain tractography. A point-cloud-based network is adapted to our SWM parcellation task, and supervised contrastive learning enables more discriminative representations between plausible streamlines and outliers for SWM. We train our model on a large-scale tractography dataset including streamline samples from labeled long- and medium-range (over 40 mm) SWM clusters and anatomically implausible streamline samples, and we perform testing on six independently acquired datasets of different ages and health conditions (including neonates and patients with space-occupying brain tumors). Compared to several state-of-the-art methods, SupWMA obtains highly consistent and accurate SWM parcellation results on all datasets, showing good generalization across the lifespan in health and disease. In addition, the computational speed of SupWMA is much faster than other methods.

Multi-Scale Deep Learning of Clinically Acquired Multi-Modal MRI Improves the Localization of Seizure Onset Zone in Children With Drug-Resistant Epilepsy

The present study investigates the effectiveness of a deep learning neural network for non-invasively localizing the seizure onset zone (SOZ) using multi-modal MRI data that are clinically acquired from children with drug-resistant epilepsy. A cortical parcellation was applied to localize the SOZ in cortical nodes of the epileptogenic hemisphere. At each node, the laminar surface analysis was followed to sample 1) the relative intensity of gray matter and white matter in multi-modal MRI and 2) the neighboring white matter connectivity using diffusion tractography edge strengths. A cross-validation was employed to train and test all layers of a multi-scale residual neural network (msResNet) that can classify SOZ node in an end-to-end fashion. A prediction probability of a given node belonging to the SOZ class was proposed as a non-invasive MRI marker of seizure onset likelihood. In an independent validation cohort, the proposed MRI marker provided a very large effect size of Cohen's d = 1.21 between SOZ and non-SOZ, and classified SOZ with a balanced accuracy of 0.75 in lesional and 0.67 in non-lesional MRI groups. The subsequent multi-variate logistic regression found the incorporation of the proposed MRI marker into interictal intracranial EEG (iEEG) markers further improves the differentiation between the epileptogenic focus (defined as SOZ resected during surgery) and non-epileptogenic sites (i.e., non-SOZ sites preserved during surgery) up to 15 % in non-lesional MRI group, suggesting that the proposed MRI marker could improve the localization of epileptogenic foci for successful pediatric epilepsy surgery.

Multi-Task Weakly-Supervised Attention Network for Dementia Status Estimation With Structural MRI

Accurate prediction of clinical scores (of neuropsychological tests) based on noninvasive structural magnetic resonance imaging (MRI) helps understand the pathological stage of dementia (e.g., Alzheimer's disease (AD)) and forecast its progression. Existing machine/deep learning approaches typically preselect dementia-sensitive brain locations for MRI feature extraction and model construction, potentially leading to undesired heterogeneity between different stages and degraded prediction performance. Besides, these methods usually rely on prior anatomical knowledge (e.g., brain atlas) and time-consuming nonlinear registration for the preselection of brain locations, thereby ignoring individual-specific structural changes during dementia progression because all subjects share the same preselected brain regions. In this article, we propose a multi-task weakly-supervised attention network (MWAN) for the joint regression of multiple clinical scores from baseline MRI scans. Three sequential components are included in MWAN: 1) a backbone fully convolutional network for extracting MRI features; 2) a weakly supervised dementia attention block for automatically identifying subject-specific discriminative brain locations; and 3) an attention-aware multitask regression block for jointly predicting multiple clinical scores. The proposed MWAN is an end-to-end and fully trainable deep learning model in which dementia-aware holistic feature learning and multitask regression model construction are integrated into a unified framework. Our MWAN method was evaluated on two public AD data sets for estimating clinical scores of mini-mental state examination (MMSE), clinical dementia rating sum of boxes (CDRSB), and AD assessment scale cognitive subscale (ADAS-Cog). Quantitative experimental results demonstrate that our method produces superior regression performance compared with state-of-the-art methods. Importantly, qualitative results indicate that the dementia-sensitive brain locations automatically identified by our MWAN method well retain individual specificities and are biologically meaningful.

Quantitative mapping of the brain's structural connectivity using diffusion MRI tractography: A review

Diffusion magnetic resonance imaging (dMRI) tractography is an advanced imaging technique that enables in vivo reconstruction of the brain's white matter connections at macro scale. It provides an important tool for quantitative mapping of the brain's structural connectivity using measures of connectivity or tissue microstructure. Over the last two decades, the study of brain connectivity using dMRI tractography has played a prominent role in the neuroimaging research landscape. In this paper, we provide a high-level overview of how tractography is used to enable quantitative analysis of the brain's structural connectivity in health and disease. We focus on two types of quantitative analyses of tractography, including: 1) tract-specific analysis that refers to research that is typically hypothesis-driven and studies particular anatomical fiber tracts, and 2) connectome-based analysis that refers to research that is more data-driven and generally studies the structural connectivity of the entire brain. We first provide a review of methodology involved in three main processing steps that are common across most approaches for quantitative analysis of tractography, including methods for tractography correction, segmentation and quantification. For each step, we aim to describe methodological choices, their popularity, and potential pros and cons. We then review studies that have used quantitative tractography approaches to study the brain's white matter, focusing on applications in neurodevelopment, aging, neurological disorders, mental disorders, and neurosurgery. We conclude that, while there have been considerable advancements in methodological technologies and breadth of applications, there nevertheless remains no consensus about the "best" methodology in quantitative analysis of tractography, and researchers should remain cautious when interpreting results in research and clinical applications.

Machine learning applications on neuroimaging for diagnosis and prognosis of epilepsy: A review

Machine learning is playing an increasingly important role in medical image analysis, spawning new advances in the clinical application of neuroimaging. There have been some reviews on machine learning and epilepsy before, and they mainly focused on electrophysiological signals such as electroencephalography (EEG) and stereo electroencephalography (SEEG), while neglecting the potential of neuroimaging in epilepsy research. Neuroimaging has its important advantages in confirming the range of the epileptic region, which is essential in presurgical evaluation and assessment after surgery. However, it is difficult for EEG to locate the accurate epilepsy lesion region in the brain. In this review, we emphasize the interaction between neuroimaging and machine learning in the context of epilepsy diagnosis and prognosis. We start with an overview of epilepsy and typical neuroimaging modalities used in epilepsy clinics, MRI, DWI, fMRI, and PET. Then, we elaborate two approaches in applying machine learning methods to neuroimaging data: (i) the conventional machine learning approach combining manual feature engineering and classifiers, (ii) the deep learning approach, such as the convolutional neural networks and autoencoders. Subsequently, the application of machine learning on epilepsy neuroimaging, such as segmentation, localization, and lateralization tasks, as well as tasks directly related to diagnosis and prognosis are looked into in detail. Finally, we discuss the current achievements, challenges, and potential future directions in this field, hoping to pave the way for computer-aided diagnosis and prognosis of epilepsy.

Presurgical Evaluation Strategies for Intractable Epilepsy of Childhood

For children who continue to experience seizures despite treatment with antiseizure medications, epilepsy surgery can be considered. The goals of the presurgical evaluation are to determine the best surgical approach to render a good outcome. In patients with drug resistant focal epilepsy, the epileptogenic zone defines the minimal brain volume which must be resected for surgical success and to delineate the relationship of this region with functional cortex. A number of noninvasive tools for these tasks have emerged over the past decade, and existing technologies have been revised and improved. In this review, we examine the recent published evidence for these techniques, specifically as applied to the pediatric population. Discussed herein are the diagnostic value of methods such as video electroencephalography, magnetic resonance imaging, and supportive neuroimaging techniques including single photon emission tomography, photon emission tomography, and magnetoencephalography. Functional testing including functional magnetic resonance imaging, electrical stimulation mapping, and transcranial magnetic stimulation are considered in the context of pediatric epilepsy. The application of emerging techniques to preoperative testing such as source localization, image post-processing, and artificial intelligence is covered. We summarize the relative value of presurgical testing based on patient characteristics, including lesional or nonlesional MRI, temporal or extratemporal epilepsy, and other factors relevant in pediatric epilepsy such as pathological substrate and age.

Can Deep Learning Hit a Moving Target? A Scoping Review of Its Role to Study Neurological Disorders in Children

Neurological disorders dramatically impact patients of any age population, their families, and societies. Pediatrics are among vulnerable age populations who differently experience the devastating consequences of neurological conditions, such as attention-deficit hyperactivity disorders (ADHD), autism spectrum disorders (ASD), cerebral palsy, concussion, and epilepsy. System-level understanding of these neurological disorders, particularly from the brain networks' dynamic perspective, has led to the significant trend of recent scientific investigations. While a dramatic maturation in the network science application domain is evident, leading to a better understanding of neurological disorders, such rapid utilization for studying pediatric neurological disorders falls behind that of the adult population. Aside from the specific technological needs and constraints in studying neurological disorders in children, the concept of development introduces uncertainty and further complexity topping the existing neurologically driven processes caused by disorders. To unravel these complexities, indebted to the availability of high-dimensional data and computing capabilities, approaches based on machine learning have rapidly emerged a new trend to understand pathways better, accurately diagnose, and better manage the disorders. Deep learning has recently gained an ever-increasing role in the era of health and medical investigations. Thanks to its relatively more minor dependency on feature exploration and engineering, deep learning may overcome the challenges mentioned earlier in studying neurological disorders in children. The current scoping review aims to explore challenges concerning pediatric brain development studies under the constraints of neurological disorders and offer an insight into the potential role of deep learning methodology on such a task with varying and uncertain nature. Along with pinpointing recent advancements, possible research directions are highlighted where deep learning approaches can assist in computationally targeting neurological disorder-related processes and translating them into windows of opportunities for interventions in diagnosis, treatment, and management of neurological disorders in children.

Prediction of baseline expressive and receptive language function in children with focal epilepsy using diffusion tractography-based deep learning network

PURPOSE

Focal epilepsy is a risk factor for language impairment in children. We investigated whether the current state-of-the-art deep learning network on diffusion tractography connectome can accurately predict expressive and receptive language scores of children with epilepsy.

METHODS

We studied 37 children with a diagnosis of drug-resistant focal epilepsy (age: 11.8 ± 3.1 years) using 3 T MRI and diffusion tractography connectome: G = (S, Ω), where S is an adjacency matrix of edges representing the connectivity strength (number of white-matter tract streamlines) between each pair of brain regions, and Ω reflects a set of brain regions. A convolutional neural network (CNN) was trained to learn the nonlinear relationship between 'S (input)' and 'language score (output)'. Repeated hold-out validation was then employed to measure the Pearson correlation and mean absolute error (MAE) between CNN-predicted and actual language scores.

RESULTS

We found that CNN-predicted and actual scores were significantly correlated (i.e., Pearson's R/p-value: 0.82/<0.001 and 0.75/<0.001), yielding MAE: 7.77 and 7.40 for expressive and receptive scores, respectively. Specifically, sparse connectivity not only within the left cortico-cortical network but also involving the right subcortical structures was predictive of language impairment of expressive or receptive domain. Subsequent subgroup analyses inferred that the effectiveness of diffusion tractography-based prediction of language outcome was independent of clinical variables. Intrinsic diffusion tractography connectome properties may be useful for predicting the severity of baseline language dysfunction and possibly provide a better understanding of the biological mechanisms of epilepsy-related language impairment in children.

Identifying gaps in using artificial intelligence to support students with intellectual disabilities from education and health perspectives

Purpose

Students with developmental/intellectual disabilities (ID/DD) often have serious health issues that require additional medical care and supervision. Serious health issues also mean increased absence and additional lags in academic achievement and development of adaptive and social skills. The incorporation of artificial intelligence in the education of a child with ID/DD could ameliorate the educational, adaptive and social skill gaps that occur as a direct result of persistent health problems.

Design/methodology/approach

The literature regarding the use of artificial intelligence in education for students with ID/DD was collected systematically from international online databases based on specific inclusion and exclusion criteria. The collected articles were analyzed deductively, looking for the different gaps in the domain. Based on the literature, an artificial intelligence–based architecture is proposed and sketched.

Findings

The findings show that there are many gaps in supporting students with ID/DD through the utilization of artificial intelligence. Given that the majority of students with ID/DD often have serious and chronic and comorbid health conditions, the potential use of health information in artificial intelligence is even more critical. Therefore, there is a clear need to develop a system that facilitates communication and access to health information for students with ID/DD, one that provides information to caregivers and education providers, limits errors, and, therefore, improves these individuals' education and quality of life.

Practical implications

This review highlights the gap in the current literature regarding using artificial intelligence in supporting the education of students with ID/DD. There is an urgent need for an intelligent system in collaboration with the updated health information to improve the quality of services submitted for people with intellectual disabilities and as a result improving their quality of life.

Originality/value

This study contributes to the literature by highlighting the gaps in incorporating artificial intelligence and its service to individuals with ID/DD. The research additionally proposes a solution based on the confounding variables of students’ health and individual characteristics. This solution will provide an automated information flow as a functional diagnostic and intervention tool for teachers, caregivers and parents. It could potentially improve the educational and practical outcomes for individuals with ID/DD and, ultimately, their quality of life.

Novel Deep Learning Network Analysis of Electrical Stimulation Mapping-Driven Diffusion MRI Tractography to Improve Preoperative Evaluation of Pediatric Epilepsy

OBJECTIVE

To investigate the clinical utility of deep convolutional neural network (DCNN) tract classification as a new imaging tool in the preoperative evaluation of children with focal epilepsy (FE).

METHODS

A DCNN tract classification deeply learned spatial trajectories of DWI white matter pathways linking electrical stimulation mapping (ESM) findings from 89 children with FE, and then automatically identified white matter pathways associated with eloquent functions (i.e., primary motor, language, and vision). Clinical utility was examined by 1) measuring the nearest distance between DCNN-determined pathways and ESM, 2) evaluating the effectiveness of DCNN-determined pathways to optimize surgical margins via Kalman filter analysis, and 3) evaluating how accurately changes in DCNN-determined language pathway volume can predict changes in language ability via canonical correlation analysis.

RESULTS

DCNN tract classification outperformed other existing methods, achieving an excellent accuracy of 98 % while non-invasively detecting eloquent areas within the spatial resolution of ESM (i.e., 1 cm). The Kalman filter analysis found that the preservation of brain areas within a surgical margin determined by DCNN tract classification predicted lack of postoperative deficit with a high accuracy of 92 %. Postoperative change of DCNN-determined language pathway volume showed a significant correlation with postoperative changes in language ability (R = 0.7, p   0.001).

CONCLUSION

Our findings demonstrate that postoperative functional deficits substantially differ according to the extent of resected white matter, and that DCNN tract classification may offer key translational information by identifying these pathways in pediatric epilepsy surgery.

SIGNIFICANCE

DCNN tract classification may be an effective tool to improve surgical outcome of children with FE.

Deep white matter analysis (DeepWMA): Fast and consistent tractography segmentation

White matter tract segmentation, i.e. identifying tractography fibers (streamline trajectories) belonging to anatomically meaningful fiber tracts, is an essential step to enable tract quantification and visualization. In this study, we present a deep learning tractography segmentation method (DeepWMA) that allows fast and consistent identification of 54 major deep white matter fiber tracts from the whole brain. We create a large-scale training tractography dataset of 1 million labeled fiber samples, and we propose a novel 2D multi-channel feature descriptor (FiberMap) that encodes spatial coordinates of points along each fiber. We learn a convolutional neural network (CNN) fiber classification model based on FiberMap and obtain a high fiber classification accuracy of 90.99% on the training tractography data with ground truth fiber labels. Then, the method is evaluated on a test dataset of 597 diffusion MRI scans from six independently acquired populations across genders, the lifespan (1 day - 82 years), and different health conditions (healthy control, neuropsychiatric disorders, and brain tumor patients). We perform comparisons with two state-of-the-art tract segmentation methods. Experimental results show that our method obtains a highly consistent tract segmentation result, where on average over 99% of the fiber tracts are successfully identified across all subjects under study, most importantly, including neonates and patients with space-occupying brain tumors. We also demonstrate good generalization of the method to tractography data from multiple different fiber tracking methods. The proposed method leverages deep learning techniques and provides a fast and efficient tool for brain white matter segmentation in large diffusion MRI tractography datasets.

Deep white matter analysis: fast, consistent tractography segmentation across populations and dMRI acquisitions

We present a deep learning tractography segmentation method that allows fast and consistent white matter fiber tract identification across healthy and disease populations and across multiple diffusion MRI (dMRI) acquisitions. We create a large-scale training tractography dataset of 1 million labeled fiber samples (54 anatomical tracts are included). To discriminate between fibers from different tracts, we propose a novel 2D multi-channel feature descriptor (FiberMap) that encodes spatial coordinates of points along each fiber. We learn a CNN tract classification model based on FiberMap and obtain a high tract classification accuracy of 90.99%. The method is evaluated on a test dataset of 374 dMRI scans from three independently acquired populations across health conditions (healthy control, neuropsychiatric disorders, and brain tumor patients). We perform comparisons with two state-of-the-art white matter tract segmentation methods. Experimental results show that our method obtains a highly consistent segmentation result, where over 99% of the fiber tracts are successfully detected across all subjects under study, most importantly, including patients with space occupying brain tumors. The proposed method leverages deep learning techniques and provides a much faster and more efficient tool for large data analysis than methods using traditional machine learning techniques.