TractoInferno - A large-scale, open-source, multi-site database for machine learning dMRI tractography

Microstructural Mapping of Neural Pathways in Alzheimer's Disease using Macrostructure-Informed Normative Tractometry

Introduction

Diffusion MRI is sensitive to the microstructural properties of brain tissues, and shows great promise in detecting the effects of degenerative diseases. However, many approaches analyze single measures averaged over regions of interest, without considering the underlying fiber geometry.

Methods

Here, we propose a novel Macrostructure-Informed Normative Tractometry (MINT) framework, to investigate how white matter microstructure and macrostructure are jointly altered in mild cognitive impairment (MCI) and dementia. We compare MINT-derived metrics with univariate metrics from diffusion tensor imaging (DTI), to examine how fiber geometry may impact interpretation of microstructure.

Results

In two multi-site cohorts from North America and India, we find consistent patterns of microstructural and macrostructural anomalies implicated in MCI and dementia; we also rank diffusion metrics' sensitivity to dementia.

Discussion

We show that MINT, by jointly modeling tract shape and microstructure, has potential to disentangle and better interpret the effects of degenerative disease on the brain's neural pathways.

What matters in reinforcement learning for tractography

Recently, deep reinforcement learning (RL) has been proposed to learn the tractography procedure and train agents to reconstruct the structure of the white matter without manually curated reference streamlines. While the performances reported were competitive, the proposed framework is complex, and little is still known about the role and impact of its multiple parts. In this work, we thoroughly explore the different components of the proposed framework, such as the choice of the RL algorithm, seeding strategy, the input signal and reward function, and shed light on their impact. Approximately 7,400 models were trained for this work, totalling nearly 41,000 h of GPU time. Our goal is to guide researchers eager to explore the possibilities of deep RL for tractography by exposing what works and what does not work with the category of approach. As such, we ultimately propose a series of recommendations concerning the choice of RL algorithm, the input to the agents, the reward function and more to help future work using reinforcement learning for tractography. We also release the open source codebase, trained models, and datasets for users and researchers wanting to explore reinforcement learning for tractography.

A systematic review of automated methods to perform white matter tract segmentation

White matter tract segmentation is a pivotal research area that leverages diffusion-weighted magnetic resonance imaging (dMRI) for the identification and mapping of individual white matter tracts and their trajectories. This study aims to provide a comprehensive systematic literature review on automated methods for white matter tract segmentation in brain dMRI scans. Articles on PubMed, ScienceDirect [NeuroImage, NeuroImage (Clinical), Medical Image Analysis], Scopus and IEEEXplore databases and Conference proceedings of Medical Imaging Computing and Computer Assisted Intervention Society (MICCAI) and International Symposium on Biomedical Imaging (ISBI), were searched in the range from January 2013 until September 2023. This systematic search and review identified 619 articles. Adhering to the specified search criteria using the query, "white matter tract segmentation OR fiber tract identification OR fiber bundle segmentation OR tractography dissection OR white matter parcellation OR tract segmentation," 59 published studies were selected. Among these, 27% employed direct voxel-based methods, 25% applied streamline-based clustering methods, 20% used streamline-based classification methods, 14% implemented atlas-based methods, and 14% utilized hybrid approaches. The paper delves into the research gaps and challenges associated with each of these categories. Additionally, this review paper illuminates the most frequently utilized public datasets for tract segmentation along with their specific characteristics. Furthermore, it presents evaluation strategies and their key attributes. The review concludes with a detailed discussion of the challenges and future directions in this field.

Integrating direct electrical brain stimulation with the human connectome

Neurological and neurodevelopmental conditions are a major public health concern for which new therapies are urgently needed. The development of effective therapies relies on the precise mapping of the neural substrates causally involved in behaviour generation. Direct electrical stimulation (DES) performed during cognitive and neurological monitoring in awake surgery is currently considered the gold standard for the causal mapping of brain functions. However, DES is limited by the focal nature of the stimulation sites, hampering a real holistic exploration of human brain functions at the network level. We used 4137 DES points derived from 612 glioma patients in combination with human connectome data-resting-state functional MRI, n = 1000 and diffusion weighted imaging, n = 284-to provide a multimodal description of the causal macroscale functional networks subtending 12 distinct behavioural domains. To probe the validity of our procedure, we (i) compared the network topographies of healthy and clinical populations; (ii) tested the predictive capacity of DES-derived networks; (iii) quantified the coupling between structural and functional connectivity; and (iv) built a multivariate model able to quantify single subject deviations from a normative population. Lastly, we probed the translational potential of DES-derived functional networks by testing their specificity and sensitivity in identifying critical neuromodulation targets and neural substrates associated with postoperative language deficits. The combination of DES and human connectome data resulted in an average 29.4-fold increase in whole brain coverage compared to DES alone. DES-derived functional networks are predictive of future stimulation points (97.8% accuracy) and strongly supported by the anatomical connectivity of subcortical stimulations. We did not observe any significant topographical differences between the patients and the healthy population at both group and single subject level. Showcasing concrete clinical applications, we found that DES-derived functional networks overlap with effective neuromodulation targets across several functional domains, show a high degree of specificity when tested with the intracranial stimulation points of a different stimulation technique and can be used effectively to characterize postoperative behavioural deficits. The integration of DES with the human connectome fundamentally advances the quality of the functional mapping provided by DES or functional imaging alone. DES-derived functional networks can reliably predict future stimulation points, have a strong correspondence with the underlying white matter and can be used for patient specific functional mapping. Possible applications range from psychiatry and neurology to neuropsychology, neurosurgery and neurorehabilitation.

Deep Normative Tractometry for Identifying Joint White Matter Macro- and Micro-structural Abnormalities in Alzheimer's Disease

This study introduces the Deep Normative Tractometry (DNT) framework, that encodes the joint distribution of both macrostructural and microstructural profiles of the brain white matter tracts through a variational autoencoder (VAE). By training on data from healthy controls, DNT learns the normative distribution of tract data, and can delineate along-tract micro-and macro-structural abnormalities. Leveraging a large sample size via generative pre-training, we assess DNT's generalizability using transfer learning on data from an independent cohort acquired in India. Our findings demonstrate DNT's capacity to detect widespread diffusivity abnormalities along tracts in mild cognitive impairment and Alzheimer's disease, aligning closely with results from the Bundle Analytics (BUAN) tractometry pipeline. By incorporating tract geometry information, DNT may be able to distinguish disease-related abnormalities in anisotropy from tract macrostructure, and shows promise in enhancing fine-scale mapping and detection of white matter alterations in neurodegenerative conditions.

Fibre orientation atlas guided rapid segmentation of white matter tracts

Fibre tract delineation from diffusion magnetic resonance imaging (MRI) is a valuable clinical tool for neurosurgical planning and navigation, as well as in research neuroimaging pipelines. Several popular methods are used for this task, each with different strengths and weaknesses making them more or less suited to different contexts. For neurosurgical imaging, priorities include ease of use, computational efficiency, robustness to pathology and ability to generalise to new tracts of interest. Many existing methods use streamline tractography, which may require expert neuroimaging operators for setting parameters and delineating anatomical regions of interest, or suffer from as a lack of generalisability to clinical scans involving deforming tumours and other pathologies. More recently, data-driven approaches including deep-learning segmentation models and streamline clustering methods have improved reproducibility and automation, although they can require large amounts of training data and/or computationally intensive image processing at the point of application. We describe an atlas-based direct tract mapping technique called 'tractfinder', utilising tract-specific location and orientation priors. Our aim was to develop a clinically practical method avoiding streamline tractography at the point of application while utilising prior anatomical knowledge derived from only 10-20 training samples. Requiring few training samples allows emphasis to be placed on producing high quality, neuro-anatomically accurate training data, and enables rapid adaptation to new tracts of interest. Avoiding streamline tractography at the point of application reduces computational time, false positives and vulnerabilities to pathology such as tumour deformations or oedema. Carefully filtered training streamlines and track orientation distribution mapping are used to construct tract specific orientation and spatial probability atlases in standard space. Atlases are then transformed to target subject space using affine registration and compared with the subject's voxel-wise fibre orientation distribution data using a mathematical measure of distribution overlap, resulting in a map of the tract's likely spatial distribution. This work includes extensive performance evaluation and comparison with benchmark techniques, including streamline tractography and the deep-learning method TractSeg, in two publicly available healthy diffusion MRI datasets (from TractoInferno and the Human Connectome Project) in addition to a clinical dataset comprising paediatric and adult brain tumour scans. Tract segmentation results display high agreement with established techniques while requiring less than 3 min on average when applied to a new subject. Results also display higher robustness than compared methods when faced with clinical scans featuring brain tumours and resections. As well as describing and evaluating a novel proposed tract delineation technique, this work continues the discussion on the challenges surrounding the white matter segmentation task, including issues of anatomical definitions and the use of quantitative segmentation comparison metrics.

A Survey of Publicly Available MRI Datasets for Potential Use in Artificial Intelligence Research

Artificial intelligence (AI) has the potential to bring transformative improvements to the field of radiology; yet, there are barriers to widespread clinical adoption. One of the most important barriers has been access to large, well-annotated, widely representative medical image datasets, which can be used to accurately train AI programs. Creating such datasets requires time and expertise and runs into constraints around data security and interoperability, patient privacy, and appropriate data use. Recognizing these challenges, several institutions have started curating and providing publicly available, high-quality datasets that can be accessed by researchers to advance AI models. The purpose of this work was to review the publicly available MRI datasets that can be used for AI research in radiology. Despite being an emerging field, a simple internet search for open MRI datasets presents an overwhelming number of results. Therefore, we decided to create a survey of the major publicly accessible MRI datasets in different subfields of radiology (brain, body, and musculoskeletal), and list the most important features of value to the AI researcher. To complete this review, we searched for publicly available MRI datasets and assessed them based on several parameters (number of subjects, demographics, area of interest, technical features, and annotations). We reviewed 110 datasets across sub-fields with 1,686,245 subjects in 12 different areas of interest ranging from spine to cardiac. This review is meant to serve as a reference for researchers to help spur advancements in the field of AI for radiology. LEVEL OF EVIDENCE: Level 4 TECHNICAL EFFICACY: Stage 6.

FIESTA: Autoencoders for accurate fiber segmentation in tractography

White matter bundle segmentation is a cornerstone of modern tractography to study the brain's structural connectivity in domains such as neurological disorders, neurosurgery, and aging. In this study, we present FIESTA (FIbEr Segmentation in Tractography using Autoencoders), a reliable and robust, fully automated, and easily semi-automatically calibrated pipeline based on deep autoencoders that can dissect and fully populate white matter bundles. This pipeline is built upon previous works that demonstrated how autoencoders can be used successfully for streamline filtering, bundle segmentation, and streamline generation in tractography. Our proposed method improves bundle segmentation coverage by recovering hard-to-track bundles with generative sampling through the latent space seeding of the subject bundle and the atlas bundle. A latent space of streamlines is learned using autoencoder-based modeling combined with contrastive learning. Using an atlas of bundles in standard space (MNI), our proposed method segments new tractograms using the autoencoder latent distance between each tractogram streamline and its closest neighbor bundle in the atlas of bundles. Intra-subject bundle reliability is improved by recovering hard-to-track streamlines, using the autoencoder to generate new streamlines that increase the spatial coverage of each bundle while remaining anatomically correct. Results show that our method is more reliable than state-of-the-art automated virtual dissection methods such as RecoBundles, RecoBundlesX, TractSeg, White Matter Analysis and XTRACT. Our framework allows for the transition from one anatomical bundle definition to another with marginal calibration efforts. Overall, these results show that our framework improves the practicality and usability of current state-of-the-art bundle segmentation framework.

Deep Learning Methods for Identification of White Matter Fiber Tracts: Review of State-of-the-Art and Future Prospective

Quantitative analysis of white matter fiber tracts from diffusion Magnetic Resonance Imaging (dMRI) data is of great significance in health and disease. For example, analysis of fiber tracts related to anatomically meaningful fiber bundles is highly demanded in pre-surgical and treatment planning, and the surgery outcome depends on accurate segmentation of the desired tracts. Currently, this process is mainly done through time-consuming manual identification performed by neuro-anatomical experts. However, there is a broad interest in automating the pipeline such that it is fast, accurate, and easy to apply in clinical settings and also eliminates the intra-reader variabilities. Following the advancements in medical image analysis using deep learning techniques, there has been a growing interest in using these techniques for the task of tract identification as well. Recent reports on this application show that deep learning-based tract identification approaches outperform existing state-of-the-art methods. This paper presents a review of current tract identification approaches based on deep neural networks. First, we review the recent deep learning methods for tract identification. Next, we compare them with respect to their performance, training process, and network properties. Finally, we end with a critical discussion of open challenges and possible directions for future works.

Generative Sampling in Bundle Tractography using Autoencoders (GESTA)

Current tractography methods use the local orientation information to propagate streamlines from seed locations. Many such seeds provide streamlines that stop prematurely or fail to map the true white matter pathways because some bundles are "harder-to-track" than others. This results in tractography reconstructions with poor white and gray matter spatial coverage. In this work, we propose a generative, autoencoder-based method, named GESTA (Generative Sampling in Bundle Tractography using Autoencoders), that produces streamlines achieving better spatial coverage. Compared to other deep learning methods, our autoencoder-based framework uses a single model to generate streamlines in a bundle-wise fashion, and does not require to propagate local orientations. GESTA produces new and complete streamlines for any given white matter bundle, including hard-to-track bundles. Applied on top of a given tractogram, GESTA is shown to be effective in improving the white matter volume coverage in poorly populated bundles, both on synthetic and human brain in vivo data. Our streamline evaluation framework ensures that the streamlines produced by GESTA are anatomically plausible and fit well to the local diffusion signal. The streamline evaluation criteria assess anatomy (white matter coverage), local orientation alignment (direction), and geometry features of streamlines, and optionally, gray matter connectivity. The GESTA framework offers considerable gains in bundle overlap using a reduced set of seeding streamlines with a 1.5x improvement for the "Fiber Cup", and 6x for the ISMRM 2015 Tractography Challenge datasets. Similarly, it provides a 4x white matter volume increase on the BIL&GIN callosal homotopic dataset, and successfully populates bundles on the multi-subject, multi-site, whole-brain in vivo TractoInferno dataset. GESTA is thus a novel deep generative bundle tractography method that can be used to improve the tractography reconstruction of the white matter.

TractoInferno - A large-scale, open-source, multi-site database for machine learning dMRI tractography

TractoInferno is the world's largest open-source multi-site tractography database, including both research- and clinical-like human acquisitions, aimed specifically at machine learning tractography approaches and related ML algorithms. It provides 284 samples acquired from 3 T scanners across 6 different sites. Available data includes T1-weighted images, single-shell diffusion MRI (dMRI) acquisitions, spherical harmonics fitted to the dMRI signal, fiber ODFs, and reference streamlines for 30 delineated bundles generated using 4 tractography algorithms, as well as masks needed to run tractography algorithms. Manual quality control was additionally performed at multiple steps of the pipeline. We showcase TractoInferno by benchmarking the learn2track algorithm and 5 variations of the same recurrent neural network architecture. Creating the TractoInferno database required approximately 20,000 CPU-hours of processing power, 200 man-hours of manual QC, 3,000 GPU-hours of training baseline models, and 4 Tb of storage, to produce a final database of 350 Gb. By providing a standardized training dataset and evaluation protocol, TractoInferno is an excellent tool to address common issues in machine learning tractography.