Automated Brain Masking of Fetal Functional MRI with Open Data

Sex differences in fetal brain functional network topology

The fetal period is a critical stage in brain development, and understanding the characteristics of the fetal brain is crucial. Although some studies have explored aspects of fetal brain functional networks, few have specifically focused on sex differences in brain network characteristics. We adopted the graph theory method to calculate brain network functional connectivity and topology properties (including global and nodal properties), and further compared the differences in these parameters between male and female fetuses. We found that male fetuses showed an increased clustering coefficient and local efficiency than female fetuses, but no significant group differences concerning other graph parameters and the functional connectivity matrix. Our study suggests the existence of sex-related distinctions in the topological properties of the brain network at the fetal stage of development and demonstrates an increase in brain network separation in male fetuses compared with female fetuses.

Review on deep learning fetal brain segmentation from Magnetic Resonance images

Brain segmentation is often the first and most critical step in quantitative analysis of the brain for many clinical applications, including fetal imaging. Different aspects challenge the segmentation of the fetal brain in magnetic resonance imaging (MRI), such as the non-standard position of the fetus owing to his/her movements during the examination, rapid brain development, and the limited availability of imaging data. In recent years, several segmentation methods have been proposed for automatically partitioning the fetal brain from MR images. These algorithms aim to define regions of interest with different shapes and intensities, encompassing the entire brain, or isolating specific structures. Deep learning techniques, particularly convolutional neural networks (CNNs), have become a state-of-the-art approach in the field because they can provide reliable segmentation results over heterogeneous datasets. Here, we review the deep learning algorithms developed in the field of fetal brain segmentation and categorize them according to their target structures. Finally, we discuss the perceived research gaps in the literature of the fetal domain, suggesting possible future research directions that could impact the management of fetal MR images.

Automatic Ventriculomegaly Detection in Fetal Brain MRI: A Step-by-Step Deep Learning Model for Novel 2D-3D Linear Measurements

In this study, we developed an automated workflow using a deep learning model (DL) to measure the lateral ventricle linearly in fetal brain MRI, which are subsequently classified into normal or ventriculomegaly, defined as a diameter wider than 10 mm at the level of the thalamus and choroid plexus. To accomplish this, we first trained a UNet-based deep learning model to segment the brain of a fetus into seven different tissue categories using a public dataset (FeTA 2022) consisting of fetal T2-weighted images. Then, an automatic workflow was developed to perform lateral ventricle measurement at the level of the thalamus and choroid plexus. The test dataset included 22 cases of normal and abnormal T2-weighted fetal brain MRIs. Measurements performed by our AI model were compared with manual measurements performed by a general radiologist and a neuroradiologist. The AI model correctly classified 95% of fetal brain MRI cases into normal or ventriculomegaly. It could measure the lateral ventricle diameter in 95% of cases with less than a 1.7 mm error. The average difference between measurements was 0.90 mm in AI vs. general radiologists and 0.82 mm in AI vs. neuroradiologists, which are comparable to the difference between the two radiologists, 0.51 mm. In addition, the AI model also enabled the researchers to create 3D-reconstructed images, which better represent real anatomy than 2D images. When a manual measurement is performed, it could also provide both the right and left ventricles in just one cut, instead of two. The measurement difference between the general radiologist and the algorithm (p = 0.9827), and between the neuroradiologist and the algorithm (p = 0.2378), was not statistically significant. In contrast, the difference between general radiologists vs. neuroradiologists was statistically significant (p = 0.0043). To the best of our knowledge, this is the first study that performs 2D linear measurement of ventriculomegaly with a 3D model based on an artificial intelligence approach. The paper presents a step-by-step approach for designing an AI model based on several radiological criteria. Overall, this study showed that AI can automatically calculate the lateral ventricle in fetal brain MRIs and accurately classify them as abnormal or normal.

Funcmasker-flex: An Automated BIDS-App for Brain Segmentation of Human Fetal Functional MRI data

Fetal functional magnetic resonance imaging (fMRI) offers critical insight into the developing brain and could aid in predicting developmental outcomes. As the fetal brain is surrounded by heterogeneous tissue, it is not possible to use adult- or child-based segmentation toolboxes. Manually-segmented masks can be used to extract the fetal brain; however, this comes at significant time costs. Here, we present a new BIDS App for masking fetal fMRI, funcmasker-flex, that overcomes these issues with a robust 3D convolutional neural network (U-net) architecture implemented in an extensible and transparent Snakemake workflow. Open-access fetal fMRI data with manual brain masks from 159 fetuses (1103 total volumes) were used for training and testing the U-net model. We also tested generalizability of the model using 82 locally acquired functional scans from 19 fetuses, which included over 2300 manually segmented volumes. Dice metrics were used to compare performance of funcmasker-flex to the ground truth manually segmented volumes, and segmentations were consistently robust (all Dice metrics ≥ 0.74). The tool is freely available and can be applied to any BIDS dataset containing fetal bold sequences. Funcmasker-flex reduces the need for manual segmentation, even when applied to novel fetal functional datasets, resulting in significant time-cost savings for performing fetal fMRI analysis.

Review of deep learning and artificial intelligence models in fetal brain magnetic resonance imaging

Central nervous system abnormalities in fetuses are fairly common, happening in 0.1% to 0.2% of live births and in 3% to 6% of stillbirths. So initial detection and categorization of fetal Brain abnormalities are critical. Manually detecting and segmenting fetal brain magnetic resonance imaging (MRI) could be time-consuming, and susceptible to interpreter experience. Artificial intelligence (AI) algorithms and machine learning approaches have a high potential for assisting in the early detection of these problems, improving the diagnosis process and follow-up procedures. The use of AI and machine learning techniques in fetal brain MRI was the subject of this narrative review paper. Using AI, anatomic fetal brain MRI processing has investigated models to predict specific landmarks and segmentation automatically. All gestation age weeks (17-38 wk) and different AI models (mainly Convolutional Neural Network and U-Net) have been used. Some models' accuracy achieved 95% and more. AI could help preprocess and post-process fetal images and reconstruct images. Also, AI can be used for gestational age prediction (with one-week accuracy), fetal brain extraction, fetal brain segmentation, and placenta detection. Some fetal brain linear measurements, such as Cerebral and Bone Biparietal Diameter, have been suggested. Classification of brain pathology was studied using diagonal quadratic discriminates analysis, K-nearest neighbor, random forest, naive Bayes, and radial basis function neural network classifiers. Deep learning methods will become more powerful as more large-scale, labeled datasets become available. Having shared fetal brain MRI datasets is crucial because there aren not many fetal brain pictures available. Also, physicians should be aware of AI's function in fetal brain MRI, particularly neuroradiologists, general radiologists, and perinatologists.

Machine Learning and Prediction in Fetal, Infant, and Toddler Neuroimaging: A Review and Primer

Predictive models in neuroimaging are increasingly designed with the intent to improve risk stratification and support interventional efforts in psychiatry. Many of these models have been developed in samples of children school-aged or older. Nevertheless, despite growing evidence that altered brain maturation during the fetal, infant, and toddler (FIT) period modulates risk for poor mental health outcomes in childhood, these models are rarely implemented in FIT samples. Applications of predictive modeling in children of these ages provide an opportunity to develop powerful tools for improved characterization of the neural mechanisms underlying development. To facilitate the broader use of predictive models in FIT neuroimaging, we present a brief primer and systematic review on the methods used in current predictive modeling FIT studies. Reflecting on current practices in more than 100 studies conducted over the past decade, we provide an overview of topics, modalities, and methods commonly used in the field and under-researched areas. We then outline ethical and future considerations for neuroimaging researchers interested in predicting health outcomes in early life, including researchers who may be relatively new to either advanced machine learning methods or using FIT data. Altogether, the last decade of FIT research in machine learning has provided a foundation for accelerating the prediction of early-life trajectories across the full spectrum of illness and health.

Fetal behavior during MRI changes with age and relates to network dynamics

Fetal motor behavior is an important clinical indicator of healthy development. However, our understanding of associations between fetal behavior and fetal brain development is limited. To fill this gap, this study introduced an approach to automatically and objectively classify long durations of fetal movement from a continuous four-dimensional functional magnetic resonance imaging (fMRI) data set, and paired behavior features with brain activity indicated by the fMRI time series. Twelve-minute fMRI scans were conducted in 120 normal fetuses. Postnatal motor function was evaluated at 7 and 36 months age. Fetal motor behavior was quantified by calculating the frame-wise displacement (FD) of fetal brains extracted by a deep-learning model along the whole time series. Analyzing only low motion data, we characterized the recurring coactivation patterns (CAPs) of the supplementary motor area (SMA). Results showed reduced motor activity with advancing gestational age (GA), likely due in part to loss of space (r = -.51, p < .001). Evaluation of individual variation in motor movement revealed a negative association between movement and the occurrence of coactivations within the left parietotemporal network, controlling for age and sex (p = .003). Further, we found that the occurrence of coactivations between the SMA to posterior brain regions, including visual cortex, was prospectively associated with postnatal motor function at 7 months (r = .43, p = .03). This is the first study to pair fetal movement and fMRI, highlighting potential for comparisons of fetal behavior and neural network development to enhance our understanding of fetal brain organization.

RS-FetMRI: a MATLAB-SPM Based Tool for Pre-processing Fetal Resting-State fMRI Data

Resting-state functional magnetic resonance imaging (rs-fMRI) most recently has proved to open a measureless window on functional neurodevelopment in utero. Fetal brain activation and connectivity maps can be heavily influenced by 1) fetal-specific motion effects on the time-series and 2) the accuracy of time-series spatial normalization to a standardized gestational-week (GW) specific fetal template space.Due to the absence of a standardized and generalizable image processing protocol, the objective of the present work was to implement a validated fetal rs-fMRI preprocessing pipeline (RS-FetMRI) divided into 6 inter-dependent preprocessing modules (i.e., M1 to M6) and designed to work entirely as an extension for Statistical Parametric Mapping (SPM).RS-FetMRI pipeline output analyses on rs-fMRI time-series sampled from a cohort of fetuses acquired on both 1.5 T and 3 T MRI scanning systems showed increased efficacy of estimation of the degree of movement coupled with an efficient motion censoring procedure, resulting in increased number of motion-uncorrupted volumes and temporal continuity in fetal rs-fMRI time-series data. Moreover, a "structural-free" SPM-based spatial normalization procedure granted a high degree of spatial overlap with high reproducibility and a significant improvement in whole-brain and parcellation-specific Temporal Signal-to-Noise Ratio (TSNR) mirrored by functional connectivity analysis.To our knowledge, the RS-FetMRI pipeline is the first semi-automatic and easy-to-use standardized fetal rs-fMRI preprocessing pipeline completely integrated in MATLAB-SPM able to remove entry barriers for new research groups into the field of fetal rs-fMRI, for both research or clinical purposes, and ultimately to make future fetal brain connectivity investigations more suitable for comparison and cross-validation.

Hypoconnectivity between anterior insula and amygdala associates with future vulnerabilities in social development in a neurodiverse sample of neonates

Altered resting state functional connectivity (FC) involving the anterior insula (aINS), a key node in the salience network, has been reported consistently in autism. Here we examined, for the first time, FC between the aINS and the whole brain in a sample of full-term, postmenstrual age (PMA) matched neonates (mean 44.0 weeks, SD = 1.5) who due to family history have high likelihood (HL) for developing autism (n = 12) and in controls (n = 41) without family history of autism (low likelihood, LL). Behaviors associated with autism were evaluated between 12 and 18 months (M = 17.3 months, SD = 2.5) in a subsample (25/53) of participants using the First Year Inventory (FYI). Compared to LL controls, HL neonates showed hypoconnectivity between left aINS and left amygdala. Lower connectivity between the two nodes was associated with higher FYI risk scores in the social domain (r(25) = -0.561, p = .003) and this association remained robust when maternal mental health factors were considered. Considering that a subsample of LL participants (n = 14/41) underwent brain imaging during the fetal period at PMA 31 and 34 weeks, in an exploratory analysis, we evaluated prospectively development of the LaINS-Lamy connectivity and found that the two areas strongly coactivate throughout the third trimester of pregnancy. The study identifies left lateralized anterior insula-amygdala connectivity as a potential target of further investigation into neural circuitry that enhances likelihood of future onset of social behaviors associated with autism during neonatal and potentially prenatal periods.

Functional connectivity for the language network in the developing brain: 30 weeks of gestation to 30 months of age

Although the neural scaffolding for language is putatively present before birth, the maturation of functional connections among the key nodes of the language network, Broca's and Wernicke's areas, is less known. We leveraged longitudinal and cross-sectional data from three sites collected through six studies to track the development of functional circuits between Broca's and Wernicke's areas from 30 weeks of gestation through 30 months of age in 127 unique participants. Using resting-state fMRI data, functional connectivity was calculated as the correlation between fMRI time courses from pairs of regions, defined as Broca's and Wernicke's in both hemispheres. The primary analysis evaluated 23 individuals longitudinally imaged from 30 weeks postmenstrual age (fetal) through the first postnatal month (neonatal). A secondary analysis in 127 individuals extended these curves into older infants and toddlers. These data demonstrated significant growth of interhemispheric connections including left Broca's and its homolog and left Wernicke's and its homolog from 30 weeks of gestation through the first postnatal month. In contrast, intrahemispheric connections did not show significant increases across this period. These data represent an important baseline for language systems in the developing brain against which to compare those neurobehavioral disorders with the potential fetal onset of disease.

Empirical evaluation of human fetal fMRI preprocessing steps

Increased study and methodological innovation have led to growth in the field of fetal brain fMRI. An important gap yet to be addressed is optimization of fetal fMRI preprocessing. Rapid developmental changes, imaged within the maternal compartment using an abdominal coil, introduce novel constraints that challenge established methods used in adult fMRI. This study evaluates the impact of (1) normalization to a group mean-age template versus normalization to an age-matched template; (2) independent components analysis (ICA) denoising at two criterion thresholds; and (3) smoothing using three kernel sizes. Data were collected from 121 fetuses (25-39 weeks, 43.8% female). Results indicate that the mean age template is superior in older fetuses, but less optimal in younger fetuses. ICA denoising at a more stringent threshold is superior to less stringent denoising. A larger smoothing kernel can enhance cross-hemisphere functional connectivity. Overall, this study provides improved understanding of the impact of specific steps on fetal image quality. Findings can be used to inform a common set of best practices for fetal fMRI preprocessing.

An ode to fetal, infant, and toddler neuroimaging: Chronicling early clinical to research applications with MRI, and an introduction to an academic society connecting the field

Fetal, infant, and toddler neuroimaging is commonly thought of as a development of modern times (last two decades). Yet, this field mobilized shortly after the discovery and implementation of MRI technology. Here, we provide a review of the parallel advancements in the fields of fetal, infant, and toddler neuroimaging, noting the shifts from clinical to research use, and the ongoing challenges in this fast-growing field. We chronicle the pioneering science of fetal, infant, and toddler neuroimaging, highlighting the early studies that set the stage for modern advances in imaging during this developmental period, and the large-scale multi-site efforts which ultimately led to the explosion of interest in the field today. Lastly, we consider the growing pains of the community and the need for an academic society that bridges expertise in developmental neuroscience, clinical science, as well as computational and biomedical engineering, to ensure special consideration of the vulnerable mother-offspring dyad (especially during pregnancy), data quality, and image processing tools that are created, rather than adapted, for the young brain.

Artificial intelligence applied to fetal MRI: A scoping review of current research

Artificial intelligence (AI) is defined as the development of computer systems to perform tasks normally requiring human intelligence. A subset of AI, known as machine learning (ML), takes this further by drawing inferences from patterns in data to 'learn' and 'adapt' without explicit instructions meaning that computer systems can 'evolve' and hopefully improve without necessarily requiring external human influences. The potential for this novel technology has resulted in great interest from the medical community regarding how it can be applied in healthcare. Within radiology, the focus has mostly been for applications in oncological imaging, although new roles in other subspecialty fields are slowly emerging.In this scoping review, we performed a literature search of the current state-of-the-art and emerging trends for the use of artificial intelligence as applied to fetal magnetic resonance imaging (MRI). Our search yielded several publications covering AI tools for anatomical organ segmentation, improved imaging sequences and aiding in diagnostic applications such as automated biometric fetal measurements and the detection of congenital and acquired abnormalities. We highlight our own perceived gaps in this literature and suggest future avenues for further research. It is our hope that the information presented highlights the varied ways and potential that novel digital technology could make an impact to future clinical practice with regards to fetal MRI.

FetalGAN: Automated Segmentation of Fetal Functional Brain MRI Using Deep Generative Adversarial Learning and Multi-Scale 3D U-Net

An important step in the preprocessing of resting state functional magnetic resonance images (rs-fMRI) is the separation of brain from non-brain voxels. Widely used imaging tools such as FSL's BET2 and AFNI's 3dSkullStrip accomplish this task effectively in children and adults. In fetal functional brain imaging, however, the presence of maternal tissue around the brain coupled with the non-standard position of the fetal head limit the usefulness of these tools. Accurate brain masks are thus generated manually, a time-consuming and tedious process that slows down preprocessing of fetal rs-fMRI. Recently, deep learning-based segmentation models such as convolutional neural networks (CNNs) have been increasingly used for automated segmentation of medical images, including the fetal brain. Here, we propose a computationally efficient end-to-end generative adversarial neural network (GAN) for segmenting the fetal brain. This method, which we call FetalGAN, yielded whole brain masks that closely approximated the manually labeled ground truth. FetalGAN performed better than 3D U-Net model and BET2: FetalGAN, Dice score = 0.973 ± 0.013, precision = 0.977 ± 0.015; 3D U-Net, Dice score = 0.954 ± 0.054, precision = 0.967 ± 0.037; BET2, Dice score = 0.856 ± 0.084, precision = 0.758 ± 0.113. FetalGAN was also faster than 3D U-Net and the manual method (7.35 s vs. 10.25 s vs. ∼5 min/volume). To the best of our knowledge, this is the first successful implementation of 3D CNN with GAN on fetal fMRI brain images and represents a significant advance in fully automating processing of rs-MRI images.

Recognition Rate Advancement and Data Error Improvement of Pathology Cutting with H-DenseUNet for Hepatocellular Carcinoma Image

Due to the fact that previous studies have rarely investigated the recognition rate discrepancy and pathology data error when applied to different databases, the purpose of this study is to investigate the improvement of recognition rate via deep learning-based liver lesion segmentation with the incorporation of hospital data. The recognition model used in this study is H-DenseUNet, which is applied to the segmentation of the liver and lesions, and a mixture of 2D/3D Hybrid-DenseUNet is used to reduce the recognition time and system memory requirements. Differences in recognition results were determined by comparing the training files of the standard LiTS competition data set with the training set after mixing in an additional 30 patients. The average error value of 9.6% was obtained by comparing the data discrepancy between the actual pathology data and the pathology data after the analysis of the identified images imported from Kaohsiung Chang Gung Memorial Hospital. The average error rate of the recognition output after mixing the LiTS database with hospital data for training was 1%. In the recognition part, the Dice coefficient was 0.52 after training 50 epochs using the standard LiTS database, while the Dice coefficient was increased to 0.61 after adding 30 hospital data to the training. After importing 3D Slice and ITK-Snap software, a 3D image of the lesion and liver segmentation can be developed. It is hoped that this method could be used to stimulate more research in addition to the general public standard database in the future, as well as to study the applicability of hospital data and improve the generality of the database.