A novel 5D brain parcellation approach based on spatio-temporal encoding of resting fMRI data from deep residual learning

fMRI-based spatio-temporal parcellations of the human brain

PURPOSE OF REVIEW

Human brain parcellation based on functional magnetic resonance imaging (fMRI) plays an essential role in neuroscience research. By segmenting vast and intricate fMRI data into functionally similar units, researchers can better decipher the brain's structure in both healthy and diseased states. This article reviews current methodologies and ideas in this field, while also outlining the obstacles and directions for future research.

RECENT FINDINGS

Traditional brain parcellation techniques, which often rely on cytoarchitectonic criteria, overlook the functional and temporal information accessible through fMRI. The adoption of machine learning techniques, notably deep learning, offers the potential to harness both spatial and temporal information for more nuanced brain segmentation. However, the search for a one-size-fits-all solution to brain segmentation is impractical, with the choice between group-level or individual-level models and the intended downstream analysis influencing the optimal parcellation strategy. Additionally, evaluating these models is complicated by our incomplete understanding of brain function and the absence of a definitive "ground truth".

SUMMARY

While recent methodological advancements have significantly enhanced our grasp of the brain's spatial and temporal dynamics, challenges persist in advancing fMRI-based spatio-temporal representations. Future efforts will likely focus on refining model evaluation and selection as well as developing methods that offer clear interpretability for clinical usage, thereby facilitating further breakthroughs in our comprehension of the brain.

A comparative study of attention mechanism based deep learning methods for bladder tumor segmentation

BACKGROUND

Artificial intelligence aided tumor segmentation has been applied in various medical scenarios and showed effectiveness in helping physicians observe the potential malignant tissues. However, little research has been conducted for the cystoscopic image segmentation problem.

METHODS

This paper provided a comprehensive comparison of various attention modules for improving the bladder tumor segmentation performance by utilizing the cystoscopic images from Peking University Third Hospital within 2017-2022. Furthermore, this paper presented an attention mechanism based cystoscopic images segmentation (ACS) model, which was featured by the following points: (1) A mixed attention module including both the channel and spatial attention modules was integrated in the encoder-decoder path, which helped to exploit the global information of the tumor area more effectively. (2) A guidance and fusion attention module was introduced in the skip connection part, facilitating the integration of the high-level semantic features with low-level fine-grained features and the discarding of irrelevant features. (3) An inception attention module was added to enhance the feature expression in the scale of pixel level, so as to better discriminate multi-scale targets.

RESULTS

The proposed ACS model showed obviously better tumor segmentation performance than the compared models, with Dice of 82.7% and MIoU of 69% achieved.

CONCLUSIONS

The proposed ACS model achieved significantly better diagnostic performance than the previous bladder tumor segmentation method based on U-Net. Our ACS model is expected to be a useful support tool to assist the tumor segmentation under cystoscopy.

A deep residual model for characterization of 5D spatiotemporal network dynamics reveals widespread spatiodynamic changes in schizophrenia

Schizophrenia is a severe brain disorder with serious symptoms including delusions, disorganized speech, and hallucinations that can have a long-term detrimental impact on different aspects of a patient's life. It is still unclear what the main cause of schizophrenia is, but a combination of altered brain connectivity and structure may play a role. Neuroimaging data has been useful in characterizing schizophrenia, but there has been very little work focused on voxel-wise changes in multiple brain networks over time, despite evidence that functional networks exhibit complex spatiotemporal changes over time within individual subjects. Recent studies have primarily focused on static (average) features of functional data or on temporal variations between fixed networks; however, such approaches are not able to capture multiple overlapping networks which change at the voxel level. In this work, we employ a deep residual convolutional neural network (CNN) model to extract 53 different spatiotemporal networks each of which captures dynamism within various domains including subcortical, cerebellar, visual, sensori-motor, auditory, cognitive control, and default mode. We apply this approach to study spatiotemporal brain dynamism at the voxel level within multiple functional networks extracted from a large functional magnetic resonance imaging (fMRI) dataset of individuals with schizophrenia (N = 708) and controls (N = 510). Our analysis reveals widespread group level differences across multiple networks and spatiotemporal features including voxel-wise variability, magnitude, and temporal functional network connectivity in widespread regions expected to be impacted by the disorder. We compare with typical average spatial amplitude and show highly structured and neuroanatomically relevant results are missed if one does not consider the voxel-wise spatial dynamics. Importantly, our approach can summarize static, temporal dynamic, spatial dynamic, and spatiotemporal dynamics features, thus proving a powerful approach to unify and compare these various perspectives. In sum, we show the proposed approach highlights the importance of accounting for both temporal and spatial dynamism in whole brain neuroimaging data generally, shows a high-level of sensitivity to schizophrenia highlighting global but spatially unique dynamics showing group differences, and may be especially important in studies focused on the development of brain-based biomarkers.

A 5D approach to study spatio-temporal dynamism of resting-state brain networks in schizophrenia

Schizophrenia is a serious brain disorder that can affect all aspects of patient's life such as thinking, behaving and even feeling. The principal cause of schizophrenia is still unknown, but there is some evidence that differences in brain networks interactions along with functional dysconnectivity may play a significant role. Prior work has mostly focused on static summaries of functional data, or more recently changes in temporal coupling between fixed networks. Here, we study differences in spatio-temporal brain dynamics using resting state fMRI images in a dataset including 510 control and 708 schizophrenia patients. To do this, we utilized a deep residual network to extract 5 different spatiotemporal networks each of which captures spatial and temporal dynamics within sensory-motor, auditory, and default mode domains. Our analysis shows significant group differences in various aspects of spatio-temporal dynamics including magnitude, voxel-wise variability, and temporal functional network connectivity. Clinical relevance- Our study explores effects of spatio-temporal brain dynamism in schizophrenia, which is rarely taken into account, but could provide unique and more sensitive information about the disorder. Here we incorporate a novel 5D brain parcellation model, that enables us to encode spatio-temporal dynamics, to extract and characterize multiple resting fMRI brain networks.