State-of-the-Art Methods for Brain Tissue Segmentation: A Review

Enhanced Spatial Fuzzy C-Means Algorithm for Brain Tissue Segmentation in T1 Images

Magnetic Resonance Imaging (MRI) plays an important role in neurology, particularly in the precise segmentation of brain tissues. Accurate segmentation is crucial for diagnosing brain injuries and neurodegenerative conditions. We introduce an Enhanced Spatial Fuzzy C-means (esFCM) algorithm for 3D T1 MRI segmentation to three tissues, i.e. White Matter (WM), Gray Matter (GM), and Cerebrospinal Fluid (CSF). The esFCM employs a weighted least square algorithm utilizing the Structural Similarity Index (SSIM) for polynomial bias field correction. It also takes advantage of the information from the membership function of the last iteration to compute neighborhood impact. This strategic refinement enhances the algorithm's adaptability to complex image structures, effectively addressing challenges such as intensity irregularities and contributing to heightened segmentation accuracy. We compare the segmentation accuracy of esFCM against four variants of FCM, Gaussian Mixture Model (GMM) and FSL and ANTs algorithms using four various dataset, employing three measurement criteria. Comparative assessments underscore esFCM's superior performance, particularly in scenarios involving added noise and bias fields.The obtained results emphasize the significant potential of the proposed method in the segmentation of MRI images.

A neural network with a human learning paradigm for breast fibroadenoma segmentation in sonography

BACKGROUND

Breast fibroadenoma poses a significant health concern, particularly for young women. Computer-aided diagnosis has emerged as an effective and efficient method for the early and accurate detection of various solid tumors. Automatic segmentation of the breast fibroadenoma is important and potentially reduces unnecessary biopsies, but challenging due to the low image quality and presence of various artifacts in sonography.

METHODS

Human learning involves modularizing complete information and then integrating it through dense contextual connections in an intuitive and efficient way. Here, a human learning paradigm was introduced to guide the neural network by using two consecutive phases: the feature fragmentation stage and the information aggregation stage. To optimize this paradigm, three fragmentation attention mechanisms and information aggregation mechanisms were adapted according to the characteristics of sonography. The evaluation was conducted using a local dataset comprising 600 breast ultrasound images from 30 patients at Suining Central Hospital in China. Additionally, a public dataset consisting of 246 breast ultrasound images from Dataset_BUSI and DatasetB was used to further validate the robustness of the proposed network. Segmentation performance and inference speed were assessed by Dice similarity coefficient (DSC), Hausdorff distance (HD), and training time and then compared with those of the baseline model (TransUNet) and other state-of-the-art methods.

RESULTS

Most models guided by the human learning paradigm demonstrated improved segmentation on the local dataset with the best one (incorporating C3ECA and LogSparse Attention modules) outperforming the baseline model by 0.76% in DSC and 3.14 mm in HD and reducing the training time by 31.25%. Its robustness and efficiency on the public dataset are also confirmed, surpassing TransUNet by 0.42% in DSC and 5.13 mm in HD.

CONCLUSIONS

Our proposed human learning paradigm has demonstrated the superiority and efficiency of ultrasound breast fibroadenoma segmentation across both public and local datasets. This intuitive and efficient learning paradigm as the core of neural networks holds immense potential in medical image processing.

A Siamese-Transport Domain Adaptation Framework for 3D MRI Classification of Gliomas and Alzheimer's Diseases

Accurate and fully automated brain structure examination and prediction from 3D volumetric magnetic resonance imaging (MRI) is a necessary step in medical imaging analysis, which can assist greatly in clinical diagnosis. Traditional deep learning models suffer from severe performance degradation when applied to clinically acquired unlabeled data. The performance degradation is mainly caused by domain discrepancy such as different device types and parameter settings for data acquisition. However, existing approaches focus on the reduction of domain discrepancies but ignore the entanglement of semantic features and domain information. In this article, we explore the feature invariance of categories and domains in different projection spaces and propose a Siamese-Transport Domain Adaptation (STDA) method using a joint optimal transport theory and contrastive learning for automatic 3D MRI classification and glioma multi-grade prediction. Specifically, the learning framework updates the distribution of features across domains and categories by Siamese transport network training with an Optimal Cost Transfer Strategy (OCTS) and a Mutual Invariant Constraint (MIC) in two projective spaces to find multiple invariants in potential heterogeneity. We design three sets of transfer task scenarios with different source and target domains, and demonstrate that STDA yields substantially higher generalization performance than other state-of-the-art unsupervised domain adaptation (UDA) methods. The method is applicable on 3D MRI data from glioma to Alzheimer's disease and has promising applications in the future clinical diagnosis and treatment of brain diseases.

Automatic brain extraction and brain tissues segmentation on multi-contrast animal MRI

For many neuroscience applications, brain extraction in MRI images is the first pre-processing step of a quantification pipeline. Once the brain is extracted, further post-processing calculations become faster, more specific and easier to implement and interpret. It is the case, for example, of functional MRI brain studies, or relaxation time mappings and brain tissues classifications to characterise brain pathologies. Existing brain extraction tools are mostly adapted to work on the human anatomy, this gives poor results when applied to animal brain images. We have developed an atlas-based Veterinary Images Brain Extraction (VIBE) algorithm that encompasses a pre-processing step to adapt the atlas to the patient's image, and a subsequent registration step. We show that the brain extraction is achieved with excellent results in terms of Dice and Jaccard metrics. The algorithm is automatic, with no need to adapt the parameters in a broad range of situations: we successfully tested multiple MRI contrasts (T1-weighted, T2-weighted, T2-weighted FLAIR), all the acquisition planes (sagittal, dorsal, transverse), different animal species (dogs and cats) and canine cranial conformations (brachycephalic, mesocephalic, dolichocephalic). VIBE can be successfully extended to other animal species, provided that an atlas for that specific species exists. We show also how brain extraction, as a preliminary step, can help to segment brain tissues with a K-Means clustering algorithm.

Energy minimization segmentation model based on MRI images

Introduction

Medical image segmentation is an important tool for doctors to accurately analyze the volume of brain tissue and lesions, which is important for the correct diagnosis of brain diseases. However, manual image segmentation methods are time-consuming, subjective and lack of repeatability, it needs to develop automatic and reliable methods for image segmentation.

Methods

Magnetic Resonance Imaging (MRI), a non-invasive imaging technique, is commonly used to detect, characterize and quantify tissues and lesions in the brain. Partial volume effect, gray scale in homogeneity, and lesions presents a great challenge for automatic medical image segmentation methods. So, the paper is dedicated to address the impact of partial volume effect and multiple sclerosis lesions on the segmentation accuracy in MRI. The objective function of the improved model and the post-processing method of lesion filling are researched based on the fuzzy clustering space and energy model.

Results

In particular, an energy-minimized segmentation algorithm is proposed. Through experimental verification, the AR-FCM algorithm can better overcome the problem of low segmentation accuracy of the RFCM algorithm for tissue boundary voxels and improve the segmentation accuracy of this algorithm. Meanwhile, a multi-channel input energy-minimization segmentation method with lesion filling and anatomical mapping is further proposed.

Discussion

The feasibility of the lesion filling strategy using post-processing can be confirmed and the segmentation accuracy is increased by comparison experiments.

A lightweight hierarchical convolution network for brain tumor segmentation

BACKGROUND

Brain tumor segmentation plays a significant role in clinical treatment and surgical planning. Recently, several deep convolutional networks have been proposed for brain tumor segmentation and have achieved impressive performance. However, most state-of-the-art models use 3D convolution networks, which require high computational costs. This makes it difficult to apply these models to medical equipment in the future. Additionally, due to the large diversity of the brain tumor and uncertain boundaries between sub-regions, some models cannot well-segment multiple tumors in the brain at the same time.

RESULTS

In this paper, we proposed a lightweight hierarchical convolution network, called LHC-Net. Our network uses a multi-scale strategy which the common 3D convolution is replaced by the hierarchical convolution with residual-like connections. It improves the ability of multi-scale feature extraction and greatly reduces parameters and computation resources. On the BraTS2020 dataset, LHC-Net achieves the Dice scores of 76.38%, 90.01% and 83.32% for ET, WT and TC, respectively, which is better than that of 3D U-Net with 73.50%, 89.42% and 81.92%. Especially on the multi-tumor set, our model shows significant performance improvement. In addition, LHC-Net has 1.65M parameters and 35.58G FLOPs, which is two times fewer parameters and three times less computation compared with 3D U-Net.

CONCLUSION

Our proposed method achieves automatic segmentation of tumor sub-regions from four-modal brain MRI images. LHC-Net achieves competitive segmentation performance with fewer parameters and less computation than the state-of-the-art models. It means that our model can be applied under limited medical computing resources. By using the multi-scale strategy on channels, LHC-Net can well-segment multiple tumors in the patient's brain. It has great potential for application to other multi-scale segmentation tasks.

Improving across-dataset brain tissue segmentation for MRI imaging using transformer

Brain tissue segmentation has demonstrated great utility in quantifying MRI data by serving as a precursor to further post-processing analysis. However, manual segmentation is highly labor-intensive, and automated approaches, including convolutional neural networks (CNNs), have struggled to generalize well due to properties inherent to MRI acquisition, leaving a great need for an effective segmentation tool. This study introduces a novel CNN-Transformer hybrid architecture designed to improve brain tissue segmentation by taking advantage of the increased performance and generality conferred by Transformers for 3D medical image segmentation tasks. We first demonstrate the superior performance of our model on various T1w MRI datasets. Then, we rigorously validate our model's generality applied across four multi-site T1w MRI datasets, covering different vendors, field strengths, scan parameters, and neuropsychiatric conditions. Finally, we highlight the reliability of our model on test-retest scans taken in different time points. In all situations, our model achieved the greatest generality and reliability compared to the benchmarks. As such, our method is inherently robust and can serve as a valuable tool for brain related T1w MRI studies. The code for the TABS network is available at: https://github.com/raovish6/TABS.

Single-cell spatial proteomic imaging for human neuropathology

Neurodegenerative disorders are characterized by phenotypic changes and hallmark proteopathies. Quantifying these in archival human brain tissues remains indispensable for validating animal models and understanding disease mechanisms. We present a framework for nanometer-scale, spatial proteomics with multiplex ion beam imaging (MIBI) for capturing neuropathological features. MIBI facilitated simultaneous, quantitative imaging of 36 proteins on archival human hippocampus from individuals spanning cognitively normal to dementia. Customized analysis strategies identified cell types and proteopathies in the hippocampus across stages of Alzheimer's disease (AD) neuropathologic change. We show microglia-pathologic tau interactions in hippocampal CA1 subfield in AD dementia. Data driven, sample independent creation of spatial proteomic regions identified persistent neurons in pathologic tau neighborhoods expressing mitochondrial protein MFN2, regardless of cognitive status, suggesting a survival advantage. Our study revealed unique insights from multiplexed imaging and data-driven approaches for neuropathologic analysis and serves broadly as a methodology for spatial proteomic analysis of archival human neuropathology. TEASER: Multiplex Ion beam Imaging enables deep spatial phenotyping of human neuropathology-associated cellular and disease features.

Review on Hybrid Segmentation Methods for Identification of Brain Tumor in MRI

Modalities like MRI give information about organs and highlight diseases. Organ information is visualized in intensities. The segmentation method plays an important role in the identification of the region of interest (ROI). The ROI can be segmented from the image using clustering, features, and region extraction. Segmentation can be performed in steps; firstly, the region is extracted from the image. Secondly, feature extraction performed, and better features are selected. They can be shape, texture, or intensity. Thirdly, clustering segments the shape of tumor, tumor has specified shape, and shape is detected by feature. Clustering consists of FCM, K-means, FKM, and their hybrid. To support the segmentation, we conducted three studies (region extraction, feature, and clustering) which are discussed in the first line of this review paper. All these studies are targeting MRI as a modality. MRI visualization proved to be more accurate for the identification of diseases compared with other modalities. Information of the modality is compromised due to low pass image. In MRI Images, the tumor intensities are variable in tumor areas as well as in tumor boundaries.

Machine learning in neuro-oncology: toward novel development fields

PURPOSE

Artificial Intelligence (AI) involves several and different techniques able to elaborate a large amount of data responding to a specific planned outcome. There are several possible applications of this technology in neuro-oncology.

METHODS

We reviewed, according to PRISMA guidelines, available studies adopting AI in different fields of neuro-oncology including neuro-radiology, pathology, surgery, radiation therapy, and systemic treatments.

RESULTS

Neuro-radiology presented the major number of studies assessing AI. However, this technology is being successfully tested also in other operative settings including surgery and radiation therapy. In this context, AI shows to significantly reduce resources and costs maintaining an elevated qualitative standard. Pathological diagnosis and development of novel systemic treatments are other two fields in which AI showed promising preliminary data.

CONCLUSION

It is likely that AI will be quickly included in some aspects of daily clinical practice. Possible applications of these techniques are impressive and cover all aspects of neuro-oncology.

Planning System for the Optimization of Electric Field Delivery using Implanted Electrodes for Brain Tumor Control

BACKGROUND

The use of non-ionizing electric fields from low intensity voltage sources (<10 V) to control malignant tumor growth is showing increasing potential as a cancer treatment modality. A method of applying these low intensity electric fields using multiple implanted electrodes within or adjacent to tumor volumes has been termed as intratumoral modulation therapy (IMT).

PURPOSE

This study explores advancements in the previously established IMT optimization algorithm, and the development of a custom treatment planning system for patient specific IMT. The practicality of the treatment planning system is demonstrated by implementing the full optimization pipeline on a brain phantom with robotic electrode implantation, post-operative imaging, and treatment stimulation.

METHODS

The integrated planning pipeline in 3D Slicer begins with importing and segmenting patient magnetic resonance images (MRI) or computed tomography (CT) images. The segmentation process is manual, followed by a semi-automatic smoothing step that allows the segmented brain and tumor mesh volumes to be smoothed and simplified by applying selected filters. Electrode trajectories are planned manually on the patient MRI or CT by selecting insertion and tip coordinates for a chosen number of electrodes. The electrode tip positions, and stimulation parameters (phase shift and voltage) can then be optimized with the custom semi-automatic IMT optimization algorithm where users can select the prescription electric field, voltage amplitude limit, tissue electrical properties, nearby organs at risk, optimization parameters (electrode tip location, individual contact phase shift and voltage), desired field coverage percent, and field conformity optimization. Tables of optimization results are displayed, and the resulting electric field is visualized as a field-map superimposed on the MR or CT image, with 3D renderings of the brain, tumor, and electrodes. Optimized electrode coordinates are transferred to robotic electrode implantation software to enable planning and subsequent implantation of the electrodes at the desired trajectories.

RESULTS

An IMT treatment planning system was developed that incorporates patient specific MRI or CT, segmentation, volume smoothing, electrode trajectory planning, electrode tip location and stimulation parameter optimization, and results visualization. All previous manual pipeline steps operating on diverse software platforms were coalesced into a single semi-automated 3D Slicer based user interface. Brain phantom validation of the full system implementation was successful in pre-operative planning, robotic electrode implantation, and post-operative treatment planning to adjust stimulation parameters based on actual implant locations. Voltage measurements were obtained in the brain phantom to determine the electrical parameters of the phantom and validate the simulated electric field distribution.

CONCLUSIONS

A custom treatment planning and implantation system for IMT has been developed in this study, and validated on a phantom brain model, providing an essential step in advancing IMT technology towards future clinical safety and efficacy investigations. This article is protected by copyright. All rights reserved.

LLRHNet: Multiple Lesions Segmentation Using Local-Long Range Features

The encoder-decoder-based deep convolutional neural networks (CNNs) have made great improvements in medical image segmentation tasks. However, due to the inherent locality of convolution, CNNs generally are demonstrated to have limitations in obtaining features across layers and long-range features from the medical image. In this study, we develop a local-long range hybrid features network (LLRHNet), which inherits the merits of the iterative aggregation mechanism and the transformer technology, as a medical image segmentation model. LLRHNet adopts encoder-decoder architecture as the backbone which iteratively aggregates the projection and up-sampling to fuse local low-high resolution features across isolated layers. The transformer adopts the multi-head self-attention mechanism to extract long-range features from the tokenized image patches and fuses these features with the local-range features extracted by down-sampling operation in the backbone network. These hybrid features are used to assist the cascaded up-sampling operations to local the position of the target tissues. LLRHNet is evaluated on two multiple lesions medical image data sets, including a public liver-related segmentation data set (3DIRCADb) and an in-house stroke and white matter hyperintensity (SWMH) segmentation data set. Experimental results denote that LLRHNet achieves state-of-the-art performance on both data sets.

Co-optimization Learning Network for MRI Segmentation of Ischemic Penumbra Tissues

Convolutional neural networks (CNNs) have brought hope for the medical image auxiliary diagnosis. However, the shortfall of labeled medical image data is the bottleneck that limits the performance improvement of supervised CNN methods. In addition, annotating a large number of labeled medical image data is often expensive and time-consuming. In this study, we propose a co-optimization learning network (COL-Net) for Magnetic Resonance Imaging (MRI) segmentation of ischemic penumbra tissues. COL-Net base on the limited labeled samples and consists of an unsupervised reconstruction network (R), a supervised segmentation network (S), and a transfer block (T). The reconstruction network extracts the robust features from reconstructing pseudo unlabeled samples, which is the auxiliary branch of the segmentation network. The segmentation network is used to segment the target lesions under the limited labeled samples and the auxiliary of the reconstruction network. The transfer block is used to co-optimization the feature maps between the bottlenecks of the reconstruction network and segmentation network. We propose a mix loss function to optimize COL-Net. COL-Net is verified on the public ischemic penumbra segmentation challenge (SPES) with two dozen labeled samples. Results demonstrate that COL-Net has high predictive accuracy and generalization with the Dice coefficient of 0.79. The extended experiment also shows COL-Net outperforms most supervised segmentation methods. COL-Net is a meaningful attempt to alleviate the limited labeled sample problem in medical image segmentation.

Multi-task learning approach for volumetric segmentation and reconstruction in 3D OCT images

The choroid is the vascular layer of the eye that supplies photoreceptors with oxygen. Changes in the choroid are associated with many pathologies including myopia where the choroid progressively thins due to axial elongation. To quantize these changes, there is a need to automatically and accurately segment the choroidal layer from optical coherence tomography (OCT) images. In this paper, we propose a multi-task learning approach to segment the choroid from three-dimensional OCT images. Our proposed architecture aggregates the spatial context from adjacent cross-sectional slices to reconstruct the central slice. Spatial context learned by this reconstruction mechanism is then fused with a U-Net based architecture for segmentation. The proposed approach was evaluated on volumetric OCT scans of 166 myopic eyes acquired with a commercial OCT system, and achieved a cross-validation Intersection over Union (IoU) score of 94.69% which significantly outperformed (p<0.001) the other state-of-the-art methods on the same data set. Choroidal thickness maps generated by our approach also achieved a better structural similarity index (SSIM) of 72.11% with respect to the groundtruth. In particular, our approach performs well for highly challenging eyes with thinner choroids. Compared to other methods, our proposed approach also requires lesser processing time and has lower computational requirements. The results suggest that our proposed approach could potentially be used as a fast and reliable method for automated choroidal segmentation.

Towards an Architecture of a Multi-purpose, User-Extendable Reference Human Brain Atlas

Human brain atlas development is predominantly research-oriented and the use of atlases in clinical practice is limited. Here I introduce a new definition of a reference human brain atlas that serves education, research and clinical applications, and is extendable by its user. Subsequently, an architecture of a multi-purpose, user-extendable reference human brain atlas is proposed and its implementation discussed. The human brain atlas is defined as a vehicle to gather, present, use, share, and discover knowledge about the human brain with highly organized content, tools enabling a wide range of its applications, massive and heterogeneous knowledge database, and means for content and knowledge growing by its users. The proposed architecture determines major components of the atlas, their mutual relationships, and functional roles. It contains four functional units, core cerebral models, knowledge database, research and clinical data input and conversion, and toolkit (supporting processing, content extension, atlas individualization, navigation, exploration, and display), all united by a user interface. Each unit is described in terms of its function, component modules and sub-modules, data handling, and implementation aspects. This novel architecture supports brain knowledge gathering, presentation, use, sharing, and discovery and is broadly applicable and useful in student- and educator-oriented neuroeducation for knowledge presentation and communication, research for knowledge acquisition, aggregation and discovery, and clinical applications in decision making support for prevention, diagnosis, treatment, monitoring, and prediction. It establishes a backbone for designing and developing new, multi-purpose and user-extendable brain atlas platforms, serving as a potential standard across labs, hospitals, and medical schools.

Whole brain segmentation with full volume neural network

Whole brain segmentation is an important neuroimaging task that segments the whole brain volume into anatomically labeled regions-of-interest. Convolutional neural networks have demonstrated good performance in this task. Existing solutions, usually segment the brain image by classifying the voxels, or labeling the slices or the sub-volumes separately. Their representation learning is based on parts of the whole volume whereas their labeling result is produced by aggregation of partial segmentation. Learning and inference with incomplete information could lead to sub-optimal final segmentation result. To address these issues, we propose to adopt a full volume framework, which feeds the full volume brain image into the segmentation network and directly outputs the segmentation result for the whole brain volume. The framework makes use of complete information in each volume and can be implemented easily. An effective instance in this framework is given subsequently. We adopt the 3D high-resolution network (HRNet) for learning spatially fine-grained representations and the mixed precision training scheme for memory-efficient training. Extensive experiment results on a publicly available 3D MRI brain dataset show that our proposed model advances the state-of-the-art methods in terms of segmentation performance.

Computer auxiliary diagnosis technique of detecting cholangiocarcinoma based on medical imaging: A review

BACKGROUND AND OBJECTIVES

Cholangiocarcinoma (CCA) is one of the most aggressive human malignant tumors and is becoming one of the main factors of death and disability globally. Specifically, 60% to 70% of CCA patients were diagnosed with local invasion or distant metastasis and lost the chance of radical operation. The overall median survival time was less than 12 months. As a non-invasive diagnostic technology, medical imaging consisting of computed tomography (CT) imaging, magnetic resonance imaging (MRI), and ultrasound (US) imaging, is the most effectively and commonly used method to detect CCA. The computer auxiliary diagnosis (CAD) system based on medical imaging is helpful for rapid diagnosis and provides credible "second opinion" for specialists. The purpose of this review is to categorize and review the CAD technique of detecting CCA based on medical imaging.

METHODS

This work applies a four-level screening process to choose suitable publications. 125 research papers published in different academic research databases were selected and analyzed according to specific criteria. From the five steps of medical image acquisition, processing, analysis, understanding and verification of CAD combined with artificial intelligence algorithms, we obtain the most advanced insights related to CCA detection.

RESULTS

This work provides a comprehensive analysis and comparison analysis of the current CAD systems of detecting CCA. After careful investigation, we find that the main detection methods are traditional machine learning method and deep learning method. For the detection, the most commonly used method is semi-automatic segmentation algorithm combined with support vector machine classifier method, combination of which has good detection performance. The end-to-end training mode makes deep learning method more and more popular in CAD systems. However, due to the limited medical training data, the accuracy of deep learning method is unsatisfactory.

CONCLUSIONS

Based on analysis of artificial intelligence methods applied in CCA, this work is expected to be truly applied in clinical practice in the future to improve the level of clinical diagnosis and treatment of it. This work concludes by providing a prediction of future trends, which will be of great significance for researchers in the medical imaging of CCA and artificial intelligence.

A Novel Type-2 Fuzzy C-Means Clustering for Brain MR Image Segmentation

The fuzzy C -means (FCM) clustering procedure is an unsupervised form of grouping the homogenous pixels of an image in the feature space into clusters. A brain magnetic resonance (MR) image is affected by noise and intensity inhomogeneity (IIH) during the acquisition process. FCM has been used in MR brain tissue segmentation. However, it does not consider the neighboring pixels for computing the membership values, thereby misclassifying the noisy pixels. The inaccurate cluster centers obtained in FCM do not address the problem of IIH. A fixed value of the fuzzifier ( m ) used in FCM brings uncertainty in controlling the fuzziness of the extracted clusters. To resolve these issues, we suggest a novel type-2 adaptive weighted spatial FCM (AWSFCM) clustering algorithm for MR brain tissue segmentation. The idea of type-2 FCM applied to the problem on hand is new and is reported in this article. The application of the proposed technique to the problem of MR brain tissue segmentation replaces the fixed fuzzifier value with a fuzzy linguistic fuzzifier value ( M ). The introduction of the spatial information in the membership function reduces the misclassification of noisy pixels. Furthermore, the incorporation of adaptive weights into the cluster center update function improves the accuracy of the final cluster centers, thereby reducing the effect of IIH. The suggested algorithm is evaluated using T1-w, T2-w, and proton density (PD) brain MR image slices. The performance is justified in terms of qualitative and quantitative measures followed by statistical analysis. The outcomes demonstrate the superiority and robustness of the algorithm in comparison to the state-of-the-art methods. This article is useful for the cybernetics application.

An atlas of classifiers-a machine learning paradigm for brain MRI segmentation

We present the Atlas of Classifiers (AoC)-a conceptually novel framework for brain MRI segmentation. The AoC is a spatial map of voxel-wise multinomial logistic regression (LR) functions learned from the labeled data. Upon convergence, the resulting fixed LR weights, a few for each voxel, represent the training dataset. It can, therefore, be considered as a light-weight learning machine, which despite its low capacity does not underfit the problem. The AoC construction is independent of the actual intensities of the test images, providing the flexibility to train it on the available labeled data and use it for the segmentation of images from different datasets and modalities. In this sense, it does not overfit the training data, as well. The proposed method has been applied to numerous publicly available datasets for the segmentation of brain MRI tissues and is shown to be robust to noise and outreach commonly used methods. Promising results were also obtained for multi-modal, cross-modality MRI segmentation. Finally, we show how AoC trained on brain MRIs of healthy subjects can be exploited for lesion segmentation of multiple sclerosis patients.

A deep learning method for automatic segmentation of the bony orbit in MRI and CT images

This paper proposes a fully automatic method to segment the inner boundary of the bony orbit in two different image modalities: magnetic resonance imaging (MRI) and computed tomography (CT). The method, based on a deep learning architecture, uses two fully convolutional neural networks in series followed by a graph-search method to generate a boundary for the orbit. When compared to human performance for segmentation of both CT and MRI data, the proposed method achieves high Dice coefficients on both orbit and background, with scores of 0.813 and 0.975 in CT images and 0.930 and 0.995 in MRI images, showing a high degree of agreement with a manual segmentation by a human expert. Given the volumetric characteristics of these imaging modalities and the complexity and time-consuming nature of the segmentation of the orbital region in the human skull, it is often impractical to manually segment these images. Thus, the proposed method provides a valid clinical and research tool that performs similarly to the human observer.

Evaluation of automated segmentation algorithms for neurons in macaque cerebral microscopic images

Accurate cerebral neuron segmentation is required before neuron counting and neuron morphological analysis. Numerous algorithms for neuron segmentation have been published, but they are mainly evaluated using limited subsets from a specific anatomical region, targeting neurons of clear contrast and/or neurons with similar staining intensity. It is thus unclear how these algorithms perform on cerebral neurons in diverse anatomical regions. In this article, we introduce and reliably evaluate existing machine learning algorithms using a data set of microscopy images of macaque brain. This data set highlights various anatomical regions (e.g., cortex, caudate, thalamus, claustrum, putamen, hippocampus, subiculum, lateral geniculate, globus pallidus, etc.), poor contrast, and staining intensity differences of neurons. The evaluation was performed using 10 architectures of six classic machine learning algorithms in terms of typical Recall, Precision, F-score, aggregated Jaccard index (AJI), as well as a performance ranking of algorithms. F-score of most of the algorithms is superior to 0.7. Deep learning algorithms facilitate generally higher F-scores. U-net with suitable layer depth has been evaluated to be excellent classifiers with F-score of 0.846 and 0.837 when performing cross validation. The evaluation and analysis indicate the performance gap among algorithms in various anatomical regions and the strengths and limitations of each algorithm. The comparative result highlights at the same time the importance and difficulty of neuron segmentation and provides clues for future improvement. To the best of our knowledge, this work is the first comprehensive study for neuron segmentation in such large-scale anatomical regions.

Voxel-Wise Feature Selection Method for CNN Binary Classification of Neuroimaging Data

Voxel-wise group analysis is presented as a novel feature selection (FS) technique for a deep learning (DL) approach to brain imaging data classification. The method, based on a voxel-wise two-sample t-test and denoted as t-masking, is integrated into the learning procedure as a data-driven FS strategy. t-Masking has been introduced in a convolutional neural network (CNN) for the test bench of binary classification of very-mild Alzheimer’s disease vs. normal control, using a structural magnetic resonance imaging dataset of 180 subjects. To better characterize the t-masking impact on CNN classification performance, six different experimental configurations were designed. Moreover, the performances of the presented FS method were compared to those of similar machine learning (ML) models that relied on different FS approaches. Overall, our results show an enhancement of about 6% in performance when t-masking was applied. Moreover, the reported performance enhancement was higher with respect to similar FS-based ML models. In addition, evaluation of the impact of t-masking on various selection rates has been provided, serving as a useful characterization for future insights. The proposed approach is also highly generalizable to other DL architectures, neuroimaging modalities, and brain pathologies.

MhURI:A Supervised Segmentation Approach to Leverage Salient Brain Tissues in Magnetic Resonance Images

BACKGROUND AND OBJECTIVES

Accurate segmentation of critical tissues from a brain MRI is pivotal for characterization and quantitative pattern analysis of the human brain and thereby, identifies the earliest signs of various neurodegenerative diseases. To date, in most cases, it is done manually by the radiologists. The overwhelming workload in some of the thickly populated nations may cause exhaustion leading to interruption for the doctors, which may pose a continuing threat to patient safety. A novel fusion method called U-Net inception based on 3D convolutions and transition layers is proposed to address this issue.

METHODS

A 3D deep learning method called Multi headed U-Net with Residual Inception (MhURI) accompanied by Morphological Gradient channel for brain tissue segmentation is proposed, which incorporates Residual Inception 2-Residual (RI2R) module as the basic building block. The model exploits the benefits of morphological pre-processing for structural enhancement of MR images. A multi-path data encoding pipeline is introduced on top of the U-Net backbone, which encapsulates initial global features and captures the information from each MRI modality.

RESULTS

The proposed model has accomplished encouraging outcomes, which appreciates the adequacy in terms of some of the established quality metrices when compared with some of the state-of-the-art methods while evaluating with respect to two popular publicly available data sets.

CONCLUSION

The model is entirely automatic and able to segment gray matter (GM), white matter (WM), and cerebrospinal fluid (CSF) from brain MRI effectively with sufficient accuracy. Hence, it may be considered to be a potential computer-aided diagnostic (CAD) tool for radiologists and other medical practitioners in their clinical diagnosis workflow.

A Survey on State-of-the-art Denoising Techniques for Brain Magnetic Resonance Images

The accuracy of the magnetic resonance (MR) image diagnosis depends on the quality of the image, which degrades mainly due to noise and artifacts. The noise is introduced because of erroneous imaging environment or distortion in the transmission system. Therefore, denoising methods play an important role in enhancing the image quality. However, a tradeoff between denoising and preserving the structural details is required. Most of the existing surveys are conducted on a specific MR image modality or on limited denoising schemes. In this context, a comprehensive review on different MR image denoising techniques is inevitable. This survey suggests a new direction in categorizing the MR image denoising techniques. The categorization of the different image models used in medical image processing serves as the basis of our classification. This study includes recent improvements on deep learning-based denoising methods alongwith important traditional MR image denoising methods. The major challenges and their scope of improvement are also discussed. Further, many more evaluation indices are considered for a fair comparison. An elaborate discussion on selecting appropriate method and evaluation metric as per the kind of data is presented. This study may encourage researchers for further work in this domain.

Magnetic resonance imaging manifestations of cerebral small vessel disease: automated quantification and clinical application

The common cerebral small vessel disease (CSVD) neuroimaging features visible on conventional structural magnetic resonance imaging include recent small subcortical infarcts, lacunes, white matter hyperintensities, perivascular spaces, microbleeds, and brain atrophy. The CSVD neuroimaging features have shared and distinct clinical consequences, and the automatic quantification methods for these features are increasingly used in research and clinical settings. This review article explores the recent progress in CSVD neuroimaging feature quantification and provides an overview of the clinical consequences of these CSVD features as well as the possibilities of using these features as endpoints in clinical trials. The added value of CSVD neuroimaging quantification is also discussed for researches focused on the mechanism of CSVD and the prognosis in subjects with CSVD.

Segmentation of MR Brain Images Through Hidden Markov Random Field and Hybrid Metaheuristic Algorithm

Image segmentation is one of the most critical tasks in Magnetic Resonance (MR) images analysis. Since the performance of most current image segmentation methods is suffered by noise and intensity non-uniformity artifact (INU), a precise and artifact resistant method is desired. In this work, we propose a new segmentation method combining a new Hidden Markov Random Field (HMRF) model and a novel hybrid metaheuristic method based on Cuckoo search (CS) and Particle swarm optimization algorithms (PSO). The new model uses adaptive parameters to allow balancing between the segmented components of the model. In addition, to improve the quality of searching solutions in the Maximum a posteriori (MAP) estimation of the HMRF model, the hybrid metaheuristic algorithm is introduced. This algorithm takes into account both the advantages of CS and PSO algorithms in searching ability by cooperating them with the same population in a parallel way and with a solution selection mechanism. Since CS and PSO are performing exploration and exploitation in the search space, respectively, hybridizing them in an intelligent way can provide better solutions in terms of quality. Furthermore, initialization of the population is carefully taken into account to improve the performance of the proposed method. The whole algorithm is evaluated on benchmark images including both the simulated and real MR brain images. Experimental results show that the proposed method can achieve satisfactory performance for images with noise and intensity inhomogeneity, and provides better results than its considered competitors.

A 3D Spatially Weighted Network for Segmentation of Brain Tissue From MRI

The segmentation of brain tissue in MRI is valuable for extracting brain structure to aid diagnosis, treatment and tracking the progression of different neurologic diseases. Medical image data are volumetric and some neural network models for medical image segmentation have addressed this using a 3D convolutional architecture. However, this volumetric spatial information has not been fully exploited to enhance the representative ability of deep networks, and these networks have not fully addressed the practical issues facing the analysis of multimodal MRI data. In this paper, we propose a spatially-weighted 3D network (SW-3D-UNet) for brain tissue segmentation of single-modality MRI, and extend it using multimodality MRI data. We validate our model on the MRBrainS13 and MALC12 datasets. This unpublished model ranked first on the leaderboard of the MRBrainS13 Challenge.

A Review of Automated Methods for the Detection of Sickle Cell Disease

Detection of sickle cell disease is a crucial job in medical image analysis. It emphasizes elaborate analysis of proper disease diagnosis after accurate detection followed by a classification of irregularities, which plays a vital role in the sickle cell disease diagnosis, treatment planning, and treatment outcome evaluation. Proper segmentation of complex cell clusters makes sickle cell detection more accurate and robust. Cell morphology has a key role in the detection of the sickle cell because the shapes of the normal blood cell and sickle cell differ significantly. This review emphasizes state-of-the-art methods and recent advances in detection, segmentation, and classification of sickle cell disease. We discuss key challenges encountered during the segmentation of overlapping blood cells. Moreover, standard validation measures that have been employed to yield performance analysis of various methods are also discussed. The methodologies and experiments in this review will be useful to further research and work in this area.

A multi-objective optimization approach for brain MRI segmentation using fuzzy entropy clustering and region-based active contour methods

In this paper, we present a new multi-objective optimization approach for segmentation of Magnetic Resonance Imaging (MRI) of the human brain. The proposed algorithm not only takes advantages but also solves major drawbacks of two well-known complementary techniques, called fuzzy entropy clustering method and region-based active contour method, using multi-objective particle swarm optimization (MOPSO) approach. In order to obtain accurate segmentation results, firstly, two fitness functions with independent characteristics, compactness and separation, are derived from kernelized fuzzy entropy clustering with local spatial information and bias correction (KFECSB) and a novel adaptive energy weight combined with global and local fitting energy active contour (AWGLAC) model. Then, they are simultaneously optimized to finally produce a set of non-dominated solutions, from which L₂-metric method is used to select the best trade-off solution. Our algorithm is both verified and compared with other state-of-the-art methods using simulated MR images and real MR images from the McConnell Brain Imaging Center (BrainWeb) and the Internet Brain Segmentation Repository (IBSR), respectively. The experimental results demonstrate that the proposed technique achieves superior segmentation performance in terms of accuracy and robustness.

Local Complexity Estimation Based Filtering Method in Wavelet Domain for Magnetic Resonance Imaging Denoising

In this paper, we propose the local complexity estimation based filtering method in wavelet domain for MRI (magnetic resonance imaging) denoising. A threshold selection methodology is proposed in which the edge and detail preservation properties for each pixel are determined by the local complexity of the input image. In the proposed filtering method, the current wavelet kernel is compared with a threshold to identify the signal- or noise-dominant pixels in a scale providing a good visual quality avoiding blurred and over smoothened processed images. We present a comparative performance analysis with different wavelets to find the optimal wavelet for MRI denoising. Numerical experiments and visual results in simulated MR images degraded with Rician noise demonstrate that the proposed algorithm consistently outperforms other denoising methods by balancing the tradeoff between noise suppression and fine detail preservation. The proposed algorithm can enhance the contrast between regions allowing the delineation of the regions of interest between different textures or tissues in the processed images. The proposed approach produces a satisfactory result in the case of real MRI denoising by balancing the detail preservation and noise removal, by enhancing the contrast between the regions of the image. Additionally, the proposed algorithm is compared with other approaches in the case of Additive White Gaussian Noise (AWGN) using standard images to demonstrate that the proposed approach does not need to be adapted specifically to Rician or AWGN noise; it is an advantage of the proposed approach in comparison with other methods. Finally, the proposed scheme is simple, efficient and feasible for MRI denoising.

An overview of deep learning in medical imaging focusing on MRI

What has happened in machine learning lately, and what does it mean for the future of medical image analysis? Machine learning has witnessed a tremendous amount of attention over the last few years. The current boom started around 2009 when so-called deep artificial neural networks began outperforming other established models on a number of important benchmarks. Deep neural networks are now the state-of-the-art machine learning models across a variety of areas, from image analysis to natural language processing, and widely deployed in academia and industry. These developments have a huge potential for medical imaging technology, medical data analysis, medical diagnostics and healthcare in general, slowly being realized. We provide a short overview of recent advances and some associated challenges in machine learning applied to medical image processing and image analysis. As this has become a very broad and fast expanding field we will not survey the entire landscape of applications, but put particular focus on deep learning in MRI. Our aim is threefold: (i) give a brief introduction to deep learning with pointers to core references; (ii) indicate how deep learning has been applied to the entire MRI processing chain, from acquisition to image retrieval, from segmentation to disease prediction; (iii) provide a starting point for people interested in experimenting and perhaps contributing to the field of deep learning for medical imaging by pointing out good educational resources, state-of-the-art open-source code, and interesting sources of data and problems related medical imaging.

Evaluation of Parallel Level Sets and Bowsher's Method as Segmentation-Free Anatomical Priors for Time-of-Flight PET Reconstruction

In this article, we evaluate Parallel Level Sets (PLS) and Bowsher's method as segmentation-free anatomical priors for regularized brain positron emission tomography (PET) reconstruction. We derive the proximity operators for two PLS priors and use the EM-TV algorithm in combination with the first order primal-dual algorithm by Chambolle and Pock to solve the non-smooth optimization problem for PET reconstruction with PLS regularization. In addition, we compare the performance of two PLS versions against the symmetric and asymmetric Bowsher priors with quadratic and relative difference penalty function. For this aim, we first evaluate reconstructions of 30 noise realizations of simulated PET data derived from a real hybrid positron emission tomography/magnetic resonance imaging (PET/MR) acquisition in terms of regional bias and noise. Second, we evaluate reconstructions of a real brain PET/MR data set acquired on a GE Signa time-of-flight PET/MR in a similar way. The reconstructions of simulated and real 3D PET/MR data show that all priors were superior to post-smoothed maximum likelihood expectation maximization with ordered subsets (OSEM) in terms of bias-noise characteristics in different regions of interest where the PET uptake follows anatomical boundaries. Our implementation of the asymmetric Bowsher prior showed slightly superior performance compared with the two versions of PLS and the symmetric Bowsher prior. At very high regularization weights, all investigated anatomical priors suffer from the transfer of non-shared gradients.

Discovery and visualization of structural biomarkers from MRI using transport-based morphometry

Disease in the brain is often associated with subtle, spatially diffuse, or complex tissue changes that may lie beneath the level of gross visual inspection, even on magnetic resonance imaging (MRI). Unfortunately, current computer-assisted approaches that examine pre-specified features, whether anatomically-defined (i.e. thalamic volume, cortical thickness) or based on pixelwise comparison (i.e. deformation-based methods), are prone to missing a vast array of physical changes that are not well-encapsulated by these metrics. In this paper, we have developed a technique for automated pattern analysis that can fully determine the relationship between brain structure and observable phenotype without requiring any a priori features. Our technique, called transport-based morphometry (TBM), is an image transformation that maps brain images losslessly to a domain where they become much more separable. The new approach is validated on structural brain images of healthy older adult subjects where even linear models for discrimination, regression, and blind source separation enable TBM to independently discover the characteristic changes of aging and highlight potential mechanisms by which aerobic fitness may mediate brain health later in life. TBM is a generative approach that can provide visualization of physically meaningful shifts in tissue distribution through inverse transformation. The proposed framework is a powerful technique that can potentially elucidate genotype-structural-behavioral associations in myriad diseases.