Tumour volume determination from MR images by morphological segmentation

Estimation of the Ischemic Lesion in the Experimental Stroke Studies Using Magnetic Resonance Imaging (Review)

In translational animal study aimed at evaluation of the effectiveness of innovative methods for treating cerebral stroke, including regenerative cell technologies, of particular importance is evaluation of the dynamics of changes in the volume of the cerebral infarction in response to therapy. Among the methods for assessing the focus of infarction, MRI is the most effective and convenient tool for use in preclinical studies. This review provides a description of MR pulse sequences used to visualize cerebral ischemia at various stages of its development, and a detailed description of the MR semiotics of cerebral infarction. A comparison of various methods for morphometric analysis of the focus of a cerebral infarction, including systems based on artificial intelligence for a more objective measurement of the volume of the lesion, is also presented.

Deep 3D Neural Network for Brain Structures Segmentation Using Self-Attention Modules in MRI Images

In recent years, the use of deep learning-based models for developing advanced healthcare systems has been growing due to the results they can achieve. However, the majority of the proposed deep learning-models largely use convolutional and pooling operations, causing a loss in valuable data and focusing on local information. In this paper, we propose a deep learning-based approach that uses global and local features which are of importance in the medical image segmentation process. In order to train the architecture, we used extracted three-dimensional (3D) blocks from the full magnetic resonance image resolution, which were sent through a set of successive convolutional neural network (CNN) layers free of pooling operations to extract local information. Later, we sent the resulting feature maps to successive layers of self-attention modules to obtain the global context, whose output was later dispatched to the decoder pipeline composed mostly of upsampling layers. The model was trained using the Mindboggle-101 dataset. The experimental results showed that the self-attention modules allow segmentation with a higher Mean Dice Score of 0.90 ± 0.036 compared with other UNet-based approaches. The average segmentation time was approximately 0.038 s per brain structure. The proposed model allows tackling the brain structure segmentation task properly. Exploiting the global context that the self-attention modules incorporate allows for more precise and faster segmentation. We segmented 37 brain structures and, to the best of our knowledge, it is the largest number of structures under a 3D approach using attention mechanisms.

Medical Image Segmentation Using Transformer Networks

Deep learning models represent the state of the art in medical image segmentation. Most of these models are fully-convolutional networks (FCNs), namely each layer processes the output of the preceding layer with convolution operations. The convolution operation enjoys several important properties such as sparse interactions, parameter sharing, and translation equivariance. Because of these properties, FCNs possess a strong and useful inductive bias for image modeling and analysis. However, they also have certain important shortcomings, such as performing a fixed and pre-determined operation on a test image regardless of its content and difficulty in modeling long-range interactions. In this work we show that a different deep neural network architecture, based entirely on self-attention between neighboring image patches and without any convolution operations, can achieve more accurate segmentations than FCNs. Our proposed model is based directly on the transformer network architecture. Given a 3D image block, our network divides it into non-overlapping 3D patches and computes a 1D embedding for each patch. The network predicts the segmentation map for the block based on the self-attention between these patch embeddings. Furthermore, in order to address the common problem of scarcity of labeled medical images, we propose methods for pre-training this model on large corpora of unlabeled images. Our experiments show that the proposed model can achieve segmentation accuracies that are better than several state of the art FCN architectures on two datasets. Our proposed network can be trained using only tens of labeled images. Moreover, with the proposed pre-training strategies, our network outperforms FCNs when labeled training data is small.

Sparse Coding for Brain Tumor Segmentation Based on the Non-Linear Features

The main aim of brain Magnetic Resonance Image (MRI) segmentation is to extractthe significant objects like tumors for better diagnosis and proper treatment. As the brain tumors are distinct in the sense of shapes, location, and intensity it is hard to define a general algorithm for the tumor segmentation. Accurate extraction of tumors from the brain MRIs is a challenging task due to the complex anatomical structure of brain tissues in addition to the existence of intensity inhomogeneity, partial volume effects, and noise. In this paper, a method of Sparse coding based on non-linear features is proposed for the tumor segmentation from MR images of the brain. Initially, first and second-order statistical eigenvectors of 3 × 3 size are extracted from the MRIs then the process of Sparse coding is applied to them. The kernel dictionary learning algorithm is employed to obtain the non-linear features from these processed vectors to build two individual adaptive dictionaries for healthy and pathological tissues. This work proposes dictionary learning based kernel clustering algorithm to code the pixels, and then the target pixelsare classified by utilizing the method of linear discrimination. The proposed technique is applied to several tumor MRIs, taken from the BRATS database. This technique overcomes the problem of linear inseparability produced by the high level intensity similarity between the normal and abnormal tissues of the given brain image. All the performance parameters are high for the proposed technique. Comparison of the results with some other existing methods such as Fuzzy – C- Means (FCM), Hybrid k-Mean Graph Cut (HKMGC) and Neutrosophic Set – Expert Maximum Fuzzy Sure Entropy (NS-EMFSE) demonstrates that the proposed sparse coding method is effective in segmenting the brain tumor regions.

A Brain Tumor Segmentation Framework Based on Outlier Detection Using One-Class Support Vector Machine

Accurate segmentation of brain tumors is a challenging task and also a crucial step in diagnosis and treatment planning for cancer patients. Magnetic resonance imaging (MRI) is the standard imaging modality for detection, characterization, treatment planning and outcome evaluation of brain tumors. MRI scans are usually acquired at multiple sessions before and after the treatment. An automatic segmentation framework is highly desirable to segment brain tumors in MR images as it streamlines the image-guided radiation therapy workflow considerably. Automatic segmentation of brain tumors also facilitates an incremental development of data-driven systems for therapy outcome prediction based on radiomics analysis. In this study, an outlier-detection-based segmentation framework is proposed to delineate brain tumors in magnetic resonance (MR) images automatically. The proposed method considers the tumor and edema pixels in an MR image as outliers compared to the pixels associated with the healthy tissue. The framework generates two outlier masks using independent one-class support vector machines that operate on post-contrast T1-weighted (T1w) and T2-weighted-fluid-attenuation-inversion-recovery (T2-FLAIR) images. The outlier masks are subsequently refined and fused using a number of morphological and logical operators to estimate a tumor mask for each image slice. The framework was constructed and evaluated using the MRI data acquired from 35 and 5 patients with brain metastasis, respectively. The obtained results demonstrated an average Dice similarity coefficient and Hausdorff distance of 0.84 ± 0.06 and 1.85 ± 0.48 mm, respectively, between the manual (ground truth) and automatic tumor contours, on the independent test set.

A Cascaded Deep-Learning Framework for Segmentation of Metastatic Brain Tumors Before and After Stereotactic Radiation Therapy

Radiation therapy is a major treatment option for brain metastasis. For radiation treatment planning and outcome evaluation, magnetic resonance (MR) images are acquired before and at multiple sessions after the treatment. Accurate segmentation of brain tumors on MR images is crucial for treatment planning, response evaluation, and developing data-driven models for outcome prediction. Due to the high volume of imaging data acquired from each patient at multiple follow-up sessions, manual tumor segmentation is resource- and time-consuming in clinic, hence developing an automatic segmentation framework is highly desirable. In this work, we proposed a cascaded 2D-3D Unet framework to segment brain tumors automatically on contrast-enhanced T1- weighted images acquired before and at multiple scan sessions after radiotherapy. 2D Unet is a well-known structure for medical image segmentation. 3D Unet is an extension of 2D Unet with a volumetric input image to provide richer spatial information. The limitation of 3D Unet is that it is memory consuming and cannot process large volumetric images. To address this limitation, a large volumetric input of 3D Unet is often patched to smaller volumes which leads to loss of context. To overcome this problem, we proposed using two cascaded 2D Unets to crop the input volume around the tumor area and reduce the input size of the 3D Unet, obviating the need to patch the input images. The framework was trained using images acquired from 96 patients before radiation therapy and tested using images acquired from 10 patients before and at four follow-up scans after radiotherapy. The segmentation results for the images of independent test set demonstrated that the cascaded framework outperformed the 2D and 3D Unets alone, with an average Dice score of 0.9 versus 0.86 and 0.88 for the baseline, and 0.87 versus 0.83 and 0.84 for the first followup. Similar results were obtained for the other follow-up scans.

Review on 2D and 3D MRI Image Segmentation Techniques

BACKGROUND

Magnetic Resonance Imaging is most widely used for early diagnosis of abnormalities in human organs. Due to the technical advancement in digital image processing, automatic computer aided medical image segmentation has been widely used in medical diagnostics.

DISCUSSION

Image segmentation is an image processing technique which is used for extracting image features, searching and mining the medical image records for better and accurate medical diagnostics. Commonly used segmentation techniques are threshold based image segmentation, clustering based image segmentation, edge based image segmentation, region based image segmentation, atlas based image segmentation, and artificial neural network based image segmentation.

CONCLUSION

This survey aims at providing an insight about different 2-Dimensional and 3- Dimensional MRI image segmentation techniques and to facilitate better understanding to the people who are new in this field. This comparative study summarizes the benefits and limitations of various segmentation techniques.

Prediction of Glioma Grades Using Deep Learning with Wavelet Radiomic Features

Gliomas are the most common primary brain tumors. They are classified into 4 grades (Grade I–II-III–IV) according to the guidelines of the World Health Organization (WHO). The accurate grading of gliomas has clinical significance for planning prognostic treatments, pre-diagnosis, monitoring and administration of chemotherapy. The purpose of this study is to develop a deep learning-based classification method using radiomic features of brain tumor glioma grades with deep neural network (DNN). The classifier was combined with the discrete wavelet transform (DWT) the powerful feature extraction tool. This study primarily focuses on the four main aspects of the radiomic workflow, namely tumor segmentation, feature extraction, analysis, and classification. We evaluated data from 121 patients with brain tumors (Grade II, n = 77; Grade III, n = 44) from The Cancer Imaging Archive, and 744 radiomic features were obtained by applying low sub-band and high sub-band 3D wavelet transform filters to the 3D tumor images. Quantitative values were statistically analyzed with MannWhitney U tests and 126 radiomic features with significant statistical properties were selected in eight different wavelet filters. Classification performances of 3D wavelet transform filter groups were measured using accuracy, sensitivity, F1 score, and specificity values using the deep learning classifier model. The proposed model was highly effective in grading gliomas with 96.15% accuracy, 94.12% precision, 100% recall, 96.97% F1 score, and 98.75% Area under the ROC curve. As a result, deep learning and feature selection techniques with wavelet transform filters can be accurately applied using the proposed method in glioma grade classification.

Multimodal MRI Brain Tumor Image Segmentation Using Sparse Subspace Clustering Algorithm

Brain tumors are one of the most deadly diseases with a high mortality rate. The shape and size of the tumor are random during the growth process. Brain tumor segmentation is a brain tumor assisted diagnosis technology that separates different brain tumor structures such as edema and active and tumor necrosis tissues from normal brain tissue. Magnetic resonance imaging (MRI) technology has the advantages of no radiation impact on the human body, good imaging effect on structural tissues, and an ability to realize tomographic imaging of any orientation. Therefore, doctors often use MRI brain tumor images to analyze and process brain tumors. In these images, the tumor structure is only characterized by grayscale changes, and the developed images obtained by different equipment and different conditions may also be different. This makes it difficult for traditional image segmentation methods to deal well with the segmentation of brain tumor images. Considering that the traditional single-mode MRI brain tumor images contain incomplete brain tumor information, it is difficult to segment the single-mode brain tumor images to meet clinical needs. In this paper, a sparse subspace clustering (SSC) algorithm is introduced to process the diagnosis of multimodal MRI brain tumor images. In the absence of added noise, the proposed algorithm has better advantages than traditional methods. Compared with the top 15 in the Brats 2015 competition, the accuracy is not much different, being basically stable between 10 and 15. In order to verify the noise resistance of the proposed algorithm, this paper adds 5%, 10%, 15%, and 20% Gaussian noise to the test image. Experimental results show that the proposed algorithm has better noise immunity than a comparable algorithm.

A Novel Radial Basis Neural Network-Leveraged Fast Training Method for Identifying Organs in MR Images

We propose a new method for fast organ classification and segmentation of abdominal magnetic resonance (MR) images. Magnetic resonance imaging (MRI) is a new type of high-tech imaging examination fashion in recent years. Recognition of specific target areas (organs) based on MR images is one of the key issues in computer-aided diagnosis of medical images. Artificial neural network technology has made significant progress in image processing based on the multimodal MR attributes of each pixel in MR images. However, with the generation of large-scale data, there are few studies on the rapid processing of large-scale MRI data. To address this deficiency, we present a fast radial basis function artificial neural network (Fast-RBF) algorithm. The importance of our efforts is as follows: (1) The proposed algorithm achieves fast processing of large-scale image data by introducing the ε-insensitive loss function, the structural risk term, and the core-set principle. We apply this algorithm to the identification of specific target areas in MR images. (2) For each abdominal MRI case, we use four MR sequences (fat, water, in-phase (IP), and opposed-phase (OP)) and the position coordinates (x, y) of each pixel as the input of the algorithm. We use three classifiers to identify the liver and kidneys in the MR images. Experiments show that the proposed method achieves a higher precision in the recognition of specific regions of medical images and has better adaptability in the case of large-scale datasets than the traditional RBF algorithm.

Fully automatic brain tumor segmentation with deep learning-based selective attention using overlapping patches and multi-class weighted cross-entropy

In this paper, we present a new Deep Convolutional Neural Networks (CNNs) dedicated to fully automatic segmentation of Glioblastoma brain tumors with high- and low-grade. The proposed CNNs model is inspired by the Occipito-Temporal pathway which has a special function called selective attention that uses different receptive field sizes in successive layers to figure out the crucial objects in a scene. Thus, using selective attention technique to develop the CNNs model, helps to maximize the extraction of relevant features from MRI images. We have also addressed two more issues: class-imbalance, and the spatial relationship among image Patches. To address the first issue, we propose two steps: an equal sampling of images Patches and an experimental analysis of the effect of weighted cross-entropy loss function on the segmentation results. In addition, to overcome the second issue, we have studied the effect of Overlapping Patches against Adjacent Patches where the Overlapping Patches show better segmentation results due to the introduction of the global context as well as the local features of the image Patches compared to the conventionnel Adjacent Patches. Our experiment results are reported on BRATS-2018 dataset where our End-to-End Deep Learning model achieved state-of-the-art performance. The median Dice score of our fully automatic segmentation model is 0.90, 0.83, 0.83 for the whole tumor, tumor core, and enhancing tumor respectively compared to the Dice score of radiologist, that is in the range 74% - 85%. Moreover, our proposed CNNs model is not only computationally efficient at inference time, but it could segment the whole brain on average 12 seconds. Finally, the proposed Deep Learning model provides an accurate and reliable segmentation result, and that makes it suitable for adopting in research and as a part of different clinical settings.

Supervised Brain Tumor Segmentation Based on Gradient and Context-Sensitive Features

Gliomas have the highest mortality rate and prevalence among the primary brain tumors. In this study, we proposed a supervised brain tumor segmentation method which detects diverse tumoral structures of both high grade gliomas and low grade gliomas in magnetic resonance imaging (MRI) images based on two types of features, the gradient features and the context-sensitive features. Two-dimensional gradient and three-dimensional gradient information was fully utilized to capture the gradient change. Furthermore, we proposed a circular context-sensitive feature which captures context information effectively. These features, totally 62, were compressed and optimized based on an mRMR algorithm, and random forest was used to classify voxels based on the compact feature set. To overcome the class-imbalanced problem of MRI data, our model was trained on a class-balanced region of interest dataset. We evaluated the proposed method based on the 2015 Brain Tumor Segmentation Challenge database, and the experimental results show a competitive performance.

Towards Reinforced Brain Tumor Segmentation on MRI Images Based on Temperature Changes on Pathologic Area

Brain tumor segmentation is the process of separating the tumor from normal brain tissues; in clinical routine, it provides useful information for diagnosis and treatment planning. However, it is still a challenging task due to the irregular form and confusing boundaries of tumors. Tumor cells thermally represent a heat source; their temperature is high compared to normal brain cells. The main aim of the present paper is to demonstrate that thermal information of brain tumors can be used to reduce false positive and false negative results of segmentation performed in MRI images. Pennes bioheat equation was solved numerically using the finite difference method to simulate the temperature distribution in the brain; Gaussian noises of ±2% were added to the simulated temperatures. Canny edge detector was used to detect tumor contours from the calculated thermal map, as the calculated temperature showed a large gradient in tumor contours. The proposed method is compared to Chan–Vese based level set segmentation method applied to T1 contrast-enhanced and Flair MRI images of brains containing tumors with ground truth. The method is tested in four different phantom patients by considering different tumor volumes and locations and 50 synthetic patients taken from BRATS 2012 and BRATS 2013. The obtained results in all patients showed significant improvement using the proposed method compared to segmentation by level set method with an average of 0.8% of the tumor area and 2.48% of healthy tissue was differentiated using thermal images only. We conclude that tumor contours delineation based on tumor temperature changes can be exploited to reinforce and enhance segmentation algorithms in MRI diagnostic.

Fully Automatic Brain Tumor Segmentation using End-To-End Incremental Deep Neural Networks in MRI images

BACKGROUND AND OBJECTIVE

Nowadays, getting an efficient Brain Tumor Segmentation in Multi-Sequence MR images as soon as possible, gives an early clinical diagnosis, treatment and follow-up. The aim of this study is to develop a new deep learning model for the segmentation of brain tumors. The proposed models are used to segment the brain tumors of Glioblastomas (with both high and low grade). Glioblastomas have four properties: different sizes, shapes, contrasts, in addition, Glioblastomas appear anywhere in the brain.

METHODS

In this paper, we propose three end-to-end Incremental Deep Convolutional Neural Networks models for fully automatic Brain Tumor Segmentation. Our proposed models are different from the other CNNs-based models that follow the technique of trial and error process which does not use any guided approach to get the suitable hyper-parameters. Moreover, we adopt the technique of Ensemble Learning to design a more efficient model. For solving the problem of training CNNs model, we propose a new training strategy which takes into account the most influencing hyper-parameters by bounding and setting a roof to these hyper-parameters to accelerate the training.

RESULTS

Our experiment results reported on BRATS-2017 dataset. The proposed deep learning models achieve the state-of-the-art performance without any post-processing operations. Indeed, our models achieve in average 0.88 Dice score over the complete region. Moreover, the efficient design with the advantage of GPU implementation, allows our three deep learning models to achieve brain segmentation results in average 20.87 s.

CONCLUSIONS

The proposed deep learning models are effective for the segmentation of brain tumors and allow to obtain high accurate results. Moreover, the proposed models could help the physician experts to reduce the time of diagnostic.

Progressive disease in glioblastoma: Benefits and limitations of semi-automated volumetry

Purpose

Unambiguous evaluation of glioblastoma (GB) progression is crucial, both for clinical trials as well as day by day routine management of GB patients. 3D-volumetry in the follow-up of GB provides quantitative data on tumor extent and growth, and therefore has the potential to facilitate objective disease assessment. The present study investigated the utility of absolute changes in volume (delta) or regional, segmentation-based subtractions for detecting disease progression in longitudinal MRI follow-ups.

Methods

165 high resolution 3-Tesla MRIs of 30 GB patients (23m, mean age 60.2y) were retrospectively included in this single center study. Contrast enhancement (CV) and tumor-related signal alterations in FLAIR images (FV) were semi-automatically segmented. Delta volume (dCV, dFV) and regional subtractions (sCV, sFV) were calculated. Disease progression was classified for every follow-up according to histopathologic results, decisions of the local multidisciplinary CNS tumor board and a consensus rating of the neuro-radiologic report.

Results

A generalized logistic mixed model for disease progression (yes / no) with dCV, dFV, sCV and sFV as input variables revealed that only dCV was significantly associated with prediction of disease progression (P = .005). Delta volume had a better accuracy than regional, segmentation-based subtractions (79% versus 72%) and a higher area under the curve by trend in ROC curves (.83 versus .75).

Conclusion

Absolute volume changes of the contrast enhancing tumor part were the most accurate volumetric determinant to detect progressive disease in assessment of GB and outweighed FLAIR changes as well as regional, segmentation-based image subtractions. This parameter might be useful in upcoming objective response criteria for glioblastoma.

Assessing the Effects of Software Platforms on Volumetric Segmentation of Glioblastoma

BACKGROUND

Radiological assessments of biologically relevant regions in glioblastoma have been associated with genotypic characteristics, implying a potential role in personalized medicine. Here, we assess the reproducibility and association with survival of two volumetric segmentation platforms and explore how methodology could impact subsequent interpretation and analysis.

METHODS

Post-contrast T1- and T2-weighted FLAIR MR images of 67 TCGA patients were segmented into five distinct compartments (necrosis, contrast-enhancement, FLAIR, post contrast abnormal, and total abnormal tumor volumes) by two quantitative image segmentation platforms - 3D Slicer and a method based on Velocity AI and FSL. We investigated the internal consistency of each platform by correlation statistics, association with survival, and concordance with consensus neuroradiologist ratings using ordinal logistic regression.

RESULTS

We found high correlations between the two platforms for FLAIR, post contrast abnormal, and total abnormal tumor volumes (spearman's r(67) = 0.952, 0.959, and 0.969 respectively). Only modest agreement was observed for necrosis and contrast-enhancement volumes (r(67) = 0.693 and 0.773 respectively), likely arising from differences in manual and automated segmentation methods of these regions by 3D Slicer and Velocity AI/FSL, respectively. Survival analysis based on AUC revealed significant predictive power of both platforms for the following volumes: contrast-enhancement, post contrast abnormal, and total abnormal tumor volumes. Finally, ordinal logistic regression demonstrated correspondence to manual ratings for several features.

CONCLUSION

Tumor volume measurements from both volumetric platforms produced highly concordant and reproducible estimates across platforms for general features. As automated or semi-automated volumetric measurements replace manual linear or area measurements, it will become increasingly important to keep in mind that measurement differences between segmentation platforms for more detailed features could influence downstream survival or radio genomic analyses.

Rough-fuzzy clustering and unsupervised feature selection for wavelet based MR image segmentation

Image segmentation is an indispensable process in the visualization of human tissues, particularly during clinical analysis of brain magnetic resonance (MR) images. For many human experts, manual segmentation is a difficult and time consuming task, which makes an automated brain MR image segmentation method desirable. In this regard, this paper presents a new segmentation method for brain MR images, integrating judiciously the merits of rough-fuzzy computing and multiresolution image analysis technique. The proposed method assumes that the major brain tissues, namely, gray matter, white matter, and cerebrospinal fluid from the MR images are considered to have different textural properties. The dyadic wavelet analysis is used to extract the scale-space feature vector for each pixel, while the rough-fuzzy clustering is used to address the uncertainty problem of brain MR image segmentation. An unsupervised feature selection method is introduced, based on maximum relevance-maximum significance criterion, to select relevant and significant textural features for segmentation problem, while the mathematical morphology based skull stripping preprocessing step is proposed to remove the non-cerebral tissues like skull. The performance of the proposed method, along with a comparison with related approaches, is demonstrated on a set of synthetic and real brain MR images using standard validity indices.

Semi-automatic segmentation for 3D motion analysis of the tongue with dynamic MRI

Dynamic MRI has been widely used to track the motion of the tongue and measure its internal deformation during speech and swallowing. Accurate segmentation of the tongue is a prerequisite step to define the target boundary and constrain the tracking to tissue points within the tongue. Segmentation of 2D slices or 3D volumes is challenging because of the large number of slices and time frames involved in the segmentation, as well as the incorporation of numerous local deformations that occur throughout the tongue during motion. In this paper, we propose a semi-automatic approach to segment 3D dynamic MRI of the tongue. The algorithm steps include seeding a few slices at one time frame, propagating seeds to the same slices at different time frames using deformable registration, and random walker segmentation based on these seed positions. This method was validated on the tongue of five normal subjects carrying out the same speech task with multi-slice 2D dynamic cine-MR images obtained at three orthogonal orientations and 26 time frames. The resulting semi-automatic segmentations of a total of 130 volumes showed an average dice similarity coefficient (DSC) score of 0.92 with less segmented volume variability between time frames than in manual segmentations.

A hybrid approach of using symmetry technique for brain tumor segmentation

Tumor and related abnormalities are a major cause of disability and death worldwide. Magnetic resonance imaging (MRI) is a superior modality due to its noninvasiveness and high quality images of both the soft tissues and bones. In this paper we present two hybrid segmentation techniques and their results are compared with well-recognized techniques in this area. The first technique is based on symmetry and we call it a hybrid algorithm using symmetry and active contour (HASA). In HASA, we take refection image, calculate the difference image, and then apply the active contour on the difference image to segment the tumor. To avoid unimportant segmented regions, we improve the results by proposing an enhancement in the form of the second technique, EHASA. In EHASA, we also take reflection of the original image, calculate the difference image, and then change this image into a binary image. This binary image is mapped onto the original image followed by the application of active contouring to segment the tumor region.

GBM volumetry using the 3D Slicer medical image computing platform

Volumetric change in glioblastoma multiforme (GBM) over time is a critical factor in treatment decisions. Typically, the tumor volume is computed on a slice-by-slice basis using MRI scans obtained at regular intervals. (3D)Slicer – a free platform for biomedical research – provides an alternative to this manual slice-by-slice segmentation process, which is significantly faster and requires less user interaction. In this study, 4 physicians segmented GBMs in 10 patients, once using the competitive region-growing based GrowCut segmentation module of Slicer, and once purely by drawing boundaries completely manually on a slice-by-slice basis. Furthermore, we provide a variability analysis for three physicians for 12 GBMs. The time required for GrowCut segmentation was on an average 61% of the time required for a pure manual segmentation. A comparison of Slicer-based segmentation with manual slice-by-slice segmentation resulted in a Dice Similarity Coefficient of 88.43 ± 5.23% and a Hausdorff Distance of 2.32 ± 5.23 mm.

State of the art survey on MRI brain tumor segmentation

Brain tumor segmentation consists of separating the different tumor tissues (solid or active tumor, edema, and necrosis) from normal brain tissues: gray matter (GM), white matter (WM), and cerebrospinal fluid (CSF). In brain tumor studies, the existence of abnormal tissues may be easily detectable most of the time. However, accurate and reproducible segmentation and characterization of abnormalities are not straightforward. In the past, many researchers in the field of medical imaging and soft computing have made significant survey in the field of brain tumor segmentation. Both semiautomatic and fully automatic methods have been proposed. Clinical acceptance of segmentation techniques has depended on the simplicity of the segmentation, and the degree of user supervision. Interactive or semiautomatic methods are likely to remain dominant in practice for some time, especially in these applications where erroneous interpretations are unacceptable. This article presents an overview of the most relevant brain tumor segmentation methods, conducted after the acquisition of the image. Given the advantages of magnetic resonance imaging over other diagnostic imaging, this survey is focused on MRI brain tumor segmentation. Semiautomatic and fully automatic techniques are emphasized.

MRI pre-treatment tumour volume in maxillary complex squamous cell carcinoma treated with surgical resection

Tumour volume (Tv) measurements obtained from pre-treatment CT and MRI have increasingly shown to be more reliable predictors of outcome than TNM stage. The aim of this study was to determine the correlation of MRI calculated maxillary complex tumour volume with patient outcome.

METHODS

The medical records of 39 patients with squamous cell carcinoma involving the maxillary sinus, maxilla, hard palate and maxillary alveolus were reviewed and tumour volume measurements completed on pre-treatment MRI.

RESULTS

The mean tumour volume was 12.79 ± 24.31 cm(3). Independent samples t test was significant for increasing overall all-cause survival and decreasing tumour volume (1 year: p = 0.003; 5-year: p = 0.031). Cox regression was significant for stratified tumour volume, nodal involvement and peri-neural invasion for predicting disease-free survival.

CONCLUSIONS

MRI measured tumour volume assessment appears to be a reliable predictor of survival in patients with maxillary complex SCC treated by surgical resection.

Segmentation of pituitary adenoma: a graph-based method vs. a balloon inflation method

Among all abnormal growths inside the skull, the percentage of tumors in sellar region is approximately 10-15%, and the pituitary adenoma is the most common sellar lesion. A time-consuming process that can be shortened by using adequate algorithms is the manual segmentation of pituitary adenomas. In this contribution, two methods for pituitary adenoma segmentation in the human brain are presented and compared using magnetic resonance imaging (MRI) patient data from the clinical routine: Method A is a graph-based method that sets up a directed and weighted graph and performs a min-cut for optimal segmentation results: Method B is a balloon inflation method that uses balloon inflation forces to detect the pituitary adenoma boundaries. The ground truth of the pituitary adenoma boundaries - for the evaluation of the methods - are manually extracted by neurosurgeons. Comparison is done using the Dice Similarity Coefficient (DSC), a measure for spatial overlap of different segmentation results. The average DSC for all data sets is 77.5±4.5% for the graph-based method and 75.9±7.2% for the balloon inflation method showing no significant difference. The overall segmentation time of the implemented approaches was less than 4s - compared with a manual segmentation that took, on the average, 3.9±0.5min.

Segmentation of malignant gliomas through remote collaboration and statistical fusion

PURPOSE

Malignant gliomas represent an aggressive class of central nervous system neoplasms. Correlation of interventional outcomes with tumor morphometry data necessitates 3D segmentation of tumors (typically based on magnetic resonance imaging). Expert delineation is the long-held gold standard for tumor segmentation, but is exceptionally resource intensive and subject to intrarater and inter-rater variability. Automated tumor segmentation algorithms have been demonstrated for a variety of imaging modalities and tumor phenotypes, but translation of these methods across clinical study designs is problematic given variation in image acquisition, tumor characteristics, segmentation objectives, and validation criteria. Herein, the authors demonstrate an alternative approach for high-throughput tumor segmentation using Internet-based, collaborative labeling.

METHODS

In a study of 85 human raters and 98 tumor patients, raters were recruited from a general university campus population (i.e., no specific medical knowledge), given minimal training, and provided web-based tools to label MRI images based on 2D cross sections. The labeling goal was characterized as to extract the enhanced tumor cores on T1-weighted MRI and the bright abnormality on T2-weighted MRI. An experienced rater manually constructed the ground truth volumes of a randomly sampled subcohort of 48 tumor subjects (for both T1w and T2w). Raters' taskwise individual observations, as well as the volume wise truth estimates via statistical fusion method, were evaluated over the subjects having the ground truth.

RESULTS

Individual raters were able to reliably characterize (with >0.8 dice similarity coefficient, DSC) the gadolinium-enhancing cores and extent of the edematous areas only slightly more than half of the time. Yet, human raters were efficient in terms of providing these highly variable segmentations (less than 20 s per slice). When statistical fusion was used to combine the results of seven raters per slice for all slices in the datasets, the 3D agreement of the fused results with expertly delineated segmentations was on par with the inter-rater reliability observed between experienced raters using traditional 3D tools (approximately 0.85 DSC). The cumulative time spent per tumor patient with the collaborative approach was equivalent to that with an experienced rater, but the collaborative approach could be achieved with less training time, fewer resources, and efficient parallelization.

CONCLUSIONS

Hence, collaborative labeling is a promising technique with potentially wide applicability to cost-effective manual labeling of medical images.

Template-cut: a pattern-based segmentation paradigm

We present a scale-invariant, template-based segmentation paradigm that sets up a graph and performs a graph cut to separate an object from the background. Typically graph-based schemes distribute the nodes of the graph uniformly and equidistantly on the image, and use a regularizer to bias the cut towards a particular shape. The strategy of uniform and equidistant nodes does not allow the cut to prefer more complex structures, especially when areas of the object are indistinguishable from the background. We propose a solution by introducing the concept of a "template shape" of the target object in which the nodes are sampled non-uniformly and non-equidistantly on the image. We evaluate it on 2D-images where the object's textures and backgrounds are similar, and large areas of the object have the same gray level appearance as the background. We also evaluate it in 3D on 60 brain tumor datasets for neurosurgical planning purposes.

Development of image-processing software for automatic segmentation of brain tumors in MR images

Most of the commercially available software for brain tumor segmentation have limited functionality and frequently lack the careful validation that is required for clinical studies. We have developed an image-analysis software package called ‘Prometheus,’ which performs neural system–based segmentation operations on MR images using pre-trained information. The software also has the capability to improve its segmentation performance by using the training module of the neural system. The aim of this article is to present the design and modules of this software. The segmentation module of Prometheus can be used primarily for image analysis in MR images. Prometheus was validated against manual segmentation by a radiologist and its mean sensitivity and specificity was found to be 85.71±4.89% and 93.2±2.87%, respectively. Similarly, the mean segmentation accuracy and mean correspondence ratio was found to be 92.35±3.37% and 0.78±0.046, respectively.

A medical software system for volumetric analysis of cerebral pathologies in magnetic resonance imaging (MRI) data

In this contribution, a medical software system for volumetric analysis of different cerebral pathologies in magnetic resonance imaging (MRI) data is presented. The software system is based on a semi-automatic segmentation algorithm and helps to overcome the time-consuming process of volume determination during monitoring of a patient. After imaging, the parameter settings-including a seed point-are set up in the system and an automatic segmentation is performed by a novel graph-based approach. Manually reviewing the result leads to reseeding, adding seed points or an automatic surface mesh generation. The mesh is saved for monitoring the patient and for comparisons with follow-up scans. Based on the mesh, the system performs a voxelization and volume calculation, which leads to diagnosis and therefore further treatment decisions. The overall system has been tested with different cerebral pathologies-glioblastoma multiforme, pituitary adenomas and cerebral aneurysms- and evaluated against manual expert segmentations using the Dice Similarity Coefficient (DSC). Additionally, intra-physician segmentations have been performed to provide a quality measure for the presented system.

The brain MR Image segmentation techniques and use of diagnostic packages

RATIONALE AND OBJECTIVES

This article provides a survey of segmentation methods for medical images. Usually, classification of segmentation methods is done based on the approaches adopted and the domain of application.

MATERIALS AND METHODS

This survey is conducted on the recent segmentation methods used in biomedical image processing and explores the methods useful for better segmentation. A critical appraisal of the current status of semiautomated and automated methods is made for the segmentation of anatomical medical images emphasizing the advantages and disadvantages. Computer-aided diagnosis (CAD) used by radiologists as a second opinion has become one of the major research areas in medical imaging and diagnostic radiology. A picture archiving communication system (PACS) is an integrated workflow system for managing images and related data that is designed to streamline operations throughout the whole patient care delivery process.

RESULTS

By using PACS, the medical image interpretation may be changed from conventional hard-copy images to soft-copy studies viewed on the systems workstations.

CONCLUSION

The automatic segmentations assist the doctors in making quick diagnosis. The CAD need not be comparable to that of physicians, but is surely complementary.

Comparison of two-dimensional and three-dimensional iterative watershed segmentation methods in hepatic tumor volumetrics

In this work the authors compare the accuracy of two-dimensional (2D) and three-dimensional (3D) implementations of a computer-aided image segmentation method to that of physician observers (using manual outlining) for volume measurements of liver tumors visualized with diagnostic contrast-enhanced and PET/CT-based non-contrast-enhanced (PET-CT) CT scans. The method assessed is a hybridization of the watershed method using observer-set markers with a gradient vector flow approach. This method is known as the iterative watershed segmentation (IWS) method. Initial assessments are performed using software phantoms that model a range of tumor shapes, noise levels, and noise qualities. IWS is then applied to CT image sets of patients with identified hepatic tumors and compared to the physicians' manual outlines on the same tumors. The repeatability of the physicians' measurements is also assessed. IWS utilizes multiple levels of segmentation performed with the use of "fuzzy regions" that could be considered part of a selected tumor. In phantom studies, the outermost volume outline for level 1 (called level 1_1 consisting of inner region plus fuzzy region) was generally the most accurate. For in vivo studies, the level 1_1 and the second outermost outline for level 2 (called level 2_2 consisting of inner region plus two fuzzy regions) typically had the smallest percent error values when compared to physician observer volume estimates. Our data indicate that allowing the operator to choose the "best result" level iteration outline from all generated outlines would likely give the more accurate volume for a given tumor rather than automatically choosing a particular level iteration outline. The preliminary in vivo results indicate that 2D-IWS is likely to be more accurate than 3D-IWS in relation to the observer volume estimates.

Early clinical evaluation of a novel three-dimensional structure delineation software tool (SCULPTER) for radiotherapy treatment planning

Modern radiotherapy treatment planning (RTP) necessitates increased delineation of target volumes and organs at risk. Conventional manual delineation is a laborious, time-consuming and subjective process. It is prone to inconsistency and variability, but has the potential to be improved using automated segmentation algorithms. We carried out a pilot clinical evaluation of SCULPTER (Structure Creation Using Limited Point Topology Evidence in Radiotherapy) - a novel prototype software tool designed to improve structure delineation for RTP. Anonymized MR and CT image datasets from patients who underwent radiotherapy for bladder or prostate cancer were studied. An experienced radiation oncologist used manual and SCULPTER-assisted methods to create clinically acceptable organ delineations. SCULPTER was also tested by four other RTP professionals. Resulting contours were compared by qualitative inspection and quantitatively by using the volumes of the structures delineated and the time taken for completion. The SCULPTER tool was easy to apply to both MR and CT images and diverse anatomical sites. SCULPTER delineations closely reproduced manual contours with no significant volume differences detected, but SCULPTER delineations were significantly quicker (p<0.05) in most cases. In conclusion, clinical application of SCULPTER resulted in rapid and simple organ delineations with equivalent accuracy to manual methods, demonstrating proof-of-principle of the SCULPTER system and supporting its potential utility in RTP.

A modified probabilistic neural network for partial volume segmentation in brain MR image

A modified probabilistic neural network (PNN) for brain tissue segmentation with magnetic resonance imaging (MRI) is proposed. In this approach, covariance matrices are used to replace the singular smoothing factor in the PNN's kernel function, and weighting factors are added in the pattern of summation layer. This weighted probabilistic neural network (WPNN) classifier can account for partial volume effects, which exist commonly in MRI, not only in the final result stage, but also in the modeling process. It adopts the self-organizing map (SOM) neural network to overly segment the input MR image, and yield reference vectors necessary for probabilistic density function (pdf) estimation. A supervised "soft" labeling mechanism based on Bayesian rule is developed, so that weighting factors can be generated along with corresponding SOM reference vectors. Tissue classification results from various algorithms are compared, and the effectiveness and robustness of the proposed approach are demonstrated.

Target Definition in Prostate, Head, and Neck

Target definition is a major source of errors in both prostate and head and neck external-beam radiation treatment. Delineation errors remain constant during the course of radiation and therefore have a large impact on the dose to the tumor. Major sources of delineation variation are visibility of the target including its extensions, disagreement on the target extension, and interpretation or lack of delineation protocols. The visibility of the target can be greatly improved with the use of multimodality imaging. Both in the head and neck and the prostate, computed tomography (CT)-magnetic resonance imaging coregistration decreases the target volume and its variability. CT-positron emission tomography delineation is promising for delineation in head and neck cancer. Despite the better visibility, a different interpretation of the target extension remains a major source of error. The use of coregistration of CT with a second modality, together with improved guidelines for delineation and an online anatomical atlas, increases agreement between observers in prostate, lung, and nasopharynx tumors. Delineation errors should not be treated differently from other geometrical errors. Similar margin recipes for the correction of setup errors and organ motion should be adapted to incorporate the effect of delineation errors. A calculation of a 3-dimensional clinical target volume-planning target volume margin incorporating delineation errors for the head and neck is around 6.1 to 9.7 mm. Given the good local control of IMRT with smaller margins and smaller pathological specimens, it is likely that the delineated CTV frequently overestimates the actual volume.