Tumor feature visualization with unsupervised learning

Identification of sarcomatoid differentiation in renal cell carcinoma by machine learning on multiparametric MRI

Sarcomatoid differentiation in RCC (sRCC) is associated with a poor prognosis, necessitating more aggressive management than RCC without sarcomatoid components (nsRCC). Since suspected renal cell carcinoma (RCC) tumors are not routinely biopsied for histologic evaluation, there is a clinical need for a non-invasive method to detect sarcomatoid differentiation pre-operatively. We utilized unsupervised self-organizing map (SOM) and supervised Learning Vector Quantizer (LVQ) machine learning to classify RCC tumors on T2-weighted, non-contrast T1-weighted fat-saturated, contrast-enhanced arterial-phase T1-weighted fat-saturated, and contrast-enhanced venous-phase T1-weighted fat-saturated MRI images. The SOM was trained on 8 nsRCC and 8 sRCC tumors, and used to compute Activation Maps for each training, validation (3 nsRCC and 3 sRCC), and test (5 nsRCC and 5 sRCC) tumor. The LVQ classifier was trained and optimized on Activation Maps from the 22 training and validation cohort tumors, and tested on Activation Maps of the 10 unseen test tumors. In this preliminary study, the SOM-LVQ model achieved a hold-out testing accuracy of 70% in the task of identifying sarcomatoid differentiation in RCC on standard multiparameter MRI (mpMRI) images. We have demonstrated a combined SOM-LVQ machine learning approach that is suitable for analysis of limited mpMRI datasets for the task of differential diagnosis.

Computer-aided interpretation approach for optical tomographic images

A computer-aided interpretation approach is proposed to detect rheumatic arthritis (RA) in human finger joints using optical tomographic images. The image interpretation method employs a classification algorithm that makes use of a so-called self-organizing mapping scheme to classify fingers as either affected or unaffected by RA. Unlike in previous studies, this allows for combining multiple image features, such as minimum and maximum values of the absorption coefficient for identifying affected and not affected joints. Classification performances obtained by the proposed method were evaluated in terms of sensitivity, specificity, Youden index, and mutual information. Different methods (i.e., clinical diagnostics, ultrasound imaging, magnet resonance imaging, and inspection of optical tomographic images), were used to produce ground truth benchmarks to determine the performance of image interpretations. Using data from 100 finger joints, findings suggest that some parameter combinations lead to higher sensitivities, while others to higher specificities when compared to single parameter classifications employed in previous studies. Maximum performances are reached when combining the minimum/maximum ratio of the absorption coefficient and image variance. In this case, sensitivities and specificities over 0.9 can be achieved. These values are much higher than values obtained when only single parameter classifications were used, where sensitivities and specificities remained well below 0.8.

Estimating kinetic parameter maps from dynamic contrast-enhanced MRI using spatial prior knowledge

Dynamic contrast-enhanced magnetic resonance (DCE-MR) imaging can be used to study microvascular structure in vivo by monitoring the abundance of an injected diffusible contrast agent over time. The resulting spatially resolved intensity-time curves are usually interpreted in terms of kinetic parameters obtained by fitting a pharmacokinetic model to the observed data. Least squares estimates of the highly nonlinear model parameters, however, can exhibit high variance and can be severely biased. As a remedy, we bring to bear spatial prior knowledge by means of a generalized Gaussian Markov random field (GGMRF). By using information from neighboring voxels and computing the maximum a posteriori solution for entire parameter maps at once, both bias and variance of the parameter estimates can be reduced thus leading to smaller root mean square error (RMSE). Since the number of variables gets very big for common image resolutions, sparse solvers have to be employed. To this end, we propose a generalized iterated conditional modes (ICM) algorithm operating on blocks instead of sites which is shown to converge considerably faster than the conventional ICM algorithm. Results on simulated DCE-MR images show a clear reduction of RMSE and variance as well as, in some cases, reduced estimation bias. The mean residual bias (MRB) is reduced on the simulated data as well as for all 37 patients of a prostate DCE-MRI dataset. Using the proposed algorithm, average computation times only increase by a factor of 1.18 (871 ms per voxel) for a Gaussian prior and 1.51 (1.12 s per voxel) for an edge-preserving prior compared to the single voxel approach (740 ms per voxel).

Survey of the visual exploration and analysis of perfusion data

Dynamic contrast-enhanced image data (perfusion data) are used to characterize regional tissue perfusion. Perfusion data consist of a sequence of images, acquired after a contrast agent bolus is applied. Perfusion data are used for diagnostic purposes in oncology, ischemic stroke assessment or myocardial ischemia. The diagnostic evaluation of perfusion data is challenging, since the data is complex and exhibits various artifacts, e.g., motion artifacts. We provide an overview on existing methods to analyze, and visualize CT and MR perfusion data. The integrated visualization of several 2D parameter maps, the 3D visualization of parameter volumes and exploration techniques are discussed. An essential aspect in the diagnosis of perfusion data is the correlation between perfusion data and derived time-intensity curves as well as with other image data, in particular with high resolution morphologic image data. We discuss visualization support with respect to the three major application areas: ischemic stroke diagnosis, breast tumor diagnosis and the diagnosis of coronary heart disease.

MR factor analysis: improved technology for the assessment of 2D dynamic structures of benign and malignant salivary gland tumors

PURPOSE

To establish an MR factor analysis technique for two-dimensional (2D) MR dynamic structures of benign and malignant salivary gland tumors.

MATERIALS AND METHODS

Dynamic contrast-enhanced MRI using a surface coil was performed on 36 patients with benign (N = 24) or malignant (N = 12) salivary gland tumors. Signal intensity kinetics in each pixel of the tumors after contrast medium injections were semiautomatically categorized into four patterns (slow uptake, rapid uptake with high washout, rapid uptake with low washout, and flat). The 2D distributions of the kinetic patterns in the tumors were compared with the histological features of the corresponding parts of the excised tumors and with overall kinetics obtained by a conventional analysis.

RESULTS

The MR factor analysis technique allowed the pixel-to-pixel evaluation of the contrast enhancement kinetics of the salivary gland tumors. The 2D distributions of the time-intensity curve (TIC) patterns correlated well with the histological features of the salivary gland tumors and allowed more detailed dynamic structures of the tumors compared with the results obtained by the conventional dynamic study analysis.

CONCLUSION

The proposed MR factor analysis would be clinically feasible to diagnose salivary gland tumors and tumor-like lesions.

Multiparameter classifications of optical tomographic images

This research study explores the combined use of more than one parameter derived from optical tomographic images to increase diagnostic accuracy which is measured in terms of sensitivity and specificity. Parameters considered include, for example, smallest or largest absorption or scattering coefficients or the ratios thereof in an image region of interest. These parameters have been used individually in a previous study to determine if a finger joint is affected or not affected by rheumatoid arthritis. To combine these parameters in the analysis we employ here a vector quantization based classification method called Self-Organizing Mapping (SOM). This method allows producing multivariate ROC-curves from which sensitivity and specificities can be determined. We found that some parameter combinations can lead to higher sensitivities whereas others to higher specificities when compared to singleparameter classifications employed in previous studies. The best diagnostic accuracy, in terms of highest Youden index, was achieved by combining three absorption parameters [maximum(micro a), minimum(micro a), and the ratio of minimum(micro a) and maximum(micro a)], which result in a sensitivity of 0.78, a specificity of 0.76, a Youden index of 0.54, and an area under the curve (AUC) of 0.72. These values are higher than for previously reported single parameter classifications with a best sensitivity and specificity of 0.71, a Youden index of 0.41, and an AUC of 0.66.

Classification of dynamic contrast-enhanced magnetic resonance breast lesions by support vector machines

Early detection of breast cancer is one of the most important factors in determining prognosis for women with malignant tumors. Dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) has been shown to be the most sensitive modality for screening high-risk women. Computer-aided diagnosis (CAD) systems have the potential to assist radiologists in the early detection of cancer. A key component of the development of such a CAD system will be the selection of an appropriate classification function responsible for separating malignant and benign lesions. The purpose of this study is to evaluate the effects of variations in temporal feature vectors and kernel functions on the separation of malignant and benign DCE-MRI breast lesions by support vector machines (SVMs). We also propose and demonstrate a classifier visualization and evaluation technique. We show that SVMs provide an effective and flexible framework from which to base CAD techniques for breast MRI, and that the proposed classifier visualization technique has potential as a mechanism for the evaluation of classification solutions.

1H NMR metabonomics of plasma lipoprotein subclasses: elucidation of metabolic clustering by self-organising maps

(1)H NMR spectra of plasma are known to provide specific information on lipoprotein subclasses in the form of complex overlapping resonances. A combination of (1)H NMR and self-organising map (SOM) analysis was applied to investigate if automated characterisation of subclass-related metabolic interactions can be achieved. To reliably assess the intrinsic capability of (1)H NMR for resolving lipoprotein subclass profiles, sum spectra representing the pure lipoprotein subclass part of actual plasma were simulated with the aid of experimentally derived model signals for 11 distinct lipoprotein subclasses. Two biochemically characteristic categories of spectra, representing normolipidaemic and metabolic syndrome status, were generated with corresponding lipoprotein subclass profiles. A set of spectra representing a metabolic pathway between the two categories was also generated. The SOM analysis, based solely on the aliphatic resonances of these simulated spectra, clearly revealed the lipoprotein subclass profiles and their changes. Comparable SOM analysis in a group of 69 experimental (1)H NMR spectra of serum samples, which according to biochemical analyses represented a wide range of lipoprotein lipid concentrations, corroborated the findings based on the simulated data. Interestingly, the choline-N(CH(3))(3) region seems to provide more resolved clustering of lipoprotein subclasses in the SOM analyses than the methyl-CH(3) region commonly used for subclass quantification. The results illustrate the inherent suitability of (1)H NMR metabonomics for automated studies of lipoprotein subclass-related metabolism and demonstrate the power of SOM analysis in an extensive and representative case of (1)H NMR metabonomics.

Interactive visual analysis of perfusion data

Perfusion data are dynamic medical image data which characterize the regional blood flow in human tissue. These data bear a great potential in medical diagnosis, since diseases can be better distinguished and detected at an earlier stage compared to static image data. The wide-spread use of perfusion data is hampered by the lack of efficient evaluation methods. For each voxel, a time-intensity curve characterizes the enhancement of a contrast agent. Parameters derived from these curves characterize the perfusion and have to be integrated for diagnosis. The diagnostic evaluation of this multi-field data is challenging and time-consuming due to its complexity. For the visual analysis of such datasets, feature-based approaches allow to reduce the amount of data and direct the user to suspicious areas. We present an interactive visual analysis approach for the evaluation of perfusion data. For this purpose, we integrate statistical methods and interactive feature specification. Correlation analysis and Principal Component Analysis (PCA) are applied for dimensionreduction and to achieve a better understanding of the inter-parameter relations. Multiple, linked views facilitate the definition of features by brushing multiple dimensions. The specification result is linked to all views establishing a focus+context style of visualization in 3D. We discuss our approach with respect to clinical datasets from the three major application areas: ischemic stroke diagnosis, breast tumor diagnosis, as well as the diagnosis of the coronary heart disease (CHD). It turns out that the significance of perfusion parameters strongly depends on the individual patient, scanning parameters, and data pre-processing.

Multiscale analysis of MR-mammography data

In this work we propose a method for automatically discriminating between different types of tissue in MR mammography datasets. This is accomplished by employing a wavelet-based multiscale analysis. After the data has been wavelet-transformed unsupervised machine learning methods are employed to identify typical patterns in the wavelet domain. To demonstrate the potential of the proposed approach we apply a filtering procedure that extracts the wavelet-based image information related to tumour tissue. In this way we obtain a robust segmentation of suspicious tissue in the MR image.

Segmentation and grading of brain tumors on apparent diffusion coefficient images using self-organizing maps

An accurate computer-assisted method to perform segmentation of brain tumor on apparent diffusion coefficient (ADC) images and evaluate its grade (malignancy state) has been designed using a mixture of unsupervised artificial neural networks (ANN) and hierarchical multiresolution wavelet. Firstly, the ADC images are decomposed by multiresolution wavelets, which are subsequently selectively reconstructed to form wavelet filtered images. These wavelet filtered images along with FLAIR and T2 weighted images have been utilized as the features to unsupervised neural network - self organizing maps (SOM) - to segment the tumor, edema, necrosis, CSF and normal tissue and grade the malignant state of the tumor. A novel segmentation algorithm based on the number of hits experienced by Best Matching Units (BMU) on SOM maps is proposed. The results shows that the SOM performs well in differentiating the tumor, edema, necrosis, CSF and normal tissue pattern vectors on ADC images. Using the trained SOM and proposed segmentation algorithm, we are able to identify high or low grade tumor, edema, necrosis, CSF and normal tissue. The results are validated against manually segmented images and sensitivity and the specificity are observed to be 0.86 and 0.93, respectively.