Image content extraction: application to MR images of the brain

Gross feature recognition of Anatomical Images based on Atlas grid (GAIA): Incorporating the local discrepancy between an atlas and a target image to capture the features of anatomic brain MRI

We aimed to develop a new method to convert T1-weighted brain MRIs to feature vectors, which could be used for content-based image retrieval (CBIR). To overcome the wide range of anatomical variability in clinical cases and the inconsistency of imaging protocols, we introduced the Gross feature recognition of Anatomical Images based on Atlas grid (GAIA), in which the local intensity alteration, caused by pathological (e.g., ischemia) or physiological (development and aging) intensity changes, as well as by atlas–image misregistration, is used to capture the anatomical features of target images.

As a proof-of-concept, the GAIA was applied for pattern recognition of the neuroanatomical features of multiple stages of Alzheimer's disease, Huntington's disease, spinocerebellar ataxia type 6, and four subtypes of primary progressive aphasia. For each of these diseases, feature vectors based on a training dataset were applied to a test dataset to evaluate the accuracy of pattern recognition. The feature vectors extracted from the training dataset agreed well with the known pathological hallmarks of the selected neurodegenerative diseases. Overall, discriminant scores of the test images accurately categorized these test images to the correct disease categories. Images without typical disease-related anatomical features were misclassified. The proposed method is a promising method for image feature extraction based on disease-related anatomical features, which should enable users to submit a patient image and search past clinical cases with similar anatomical phenotypes.

•

A novel method to convert anatomical brain MRIs to feature vectors is introduced.

•

Degree of local atlas–image disagreement is used to capture the anatomical features.

•

The method was applied for pattern recognition of various neurodegenerative diseases.

•

The feature vectors agreed well with the known pathological hallmarks of diseases.

•

The method accurately categorized test images to the correct disease categories.

Atlas-based neuroinformatics via MRI: harnessing information from past clinical cases and quantitative image analysis for patient care

With the ever-increasing amount of anatomical information radiologists have to evaluate for routine diagnoses, computational support that facilitates more efficient education and clinical decision making is highly desired. Despite the rapid progress of image analysis technologies for magnetic resonance imaging of the human brain, these methods have not been widely adopted for clinical diagnoses. To bring computational support into the clinical arena, we need to understand the decision-making process employed by well-trained clinicians and develop tools to simulate that process. In this review, we discuss the potential of atlas-based clinical neuroinformatics, which consists of annotated databases of anatomical measurements grouped according to their morphometric phenotypes and coupled with the clinical informatics upon which their diagnostic groupings are based. As these are indexed via parametric representations, we can use image retrieval tools to search for phenotypes along with their clinical metadata. The review covers the current technology, preliminary data, and future directions of this field.

A review of medical imaging informatics

This review of medical imaging informatics is a survey of current developments in an exciting field. The focus is on informatics issues rather than traditional data processing and information systems, such as picture archiving and communications systems (PACS) and image processing and analysis systems. In this review, we address imaging informatics issues within the requirements of an informatics system defined by the American Medical Informatics Association. With these requirements as a framework, we review, in four sections: (1) Methods to present imaging and associated data without causing an overload, including image study summarization, content-based medical image retrieval, and natural language processing of text data. (2) Data modeling techniques to represent clinical data with focus on an image data model, including general-purpose time-based multimedia data models, health-care-specific data models, knowledge models, and problem-centric data models. (3) Methods to integrate medical data information from heterogeneous clinical data sources. Advances in centralized databases and mediated architectures are reviewed along with a discussion on our efforts at data integration based on peer-to-peer networking and shared file systems. (4) Visualization schemas to present imaging and clinical data: the large volume of medical data presents a daunting challenge for an efficient visualization paradigm. In this section we review current multimedia visualization methods including temporal modeling, problem-specific data organization, including our problem-centric, context and user-specific visualization interface.