Effect of color visualization and display hardware on the visual assessment of pseudocolor medical images

Current state and guidance on arterial spin labeling perfusion MRI in clinical neuroimaging

This article focuses on clinical applications of arterial spin labeling (ASL) and is part of a wider effort from the International Society for Magnetic Resonance in Medicine (ISMRM) Perfusion Study Group to update and expand on the recommendations provided in the 2015 ASL consensus paper. Although the 2015 consensus paper provided general guidelines for clinical applications of ASL MRI, there was a lack of guidance on disease-specific parameters. Since that time, the clinical availability and clinical demand for ASL MRI has increased. This position paper provides guidance on using ASL in specific clinical scenarios, including acute ischemic stroke and steno-occlusive disease, arteriovenous malformations and fistulas, brain tumors, neurodegenerative disease, seizures/epilepsy, and pediatric neuroradiology applications, focusing on disease-specific considerations for sequence optimization and interpretation. We present several neuroradiological applications in which ASL provides unique information essential for making the diagnosis. This guidance is intended for anyone interested in using ASL in a routine clinical setting (i.e., on a single-subject basis rather than in cohort studies) building on the previous ASL consensus review.

Interoperable slide microscopy viewer and annotation tool for imaging data science and computational pathology

The exchange of large and complex slide microscopy imaging data in biomedical research and pathology practice is impeded by a lack of data standardization and interoperability, which is detrimental to the reproducibility of scientific findings and clinical integration of technological innovations. We introduce Slim, an open-source, web-based slide microscopy viewer that implements the internationally accepted Digital Imaging and Communications in Medicine (DICOM) standard to achieve interoperability with a multitude of existing medical imaging systems. We showcase the capabilities of Slim as the slide microscopy viewer of the NCI Imaging Data Commons and demonstrate how the viewer enables interactive visualization of traditional brightfield microscopy and highly-multiplexed immunofluorescence microscopy images from The Cancer Genome Atlas and Human Tissue Atlas Network, respectively, using standard DICOMweb services. We further show how Slim enables the collection of standardized image annotations for the development or validation of machine learning models and the visual interpretation of model inference results in the form of segmentation masks, spatial heat maps, or image-derived measurements.

T2 mapping in myocardial disease: a comprehensive review

Cardiovascular magnetic resonance (CMR) is considered the gold standard imaging modality for myocardial tissue characterization. Elevated transverse relaxation time (T2) is specific for increased myocardial water content, increased free water, and is used as an index of myocardial edema. The strengths of quantitative T2 mapping lie in the accurate characterization of myocardial edema, and the early detection of reversible myocardial disease without the use of contrast agents or ionizing radiation. Quantitative T2 mapping overcomes the limitations of T2-weighted imaging for reliable assessment of diffuse myocardial edema and can be used to diagnose, stage, and monitor myocardial injury. Strong evidence supports the clinical use of T2 mapping in acute myocardial infarction, myocarditis, heart transplant rejection, and dilated cardiomyopathy. Accumulating data support the utility of T2 mapping for the assessment of other cardiomyopathies, rheumatologic conditions with cardiac involvement, and monitoring for cancer therapy-related cardiac injury. Importantly, elevated T2 relaxation time may be the first sign of myocardial injury in many diseases and oftentimes precedes symptoms, changes in ejection fraction, and irreversible myocardial remodeling. This comprehensive review discusses the technical considerations and clinical roles of myocardial T2 mapping with an emphasis on expanding the impact of this unique, noninvasive tissue parameter.

Over the rainbow: Guidelines for meaningful use of colour maps in neurophysiology

Visualization of complex data is commonplace in neurophysiology research. Here, we highlight specific perceptual issues related to the ongoing misuse of variations of the rainbow colour scheme, with a particular emphasis on time-frequency decompositions in electrophysiology as an illustrative example. We review the risks of biased interpretation of neurophysiological data in this context, and provide guidelines to improve the use of colour maps to visualise complex, multidimensional data in neurophysiology research.

Cochlear signal alterations using pseudo-color perceptual enhancement for patients with sensorineural hearing loss

BACKGROUND

Neuroimaging detection of sensorineural hearing loss (SNHL)-related temporal bone abnormalities is limited (20-50%). We hypothesize that cochlear signal differences in gray-scale data may exceed the threshold of human eye detection. Gray-scale images can be post-processed to enhance perception of tonal difference using "pseudo-color" schemes.

OBJECTIVE

To compare patients with unilateral SNHL to age-matched normal magnetic resonance imaging (MRI) exams for "labyrinthine color differences" employing pseudo-color post-processing.

MATERIALS AND METHODS

The MRI database at an academic children's hospital was queried for "hearing loss." Only unilateral SNHL cases were analyzed. Sixty-nine imaging exams were reviewed. Thirteen age-matched normal MR exams in children without hearing loss were chosen for comparison. Pseudo-color was applied with post-processing assignment of specific hues to each gray-scale intensity value. Gray-scale and pseudo-color images were qualitatively evaluated for signal asymmetries by a board-certified neuroradiologist blinded to the side of SNHL.

RESULTS

Twenty-six SNHL (mean: 7.6±3 years) and 13 normal control exams (mean: 7.3±4 years) were included. All patients had normal gray-scale cochlear signal and all controls had symmetrical pseudo-color signal. However, pseudo-color images revealed occult asymmetries localizing to the SNHL ear with lower values in 38%. Ninety-one percent of these cases showed concordance between the side of pseudo-color positivity and the side of hearing loss.

CONCLUSION

Pseudo-color perceptual image enhancement reveals intra-labyrinthine fluid alterations on MR exams in children with unilateral SNHL. Pseudo-color image enhancement techniques improve detection of cochlear pathology and could have therapeutic implications.

Taking pigeons to heart: Birds proficiently diagnose human cardiac disease

In two experiments, we trained pigeons (Columba livia) to sort visual images (obtained by clinical myocardial perfusion imaging techniques) depicting different degrees of human cardiac disfunction (myocardial hypoperfusion of the left ventricle) into normal and abnormal categories by providing food reward only after correct choice responses. Pigeons proved to be highly proficient at categorizing pseudo-colorized images as well as highly sensitive to the degree of the perfusion deficit depicted in the abnormal images. In later testing, the pigeons completely transferred discriminative responding to novel stimuli, demonstrating that they had fully learned the normal and abnormal categories. Yet, these pigeons failed to transfer discriminative responding to grayscale images containing no color information. We therefore trained a second cohort of pigeons to categorize grayscale image sets from the outset. These birds required substantially more training to achieve similar levels of performance. Yet, they too completely transferred discriminative responding to novel stimuli by relying on both global and local disparities in brightness between the normal and abnormal images. These results confirm that pseudo-colorization can enhance pigeons' categorization of human cardiac images, a result also found with human observers. Overall, our findings further document the potential of the pigeon as a useful aide in studies of medical image perception.

Impact of Colorized Display of Mammograms on Lesion Detection

OBJECTIVE

To assess the effect of the colorized display of digital mammograms on observer detection of subtle breast lesions.

METHODS

Three separate observer studies compared detection performance using grayscale versus color display of 1) low-contrast mass-like objects in a standardized mammography phantom; 2) simulated microcalcifications in a background of normal breast parenchyma; and 3) standard-of-care clinical digital mammograms with subtle calcifications and masses. Colorization of the images was done by displaying each image pixel in blue, green, and red hues, or gray, maintaining DICOM-calibrated luminance scale and consistent luminance range. For the simulated calcifications and clinical mammogram studies, comparison of detection rates was computed using McNemar's test for paired differences.

RESULTS

For the phantom study, mass-like object detection was significantly better using a green colormap than grayscale (73.3% vs 70.8%, P = .009), with no significant improvement using blue or red colormaps (72.6% and 72.5%, respectively). For simulated microcalcifications, no significant difference was noted in detection using the green colormap, as compared with grayscale. For clinical digital screening mammograms, no significant difference was noted between gray and green colormaps for detection of microcalcifications. Green color display, however, resulted in decreased sensitivity for detection of subtle masses (63% vs 69%, P = .03).

CONCLUSION

Although modest improvement was demonstrated for a detection task using colorized display of a standard mammography phantom, no significant improvement was demonstrated using a color display for a simulated clinical detection task, and actual clinical performance was worse for colorized display of mammograms in comparison to standard grayscale display.

Basal and Acetazolamide Brain Perfusion SPECT in Internal Carotid Artery Stenosis

Internal carotid artery (ICA) stenosis including Moyamoya disease needs revascularization when hemodynamic insufficiency is validated. Vascular reserve impairment was the key to find the indication for endarterectomy/bypass surgery in the atherosclerotic ICA stenosis and to determine the indication, treatment effect, and prognosis in Moyamoya diseases. Vascular reserve was quantitatively assessed by 1-day split-dose I-123 IMP basal/acetazolamide SPECT in Japan or by Tc-99m HMPAO SPECT in other countries using qualitative or semi-quantitative method. We summarized the development of 1-day basal/ acetazolamide brain perfusion SPECT for ICA stenosis, both quantitative and qualitative methods, and their methodological issues regarding (1) acquisition protocol; (2) qualitative assessment, either visual or deep learning-based; (3) clinical use for atherosclerotic ICA steno-occlusive diseases and mostly Moyamoya diseases; and (4) their impact on the choice of treatment options. Trials to use CT perfusion or perfusion MRI using contrast materials or arterial spin labeling were briefly discussed in their endeavor to use basal studies alone to replace acetazolamide-challenge SPECT. Theoretical and practical issues imply that basal perfusion evaluation, no matter how much sophisticated, will not disclose vascular reserve. Acetazolamide rarely causes serious adverse reactions but included fatality, and now, we need to monitor patients closely in acetazolamide-challenge studies.

Color standard display function: A proposed extension of DICOM GSDF

PURPOSE

Color images are being used more in medical imaging for a broad range of modalities and applications. While in the past, color was mostly used for annotations, today color is also widely being used for diagnostic purposes. Surprisingly enough, there is no agreed upon standard yet that describes how color medical images need to be visualized and how calibration and quality assurance of color medical displays need to be performed. This paper proposes color standard display function (CSDF) which is an extension of the DICOM GSDF standard toward color. CSDF defines how color medical displays need to be calibrated and how QA can be performed to obtain perceptually linear behavior not only for grayscale but also for color.

METHODS

The proposed CSDF algorithm uses DICOM GSDF calibration as a starting point and subsequently uses a color visual difference metric to redistribute colors in order to obtain perceptual linearity not only for the grayscale behavior but also for the color behavior. A clear calibration and quality assurance algorithm is defined and is validated on a wide range of different display systems.

RESULTS

A detailed description of the proposed CSDF calibration and quality assurance algorithms is provided. These algorithms have been tested extensively on three types of display systems: consumer displays, professional displays, and medical grade displays. Test results are reported both for the calibration algorithm as well as for the quantitative and visual quality assurance methods. The tests confirm that the described algorithm generates consistent results and is able to increase perceptual linearity for color and grayscale visualization. Moreover the proposed algorithms are working well on a wide range of display systems.

CONCLUSIONS

CSDF has been proposed as an extension of the DICOM GSDF standard toward color. Calibration and QA algorithms for CSDF have been described in detail. The proposed algorithms have been tested on several types of display systems and the results confirm that CSDF largely increases the perceptual linearity of visualized colors, while at the same time remaining compliant with DICOM GSDF.