Effect of monitor luminance and ambient light on observer performance in soft-copy reading of digital chest radiographs

Pathologists light level preferences using the microscope-study to guide digital pathology display use

Background

Currently, there is a paucity of guidelines relating to displays used for digital pathology making procurement decisions, and optimal display configuration, challenging.Experience suggests pathologists have personal preferences for brightness when using a conventional microscope which we hypothesized could be used as a predictor for display setup.

Methods

We conducted an online survey across six NHS hospitals, totalling 108 practicing pathologists, to capture brightness adjustment habits on both microscopes and displays.A convenience subsample of respondents was then invited to take part in a practical task to determine microscope brightness and display luminance preferences in the normal working environment. A novel adaptation for a lightmeter was developed to directly measure the light output from the microscope eyepiece.

Results

The survey (response rate 59% n=64) indicates 81% of respondents adjust the brightness on their microscope. In comparison, only 11% report adjusting their digital display. Display adjustments were more likely to be for visual comfort and ambient light compensation rather than for tissue factors, common for microscope adjustments. Part of this discrepancy relates to lack of knowledge of how to adjust displays and lack of guidance on whether this is safe; But, 66% felt that the ability to adjust the light on the display was important.Twenty consultants took part in the practical brightness assessment. Light preferences on the microscope showed no correlation with display preferences, except where a pathologist has a markedly brighter microscope light preference. All of the preferences in this cohort were for a display luminance of <500 cd/m2, with 90% preferring 350 cd/m2 or less. There was no correlation between these preferences and the ambient lighting in the room.

Conclusions

We conclude that microscope preferences can only be used to predict display luminance requirements where the microscope is being used at very high brightness levels. A display capable of a brightness of 500 cd/m2 should be suitable for almost all pathologists with 300 cd/m2 suitable for the majority. Although display luminance is not frequently changed by users, the ability to do so was felt to be important by the majority of respondents.Further work needs to be undertaken to establish the relationship between diagnostic performance, luminance preferences, and ambient lighting levels.

[Studies on the Effectiveness of High-luminance Monitors in Mammography Softcopy Interpretation]

PURPOSE

Recently, monitors with maximum luminance exceeding 2000 cd/m2 (high-luminance monitor) have been used for diagnostic mammography. In this study, we examined the visibility of high-luminance monitors by converting luminance meter measurements into the just noticeable difference (JND) Index. The ambient light was also examined at the same time.

METHOD

The high-luminance monitor is a 21.3-inch IPS monochrome monitor with a maximum luminance of 3000 cd/m2. Experiments were conducted with a minimum luminance of 0.6 cd/m2 and a maximum luminance of 500, 850, and 1200 cd/m2. The luminance ratio was set to 1 : 2000 and the maximum luminance was changed to 500, 1000, and 2000 cd/m2. The ambient light was varied to 8.7, 36.1, 61.3, and 129.6 lx. The Japan Radiological Society recommended luminance values for each stage of phantom and Grayscale Standard Display Function curves were measured.

RESULT

The JND increased as the maximum luminance was increased for both the case with the same minimum luminance and the case with the same luminance ratio, and visibility was improved.

CONCLUSION

In both the case of the same minimum luminance and the case of the same luminance ratio, the JND was found to increase as the maximum luminance was increased. The results suggest that high-luminance monitors may improve visibility and allow for higher ambient light settings. Furthermore, the degree of eye fatigue needs to be verified.

Mandating Limits on Workload, Duty, and Speed in Radiology

Research has not yet quantified the effects of workload or duty hours on the accuracy of radiologists. With the exception of a brief reduction in imaging studies during the 2020 peak of the COVID-19 pandemic, the workload of radiologists in the United States has seen relentless growth in recent years. One concern is that this increased demand could lead to reduced accuracy. Behavioral studies in species ranging from insects to humans have shown that decision speed is inversely correlated to decision accuracy. A potential solution is to institute workload and duty limits to optimize radiologist performance and patient safety. The concern, however, is that any prescribed mandated limits would be arbitrary and thus no more advantageous than allowing radiologists to self-regulate. Specific studies have been proposed to determine whether limits reduce error, and if so, to provide a principled basis for such limits. This could determine the precise susceptibility of individual radiologists to medical error as a function of speed during image viewing, the maximum number of studies that could be read during a work shift, and the appropriate shift duration as a function of time of day. Before principled recommendations for restrictions are made, however, it is important to understand how radiologists function both optimally and at the margins of adequate performance. This study examines the relationship between interpretation speed and error rates in radiology, the potential influence of artificial intelligence on reading speed and error rates, and the possible outcomes of imposed limits on both caseload and duty hours. This review concludes that the scientific evidence needed to make meaningful rules is lacking and notes that regulating workloads without scientific principles can be more harmful than not regulating at all.

Perceived contrast on displays with different luminance ranges

PURPOSE

Medical displays are fundamental in today's healthcare since they provide the link between digitally stored data and the human clinician, and it is thus important that the transfer of information is as effective and reliable as possible. Contrast perception in viewed images is complex due to the nature of the human visual system, and the luminance distribution in the viewed scene plays a major role. Standards and guidelines concerning medical displays are important as they set a baseline image quality. However, as the number of imaging applications as well as display technology has evolved rapidly during the past decades, there may be possible uses not foreseen in the current guidelines. Bright screens may perform as good in bright rooms as less bright displays do in dark rooms, but current guidelines are likely to favor dark rooms due to historical reasons. The purpose of this study was to determine the limits of contrast perception in three very different lighting conditions and relate the outcome to guideline recommendations.

METHODS

Three different display luminance settings were studied, 1-250, 6-500, and 12-750 cd/m2 with luminance ratios of 250, 85, and 62, respectively. Although the luminance ratios, black levels, and white levels were different, they all covered the same number of just noticeable differences (JNDs). By using a two-alternative forced-choice method, contrast thresholds were determined at dark, mid-gray, and bright pixel values for all luminance settings using bar patterns with two different spatial frequencies. In total, 18 contrast thresholds were determined by each of the 10 observers.

RESULTS

The contrast thresholds for the low-frequency patterns were close to 0.5 JNDs and there were no systematic differences between the three luminance conditions at any of the pixel values. The high-frequency patterns required almost 10 times higher contrast where the highest contrast threshold (worst visibility) was obtained for the luminance setting 1-250 cd/m2 at the dark pixel value.

CONCLUSIONS

The differences between the three luminance conditions were mostly minor, which indicate that display settings with low luminance ratios and high minimum luminance levels can be used without compromising displayed image contrast. The number of JNDs enclosed by the luminance range of a display is a reliable metric for global perceived contrast. Luminance ratios are limited regarding the ability to detect low contrast objects when there are large differences in luminance, although they can still be used within a relatively small range of luminance levels. Low luminance levels may cause a loss of visibility, especially for fine details, and should be avoided.

Advancing Research on Medical Image Perception by Strengthening Multidisciplinary Collaboration

Medical image interpretation is central to detecting, diagnosing, and staging cancer and many other disorders. At a time when medical imaging is being transformed by digital technologies and artificial intelligence, understanding the basic perceptual and cognitive processes underlying medical image interpretation is vital for increasing diagnosticians' accuracy and performance, improving patient outcomes, and reducing diagnostician burnout. Medical image perception remains substantially understudied. In September 2019, the National Cancer Institute convened a multidisciplinary panel of radiologists and pathologists together with researchers working in medical image perception and adjacent fields of cognition and perception for the "Cognition and Medical Image Perception Think Tank." The Think Tank's key objectives were to identify critical unsolved problems related to visual perception in pathology and radiology from the perspective of diagnosticians, discuss how these clinically relevant questions could be addressed through cognitive and perception research, identify barriers and solutions for transdisciplinary collaborations, define ways to elevate the profile of cognition and perception research within the medical image community, determine the greatest needs to advance medical image perception, and outline future goals and strategies to evaluate progress. The Think Tank emphasized diagnosticians' perspectives as the crucial starting point for medical image perception research, with diagnosticians describing their interpretation process and identifying perceptual and cognitive problems that arise. This article reports the deliberations of the Think Tank participants to address these objectives and highlight opportunities to expand research on medical image perception.

Burnout: A Mindful Framework for the Radiologist

Burnout, the outcome of prolonged stress or frustration, manifests as both mental and physical fatigue affecting over half of healthcare workers. This article will discuss the etiologies, problems, and potential solutions to burnout related issues that are impacting radiologists. Factors placing radiologists at risk for burnout as well the impact of burnout upon the radiologist, the department, staff, and patients they serve will also be discussed. An emphasis will also be placed upon recognition, solutions, and a collective response to burnout. Readers should be able to perform a self-assessment of their own risk for burnout and understand what can be done to dissolve and prevent burnout amongst their colleagues. In doing so, our hope is that radiologists will develop greater insight, awareness, and ultimately empathy for the unique challenges that others in the radiology community may face.

Pupil diameter differentiates expertise in dental radiography visual search

Expert behavior is characterized by rapid information processing abilities, dependent on more structured schemata in long-term memory designated for their domain-specific tasks. From this understanding, expertise can effectively reduce cognitive load on a domain-specific task. However, certain tasks could still evoke different gradations of load even for an expert, e.g., when having to detect subtle anomalies in dental radiographs. Our aim was to measure pupil diameter response to anomalies of varying levels of difficulty in expert and student dentists’ visual examination of panoramic radiographs. We found that students’ pupil diameter dilated significantly from baseline compared to experts, but anomaly difficulty had no effect on pupillary response. In contrast, experts’ pupil diameter responded to varying levels of anomaly difficulty, where more difficult anomalies evoked greater pupil dilation from baseline. Experts thus showed proportional pupillary response indicative of increasing cognitive load with increasingly difficult anomalies, whereas students showed pupillary response indicative of higher cognitive load for all anomalies when compared to experts.

Increasing display luminance as a means to enhance interpretation accuracy and efficiency when reducing full-field digital mammography dose

Reducing dose increases noise impacting image quality but can be offset by increasing display luminance. Two contrast detail mammography images were obtained at 26 kV and the same distance between detectors, at 45 and 50 mAs resulting in entrance surface doses of 7.09 and 7.88 mGy, respectively. They were processed to make average gray level of the background independent of the dose level while maintaining original SNR. Eight radiologists viewed the images at 420, 1000  cd/m2 , and SpotView™ a tool that resulted in an average display luminance of 3138.8  cd/m2 . Percent correct (PC) for all three luminances was higher for high versus low dose. Performance was always higher with high dose no matter what the luminance. For low dose, PC was highest with SpotView™, and SpotView™ and 1000  cd/m2 were significantly higher than 420  cd/m2 . At high dose, SpotView™ PC was significantly higher than both lower luminances. Average time per image was lower in high dose, and, at both doses, time decreased as luminance increased, with SpotView™ having significantly shorter times. Increasing luminance from 420 to 1000  cd/m2 significantly increases target detection by ∼3.0% and with SpotView™ by ∼6.2% . Increasing display luminance with SpotView™ significantly decreases reading time by 16.0%.

Factors Affecting Radiologist's PACS Usage

The purpose of this study was to determine if any of the factors radiologist, examination category, time of week, and week effect PACS usage, with PACS usage defined as the sequential order of computer commands issued by a radiologist in a PACS during interpretation and dictation. We initially hypothesized that only radiologist and examination category would have significant effects on PACS usage. Command logs covering 8 weeks of PACS usage were analyzed. For each command trace (describing performed activities of an attending radiologist interpreting a single examination), the PACS usage variables number of commands, number of command classes, bigram repetitiveness, and time to read were extracted. Generalized linear models were used to determine the significance of the factors on the PACS usage variables. The statistical results confirmed the initial hypothesis that radiologist and examination category affect PACS usage and that the factors week and time of week to a large extent have no significant effect. As such, this work provides direction for continued efforts to analyze system data to better understand PACS utilization, which in turn can provide input to enable optimal utilization and configuration of corresponding systems. These continued efforts were, in this work, exemplified by a more detailed analysis using PACS usage profiles, which revealed insights directly applicable to improve PACS utilization through modified system configuration.

A Systematic Review of Fatigue in Radiology: Is It a Problem?

OBJECTIVE

The purpose of this study was to review current literature regarding radiologist fatigue.

MATERIALS AND METHODS

A literature search was performed using PubMed. Key words and Medical Subject Heading terms were used to generate refined queries with inclusion and exclusion criteria, focusing on fatigue and error. Results were selected according to these criteria: examined radiologist fatigue and radiologic error stemming from fatigue; experimental results measured as accuracy, error, or performance; and peer-reviewed publication. The risk of bias was addressed by including both quantitative and qualitative studies.

RESULTS

Twenty-seven articles were included, mainly primary research articles. Common outcome measures included subjective self-reports and tests to measure eyestrain. Reaction time was also recorded, accounting for variables such as age and experience. One group recommended that guidelines should be implemented regarding number of hours worked. Most recommended ergonomic interventions, proposing the implementation of tools to measure and standardize fatigue and optimize workflow, in conjunction with considering radiologists individually. Education in appropriate viewing habits and breaks were also suggested. Only one study with seven participants recommended that radiologists should sleep well to improve their performance and overall well-being, despite the undeniable evidence that radiologists are fatigued.

CONCLUSION

Fatigue is present in radiology and affects diagnostic accuracy.

Detectability of T1a lung cancer on digital chest radiographs: an observer-performance comparison among 2-megapixel general-purpose, 2-megapixel medical-purpose, and 3-megapixel medical-purpose liquid-crystal display (LCD) monitors

BACKGROUND

There has been no comparison of detectability of small lung cancer between general and medical LCD monitors or no comparison of detectability of small lung cancer between solid and part-solid nodules.

PURPOSE

To compare the detectabilities of T1a lung cancer on chest radiographs on three LCD monitor types: 2-megapixel (MP) for general purpose (General), 2-MP for medical purpose (Medical), and 3-MP-Medical.

MATERIAL AND METHODS

Radiographs from forty patients with T1aN0M0 primary lung cancer (27 solid nodules, 13 part-solid nodules) and 60 patients with no abnormalities on both chest X-ray and computed tomography (CT) were consecutively collected. Five readers assessed 100 cases for each monitor. The observations were analyzed using receiver operating characteristic (ROC) analysis. A jackknife method was used for statistical analysis. A P value of <0.05 was considered significant.

RESULTS

The average AUC for all T1a lung cancer nodule detection using the 2-MP-General, 2-MP-Medical, and 3-MP-Medical LCD monitors were 0.86, 0.89, and 0.89, respectively; there were no significant differences among them. The average AUC for part-solid nodule detection using a 2-MP-General, 2-MP-Medical, and 3-MP-Medical LCD monitors were 0.77, 0.86, and 0.89, respectively. There were significant differences between the 2-MP-General and 2-MP-Medical LCD monitors (P = 0.043) and between the 2-MP-General and 3-MP-Medical LCD monitors (P = 0.027). There was no significant difference between the 2-MP-Medical and 3-MP-Medical LCD monitors. The average AUC for solid nodule detection using a 2-MP-General, 2-MP-Medical, and 3-MP-Medical LCD monitors were 0.90, 0.90, and 0.88, respectively; there were no significant differences among them. The mean AUC values for all and part-solid nodules of the low-experienced readers were significantly lower than those of the high-experienced readers with the 2 M-GP color LCD monitor (P < 0.05).

CONCLUSION

Detectability of part-solid nodules using a general-purpose LCD monitor was significantly lower than those using medical-purpose LCD monitors.

[Current situations and problems of quality control for medical imaging display systems]

Diagnostic imaging has been shifted rapidly from film to monitor diagnostic. Consequently, Japan medical imaging and radiological systems industries association (JIRA) have recommended methods of quality control (QC) for medical imaging display systems. However, in spite of its need by majority of people, executing rate is low. The purpose of this study was to validate the problem including check items about QC for medical imaging display systems. We performed acceptance test of medical imaging display monitors based on Japanese engineering standards of radiological apparatus (JESRA) X-0093*A-2005 to 2009, and performed constancy test based on JESRA X-0093*A-2010 from 2010 to 2012. Furthermore, we investigated the cause of trouble and repaired number. Medical imaging display monitors had 23 inappropriate monitors about visual estimation, and all these monitors were not criteria of JESRA about luminance uniformity. Max luminance was significantly lower year-by-year about measurement estimation, and the 29 monitors did not meet the criteria of JESRA about luminance deviation. Repaired number of medical imaging display monitors had 25, and the cause was failure liquid crystal panel. We suggested the problems about medical imaging display systems.

Interpretation of digital chest radiographs: comparison of light emitting diode versus cold cathode fluorescent lamp backlit monitors

Objective

To compare the diagnostic performance of light emitting diode (LED) backlight monitors and cold cathode fluorescent lamp (CCFL) monitors for the interpretation of digital chest radiographs.

Materials and Methods

We selected 130 chest radiographs from health screening patients. The soft copy image data were randomly sorted and displayed on a 3.5 M LED (2560 × 1440 pixels) monitor and a 3 M CCFL (2048 × 1536 pixels) monitor. Eight radiologists rated their confidence in detecting nodules and abnormal interstitial lung markings (ILD). Low dose chest CT images were used as a reference standard. The performance of the monitor systems was assessed by analyzing 2080 observations and comparing them by multi-reader, multi-case receiver operating characteristic analysis. The observers reported visual fatigue and a sense of heat. Radiant heat and brightness of the monitors were measured.

Results

Measured brightness was 291 cd/m² for the LED and 354 cd/m² for the CCFL monitor. Area under curves for nodule detection were 0.721 ± 0.072 and 0.764 ± 0.098 for LED and CCFL (p = 0.173), whereas those for ILD were 0.871 ± 0.073 and 0.844 ± 0.068 (p = 0.145), respectively. There were no significant differences in interpretation time (p = 0.446) or fatigue score (p = 0.102) between the two monitors. Sense of heat was lower for the LED monitor (p = 0.024). The temperature elevation was 6.7℃ for LED and 12.4℃ for the CCFL monitor.

Conclusion

Although the LED monitor had lower maximum brightness compared with the CCFL monitor, soft copy reading of the digital chest radiographs on LED and CCFL showed no difference in terms of diagnostic performance. In addition, LED emitted less heat.

Performance evaluation of soft copy display systems according to AAPM TG18 protocol

The purpose of this study was to evaluate the display performance of the liquid crystal display monitors according to the American association of physicists in medicine task group 18 (AAPM TG18) protocol at prior and after new calibration. We measured minimum and maximum luminance, luminance ratio, luminance and contrast response, luminance angular and spatial dependency, resolution, veiling glare and chromaticity quantitatively for 33 medical displays. Display noise was evaluated only visually. The mean maximum luminance and luminance ratio were 386 and 273 cd m(-2), respectively. The mean deviation of measured luminance and contrast response from expected response associated with the digital imaging and communications in medicine (DICOM) grayscale standard display function (GSDF) were 9.76 and 2.35 % at prior calibration and 1.23 and 0.26 % after recalibration, respectively. In luminance uniformity test the mean maximum luminance deviation was 16 %. Luminance method was used in the spatial resolution test and the mean percent luminance difference was 12 % at the center. The mean glare ratio was 1 154. The average color uniformity parameter across the display area of each display device was 0.0093. Majority of the test results were in good agreement with the criteria recommended by AAPM TG18 report. Considerable improvement was observed in display luminance and contrast response with respect to expected response of DICOM GSDF after new calibration for some displays.

Breast screen new South wales generally demonstrates good radiologic viewing conditions

This study measured reading workstation monitors and the viewing environment currently available within BreastScreen New South Wales (BSNSW) centres to determine levels of adherence to national and international guidelines. Thirteen workstations from four BSNSW service centres were assessed using the American Association of Physicists in Medicine Task Group 18 Quality Control test pattern. Reading workstation monitor performance and ambient light levels when interpreting screening mammographic images were assessed using spectroradiometer CS-2000 and chroma meter CL-200. Overall, radiologic monitors within BSNSW were operating at good acceptable levels. Some non-adherence to published guidelines included the percentage difference in maximum luminance between pairs of primary monitors at individual workstations (61.5 % or 30.8 % of workstations depending on specific guidelines), maximum luminance (23.1 % of workstations), luminance non-uniformity (11.5 % of workstations) and minimum luminance (3.8 % of workstations). A number of ambient light measurements did not comply with the only available evidence-based guideline relevant to the methodology used in this study. Larger ambient light variations across sites are shown when monitors were switched off, suggesting that differences in ambient lighting between sites can be masked when a standard mammogram is displayed for photometric measurements. Overall, BSNSW demonstrated good adherence to available guidelines, although some non-compliance has been shown. Recently updated United Kingdom and Australian guidelines should help reduce confusion generated by the plethora and sometimes dated nature of currently available recommendations.

The effects of ambient lighting in chest radiology reading rooms

Under typical dark chest radiography reading room conditions, a radiologist's pupils contract and dilate as their visual focus intermittently shifts between the high luminance monitor and the darker background wall, resulting in increased visual fatigue and degradation of diagnostic performance. A controlled increase of ambient lighting may minimize these visual adjustments and potentially improve comfort and accuracy. This study was designed to determine the effect of a controlled increase of ambient lighting on chest radiologist nodule detection performance. Four chest radiologists read 100 radiographs (50 normal and 50 containing a subtle nodule) under low (E=1 lx) and elevated (E=50 lx) ambient lighting levels on a DICOM-calibrated, medical-grade liquid crystal display. Radiologists were asked to identify nodule locations and rate their detection confidence. A receiver operating characteristic (ROC) analysis of radiologist results was performed and area under ROC curve (AUC) values calculated for each ambient lighting level. Additionally, radiologist selection times under both illuminance conditions were determined. Average AUC values did not significantly differ (p>0.05) between ambient lighting levels (estimated mean difference=-0.03; 95% CI, (-0.08, 0.03)). Average selection times decreased or remained constant with increased illuminance. The most considerable decreases occurred for false positive identification times (35.4±18.8 to 26.2±14.9 s) and true positive identification times (29.7±18.3 to 24.5±15.5 s). No performance differences were statistically significant. Study findings suggest that a controlled increase of ambient lighting within darkly lit chest radiology reading rooms, to a level more suitable for performance of common radiological tasks, does not appear to have a statistically significant effect on nodule detection performance.

Human contrast-detail performance with declining contrast

PURPOSE

How do display settings and ambient lighting affect contrast detection thresholds for human observers? Can recalibrating a display for high ambient lighting improve object detection?

METHODS

Contrast∕detail (CD) threshold detection performance was measured for observers using four color displays with varying overall contrast (e.g., differing maximum luminance and ambient lighting conditions). Detailed mapping of contrast detection performance (for fixed object size) was tracked as a function of: display maximum luminance, ambient lighting changes (with and without recalibrating for the higher ambience), and the performance of radiologists vs. nonradiologists.

RESULTS

The initial phase was analyzed with a hierarchical linear model of observer performance using: background gray level, maximum display luminance, and radiologist vs. nonradiologist. The only statistically significant finding was a maximum luminance of 100 cd∕m(2) display performing worse than a baseline peak of 400 cd∕m(2). The second phase examined ambient lighting effects on detection thresholds. Background gray level and maximum display luminance were examined coupled with ambient lighting for: baseline at 30, 435 uncorrected, and 435 lx with display recalibration for the ambient conditions. Results showed ambient correction improved sensitivity for small background digital driving level, but not at higher luminance backgrounds.

CONCLUSIONS

For CD study, nonradiologist observers can be used without loss of applicability. Contrast detection thresholds improved significantly between displays with peak luminance from 100 cd∕m(2) to 200 cd∕m(2), but improvement beyond that was not statistically significant for contrast detection thresholds in a reading room environment. Applying a calibration correction at high ambience (435 lx) improved detection tasks primarily in the darker background regions.

Chromaticity and correlated color temperature of the white point in medical liquid-crystal display

PURPOSE

The color characteristics of medical liquid-crystal displays (LCDs) have become one of the main interests in quality assurance and quality control of medical display devices. It is necessary to evaluate variations of the color characteristics in medical LCDs in order to provide consistent color characteristics for image reading. In this study, we characterize the color characteristics in grayscale images displayed on medical LCDs.

METHODS

Eight medical color LCDs and eight medical monochrome LCDs were used in this study with operating times ranging from 800 to 25 000 h. Default settings of correlated color temperature (CCT) of white points for all color LCDs were set at 7500 K. We measured chromaticity in the Commission Internationale de l'Éclairage (CIE) u'v' color space and CCT of the white point at 18 luminance levels. A colorimeter and grayscale test patterns with various luminance levels were used for the measurements. First, we examined differences in chromaticity and CCT at 18 luminance levels for each LCD. Second, we compared chromaticities of the different LCDs. Then, chromaticity and CCT of LCDs were measured at different ambient light conditions (30 and 560 lux) and compared to those measured in a dark room. Finally, the relationship between operating times and CCT was evaluated.

RESULTS

The chromaticities of monochrome LCDs changed toward the blue and CCT increased as luminance decreased. In color LCDs, the chromaticity and CCT of the white point except at the minimum luminance were nearly constant to those measured at the maximum luminance. We observed differences in chromaticity between color and monochrome LCDs because of the nonadjustable white point of monochrome LCDs. When the ambient light increased, chromaticity varied, and CCT decreased on every LCD. Ambient light had a much greater impact on chromaticity and CCT at lower luminance levels. The CCT of LCDs decreased in longer operating times. The grayscale of LCDs with longer operating times was measured to be more yellowish due to the degradation of cold cathode fluorescent lamps.

CONCLUSIONS

Our results clearly indicate that the white point in grayscale images displayed on medical LCDs changes depending on luminance levels, color or monochrome LCDs, ambient light conditions, and operating times. These data provide useful information to understand color characteristics of LCD for image reading, especially for quality assurance and quality control of LCDs.

Expert interpretation compensates for reduced image quality of camera-digitized images referred to radiologists

We compared the accuracy of five veterinary radiologists when reading 20 radiographic cases on both analog film and in camera-digitized format. In addition, we compared the ability of five veterinary radiologists vs. 10 private practice veterinarians to interpret the analog images. Interpretation accuracy was compared using receiver operating characteristic curve analysis. Veterinary radiologists' accuracy did not significantly differ between analog vs. camera-digitized images (P = 0.13) although sensitivity was higher for analog images. Radiologists' interpretation of both digital and analog images was significantly better compared with the private veterinarians (P < 0.05).

Assessment of ultrasound monitor image display performance

The display monitor on an ultrasound scanner is used to make primary diagnoses. In this study, 31 ultrasound systems were assessed against current American Association of Physicists in Medicine (AAPM) display standards. Measurements of peak levels (L(max) and L(min)) were generated. Ambient light, L(amb) (cd/m(2)) and room illuminance, L(x) (Lux) were measured. Luminance ratio was calculated (LR' = (L(max)+L(amb))/(L(min)+L(amb))). Initially, only 8/31 systems (26%) passed all the criteria. After adjustment, a further 7/31 (23%) passed making a total of 15/31 passes (48%). A total of 16/31 (52%) were considered overall fails: three due to poor room lighting, 14 due to poor monitor performance. Considering errors this could be as low as 6/31 (19%). Although further work is required to confirm the applicability of these results, it is of concern that three-quarters of ultrasound scanners could be suboptimally adjusted with 19%-55% unable to pass the AAPM criteria. The impact of this on clinical practice is unknown but there is clearly a need to review display quality assurance on ultrasound scanners.

Effect of LCD monitor type and observer experience on diagnostic performance in soft-copy interpretations of the maxillary sinus on panoramic radiographs

Purpose

The aim of this study was to evaluate the effect of liquid crystal display (LCD) monitor type and observer experience on the diagnostic performance in soft-copy interpretations of maxillary sinus inflammatory lesions on panoramic radiographs.

Materials and Methods

Ninety maxillary sinuses on panoramic images were grouped into negative and positive groups according to the presence of inflammatory lesions, using CT for confirmation. Monochrome and color LCDs were used. Six observers participated and ROC analysis was performed to evaluate the diagnostic performance. The reading time, fatigue score, and inter-/intra-observer agreements were assessed.

Results

The interpretation of maxillary sinus inflammatory lesions was affected by the LCD monitor type used and by the experience of the observer. The reading time was not significantly different, however the fatigue score was significantly different between two LCD monitors. Inter-observer agreement was relatively good in experienced observers, while the intra-observer agreement for all observers was good with monochrome LCD but not with color LCD.

Conclusion

The less experienced observers showed lowered diagnostic ability with a general color LCD.

Detection of cervical spine fracture on computed radiography images a monitor resolution study

RATIONALE AND OBJECTIVES

The purpose of this study was to evaluate the diagnostic accuracy of radiologists using monochrome medical-grade 5 megapixel (MP), 3 MP, 2 MP, and 1 MP displays for the detection of cervical fractures on cervical radiographs, while controlling factors such as luminance and ambient conditions.

MATERIALS AND METHODS

Institutional review board approval was obtained. Two hundred lateral cervical computed radiography images, 97 with fractures, were randomly displayed on 5-MP, 3-MP, 2-MP, or 1-MP liquid crystal displays (LCDs) for a total of 450 interpretations per display. These radiographs were presented in eight sessions, each with 25 radiographs, to nine readers. The reference standard for all cases was computed tomography. Ambient lighting, monitor luminance, and gamma were controlled throughout the study. Measures included receiver operator characteristic areas under the curve (AUC), sensitivity, specificity, and accuracy, mean elapsed time by display, and mean confidence level by display. One way analysis of variance was performed. Results were considered to be significant at an alpha level of 0.05.

RESULTS

AUCs were 0.76 (95% CI, 0.72-0.80) for the 1 MP, 0.80 (95% CI, 0.76-0.84) for the 2 MP, 0.77 (95% CI, 0.73-0.81) for the 3 MP, and 0.76 (95% CI, 0.72-0.80) for the 5 MP medical grade LCDs. There was no significant difference in the AUCs (P values between .0651 and .8693), confidence (P = .158), or interpretation times (P = .751).

CONCLUSION

When controlling factors such as luminance and ambient light, a difference in accuracy in the detection of cervical fractures by resolution could not be detected when using medical-grade displays. Interpretation time and confidence were also not affected by resolution.

[Objective evaluation of visual fatigue for reading of radiographs displayed on medical-grade liquid-crystal displays]

The aim of this study was to evaluate visual fatigue objectively by measuring accommodation time and critical fusion frequency (CFF) before and after reading posteroanterior chest radiographs displayed on medical-grade liquid-crystal displays (LCDs) under different monitor conditions. A color LCD (500, 170 cd/m²) and a monochrome LCD (500 cd/m²) were used in this study. Six observers independently kept reading the radiographs for two hours to understand various lung nodules in the "Fatigue Session". Objective visual fatigue was measured by using the accommodation device and the CFF meter before and after the Fatigue Session. The ambient lighting of the laboratory was set at 35 lux. Both the accommodation time and the CFF between before and after the Fatigue Session indicated statistically significant differences (p<0.05). Our results on accommodation time and CFF before and after reading the radiographs on medical-grade LCDs indicated that visual fatigue could be evaluated objectively.

Current perspectives in medical image perception

Medical images constitute a core portion of the information a physician utilizes to render diagnostic and treatment decisions. At a fundamental level, this diagnostic process involves two basic processes: visually inspecting the image (visual perception) and rendering an interpretation (cognition). The likelihood of error in the interpretation of medical images is, unfortunately, not negligible. Errors do occur, and patients' lives are impacted, underscoring our need to understand how physicians interact with the information in an image during the interpretation process. With improved understanding, we can develop ways to further improve decision making and, thus, to improve patient care. The science of medical image perception is dedicated to understanding and improving the clinical interpretation process.

Long radiology workdays reduce detection and accommodation accuracy

PURPOSE

The aim of this study was to measure the diagnostic accuracy of fracture detection, visual accommodation, reading time, and subjective ratings of fatigue and visual strain before and after a day of clinical reading.

METHODS

Forty attending radiologists and radiology residents viewed 60 deidentified, HIPAA-compliant bone examinations, half with fractures, once before any clinical reading (early) and once after a day of clinical reading (late). Reading time was recorded. Visual accommodation (the ability to maintain focus) was measured before and after each reading session. Subjective ratings of symptoms of fatigue and oculomotor strain were collected. The study was approved by local institutional review boards.

RESULTS

Diagnostic accuracy was reduced significantly after a day of clinical reading, with average areas under the receiver operating characteristic curves of 0.885 for early reading and 0.852 for late reading (P < .05). After a day of image interpretation, visual accommodation was no more variable, though error in visual accommodation was greater (P < .01), and subjective ratings of fatigue were higher.

CONCLUSIONS

After a day of clinical reading, radiologists have reduced ability to focus, increased symptoms of fatigue and oculomotor strain, and reduced ability to detect fractures. Radiologists need to be aware of the effects of fatigue on diagnostic accuracy and take steps to mitigate these effects.

A comparative contrast perception phantom image of brain CT study between high-grade and low-grade liquid crystal displays (LCDs) in electronic medical charts

The purpose of this study was to clarify whether non-medical-grade liquid crystal displays (LCDs) are acceptable for the soft-copy reading of brain CTs. Four kinds of color LCDs with different image quality levels were used: medical-grade LCD, low-grade general LCD calibrated with the grayscale display function (GSDF), low-grade general LCD calibrated with gamma 2.2 and a notebook personal computer display panel. In Osirix's standard window setting for brain CTs, the average CT values of brain parenchyma in 100 cases were correlated with a grayscale level ranging from 71 to 91 in a 256-step grayscale. At these gray levels, the image contrast on the two low-grade LCDs calibrated with gamma 2.2 was higher than that on the medical-grade LCD. Eleven healthy volunteers participated in the contrast perception study, which used electronically generated target phantom images that simulated subtle abnormalities with a low or high attenuation difference in brain parenchyma. The three low-grade LCDs showed correct response rates and reaction times that were superior to those of the medical-grade display. The grayscale calibrations, GSDF or gamma 2.2, are likely to be more critical than the display grade, suggesting that the use of a low-grade LCD may be acceptable in the image contrast of brain CT.

Comparison of observer performance on soft-copy reading of digital chest radiographs: High resolution liquid-crystal display monitors versus cathode-ray tube monitors

The purpose of this study is to compare observer performance for detection of abnormalities on chest radiographs with 5-megapixel resolution liquid-crystal displays (LCD) and 5-megapixel resolution cathode-ray tube (CRT) monitors under bright and subdued ambient light conditions. Six radiologists reviewed a total of 254 digital chest radiographs under four different conditions with a combination of two types of monitors (a 5-megapixel resolution LCD and a 5-megapixel resolution CRT monitor) and with two types of ambient light (460 and 50 lux). The abnormalities analyzed were nodules, pneumothorax and interstitial lung disease. For each reader, the detection performance using 5-megapixel LCD and 5-megapixel CRT monitors under bright and subdued ambient light conditions were compared using multi-case and multi-modality ROC analysis. For each type of ambient light, the average detection performance with the two types of monitors was also compared. For each reader, the observer performance of 5-megapixel LCD and 5-megapixel CRT monitors, under both bright and subdued ambient light conditions, showed no significant statistical differences for detecting nodules, pneumothorax and interstitial lung disease. In addition, there was no significant statistical difference in the average performance when the two monitor displays, under both bright and subdued ambient light conditions, were compared.

Comparison of color LCD and medical-grade monochrome LCD displays in diagnostic radiology

In diagnostic radiology, medical-grade monochrome displays are usually recommended because of their higher luminance. Standard color displays can be used as a less expensive alternative, but have a lower luminance. The aim of the present study was to compare image quality for these two types of displays. Images of a CDRAD contrast-detail phantom were read by four radiologists using a 2-megapixel (MP) color display (143 cd/m(2) maximum luminance) as well as 2-MP (295 cd/m(2)) and 3-MP monochrome displays. Thirty lumbar spine radiographs were also read by four radiologists using the color and the 2-MP monochrome display in a visual grading analysis (VGA). Very small differences were found between the displays when reading the CDRAD images. The VGA scores were -0.28 for the color and -0.25 for the monochrome display (p = 0.24; NS). It thus seems possible to use color displays in diagnostic radiology provided that grayscale adjustment is used.

Influence of display quality on radiologists' performance in the detection of lung nodules on radiographs

The purpose of this study was to evaluate the influence of display quality on radiologists' performance in the detection of lung nodules. Display systems with various technical properties were considered based on their general availability in a radiology department. Their quality was assessed by physical tests. Multireader-multicase receiver operating characteristic (ROC) analysis was used to evaluate observer performance. The area under the curve (Az) was used as a metric for detectability of simulated lung nodules with diameters of 5 mm and 10 mm, and peak contrast values ranging from 0.1 (subtle) to 0.4 (evident) that were digitally superimposed on normal chest radiographs. Three experienced radiologists interpreted a batch of 60 radiographs on five different display systems; four monitors (two liquid crystal display (LCD) and two cathode ray tube (CRT) monitors) and one printed hardcopy. The physical tests showed superior performance of the two LCD monitors. ROC analysis resulted in the following Az scores: LCD-5MP Az = 0.78, hardcopy Az = 0.77, LCDc-2MP Az = 0.75, CRT-5MP Az = 0.72 and CRTc-1MP Az = 0.71. Difference in Az scores between the LCD-5MP monitor and both the CRT-5MP (p = 0.04) and CRTc-1MP (p = 0.01) monitors was significant. The primary class CRT-5MP monitor that showed reduced observer performance failed to comply with physical acceptance requirements. Luminance response was particularly observed to be insufficient. The results indicate that a quality assurance program has the potential to detect non-optimised display systems that could otherwise result in reduced observer performance.

Effect of ambient light and bit depth of digital radiograph on observer performance in determination of endodontic file positioning

OBJECTIVES

To examine the effects of the luminance and bit depth of digital image on observer performance for determination of endodontic file positioning.

STUDY DESIGN

Using extracted premolar teeth, no. 08 K-file was placed into the canal and positioned so that the tip was either flush or 1 mm short of the radiologic root apex. The samples were imaged with both conventional and digital radiographs at 8 and 12 bits. Eleven observers read the images under dark and bright condition, and receiver operating characteristics analysis was performed. Additionally, the interpreting time was measured.

RESULTS

The 12-bit images showed similar observer performance compared with conventional images, and better than the 8-bit images. The interpretation time for bright condition and 8-bit images was longer than for dark condition and 12-bit images.

CONCLUSION

Twelve-bit digital images were preferred to 8-bit for accurate determination of endodontic file position.

Practical assessment of the display performance of radiology workstations

The performance of 14 primary clinical display monitor workstations in use in the Radiology Department of a large acute NHS Trust was assessed using the methods and guidelines described by the American Association of Physicists in Medicine Task Group 18. Tests undertaken included the measurement of ambient light, display uniformity, luminance ratio, luminance response, maximum luminance and spatial resolution. Four display monitors failed to meet at least one of the test's guideline tolerances. In addition a number of display monitors were found to be operating at settings that might reduce their useful life span. These devices were either replaced or recalibrated by the installers, or were subject to local adjustment to ensure applicable standards were met. Consequently the study suggests that quality assurance testing of display monitors used for image reporting is necessary and valuable to ensure that images are viewed at an appropriate standard.

Neonatal Chest Computed Radiography: Image Processing and Optimal Image Display

OBJECTIVE

The purpose of this study was to determine soft-copy image display preferences of brightness, latitude, and detail contrast for neonatal chest computed radiography to establish a baseline for future work on low-dose imaging.

CONCLUSION

Observers preferred brighter images with higher detail contrast and narrow to middle latitude for soft-copy display compared with the typical screen-film hard-copy appearance. Future research on low-dose neonatal chest imaging will be facilitated by an understanding of optimal soft-copy image display.

Ambient Lighting: Effect of Illumination on Soft-Copy Viewing of Radiographs of the Wrist

OBJECTIVE

The aim of the work was to establish optimum ambient light conditions for viewing radiologic images of the wrist on liquid crystal display monitors.

MATERIALS AND METHODS

Five ambient light levels were investigated: 480, 100, 40, 25, and 7 lux. Seventy-nine experienced radiologists were asked to examine 30 posteroanterior wrist images and decide whether a fracture was present. All images were displayed on liquid crystal display monitors. Receiver operating characteristic analysis was performed, and the numbers of false-positive and false-negative findings were recorded.

RESULTS

For all the radiologists, greater area under the receiver operating characteristic curve and lower numbers of false-positive and false-negative findings were recorded at 40 and 25 lux compared with 480 and 100 lux. At 7 lux, the results were generally similar to those at 480 and 100 lux. The experience and knowledge of radiologists specializing in imaging of musculoskeletal trauma appeared to compensate in part for inappropriate lighting levels.

CONCLUSION

Typical office lighting and current recommendations on ambient lighting can reduce diagnostic efficacy compared with lower levels of ambient lighting. If, however, no light other than that of the monitor is used, results are similar to those with excessive levels of lighting. Careful control of ambient lighting is therefore required to ensure that diagnostic accuracy is maximized, particularly for clinicians not expert in interpreting posteroanterior wrist images.

Pulmonary nodule detection with digital projection radiography: an ex-vivo study on increased latitude post-processing

To evaluate increased image latitude post-processing of digital projection radiograms for the detection of pulmonary nodules. 20 porcine lungs were inflated inside a chest phantom, prepared with 280 solid nodules of 4-8 mm in diameter and examined with direct radiography (3.0x2.5 k detector, 125 kVp, 4 mAs). Nodule position and size were documented by CT controls and dissection. Four intact lungs served as negative controls. Image post-processing included standard tone scales and increased latitude with detail contrast enhancement (log-factors 1.0, 1.5 and 2.0). 1280 sub-images (512x512 pixel) were centred on nodules or controls, behind the diaphragm and over free parenchyma, randomized and presented to six readers. Confidence in the decision was recorded with a scale of 0-100%. Sensitivity and specificity for nodules behind the diaphragm were 0.87/0.97 at standard tone scale and 0.92/0.92 with increased latitude (log factor 2.0). The fraction of "not diagnostic" readings was reduced (from 208/1920 to 52/1920). As an indicator of increased detection confidence, the median of the ratings behind the diaphragm approached 100 and 0, respectively, and the inter-quartile width decreased (controls: p<0.001, nodules: p=0.239) at higher image latitude. Above the diaphragm, accuracy and detection confidence remained unchanged. Here, the sensitivity for nodules was 0.94 with a specificity from 0.96 to 0.97 (all p>0.05). Increased latitude post-processing has minimal effects on the overall accuracy, but improves the detection confidence for sub-centimeter nodules in the posterior recesses of the lung.

Digital Mammography Image Quality: Image Display

This paper on digital mammography image display is 1 of 3 papers written as part of an intersociety effort to establish image quality standards for digital mammography. The information included in this paper is intended to support the development of an American College of Radiology (ACR) guideline on image quality for digital mammography. The topics of the other 2 papers are digital mammography image acquisition and digital mammography image storage, transmission, and retrieval. The societies represented in compiling this document were the Radiological Society of North America, the ACR, the American Association of Physicists in Medicine, and the Society for Computer Applications in Radiology. These papers describe in detail what is known to improve image quality for digital mammography and make recommendations about how digital mammography should be performed to optimize the visualization of breast cancers using this imaging tool. Through the publication of these papers, the ACR is seeking input from industry, radiologists, and other interested parties on their contents so that the final ACR guideline for digital mammography will represent the consensus of the broader community interested in these topics.

Design and Ergonomic Considerations for the Filmless Environment

Planning and executing the redesign of a traditional institutional radiology reading room to conform to the radically different requirements of digital imaging are reviewed, with examples drawn from the authors' experience and from the growing body of literature on this subject. Included are best-practice recommendations and real-life examples on initial design and planning, stakeholder involvement, identifying and hiring consultants, architectural planning, the designation of a radiology point person, rethinking room and workstation design, the selection of ergonomic furniture and fittings, identifying optimal environmental elements, fine tuning and lessons learned, and going digital.

Validated simple tip to aid eliminating light scatter in viewing overexposed radiographs

INTRODUCTION

Overexposed radiographs can hinder the diagnostic performance of the examining physician. We describe a new, simple technique to aid eliminating light scatter in overexposed radiographs and examine its effect objectively.

MATERIALS AND METHODS

The new technique is simply manufacturing a monocular device out of another rolled up XR sheet and examining the object radiograph through it to mask the light scatter. Controlled environments were created to examine five different radiographs and register the light scatter reduction using a digital high resolution camera.

RESULTS

The light scatter reduction was noted to be statistically significant by using the new technique. (P < 0.001).

CONCLUSIONS

This technique is simple, readily available and avoids the need to repeat radiographs with the associated increased cost, chronological delays and potential radiological harm.

Image quality performance of liquid crystal display systems: influence of display resolution, magnification and window settings on contrast-detail detection

The aim of this study was to investigate the combined effects of liquid crystal display (LCD) resolution, image magnification and window/level adjustment on the low-contrast performance in soft-copy image interpretation in digital radiography and digital mammography. In addition, the effect of a new LCD noise reduction mechanism on the low-contrast detectability was studied. Digital radiographs and mammograms of two dedicated contrast-detail phantoms (CDRAD 2.0 and CDMAM 3.4) were scored on five LCD devices with varying resolutions (1-3- and 5-megapixel) and one dedicated 5-megapixel cathode ray tube monitor. Two 5-megapixel LCDs were included. The first one was a standard 5-megapixel LCD and the second had a new (Per Pixel Uniformity) noise reduction mechanism. A multi-variate analysis of variance revealed a significant influence of LCD resolution, image magnification and window/level adjustment on the image quality performance assessed with both the CDRAD 2.0 and the CDMAM 3.4 phantoms. The interactive adjustment of brightness and contrast of digital images did not affect the reading time, whereas magnification to full resolution resulted in a significantly slower soft-copy interpretation. For digital radiography applications, a 3-megapixel LCD is comparable with a 5-megapixel CRT monitor in terms of low-contrast performance as well as in reading time. The use of a 2-megapixel LCD is only warranted when radiographs are analysed in full resolution and when using the interactive window/level adjustment. In digital mammography, a 5-megapixel monitor should be the first choice. In addition, the new PPU noise reduction system in the 5-megapixel LCD devices provides significantly better results for mammography reading as compared to a standard 5-magapixel LCD or CRT. If a 3-megapixel LCD is used in mammography setting, a very time-consuming magnification of the digital mammograms would be necessary.

Acceptance tests of diagnostic displays in a PACS system according to AAPM TG18

In a filmless environment it is necessary to execute acceptance and constancy tests on monitors used for interpretation of medical images. Performances of Barco CRT MGD521 MKII, Barco LCD L685EX monitors have been evaluated. Acceptancepress were executed following AAPM Task Group 18 guidelines. Visual and instrumental evaluations of geometric distortions, reflections, luminances response, contrast, uniformity, resolution, angular response and veiling glare were made. Barco monitors showed optimal performances, while EIZO monitors were accepted with some reserve on their quality level. Finally a comparative evaluation between monitors and film (the actual gold standard) was performed by an interview of ten radiologists: the monitors showed a quality at least equal to film. These monitors are currently in use for routine medical interpretation.