Differential use of image enhancement techniques by experienced and inexperienced observers

Does mammographic density remain a radiological challenge in the digital era?

BACKGROUND

The low subject contrast between cancerous and fibroglandular tissue could obscure breast abnormalities.

PURPOSE

To investigate radiologists' performance for detection of breast cancer in low and high mammographic density (MD) when cases are digitally acquired.

MATERIAL AND METHODS

A test set of 60 digital mammography cases, of which 20 were cancerous, were examined by 17 radiologists. Mammograms were categorized as low (≤50%) or high (>50%) MD and rated for suspicion of malignancy using the Royal Australian and New Zealand College of Radiology (RANZCR) classification system. Radiologist demographics including cases read per year, age, subspecialty, and years of reporting were recorded. Radiologist performance was analyzed by the following metrics: sensitivity; specificity; area under the receiver operating characteristic (ROC) curve (AUC), location sensitivity, and jackknife free-response ROC (JAFROC) figure of merit (FOM).

RESULTS

Comparing high to low MD cases, radiologists showed a significantly higher sensitivity (P = 0.015), AUC (P = 0.003), location sensitivity (P = 0.002), and JAFROC FOM (P = 0.001). In high compared to low MD cases, radiologists with <1000 annual reads and radiologists with no mammographic subspecialty had significantly higher AUC, location sensitivity, and JAFROC FOM. Radiologists with ≥1000 annual reads and radiologists with mammography subspecialty demonstrated a significant increase in location sensitivity in high compared to low MD cases.

CONCLUSION

In this experimental situation, radiologists' performance was higher when reading cases with high compared to low MD. Experienced radiologists were able to precisely localize lesions in breasts with higher MD. Further studies in unselected screening materials are needed to verify the results.

Digital zoom of the full-field digital mammogram versus magnification mammography: a systematic review

OBJECTIVES

To summarise and compare the performance of magnification mammography and digital zoom utilising a full-field digital mammography (FFDM) system in the detection and diagnosis of microcalcifications.

METHODS

We ran an extended search in MEDLINE, EMBASE, CINAHL, Engineering Village and Web of Science. Diagnostic test studies, experimental breast phantom studies and a Monte Carlo phantom study were included. A narrative approach was selected to summarise and compare findings regarding the detection of microcalcifications, while a hierarchical model with bivariate analysis was used for the meta-analysis of sensitivity and specificity for diagnosing microcalcifications.

RESULTS

Nine studies were included. Phantom studies suggested that the size of microcalcifications, magnification or zoom factor, exposure factors and detector technology determine whether digital zoom is equivalent to magnification mammography in the detection of microcalcifications. Pooled sensitivity for magnification and zoom calculated from the diagnostic test studies was 0.93 (95% CI 0.84-0.97) and 0.85 (95% CI 0.70-0.94), respectively. Pooled specificity was 0.55 (95% CI 0.51-0.58) and 0.56 (95% CI 0.50-0.62), respectively. The differences between the sensitivities and specificities were not statistically significant.

CONCLUSIONS

Digital zoom may be equivalent to magnification mammography. Diagnostic test studies and phantom studies using newer detector technology would contribute additional knowledge on this topic.

KEY POINTS

• The performance of digital zoom is comparable to magnification for detecting microcalcifications when newer detector technology and optimised imaging procedures are utilised. • The accuracy of digital zoom appears equivalent to geometric magnification in diagnosing microcalcifications.

Evaluation of the effect of zoom function on lesion detection by soft-copy reading of screening mammograms

INTRODUCTION

This study aims to evaluate the effectiveness of zooming in improving screen-reader performance in reporting digital mammograms.

METHOD

Two experiments were conducted. In the first experiment, 5 readers were asked to report 59 two-view bilateral mammograms retrospectively with zooming function turned off. The second session was similar to the first one except that zooming was enabled. The task of readers was to assess if the mammograms were normal or abnormal and rate the confidence levels for each of the lesion they detected. The reader performances were evaluated via case sensitivity, lesion sensitivity, specificity, receiver operating characteristics (ROC) area under the curve (AUC) and jackknife free-response receiver operating characteristics (JAFROC) figure of merit (FOM).

RESULTS

There was no significant improvement in overall reader performance in detecting abnormalities in zooming condition compared with no zooming in terms of case sensitivity (96% and 87%, P = 0.285) or lesion sensitivity (88% and 81%, P = 0.224). However, differences in ROC AUC and JAFROC FOM (P ≤ 0.05) were found in two readers when they performed the test set with zooming function.

CONCLUSION

The results suggested that the use of the zooming function did improve the performance of some readers in detecting abnormal cases.

Mammographic density and cancer detection: does digital imaging challenge our current understanding?

RATIONALE AND OBJECTIVES

To investigate the impact of breast density on the performance of radiologists when mammograms are digitally acquired and displayed.

MATERIALS AND METHODS

A total of 150 craniocaudal digital mammograms including 75 cases with cancer were examined by 14 radiologists divided into two groups: those who read more (six) and less (eight) than 2000 mammograms per year. Cases were classified as low or high mammographic density. For both types of cases, detection of cancers within and outside the dense fibroglandular tissue was investigated. The performance of radiologist was measured using jack-knife free-response receiver operating characteristic (JAFROC) figure of merit (FOM).

RESULTS

Radiologists with over 2000 annual reads had significantly higher JAFROC FOM (P = .03) for high (0.76) mammographic density compared to low (0.70) mammographic density cases. When lesions overlaid the fibroglandular tissue, cases with high mammographic density compared to low mammographic density displayed increased location sensitivity for all radiologists (P = .03) and for those radiologists reading more than 2000 mammograms annually (P = .04), whereas JAFROC FOMs increased for all radiologists (P = .05). No significant changes were observed when the lesion was outside the fibroglandular region.

CONCLUSIONS

Increased mammographic density improves the performance of experienced radiologists when using digital mammograms. This finding, which does not align with those previously reported for film screen systems, may be because of windowing/leveling opportunities available with digital images.

How mammographic breast density affects radiologists' visual search patterns

RATIONALE AND OBJECTIVES

To determine the impact of mammographic breast density on the visual search process of radiologists when reading digital mammograms.

MATERIALS AND METHODS

Institutional review board approval was obtained. A set of 149 craniocaudal digital mammograms were read by seven radiologists, and observer search patterns were recorded. Total time examining each case, time to first hit the lesion, dwell time, and number of hits per area were calculated. The nonparametric Mann-Whitney U test was used for statistical evaluation.

RESULTS

In both low- and high-mammographic density cases, significant increases were observed in the time to first hit lesions when they were located outside, compared to overlying fibroglandular dense tissue (P = .001). Significantly longer dwell time (P = .003) and greater number of fixations (P = .0003) were observed when the lesions were situated within--rather than outside--the dense fibroglandular tissue.

CONCLUSIONS

Increased mammographic breast density changes radiologists' visual search patterns. Dense areas of the parenchyma attracted greater visual attention in both high- and low-mammographic density cases, resulting in faster detection of lesions overlying the fibroglandular dense tissue, along with longer dwell times and greater number of fixations, as compared to lesions located outside the dense fibroglandular regions.

Hidden costs of poor image quality: a radiologist's perspective

Although image quality is a well-recognized component in the successful delivery of medical imaging services, it has arguably declined over the past decade owing to several technical, economic, cultural, and geographic factors. To improve quality, the radiologist community must take a more proactive role in image quality analysis and optimization; these require analysis of not just the single step of image acquisition but the entire imaging chain. Radiologists can benefit through improved report accuracy, diagnostic confidence, and workflow efficiency. The derived data-driven analyses offer an objective means for provider performance analysis, which can help combat commoditization trends and self-referral by nonradiologist providers.

Human-computer interaction in radiotherapy target volume delineation: a prospective, multi-institutional comparison of user input devices

The purpose of this study was the prospective comparison of objective and subjective effects of target volume region of interest (ROI) delineation using mouse-keyboard and pen-tablet user input devices (UIDs). The study was designed as a prospective test/retest sequence, with Wilcoxon signed rank test for matched-pair comparison. Twenty-one physician-observers contoured target volume ROIs on four standardized cases (representative of brain, prostate, lung, and head and neck malignancies) twice: once using QWERTY keyboard/scroll-wheel mouse UID and once with pen-tablet UID (DTX2100, Wacom Technology Corporation, Vancouver, WA, USA). Active task time, ROI manipulation task data, and subjective survey data were collected. One hundred twenty-nine target volume ROI sets were collected, with 62 paired pen-tablet/mouse-keyboard sessions. Active contouring time was reduced using the pen-tablet UID, with mean ± SD active contouring time of 26 ± 23 min, compared with 32 ± 25 with the mouse (p ≤ 0.01). Subjective estimation of time spent was also reduced from 31 ± 26 with mouse to 27 ± 22 min with the pen (p = 0.02). Task analysis showed ROI correction task reduction (p = 0.045) and decreased panning and scrolling tasks (p < 0.01) with the pen-tablet; drawing, window/level changes, and zoom commands were unchanged (p = n.s.) Volumetric analysis demonstrated no detectable differences in ROI volume nor intra- or inter-observer volumetric coverage. Fifty-two of 62 (84%) users preferred the tablet for each contouring task; 5 of 62 (8%) denoted no preference, and 5 of 62 (8%) chose the mouse interface. The pen-tablet UID reduced active contouring time and reduced correction of ROIs, without substantially altering ROI volume/coverage.

Assessment of using digital manipulation tools for diagnosing mandibular radiolucent lesions

OBJECTIVE

The purpose of this study was to analyse the use of digital tools for image enhancement of mandibular radiolucent lesions and the effects of this manipulation on the percentage of correct radiographic diagnoses.

METHODS

24 panoramic radiographs exhibiting radiolucent lesions were selected, digitized and evaluated by non-experts (undergraduate and newly graduated practitioners) and by professional experts in oral diagnosis. The percentages of correct and incorrect diagnoses, according to the use of brightness/contrast, sharpness, inversion, highlight and zoom tools, were compared. All dental professionals made their evaluations without (T₁) and with (T₂) a list of radiographic diagnostic parameters.

RESULTS

Digital tools were used with low frequency mainly in T₂. The most preferred tool was sharpness (45.2%). In the expert group, the percentage of correct diagnoses did not change when any of the digital tools were used. For the non-expert group, there was an increase in the frequency of correct diagnoses when brightness/contrast was used in T₂ (p=0.008) and when brightness/contrast and sharpness were not used in T₁ (p=0.027). The use or non-use of brightness/contrast, zoom and sharpness showed moderate agreement in the group of experts [kappa agreement coefficient (κ) = 0.514, 0.425 and 0.335, respectively]. For the non-expert group there was slight agreement for all the tools used (κ ≤ 0.237).

CONCLUSIONS

Consulting the list of radiographic parameters before image manipulation reduced the frequency of tool use in both groups of examiners. Consulting the radiographic parameters with the use of some digital tools was important for improving correct diagnosis only in the group of non-expert examiners.

Detection of microcalcifications on digital screening mammograms using varying degrees of monitor zooming

OBJECTIVE

The American College of Radiology recommends that mammogram images be viewed at 100% resolution (also called one-to-one or full resolution). We tested the effect of this and three other levels of zooming on the ability of radiologists to identify malignant calcifications on screening mammographic views.

MATERIALS AND METHODS

Seven breast imagers viewed 77 mammographic images, 32 with and 45 without malignant microcalcifications, using four different degrees of monitor zooming. The readers indicated whether they thought a cluster of potentially malignant calcifications was present and where the cluster was located. Tested degrees of zooming included fit screen, a size midway between fit screen and 100%, 100%, and a size slightly larger than 100%.

RESULTS

Readers failed to detect 17 clusters of malignant calcifications with fit-screen images, 12 clusters with midway images, 13 clusters with 100% images, and 11 clusters with slightly larger images. When viewing images without malignant microcalcifications, the readers marked false-positive areas on 25 images using fit-screen images, 43 of the midway images, 40 of the 100% images, and 29 of the slightly larger images.

CONCLUSION

All four tested levels of zooming functioned well. There was a trend for the fit-screen images to function slightly less well than the others with regard to sensitivity, so it may not be prudent to rely on those images without other levels of zooming. The 100% resolution images did not function noticeably better than the others.

Conspicuity of microcalcifications on digital screening mammograms using varying degrees of monitor zooming

RATIONALE AND OBJECTIVES

American College of Radiology guidelines suggest that digital screening mammographic images should be viewed at the full resolution at which they were acquired. This slows interpretation speed. The aim of this study was to examine the effect of various levels of zooming on the detection and conspicuity of microcalcifications.

MATERIALS AND METHODS

Six radiologists viewed 40 mammographic images five times in different random orders using five different levels of zooming: full resolution (100%) and 30%, 61%, 88%, and 126% of that size. Thirty-three images contained microcalcifications varying in subtlety, all associated with breast cancer. The clusters were circled. Seven images contained no malignant calcifications but also had randomly placed circles. The radiologists graded the presence or absence and visual conspicuity of any calcifications compared to calcifications in a reference image. They also counted the microcalcifications.

RESULTS

The radiologists saw the microcalcifications in 94% of the images at 30% size and in either 99% or 100% of the other tested levels of zooming. Conspicuity ratings were worst for the 30% size and fairly similar for the others. Using the 30% size, two radiologists failed to see the microcalcifications on either the craniocaudal or mediolateral oblique view taken from one patient. Interobserver agreement regarding the number of calcifications was lowest for the 30% images and second lowest for the 100% images.

CONCLUSIONS

Images at 30% size should not be relied on alone for systematic scanning for microcalcifications. The other four levels of magnification all performed well enough to warrant further testing.

Optimization of exposure parameters in full field digital mammography

Optimization of exposure parameters (target, filter, and kVp) in digital mammography necessitates maximization of the image signal-to-noise ratio (SNR), while simultaneously minimizing patient dose. The goal of this study is to compare, for each of the major commercially available full field digital mammography (FFDM) systems, the impact of the selection of technique factors on image SNR and radiation dose for a range of breast thickness and tissue types. This phantom study is an update of a previous investigation and includes measurements on recent versions of two of the FFDM systems discussed in that article, as well as on three FFDM systems not available at that time. The five commercial FFDM systems tested, the Senographe 2000D from GE Healthcare, the Mammomat Novation DR from Siemens, the Selenia from Hologic, the Fischer Senoscan, and Fuji's 5000MA used with a Lorad M-IV mammography unit, are located at five different university test sites. Performance was assessed using all available x-ray target and filter combinations and nine different phantom types (three compressed thicknesses and three tissue composition types). Each phantom type was also imaged using the automatic exposure control (AEC) of each system to identify the exposure parameters used under automated image acquisition. The figure of merit (FOM) used to compare technique factors is the ratio of the square of the image SNR to the mean glandular dose. The results show that, for a given target/filter combination, in general FOM is a slowly changing function of kVp, with stronger dependence on the choice of target/filter combination. In all cases the FOM was a decreasing function of kVp at the top of the available range of kVp settings, indicating that higher tube voltages would produce no further performance improvement. For a given phantom type, the exposure parameter set resulting in the highest FOM value was system specific, depending on both the set of available target/filter combinations, and on the receptor type. In most cases, the AECs of the FFDM systems successfully identified exposure parameters resulting in FOM values near the maximum ones, however, there were several examples where AEC performance could be improved.

Thick slices from tomosynthesis data sets: phantom study for the evaluation of different algorithms

Tomosynthesis is a 3-dimensional mammography technique that generates thin slices separated one to the other by typically 1 mm from source data sets. The relatively high image noise in these thin slices raises the value of 1-cm thick slices computed from the set of reconstructed slices for image interpretation. In an initial evaluation, we investigated the potential of different algorithms for generating thick slices from tomosynthesis source data (maximum intensity projection-MIP; average algorithm-AV, and image generation by means of a new algorithm, so-called softMip). The three postprocessing techniques were evaluated using a homogeneous phantom with one textured slab with a total thickness of about 5 cm in which two 0.5-cm-thick slabs contained objects to simulate microcalcifications, spiculated masses, and round masses. The phantom was examined by tomosynthesis (GE Healthcare). Microcalcifications were simulated by inclusion of calcium particles of four different sizes. The slabs containing the inclusions were examined in two different configurations: adjacent to each other and close to the detector and with the two slabs separated by two 1-cm thick breast equivalent material slabs. The reconstructed tomosynthesis slices were postprocessed using MIP, AV, and softMip to generate 1-cm thick slices with a lower noise level. The three postprocessing algorithms were assessed by calculating the resulting contrast versus background for the simulated microcalcifications and contrast-to-noise ratios (CNR) for the other objects. The CNRs of the simulated round and spiculated masses were most favorable for the thick slices generated with the average algorithm, followed by softMip and MIP. Contrast of the simulated microcalcifications was best for MIP, followed by softMip and average projections. Our results suggest that the additional generation of thick slices may improve the visualization of objects in tomosynthesis. This improvement differs from the different algorithms for microcalcifications, speculated objects, and round masses. SoftMip is a new approach combining features of MIP and average showing image properties in between MIP and AV.

Risk factors for a false positive test outcome in diagnosis of caries in approximal surfaces: impact of radiographic modality and observer characteristics

The aim of this study was to evaluate the impact of image modality and observer characteristics on radiographic caries diagnosis with particular emphasis on the false positive (FP) test outcome. Eighty human teeth were radiographed by eight digital modalities and film. Eight observers scored caries lesions in each approximal tooth surface. Their use of image enhancement and time spent in assessing an image was recorded. Microscopy served as validation for the presence/absence of a lesion. Of 160 approximal surfaces, 63% were sound and 37% had lesions. Multivariate logistic regression analysis was performed with the FP test outcome as the dependent variable and the radiographic modality and observer's gender, experience, employment, image enhancement, and time use as the independent variables. The significant risk factors for an FP test outcome were: (1) gender: males scored fewer FP than females (OR 0.26, CI 0.18-0.36); (2) experience: observers with no experience with digital radiography had a six times higher risk for an FP (OR 6.09, CI 4.9-8.1); (3) radiographic modality: two of the digital systems had a significantly lower risk for an FP [a phosphor plate system (OR 0.55, CI 0.37-0.73) and a sensor-based system (OR 0.65, CI 0.46-0.93)] and one phosphor plate system had a higher risk (OR 1.57, CI 1.17-2.13) than film; (4) time use: more time was spent when scoring an FP (OR 1.05, CI 1.03-1.05) than for any other test outcome. Type of employment and the use of image enhancement had no significant impact on the risk for an FP diagnosis.