Evaluation of clinical image processing algorithms used in digital mammography

Successes and challenges in extracting information from DICOM image databases for audit and research

In radiography, much valuable associated data (metadata) is generated during image acquisition. The current setup of picture archive and communication systems (PACS) can make extraction of this metadata difficult, especially as it is typically stored with the image. The aim of this work is to examine the current challenges in extracting image metadata and to discuss the potential benefits of using this rich information. This work focuses on breast screening, though the conclusions are applicable to other modalities.The data stored in PACS contain information, currently underutilised, and is of great benefit for auditing and improving imaging and radiographic practice. From the literature, we present examples of the potential clinical benefit such as audits of dose, and radiographic practice, as well as more advanced research highlighting the effects of radiographic practice, e.g. cancer detection rates affected by imaging technology.This review considers the challenges in extracting data, namely,• The search tools for data on most PACS are inadequate being both time-consuming and limited in elements that can be searched.• Security and information governance considerations• Anonymisation of data if required• Data curationThe review describes some solutions that have been successfully implemented.• Retrospective extraction: direct query on PACS• Extracting data prospectively• Use of structured reports• Use of trusted research environmentsUltimately, the data access process will be made easier by inclusion during PACS procurement. Auditing data from PACS can be used to improve quality of imaging and workflow, all of which will be a clinical benefit to patients.

Virtual clinical trial to compare cancer detection using combinations of 2D mammography, digital breast tomosynthesis and synthetic 2D imaging

OBJECTIVES

This study was designed to compare the detection of subtle lesions (calcification clusters or masses) when using the combination of digital breast tomosynthesis (DBT) and synthetic mammography (SM) with digital mammography (DM) alone or combined with DBT.

METHODS

A set of 166 cases without cancer was acquired on a DBT mammography system. Realistic subtle calcification clusters and masses in the DM images and DBT planes were digitally inserted into 104 of the acquired cases. Three study arms were created: DM alone, DM with DBT and SM with DBT. Five mammographic readers located the centre of any lesion within the images that should be recalled for further investigation and graded their suspiciousness. A JAFROC figure of merit (FoM) and lesion detection fraction (LDF) were calculated for each study arm. The visibility of the lesions in the DBT images was compared with SM and DM images.

RESULTS

For calcification clusters, there were no significant differences (p > 0.075) in FoM or LDF. For masses, the FoM and LDF were significantly improved in the arms using DBT compared to DM alone (p < 0.001). On average, both calcification clusters and masses were more visible on DBT than on DM and SM images.

CONCLUSIONS

This study demonstrated that masses were detected better with DBT than with DM alone and there was no significant difference (p = 0.075) in LDF between DM&DBT and SM&DBT for calcifications clusters. Our results support previous studies that it may be acceptable to not acquire digital mammography alongside tomosynthesis for subtle calcification clusters and ill-defined masses.

KEY POINTS

• The detection of masses was significantly better using DBT than with digital mammography alone. • The detection of calcification clusters was not significantly different between digital mammography and synthetic 2D images combined with tomosynthesis. • Our results support previous studies that it may be acceptable to not acquire digital mammography alongside tomosynthesis for subtle calcification clusters and ill-defined masses for the imaging technology used.

Radiation Dose Reduction in Digital Mammography by Deep-Learning Algorithm Image Reconstruction: A Preliminary Study

Purpose

To develop a denoising convolutional neural network-based image processing technique and investigate its efficacy in diagnosing breast cancer using low-dose mammography imaging.

Materials and Methods

A total of 6 breast radiologists were included in this prospective study. All radiologists independently evaluated low-dose images for lesion detection and rated them for diagnostic quality using a qualitative scale. After application of the denoising network, the same radiologists evaluated lesion detectability and image quality. For clinical application, a consensus on lesion type and localization on preoperative mammographic examinations of breast cancer patients was reached after discussion. Thereafter, coded low-dose, reconstructed full-dose, and full-dose images were presented and assessed in a random order.

Results

Lesions on 40% reconstructed full-dose images were better perceived when compared with low-dose images of mastectomy specimens as a reference. In clinical application, as compared to 40% reconstructed images, higher values were given on full-dose images for resolution (p < 0.001); diagnostic quality for calcifications (p < 0.001); and for masses, asymmetry, or architectural distortion (p = 0.037). The 40% reconstructed images showed comparable values to 100% full-dose images for overall quality (p = 0.547), lesion visibility (p = 0.120), and contrast (p = 0.083), without significant differences.

Conclusion

Effective denoising and image reconstruction processing techniques can enable breast cancer diagnosis with substantial radiation dose reduction.

Development of a neonate X-ray phantom for 2D imaging applications using single-tone inkjet printing

PURPOSE

Inkjet printers can be used to fabricate anthropomorphic phantoms by the use of iodine-doped ink. However, challenges persist in implementing this technique. The calibration from grayscale to ink density is complex and time-consuming. The purpose of this work is to develop a printing methodology that requires a simpler calibration and is less dependent on printer characteristics to produce the desired range of x-ray attenuation values.

METHODS

Conventional grayscale printing was substituted by single-tone printing; that is, the superposition of pure black layers of iodinated ink. Printing was performed with a consumer-grade inkjet printer using ink made of potassium-iodide (KI) dissolved in water at 1 g/ml. A calibration for the attenuation of ink was measured using a commercial x-ray system at 70 kVp. A neonate radiograph obtained at 70 kVp served as an anatomical model. The attenuation map of the neonate radiograph was processed into a series of single-tone images. Single-tone images were printed, stacked, and imaged at 70 kVp. The phantom was evaluated by comparing attenuation values between the printed phantom and the original radiograph; attenuation maps were compared using the structural similarity index measure (SSIM), while attenuation histograms were compared using the Kullback-Leibler (KL) divergence. A region of interest (ROI)-based analysis was also performed, where the attenuation distribution within given ROIs was compared between phantom and patient. The phantom sharpness was evaluated in terms of modulation transfer function (MTF) estimates and signal spread profiles of high spatial resolution features in the image.

RESULTS

The printed phantom required 36 pages. The printing queue was automated and it took about 2 h to print the phantom. The radiograph of the printed phantom demonstrated a close resemblance to the original neonate radiograph. The SSIM of the phantom with respect to that of the patient was 0.53. Both patient and phantom attenuation histograms followed similar distributions, and the KL divergence between such histograms was 0.20. The ROI-based analysis showed that the largest deviations from patient attenuation values were observed at the higher and lower ends of the attenuation range. The limiting resolution of the proposed methodology was about 1 mm.

CONCLUSION

A methodology to generate a neonate phantom for 2D imaging applications, using single-tone printing, was developed. This method only requires a single-value calibration and required less than 2 h to print a complete phantom.

How does image quality affect radiologists' perceived ability for image interpretation and lesion detection in digital mammography?

OBJECTIVES

To study how radiologists' perceived ability to interpret digital mammography (DM) images is affected by decreases in image quality.

METHODS

One view from 45 DM cases (including 30 cancers) was degraded to six levels each of two acquisition-related issues (lower spatial resolution and increased quantum noise) and three post-processing-related issues (lower and higher contrast and increased correlated noise) seen during clinical evaluation of DM systems. The images were shown to fifteen breast screening radiologists from five countries. Aware of lesion location, the radiologists selected the most-degraded mammogram (indexed from 1 (reference) to 7 (most degraded)) they still felt was acceptable for interpretation. The median selected index, per degradation type, was calculated separately for calcification and soft tissue (including normal) cases. Using the two-sided, non-parametric Mann-Whitney test, the median indices for each case and degradation type were compared.

RESULTS

Radiologists were not tolerant to increases (medians: 1.5 (calcifications) and 2 (soft tissue)) or decreases (median: 2, for both types) in contrast, but were more tolerant to correlated noise (median: 3, for both types). Increases in quantum noise were tolerated more for calcifications than for soft tissue cases (medians: 3 vs. 4, p = 0.02). Spatial resolution losses were considered less acceptable for calcification detection than for soft tissue cases (medians: 3.5 vs. 5, p = 0.001).

CONCLUSIONS

Perceived ability of radiologists for image interpretation in DM was affected not only by image acquisition-related issues but also by image post-processing issues, and some of those issues affected calcification cases more than soft tissue cases.

KEY POINTS

• Lower spatial resolution and increased quantum noise affected the radiologists' perceived ability to interpret calcification cases more than soft tissue lesion or normal cases. • Post-acquisition image processing-related effects, not only image acquisition-related effects, also impact the perceived ability of radiologists to interpret images and detect lesions. • In addition to current practices, post-acquisition image processing-related effects need to also be considered during the testing and evaluation of digital mammography systems.

Validation of a candidate instrument to assess image quality in digital mammography using ROC analysis

PURPOSE

To validate a candidate instrument, to be used by different professionals to assess image quality in digital mammography (DM), against detection performance results.

METHODS

A receiver operating characteristics (ROC) study was conducted to assess the detection performance in DM images with four different image quality levels due to different quality issues. Fourteen expert breast radiologists from five countries assessed a set of 80 DM cases, containing 60 lesions (40 cancers, 20 benign findings) and 20 normal cases. A visual grading analysis (VGA) study using a previously-described candidate instrument was conducted to evaluate a subset of 25 of the images used in the ROC study. Eight radiologists that had participated in the ROC study, and seven expert breast-imaging physicists, evaluated this subset. The VGA score (VGAS) and the ROC and visual grading characteristics (VGC) areas under the curve (AUCROC and AUCVGC) were compared.

RESULTS

No large differences in image quality among the four levels were detected by either ROC or VGA studies. However, the ranking of the four levels was consistent: level 1 (partial AUCROC: 0.070, VGAS: 6.77) performed better than levels 2 (0.066, 6.15), 3 (0.061, 5.82), and 4 (0.062, 5.37). Similarity between radiologists' and physicists' assessments was found (average VGAS difference of 10 %).

CONCLUSIONS

The results from the candidate instrument were found to correlate with those from ROC analysis, when used by either observer group. Therefore, it may be used by different professionals, such as radiologists, radiographers, and physicists, to assess clinically-relevant image quality variations in DM.

Procurement, commissioning and QA of AI based solutions: An MPE's perspective on introducing AI in clinical practice

PURPOSE

In this study, we propose a framework to help the MPE take up a unique and important role at the introduction of AI solutions in clinical practice, and more in particular at procurement, acceptance, commissioning and QA.

MATERIAL AND METHODS

The steps for the introduction of Medical Radiological Equipment in a hospital setting were extrapolated to AI tools. Literature review and in-house experience was added to prepare similar, yet dedicated test methods.

RESULTS

Procurement starts from the clinical cases to be solved and is usually a complex process with many stakeholders and possibly many candidate AI solutions. Specific KPIs and metrics need to be defined. Acceptance testing follows, to verify the installation and test for critical exams. Commissioning should test the suitability of the AI tool for the intended use in the local institution. Results may be predicted from peer reviewed papers that treat representative populations. If not available, local data sets can be prepared to assess the KPIs, or 'virtual clinical trials' could be used to create large, simulated test data sets. Quality assurance must be performed periodically to verify if KPIs are stable, especially if the software is upscaled or upgraded, and as soon as self-learning AI tools would enter the medical practice.

DISCUSSION

MPEs are well placed to bridge between manufacturer and medical team and help from procurement up to reporting to the management board. More work is needed to establish consolidated test protocols.

Validation of a mammographic image quality modification algorithm using 3D-printed breast phantoms

Purpose: To validate a previously proposed algorithm that modifies a mammogram to appear as if it was acquired with different technique factors using realistic phantom-based mammograms. Approach: Two digital mammography systems (an indirect- and a direct-detector-based system) were used to acquire realistic mammographic images of five 3D-printed breast phantoms with the technique factors selected by the automatic exposure control and at various other conditions (denoted by the original images). Additional images under other simulated conditions were also acquired: higher or lower tube voltages, different anode/filter combinations, or lower tube current-time products (target images). The signal and noise in the original images were modified to simulate the target images (simulated images). The accuracy of the image modification algorithm was validated by comparing the target and simulated images using the local mean, local standard deviation (SD), local variance, and power spectra (PS) of the image signals. The absolute relative percent error between the target and simulated images for each parameter was calculated at each sub-region of interest (local parameters) and frequency (PS), and then averaged. Results: The local mean signal, local SD, local variance, and PS of the target and simulated images were very similar, with a relative percent error of 5.5%, 3.8%, 7.8%, and 4.4% (indirect system), respectively, and of 3.7%, 3.8%, 7.7%, and 7.5% (direct system), respectively. Conclusions: The algorithm is appropriate for simulating different technique factors. Therefore, it can be used in various studies, for instance to evaluate the impact of technique factors in cancer detection using clinical images.

Development and content validity evaluation of a candidate instrument to assess image quality in digital mammography: A mixed-method study

PURPOSE

To develop a candidate instrument to assess image quality in digital mammography, by identifying clinically relevant features in images that are affected by lower image quality.

METHODS

Interviews with fifteen expert breast radiologists from five countries were conducted and analysed by using adapted directed content analysis. During these interviews, 45 mammographic cases, containing 44 lesions (30 cancers, 14 benign findings), and 5 normal cases, were shown with varying image quality. The interviews were performed to identify the structures from breast tissue and lesions relevant for image interpretation, and to investigate how image quality affected the visibility of those structures. The interview findings were used to develop tentative items, which were evaluated in terms of wording, understandability, and ambiguity with expert breast radiologists. The relevance of the tentative items was evaluated using the content validity index (CVI) and modified kappa index (k*).

RESULTS

Twelve content areas, representing the content of image quality in digital mammography, emerged from the interviews and were converted into 29 tentative items. Fourteen of these items demonstrated excellent CVI ≥ 0.78 (k* > 0.74), one showed good CVI < 0.78 (0.60 ≤ k* ≤ 0.74), while fourteen were of fair or poor CVI < 0.78 (k* ≤ 0.59). In total, nine items were deleted and five were revised or combined resulting in 18 items.

CONCLUSIONS

By following a mixed-method methodology, a candidate instrument was developed that may be used to characterise the clinically-relevant impact that image quality variations can have on digital mammography.

Digital zoom of the full-field digital mammogram versus magnification mammography: a systematic review

OBJECTIVES

To summarise and compare the performance of magnification mammography and digital zoom utilising a full-field digital mammography (FFDM) system in the detection and diagnosis of microcalcifications.

METHODS

We ran an extended search in MEDLINE, EMBASE, CINAHL, Engineering Village and Web of Science. Diagnostic test studies, experimental breast phantom studies and a Monte Carlo phantom study were included. A narrative approach was selected to summarise and compare findings regarding the detection of microcalcifications, while a hierarchical model with bivariate analysis was used for the meta-analysis of sensitivity and specificity for diagnosing microcalcifications.

RESULTS

Nine studies were included. Phantom studies suggested that the size of microcalcifications, magnification or zoom factor, exposure factors and detector technology determine whether digital zoom is equivalent to magnification mammography in the detection of microcalcifications. Pooled sensitivity for magnification and zoom calculated from the diagnostic test studies was 0.93 (95% CI 0.84-0.97) and 0.85 (95% CI 0.70-0.94), respectively. Pooled specificity was 0.55 (95% CI 0.51-0.58) and 0.56 (95% CI 0.50-0.62), respectively. The differences between the sensitivities and specificities were not statistically significant.

CONCLUSIONS

Digital zoom may be equivalent to magnification mammography. Diagnostic test studies and phantom studies using newer detector technology would contribute additional knowledge on this topic.

KEY POINTS

• The performance of digital zoom is comparable to magnification for detecting microcalcifications when newer detector technology and optimised imaging procedures are utilised. • The accuracy of digital zoom appears equivalent to geometric magnification in diagnosing microcalcifications.

Association of Microcalcification Clusters with Short-term Invasive Breast Cancer Risk and Breast Cancer Risk Factors

Using for-presentation and for-processing digital mammograms, the presence of microcalcifications has been shown to be associated with short-term risk of breast cancer. In a previous article we developed an algorithm for microcalcification cluster detection from for-presentation digital mammograms. Here, we focus on digitised mammograms and use a three-step algorithm. In total, 253 incident invasive breast cancer cases (with a negative mammogram between three months and two years before diagnosis, from which we measured microcalcifications) and 728 controls (also with prior mammograms) were included in a short-term risk study. After adjusting for potential confounding variables, we found evidence of an association between the number of microcalcification clusters and short-term (within 3-24 months) invasive breast cancer risk (per cluster OR = 1.30, 95% CI = (1.11, 1.53)). Using the 728 postmenopausal healthy controls, we also examined association of microcalcification clusters with reproductive factors and other established breast cancer risk factors. Age was positively associated with the presence of microcalcification clusters (p = 4 × 10^-04). Of ten other risk factors that we studied, life time breastfeeding duration had the strongest evidence of association with the presence of microcalcifications (positively associated, unadjusted p = 0.001). Developing algorithms, such as ours, which can be applied on both digitised and digital mammograms (in particular for presentation images), is important because large epidemiological studies, for deriving markers of (clinical) risk prediction of breast cancer and prognosis, can be based on images from these different formats.

Determination of contrast-detail curves in mammography image quality assessment by a parametric model observer

A novel approach is proposed for the determination of contrast-detail curves in mammography image quality assessment. The approach is compared with current practice using virtual mammography. A binary parametric model observer is applied to images of the CDMAM phantom. The observer accounts for the simple disc shaped objects in the phantom and is applied separately to each cell of the phantom. For each of these applications, the area under the ROC curve (AUC) of the model observer is determined. The different AUCs, calculated from different applications of the parametric model observer, are then combined to a single contrast-detail curve quantifying the ability of the observer to detect details in the images. Virtual mammography is developed as a tool to simulate X-ray images of single CDMAM cells and to quantitatively assess the approach in comparison with current practice. It is shown that the proposed approach can lead to similar contrast-detail curves as current practice. The precision of the estimated contrast-detail curves is increased, i.e. using 5 images yields about the same precision for the proposed approach as 16 images when applying current practice. We conclude that contrast-detail curves in mammography image quality assessment can also be determined through the AUC of a binary parametric model observer. Since the proposed approach has higher precision than current practice, it is a promising candidate for contrast-detail analysis in mammography image quality assessment.

Detection of potential microcalcification clusters using multivendor for-presentation digital mammograms for short-term breast cancer risk estimation

PURPOSE

We explore using the number of potential microcalcification clusters detected in for-presentation mammographic images (the images which are typically accessible to large epidemiological studies) a marker of short-term breast cancer risk.

METHODS

We designed a three-step algorithm for detecting potential microcalcification clusters in for-presentation digital mammograms. We studied association with short-term breast cancer risk using a nested case control design, with a mammography screening cohort as a source population. In total, 373 incident breast cancer cases (diagnosed at least 3 months after a negative screen at study entry) and 1466 matched controls were included in our study. Conditional logistic regression Wald tests were used to test for association with the presence of microcalcifications at study entry. We compared results of these analyses to those obtained using a Computer-aided Diagnosis (CAD) software (VuComp) on corresponding for-processing images (images which are used clinically, but typically not saved).

RESULTS

We found a moderate agreement between our measure of potential microcalcification clusters on for-presentation images and a CAD measure on for-processing images. Similar evidence of association with short-term breast cancer risk was found (P =  1 × 10 - 10 and P =  9 × 10 - 09 , for our approach on for-presentation images and for the CAD measure on for-processing images, respectively) and interestingly both measures contributed independently to association with a short-term risk (P =  9 × 10 - 03 for the CAD measure, adjusted for our proposed method and P =  1 × 10 - 04 for our proposed method, adjusted for the CAD measure).

CONCLUSION

Meaningful measurement of potential microcalcifications, in the context of short-term breast cancer risk assessment, is feasible for for-presentation images across a range of vendors. Our algorithm for for-presentation images performs similarly to a CAD algorithm on for-processing images, hence our algorithm can be a useful tool for research on microcalcifications and their role on breast cancer risk, based on large-scale epidemiological studies with access to for-presentation images.

Mammography cancer detection: comparison of single 8MP and pair of 5MP reporting monitors

OBJECTIVE:

To compare breast cancer detection using a single 8MP display with using a standard pair of 5MP monitors.

METHODS:

An observer study was carried out in which mammograms were read using full field views only, and again with the additional use of magnified quadrant views. Seven observers read 300 cases, one view per breast, using each display type. Cases comprised 100 normal cases and 200 cases with cancers of subtle or very subtle appearance: 100 with malignant calcification clusters and 100 with non-calcified lesions. JAFROC software was used to analyse the results.

RESULTS:

When mammograms were viewed full field only, observers performed better (p = 0.050) in detecting malignant calcification clusters when using the pair of 5MP monitors compared with a single 8MP monitor. This result became non-significant when results were generalised to a population of readers. Performance in detecting calcification clusters was improved by using quadrant view in addition to full field view when using either the pair of 5MP monitors or the 8MP monitor. There was no significant difference in detection of all types of cancer between the pair of 5MP monitors and the 8MP monitor when quadrant zoom was used.

CONCLUSION:

Providing quadrant view is used in addition to full field view, there is no significant difference in cancer detection between the 8MP monitor and the pair of 5MP monitors.

ADVANCES IN KNOWLEDGE:

Effect of magnification on the detectability of subtle malignant calcification clusters in breast screening.

Signal template generation from acquired images for model observer-based image quality analysis in mammography

Mammography images undergo vendor-specific processing, which may be nonlinear, before radiologist interpretation. Therefore, to test the entire imaging chain, the effect of image processing should be included in the assessment of image quality, which is not current practice. For this purpose, model observers (MOs), in combination with anthropomorphic breast phantoms, are proposed to evaluate image quality in mammography. In this study, the nonprewhitening MO with eye filter and the channelized Hotelling observer were investigated. The goal of this study was to optimize the efficiency of the procedure to obtain the expected signal template from acquired images for the detection of a 0.25-mm diameter disk. Two approaches were followed: using acquired images with homogeneous backgrounds (approach 1) and images from an anthropomorphic breast phantom (approach 2). For quality control purposes, a straightforward procedure using a single exposure of a single disk was found adequate for both approaches. However, only approach 2 can yield templates from processed images since, due to its nonlinearity, image postprocessing cannot be evaluated using images of homogeneous phantoms. Based on the results of the current study, a phantom should be designed, which can be used for the objective assessment of image quality.

Toward image quality assessment in mammography using model observers: Detection of a calcification-like object

PURPOSE

Model observers (MOs) are of interest in the field of medical imaging to assess image quality. However, before procedures using MOs can be proposed in quality control guidelines for mammography systems, we need to know whether MOs are sensitive to changes in image quality and correlations in background structure. Therefore, as a proof of principle, in this study human and model observer (MO) performance are compared for the detection of calcification-like objects using different background structures and image quality levels of unprocessed mammography images.

METHOD

Three different phantoms, homogeneous polymethyl methacrylate, BR3D slabs with swirled patterns (CIRS, Norfolk, VA, USA), and a prototype anthropomorphic breast phantom (Institute of Medical Physics and Radiation Protection, Technische Hochschule Mittelhessen, Germany) were imaged on an Amulet Innovality (FujiFilm, Tokyo, Japan) mammographic X-ray unit. Because the complexities of the structures of these three phantoms were different and not optimized to match the characteristics of real mammographic images, image processing was not applied in this study. In addition, real mammograms were acquired on the same system. Regions of interest (ROIs) were extracted from each image. In half of the ROIs, a 0.25-mm diameter disk was inserted at four different contrast levels to represent a calcification-like object. Each ROI was then modified, so four image qualities relevant for mammography were simulated. The signal-present and signal-absent ROIs were evaluated by a non-pre-whitening model observer with eye filter (NPWE) and a channelized Hotelling observer (CHO) using dense difference of Gaussian channels. The ROIs were also evaluated by human observers in a two alternative forced choice experiment. Detectability results for the human and model observer experiments were correlated using a mixed-effect regression model. Threshold disk contrasts for human and predicted human observer performance based on the NPWE MO and CHO were estimated.

RESULTS

Global trends in threshold contrast were similar for the different background structures, but absolute contrast threshold levels differed. Contrast thresholds tended to be lower in ROIs from simple phantoms compared with ROIs from real mammographic images. The correlation between human and model observer performance was not affected by the range of image quality levels studied.

CONCLUSIONS

The correlation between human and model observer performance does not depend on image quality. This is a promising outcome for the use of model observers in image quality analysis and allows for subsequent research toward the development of MO-based quality control procedures and guidelines.

Image processing can cause some malignant soft-tissue lesions to be missed in digital mammography images

AIM

To investigate the effect of image processing on cancer detection in mammography.

METHODS AND MATERIALS

An observer study was performed using 349 digital mammography images of women with normal breasts, calcification clusters, or soft-tissue lesions including 191 subtle cancers. Images underwent two types of processing: FlavourA (standard) and FlavourB (added enhancement). Six observers located features in the breast they suspected to be cancerous (4,188 observations). Data were analysed using jackknife alternative free-response receiver operating characteristic (JAFROC) analysis. Characteristics of the cancers detected with each image processing type were investigated.

RESULTS

For calcifications, the JAFROC figure of merit (FOM) was equal to 0.86 for both types of image processing. For soft-tissue lesions, the JAFROC FOM were better for FlavourA (0.81) than FlavourB (0.78); this difference was significant (p=0.001). Using FlavourA a greater number of cancers of all grades and sizes were detected than with FlavourB. FlavourA improved soft-tissue lesion detection in denser breasts (p=0.04 when volumetric density was over 7.5%) CONCLUSIONS: The detection of malignant soft-tissue lesions (which were primarily invasive) was significantly better with FlavourA than FlavourB image processing. This is despite FlavourB having a higher contrast appearance often preferred by radiologists. It is important that clinical choice of image processing is based on objective measures.

Qualitative Versus Quantitative Mammographic Breast Density Assessment: Applications for the US and Abroad

Mammographic breast density (MBD) has been proven to be an important risk factor for breast cancer and an important determinant of mammographic screening performance. The measurement of density has changed dramatically since its inception. Initial qualitative measurement methods have been found to have limited consistency between readers, and in regards to breast cancer risk. Following the introduction of full-field digital mammography, more sophisticated measurement methodology is now possible. Automated computer-based density measurements can provide consistent, reproducible, and objective results. In this review paper, we describe various methods currently available to assess MBD, and provide a discussion on the clinical utility of such methods for breast cancer screening.

Impact of compressed breast thickness and dose on lesion detectability in digital mammography: FROC study with simulated lesions in real mammograms

PURPOSE

The aim of this work was twofold: (1) to examine whether, with standard automatic exposure control (AEC) settings that maintain pixel values in the detector constant, lesion detectability in clinical images decreases as a function of breast thickness and (2) to verify whether a new AEC setup can increase lesion detectability at larger breast thicknesses.

METHODS

Screening patient images, acquired on two identical digital mammography systems, were collected over a period of 2 yr. Mammograms were acquired under standard AEC conditions (part 1) and subsequently with a new AEC setup (part 2), programmed to use the standard AEC settings for compressed breast thicknesses ≤49 mm, while a relative dose increase was applied above this thickness. The images were divided into four thickness groups: T1 ≤ 29 mm, T2 = 30-49 mm, T3 = 50-69 mm, and T4 ≥ 70 mm, with each thickness group containing 130 randomly selected craniocaudal lesion-free images. Two measures of density were obtained for every image: a BI-RADS score and a map of volumetric breast density created with a software application (VolparaDensity, Matakina, NZ). This information was used to select subsets of four images, containing one image from each thickness group, matched to a (global) BI-RADS score and containing a region with the same (local) volpara volumetric density value. One selected lesion (a microcalcification cluster or a mass) was simulated into each of the four images. This process was repeated so that, for a given thickness group, half the images contained a single lesion and half were lesion-free. The lesion templates created and inserted in groups T3 and T4 for the first part of the study were then inserted into the images of thickness groups T3 and T4 acquired with higher dose settings. Finally, all images were visualized using the ViewDEX software and scored by four radiologists performing a free search study. A statistical jackknife-alternative free-response receiver operating characteristic analysis was applied.

RESULTS

For part 1, the alternative free-response receiver operating characteristic curves for the four readers were 0.80, 0.65, 0.55 and 0.56 in going from T1 to T4, indicating a decrease in detectability with increasing breast thickness. P-values and the 95% confidence interval showed no significant difference for the T3-T4 comparison (p = 0.78) while all the other differences were significant (p < 0.05). Separate analysis of microcalcification clusters presented the same results while for mass detection, the only significant difference came when comparing T1 to the other thickness groups. Comparing the scores of part 1 and part 2, results for the T3 group acquired with the new AEC setup and T3 group at standard AEC doses were significantly different (p = 0.0004), indicating improved detection. For this group a subanalysis for microcalcification detection gave the same results while no significant difference was found for mass detection.

CONCLUSIONS

These data using clinical images confirm results found in simple QA tests for many mammography systems that detectability falls as breast thickness increases. Results obtained with the AEC setup for constant detectability above 49 mm showed an increase in lesion detection with compressed breast thickness, bringing detectability of lesions to the same level.

Can the non-pre-whitening model observer, including aspects of the human visual system, predict human observer performance in mammography?

PURPOSE

In mammography, images are processed prior to display. Current methodologies based on physical image quality measurements are however not designed for the evaluation of processed images. Model observers (MO) might be suitable for this evaluation. The aim of this study was to investigate whether the non-pre-whitening (NPW) MO can be used to predict human observer performance in mammography-like images by including different aspects of the human visual system (HVS).

METHODS

The correlation between human and NPW MO performance has been investigated for the detection of disk shaped objects in simulated white noise (WN) and clustered lumpy backgrounds (CLB), representing quantum noise limited and mammography-like images respectively. The images were scored by the MO and five human observers in a 2-alternative forced choice experiment.

RESULTS

For WN images it was found that the log likelihood ratio (RLR2), which expresses the goodness of fit, was highest (0.44) for the NPW MO without addition of HVS aspects. For CLB the RLR2 improved from 0.46 to 0.65 with addition of HVS aspects. The correlation was affected by object size and background.

CONCLUSIONS

This study shows that by including aspects of the HVS, the performance of the NPW MO can be improved to better predict human observer performance. This demonstrates that the NPW MO has potential for image quality assessment. However, due to the dependencies found in the correlation, the NPW MO can only be used for image quality assessment for a limited range of object sizes and background variability.

Utility of adaptive control processing for the interpretation of digital mammograms

Background Adaptive control processing for mammography (ACM) is a novel program that automatically sets up appropriate image-processing parameters for individual mammograms (MMGs) by analyzing the focal and whole breast histogram. Purpose To investigate whether ACM improves the image contrast of digital MMGs and whether it improves radiologists' diagnostic performance in reading of MMGs. Material and Methods One hundred normal cases for image quality assessment and another 100 cases (50 normal and 50 cancers) for observer performance assessment were enrolled. All mammograms were examined with and without ACM. Five radiologists assessed the intra- and extra-mammary contrast of 100 normal MMGs, and the mean scores of the intra- and extra-mammary contrast were compared between MMGs with and without ACM in both the dense and non-dense group. They classified 100 MMGs into BI-RADS categories 1-5, and were asked to rate the images on a scale of 0 to 100 for the likelihood of the presence of category 3-5 lesions in each breast. Detectability of breast cancer, reading time, and frequency of window adjustment were compared between MMGs with and without ACM. Results ACM improved the intra-mammary contrast in both the dense and non-dense group but degraded extra-mammary contrast in the dense group. There was no significant difference in detectability of breast cancer between MMGs with and without ACM. Frequency of window adjustment without ACM was significantly higher than that with ACM. Reading time without ACM was significantly longer than that with ACM. Conclusion ACM improves the image contrast of MMGs and shortens reading time.

The relationship between cancer detection in mammography and image quality measurements

PURPOSE

To investigate the relationship between image quality measurements and the clinical performance of digital mammographic systems.

METHODS

Mammograms containing subtle malignant non-calcification lesions and simulated malignant calcification clusters were adapted to appear as if acquired by four types of detector. Observers searched for suspicious lesions and gave these a malignancy score. Analysis was undertaken using jackknife alternative free-response receiver operating characteristics weighted figure of merit (FoM). Images of a CDMAM contrast-detail phantom were adapted to appear as if acquired using the same four detectors as the clinical images. The resultant threshold gold thicknesses were compared to the FoMs using a linear regression model and an F-test was used to find if the gradient of the relationship was significantly non-zero.

RESULTS

The detectors with the best image quality measurement also had the highest FoM values. The gradient of the inverse relationship between FoMs and threshold gold thickness for the 0.25mm diameter disk was significantly different from zero for calcification clusters (p=0.027), but not for non-calcification lesions (p=0.11). Systems performing just above the minimum image quality level set in the European Guidelines for Quality Assurance in Breast Cancer Screening and Diagnosis resulted in reduced cancer detection rates compared to systems performing at the achievable level.

CONCLUSIONS

The clinical effectiveness of mammography for the task of detecting calcification clusters was found to be linked to image quality assessment using the CDMAM phantom. The European Guidelines should be reviewed as the current minimum image quality standards may be too low.

Comparison of a discrete wavelet transform method and a modified undecimated discrete wavelet transform method for denoising of mammograms

The purpose of this study was to evaluate the performance of a conventional discrete wavelet transform (DWT) method and a modified undecimated discrete wavelet transform (M-UDWT) method applied to mammographic image denoising. Mutual information, mean square error, and signal to noise ratio were used as image quality measures of images processed by the two methods. We examined the performance of the two methods with visual perceptual evaluation. A two-tailed F test was used to measure statistical significance. The difference between the M-UDWT processed images and the conventional DWT-method processed images was statistically significant (P<0.01). The authors confirmed the superiority and effectiveness of the M-UDWT method. The results of this study suggest the M-UDWT method may provide better image quality as compared to the conventional DWT.

Application of off-line image processing for optimization in chest computed radiography using a low cost system

The objective of this study was to improve the visibility of anatomical details by applying off‐line postimage processing in chest computed radiography (CR). Four spatial domain‐based external image processing techniques were developed by using MATLAB software version 7.0.0.19920 (R14) and image processing tools. The developed techniques were implemented to sample images and their visual appearances confirmed by two consultant radiologists to be clinically adequate. The techniques were then applied to 200 chest clinical images and randomized with other 100 images previously processed online. These 300 images were presented to three experienced radiologists for image quality assessment using standard quality criteria. The mean and ranges of the average scores for three radiologists were characterized for each of the developed technique and imaging system. The Mann‐Whitney U‐test was used to test the difference of details visibility between the images processed using each of the developed techniques and the corresponding images processed using default algorithms. The results show that the visibility of anatomical features improved significantly (0.005≤p≤0.02) with combinations of intensity values adjustment and/or spatial linear filtering techniques for images acquired using 60≤kVp≤70. However, there was no improvement for images acquired using 102≤kVp≤107 (0.127≤p≤0.48). In conclusion, the use of external image processing for optimization can be effective in chest CR, but should be implemented in consultations with the radiologists.

PACS number: 87.59.−e, 87.59.−B, 87.59.−bd

Should processed or raw image data be used in mammographic image quality analyses? A comparative study of three full-field digital mammography systems

The purpose of this study is to compare a number of measured image quality parameters using processed and unprocessed or raw images in two full-field direct digital units and one computed radiography mammography system. This study shows that the difference between raw and processed image data is system specific. The results have shown that there are no significant differences between raw and processed data in the mean threshold contrast values using the contrast-detail mammography phantom in all the systems investigated; however, these results cannot be generalised to all available systems. Notable differences were noted in contrast-to-noise ratios and in other tests including: response function, modulation transfer function , noise equivalent quanta, normalised noise power spectra and detective quantum efficiency as specified in IEC 62220-1-2. Consequently, the authors strongly recommend the use of raw data for all image quality analyses in digital mammography.

A motion-compensated image filter for low-dose fluoroscopy in a real-time tumor-tracking radiotherapy system

In the real-time tumor-tracking radiotherapy system, a surrogate fiducial marker inserted in or near the tumor is detected by fluoroscopy to realize respiratory-gated radiotherapy. The imaging dose caused by fluoroscopy should be minimized. In this work, an image processing technique is proposed for tracing a moving marker in low-dose imaging. The proposed tracking technique is a combination of a motion-compensated recursive filter and template pattern matching. The proposed image filter can reduce motion artifacts resulting from the recursive process based on the determination of the region of interest for the next frame according to the current marker position in the fluoroscopic images. The effectiveness of the proposed technique and the expected clinical benefit were examined by phantom experimental studies with actual tumor trajectories generated from clinical patient data. It was demonstrated that the marker motion could be traced in low-dose imaging by applying the proposed algorithm with acceptable registration error and high pattern recognition score in all trajectories, although some trajectories were not able to be tracked with the conventional spatial filters or without image filters. The positional accuracy is expected to be kept within ±2 mm. The total computation time required to determine the marker position is a few milliseconds. The proposed image processing technique is applicable for imaging dose reduction.

Wavelet-based 3D reconstruction of microcalcification clusters from two mammographic views: new evidence that fractal tumors are malignant and Euclidean tumors are benign

The 2D Wavelet-Transform Modulus Maxima (WTMM) method was used to detect microcalcifications (MC) in human breast tissue seen in mammograms and to characterize the fractal geometry of benign and malignant MC clusters. This was done in the context of a preliminary analysis of a small dataset, via a novel way to partition the wavelet-transform space-scale skeleton. For the first time, the estimated 3D fractal structure of a breast lesion was inferred by pairing the information from two separate 2D projected mammographic views of the same breast, i.e. the cranial-caudal (CC) and mediolateral-oblique (MLO) views. As a novelty, we define the “CC-MLO fractal dimension plot”, where a “fractal zone” and “Euclidean zones” (non-fractal) are defined. 118 images (59 cases, 25 malignant and 34 benign) obtained from a digital databank of mammograms with known radiologist diagnostics were analyzed to determine which cases would be plotted in the fractal zone and which cases would fall in the Euclidean zones. 92% of malignant breast lesions studied (23 out of 25 cases) were in the fractal zone while 88% of the benign lesions were in the Euclidean zones (30 out of 34 cases). Furthermore, a Bayesian statistical analysis shows that, with 95% credibility, the probability that fractal breast lesions are malignant is between 74% and 98%. Alternatively, with 95% credibility, the probability that Euclidean breast lesions are benign is between 76% and 96%. These results support the notion that the fractal structure of malignant tumors is more likely to be associated with an invasive behavior into the surrounding tissue compared to the less invasive, Euclidean structure of benign tumors. Finally, based on indirect 3D reconstructions from the 2D views, we conjecture that all breast tumors considered in this study, benign and malignant, fractal or Euclidean, restrict their growth to 2-dimensional manifolds within the breast tissue.

The effect of image processing on the detection of cancers in digital mammography

OBJECTIVE. The objective of our study was to investigate the effect of image processing on the detection of cancers in digital mammography images. MATERIALS AND METHODS. Two hundred seventy pairs of breast images (both breasts, one view) were collected from eight systems using Hologic amorphous selenium detectors: 80 image pairs showed breasts containing subtle malignant masses; 30 image pairs, biopsy-proven benign lesions; 80 image pairs, simulated calcification clusters; and 80 image pairs, no cancer (normal). The 270 image pairs were processed with three types of image processing: standard (full enhancement), low contrast (intermediate enhancement), and pseudo-film-screen (no enhancement). Seven experienced observers inspected the images, locating and rating regions they suspected to be cancer for likelihood of malignancy. The results were analyzed using a jackknife-alternative free-response receiver operating characteristic (JAFROC) analysis. RESULTS. The detection of calcification clusters was significantly affected by the type of image processing: The JAFROC figure of merit (FOM) decreased from 0.65 with standard image processing to 0.63 with low-contrast image processing (p = 0.04) and from 0.65 with standard image processing to 0.61 with film-screen image processing (p = 0.0005). The detection of noncalcification cancers was not significantly different among the image-processing types investigated (p > 0.40). CONCLUSION. These results suggest that image processing has a significant impact on the detection of calcification clusters in digital mammography. For the three image-processing versions and the system investigated, standard image processing was optimal for the detection of calcification clusters. The effect on cancer detection should be considered when selecting the type of image processing in the future.

The simulation of 3D mass models in 2D digital mammography and breast tomosynthesis

PURPOSE

This work proposes a new method of building 3D breast mass models with different morphological shapes and describes the validation of the realism of their appearance after simulation into 2D digital mammograms and breast tomosynthesis images.

METHODS

Twenty-five contrast enhanced MRI breast lesions were collected and each mass was manually segmented in the three orthogonal views: sagittal, coronal, and transversal. The segmented models were combined, resampled to have isotropic voxel sizes, triangularly meshed, and scaled to different sizes. These masses were referred to as nonspiculated masses and were then used as nuclei onto which spicules were grown with an iterative branching algorithm forming a total of 30 spiculated masses. These 55 mass models were projected into 2D projection images to obtain mammograms after image processing and into tomographic sequences of projection images, which were then reconstructed to form 3D tomosynthesis datasets. The realism of the appearance of these mass models was assessed by five radiologists via receiver operating characteristic (ROC) analysis when compared to 54 real masses. All lesions were also given a breast imaging reporting and data system (BIRADS) score. The data sets of 2D mammography and tomosynthesis were read separately. The Kendall's coefficient of concordance was used for the interrater observer agreement assessment for the BIRADS scores per modality. Further paired analysis, using the Wilcoxon signed rank test, of the BIRADS assessment between 2D and tomosynthesis was separately performed for the real masses and for the simulated masses.

RESULTS

The area under the ROC curves, averaged over all observers, was 0.54 (95% confidence interval [0.50, 0.66]) for the 2D study, and 0.67 (95% confidence interval [0.55, 0.79]) for the tomosynthesis study. According to the BIRADS scores, the nonspiculated and the spiculated masses varied in their degrees of malignancy from normal (BIRADS 1) to highly suggestive for malignancy (BIRADS 5) indicating the required variety of shapes and margins of these models. The assessment of the BIRADS scores for all observers indicated good agreement based on Kendall's coefficient for both the 2D and the tomosynthesis evaluations. The paired analysis of the BIRADS scores between 2D and tomosynthesis for each observer revealed consistent behavior for the real and simulated masses.

CONCLUSIONS

A database of 3D mass models, with variety of shapes and margins, was validated for the realism of their appearance for 2D digital mammography and for breast tomosynthesis. This database is suitable for use in future observer performance studies whether in virtual clinical trials or in patient images with simulated lesions.

A modified undecimated discrete wavelet transform based approach to mammographic image denoising

In this work, the authors present an effective denoising method to attempt reducing the noise in mammographic images. The method is based on using hierarchical correlation of the coefficients of discrete stationary wavelet transforms. The features of the proposed technique include iterative use of undecimated multi-directional wavelet transforms at adjacent scales. To validate the proposed method, computer simulations were conducted, followed by its applications to clinical mammograms. Mutual information originating from information theory was used as an evaluation measure for selection of an optimal wavelet basis function. We examined the performance of the proposed method by comparing it with the conventional undecimated discrete wavelet transform (UDWT) method in terms of processing time-consuming and image quality. Our results showed that with the use of the proposed method the computation time can be reduced to approximately 1/10 of the conventional UDWT method consumed. The results of visual assessment indicated that the images processed with the proposed UDWT method showed statistically significant superior image quality over those processed with the conventional UDWT method. Our research results demonstrate the superiority and effectiveness of the proposed approach.

Validation of simulation of calcifications for observer studies in digital mammography

Studies using simulated calcifications can be performed to measure the effect of different imaging factors on calcification detection in digital mammography. The simulated calcifications must be inserted into clinical images with realistic contrast and sharpness. MoCa is a program which modifies the contrast and sharpness of simulated calcification clusters extracted from images of mastectomy specimens acquired on a digital specimen cabinet at high magnification for insertion into clinical mammography images. This work determines whether the use of MoCa results in simulated calcifications with the correct contrast and sharpness. Aluminium foils (thickness 0.1-0.4 mm) and 1.60 µm thick gold discs (diameter 0.13-0.8 mm) on 0.5 mm aluminium were imaged with a range of thicknesses of polymethyl methacrylate (PMMA) using an amorphous selenium direct digital (DR) system and a powder phosphor computed radiography (CR) system (real images). Simulated images of the tests objects were also generated using MoCa. The contrast of the aluminium squares and the degradation of the contrast of the gold discs as a function of disc diameter were compared in the real and simulated images. The average ratios of the simulated-to-real aluminium contrasts over all aluminium and PMMA thicknesses were 1.03 ± 0.04 (two standard errors in the mean) and 0.99 ± 0.03 for the DR and CR systems, respectively. The ratio of the simulated-to-real degradations of contrast averaged over all disc diameters and PMMA thicknesses were 1.007 ± 0.008 and 1.002 ± 0.013 for DR and CR, respectively. The use of MoCa was accurate within the experimental errors.

Comparison of the x-ray attenuation properties of breast calcifications, aluminium, hydroxyapatite and calcium oxalate

Aluminium is often used as a substitute material for calcifications in phantom measurements in mammography. Additionally, calcium oxalate, hydroxyapatite and aluminium are used in simulation studies. This assumes that these materials have similar attenuation properties to calcification, and this assumption is examined in this work. Sliced mastectomy samples containing calcification were imaged at ×5 magnification using a digital specimen cabinet. Images of the individual calcifications were extracted, and the diameter and contrast of each calculated. The thicknesses of aluminium required to achieve the same contrast as each calcification when imaged under the same conditions were calculated using measurements of the contrast of aluminium foils. As hydroxyapatite and calcium oxalate are also used to simulate calcifications, the equivalent aluminium thicknesses of these materials were also calculated using tabulated attenuation coefficients. On average the equivalent aluminium thickness was 0.85 times the calcification diameter. For calcium oxalate and hydroxyapatite, the equivalent aluminium thicknesses were 1.01 and 2.19 times the thickness of these materials respectively. Aluminium and calcium oxalate are suitable substitute materials for calcifications. Hydroxyapatite is much more attenuating than the calcifications and aluminium. Using solid hydroxyapatite as a substitute for calcification of the same size would lead to excessive contrast in the mammographic image.

Correlation of free-response and receiver-operating-characteristic area-under-the-curve estimates: results from independently conducted FROC∕ROC studies in mammography

PURPOSE

From independently conducted free-response receiver operating characteristic (FROC) and receiver operating characteristic (ROC) experiments, to study fixed-reader associations between three estimators: the area under the alternative FROC (AFROC) curve computed from FROC data, the area under the ROC curve computed from FROC highest rating data, and the area under the ROC curve computed from confidence-of-disease ratings.

METHODS

Two hundred mammograms, 100 of which were abnormal, were processed by two image-processing algorithms and interpreted by four radiologists under the FROC paradigm. From the FROC data, inferred-ROC data were derived, using the highest rating assumption. Eighteen months afterwards, the images were interpreted by the same radiologists under the conventional ROC paradigm; conventional-ROC data (in contrast to inferred-ROC data) were obtained. FROC and ROC (inferred, conventional) data were analyzed using the nonparametric area-under-the-curve (AUC), (AFROC and ROC curve, respectively). Pearson correlation was used to quantify the degree of association between the modality-specific AUC indices and standard errors were computed using the bootstrap-after-bootstrap method. The magnitude of the correlations was assessed by comparison with computed Obuchowski-Rockette fixed reader correlations.

RESULTS

Average Pearson correlations (with 95% confidence intervals in square brackets) were: Corr(FROC, inferred ROC) = 0.76[0.64, 0.84] > Corr(inferred ROC, conventional ROC) = 0.40[0.18, 0.58] > Corr (FROC, conventional ROC) = 0.32[0.16, 0.46].

CONCLUSIONS

Correlation between FROC and inferred-ROC data AUC estimates was high. Correlation between inferred- and conventional-ROC AUC was similar to the correlation between two modalities for a single reader using one estimation method, suggesting that the highest rating assumption might be questionable.

Application of detector precision characteristics and histogram packing for compression of biological fluorescence micrographs

Modern applications of biological microscopy such as high-content screening (HCS), 4D imaging, and multispectral imaging may involve collection of thousands of images in every experiment making efficient image-compression techniques necessary. Reversible compression algorithms, when used with biological micrographs, provide only a moderate compression ratio, while irreversible techniques obtain better ratios at the cost of removing some information from images and introducing artifacts. We construct a model of noise, which is a function of signal in the imaging system. In the next step insignificant intensity levels are discarded using intensity binning. The resultant images, characterized by sparse intensity histograms, are coded reversibly. We evaluate compression efficiency of combined reversible coding and intensity depth-reduction using single-channel 12-bit light micrographs of several subcellular structures. We apply local and global measures of intensity distribution to estimate maximum distortions introduced by the proposed algorithm. We demonstrate that the algorithm provides efficient compression and does not introduce significant changes to biological micrographs. The algorithm preserves information content of these images and therefore offers better fidelity than standard irreversible compression method JPEG2000.

Effect of image quality on calcification detection in digital mammography

PURPOSE

This study aims to investigate if microcalcification detection varies significantly when mammographic images are acquired using different image qualities, including: different detectors, dose levels, and different image processing algorithms. An additional aim was to determine how the standard European method of measuring image quality using threshold gold thickness measured with a CDMAM phantom and the associated limits in current EU guidelines relate to calcification detection.

METHODS

One hundred and sixty two normal breast images were acquired on an amorphous selenium direct digital (DR) system. Microcalcification clusters extracted from magnified images of slices of mastectomies were electronically inserted into half of the images. The calcification clusters had a subtle appearance. All images were adjusted using a validated mathematical method to simulate the appearance of images from a computed radiography (CR) imaging system at the same dose, from both systems at half this dose, and from the DR system at quarter this dose. The original 162 images were processed with both Hologic and Agfa (Musica-2) image processing. All other image qualities were processed with Agfa (Musica-2) image processing only. Seven experienced observers marked and rated any identified suspicious regions. Free response operating characteristic (FROC) and ROC analyses were performed on the data. The lesion sensitivity at a nonlesion localization fraction (NLF) of 0.1 was also calculated. Images of the CDMAM mammographic test phantom were acquired using the automatic setting on the DR system. These images were modified to the additional image qualities used in the observer study. The images were analyzed using automated software. In order to assess the relationship between threshold gold thickness and calcification detection a power law was fitted to the data.

RESULTS

There was a significant reduction in calcification detection using CR compared with DR: the alternative FROC (AFROC) area decreased from 0.84 to 0.63 and the ROC area decreased from 0.91 to 0.79 (p < 0.0001). This corresponded to a 30% drop in lesion sensitivity at a NLF equal to 0.1. Detection was also sensitive to the dose used. There was no significant difference in detection between the two image processing algorithms used (p > 0.05). It was additionally found that lower threshold gold thickness from CDMAM analysis implied better cluster detection. The measured threshold gold thickness passed the acceptable limit set in the EU standards for all image qualities except half dose CR. However, calcification detection varied significantly between image qualities. This suggests that the current EU guidelines may need revising.

CONCLUSIONS

Microcalcification detection was found to be sensitive to detector and dose used. Standard measurements of image quality were a good predictor of microcalcification cluster detection.

Comparison of the clinical performance of three digital mammography systems in a breast cancer screening programme

This study compares the clinical performance of three digital mammography system types in a breast cancer screening programme. 28 digital mammography systems from three different vendors were included in the study. The retrospective analysis included 238 182 screening examinations of females aged between 50 and 64 years over a 3-year period. All images were double read and assigned a result according to a 5-point rating scale to indicate the probability of cancer. Females with a positive result were recalled for further assessment imaging and biopsy if necessary. Clinical performance in terms of cancer detection rate was analysed and the results presented. No statistically significant difference was found between the three different mammography systems in a population-based screening programme, in terms of the overall cancer detection rate or in the detection of invasive cancer and ductal carcinoma in situ. This was shown in both prevalent and subsequent screening examination categories. The results demonstrate comparable cancer detection performance for the three imaging system types operational in the screening programme.

Comparison of visual grading and free-response ROC analyses for assessment of image-processing algorithms in digital mammography

OBJECTIVE

To compare two methods for assessment of image-processing algorithms in digital mammography: free-response receiver operating characteristic (FROC) for the specific task of microcalcification detection and visual grading analysis (VGA).

METHODS

The FROC study was conducted prior to the VGA study reported here. 200 raw data files of low breast density (Breast Imaging-Reporting and Data System I-II) mammograms (Novation DR, Siemens, Germany)-100 of which abnormal-were processed by four image-processing algorithms: Raffaello (IMS, Bologna, Italy), Sigmoid (Sectra, Linköping, Sweden), and OpView v. 2 and v. 1 (Siemens, Erlangen, Germany). Four radiologists assessed the mammograms for the detection of microcalcifications. 8 months after the FROC study, a subset (200) of the 800 images was reinterpreted by the same radiologists, using the VGA methodology in a side-by-side approach. The VGA grading was based on noise, saturation, contrast, sharpness and confidence with the image in terms of normal structures. Ordinal logistic regression was applied; OpView v. 1 was the reference processing algorithm.

RESULTS

In the FROC study all algorithms performed better than OpView v. 1. From the current VGA study and for confidence with the image, Sigmoid and Raffaello were significantly worse (p<0.001) than OpView v. 1; OpView v. 2 was significantly better (p=0.01). For the image quality criteria, results were mixed; Raffaello and Sigmoid for example were better than OpView v. 1 for sharpness and contrast (although not always significantly).

CONCLUSION

VGA and FROC discordant results should be attributed to the different clinical task addressed.

ADVANCES IN KNOWLEDGE

The method to use for image-processing assessment depends on the clinical task tested.

Increase in perceived case suspiciousness due to local contrast optimisation in digital screening mammography

Objectives

To determine the influence of local contrast optimisation on diagnostic accuracy and perceived suspiciousness of digital screening mammograms.

Methods

Data were collected from a screening region in the Netherlands and consisted of 263 digital screening cases (153 recalled,110 normal). Each case was available twice, once processed with a tissue equalisation (TE) algorithm and once with local contrast optimisation (PV). All cases had digitised previous mammograms. For both algorithms, the probability of malignancy of each finding was scored independently by six screening radiologists. Perceived case suspiciousness was defined as the highest probability of malignancy of all findings of a radiologist within a case. Differences in diagnostic accuracy of the processing algorithms were analysed by comparing the areas under the receiver operating characteristic curves (A_z). Differences in perceived case suspiciousness were analysed using sign tests.

Results

There was no significant difference in A_z (TE: 0.909, PV 0.917, P = 0.46). For all radiologists, perceived case suspiciousness using PV was higher than using TE more often than vice versa (ratio: 1.14–2.12). This was significant (P <0.0083) for four radiologists.

Conclusions

Optimisation of local contrast by image processing may increase perceived case suspiciousness, while diagnostic accuracy may remain similar.

Key Points

• Variations among different image processing algorithms for digital screening mammography are large.

• Current algorithms still aim for optimal local contrast with a low dynamic range.

• Although optimisation of contrast may increase sensitivity, diagnostic accuracy is probably unchanged.

• Increased local contrast may render both normal and abnormal structures more conspicuous.

The basics and implementation of digital mammography

Current day digital mammography acquisition units have already been shown to be equal or better than screen film systems for the detection and classification of breast lesions. The optimal multimodality breast imaging diagnostic workstations and connectivity to existing picture and archiving communication systems and information systems is still a work in progress, but with more and more facilities transitioning to digital imaging it is only a matter of time until these hurdles are overcome.

A technique optimization protocol and the potential for dose reduction in digital mammography

Digital mammography requires revisiting techniques that have been optimized for prior screen/film mammography systems. The objective of the study was to determine optimized radiographic technique for a digital mammography system and demonstrate the potential for dose reduction in comparison to the clinically established techniques based on screen- film. An objective figure of merit (FOM) was employed to evaluate a direct-conversion amorphous selenium (a-Se) FFDM system (Siemens Mammomat Novation(DR), Siemens AG Medical Solutions, Erlangen, Germany) and was derived from the quotient of the squared signal-difference-to-noise ratio to mean glandular dose, for various combinations of technique factors and breast phantom configurations including kilovoltage settings (23-35 kVp), target/filter combinations (Mo-Mo and W-Rh), breast-equivalent plastic in various thicknesses (2-8 cm) and densities (100% adipose, 50% adipose/50% glandular, and 100% glandular), and simulated mass and calcification lesions. When using a W-Rh spectrum, the optimized FOM results for the simulated mass and calcification lesions showed highly consistent trends with kVp for each combination of breast density and thickness. The optimized kVp ranged from 26 kVp for 2 cm 100% adipose breasts to 30 kVp for 8 cm 100% glandular breasts. The use of the optimized W-Rh technique compared to standard Mo-Mo techniques provided dose savings ranging from 9% for 2 cm thick, 100% adipose breasts, to 63% for 6 cm thick, 100% glandular breasts, and for breasts with a 50% adipose/50% glandular composition, from 12% for 2 cm thick breasts up to 57% for 8 cm thick breasts.