Comparison of eight different digital chest radiography systems: variation in detection of simulated chest disease

Image Quality Evaluation of a Digital Radiography System Made in Thailand

Background

The National Science and Technology Development Agency (NSTDA) in Thailand researched and prototyped digital radiography systems under the brand name BodiiRay aiming for sustainable development and affordability of medical imaging technology. The image restoration and enhancement were implemented for the systems.

Purpose

The image quality of the systems was evaluated using images from phantoms and from healthy volunteers.

Methods

The survey phantom images from BodiiRay and other two commercial systems using the exposure settings for the chest, the abdomen, and the extremity were evaluated by three experience observers in terms of the high-contrast image resolution, the low-contrast image detectability, and the grayscale differentiation. The volunteer images of the chests, the abdomens, and the extremities from BodiiRay were evaluated by three specialized radiologists based on visual grading on 5-point scaled questionnaires for the anatomy visibility, the image quality satisfaction, and the diagnosis confidence in using the images.

Results

BodiiRay phantom results were similar to those from the commercial systems. The overall performance averaged across the exposure settings showed that BodiiRay was slightly better than Fujifilm FDR Go in the low-contrast detectability (p = 0.033) and in the grayscale differentiation (p = 0.004). It was also slightly better than Siemens YSIO Max in the high-contrast resolution (p = 0.018). The images of chest, pelvis, and hand phantoms illustrated comparable visual quality. For volunteer images, the percentage of the images scored ≥4 ranged from 61% to 99%, 23% to 92%, and 96% to 99% for the chest, abdomen, and extremity images, respectively. The average score ranged from 3.63 to 4.46, 3.18 to 4.21, and 4.41 to 4.51 for the chest, abdomen, and extremity images, respectively.

Conclusion

The phantom image results showed the comparability of these systems. The clinical evaluation showed BodiiRay images provided sufficient image qualities for digital radiography of these body parts.

Introduction of a New Parameter for Evaluation of Digital Radiography System Performance

Background

The aim of this study was to compare the image quality and radiation doses in various digital radiography systems using contrast-detail radiography (CDRAD) phantom.

Methods

The image quality and radiation dose for seven different digital radiography systems were compared using the CDRAD phantom. Incident air kerma (IAK) values were measured for certain exposure settings in all digital radiography systems. The images from the CDRAD phantom were evaluated by three observers. The results were displayed in the form of a contrast-detail (CD) curve. In addition, the inverse image quality figure (IQFinv)-to-IAK ratios were used for quantitative comparison of different digital radiography system performance.

Results

Results of this study showed that the CD curves cannot be suitable criterion for determining the performance of digital radiography systems. For this reason, IQFinv-to-radiation dose (IAK) ratios in a fixed radiation condition were used. The highest performance in terms of producing high-quality images and low radiation dose was related to X-ray unit 1 and the lowest performance was for X-ray unit 5.

Conclusion

The ratio of IQFinv to IAK for performance evaluation of digital radiography systems is an innovation of this study. A digital radiography system with a higher IQFinv-to-IAK ratio is associated with lower patient dose and better image quality. Therefore, it is recommended to equip the new imaging centers with the systems that have higher IQFinv-to-IAK ratios.

Neonatal chest radiography: Influence of standard clinical protocols and radiographic equipment on pathology visibility and radiation dose using a neonatal chest phantom

INTRODUCTION

Little is known about the variations in pathology visibility (PV) and their corresponding radiation dose values for neonatal chest radiography, between and within hospitals. Large variations in PV could influence the diagnostic outcome and the variations in radiation dose could affect the risk to patients. The aim of this study is to compare the PV and radiation dose for standard neonatal chest radiography protocols among a series of public hospitals.

METHODS

A Gammex 610 neonatal chest phantom was used to simulate the chest region of neonates. Radiographic acquisitions were conducted on 17 X-ray machines located in eight hospitals, utilising their current neonatal chest radiography protocols. Six qualified radiographers assessed PV visually using a relative visual grading analysis (VGA). Signal to noise ratios (SNR) and contrast to noise ratios (CNR) were measured as a measure of image quality (IQ). Incident air kerma (IAK) was measured using a solid-state dosimeter.

RESULTS

PV and radiation dose varied substantially between and within hospitals. For PV, the mean (range) VGA scores, between and within the hospitals, were 2.69 (2.00-3.50) and 2.73 (2.33-3.33), respectively. For IAK, the mean (range), between and within the hospitals, were 24.45 (8.11-49.94) μGy and 34.86 (22.26-49.94) μGy, respectively.

CONCLUSION

Between and within participating hospitals there was wide variation in the visibility of simulated pathology and radiation dose (IAK).

IMPLICATIONS FOR PRACTICE

X-ray units with lower PV and higher doses require optimisation of their standard clinical protocols. Institutions which can offer acceptable levels of PV but with lower radiation doses should help facilitate national optimisation processes.

Image quality and dose differences caused by vendor-specific image processing of neonatal radiographs

BACKGROUND

Image processing plays an important role in optimizing image quality and radiation dose in projection radiography. Unfortunately commercial algorithms are black boxes that are often left at or near vendor default settings rather than being optimized.

OBJECTIVE

We hypothesize that different commercial image-processing systems, when left at or near default settings, create significant differences in image quality. We further hypothesize that image-quality differences can be exploited to produce images of equivalent quality but lower radiation dose.

MATERIALS AND METHODS

We used a portable radiography system to acquire images on a neonatal chest phantom and recorded the entrance surface air kerma (ESAK). We applied two image-processing systems (Optima XR220amx, by GE Healthcare, Waukesha, WI; and MUSICA(2) by Agfa HealthCare, Mortsel, Belgium) to the images. Seven observers (attending pediatric radiologists and radiology residents) independently assessed image quality using two methods: rating and matching. Image-quality ratings were independently assessed by each observer on a 10-point scale. Matching consisted of each observer matching GE-processed images and Agfa-processed images with equivalent image quality. A total of 210 rating tasks and 42 matching tasks were performed and effective dose was estimated.

RESULTS

Median Agfa-processed image-quality ratings were higher than GE-processed ratings. Non-diagnostic ratings were seen over a wider range of doses for GE-processed images than for Agfa-processed images. During matching tasks, observers matched image quality between GE-processed images and Agfa-processed images acquired at a lower effective dose (11 ± 9 μSv; P < 0.0001).

CONCLUSION

Image-processing methods significantly impact perceived image quality. These image-quality differences can be exploited to alter protocols and produce images of equivalent image quality but lower doses. Those purchasing projection radiography systems or third-party image-processing software should be aware that image processing can significantly impact image quality when settings are left near default values.

Automated characterization of perceptual quality of clinical chest radiographs: validation and calibration to observer preference

PURPOSE

The authors previously proposed an image-based technique [Y. Lin et al. Med. Phys. 39, 7019-7031 (2012)] to assess the perceptual quality of clinical chest radiographs. In this study, an observer study was designed and conducted to validate the output of the program against rankings by expert radiologists and to establish the ranges of the output values that reflect the acceptable image appearance so the program output can be used for image quality optimization and tracking.

METHODS

Using an IRB-approved protocol, 2500 clinical chest radiographs (PA/AP) were collected from our clinical operation. The images were processed through our perceptual quality assessment program to measure their appearance in terms of ten metrics of perceptual image quality: lung gray level, lung detail, lung noise, rib-lung contrast, rib sharpness, mediastinum detail, mediastinum noise, mediastinum alignment, subdiaphragm-lung contrast, and subdiaphragm area. From the results, for each targeted appearance attribute/metric, 18 images were selected such that the images presented a relatively constant appearance with respect to all metrics except the targeted one. The images were then incorporated into a graphical user interface, which displayed them into three panels of six in a random order. Using a DICOM calibrated diagnostic display workstation and under low ambient lighting conditions, each of five participating attending chest radiologists was tasked to spatially order the images based only on the targeted appearance attribute regardless of the other qualities. Once ordered, the observer also indicated the range of image appearances that he/she considered clinically acceptable. The observer data were analyzed in terms of the correlations between the observer and algorithmic rankings and interobserver variability. An observer-averaged acceptable image appearance was also statistically derived for each quality attribute based on the collected individual acceptable ranges.

RESULTS

The observer study indicated that, for each image quality attribute, the averaged observer ranking strongly correlated with the algorithmic ranking (linear correlation coefficient R > 0.92), with highest correlation (R = 1) for lung gray level and the lowest (R = 0.92) for mediastinum noise. There was a strong concordance between the observers in terms of their rankings (i.e., Kendall's tau agreement > 0.84). The observers also generally indicated similar tolerance and preference levels in terms of acceptable ranges, as 85% of the values were close to the overall tolerance or preference levels and the differences were smaller than 0.15.

CONCLUSIONS

The observer study indicates that the previously proposed technique provides a robust reflection of the perceptual image quality in clinical images. The results established the range of algorithmic outputs for each metric that can be used to quantitatively assess and qualify the appearance quality of clinical chest radiographs.

Utility of digital radiography for the screening of pneumoconiosis as compared to analog radiography: radiation dose, image quality, and pneumoconiosis classification

The purpose of this study was to compare digital radiography (DR) and analog radiography (AR) for the screening of pneumoconiosis with respect to radiation dose, image quality, and pneumoconiosis classification. DR was performed on 50 subjects who were enrolled for an examination of pneumoconiosis (Digital Diagnost™, Philips, Netherlands), and AR (MXO-15B, Toshiba, Japan) was performed the same day after the study was approved by the Institutional Review Board and written informed consent was obtained from all subjects. Entrance surface doses (ESDs) of DR and AR were measured using a glass dosimeter attached to a Rando human phantom (Alderson Co., U.S.) under exposure conditions commonly used in clinical practice in Korea. Visibilities on all images were evaluated using a 5-point scale by four chest radiologists using a modified form of the European Chest Guidelines (EUR 16260). All the images were classified using the ILO's guidelines by referencing standard analog radiographs. ESDs of DR were significantly lower than those of AR (0.15 mGy vs. 0.21 mGy, p < 0.05). All anatomic structures were significantly more visible by DR images (p < 0.0001), especially the left main bronchus, ribs, and thoracic spine. Body mass index did not correlate with anatomic structure visibility by DR (r = -0.029, p = 0.842) or AR images (r = -0.076, p = 0.602). Overall intra- and inter-reader agreements for DR images were significantly higher than for AR images. DR offers improved image quality with a significant reduction of up to 23.6% in radiation dose and more accurate pneumoconiosis classification than AR.

[Correlation between basic imaging properties and subjective evaluations of two digital radiographic X-ray systems based on direct-conversion flat panel detector]

The purpose of this study was to examine the correlation between the basic imaging properties of two digital radiographic X-ray systems with a direct conversion flat-panel detector and their image qualities, which were evaluated by the observer in hard copy and soft copy studies. The subjective image quality was evaluated and compared in terms of the low-contrast detectability and image sharpness in the two digital radiographic X-ray systems. We applied the radiographs of a contrast detail phantom to the evaluation of low-contrast detectability and analyzed the contrast detail diagrams. Finally, low-contrast detectability was evaluated by the image quality figure (IQF) calculated from the contrast detail diagrams. Also, the subjective image sharpness of human dry bones of two systems was examined and evaluated by the normalized-rank method. The results indicated that System A tended to provide superior subjective image quality compared to System B in both observer studies. We also found high correlations between IQFs and basic imaging properties, such as the noise power spectrum (NPS) and the noise equivalent quantum (NEQ). In conclusion, the low-contrast detectability of the two digital radiographic X-ray systems with a direct conversion flat-panel detector corresponded to the NPS and the NEQ in both outputs (soft copy and hard copy). On the other hand, the subjective image sharpness of human dry bones was affected by their noise properties.

Dose and perceived image quality in chest radiography

Chest radiography is the most commonly performed diagnostic X-ray examination. The radiation dose to the patient for this examination is relatively low but because of its frequent use, the contribution to the collective dose is considerable. Consequently, optimization of dose and image quality offers a challenging area of research. In this article studies on dose reduction, different detector technologies, optimization of image acquisition and new technical developments in image acquisition and post processing will be reviewed. Studies indicate that dose reduction in PA chest images to at least 50% of commonly applied dose levels does not affect diagnosis in the lung fields; however, dose reduction in the mediastinum, upper abdomen and retrocardiac areas appears to directly deteriorate diagnosis. In addition to patient dose, also the design of the various digital detectors seems to have an effect on image quality. With respect to image acquisition, studies showed that using a lower tube voltage improves visibility of anatomical structures and lesions in digital chest radiographs but also increases the disturbing appearance of ribs. New techniques that are currently being evaluated are dual energy, tomosynthesis, temporal subtraction and rib suppression. These technologies may improve diagnostic chest X-ray further. They may for example reduce the negative influence of over projection of ribs, referred to as anatomic noise. In chest X-ray this type of noise may be the dominating factor in the detection of nodules. In conclusion, optimization and new developments will enlarge the value of chest X-ray as a mainstay in the diagnosis of chest diseases.

Slot-scan digital radiography of the lower extremities: a comparison to computed radiography with respect to image quality and radiation dose

Objective

To compare the slot-scan digital radiography (SSDR) of the lower extremity region and the computed radiography (CR) method with respect to the image quality and radiation exposure.

Materials and Methods

We enrolled 54 patients who underwent both the SSDR and CR of the lower extremities. The study evaluated and statistically compared the image quality of four features (outer cortex, inner cortex, trabeculae and intermuscular fat) at six different levels (pelvis, hip, femur, knee, tibia and ankle) between each method. The image quality was evaluated using a visibility scale, and the entrance skin dose was measured using a dosimeter at three different levels of a phantom (hip, knee, and ankle).

Results

The mean image visibility scale values for the SSDR method were significantly higher than for the CR method. The entrance skin dose for the SSDR method was 278 µGy at each level, compared to the entrance skin doses of the CR method, which were 3,410 µGy for the hip, 1,152 µGy for the knee, and 580 µGy for the ankle.

Conclusion

Both the image quality and patient entrance skin dose data suggest that the SSDR method is superior to the CR method for the lower extremity musculoskeletal examination.

The influence of liquid crystal display monitors on observer performance for the detection of interstitial lung markings on both storage phosphor and flat-panel-detector chest radiography

PURPOSE

To compare observer performance with a flat-panel liquid crystal display (LCD) monitor and with a high-resolution gray-scale cathode ray tube (CRT) monitor in the detection of interstitial lung markings using a silicon flat-panel-detector direct radiography (DR) and storage phosphor computed radiography (CR) in a clinical setting.

MATERIALS AND METHODS

We displayed 39 sets of posteroanterior chest radiographs from the patients who were suspected of interstitial lung disease. Each sets consisted of DR, CR and thin-section CT as the reference standard. Image identities were masked, randomly sorted, and displayed on both five mega pixel (2048x2560x8 bits) LCD and CRT monitors. Ten radiologists independently rated their confidence in detection for the presence of linear opacities in the four fields of the lungs; right upper, left upper, right lower, and left lower quadrant. Performance of a total 6240 (39 setsx2 detector systemsx2 monitor systemx4 fieldsx10 observers) observations was analyzed by multi-reader multi-case receiver operating characteristic (ROC) analysis. Differences between monitor systems in combinations of detector systems were compared using ANOVA and paired-samples t-test.

RESULTS

Area under curves (AUC) for the presence of linear opacities measured by ROC analysis was higher on the LCDs than CRTs without statistical significance (p=0.082). AUC was significantly higher on the DR systems than CR systems (p=0.006). AUC was significantly higher on the LCDs than CRTs for DR systems (p=0.039) but not different for CR systems (p=0.301).

CONCLUSION

In clinical conditions, performance of the LCD monitor appears to be better for detecting interstitial lung markings when interfaced with DR systems.

Patient dose evaluation by means of DICOM images for a direct radiography system

PURPOSE

The purpose of this work was to evaluate the statistical distribution of patient dose for different examinations by using the data stored in a DICOM image archive of a direct digital radiography system.

MATERIALS AND METHODS

An automatic procedure to extract dose data and exposure parameters from the image archives was implemented. During a 4.5-month period, 8,292 images were collected. Exposure parameters and the air kerma area product (P (KA)) stored in the image DICOM header were examined for each image. The entrance surface air kerma (K (a,e)), a quantity comparable to the current diagnostic reference levels (DRL), was estimated considering the P (KA) and the geometric parameters of each examination.

RESULTS

P (KA) and K (a,e ) distributions showed highly variable values. The obtained K (a,e ) values were substantially lower than the DRL. DRL were more than six times the mean value of K (a,e ) distribution for the abdomen anteroposterior (AP) and lumbar spine lateral (LAT) projections, whereas the ratio was equal to 2.7 for posteroanterior (PA) chest examinations.

CONCLUSIONS

The method adopted proved to be effective for characterising the dose of each examination by means of the statistical analysis of the dose quantities over extensive samples. The dose values obtained and the comparison with the DRL showed that this radiographic device allows substantial dose savings compared with estimations made for nondigital or for phosphor-based systems.

Effective doses in radiology and diagnostic nuclear medicine: a catalog

Medical uses of radiation have grown very rapidly over the past decade, and, as of 2007, medical uses represent the largest source of exposure to the U.S. population. Most physicians have difficulty assessing the magnitude of exposure or potential risk. Effective dose provides an approximate indicator of potential detriment from ionizing radiation and should be used as one parameter in evaluating the appropriateness of examinations involving ionizing radiation. The purpose of this review is to provide a compilation of effective doses for radiologic and nuclear medicine procedures. Standard radiographic examinations have average effective doses that vary by over a factor of 1000 (0.01-10 mSv). Computed tomographic examinations tend to be in a more narrow range but have relatively high average effective doses (approximately 2-20 mSv), and average effective doses for interventional procedures usually range from 5-70 mSv. Average effective dose for most nuclear medicine procedures varies between 0.3 and 20 mSv. These doses can be compared with the average annual effective dose from background radiation of about 3 mSv.

Digital chest radiography: an update on modern technology, dose containment and control of image quality

The introduction of digital radiography not only has revolutionized communication between radiologists and clinicians, but also has improved image quality and allowed for further reduction of patient exposure. However, digital radiography also poses risks, such as unnoticed increases in patient dose and suboptimum image processing that may lead to suppression of diagnostic information. Advanced processing techniques, such as temporal subtraction, dual-energy subtraction and computer-aided detection (CAD) will play an increasing role in the future and are all targeted to decrease the influence of distracting anatomic background structures and to ease the detection of focal and subtle lesions. This review summarizes the most recent technical developments with regard to new detector techniques, options for dose reduction and optimized image processing. It explains the meaning of the exposure indicator or the dose reference level as tools for the radiologist to control the dose. It also provides an overview over the multitude of studies conducted in recent years to evaluate the options of these new developments to realize the principle of ALARA. The focus of the review is hereby on adult applications, the relationship between dose and image quality and the differences between the various detector systems.

A technique for simulating the effect of dose reduction on image quality in digital chest radiography

PURPOSE

The purpose of this study is to provide a pragmatic tool for studying the relationship between dose and image quality in clinical chest images. To achieve this, we developed a technique for simulating the effect of dose reduction on image quality of digital chest images.

MATERIALS AND METHODS

The technique was developed for a digital charge-coupled-device (CCD) chest unit with slot-scan acquisition. Raw pixel values were scaled to a lower dose level, and a random number representing noise to each specific pixel value was added. After adding noise, raw images were post processed in the standard way. Validation was performed by comparing pixel standard deviation, as a measure of noise, in simulated images with images acquired at actual lower doses. To achieve this, a uniform test object and an anthropomorphic phantom were used. Additionally, noise power spectra of simulated and actual images were compared. Also, detectability of simulated lesions was investigated using a model observer.

RESULTS

The mean difference in noise values between simulated and real lower-dose phantom images was smaller than 5% for relevant clinical settings. Noise power spectra appeared to be comparable on average but simulated images showed slightly higher noise levels for higher spatial frequencies and slightly lower noise levels for lower spatial frequencies. Comparable detection performance was shown in simulated and actual images with slightly worse detectability for simulated lower dose images.

CONCLUSION

We have developed and validated a method for simulating dose reduction. Our method seems an acceptable pragmatic tool for studying the relationship between dose and image quality.

Advances in Digital Radiography: Physical Principles and System Overview

During the past two decades, digital radiography has supplanted screen-film radiography in many radiology departments. Today, manufacturers provide a variety of digital imaging solutions based on various detector and readout technologies. Digital detectors allow implementation of a fully digital picture archiving and communication system, in which images are stored digitally and are available anytime. Image distribution in hospitals can now be achieved electronically by means of web-based technology with no risk of losing images. Other advantages of digital radiography include higher patient throughput, increased dose efficiency, and the greater dynamic range of digital detectors with possible reduction of radiation exposure to the patient. The future of radiography will be digital, and it behooves radiologists to be familiar with the technical principles, image quality criteria, and radiation exposure issues associated with the various digital radiography systems that are currently available.

Detection of simulated nodules on clinical radiographs: dose reduction at digital posteroanterior chest radiography

PURPOSE

To determine to what extent dose reduction results in decreased detection of simulated nodules on patient digital posteroanterior (PA) chest radiographs.

MATERIALS AND METHODS

Raw data from 20 clinical digital PA chest images that were reported as having normal findings and that were obtained with a slot-scan charge-coupled device system were used. For research protocol that concerns data with patient identities concealed, institutional review board approval is not required. One hundred twenty nodules varying in size and signal intensity were digitally simulated and added to the chest images. Hard copies were printed to represent a 100% dose and, by adding noise, to represent simulated patient doses of 50%, 25%, and 12%. Four radiologists reviewed images. Each lesion was registered as "detected" or "not detected." A semiparametric logistic regression model was used for statistical analysis.

RESULTS

The decrease in radiation dose from 100% to 50%, 25%, or 12% had no effect on lesion detection in the lungs. The decrease in radiation dose had an effect on lesion detection in the mediastinum, as probabilities deteriorated from the 100% dose to the 50%, 25%, and 12% dose with each step. Probabilities of smaller detection rates when compared with that of the reference category (100% dose) were 0.97 (95% confidence interval [CI]: -0.86, 0.012) for the 50% dose, 1 (CI: -0.59, -0.61) for the 25% dose, and 1 (CI: -2.41, -1.22) for the 12% dose. CIs for the effects were on the log(odds). Detection probability decreased with smaller and lower signal intensity lesions.

CONCLUSION

At clinical digital radiography, dose reduction resulted in decreased observer detection of simulated nodules in the mediastinum but not in the lungs.

Depiction of low-contrast detail in digital radiography: comparison of powder- and needle-structured storage phosphor systems

PURPOSE

We sought to evaluate the low-contrast performance of a newly developed needle image plate/line scanner (NIP) computed radiography system in comparison with a standard powder image plate/flying-spot scanner (PIP) system.

MATERIALS AND METHODS

A total of 36 images of a CDRAD phantom, simulating low-contrast structures with different drill holes of different diameters, were obtained with both imaging systems using 9 different exposure variables. All images had window and level set to generate consistent density and contrast. In addition, multiscale contrast-dependent contrast amplification was applied to some of the images. All images obtained were printed and presented to a total of 10 observers (5 radiologists, 5 engineers/physicists), who were blinded to both the image plate and parameter setting used. The smallest detectable drill hole depth (= contrast) correctly identified was recorded for each diameter. The median values observed were calculated and tested for statistical differences between PIP and NIP using Student t test for matched pairs (level of significance P < or = 0.05).

RESULTS

At all but 2 settings of the variables, NIP images depicted significantly lower contrast levels (= lower depth of drill holes) compared with PIP images. The 2 settings also showed a trend towards better low contrast depiction with NIP. In no case was low contrast performance better using PIP images.

CONCLUSION

Images obtained with needle image plate/line scanner provide superior low contrast performance compared with the images obtained with powder image plate/flying-spot scanner.

Contrast-detail evaluation and dose assessment of eight digital chest radiography systems in clinical practice

The purpose of this study was to assess contrast-detail performance and effective dose of eight different digital chest radiography systems. Digital chest radiography systems from different manufacturers were included: one storage phosphor system, one selenium-coated drum system, and six direct readout systems including four thin-film transistor (TFT) systems and two charge-coupled device (CCD) systems. For measuring image quality, a contrast-detail test object was used in combination with a phantom that simulates the primary and scatter transmission through lung fields (LucAl). Six observers judged phantom images of each modality by soft-copy reading in a four-alternative-forced-choice experiment. The entrance dose was also measured, and the effective dose was calculated for an average patient. Contrast-detail curves were constructed from the observer data. The blocked two-way ANOVA test was used for statistical analysis. Significant difference in contrast-detail performance was found between the systems. Best contrast-detail performance was shown by a CCD system with slot-scan technology, and the selenium-coated drum system was compared to the other six systems (p values <or=0.003). Calculated effective dose varied between 0.010 mSv and 0.032 mSv. Significant differences in contrast-detail performance and effective dose levels were found between different digital chest radiography systems in clinical practice.