Diagnostic performance of a prototype dual-energy chest imaging system ROC analysis

Evaluation of the clinical utility of temporal subtraction using bone suppression processing in digital chest radiography

Rationale and objectives

To evaluate the usefulness of temporal subtraction using the bone suppression method in digital chest radiography for the detection of pulmonary lesions.

Materials and methods

The images of 31 patients with pulmonary lesions and 19 normal cases were included in the study. Conventional and bone suppression temporal subtraction were performed in the 50 cases selected and used for an observer performance study. Five radiologists participated in the study, and the differences between using conventional and bone suppression temporal subtraction were assessed using jackknife free-response receiver operating characteristic analysis.

Results

The average figure-of-merit values for all radiologists increased significantly using the bone suppression method, from 0.619 (conventional) to 0.696 (p = 0.032). The average sensitivity for detecting pulmonary lesions improved from 67.9% to 75.4%, and the average number of false-positive per case decreased from 0.336 to 0.252 using bone suppression temporal subtraction.

Conclusion

Bone suppression temporal subtraction processing can assist with the detection of subtle pulmonary lesions in digital chest radiographs.

Bone Suppression on Chest Radiographs for Pulmonary Nodule Detection: Comparison between a Generative Adversarial Network and Dual-Energy Subtraction

OBJECTIVE

To compare the effects of bone suppression imaging using deep learning (BSp-DL) based on a generative adversarial network (GAN) and bone subtraction imaging using a dual energy technique (BSt-DE) on radiologists' performance for pulmonary nodule detection on chest radiographs (CXRs).

MATERIALS AND METHODS

A total of 111 adults, including 49 patients with 83 pulmonary nodules, who underwent both CXR using the dual energy technique and chest CT, were enrolled. Using CT as a reference, two independent radiologists evaluated CXR images for the presence or absence of pulmonary nodules in three reading sessions (standard CXR, BSt-DE CXR, and BSp-DL CXR). Person-wise and nodule-wise performances were assessed using receiver-operating characteristic (ROC) and alternative free-response ROC (AFROC) curve analyses, respectively. Subgroup analyses based on nodule size, location, and the presence of overlapping bones were performed.

RESULTS

BSt-DE with an area under the AFROC curve (AUAFROC) of 0.996 and 0.976 for readers 1 and 2, respectively, and BSp-DL with AUAFROC of 0.981 and 0.958, respectively, showed better nodule-wise performance than standard CXR (AUAFROC of 0.907 and 0.808, respectively; p ≤ 0.005). In the person-wise analysis, BSp-DL with an area under the ROC curve (AUROC) of 0.984 and 0.931 for readers 1 and 2, respectively, showed better performance than standard CXR (AUROC of 0.915 and 0.798, respectively; p ≤ 0.011) and comparable performance to BSt-DE (AUROC of 0.988 and 0.974; p ≥ 0.064). BSt-DE and BSp-DL were superior to standard CXR for detecting nodules overlapping with bones (p < 0.017) or in the upper/middle lung zone (p < 0.017). BSt-DE was superior (p < 0.017) to BSp-DL in detecting peripheral and sub-centimeter nodules.

CONCLUSION

BSp-DL (GAN-based bone suppression) showed comparable performance to BSt-DE and can improve radiologists' performance in detecting pulmonary nodules on CXRs. Nevertheless, for better delineation of small and peripheral nodules, further technical improvements are required.

Chest X-ray Interpretation by Radiographers Is Not Inferior to Radiologists: A Multireader, Multicase Comparison Using JAFROC (Jack-knife Alternative Free-response Receiver Operating Characteristics) Analysis

RATIONALE AND OBJECTIVES

Chest X-rays (CXR) are one of the most frequently requested imaging examinations and are fundamental to many patient pathways. The aim of this study was to investigate the diagnostic accuracy of CXR interpretation by reporting radiographers (technologists).

METHODS

A cohort of consultant radiologists (n = 10) and reporting radiographers (technologists; n = 11) interpreted a bank (n = 106) of adult CXRs that contained a range of pathologies. Jack-knife alternate free-response receiver operating characteristic (JAFROC) methodology was used to determine the performance of the observers (JAFROC v4.2). A noninferiority approach was used, with a predefined margin of clinical insignificance of 10% of average consultant radiologist diagnostic accuracy.

RESULTS

The diagnostic accuracy of the reporting radiographers (figure of merit = 0.828, 95% confidence interval 0.808-0.847) was noninferior to the consultant radiologists (figure of merit = 0.788, 95% confidence interval 0.766-0.811), P < .0001.

CONCLUSIONS

With appropriate postgraduate education, reporting radiographers are able to interpret CXRs at a level comparable to consultant radiologists.

The Effectiveness of Non-ECG-Gated Contrast-Enhanced Computed Tomography for the Diagnosis of Non-ST Segment Elevation Acute Coronary Syndrome

Non-ST segment elevation acute coronary syndrome (NSTE-ACS) can be difficult to diagnose accurately, especially in the hyper-acute phase. Non-ECG-gated contrast-enhanced computed tomography (non-ECG-gated CE-CT) has been used in many institutions for screening acute chest pain. Although early defects (EDs) observed in non-ECG-gated CE-CT have been reported as a sign of acute myocardial ischemia, the precise diagnostic value of this sign for acute coronary syndrome has not been fully elucidated. We investigated the usefulness of non-ECG-gated CE-CT for the diagnosis of NSTE-ACS. We retrospectively reviewed 556 patients who were hospitalized for acute-onset chest pain and who underwent emergent coronary angiography. Non-ECG-gated CE-CT was performed in 23 of these patients. Two readers independently analyzed CT images using a 5-point scale. Of the 23 patients, 13 were diagnosed with NSTE-ACS. The remaining 10 patients were diagnosed with other conditions. The sensitivity, specificity, positive predictive value, and negative predictive value, respectively, of EDs on non-ECG-gated CE-CT to detect NSTE-ACS were 84.6%, 90%, 91.7%, and 81.8%. The identification of EDs was consistent between the two readers. Non-ECG-gated CE-CT may be useful not only to triage patients with chest pain by ruling out other conditions, but also to accurately diagnose NSTE-ACS.

Color radiography in lung nodule detection and characterization: comparison with conventional gray scale radiography

Background

To compare the capability of lung nodule detection and characterization between dual-energy radiography with color-representation (DCR) and conventional gray scale chest radiography (GSR).

Methods

A total of 130 paired chest radiographs (DCR and GSR) obtained from 65 patients (14 with normal scans and 51 with pulmonary nodules) were evaluated. After analysis, 45 non-calcified and 21 calcified nodules were identified. DCR was obtained by adding color space within material-decomposed data (blue for high attenuation and red for low attenuation) and by compounding the manipulated data to one color image. Three radiologists marked suggested nodules on radiographic images and assessed the level of confidence of lesion presence and probability of nodule calcification by using a nine-point rating scale. The jackknife active free-response receiver operating characteristics (JAFROC) analysis was used to evaluate lesion detectability, and multi-reader multi-case receiver operating characteristics (MRMC ROC) analysis was used for the evaluation of the accuracy of nodule calcification prediction.

Results

Figures of merit (FOM) from JAFROC was 0.807 for DCR and 0.811 for GSR, respectively; nodule detectability was not significantly different between DCR and GSR (p = 0.93). Areas under curve (AUC) from MRMC ROC were 0.944 for DCR and 0.828 for GSR, respectively; performance of DCR in predicting lung nodule calcification was significantly higher than that of GSR (p = 0.04).

Conclusions

DCR showed similar performance in terms of lung nodule detection compared with GSR. However, DCR does provide a significant benefit in predicting the presence of nodule calcification.

Multi-Institutional Evaluation of Digital Tomosynthesis, Dual-Energy Radiography, and Conventional Chest Radiography for the Detection and Management of Pulmonary Nodules

Purpose To conduct a multi-institutional, multireader study to compare the performance of digital tomosynthesis, dual-energy (DE) imaging, and conventional chest radiography for pulmonary nodule detection and management. Materials and Methods In this binational, institutional review board-approved, HIPAA-compliant prospective study, 158 subjects (43 subjects with normal findings) were enrolled at four institutions. Informed consent was obtained prior to enrollment. Subjects underwent chest computed tomography (CT) and imaging with conventional chest radiography (posteroanterior and lateral), DE imaging, and tomosynthesis with a flat-panel imaging device. Three experienced thoracic radiologists identified true locations of nodules (n = 516, 3-20-mm diameters) with CT and recommended case management by using Fleischner Society guidelines. Five other radiologists marked nodules and indicated case management by using images from conventional chest radiography, conventional chest radiography plus DE imaging, tomosynthesis, and tomosynthesis plus DE imaging. Sensitivity, specificity, and overall accuracy were measured by using the free-response receiver operating characteristic method and the receiver operating characteristic method for nodule detection and case management, respectively. Results were further analyzed according to nodule diameter categories (3-4 mm, >4 mm to 6 mm, >6 mm to 8 mm, and >8 mm to 20 mm). Results Maximum lesion localization fraction was higher for tomosynthesis than for conventional chest radiography in all nodule size categories (3.55-fold for all nodules, P < .001; 95% confidence interval [CI]: 2.96, 4.15). Case-level sensitivity was higher with tomosynthesis than with conventional chest radiography for all nodules (1.49-fold, P < .001; 95% CI: 1.25, 1.73). Case management decisions showed better overall accuracy with tomosynthesis than with conventional chest radiography, as given by the area under the receiver operating characteristic curve (1.23-fold, P < .001; 95% CI: 1.15, 1.32). There were no differences in any specificity measures. DE imaging did not significantly affect nodule detection when paired with either conventional chest radiography or tomosynthesis. Conclusion Tomosynthesis outperformed conventional chest radiography for lung nodule detection and determination of case management; DE imaging did not show significant differences over conventional chest radiography or tomosynthesis alone. These findings indicate performance likely achievable with a range of reader expertise. ^© RSNA, 2016 Online supplemental material is available for this article.

Role of digital tomosynthesis and dual energy subtraction digital radiography in detecting pulmonary nodules

OBJECTIVE

Digital tomosynthesis (DT) and dual-energy subtraction digital radiography (DES-DR) are known to perform better than conventional radiography in the detection of pulmonary nodules. Yet the comparative diagnostic performances of DT, DES-DR and digital radiography (DR) is not known. The present study compares the diagnostic performances of DT, DES-DR and DR in detecting pulmonary nodules.

SUBJECTS AND METHODS

The institutional Review Board approved the study and informed written consent was obtained. Fifty-five patients (30 with pulmonary nodules, 25 with non-nodular focal chest pathology) were included in the study. DT and DES-DR were performed within 14 days of MDCT. Composite images acquired at high kVp as part of DES-DR were used as DR images. Images were analyzed for presence of nodules and calcification in nodules. Interpretations were assigned confidence levels from 1 to 5 according to Five-Point rating scale. Areas under the receiver operating characteristic curves were compared using Z test.

RESULTS

A total of 110 (88 non-calcified, 22 calcified) nodules were identified on MDCT. For detection of nodules, DR showed cumulative sensitivity and specificity of 25.45% and 67.97%, respectively. DT showed a cumulative sensitivity and specificity of 60.9% and 85.07%, respectively. The performance was significantly better than DR (p<0.003). DES-DR showed sensitivity and specificity of 27.75% and 82.64%, not statistically different from those of DR (p-0.92). In detection of calcification, there was no statistically significant difference between DT, DES-DR and DR.

CONCLUSIONS

DT performs significantly better than DES-DR and DR at the cost of moderate increase in radiation dose.

Optimization of dual-energy subtraction chest radiography by use of a direct-conversion flat-panel detector system

We aimed to optimize the exposure conditions in the acquisition of soft-tissue images using dual-energy subtraction chest radiography with a direct-conversion flat-panel detector system. Two separate chest images were acquired at high- and low-energy exposures with standard or thick chest phantoms. The high-energy exposure was fixed at 120 kVp with the use of an auto-exposure control technique. For the low-energy exposure, the tube voltages and entrance surface doses ranged 40-80 kVp and 20-100 % of the dose required for high-energy exposure, respectively. Further, a repetitive processing algorithm was used for reduction of the image noise generated by the subtraction process. Seven radiology technicians ranked soft-tissue images, and these results were analyzed using the normalized-rank method. Images acquired at 60 kVp were of acceptable quality regardless of the entrance surface dose and phantom size. Using a repetitive processing algorithm, the minimum acceptable doses were reduced from 75 to 40 % for the standard phantom and to 50 % for the thick phantom. We determined that the optimum low-energy exposure was 60 kVp at 50 % of the dose required for the high-energy exposure. This allowed the simultaneous acquisition of standard radiographs and soft-tissue images at 1.5 times the dose required for a standard radiograph, which is significantly lower than the values reported previously.

Applications of ROC analysis in medical research: recent developments and future directions

With the growing focus on comparative effectiveness research and personalized medicine, receiver-operating characteristic analysis can continue to play an important role in health care decision making. Specific applications of receiver-operating characteristic analysis include predictive model assessment and validation, biomarker diagnostics, responder analysis in patient-reported outcomes, and comparison of alternative treatment options. The authors present a survey of the potential applications of the method and briefly review several relevant extensions. Given the level of attention paid to biomarker validation, personalized medicine and comparative effectiveness research, it is highly likely that the receiver-operating characteristic analysis will remain an important visual and analytic tool for medical research and evidence-based medicine in the foreseeable future.

Improved detection of focal pneumonia by chest radiography with bone suppression imaging

OBJECTIVE

To evaluate radiologists' ability to detect focal pneumonia by use of standard chest radiographs alone compared with standard plus bone-suppressed chest radiographs.

METHODS

Standard chest radiographs in 36 patients with 46 focal airspace opacities due to pneumonia (10 patients had bilateral opacities) and 20 patients without focal opacities were included in an observer study. A bone suppression image processing system was applied to the 56 radiographs to create corresponding bone suppression images. In the observer study, eight observers, including six attending radiologists and two radiology residents, indicated their confidence level regarding the presence of a focal opacity compatible with pneumonia for each lung, first by use of standard images, then with the addition of bone suppression images. Receiver operating characteristic (ROC) analysis was used to evaluate the observers' performance.

RESULTS

The mean value of the area under the ROC curve (AUC) for eight observers was significantly improved from 0.844 with use of standard images alone to 0.880 with standard plus bone suppression images (P < 0.001) based on 46 positive lungs and 66 negative lungs.

CONCLUSION

Use of bone suppression images improved radiologists' performance for detection of focal pneumonia on chest radiographs.

KEY POINTS

Bone suppression image processing can be applied to conventional digital radiography systems. Bone suppression imaging (BSI) produces images that appear similar to dual-energy soft tissue images. BSI improves the conspicuity of focal lung disease by minimizing bone opacity. BSI can improve the accuracy of radiologists in detecting focal pneumonia.

Imaging of nanoparticles with dual-energy computed tomography

A simulation study was performed to determine the feasibility and performance of imaging nanoparticles as contrast agents in dual-energy computed tomography. An analytical simulation model was used to model the relevant signal-to-noise ratio (SNR) in dual-energy imaging for the specific case of a three-material patient phantom consisting of water, calcium hydroxyapatite and contrast agent. Elemental gold and iodine were both considered as contrast agents. Simulations were performed for a range of monoenergetic (20-150 keV) and polyenergetic (20-150 kVp) beam spectra. A reference configuration was defined with beam energies of 80 and 140 kVp to match current clinical practice. The effect of adding a silver filter to the high-energy beam was also studied. A figure of merit (FOM), which normalized the dual-energy SNR to the square root of the patient integral dose, was calculated for all cases. The units of the FOM were keV(-1/2). A simple Rose model of detectability was used to estimate the minimum concentration of either elements needed to be detected (SNR > 5). For monoenergetic beams, the peak FOM of gold was 6.4 × 10(-6) keV(-1/2), while the peak FOM of iodine was 3.1 × 10(-6) keV(-1/2), a factor of approximately 2 greater for gold. For polyenergetic spectra, at the reference energies of 80 and 140 kVp, the FOM for gold and iodine was 1.65 × 10(-6) and 5.0 × 10(-7) keV(-1/2), respectively, a factor of approximately 3.3 greater. Also at these energies, the minimum detectable concentration of gold was estimated to be 58.5 mg mL(-1), while iodine was estimated to be 117.5 mg mL(-1). The results suggest that the imaging of a gold nanoparticle contrast agent is well suited to current conditions used in clinical imaging. The addition of a silver filter of 800 µm further increased the image quality of the gold signal by approximately 50% for the same absorbed dose to the patient.

[Conventional and CT diagnostics of bronchial carcinoma]

A number of important technical advances made in recent years in the area of both digital radiography as well as multidetector computed tomography (MDCT) have improved detection and staging of bronchial carcinoma. The aim of elaborate processing such as temporal subtraction, rib suppression, dual energy subtraction or CAD is to aid the radiologist in detecting lung tumors at the earliest stage possible. For both CT and radiography techniques the differentiation between true and false positive lesions seems to be the biggest challenge. MDCT with multiplanar projections is the imaging method of choice for staging of the extent of local tumor spread (T staging), while N staging and M staging are the domain of positron emission tomography (PET) or even better of integrated PET/CT. Management rules for follow-up of solid and semi-solid lesions seen in CT consider the risks of the patient and are summarized in international guidelines. In 2009 a new 7th edition of the TNM classification was published, which, among other aspects, sub-classifies tumor size more specifically and the presence of a satellite nodule in the tumor lobe is down-staged to T3 and no longer determines tumor resectability. The N staging was not modified. One of the most important new features is the fact that the new classification no longer applies only to non-small cell lung cancer (NSCLC) but also to SCLC and carcinoid tumors.