Correlation of clinical and physical-technical image quality in chest CT: a human cadaver study applied on iterative reconstruction

How subjective CT image quality assessment becomes surprisingly reliable: pairwise comparisons instead of Likert scale

OBJECTIVES

The aim of this study is to improve the reliability of subjective IQ assessment using a pairwise comparison (PC) method instead of a Likert scale method in abdominal CT scans.

METHODS

Abdominal CT scans (single-center) were retrospectively selected between September 2019 and February 2020 in a prior study. Sample variance in IQ was obtained by adding artificial noise using dedicated reconstruction software, including reconstructions with filtered backprojection and varying iterative reconstruction strengths. Two datasets (each n = 50) were composed with either higher or lower IQ variation with the 25 original scans being part of both datasets. Using in-house developed software, six observers (five radiologists, one resident) rated both datasets via both the PC method (forcing observers to choose preferred scans out of pairs of scans resulting in a ranking) and a 5-point Likert scale. The PC method was optimized using a sorting algorithm to minimize necessary comparisons. The inter- and intraobserver agreements were assessed for both methods with the intraclass correlation coefficient (ICC).

RESULTS

Twenty-five patients (mean age 61 years ± 15.5; 56% men) were evaluated. The ICC for interobserver agreement for the high-variation dataset increased from 0.665 (95%CI 0.396-0.814) to 0.785 (95%CI 0.676-0.867) when the PC method was used instead of a Likert scale. For the low-variation dataset, the ICC increased from 0.276 (95%CI 0.034-0.500) to 0.562 (95%CI 0.337-0.729). Intraobserver agreement increased for four out of six observers.

CONCLUSION

The PC method is more reliable for subjective IQ assessment indicated by improved inter- and intraobserver agreement.

CLINICAL RELEVANCE STATEMENT

This study shows that the pairwise comparison method is a more reliable method for subjective image quality assessment. Improved reliability is of key importance for optimization studies, validation of automatic image quality assessment algorithms, and training of AI algorithms.

KEY POINTS

• Subjective assessment of diagnostic image quality via Likert scale has limited reliability. • A pairwise comparison method improves the inter- and intraobserver agreement. • The pairwise comparison method is more reliable for CT optimization studies.

Finding the optimal tube current and iterative reconstruction strength in liver imaging; two needles in one haystack

Objectives

The aim of the study was to find the lowest possible tube current and the optimal iterative reconstruction (IR) strength in abdominal imaging.

Material and methods

Reconstruction software was used to insert noise, simulating the use of a lower tube current. A semi-anthropomorphic abdominal phantom (Quality Assurance in Radiology and Medicine, QSA-543, Moehrendorf, Germany) was used to validate the performance of the ReconCT software (S1 Appendix). Thirty abdominal CT scans performed with a standard protocol (120 kVref, 150 mAsref) scanned at 90 kV, with dedicated contrast media (CM) injection software were selected. There were no other in- or exclusion criteria. The software was used to insert noise as if the scans were performed with 90, 80, 70 and 60% of the full dose. Consequently, the different scans were reconstructed with filtered back projection (FBP) and IR strength 2, 3 and 4. Both objective (e.g. Hounsfield units [HU], signal to noise ratio [SNR] and contrast to noise ratio [CNR]) and subjective image quality were evaluated. In addition, lesion detection was graded by two radiologists in consensus in another 30 scans (identical scan protocol) with various liver lesions, reconstructed with IR 3, 4 and 5.

Results

A tube current of 60% still led to diagnostic objective image quality (e.g. SNR and CNR) when IR strength 3 or 4 were used. IR strength 4 was preferred for lesion detection. The subjective image quality was rated highest for the scans performed at 90% with IR 4.

Conclusion

A tube current reduction of 10–40% is possible in case IR 4 is used, leading to the highest image quality (10%) or still diagnostic image quality (40%), shown by a pairwise comparison in the same patients.

Iterative reconstruction improves image quality and reduces radiation dose in trauma protocols; A human cadaver study

Background

Radiation-related cancer risk is an object of concern in CT of trauma patients, as these represent a young population. Different radiation reducing methods, including iterative reconstruction (IR), and spilt bolus techniques have been introduced in the recent years in different large scale trauma centers.

Purpose

To compare image quality in human cadaver exposed to thoracoabdominal computed tomography using IR and standard filtered back-projection (FBP) at different dose levels.

Material and methods

Ten cadavers were scanned at full dose and a dose reduction in CTDIvol of 5 mGy (low dose 1) and 7.5 mGy (low dose 2) on a Siemens Definition Flash 128-slice computed tomography scanner. Low dose images were reconstructed with FBP and Sinogram affirmed iterative reconstruction (SAFIRE) level 2 and 4. Quantitative image quality was analyzed by comparison of contrast-to-noise ratio (CNR) and signal-to-noise ratio (SNR). Qualitative image quality was evaluated by use of visual grading regression (VGR) by four radiologists.

Results

Readers preferred SAFIRE reconstructed images over FBP at a dose reduction of 40% (low dose 1) and 56% (low dose 2), with significant difference in overall impression of image quality. CNR and SNR showed significant improvement for images reconstructed with SAFIRE 2 and 4 compared to FBP at both low dose levels.

Conclusions

Iterative image reconstruction, SAFIRE 2 and 4, resulted in equal or improved image quality at a dose reduction of up to 56% compared to full dose FBP and may be used a strong radiation reduction tool in the young trauma population.

PULMONARY NODULE DETECTION IN CHEST CT USING A DEEP LEARNING-BASED RECONSTRUCTION ALGORITHM

This study's aim was to assess whether deep learning image reconstruction (DLIR) techniques are non-inferior to ASIR-V for the clinical task of pulmonary nodule detection in chest computed tomography. Up to 6 (range 3-6, mean 4.2) artificial lung nodules (diameter: 3, 5, 8 mm; density: -800, -630, +100 HU) were inserted at different locations in the Kyoto Kagaku Lungman phantom. In total, 16 configurations (10 abnormal, 6 normal) were scanned at 7.6, 3, 1.6 and 0.38 mGy CTDIvol (respectively 0, 60, 80 and 95% dose reduction). Images were reconstructed using 50% ASIR-V and a deep learning-based algorithm with low (DL-L), medium (DL-M) and high (DL-H) strength. Four chest radiologists evaluated 256 series by locating and scoring nodules on a five-point scale. No statistically significant difference was found among the reconstruction algorithms (p = 0.987, average across readers AUC: 0.555, 0.561, 0.557, 0.558 for ASIR-V, DL-L, DL-M, DL-H).

Preserving image texture while reducing radiation dose with a deep learning image reconstruction algorithm in chest CT: A phantom study

PURPOSE

To assess whether a deep learning image reconstruction algorithm (TrueFidelity) can preserve the image texture of conventional filtered back projection (FBP) at reduced dose levels attained by ASIR-V in chest CT.

METHODS

Phantom images were acquired using a clinical chest protocol (7.6 mGy) and two levels of dose reduction (60% and 80%). Images were reconstructed with FBP, ASIR-V (50% and 100% blending) and TrueFidelity (low (DL-L), medium (DL-M) and high (DL-H) strength). Noise (SD), noise power spectrum (NPS) and task-based transfer function (TTF) were calculated. Noise texture was quantitatively compared by computing root-mean-square deviations (RMSD) of NPS with respect to FBP. Four experienced readers performed a contrast-detail evaluation. The dose reducing potential of TrueFidelity compared to ASIR-V was assessed by fitting SD and contrast-detail as a function of dose.

RESULTS

DL-M and DL-H reduced noise and NPS area compared to FBP and 50% ASIR-V, at all dose levels. At 7.6 mGy, NPS of ASIR-V 50/100% was shifted towards lower frequencies (f_peak = 0.22/0.13 mm^-1, RMSD = 0.14/0.38), with respect to FBP (f_peak = 0.30 mm^-1). Marginal difference was observed for TrueFidelity: f_peak = 0.33/0.30/0.30 mm^-1 and RMSD = 0.03/0.04/0.07 for L/M/H strength. Values of TTF_50% were independent of DL strength and higher compared to FBP and ASIR-V, at all dose and contrast levels. Contrast-detail was highest for DL-H at all doses. Compared to 50% ASIR-V, DL-H had an estimated dose reducing potential of 50% on average, without impairing noise, texture and detectability.

CONCLUSIONS

TrueFidelity preserves the image texture of FBP, while outperforming ASIR-V in terms of noise, spatial resolution and detectability at lower doses.

Individually Body Weight-Adapted Contrast Media Application in Computed Tomography Imaging of the Liver at 90 kVp

OBJECTIVES

The aim of the present study was to evaluate the attenuation and image quality (IQ) of a body weight-adapted contrast media (CM) protocol compared with a fixed injection protocol in computed tomography (CT) of the liver at 90 kV.

MATERIALS AND METHODS

One hundred ninety-nine consecutive patients referred for abdominal CT imaging in portal venous phase were included. Group 1 (n = 100) received a fixed CM dose with a total iodine load (TIL) of 33 g I at a flow rate of 3.5 mL/s, resulting in an iodine delivery rate (IDR) of 1.05 g I/s. Group 2 (n = 99) received a body weight-adapted CM protocol with a dosing factor of 0.4 g I/kg with a subsequent TIL adapted to the patients' weight. Injection time of 30 seconds was kept identical for all patients. Therefore, flow rate and IDR changed with different body weight. Patients were divided into 3 weight categories; 70 kg or less, 71 to 85 kg, and 86 kg or greater. Attenuation (HU) in 3 segments of the liver, signal-to-noise ratio, and contrast-to-noise ratio were used to evaluate objective IQ. Subjective IQ was assessed by a 5-point Likert scale. Differences between groups were statistically analyzed (P < 0.05 was considered statistically significant).

RESULTS

No significant differences in baseline characteristics were found between groups. The CM volume and TIL differed significantly between groups (P < 0.01), with mean values in group 1 of 110 mL and 33 g I, and in group 2 of 104.1 ± 21.2 mL and 31.2 ± 6.3 g I, respectively. Flow rate and IDR were not significantly different between groups (P > 0.05). Body weight-adapted protocoling led to more homogeneous enhancement of the liver parenchyma compared with a fixed protocol with a mean enhancement per weight category in group 2 of 126.5 ± 15.8, 128.2 ± 15.3, and 122.7 ± 21.2 HU compared with that in group 1 of 139.9 ± 21.4, 124.6 ± 24.8, and 116.2 ± 17.8 HU, respectively.

CONCLUSIONS

Body weight-adapted CM injection protocols result in more homogeneous enhancement of the liver parenchyma at 90 kV in comparison to a fixed CM volume with comparable objective and subjective IQ, whereas overall CM volume can be safely reduced in more than half of patients.

A systematic review of incubator-based neonatal radiography - What does the evidence say?

OBJECTIVES

This systematic review aimed to explore the impact of incubator design (canopy, mattress, and mattress support) on neonatal imaging in terms of imaging technique, radiation dose and image quality.

KEY FINDINGS

A systematic literature review was performed by searching multiple healthcare databases. Following study selection and extraction, 7 articles were deemed eligible and included within the study. Of these 7 studies, six were experimental phantom based with the remaining one being a retrospective analysis. Four studies reported a percentage reduction in beam attenuation for incubator components ranging from 12% to 72% with one other study reporting a reduction but with no numerical data. This wide variation in radiation beam attenuation from the incubator components was correlated with image quality within five studies, two suggesting reduced image quality when using the incubator tray under the mattress support whilst the other three found no significant difference. Although the seven studies reported that incubator components reduced X-ray beam intensity, there was limited evidence on whether this required an increase in exposure factors. Only one study suggested increasing exposure parameters to accommodate for the increase in beam attenuation when using an incubator tray.

CONCLUSION

The literature clearly demonstrates that with existing incubator designs, there is considerable beam attenuation between placing the image receptor directly behind the neonate as oppose to the incubator tray. However, this radiation beam attenuation is not well correlated to neonatal radiation dose or image quality effects and therefore is very confusing when considering clinical implementation.

IMPLICATIONS FOR PRACTICE

This review highlights the need for standardisation and further optimisation work to ensure best practice for this vulnerable patient group.

Localization of liver lesions in abdominal CT imaging: I. Correlation of human observer performance between anatomical and uniform backgrounds

The purpose of this study was to determine the correlation between human observer performance for localization of small low contrast lesions within uniform water background versus an anatomical liver background, under the conditions of varying dose, lesion size, and reconstruction algorithm. Liver lesions (5 mm, 7 mm, and 9 mm, contrast:  -21 HU) were digitally inserted into CT projection data of ten normal patients in vessel-free liver regions. Noise was inserted into the projection data to create three image sets: full dose and simulated half and quarter doses. Images were reconstructed with a standard filtered back projection (FBP) and an iterative reconstruction (IR) algorithm. Lesion and noise insertion procedures were repeated with water phantom data. Two-dimensional regions of interest (66 lesion-present, 34 lesion-absent) were selected, randomized, and independently reviewed by three medical physicists to identify the most likely location of the lesion and provide a confidence score. Locations and confidence scores were assessed using the area under the localization receiver operating characteristic curve (Az_LROC). We examined the correlation between human performance for the liver and uniform water backgrounds as dose, lesion size, and reconstruction algorithm varied. As lesion size or dose increased, reader localization performance improved. For full dose IR images, the Az_LROC for 5, 7, and 9 mm lesions were 0.53, 0.91, and 0.97 (liver) and 0.51, 0.96, and 0.99 (uniform water), respectively. Similar trends were seen with other parameters. Performance values for liver and uniform backgrounds were highly correlated for both reconstruction algorithms, with a Spearman correlation of ρ  =  0.97, and an average difference in Az_LROC of 0.05  ±  0.04. For the task of localizing low contrast liver lesions, human observer performance was highly correlated between anatomical and uniform backgrounds, suggesting that lesion localization studies emulating a clinical test of liver lesion detection can be performed using a uniform background.

Evaluation of unenhanced axial T1W and T2W liver MR images acquired from institutions within the Republic of Ireland and the Kingdom of Saudi Arabia

INTRODUCTION

This multi-site study evaluated two breath-hold sequences commonly utilised for liver MRI; non-enhanced T1W-3D-FS-GRE-TRA and T2W-2D-FSE-TRA sequences, using physical measurements of SNR and CNR, and observer perceptions' (Visual Grading Analysis: VGA).

METHODS

Liver MR image datasets (n = 168) from nine hospitals in the Kingdom of Saudi Arabia (KSA) and 11 hospitals in the Republic of Ireland were evaluated. Images were categorised into two groups per sequence, defined by slice thickness (T2W-2D-FSE, ≤5 mm vs ≥ 6 mm and T1W-3D-GRE-FS, ≤3 mm vs 4 mm). Images were evaluated using visual grading analysis VGA and physical measurements: SNR/CNR. Account was taken of varying patient sizes based on AP/transverse diameter measurements.

RESULTS

Physical image quality measurements (SNR/CNR) returned no significant findings across Irish and KSA hospitals, for both sequences, despite variations in acquisition parameters. Statistically significant differences were found for some scoring criteria based on the observers' perceptions including spleen parenchyma, and spatial resolution for the non-enhanced T1W-3D-FS-GRE-TRA images, with a preference for images acquired using thin slices (≤3 mm). In addition, statistically significant difference was found for the scoring criteria motion artefact for the axial T2W-2D-FSE-TRA images, with a preference for images acquired using thick slices (≥5 mm). Negligible correlation was noted between SNR/CNR and measured abdominal AP/transverse diameters.

CONCLUSION

Whilst variations in sequences rendered no statistical differences in SNR/CNR findings, significant differences in observer image criteria scores was noted. The importance of both physical measurements and observers' perceptions evaluation methods for quality assessment of MR images was demonstrated and optimisation of liver sequence parameters is warranted.

Determination of a suitable low-dose abdominopelvic CT protocol using model-based iterative reconstruction through cadaveric study

INTRODUCTION

Cadaveric studies provide a means of safely assessing new technologies and optimizing scanning prior to clinical validation. Reducing radiation exposure in a clinical setting can entail incremental dose reductions to avoid missing important clinical findings. The use of cadavers allows assessment of the impact of more substantial dose reductions on image quality. Our aim was to identify a suitable low-dose abdominopelvic CT protocol for subsequent clinical validation.

METHODS

Five human cadavers were scanned at one conventional dose and three low-dose settings. All scans were reconstructed using three different reconstruction algorithms: filtered back projection (FBP), hybrid iterative reconstruction (60% FBP and 40% adaptive statistical iterative reconstruction (ASIR40)), and model-based iterative reconstruction (MBIR). Two readers rated the image quality both quantitatively and qualitatively.

RESULTS

Model-based iterative reconstruction images had significantly better objective image noise and higher qualitative scores compared with both FBP and ASIR40 images at all dose levels. The greatest absolute noise reduction, between MBIR and FBP, of 34.3 HU (equating to a 68% reduction) was at the lowest dose level. MBIR reduced image noise and improved image quality even in CT images acquired with a mean radiation dose reduction of 62% compared with conventional dose studies reconstructed with ASIR40, with lower levels of objective image noise, superior diagnostic acceptability and contrast resolution, and comparable subjective image noise and streak artefact scores.

CONCLUSION

This cadaveric study demonstrates that MBIR reduces image noise and improves image quality in abdominopelvic CT images acquired with dose reductions of up to 62%.

Quantitative Measurements Versus Receiver Operating Characteristics and Visual Grading Regression in CT Images Reconstructed with Iterative Reconstruction: A Phantom Study

RATIONALE AND OBJECTIVES

This study aimed to evaluate the correlation of quantitative measurements with visual grading regression (VGR) and receiver operating characteristics (ROC) analysis in computed tomography (CT) images reconstructed with iterative reconstruction.

MATERIALS AND METHODS

CT scans on a liver phantom were performed on CT scanners from GE, Philips, and Toshiba at three dose levels. Images were reconstructed with filtered back projection (FBP) and hybrid iterative techniques (ASiR, iDose, and AIDR 3D of different strengths). Images were visually assessed by five readers using a four- and five-grade ordinal scale for liver low contrast lesions and for 10 image quality criteria. The results were analyzed with ROC and VGR. Standard deviation, signal-to-noise ratios, and contrast-to-noise ratios were measured in the images.

RESULTS

All data were compared to FBP. The results of the quantitative measurements were improved for all algorithms. ROC analysis showed improved lesion detection with ASiR and AIDR and decreased lesion detection with iDose. VGR found improved noise properties for all algorithms, increased sharpness with iDose and AIDR, and decreased artifacts from the spine with AIDR, whereas iDose increased the artifacts from the spine. The contrast in the spine decreased with ASiR and iDose.

CONCLUSIONS

Improved quantitative measurements in images reconstructed with iterative reconstruction compared to FBP are not equivalent to improved diagnostic image accuracy.

Evaluation of automatic image quality assessment in chest CT - A human cadaver study

PURPOSE

The evaluation of clinical image quality (IQ) is important to optimize CT protocols and to keep patient doses as low as reasonably achievable. Considering the significant amount of effort needed for human observer studies, automatic IQ tools are a promising alternative. The purpose of this study was to evaluate automatic IQ assessment in chest CT using Thiel embalmed cadavers.

METHODS

Chest CT's of Thiel embalmed cadavers were acquired at different exposures. Clinical IQ was determined by performing a visual grading analysis. Physical-technical IQ (noise, contrast-to-noise and contrast-detail) was assessed in a Catphan phantom. Soft and sharp reconstructions were made with filtered back projection and two strengths of iterative reconstruction. In addition to the classical IQ metrics, an automatic algorithm was used to calculate image quality scores (IQs). To be able to compare datasets reconstructed with different kernels, the IQs values were normalized.

RESULTS

Good correlations were found between IQs and the measured physical-technical image quality: noise (ρ=-1.00), contrast-to-noise (ρ=1.00) and contrast-detail (ρ=0.96). The correlation coefficients between IQs and the observed clinical image quality of soft and sharp reconstructions were 0.88 and 0.93, respectively.

CONCLUSIONS

The automatic scoring algorithm is a promising tool for the evaluation of thoracic CT scans in daily clinical practice. It allows monitoring of the image quality of a chest protocol over time, without human intervention. Different reconstruction kernels can be compared after normalization of the IQs.

Effect of Radiation Dose Reduction and Reconstruction Algorithm on Image Noise, Contrast, Resolution, and Detectability of Subtle Hypoattenuating Liver Lesions at Multidetector CT: Filtered Back Projection versus a Commercial Model-based Iterative Reconstruction Algorithm

Purpose To determine the effect of radiation dose and iterative reconstruction (IR) on noise, contrast, resolution, and observer-based detectability of subtle hypoattenuating liver lesions and to estimate the dose reduction potential of the IR algorithm in question. Materials and Methods This prospective, single-center, HIPAA-compliant study was approved by the institutional review board. A dual-source computed tomography (CT) system was used to reconstruct CT projection data from 21 patients into six radiation dose levels (12.5%, 25%, 37.5%, 50%, 75%, and 100%) on the basis of two CT acquisitions. A series of virtual liver lesions (five per patient, 105 total, lesion-to-liver prereconstruction contrast of -15 HU, 12-mm diameter) were inserted into the raw CT projection data and images were reconstructed with filtered back projection (FBP) (B31f kernel) and sinogram-affirmed IR (SAFIRE) (I31f-5 kernel). Image noise (pixel standard deviation), lesion contrast (after reconstruction), lesion boundary sharpness (average normalized gradient at lesion boundary), and contrast-to-noise ratio (CNR) were compared. Next, a two-alternative forced choice perception experiment was performed (16 readers [six radiologists, 10 medical physicists]). A linear mixed-effects statistical model was used to compare detection accuracy between FBP and SAFIRE and to estimate the radiation dose reduction potential of SAFIRE. Results Compared with FBP, SAFIRE reduced noise by a mean of 53% ± 5, lesion contrast by 12% ± 4, and lesion sharpness by 13% ± 10 but increased CNR by 89% ± 19. Detection accuracy was 2% higher on average with SAFIRE than with FBP (P = .03), which translated into an estimated radiation dose reduction potential (±95% confidence interval) of 16% ± 13. Conclusion SAFIRE increases detectability at a given radiation dose (approximately 2% increase in detection accuracy) and allows for imaging at reduced radiation dose (16% ± 13), while maintaining low-contrast detectability of subtle hypoattenuating focal liver lesions. This estimated dose reduction is somewhat smaller than that suggested by past studies. ^© RSNA, 2017 Online supplemental material is available for this article.