Reproducibility of dynamic contrast-enhanced MR imaging: why we should care

Associations between occupational physical activity and left ventricular structure and function over 25 years in CARDIA

AIMS

Leisure time physical activity (LTPA) confers cardiovascular health benefits, while occupational physical activity (OPA) may have paradoxically negative health associations. This study tested the explanatory hypothesis that unfavourable cardiac remodelling may result from chronic OPA-induced cardiovascular strain.

METHODS AND RESULTS

Longitudinal associations of OPA and left ventricular (LV) structure and function were examined in 1462 participants {50.0% female, 56.4% White, aged 30.4 ± 3.4 years at baseline [Year 5 exam (1990-91)]} from the Coronary Artery Risk Development in Young Adults study. Left ventricular structure and function were measured as LV mass (LVMi), end-diastolic volume (LVEDVi), end-systolic volume (LVESVi), ejection fraction (LVEF), stroke volume (LVSVi), and e/a-wave ratio (EA ratio) via echocardiography at baseline and 25 years later. Occupational physical activity was reported at seven exams during the study period as months/year with 'vigorous job activities such as lifting, carrying, or digging' for ≥5 h/week. The 25-year OPA patterns were categorized into three trajectories: no OPA (n = 770), medium OPA (n = 410), and high OPA (n = 282). Linear regression estimated associations between OPA trajectories and echocardiogram variables at follow-up after adjusting for baseline values, individual demographic/health characteristics, and LTPA. Twenty-five-year OPA exposure was not significantly associated with LVMi, LVEDVi, LVSVi, or EA ratio (P > 0.05). However, higher LVESVi (β = 1.84, P < 0.05) and lower LVEF (β = -1.94, P < 0.05) were observed at follow-up among those in the high- vs. no-OPA trajectories.

CONCLUSION

The paradoxically adverse association of OPA with cardiovascular health was partially supported by null or adverse associations between high OPA and echocardiogram outcomes. Confirmation is needed using more precise OPA measures.

Radiomics and radiogenomics in gliomas: a contemporary update

The natural history and treatment landscape of primary brain tumours are complicated by the varied tumour behaviour of primary or secondary gliomas (high-grade transformation of low-grade lesions), as well as the dilemmas with identification of radiation necrosis, tumour progression, and pseudoprogression on MRI. Radiomics and radiogenomics promise to offer precise diagnosis, predict prognosis, and assess tumour response to modern chemotherapy/immunotherapy and radiation therapy. This is achieved by a triumvirate of morphological, textural, and functional signatures, derived from a high-throughput extraction of quantitative voxel-level MR image metrics. However, the lack of standardisation of acquisition parameters and inconsistent methodology between working groups have made validations unreliable, hence multi-centre studies involving heterogenous study populations are warranted. We elucidate novel radiomic and radiogenomic workflow concepts and state-of-the-art descriptors in sub-visual MR image processing, with relevant literature on applications of such machine learning techniques in glioma management.

Unified platform for multimodal voxel-based analysis to evaluate tumour perfusion and diffusion characteristics before and after radiation treatment evaluated in metastatic brain cancer

OBJECTIVE:

Early changes in tumour behaviour following stereotactic radiosurgery) are potential biomarkers of response. To-date quantitative model-based measures of dynamic contrast-enhanced (DCE) and diffusion-weighted (DW) MRI parameters have shown widely variable findings, which may be attributable to variability in image acquisition, post-processing and analysis. Big data analytic approaches are needed for the automation of computationally intensive modelling calculations for every voxel, independent of observer interpretation.

METHODS:

This unified platform is a voxel-based, multimodality architecture that brings complimentary solute transport processes such as perfusion and diffusion into a common framework. The methodology was tested on synthetic data and digital reference objects and consequently evaluated in patients who underwent volumetric DCE-CT, DCE-MRI and DWI-MRI scans before and after treatment. Three-dimensional pharmacokinetic parameter maps from both modalities were compared as well as the correlation between apparent diffusion coefficient (ADC) values and the extravascular, extracellular volume (V_e). Comparison of histogram parameters was done via Bland-Altman analysis, as well as Student's t-test and Pearson's correlation using two-sided analysis.

RESULTS:

System testing on synthetic Tofts model data and digital reference objects recovered the ground truth parameters with mean relative percent error of 1.07 × 10^-7 and 5.60 × 10^-4 respectively. Direct voxel-to-voxel Pearson's analysis showed statistically significant correlations between CT and MR which peaked at Day 7 for K_trans (R = 0.74, p <= 0.0001). Statistically significant correlations were also present between ADC and Ve derived from both DCE-MRI and DCE-CT with highest median correlations found at Day 3 between median ADC and Ve,_MRI values (R = 0.6, p < 0.01) The strongest correlation to DCE-CT measurements was found with DCE-MRI analysis using voxelwise T₁₀ maps (R = 0.575, p < 0.001) instead of assigning a fixed T₁₀ value.

CONCLUSION:

The unified implementation of multiparametric transport modelling allowed for more robust and timely observer-independent data analytics. Utility of a common analysis platform has shown higher correlations between pharmacokinetic parameters obtained from different modalities than has previously been reported.

ADVANCES IN KNOWLEDGE:

Utility of a common analysis platform has shown statistically higher correlations between pharmacokinetic parameters obtained from different modalities than has previously been reported.

Interreader Variability of Dynamic Contrast-enhanced MRI of Recurrent Glioblastoma: The Multicenter ACRIN 6677/RTOG 0625 Study

Purpose To evaluate factors contributing to interreader variation (IRV) in parameters measured at dynamic contrast material-enhanced (DCE) MRI in patients with glioblastoma who were participating in a multicenter trial. Materials and Methods A total of 18 patients (mean age, 57 years ± 13 [standard deviation]; 10 men) who volunteered for the advanced imaging arm of ACRIN 6677, a substudy of the RTOG 0625 clinical trial for recurrent glioblastoma treatment, underwent analyzable DCE MRI at one of four centers. The 78 imaging studies were analyzed centrally to derive the volume transfer constant (Ktrans) for gadolinium between blood plasma and tissue extravascular extracellular space, fractional volume of the extracellular extravascular space (ve), and initial area under the gadolinium concentration curve (IAUGC). Two independently trained teams consisting of a neuroradiologist and a technologist segmented the enhancing tumor on three-dimensional spoiled gradient-recalled acquisition in the steady-state images. Mean and median parameter values in the enhancing tumor were extracted after registering segmentations to parameter maps. The effect of imaging time relative to treatment, map quality, imager magnet and sequence, average tumor volume, and reader variability in tumor volume on IRV was studied by using intraclass correlation coefficients (ICCs) and linear mixed models. Results Mean interreader variations (± standard deviation) (difference as a percentage of the mean) for mean and median IAUGC, mean and median Ktrans, and median ve were 18% ± 24, 17% ± 23, 27% ± 34, 16% ± 27, and 27% ± 34, respectively. ICCs for these metrics ranged from 0.90 to 1.0 for baseline and from 0.48 to 0.76 for posttreatment examinations. Variability in reader-derived tumor volume was significantly related to IRV for all parameters. Conclusion Differences in reader tumor segmentations are a significant source of interreader variation for all dynamic contrast-enhanced MRI parameters. © RSNA, 2018 Online supplemental material is available for this article. See also the editorial by Wolf in this issue.

MITK-ModelFit: A generic open-source framework for model fits and their exploration in medical imaging - design, implementation and application on the example of DCE-MRI

Background

Many medical imaging techniques utilize fitting approaches for quantitative parameter estimation and analysis. Common examples are pharmacokinetic modeling in dynamic contrast-enhanced (DCE) magnetic resonance imaging (MRI)/computed tomography (CT), apparent diffusion coefficient calculations and intravoxel incoherent motion modeling in diffusion-weighted MRI and Z-spectra analysis in chemical exchange saturation transfer MRI. Most available software tools are limited to a special purpose and do not allow for own developments and extensions. Furthermore, they are mostly designed as stand-alone solutions using external frameworks and thus cannot be easily incorporated natively in the analysis workflow.

Results

We present a framework for medical image fitting tasks that is included in the Medical Imaging Interaction Toolkit MITK, following a rigorous open-source, well-integrated and operating system independent policy. Software engineering-wise, the local models, the fitting infrastructure and the results representation are abstracted and thus can be easily adapted to any model fitting task on image data, independent of image modality or model. Several ready-to-use libraries for model fitting and use-cases, including fit evaluation and visualization, were implemented. Their embedding into MITK allows for easy data loading, pre- and post-processing and thus a natural inclusion of model fitting into an overarching workflow. As an example, we present a comprehensive set of plug-ins for the analysis of DCE MRI data, which we validated on existing and novel digital phantoms, yielding competitive deviations between fit and ground truth.

Conclusions

Providing a very flexible environment, our software mainly addresses developers of medical imaging software that includes model fitting algorithms and tools. Additionally, the framework is of high interest to users in the domain of perfusion MRI, as it offers feature-rich, freely available, validated tools to perform pharmacokinetic analysis on DCE MRI data, with both interactive and automatized batch processing workflows.

Observer variability of reference tissue selection for relativecerebral blood volume measurements in glioma patients

Objectives

To assess observer variability of different reference tissues used for relative CBV (rCBV) measurements in DSC-MRI of glioma patients.

Methods

In this retrospective study, three observers measured rCBV in DSC-MR images of 44 glioma patients on two occasions. rCBV is calculated by the CBV in the tumour hotspot/the CBV of a reference tissue at the contralateral side for normalization. One observer annotated the tumour hotspot that was kept constant for all measurements. All observers annotated eight reference tissues of normal white and grey matter. Observer variability was evaluated using the intraclass correlation coefficient (ICC), coefficient of variation (CV) and Bland-Altman analyses.

Results

For intra-observer, the ICC ranged from 0.50–0.97 (fair–excellent) for all reference tissues. The CV ranged from 5.1–22.1 % for all reference tissues and observers. For inter-observer, the ICC for all pairwise observer combinations ranged from 0.44–0.92 (poor–excellent). The CV ranged from 8.1–31.1 %. Centrum semiovale was the only reference tissue that showed excellent intra- and inter-observer agreement (ICC>0.85) and lowest CVs (<12.5 %). Bland-Altman analyses showed that mean differences for centrum semiovale were close to zero.

Conclusion

Selecting contralateral centrum semiovale as reference tissue for rCBV provides the lowest observer variability.

Key Points

• Reference tissue selection for rCBV measurements adds variability to rCBV measurements.

• rCBV measurements vary depending on the choice of reference tissue.

• Observer variability of reference tissue selection varies between poor and excellent.

• Centrum semiovale as reference tissue for rCBV provides the lowest observer variability.

Repeatability of apparent diffusion coefficient and intravoxel incoherent motion parameters at 3.0 Tesla in orbital lesions

OBJECTIVES

To evaluate repeatability of intravoxel incoherent motion (IVIM) diffusion-weighted imaging (DWI) parameters in the orbit.

METHODS

From December 2015 to March 2016, 22 patients were scanned twice using an IVIM sequence with 15b values (0-2,000 s/mm2) at 3.0T. Two readers independently delineated regions of interest in an orbital mass and in different intra-orbital and extra-orbital structures. Short-term test-retest repeatability and inter-observer agreement were assessed using the intra-class correlation coefficient (ICC), the coefficient of variation (CV) and Bland-Altman limits of agreements (BA-LA).

RESULTS

Test-retest repeatability of IVIM parameters in the orbital mass was satisfactory for ADC and D (mean CV 12% and 14%, ICC 95% and 93%), poor for f and D*(means CV 43% and 110%, ICC 90% and 65%). Inter-observer repeatability agreement was almost perfect in the orbital mass for all the IVIM parameters (ICC = 95%, 93%, 94% and 90% for ADC, D, f and D*, respectively).

CONCLUSIONS

IVIM appeared to be a robust tool to measure D in orbital lesions with good repeatability, but this approach showed a poor repeatability of f and D*.

KEY POINTS

• IVIM technique is feasible in the orbit. • IVIM has a good-acceptable repeatability of D (CV range 12-25 %). • IVIM interobserver repeatability agreement is excellent (ICC range 90-95 %). • f or D* provide higher test-retest and interobserver variabilities.

Reproducibility of dynamic contrast-enhanced MRI and dynamic susceptibility contrast MRI in the study of brain gliomas: a comparison of data obtained using different commercial software

PURPOSE

Dynamic susceptibility contrast MRI (DSC) and dynamic contrast-enhanced MRI (DCE) are useful tools in the diagnosis and follow-up of brain gliomas; nevertheless, both techniques leave the open issue of data reproducibility. We evaluated the reproducibility of data obtained using two different commercial software for perfusion maps calculation and analysis, as one of the potential sources of variability can be the software itself.

METHODS

DSC and DCE analyses from 20 patients with gliomas were tested for both the intrasoftware (as intraobserver and interobserver reproducibility) and the intersoftware reproducibility, as well as the impact of different postprocessing choices [vascular input function (VIF) selection and deconvolution algorithms] on the quantification of perfusion biomarkers plasma volume (Vp), volume transfer constant (K ^trans) and rCBV. Data reproducibility was evaluated with the intraclass correlation coefficient (ICC) and Bland-Altman analysis.

RESULTS

For all the biomarkers, the intra- and interobserver reproducibility resulted in almost perfect agreement in each software, whereas for the intersoftware reproducibility the value ranged from 0.311 to 0.577, suggesting fair to moderate agreement; Bland-Altman analysis showed high dispersion of data, thus confirming these findings. Comparisons of different VIF estimation methods for DCE biomarkers resulted in ICC of 0.636 for K ^trans and 0.662 for Vp; comparison of two deconvolution algorithms in DSC resulted in an ICC of 0.999.

CONCLUSIONS

The use of single software ensures very good intraobserver and interobservers reproducibility. Caution should be taken when comparing data obtained using different software or different postprocessing within the same software, as reproducibility is not guaranteed anymore.

Comparison of Voxel-Wise Tumor Perfusion Changes Measured With Dynamic Contrast-Enhanced (DCE) MRI and Volumetric DCE CT in Patients With Metastatic Brain Cancer Treated with Radiosurgery

Dynamic contrast-enhanced (DCE)-MRI metrics are evaluated against volumetric DCE-CT quantitative parameters as a standard for tracer-kinetic validation using a common 4-dimensional temporal dynamic analysis platform in tumor perfusion measurements following stereotactic radiosurgery (SRS) for brain metastases. Patients treated with SRS as part of Research Ethics Board-approved clinical trials underwent volumetric DCE-CT and DCE-MRI at baseline, then at 7 and 21 days after SRS. Temporal dynamic analysis was used to create 3-dimensional pharmacokinetic parameter maps for both modalities. Individual vascular input functions were selected for DCE-CT and a population function was used for DCE-MRI. Semiquantitative and pharmacokinetic DCE parameters were assessed using a modified Tofts model within each tumor at every time point for both modalities for characterization of perfusion and capillary permeability, as well as their dependency on precontrast relaxation times (TRs), T₁₀, and input function. Direct voxel-to-voxel Pearson analysis showed statistically significant correlations between CT and magnetic resonance which peaked at day 7 for K_trans (R = 0.74, P ≤ .0001). The strongest correlation to DCE-CT measurements was found with DCE-MRI analysis using voxel-wise T₁₀ maps (R = 0.575, P < .001) instead of assigning a fixed T₁₀ value. Comparison of histogram features showed statistically significant correlations between modalities over all tumors for median K_trans (R = 0.42, P = .01), median area under the enhancement curve (iAUC₉₀) (R = 0.55, P < .01), and median iAUC₉₀ skewness (R = 0.34, P = .03). Statistically significant, strong correlations were found for voxel-wise K_trans, iAUC₉₀, and v_e values between DCE-CT and DCE-MRI. For DCE-MRI, the implementation of voxel-wise T₁₀ maps plays a key role in ensuring the accuracy of heterogeneous pharmacokinetic maps.

Inter-reader reproducibility of dynamic contrast-enhanced magnetic resonance imaging in patients with non-small cell lung cancer treated with bevacizumab and erlotinib

Objectives When evaluating anti-tumor treatment response by dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) it is necessary to assure its validity and reproducibility. This has not been well addressed in lung tumors. Therefore we have evaluated the inter-reader reproducibility of response classification by DCE-MRI in patients with non-small cell lung cancer (NSCLC) treated with bevacizumab and erlotinib enrolled in a multicenter trial.

MATERIALS AND METHODS

Twenty-one patients were scanned before and 3 weeks after start of treatment with DCE-MRI in a multicenter trial. The scans were evaluated by two independent readers. The primary lung tumor was used for response assessment. Responses were assessed in terms of relative changes in tumor mean trans endothelial transfer rate (K(trans)) and its heterogeneity in terms of the spatial standard deviation. Reproducibility was expressed by the inter-reader variability, intra-class correlation coefficient (ICC) and dichotomous response classification.

RESULTS

The inter-reader variability and ICC for the relative K(trans) were 5.8% and 0.930, respectively. For tumor heterogeneity the inter-reader variability and ICC were 0.017 and 0.656, respectively. For the two readers the response classification for relative K(trans) was concordant in 20 of 21 patients (k=0.90, p<0.0001) and for tumor heterogeneity in 19 of 21 patients (k=0.80, p<0.0001).

CONCLUSIONS

Strong agreement was seen with regard to the inter-reader variability and reproducibility of response classification by the two readers of lung cancer DCE-MRI scans.

An open source software for analysis of dynamic contrast enhanced magnetic resonance images: UMMPerfusion revisited

Background

Perfusion imaging has become an important image based tool to derive the physiological information in various applications, like tumor diagnostics and therapy, stroke, (cardio-) vascular diseases, or functional assessment of organs. However, even after 20 years of intense research in this field, perfusion imaging still remains a research tool without a broad clinical usage. One problem is the lack of standardization in technical aspects which have to be considered for successful quantitative evaluation; the second problem is a lack of tools that allow a direct integration into the diagnostic workflow in radiology.

Results

Five compartment models, namely, a one compartment model (1CP), a two compartment exchange (2CXM), a two compartment uptake model (2CUM), a two compartment filtration model (2FM) and eventually the extended Toft’s model (ETM) were implemented as plugin for the DICOM workstation OsiriX. Moreover, the plugin has a clean graphical user interface and provides means for quality management during the perfusion data analysis. Based on reference test data, the implementation was validated against a reference implementation. No differences were found in the calculated parameters.

Conclusion

We developed open source software to analyse DCE-MRI perfusion data. The software is designed as plugin for the DICOM Workstation OsiriX. It features a clean GUI and provides a simple workflow for data analysis while it could also be seen as a toolbox providing an implementation of several recent compartment models to be applied in research tasks. Integration into the infrastructure of a radiology department is given via OsiriX. Results can be saved automatically and reports generated automatically during data analysis ensure certain quality control.

Quality Control and Reproducibility in M-Mode, Two-Dimensional, and Speckle Tracking Echocardiography Acquisition and Analysis: The CARDIA Study, Year 25 Examination Experience

INTRODUCTION

Few large studies describe quality control procedures and reproducibility findings in cardiovascular ultrasound, particularly in novel techniques such as speckle tracking echocardiography (STE). We evaluate the echocardiography assessment performance in the Coronary Artery Risk Development in Young Adults (CARDIA) study Year 25 (Y25) examination (2010-2011) and report findings from a quality control and reproducibility program conducted to assess Field Center image acquisition and reading center (RC) accuracy.

METHODS

The CARDIA Y25 examination had 3475 echocardiograms performed in 4 US Field Centers and analyzed in a RC, assessing standard echocardiography (LA dimension, aortic root, LV mass, LV end-diastolic volume [LVEDV], ejection fraction [LVEF]), and STE (two- and four-chamber longitudinal, circumferential, and radial strains). Reproducibility was assessed using intraclass correlation coefficients (ICC), coefficients of variation (CV), and Bland-Altman plots.

RESULTS

For standard echocardiography reproducibility, LV mass and LVEDV consistently had CV above 10% and aortic root below 6%. Intra-sonographer aortic root and LV mass had the most robust values of ICC in standard echocardiography. For STE, the number of properly tracking segments was above 80% in short-axis and four-chamber and 58% in two-chamber views. Longitudinal strain parameters were the most robust and radial strain showed the highest variation. Comparing Field Centers with echocardiography RC STE readings, mean differences ranged from 0.4% to 4.1% and ICC from 0.37 to 0.66, with robust results for longitudinal strains.

CONCLUSION

Echocardiography image acquisition and reading processes in the CARDIA study were highly reproducible, including robust results for STE analysis. Consistent quality control may increase the reliability of echocardiography measurements in large cohort studies.

The reliability of routine clinical post-processing software in assessing potential diffusion-weighted MRI "biomarkers" in brain metastases

BACKGROUND AND PURPOSE

Diffusion MRI characteristics have been used as biomarkers to guide prognosis in cerebral pathologies including brain metastases. The measurement of ADC is often described poorly in clinical and research studies with little detail given to the practical considerations of where to place ROIs, which post processing software package to use and how reproducible the resulting metrics will be.

METHOD

We investigated a series of 12 patients with brain metastases and preoperative DWI. Three post processing platforms were used. ROI were placed over the tumour, peritumoural region and across the brain-tumour interface. These recordings were made by a neurosurgeon and a neuroradiologist. Inter-intra-observer variability was assessed using Bland-Altman analysis. An exploratory analysis of DWI with overall survival and tumour type was made.

RESULTS

There was excellent correlation between the software packages used for all measures including assessing the whole tumour, selective regions with lowest ADC, the change of ADC across the brain-tumour interface and the relation of the tumour ADC to peritumoural regions and the normal white matter. There was no significant inter- or intra-observer variability for repeated readings. There were significant differences in the mean values obtained using different methodologies and different metrics had differing relationships to overall survival and primary tumour of origin.

CONCLUSION

Diffusion weighted MRI metrics offer promise as potential non-invasive biomarkers in brain metastases and a variety of metrics have been shown to be reliably measured using differing platforms and observers.