Observer variability of reference tissue selection for relativecerebral blood volume measurements in glioma patients

How to evaluate perfusion imaging in post-treatment glioma: a comparison of three different analysis methods

INTRODUCTION

Dynamic susceptibility contrast (DSC) perfusion weighted (PW)-MRI can aid in differentiating treatment related abnormalities (TRA) from tumor progression (TP) in post-treatment glioma patients. Common methods, like the 'hot spot', or visual approach suffer from oversimplification and subjectivity. Using perfusion of the complete lesion potentially offers an objective and accurate alternative. This study aims to compare the diagnostic value and assess the subjectivity of these techniques.

METHODS

50 Glioma patients with enhancing lesions post-surgery and chemo-radiotherapy were retrospectively included. Outcome was determined by clinical/radiological follow-up or biopsy. Imaging analysis used the 'hot spot', volume of interest (VOI) and visual approach. Diagnostic accuracy was compared using receiving operator characteristics (ROC) curves for the VOI and 'hot spot' approach, visual assessment was analysed with contingency tables. Inter-operator agreement was determined with Cohens kappa and intra-class coefficient (ICC).

RESULTS

29 Patients suffered from TP, 21 had TRA. The visual assessment showed poor to substantial inter-operator agreement (κ = -0.72 - 0.68). Reliability of the 'hot spot' placement was excellent (ICC = 0.89), while reference placement was variable (ICC = 0.54). The area under the ROC (AUROC) of the mean- and maximum relative cerebral blood volume (rCBV) (VOI-analysis) were 0.82 and 0.72, while the rCBV-ratio ('hot spot' analysis) was 0.69. The VOI-analysis had a more balanced sensitivity and specificity compared to visual assessment.

CONCLUSIONS

VOI analysis of DSC PW-MRI data holds greater diagnostic accuracy in single-moment differentiation of TP and TRA than 'hot spot' or visual analysis. This study underlines the subjectivity of visual placement and assessment.

Reproducibility of rCBV in glioblastomas using T2*-weighted perfusion MRI: an evaluation of sampling, normalization, and experience

PURPOSE

The reproducibility of relative cerebral blood volume (rCBV) measurements among readers with different levels of experience is a concern. This study aimed to investigate the inter-reader reproducibility of rCBV measurement of glioblastomas using the hotspot method in dynamic susceptibility contrast perfusion magnetic resonance imaging (DSC-MRI) with various strategies.

METHODS

In this institutional review board-approved single-center study, 30 patients with glioblastoma were retrospectively evaluated with DSC-MRI at a 3.0 Tesla scanner. Three groups of reviewers, including neuroradiologists, general radiologists, and radiology residents, calculated the rCBV based on the number of regions of interest (ROIs) and reference areas. For statistical analysis of feature reproducibility, the intraclass correlation coefficient (ICC) and Bland-Altman plots were used. Analyses were made among individuals, reader groups, reader-group pooling, and a population that contained all of them.

RESULTS

For individuals, the highest inter-reader reproducibility was observed between neuroradiologists [ICC: 0.527; 95% confidence interval (CI): 0.21-0.74] and between residents (ICC: 0.513; 95% CI: 0.20-0.73). There was poor reproducibility in the analyses of individuals with different levels of experience (ICC range: 0.296-0.335) and in reader-wise and group-wise pooling (ICC range: 0.296-0.335 and 0.397-0.427, respectively). However, an increase in ICC values was observed when five ROIs were used. In an analysis of all strategies, the ICC for the centrum semiovale was significantly higher than that for contralateral white matter (P < 0.001).

CONCLUSION

The inter-reader reproducibility of rCBV measurement was poor to moderate regardless of whether it was calculated by neuroradiologists, general radiologists, or residents, which may indicate the need for automated methods. Choosing five ROIs and using the centrum semiovale as a reference area may increase reliability for all users.

Challenges and opportunities for advanced neuroimaging of glioblastoma

Glioblastoma is the most aggressive of glial tumours in adults. On conventional magnetic resonance (MR) imaging, these tumours are observed as irregular enhancing lesions with areas of infiltrating tumour and cortical expansion. More advanced imaging techniques including diffusion-weighted MRI, perfusion-weighted MRI, MR spectroscopy and positron emission tomography (PET) imaging have found widespread application to diagnostic challenges in the setting of first diagnosis, treatment planning and follow-up. This review aims to educate readers with regard to the strengths and weaknesses of the clinical application of these imaging techniques. For example, this review shows that the (semi)quantitative analysis of the mentioned advanced imaging tools was found useful for assessing tumour aggressiveness and tumour extent, and aids in the differentiation of tumour progression from treatment-related effects. Although these techniques may aid in the diagnostic work-up and (post-)treatment phase of glioblastoma, so far no unequivocal imaging strategy is available. Furthermore, the use and further development of artificial intelligence (AI)-based tools could greatly enhance neuroradiological practice by automating labour-intensive tasks such as tumour measurements, and by providing additional diagnostic information such as prediction of tumour genotype. Nevertheless, due to the fact that advanced imaging and AI-diagnostics is not part of response assessment criteria, there is no harmonised guidance on their use, while at the same time the lack of standardisation severely hampers the definition of uniform guidelines.

Reliability of dynamic susceptibility contrast perfusion metrics in pre- and post-treatment glioma

Background

In neuro-oncology, dynamic susceptibility contrast magnetic resonance (DSC-MR) perfusion imaging emerged as a tool to aid in the diagnostic work-up and to surveil effectiveness of treatment. However, it is believed that a significant variability exists with regard to the measured in DSC-MR perfusion parameters. The aim of this study was to assess the observer variability in measured DSC-MR perfusion parameters in patients before and after treatment. In addition, we investigated whether region-of-interest (ROI) shape impacted the observer variability.

Materials and methods

Twenty non-treated patients and a matched group of twenty patients post-treatment (neurosurgical resection and post-chemoradiotherapy) were included. Six ROIs were independently placed by three readers: circular ROIs and polygonal ROIs covering 1) the tumor hotspot; 2) the peritumoral region (T2/FLAIR-hyperintense region) and 3) the whole tumor region. A two-way random Intra-class coefficient (ICC) model was used to assess variability in measured DSC-MRI perfusion parameters. The perfusion metrics as assessed by the circular and the polygonal ROI were compared by use of the dependent T-test.

Results

In the non-treated group, circular ROIs showed good–excellent overlap (ICC-values ranging from 0.741–0.963) with the exception of those representing the tumor hotspot. Polygonal ROIs showed lower ICC-values, ranging from 0.113 till 0.856. ROI-placement in the posttreatment group showed to be highly variable with a significant deterioration of ICC-values. Furthermore, perfusion metric assessment in similar tumor regions was not impacted by ROI shape.

Discussion

This study shows that posttreatment quantitative interpretation of DSC-MR perfusion imaging is highly variable and should be carried out with precaution. Pretreatment assessment of DSC-MR images, however, could be carried out be a single reader in order to provide valid data for further analyses.

• DSC-MR perfusion imaging measurements in non-treated glioma is highly reliable between readers, even readers with little experience.

• DSC-MR perfusion imaging measurements in treated glioma is show to be inconsistent between readers.

• When using DSC-MR perfusion imaging as a quantitative surveillance tool for the recurrence of glioma after treatment, double-reading should be preferred.

Reproducibility of volume analysis of dynamic susceptibility contrast perfusion-weighted imaging in untreated glioblastomas

PURPOSE

Despite a high variability, the hotspot method is widely used to calculate the cerebral blood volume (CBV) of glioblastomas on DSC-MRI. Our aim was to investigate inter- and intra-observer reproducibility of parameters calculated with the hotspot or a volume method and that of an original parameter assessing the fraction of pixels in the tumour volume displaying rCBV > 2: %rCBV > 2.

METHODS

Twenty-seven consecutive patients with untreated glioblastoma (age: 63, women: 11) were retrospectively included. Three observers calculated the maximum tumour CBV value (rCBVmax) normalized with a reference ROI in the contralateral white matter (CBVWM) with (i) the hotspot method and (ii) with a volume method following tumour segmentation on 3D contrast-enhanced T1-WI. From this volume method, %rCBV > 2 was also assessed. After 8-12 weeks, one observer repeated all delineations. Intraclass (ICC) and Lin's (LCC) correlation coefficients were used to determine reproducibility.

RESULTS

Inter-observer reproducibility of rCBVmax was fair with the hotspot and good with the volume method (ICC = 0.46 vs 0.65, p > 0.05). For CBVWM, it was fair with the hotspot and excellent with the volume method (0.53 vs 0.84, p < 0.05). Reproducibility of one pairwise combination of observers was significantly better for both rCBVmax and CBVWM (LCC = 0.33 vs 0.75; 0.52 vs 0.89, p < 0.05). %rCBV > 2 showed excellent inter- and intra-observer reproducibility (ICC = 0.94 and 0.91).

CONCLUSION

Calculated in glioblastomas with a volume method, rCBVmax and CBVWM yielded good to excellent reproducibility but only fair with the hotspot method. Overall, the volume analysis offers a highly reproducible parameter, %rCBV > 2, that could be promising during the follow-up of such heterogeneous tumours.

Differentiation Between Primary Central Nervous System Lymphoma and Atypical Glioblastoma Based on MRI Morphological Feature and Signal Intensity Ratio: A Retrospective Multicenter Study

Objectives

To investigate the value of morphological feature and signal intensity ratio (SIR) derived from conventional magnetic resonance imaging (MRI) in distinguishing primary central nervous system lymphoma (PCNSL) from atypical glioblastoma (aGBM).

Methods

Pathology-confirmed PCNSLs (n = 93) or aGBMs (n = 48) from three institutions were retrospectively enrolled and divided into training cohort (n = 98) and test cohort (n = 43). Morphological features and SIRs were compared between PCNSL and aGBM. Using linear discriminant analysis, multiple models were constructed with SIRs and morphological features alone or jointly, and the diagnostic performances were evaluated via receiver operating characteristic (ROC) analysis. Areas under the curves (AUCs) and accuracies (ACCs) of the models were compared with the radiologists’ assessment.

Results

Incision sign, T₂ pseudonecrosis sign, reef sign and peritumoral leukomalacia sign were associated with PCNSL (training and overall cohorts, P < 0.05). Increased T₁ ratio, decreased T₂ ratio and T₂/T₁ ratio were predictive of PCNSL (all P < 0.05). ROC analysis showed that combination of morphological features and SIRs achieved the best diagnostic performance for differentiation of PCNSL and aGBM with AUC/ACC of 0.899/0.929 for the training cohort, AUC/ACC of 0.794/0.837 for the test cohort and AUC/ACC of 0.869/0.901 for the overall cohort, respectively. Based on the overall cohort, two radiologists could distinguish PCNSL from aGBM with AUC/ACC of 0.732/0.724 for radiologist A and AUC/ACC of 0.811/0.829 for radiologist B.

Conclusion

MRI morphological features can help differentiate PCNSL from aGBM. When combined with SIRs, the diagnostic performance was better than that of radiologists’ assessment.

Amide proton transfer-weighted MRI in the clinical setting - correlation with dynamic susceptibility contrast perfusion in the post-treatment imaging of adult glioma patients at 3T

INTRODUCTION

We investigated the correlation between amide proton transfer-weighted magnetic resonance imaging (APTw MRI) and dynamic susceptibility contrast (DSC) perfusion in order to assess the potential of APTw MRI as an alternative to DSC in adult brain tumor (glioma) imaging.

METHODS

After Ethical Committee approval, forty adult patients, treated for histopathologically confirmed glioma (World Health Organization (WHO) grade II-IV), were prospectively imaged at 3 Tesla (3 T) with DSC perfusion and a commercially available three-dimensional (3D) APTw sequence. Two consultant neuroradiologists independently performed region of interest (ROI) measurements on relative cerebral blood volume (rCBV) and APTw maps, co-registered with anatomical images. The correlation APTw MRI-DSC perfusion was assessed using Spearman's rank-order test. Inter-observer agreement was evaluated by the intraclass correlation coefficient (ICC) and Bland-Altman (BA) plots.

RESULTS

A statistically significant moderately strong positive correlation was observed between maximum rCBV (rCBV_max) and maximum APTw (APTw_max) values (observer 1: r = 0.73; p < 0.01; observer 2: r = 0.62; p < 0.01). We found good inter-observer agreement for APTw_max (ICC = 0.82; 95% confidence interval (CI) 0.66-0.90), with somewhat broad outer 95% CI for the BA Limits of Agreement (LoA) (-1.6 to 1.9). ICC for APTw_max was higher than ICC for rCBV_max (ICC = 0.74; 95%; CI 0.50-0.86), but the difference was not statistically significant.

CONCLUSION

APTw_max values correlate positively with rCBV_max in patients treated for brain glioma. APTw imaging is a reproducible technique, with some observer dependence. Results need to be confirmed by a larger population analysis.

IMPLICATIONS FOR PRACTICE

APTw MRI can be a useful addition to glioma follow-up imaging and a potential alternative to DSC perfusion, especially in patients where contrast agent is contraindicated.

Differentiation between primary CNS lymphoma and atypical glioblastoma according to major genomic alterations using diffusion and susceptibility-weighted MR imaging

PURPOSE

We aimed to differentiate primary central nervous system lymphoma (PCNSL) from atypical glioblastoma (GB) and distinguish major genomic subtypes between these tumors using susceptibility-weighted imaging (SWI) along with diffusion-weighted imaging (DWI).

METHODS

Thirty-one immuno-competent patients with PCNSL stratified by BCL2 and MYC rearrangement, and 57 patients with atypical GB (no visible necrosis) grouped according to isocitrate dehydrogenase-1 (IDH1) mutation status underwent 3.0-Tesla MRI before treatment in this retrospective study. Region of interest analysis with apparent diffusion coefficient (ADC) and SWI signal intensity values of the tumors were normalized by dividing those of contralateral white matter. The independent-samples t-test and Kruskal-Wallis test were utilized to compare parameters. The diagnostic ability of each parameter and their optimal combination was evaluated by logistic regression analysis and receiver operating characteristic.

RESULTS

PCNSL with rearrangement of both MYC and BCL2 (n = 7) [mean relative (r) ADCmean:0.87 ± 0.06, rADCmin:0.72 ± 0.08] demonstrated significantly lower rADCmean, and rADCmin compared to other PCNSLs (n = 24) (rADCmean:1.19 ± 0.18, rADCmin:1.03 ± 0.17;p < 0.001) and GBs (p < 0.001). GB without IDH1 mutation (n = 44) (mean rSWI value:0.95 ± 0.15) demonstrated significantly lower rSWI value compared to GB with IDH1 mutation (n = 13) (rSWI value:1.13 ± 0.09;p < 0.001) and PCNSL (p < 0.001). The incorporation of rADCmean and rSWI parameters distinguished GB with IDH1 mutation [Area under the curve (AUC):0.985] with sensitivity and specificity of 94.3 and 100 % respectively; and PCNSL with rearrangement of both MYC and BCL2 (AUC:0.982) with sensitivity and specificity of 100 % and 95.4 %, respectively. CONCLUSıONS: Combined analysis of SWI and DWI could differentiate atypical GB from PCNSL and distinguish major genomic subtypes between these tumors.

Discrimination between Glioblastoma and Solitary Brain Metastasis: Comparison of Inflow-Based Vascular-Space-Occupancy and Dynamic Susceptibility Contrast MR Imaging

BACKGROUND AND PURPOSE

Accurate differentiation between glioblastoma and solitary brain metastasis is of vital importance clinically. This study aimed to investigate the potential value of the inflow-based vascular-space-occupancy MR imaging technique, which has no need for an exogenous contrast agent, in differentiating glioblastoma and solitary brain metastasis and to compare it with DSC MR imaging.

MATERIALS AND METHODS

Twenty patients with glioblastoma and 22 patients with solitary brain metastasis underwent inflow-based vascular-space-occupancy and DSC MR imaging with a 3T clinical scanner. Two neuroradiologists independently measured the maximum inflow-based vascular-space-occupancy-derived arteriolar CBV and DSC-derived CBV values in intratumoral regions and peritumoral T2-hyperintense regions, which were normalized to the contralateral white matter (relative arteriolar CBV and relative CBV, inflow-based vascular-space-occupancy relative arteriolar CBV, and DSC-relative CBV). The intraclass correlation coefficient, Student t test, or Mann-Whitney U test and receiver operating characteristic analysis were performed.

RESULTS

All parameters of both regions had good or excellent interobserver reliability (0.74∼0.89). In peritumoral T2-hyperintese regions, DSC-relative CBV (P < .001), inflow-based vascular-space-occupancy arteriolar CBV (P = .001), and relative arteriolar CBV (P = .005) were significantly higher in glioblastoma than in solitary brain metastasis, with areas under the curve of 0.94, 0.83, and 0.72 for discrimination, respectively. In the intratumoral region, both inflow-based vascular-space-occupancy arteriolar CBV and relative arteriolar CBV were significantly higher in glioblastoma than in solitary brain metastasis (both P < .001), with areas under the curve of 0.91 and 0.90, respectively. Intratumoral DSC-relative CBV showed no significant difference (P = .616) between the 2 groups.

CONCLUSIONS

Inflow-based vascular-space-occupancy has the potential to discriminate glioblastoma from solitary brain metastasis, especially in the intratumoral region.

Vascular habitat analysis based on dynamic susceptibility contrast perfusion MRI predicts IDH mutation status and prognosis in high-grade gliomas

OBJECTIVE

The current study aimed to evaluate the clinical practice for hemodynamic tissue signature (HTS) method in IDH genotype prediction in three groups derived from high-grade gliomas.

METHODS

Preoperative MRI examinations of 44 patients with known grade and IDH genotype were assigned into three study groups: glioblastoma multiforme, grade III, and high-grade gliomas. Perfusion parameters were analyzed and were used to automatically draw the four reproducible habitats (high-angiogenic enhancing tumor habitats, low-angiogenic enhancing tumor habitats, infiltrated peripheral edema habitats, vasogenic peripheral edema habitats) related to vascular heterogeneity. These four habitats were then compared between inter-patient with IDH mutation and their wild-type counterparts at these three groups, respectively. The discriminating potential for HTS in assessing IDH mutation status prediction was assessed by ROC curves.

RESULTS

Compared with IDH wild type, IDH mutation had significantly decreased relative cerebral blood volume (rCBV) at the high-angiogenic enhancing tumor habitats and low-angiogenic enhancing tumor habitats. ROC analysis revealed that the rCBVs in habitats had great ability to discriminate IDH mutation from their wild type in all groups. In addition, the Kaplan-Meier survival analysis yielded significant differences for the survival times observed from the populations dichotomized by low (< 4.31) and high (> 4.31) rCBV in the low-angiogenic enhancing tumor habitat.

CONCLUSIONS

The HTS method has been proven to have high prediction capabilities for IDH mutation status in high-grade glioma patients, providing a set of quantifiable habitats associated with tumor vascular heterogeneity.

KEY POINTS

• The HTS method has a high accuracy for molecular stratification prediction for all subsets of HGG. • The HTS method can give IDH mutation-related hemodynamic information of tumor-infiltrated and vasogenic edema. • IDH-relevant rCBV difference in habitats will be a great prognosis factor in HGG.

Dynamic susceptibility MR perfusion in diagnosing recurrent brain metastases after radiotherapy: A systematic review and meta-analysis

Background

The diagnostic performance of dynamic susceptibility contrast (DSC) MR perfusion in discriminating treatment‐related changes from recurrence in irradiated brain metastases is currently not completely clear.

Purpose

To systematically review the accuracy of DSC MR perfusion in diagnosing recurrent brain metastases after radiotherapy.

Study Type

Systematic review and meta‐analysis.

Subjects

MEDLINE and Embase were searched for original studies investigating the accuracy of DSC MR perfusion in diagnosing recurrent brain metastases after radiotherapy. Ten studies, comprising a total of more than 271 metastases, were included.

Field Strength/Sequence

1.5T or 3.0T, DSC MR perfusion.

Assessment

Quality assessment was performed according to the Quality Assessment of Diagnostic Accuracy Studies‐2 tool.

Statistical Tests

Sensitivity and specificity were pooled with a bivariate random‐effects model. Heterogeneity was assessed by a chi‐squared test. Potential sources for heterogeneity were explored by subgroup analyses.

Results

In seven studies the diagnostic criterion was not prespecified. In eight studies it was unclear whether the reference standard was interpreted blindly. In seven studies it was unclear whether DSC MR perfusion results influenced which reference standard was used. Pooled sensitivity and specificity were 81.6% (95% confidence interval [CI]: 70.6%, 89.1%) and 80.6% (95% CI: 64.2%, 90.6%), respectively. There was significant heterogeneity in both sensitivity (P = 0.005) and specificity (P < 0.001). There were no significant differences in relative diagnostic odds ratio according to publication year, country of origin, study size, and DSC MR perfusion interpretation method (visual analysis of cerebral blood volume [CBV] map vs. relative CBV measurement) (P > 0.2). Due to insufficiently detailed reporting, it was not possible to investigate the influence of primary tumor origin on accuracy.

Data Conclusion

Our results suggest that the accuracy of DSC MR perfusion in diagnosing recurrent brain metastases after radiotherapy is fairly high. However, these findings should be interpreted with caution because of methodological quality concerns and heterogeneity between studies.

Level of Evidence: 3

Technical Efficacy: Stage 2

J. Magn. Reson. Imaging 2020;51:524–534.