Repeatability and Reproducibility of ADC Histogram Metrics from the ACRIN 6698 Breast Cancer Therapy Response Trial

The QIBA Profile for Diffusion-Weighted MRI: Apparent Diffusion Coefficient as a Quantitative Imaging Biomarker

The apparent diffusion coefficient (ADC) provides a quantitative measure of water mobility that can be used to probe alterations in tissue microstructure due to disease or treatment. Establishment of the accepted level of variance in ADC measurements for each clinical application is critical for its successful implementation. The Diffusion-Weighted Imaging Biomarker Committee of the Quantitative Imaging Biomarkers Alliance (QIBA) has recently advanced the ADC Profile from the consensus to clinically feasible stage for the brain, liver, prostate, and breast. This profile distills multiple studies on ADC repeatability and describes detailed procedures to achieve stated performance claims on an observed ADC change within acceptable confidence limits. In addition to reviewing the current ADC Profile claims, this report has used recent literature to develop proposed updates for establishing metrology benchmarks for mean lesion ADC change that account for measurement variance. Specifically, changes in mean ADC exceeding 8% for brain lesions, 27% for liver lesions, 27% for prostate lesions, and 15% for breast lesions are claimed to represent true changes with 95% confidence. This report also discusses the development of the ADC Profile, highlighting its various stages, and describes the workflow essential to achieving a standardized implementation of advanced quantitative diffusion-weighted MRI in the clinic. The presented QIBA ADC Profile guidelines should enable successful clinical application of ADC as a quantitative imaging biomarker and ensure reproducible ADC measurements that can be used to confidently evaluate longitudinal changes and treatment response for individual patients.

Fat Fraction Extracted from Whole-Body Magnetic Resonance (WB-MR) in Bone Metastatic Prostate Cancer: Intra- and Inter-Reader Agreement of Single-Slice and Volumetric Measurements

BACKGROUND

This study evaluates the repeatability and reproducibility of fat-fraction percentage (FF%) in whole-body magnetic resonance imaging (WB-MRI) of prostate cancer patients with bone metastatic hormone naive disease.

METHODS

Patients were selected from the database of a prospective phase-II trial. The treatment response was assessed using the METastasis Reporting and Data System for Prostate (MET-RADS-P). Two operators identified a Small Active Lesion (SAL, <10 mm) and a Large Active Lesion (LAL, ≥10 mm) per patient, performing manual segmentation of lesion volume and the largest cross-sectional area. Measurements were repeated by one operator after two weeks. Intra- and inter-reader agreements were assessed via Interclass Correlation Coefficient (ICC) on first-order radiomics features.

RESULTS

Intra-reader ICC showed high repeatability for both SAL and LAL in a single slice (SS) and volumetric (VS) measurements with values ranging from 0.897 to 0.971. Inter-reader ICC ranged from 0.641 to 0.883, indicating moderate to good reproducibility. Spearman's rho analysis confirmed a strong correlation between SS and VS measurements for SAL (0.817) and a moderate correlation for LAL (0.649). Both intra- and inter-rater agreement exceeded 0.75 for multiple first-order features across lesion sizes.

CONCLUSION

This study suggests that FF% measurements are reproducible, particularly for larger lesions in both SS and VS assessments.

Breast Multiparametric MRI for Prediction of Neoadjuvant Chemotherapy Response in Breast Cancer: The BMMR2 Challenge

Purpose To describe the design, conduct, and results of the Breast Multiparametric MRI for prediction of neoadjuvant chemotherapy Response (BMMR2) challenge. Materials and Methods The BMMR2 computational challenge opened on May 28, 2021, and closed on December 21, 2021. The goal of the challenge was to identify image-based markers derived from multiparametric breast MRI, including diffusion-weighted imaging (DWI) and dynamic contrast-enhanced (DCE) MRI, along with clinical data for predicting pathologic complete response (pCR) following neoadjuvant treatment. Data included 573 breast MRI studies from 191 women (mean age [±SD], 48.9 years ± 10.56) in the I-SPY 2/American College of Radiology Imaging Network (ACRIN) 6698 trial (ClinicalTrials.gov: NCT01042379). The challenge cohort was split into training (60%) and test (40%) sets, with teams blinded to test set pCR outcomes. Prediction performance was evaluated by area under the receiver operating characteristic curve (AUC) and compared with the benchmark established from the ACRIN 6698 primary analysis. Results Eight teams submitted final predictions. Entries from three teams had point estimators of AUC that were higher than the benchmark performance (AUC, 0.782 [95% CI: 0.670, 0.893], with AUCs of 0.803 [95% CI: 0.702, 0.904], 0.838 [95% CI: 0.748, 0.928], and 0.840 [95% CI: 0.748, 0.932]). A variety of approaches were used, ranging from extraction of individual features to deep learning and artificial intelligence methods, incorporating DCE and DWI alone or in combination. Conclusion The BMMR2 challenge identified several models with high predictive performance, which may further expand the value of multiparametric breast MRI as an early marker of treatment response. Clinical trial registration no. NCT01042379 Keywords: MRI, Breast, Tumor Response Supplemental material is available for this article. © RSNA, 2024.

Improved Repeatability of Mouse Tibia Volume Segmentation in Murine Myelofibrosis Model Using Deep Learning

A murine model of myelofibrosis in tibia was used in a co-clinical trial to evaluate segmentation methods for application of image-based biomarkers to assess disease status. The dataset (32 mice with 157 3D MRI scans including 49 test-retest pairs scanned on consecutive days) was split into approximately 70% training, 10% validation, and 20% test subsets. Two expert annotators (EA1 and EA2) performed manual segmentations of the mouse tibia (EA1: all data; EA2: test and validation). Attention U-net (A-U-net) model performance was assessed for accuracy with respect to EA1 reference using the average Jaccard index (AJI), volume intersection ratio (AVI), volume error (AVE), and Hausdorff distance (AHD) for four training scenarios: full training, two half-splits, and a single-mouse subsets. The repeatability of computer versus expert segmentations for tibia volume of test-retest pairs was assessed by within-subject coefficient of variance (%wCV). A-U-net models trained on full and half-split training sets achieved similar average accuracy (with respect to EA1 annotations) for test set: AJI = 83-84%, AVI = 89-90%, AVE = 2-3%, and AHD = 0.5 mm-0.7 mm, exceeding EA2 accuracy: AJ = 81%, AVI = 83%, AVE = 14%, and AHD = 0.3 mm. The A-U-net model repeatability wCV [95% CI]: 3 [2, 5]% was notably better than that of expert annotators EA1: 5 [4, 9]% and EA2: 8 [6, 13]%. The developed deep learning model effectively automates murine bone marrow segmentation with accuracy comparable to human annotators and substantially improved repeatability.

Readout-Segmented Echo-Planar Diffusion-Weighted MR Imaging Improves the Differentiation of Breast Cancer Receptor Statuses Compared With Conventional Diffusion-Weighted Imaging

BACKGROUND

Readout-segmented echo-planar diffusion-weighted imaging (RS-EPI) can improve image quality and signal-to-noise ratio, the resulting apparent diffusion coefficient (ADC) value acts as a more sensitive biomarker to characterize tumors. However, data regarding the differentiation of breast cancer (BC) receptor statuses using RS-EPI are limited.

PURPOSE

To determine whether RS-EPI improves the differentiation of receptor statuses compared with conventional single-shot (SS) EPI in breast MRI.

STUDY TYPE

Retrospective.

POPULATION

A total of 151 BC women with the mean age of 50.6 years.

FIELD STRENGTH/SEQUENCE

A 3 T/ RS-EPI and SS-EPI.

ASSESSMENT

The ADCs of the lesion and normal background tissue from the two sequences were collected by two radiologists with 15 years of experience working of breast MRI (M.H.Z. and X.F.C.), and a normalized ADC was calculated by dividing the mean ADC value of the lesion by the mean ADC value of the normal background tissue.

STATISTICAL TESTS

Agreement between the ADC measurements from the two sequences was assessed using the Pearson correlation coefficient and Bland-Altman plots. One-way analysis of variance, Kruskal-Wallis test, and median difference were used to compare the ADC measurements for all lesions and different receptor statuses. A P value less than 0.05 indicated a significant result.

RESULTS

The ADC measurements of all lesions and normal background tissues were significantly higher on RS-EPI than on SS-EPI (1.82 ± 0.33 vs. 1.55 ± 0.30 and 0.83 ± 0.11 vs. 0.79 ± 0.10). The normalized ADC was lower on RS-EPI than on SS-EPI (0.47 ± 0.11 vs. 0.53 ± 0.12, a median difference of -0.04 [95% CI: -0.256 to 0.111]). For both diffusion methods, only the ADC measurement of RS-EPI was higher for human epidermal growth factor receptor-2 (HER-2)-positive tumors than for HER-2-negative tumors (0.87 ± 0.10 vs. 0.81 ± 0.11), and this measurement was associated with HER-2 positive status (adjusted odds ratio [OR] = 654.4); however, similar results were not observed for the ADC measurement of SS-EPI (0.80 ± 0.10 vs. 0.78 ± 0.11 with P = 0.199 and adjusted OR = 0.21 with P = 0.464, respectively).

DATA CONCLUSION

RS-EPI can improve the distinction between HER-2-positive and HER-2-negative breast cancer, complementing the clinical application of diffusion imaging.

EVIDENCE LEVEL

3 TECHNICAL EFFICACY: Stage 1.

The value of dynamic contrast-enhanced magnetic resonance imaging combined with apparent diffusion coefficient in the differentiation of benign and malignant diseases of the breast

BACKGROUND

The value of combined dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) and apparent diffusion coefficient (ADC) histogram analysis for the diagnosis of breast cancer has not been evaluated in previous studies.

PURPOSE

To investigate the diagnostic value of DCE-MRI combined with ADC in benign and malignant breast lesions.

MATERIAL AND METHODS

The clinicopathological imaging data included 168 patients (177 lesions) with breast lesions who underwent convention breast MRI, DCE-MRI, and diffusion-weighted imaging (DWI); they were divided into the benign lesion group (n = 39) and malignant lesion group (n = 129) based on pathology.

RESULTS

Using the type III outflow curve as a diagnostic criterion for malignant breast lesions, the diagnostic sensitivity was 76.9%, the specificity was 80%, the correct rate was 72.2%, and its area under the curve (AUC) was 0.823. Using an enhancement ratio > 100% as a diagnostic criterion for malignant breast lesions, the sensitivity was 61.5%, specificity was 80%, and AUC was 0.723. Using > 3 ipsilateral vessels as a diagnostic criterion for malignant lesions in the breast resulted in a diagnostic sensitivity of 81.6%, a specificity of 80.8%, and an AUC of 0.805.

CONCLUSION

The type of time intensity curve DCE-MRI, the early enhancement rate in the first phase, the number of ipsilateral vessels, and the ADC full volume histogram of the blood supply score and DWI are valuable in the diagnosis of benign and malignant breast lesions.

Impact of Alternate b-Value Combinations and Metrics on the Predictive Performance and Repeatability of Diffusion-Weighted MRI in Breast Cancer Treatment: Results from the ECOG-ACRIN A6698 Trial

In diffusion-weighted MRI (DW-MRI), choice of b-value influences apparent diffusion coefficient (ADC) values by probing different aspects of the tissue microenvironment. As a secondary analysis of the multicenter ECOG-ACRIN A6698 trial, the purpose of this study was to investigate the impact of alternate b-value combinations on the performance and repeatability of tumor ADC as a predictive marker of breast cancer treatment response. The final analysis included 210 women who underwent standardized 4-b-value DW-MRI (b = 0/100/600/800 s/mm2) at multiple timepoints during neoadjuvant chemotherapy treatment and a subset (n = 71) who underwent test−retest scans. Centralized tumor ADC and perfusion fraction (fp) measures were performed using variable b-value combinations. Prediction of pathologic complete response (pCR) based on the mid-treatment/12-week percent change in each metric was estimated by area under the receiver operating characteristic curve (AUC). Repeatability was estimated by within-subject coefficient of variation (wCV). Results show that two-b-value ADC calculations provided non-inferior predictive value to four-b-value ADC calculations overall (AUCs = 0.60−0.61 versus AUC = 0.60) and for HR+/HER2− cancers where ADC was most predictive (AUCs = 0.75−0.78 versus AUC = 0.76), p < 0.05. Using two b-values (0/600 or 0/800 s/mm2) did not reduce ADC repeatability over the four-b-value calculation (wCVs = 4.9−5.2% versus 5.4%). The alternate metrics ADCfast (b ≤ 100 s/mm2), ADCslow (b ≥ 100 s/mm2), and fp did not improve predictive performance (AUCs = 0.54−0.60, p = 0.08−0.81), and ADCfast and fp demonstrated the lowest repeatability (wCVs = 6.71% and 12.4%, respectively). In conclusion, breast tumor ADC calculated using a simple two-b-value approach can provide comparable predictive value and repeatability to full four-b-value measurements as a marker of treatment response.

Twenty Years On: RECIST as a Biomarker of Response in Solid Tumours an EORTC Imaging Group - ESOI Joint Paper

Response evaluation criteria in solid tumours (RECIST) v1.1 are currently the reference standard for evaluating efficacy of therapies in patients with solid tumours who are included in clinical trials, and they are widely used and accepted by regulatory agencies. This expert statement discusses the principles underlying RECIST, as well as their reproducibility and limitations. While the RECIST framework may not be perfect, the scientific bases for the anticancer drugs that have been approved using a RECIST-based surrogate endpoint remain valid. Importantly, changes in measurement have to meet thresholds defined by RECIST for response classification within thus partly circumventing the problems of measurement variability. The RECIST framework also applies to clinical patients in individual settings even though the relationship between tumour size changes and outcome from cohort studies is not necessarily translatable to individual cases. As reproducibility of RECIST measurements is impacted by reader experience, choice of target lesions and detection/interpretation of new lesions, it can result in patients changing response categories when measurements are near threshold values or if new lesions are missed or incorrectly interpreted. There are several situations where RECIST will fail to evaluate treatment-induced changes correctly; knowledge and understanding of these is crucial for correct interpretation. Also, some patterns of response/progression cannot be correctly documented by RECIST, particularly in relation to organ-site (e.g. bone without associated soft-tissue lesion) and treatment type (e.g. focal therapies). These require specialist reader experience and communication with oncologists to determine the actual impact of the therapy and best evaluation strategy. In such situations, alternative imaging markers for tumour response may be used but the sources of variability of individual imaging techniques need to be known and accounted for. Communication between imaging experts and oncologists regarding the level of confidence in a biomarker is essential for the correct interpretation of a biomarker and its application to clinical decision-making. Though measurement automation is desirable and potentially reduces the variability of results, associated technical difficulties must be overcome, and human adjudications may be required.

Parametric Response Mapping of FLAIR MRI Provides an Early Indication of Progression Risk in Glioblastoma

RATIONALE AND OBJECTIVES

Glioblastoma image evaluation utilizes Magnetic Resonance Imaging contrast-enhanced, T1-weighted, and noncontrast T2-weighted fluid-attenuated inversion recovery (FLAIR) acquisitions. Disease progression assessment relies on changes in tumor diameter, which correlate poorly with survival. To improve treatment monitoring in glioblastoma, we investigated serial voxel-wise comparison of anatomically-aligned FLAIR signal as an early predictor of GBM progression.

MATERIALS AND METHODS

We analyzed longitudinal normalized FLAIR images (rFLAIR) from 52 subjects using voxel-wise Parametric Response Mapping (PRM) to monitor volume fractions of increased (PRM_rFLAIR+), decreased (PRM_rFLAIR-), or unchanged (PRM_rFLAIR0) rFLAIR intensity. We determined response by rFLAIR between pretreatment and 10 weeks posttreatment. Risk of disease progression in a subset of subjects (N = 26) with stable disease or partial response as defined by Response Assessment in Neuro-Oncology (RANO) criteria was assessed by PRM_rFLAIR between weeks 10 and 20 and continuously until the PRM_rFLAIR+ exceeded a defined threshold. RANO defined criteria were compared with PRM-derived outcomes for tumor progression detection.

RESULTS

Patient stratification for progression-free survival (PFS) and overall survival (OS) was achieved at week 10 using RANO criteria (PFS: p <0.0001; OS: p <0.0001), relative change in FLAIR-hyperintense volume (PFS: p = 0.0011; OS: p <0.0001), and PRM_rFLAIR+ (PFS: p <0.01; OS: p <0.001). PRM_rFLAIR+ also stratified responding patients' progression between weeks 10 and 20 (PFS: p <0.05; OS: p = 0.01) while changes in FLAIR-volume measurements were not predictive. As a continuous evaluation, PRM_rFLAIR+ exceeding 10% stratified patients for PFA after 5.6 months (p<0.0001), while RANO criteria did not stratify patients until 15.4 months (p <0.0001).

CONCLUSION

PRM_rFLAIR may provide an early biomarker of disease progression in glioblastoma.

Quantitative Imaging Enters the Clinical Arena: A Personal Viewpoint

The National Cancer Institute's Quantitative Imaging Network (QIN) has thrived over the past 12 years with an emphasis on the development of image-based decision support software tools for improving measurements of imaging metrics. An overarching goal has been to develop advanced tools that could be translated into clinical trials to provide for improved prediction of response to therapeutic interventions. This article provides an overview of the successes in development and translation of new algorithms into the clinical workflow by the many research teams of the Quantitative Imaging Network.