Evaluation of prognostic models developed using standardised image features from different PET automated segmentation methods

Does radiomics play a role in the diagnosis, staging and re-staging of gastroesophageal junction adenocarcinoma?

Radiomics is an emerging field of investigation in medicine consisting in the extraction of quantitative features from conventional medical images and exploring their potentials in improving diagnosis, prognosis and outcome prediction after therapy. Clinical applications are still limited, mostly due to reproducibility and repeatability issues as well as to limited interpretability of predictive radiomic-based features/signatures. In the specific case of gastroesophageal junction (GEJ) adenocarcinoma, the expectancies are particularly high, mainly due to its increasing incidence and to the limited performance of conventional imaging techniques in assessing correct diagnosis and accurate pre-surgical tumor characterization. Accordingly, current literature was reviewed, emphasizing the methodological quality. In addition, papers were scored according to the Radiomic Quality Score (RQS), weighting more the clinical applicability and generalizability of the resulting models. According to the criteria of the search, only two papers were retained: the resulting technical quality was relatively high for both, while the corresponding RQS were 15 and 19 (on a scale of 31). Although the potentials of radiomics in the setting of GEJ adenocarcinoma are relevant, they remain largely unexplored, warranting an urgent need of high-quality, possibly prospective, multicenter studies.

Radiomic assessment of oesophageal adenocarcinoma: a critical review of 18F-FDG PET/CT, PET/MRI and CT

Objectives

Radiomic models present an avenue to improve oesophageal adenocarcinoma assessment through quantitative medical image analysis. However, model selection is complicated by the abundance of available predictors and the uncertainty of their relevance and reproducibility. This analysis reviews recent research to facilitate precedent-based model selection for prospective validation studies.

Methods

This analysis reviews research on 18F-FDG PET/CT, PET/MRI and CT radiomics in oesophageal adenocarcinoma between 2016 and 2021. Model design, testing and reporting are evaluated according to the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) score and Radiomics Quality Score (RQS). Key results and limitations are analysed to identify opportunities for future research in the area.

Results

Radiomic models of stage and therapeutic response demonstrated discriminative capacity, though clinical applications require greater sensitivity. Although radiomic models predict survival within institutions, generalisability is limited. Few radiomic features have been recommended independently by multiple studies.

Conclusions

Future research must prioritise prospective validation of previously proposed models to further clinical translation.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13244-022-01245-0.

Training and validation of a robust PET radiomic-based index to predict distant-relapse-free-survival after radio-chemotherapy for locally advanced pancreatic cancer

PURPOSE

To assess the value of 18F-Fluorodeoxyglucose (18F-FDG) PET Radiomic Features (RF) in predicting Distant Relapse Free Survival (DRFS) in patients with Locally AdvancedPancreaticCancer (LAPC) treated with radio-chemotherapy.

MATERIALS & METHODS

One-hundred-ninety-eight RFs were extracted using IBSI (Image Biomarker Standardization Initiative) consistent software from pre-radiotherapy images of 176 LAPC patients treated with moderate hypo-fractionation (44.25 Gy, 2.95 Gy/fr). Tumors were segmented by applying a previously validated semi-automatic method. One-hundred-twenty-six RFs were excluded due to poor reproducibility and/or repeatability and/or inter-scanner variability. The original cohort was randomly split into a training (n = 116) and a validation (n = 60) group. Multi-variable Cox regression was applied to the training group, including only independent RFs in the model. The resulting radiomic index was tested in the validation cohort. The impact of selected clinical variables was also investigated.

RESULTS

The resulting Cox model included two first order RFs: Center of Mass Shift (COMshift) and 10th Intensity percentile (P₁₀) (p = 0.0005, HR = 2.72, 95%CI = 1.54-4.80), showing worse outcomes for patients with lower COMshift and higher P₁₀. Once stratified by quartile values (<lowest quartile vs >highest quartile vs the remaining), the index properly stratified patients according to their DRFS (p = 0.0024, log-rank test). Performances were confirmed in the validation cohort (p = 0.03, HR = 2.53, 95%CI = 0.96-6.65). The addition of clinical factors did not significantly improve the models' performance.

CONCLUSIONS

A radiomic-based index including only two robust PET-RFs predicted DRFS of LAPC patients after radio-chemotherapy. The current results could find relevant applications in the treatment personalization of LAPC. A multi-institution independent validation has been planned.

Assessing radiomic feature robustness to interpolation in 18F-FDG PET imaging

Radiomic studies link quantitative imaging features to patient outcomes in an effort to personalise treatment in oncology. To be clinically useful, a radiomic feature must be robust to image processing steps, which has made robustness testing a necessity for many technical aspects of feature extraction. We assessed the stability of radiomic features to interpolation processing and categorised features based on stable, systematic, or unstable responses. Here, ¹⁸F-fluorodeoxyglucose (¹⁸F-FDG) PET images for 441 oesophageal cancer patients (split: testing = 353, validation = 88) were resampled to 6 isotropic voxel sizes (1.5 mm, 1.8 mm, 2.0 mm, 2.2 mm, 2.5 mm, 2.7 mm) and 141 features were extracted from each volume of interest (VOI). Features were categorised into four groups with two statistical tests. Feature reliability was analysed using an intraclass correlation coefficient (ICC) and patient ranking consistency was assessed using a Spearman’s rank correlation coefficient (ρ). We categorised 93 features robust and 6 limited robustness (stable responses), 34 potentially correctable (systematic responses), and 8 not robust (unstable responses). We developed a correction technique for features with potential systematic variation that used surface fits to link voxel size and percentage change in feature value. Twenty-nine potentially correctable features were re-categorised to robust for the validation dataset, after applying corrections defined by surface fits generated on the testing dataset. Furthermore, we found the choice of interpolation algorithm alone (spline vs trilinear) resulted in large variation in values for a number of features but the response categorisations remained constant. This study attempted to quantify the diverse response of radiomics features commonly found in ¹⁸F-FDG PET clinical modelling to isotropic voxel size interpolation.

Deep Convolutional Neural Network-Based Positron Emission Tomography Analysis Predicts Esophageal Cancer Outcome

In esophageal cancer, few prediction tools can be confidently used in current clinical practice. We developed a deep convolutional neural network (CNN) with 798 positron emission tomography (PET) scans of esophageal squamous cell carcinoma and 309 PET scans of stage I lung cancer. In the first stage, we pretrained a 3D-CNN with all PET scans for a task to classify the scans into esophageal cancer or lung cancer. Overall, 548 of 798 PET scans of esophageal cancer patients were included in the second stage with an aim to classify patients who expired within or survived more than one year after diagnosis. The area under the receiver operating characteristic curve (AUC) was used to evaluate model performance. In the pretrain model, the deep CNN attained an AUC of 0.738 in identifying patients who expired within one year after diagnosis. In the survival analysis, patients who were predicted to be expired but were alive at one year after diagnosis had a 5-year survival rate of 32.6%, which was significantly worse than the 5-year survival rate of the patients who were predicted to survive and were alive at one year after diagnosis (50.5%, p < 0.001). These results suggest that the prediction model could identify tumors with more aggressive behavior. In the multivariable analysis, the prediction result remained an independent prognostic factor (hazard ratio: 2.830; 95% confidence interval: 2.252–3.555, p < 0.001). We conclude that a 3D-CNN can be trained with PET image datasets to predict esophageal cancer outcome with acceptable accuracy.

Machine-learned target volume delineation of 18F-FDG PET images after one cycle of induction chemotherapy

Biological tumour volume (GTV_PET) delineation on ¹⁸F-FDG PET acquired during induction chemotherapy (ICT) is challenging due to the reduced metabolic uptake and volume of the GTV_PET. Automatic segmentation algorithms applied to ¹⁸F-FDG PET (PET-AS) imaging have been used for GTV_PET delineation on ¹⁸F-FDG PET imaging acquired before ICT. However, their role has not been investigated in ¹⁸F-FDG PET imaging acquired after ICT. In this study we investigate PET-AS techniques, including ATLAAS a machine learned method, for accurate delineation of the GTV_PET after ICT. Twenty patients were enrolled onto a prospective phase I study (FiGaRO). PET/CT imaging was acquired at baseline and 3 weeks following 1 cycle of induction chemotherapy. The GTV_PET was manually delineated by a nuclear medicine physician and clinical oncologist. The resulting GTV_PET was used as the reference contour. The ATLAAS original statistical model was expanded to include images of reduced metabolic activity and the ATLAAS algorithm was re-trained on the new reference dataset. Estimated GTV_PET contours were derived using sixteen PET-AS methods and compared to the GTV_PET using the Dice Similarity Coefficient (DSC). The mean DSC for ATLAAS, 60% Peak Thresholding (PT60), Adaptive Thresholding (AT) and Watershed Thresholding (WT) was 0.72, 0.61, 0.63 and 0.60 respectively. The GTV_PET generated by ATLAAS compared favourably with manually delineated volumes and in comparison, to other PET-AS methods, was more accurate for GTV_PET delineation after ICT. ATLAAS would be a feasible method to reduce inter-observer variability in multi-centre trials.

A smart and operator independent system to delineate tumours in Positron Emission Tomography scans

Positron Emission Tomography (PET) imaging has an enormous potential to improve radiation therapy treatment planning offering complementary functional information with respect to other anatomical imaging approaches. The aim of this study is to develop an operator independent, reliable, and clinically feasible system for biological tumour volume delineation from PET images. Under this design hypothesis, we combine several known approaches in an original way to deploy a system with a high level of automation. The proposed system automatically identifies the optimal region of interest around the tumour and performs a slice-by-slice marching local active contour segmentation. It automatically stops when a "cancer-free" slice is identified. User intervention is limited at drawing an initial rough contour around the cancer region. By design, the algorithm performs the segmentation minimizing any dependence from the initial input, so that the final result is extremely repeatable. To assess the performances under different conditions, our system is evaluated on a dataset comprising five synthetic experiments and fifty oncological lesions located in different anatomical regions (i.e. lung, head and neck, and brain) using PET studies with 18F-fluoro-2-deoxy-d-glucose and 11C-labeled Methionine radio-tracers. Results on synthetic lesions demonstrate enhanced performances when compared against the most common PET segmentation methods. In clinical cases, the proposed system produces accurate segmentations (average dice similarity coefficient: 85.36 ± 2.94%, 85.98 ± 3.40%, 88.02 ± 2.75% in the lung, head and neck, and brain district, respectively) with high agreement with the gold standard (determination coefficient R² = 0.98). We believe that the proposed system could be efficiently used in the everyday clinical routine as a medical decision tool, and to provide the clinicians with additional information, derived from PET, which can be of use in radiation therapy, treatment, and planning.