Interobserver and Intraobserver Variability among Measurements of FDG PET/CT Parameters in Pulmonary Tumors

Evaluating the Utility of 18F-FDG PET/CT in Cancer of Unknown Primary

Cancer of unknown primary (CUP) represents a heterogeneous group of metastatic tumors for which standardized diagnostic work-up fails to identify the primary site. We aimed to describe the Peter MacCallum Cancer Centre experience with 18F-FDG PET/CT in extracervical CUP with respect to detection of a primary site and its impact on management. A secondary aim was to compare overall survival (OS) in patients with and without a detected primary site. Methods: CUP patients treated between 2014 and 2020 were identified from medical oncology clinics and 18F-FDG PET/CT records. Information collated from electronic medical records included the suspected primary site and treatment details before and after 18F-FDG PET/CT. Clinicopathologic details and genomic analysis were used to determine the clinically suspected primary site and compared against 2 independent masked reads of 18F-FDG PET/CT images by nuclear medicine specialists to determine sensitivity, specificity, accuracy, and the rate of detection of the primary site. Results: We identified 147 patients, 65% of whom had undergone molecular profiling. The median age at diagnosis was 61 y (range, 20-84 y), and the median follow-up time was 74 mo (range, 26-83 mo). Eighty-two percent were classified as having an unfavorable CUP subtype as per international guidelines.18F-FDG PET/CT demonstrated a primary site detection rate of 41%, resulted in a change in management in 22%, and identified previously occult disease sites in 37%. Median OS was 16.8 mo for all patients and 104.7 and 12.1 mo for favorable and unfavorable CUP subtypes, respectively (P < 0.0001). Median OS in CUP patients when using 18F-FDG PET/CT, clinicopathologic, and genomic information was 19.8 and 8.5 mo when a primary site was detected and not detected, respectively (P = 0.016). Multivariable analysis of survival adjusted for age and sex remained significant for identification of a potential primary site (P < 0.001), a favorable CUP (P < 0.001), and an Eastern Cooperative Oncology Group status of 1 or less (P < 0.001). Conclusion: 18F-FDG PET/CT plays a complementary role in CUP diagnostic work-up and was able to determine the likely primary site in 41% of cases. OS is improved with primary site identification, demonstrating the value of access to diagnostic 18F-FDG PET/CT for CUP patients.

3D whole body preclinical micro-CT database of subcutaneous tumors in mice with annotations from 3 annotators

A pivotal animal model for development of anticancer molecules is mice with subcutaneous tumors, grown by injection of xenografted tumor cells, where micro-Computed Tomography (µCT) of the mice is used to analyze the efficacy of the anticancer molecule. Manual delineation of the tumor region is necessary for the analysis, which is time-consuming and inconsistent, highlighting the need for automatic segmentation (AS) tools. This study introduces a preclinical µCT database, comprising 452 whole-body scans from 223 individual mice with subcutaneous tumors, spanning ten diverse µCT datasets conducted between 2014 and 2020 on a preclinical PET/CT scanner, making it the hitherto largest dataset of its kind. Each tumor is annotated manually by three expert annotators, allowing for robust model development. Inter-annotator agreement was analyzed, and we report an overall annotation agreement of 0.903 ± 0.046 (mean ± std) Fleiss' Kappa and a mean deviation in volume estimation of 0.015 ± 0.010 cm3 (6.9% ± 4.7), which establishes a human baseline accuracy for delineation of subcutaneous tumors, while showing good inter-annotator agreement.

Optimizing SUV Analysis: A Multicenter Study on Preclinical FDG-PET/CT Highlights the Impact of Standardization

PURPOSE

Preclinical imaging, with translational potential, lacks a standardized method for defining volumes of interest (VOIs), impacting data reproducibility. The aim of this study was to determine the interobserver variability of VOI sizes and standard uptake values (SUVmean and SUVmax) of different organs using the same [18F]FDG-PET and PET/CT datasets analyzed by multiple observers. In addition, the effect of a standardized analysis approach was evaluated.

PROCEDURES

In total, 12 observers (4 beginners and 8 experts) analyzed identical preclinical [18F]FDG-PET-only and PET/CT datasets according to their local default image analysis protocols for multiple organs. Furthermore, a standardized protocol was defined, including detailed information on the respective VOI size and position for multiple organs, and all observers reanalyzed the PET/CT datasets following this protocol.

RESULTS

Without standardization, significant differences in the SUVmean and SUVmax were found among the observers. Coregistering CT images with PET images improved the comparability to a limited extent. The introduction of a standardized protocol that details the VOI size and position for multiple organs reduced interobserver variability and enhanced comparability.

CONCLUSIONS

The protocol offered clear guidelines and was particularly beneficial for beginners, resulting in improved comparability of SUVmean and SUVmax values for various organs. The study suggested that incorporating an additional VOI template could further enhance the comparability of the findings in preclinical imaging analyses.

High diagnostic accuracy for lymph node metastasis of oral squamous cell carcinoma using PET/CT with a silicon photomultiplier

OBJECTIVE

The higher sensitivity of the new-generation positron emission tomography/computed tomography (PET/CT) with silicon photomultiplier (SiPM) may increase false-positive rates in detecting metastatic lymph nodes (LNs). This study aimed to clarify the usefulness of the SiPM PET scanner in diagnosing LN metastasis of oral squamous cell carcinoma (SCC).

METHODS

We retrospectively reviewed consecutive F-18 fluorodeoxyglucose PET/CT images of 39 SCC patients using SiPM PET and 31 SCC patients using non-SiPM PET. We measured the maximum standardized uptake value (SUV_max) of the LNs on PET images and maximum short-axis diameter on transverse CT images.

RESULTS

The sensitivity and specificity of SiPM PET were 86.2% and 95.6%, respectively (cut-off SUV_max, 4.6). The area under the curve (AUC) of SiPM PET (0.977; 95% confidence interval [CI], 0.958-0.995) was significantly higher than that of non-SiPM PET (0.825; 95% CI 0.717-0.934) (P < 0.01). In a size-limited analysis of diameter, the AUC of SiPM PET (≥ 0.96 for all diameters) was significantly higher than that of non-SiPM PET (tended to decrease as the LN diameter decreased) for the diagnosis of LN metastasis by SUV_max.

CONCLUSION

SiPM PET had higher diagnostic accuracy for LN metastasis of oral SCC than non-SiPM PET, even for small LN metastasis without increasing false-positives.

Impact of solitary pulmonary nodule size on qualitative and quantitative assessment using 18F-fluorodeoxyglucose PET/CT: the SPUTNIK trial

PURPOSE

To compare qualitative and semi-quantitative PET/CT criteria, and the impact of nodule size on the diagnosis of solitary pulmonary nodules in a prospective multicentre trial.

METHODS

Patients with an SPN on CT ≥ 8 and ≤ 30 mm were recruited to the SPUTNIK trial at 16 sites accredited by the UK PET Core Lab. Qualitative assessment used a five-point ordinal PET-grade compared to the mediastinal blood pool, and a combined PET/CT grade using the CT features. Semi-quantitative measures included SUVmax of the nodule, and as an uptake ratio to the mediastinal blood pool (SURBLOOD) or liver (SURLIVER). The endpoints were diagnosis of lung cancer via biopsy/histology or completion of 2-year follow-up. Impact of nodule size was analysed by comparison between nodule size tertiles.

RESULTS

Three hundred fifty-five participants completed PET/CT and 2-year follow-up, with 59% (209/355) malignant nodules. The AUCs of the three techniques were SUVmax 0.87 (95% CI 0.83;0.91); SURBLOOD 0.87 (95% CI 0.83; 0.91, p = 0.30 versus SUVmax); and SURLIVER 0.87 (95% CI 0.83; 0.91, p = 0.09 vs. SUVmax). The AUCs for all techniques remained stable across size tertiles (p > 0.1 for difference), although the optimal diagnostic threshold varied by size. For nodules < 12 mm, an SUVmax of 1.75 or visual uptake equal to the mediastinum yielded the highest accuracy. For nodules > 16 mm, an SUVmax ≥ 3.6 or visual PET uptake greater than the mediastinum was the most accurate.

CONCLUSION

In this multicentre trial, SUVmax was the most accurate technique for the diagnosis of solitary pulmonary nodules. Diagnostic thresholds should be altered according to nodule size.

TRIAL REGISTRATION

ISRCTN - ISRCTN30784948. ClinicalTrials.gov - NCT02013063.

Observer variability in the assessment of renal 18F-FDG uptake in kidney transplant recipients

¹⁸F-FDG PET/CT imaging may help non-invasively disprove the diagnosis of acute kidney allograft rejection (AR) in kidney transplant recipients (KTR). The present study aims at evaluating the repeatability and reproducibility of the quantification of renal ¹⁸F-FDG uptake in KTR. We prospectively performed ¹⁸F-FDG PET/CT in 95 adult KTR who underwent surveillance transplant biopsy between 3 to 6 months post transplantation. Images were obtained 180 minutes after injecting 3 MBq ¹⁸F-FDG per kg body weight. Mean standard uptake value (SUV_mean) of kidney cortex was independently measured by 2 experienced observers in 4 volumes of interest (VOI) distributed in the upper (n = 2) and lower (n = 2) poles. The first observer repeated SUV assessment in the uppermost VOI, blinded to the initial results. Intra-class correlation coefficients (ICC) and Bland-Altman plots were calculated. An ICC of 0.96 with 95%CI of [0.94; 0.97] was calculated for the intra-observer measurements. The ICC for inter-observer reproducibility for each VOI was 0.87 [0.81–0.91], 0.87 [0.81–0.91], 0.85 [0.78–0.89] and 0.83 [0.76–0.88] for the upper to the lower renal poles, respectively. The repeatability and reproducibility of the quantification of kidney allograft ¹⁸F-FDG uptake are both consistent, which makes it transferrable to the clinical routine.

Discovery of pre-therapy 2-deoxy-2-18F-fluoro-D-glucose positron emission tomography-based radiomics classifiers of survival outcome in non-small-cell lung cancer patients

PURPOSE

The aim of this multi-center study was to discover and validate radiomics classifiers as image-derived biomarkers for risk stratification of non-small-cell lung cancer (NSCLC).

PATIENTS AND METHODS

Pre-therapy PET scans from a total of 358 Stage I-III NSCLC patients scheduled for radiotherapy/chemo-radiotherapy acquired between October 2008 and December 2013 were included in this seven-institution study. A semi-automatic threshold method was used to segment the primary tumors. Radiomics predictive classifiers were derived from a training set of 133 scans using TexLAB v2. Least absolute shrinkage and selection operator (LASSO) regression analysis was used for data dimension reduction and radiomics feature vector (FV) discovery. Multivariable analysis was performed to establish the relationship between FV, stage and overall survival (OS). Performance of the optimal FV was tested in an independent validation set of 204 patients, and a further independent set of 21 (TESTI) patients.

RESULTS

Of 358 patients, 249 died within the follow-up period [median 22 (range 0-85) months]. From each primary tumor, 665 three-dimensional radiomics features from each of seven gray levels were extracted. The most predictive feature vector discovered (FVX) was independent of known prognostic factors, such as stage and tumor volume, and of interest to multi-center studies, invariant to the type of PET/CT manufacturer. Using the median cut-off, FVX predicted a 14-month survival difference in the validation cohort (N = 204, p = 0.00465; HR = 1.61, 95% CI 1.16-2.24). In the TESTI cohort, a smaller cohort that presented with unusually poor survival of stage I cancers, FVX correctly indicated a lack of survival difference (N = 21, p = 0.501). In contrast to the radiomics classifier, clinically routine PET variables including SUVmax, SUVmean and SUVpeak lacked any prognostic information.

CONCLUSION

PET-based radiomics classifiers derived from routine pre-treatment imaging possess intrinsic prognostic information for risk stratification of NSCLC patients to radiotherapy/chemo-radiotherapy.