Deep learning-based tumour segmentation and total metabolic tumour volume prediction in the prognosis of diffuse large B-cell lymphoma patients in 3D FDG-PET images

Metabolic tumour volume in Hodgkin lymphoma-A comparison between manual and AI-based analysis

AIM

To compare total metabolic tumour volume (tMTV), calculated using two artificial intelligence (AI)-based tools, with manual segmentation by specialists as the reference.

METHODS

Forty-eight consecutive Hodgkin lymphoma (HL) patients staged with [18F] fluorodeoxyglucose positron emission tomography/computed tomography were included. The median age was 35 years (range: 7-75), 46% female. The tMTV was automatically measured using the AI-based tools positron emission tomography assisted reporting system (PARS) (from Siemens) and RECOMIA (recomia.org) without any manual adjustments. A group of eight nuclear medicine specialists manually segmented lesions for tMTV calculations; each patient was independently segmented by two specialists.

RESULTS

The median of the manual tMTV was 146 cm3 (interquartile range [IQR]: 79-568 cm3) and the median difference between two tMTV values segmented by different specialists for the same patient was 26 cm3 (IQR: 10-86 cm3). In 22 of the 48 patients, the manual tMTV value was closer to the RECOMIA tMTV value than to the manual tMTV value segmented by the second specialist. In 11 of the remaining 26 patients, the difference between the RECOMIA tMTV and the manual tMTV was small (<26 cm3, which was the median difference between two manual tMTV values from the same patient). The corresponding numbers for PARS were 18 and 10 patients, respectively.

CONCLUSION

The results of this study indicate that RECOMIA and Siemens PARS AI tools could be used without any major manual adjustments in 69% (33/48) and 58% (28/48) of HL patients, respectively. This demonstrates the feasibility of using AI tools to support physicians measuring tMTV for assessment of prognosis in clinical practice.

Total metabolic tumor volume on 18F-FDG PET/CT is a game-changer for patients with metastatic lung cancer treated with immunotherapy

PURPOSE

Because of atypical response imaging patterns in patients with metastatic non-small cell lung cancer (NSCLC) treated with immune checkpoint inhibitors (ICPIs), new biomarkers are needed for a better monitoring of treatment efficacy. The aim of this prospective study was to evaluate the prognostic value of volume-derived positron-emission tomography (PET) parameters on baseline and follow-up 18F-fluoro-deoxy-glucose PET (18F-FDG-PET) scans and compare it with the conventional PET Response Criteria in Solid Tumors (PERCIST).

METHODS

Patients with metastatic NSCLC were included in two different single-center prospective trials. 18F-FDG-PET studies were performed before the start of immunotherapy (PETbaseline), after 6-8 weeks (PETinterim1) and after 12-16 weeks (PETinterim2) of treatment, using PERCIST criteria for tumor response assessment. Different metabolic parameters were evaluated: absolute values of maximum standardized uptake value (SUVmax) of the most intense lesion, total metabolic tumor volume (TMTV), total lesion glycolysis (TLG), but also their percentage changes between PET studies (ΔSUVmax, ΔTMTV and ΔTLG). The median follow-up of patients was 31 (7.3-31.8) months. Prognostic values and optimal thresholds of PET parameters were estimated by ROC (Receiver Operating Characteristic) curve analysis of 12-month overall survival (12M-OS) and 6-month progression-free survival (6M-PFS). Tumor progression needed to be confirmed by a multidisciplinary tumor board, considering atypical response patterns on imaging.

RESULTS

110 patients were prospectively included. On PETbaseline, TMTV was predictive of 12M-OS [AUC (Area Under Curve) =0.64; 95% CI: 0.61 to 0.66] whereas SUVmax and TLG were not. On PETinterim1 and PETinterim2, all metabolic parameters were predictive for 12M-OS and 6M-PFS, the residual TMTV on PETinterim1 (TMTV1) being the strongest prognostic biomarker (AUC=0.83 and 0.82; 95% CI: 0.74 to 0.91, for 12M-OS and 6M-PFS, respectively). Using the optimal threshold by ROC curve to classify patients into three TMTV1 subgroups (0 cm3; 0-57 cm3; >57 cm3), TMTV1 prognostic stratification was independent of PERCIST criteria on both PFS and OS, and significantly outperformed them. Subgroup analysis demonstrated that TMTV1 remained a strong prognostic biomarker of 12M-OS for non-responding patients (p=0.0003) according to PERCIST criteria. In the specific group of patients with PERCIST progression on PETinterim1, low residual tumor volume (<57 cm3) was still associated with a very favorable patients' outcome (6M-PFS=73%; 24M-OS=55%).

CONCLUSION

The absolute value of residual metabolic tumor volume, assessed 6-8 weeks after the start of ICPI, is an optimal and independent prognostic measure, exceeding and complementing conventional PERCIST criteria. Oncologists should consider it in patients with first tumor progression according to PERCIST criteria, as it helps identify patients who benefit from continued treatment.

TRIAL REGISTRATION NUMBER

2018-A02116-49; NCT03584334.

Deep learning for [18F]fluorodeoxyglucose-PET-CT classification in patients with lymphoma: a dual-centre retrospective analysis

BACKGROUND

The rising global cancer burden has led to an increasing demand for imaging tests such as [18F]fluorodeoxyglucose ([18F]FDG)-PET-CT. To aid imaging specialists in dealing with high scan volumes, we aimed to train a deep learning artificial intelligence algorithm to classify [18F]FDG-PET-CT scans of patients with lymphoma with or without hypermetabolic tumour sites.

METHODS

In this retrospective analysis we collected 16 583 [18F]FDG-PET-CTs of 5072 patients with lymphoma who had undergone PET-CT before or after treatment at the Memorial Sloa Kettering Cancer Center, New York, NY, USA. Using maximum intensity projection (MIP), three dimensional (3D) PET, and 3D CT data, our ResNet34-based deep learning model (Lymphoma Artificial Reader System [LARS]) for [18F]FDG-PET-CT binary classification (Deauville 1-3 vs 4-5), was trained on 80% of the dataset, and tested on 20% of this dataset. For external testing, 1000 [18F]FDG-PET-CTs were obtained from a second centre (Medical University of Vienna, Vienna, Austria). Seven model variants were evaluated, including MIP-based LARS-avg (optimised for accuracy) and LARS-max (optimised for sensitivity), and 3D PET-CT-based LARS-ptct. Following expert curation, areas under the curve (AUCs), accuracies, sensitivities, and specificities were calculated.

FINDINGS

In the internal test cohort (3325 PET-CTs, 1012 patients), LARS-avg achieved an AUC of 0·949 (95% CI 0·942-0·956), accuracy of 0·890 (0·879-0·901), sensitivity of 0·868 (0·851-0·885), and specificity of 0·913 (0·899-0·925); LARS-max achieved an AUC of 0·949 (0·942-0·956), accuracy of 0·868 (0·858-0·879), sensitivity of 0·909 (0·896-0·924), and specificity of 0·826 (0·808-0·843); and LARS-ptct achieved an AUC of 0·939 (0·930-0·948), accuracy of 0·875 (0·864-0·887), sensitivity of 0·836 (0·817-0·855), and specificity of 0·915 (0·901-0·927). In the external test cohort (1000 PET-CTs, 503 patients), LARS-avg achieved an AUC of 0·953 (0·938-0·966), accuracy of 0·907 (0·888-0·925), sensitivity of 0·874 (0·843-0·904), and specificity of 0·949 (0·921-0·960); LARS-max achieved an AUC of 0·952 (0·937-0·965), accuracy of 0·898 (0·878-0·916), sensitivity of 0·899 (0·871-0·926), and specificity of 0·897 (0·871-0·922); and LARS-ptct achieved an AUC of 0·932 (0·915-0·948), accuracy of 0·870 (0·850-0·891), sensitivity of 0·827 (0·793-0·863), and specificity of 0·913 (0·889-0·937).

INTERPRETATION

Deep learning accurately distinguishes between [18F]FDG-PET-CT scans of lymphoma patients with and without hypermetabolic tumour sites. Deep learning might therefore be potentially useful to rule out the presence of metabolically active disease in such patients, or serve as a second reader or decision support tool.

FUNDING

National Institutes of Health-National Cancer Institute Cancer Center Support Grant.

2024 Update: Advances in the risk stratification and management of large B-cell lymphoma

Diffuse large B-cell lymphoma (DLBCL) is a heterogeneous disease with varying clinical outcomes. Our understanding of its molecular makeup continues to improve risk stratification, and artificial-intelligence and ctDNA-based analyses have the potential to enhance risk assessment and disease monitoring. R-CHOP and Pola-R-CHP are used in the frontline setting; chimeric antigen receptor therapy (CART) is now the new standard-of-care for most with primary refractory disease; both CART and autologous stem cell transplantation are utilized in the relapsed and refractory setting. In this review, we summarize the classification and management of DLBCL with an emphasis on recent advances in the field.

Quantitative PET-based biomarkers in lymphoma: getting ready for primetime

The use of functional quantitative biomarkers extracted from routine PET-CT scans to characterize clinical responses in patients with lymphoma is gaining increased attention, and these biomarkers can outperform established clinical risk factors. Total metabolic tumour volume enables individualized estimation of survival outcomes in patients with lymphoma and has shown the potential to predict response to therapy suitable for  risk-adapted treatment approaches in clinical trials. The deployment of machine learning tools in molecular imaging research can assist in recognizing complex patterns and, with image classification, in tumour identification and segmentation of data from PET-CT scans. Initial studies using fully automated approaches to calculate metabolic tumour volume and other PET-based biomarkers have demonstrated appropriate correlation with calculations from experts, warranting further testing in large-scale studies. The extraction of computer-based quantitative tumour characterization through radiomics can provide a comprehensive view of phenotypic heterogeneity that better captures the molecular and functional features of the disease. Additionally, radiomics can be integrated with genomic data to provide more accurate prognostic information. Further improvements in PET-based biomarkers are imminent, although their incorporation into clinical decision-making currently has methodological shortcomings that need to be addressed with confirmatory prospective validation in selected patient populations. In this Review, we discuss the current knowledge, challenges and opportunities in the integration of quantitative PET-based biomarkers in clinical trials and the routine management of patients with lymphoma.

PET/CT in Non-Hodgkin Lymphoma: An Update

Non-Hodgkin lymphomas represents a heterogeneous group of lymphoproliferative disorders characterized by different clinical courses, varying from indolent to highly aggressive. ¹⁸F-FDG-PET/CT is the current state-of-the-art diagnostic imaging, for the staging, restaging and evaluation of response to treatment in lymphomas with avidity for ¹⁸F-FDG, despite it is not routinely recommended for surveillance. PET-based response criteria (using five-point Deauville Score) are nowadays uniformly applied in FDG-avid lymphomas. In this review, a comprehensive overview of the role of ¹⁸F-FDG-PET in Non-Hodgkin lymphomas is provided, at each relevant point of patient management, particularly focusing on recent advances on diffuse large B-cell lymphoma and follicular lymphoma, with brief updates also on other histotypes (such as marginal zone, mantle cell, primary mediastinal- B cell lymphoma and T cell lymphoma). PET-derived semiquantitative factors useful for patient stratification and prognostication and emerging radiomics research are also presented.

Role of Artificial Intelligence in PET/CT Imaging for Management of Lymphoma

Our review shows that AI-based analysis of lymphoma whole-body FDG-PET/CT can inform all phases of clinical management including staging, prognostication, treatment planning, and treatment response evaluation. We highlight advancements in the role of neural networks for performing automated image segmentation to calculate PET-based imaging biomarkers such as the total metabolic tumor volume (TMTV). AI-based image segmentation methods are at levels where they can be semi-automatically implemented with minimal human inputs and nearing the level of a second-opinion radiologist. Advances in automated segmentation methods are particularly apparent in the discrimination of lymphomatous vs non-lymphomatous FDG-avid regions, which carries through to automated staging. Automated TMTV calculators, in addition to automated calculation of measures such as Dmax are informing robust models of progression-free survival which can then feed into improved treatment planning.

Multi-scale feature similarity-based weakly supervised lymphoma segmentation in PET/CT images

Accurate lymphoma segmentation in PET/CT images is important for evaluating Diffuse Large B-Cell Lymphoma (DLBCL) prognosis. As systemic multiple lymphomas, DLBCL lesions vary in number and size for different patients, which makes DLBCL labeling labor-intensive and time-consuming. To reduce the reliance on accurately labeled datasets, a weakly supervised deep learning method based on multi-scale feature similarity is proposed for automatic lymphoma segmentation. Weak labeling was performed by randomly dawning a small and salient lymphoma volume for the patient without accurate labels. A 3D V-Net is used as the backbone of the segmentation network and image features extracted in different convolutional layers are fused with the Atrous Spatial Pyramid Pooling (ASPP) module to generate multi-scale feature representations of input images. By imposing multi-scale feature consistency constraints on the predicted tumor regions as well as the labeled tumor regions, weakly labeled data can also be effectively used for network training. The cosine similarity, which has strong generalization, is exploited here to measure feature distances. The proposed method is evaluated with a PET/CT dataset of 147 lymphoma patients. Experimental results show that when using data, half of which have accurate labels and the other half have weak labels, the proposed method performed similarly to a fully supervised segmentation network and achieved an average Dice Similarity Coefficient (DSC) of 71.47%. The proposed method is able to reduce the requirement for expert annotations in deep learning-based lymphoma segmentation.

A Deep Learning-Aided Automated Method for Calculating Metabolic Tumor Volume in Diffuse Large B-Cell Lymphoma

Metabolic tumor volume (MTV) is a robust prognostic biomarker in diffuse large B-cell lymphoma (DLBCL). The available semiautomatic software for calculating MTV requires manual input limiting its routine application in clinical research. Our objective was to develop a fully automated method (AM) for calculating MTV and to validate the method by comparing its results with those from two nuclear medicine (NM) readers. The automated method designed for this study employed a deep convolutional neural network to segment normal physiologic structures from the computed tomography (CT) scans that demonstrate intense avidity on positron emission tomography (PET) scans. The study cohort consisted of 100 patients with newly diagnosed DLBCL who were randomly selected from the Alliance/CALGB 50,303 (NCT00118209) trial. We observed high concordance in MTV calculations between the AM and readers with Pearson's correlation coefficients and interclass correlations comparing reader 1 to AM of 0.9814 (p < 0.0001) and 0.98 (p < 0.001; 95%CI = 0.96 to 0.99), respectively; and comparing reader 2 to AM of 0.9818 (p < 0.0001) and 0.98 (p < 0.0001; 95%CI = 0.96 to 0.99), respectively. The Bland-Altman plots showed only relatively small systematic errors between the proposed method and readers for both MTV and maximum standardized uptake value (SUVmax). This approach may possess the potential to integrate PET-based biomarkers in clinical trials.