Deep Learning Approach to Automatize TMTV Calculations Regardless of Segmentation Methodology for Major FDG-Avid Lymphomas

The role of response adapted therapy in the era of novel agents

The optimal treatment of classic Hodgkin Lymphoma (cHL) requires an individualized approach, with therapy guided by pretreatment clinical risk stratification and interim response assessment with positron emission tomography (PET). The overall goal is to achieve high cure rates while minimizing acute toxicity and late therapy-related effects. Interim PET-adapted strategies (iPET) were initially developed with traditional chemotherapy, reducing intensity after interim complete response and escalating treatment for patients with iPET+ disease. Recently, novel agents including brentuximab vedotin and the checkpoint inhibitor immunotherapies (CPIs) pembrolizumab and nivolumab have been adopted into the front-line treatment of cHL, and PET-adapted approaches may be relevant for these drugs as well. In this review we discuss response-adapted strategies utilizing novel agents, consider challenges including indeterminate radiographic findings with CPIs, and address emerging techniques for response assessment including new PET-based imaging metrics and the role of circulating tumor DNA.

Whole-body tumor segmentation from PET/CT images using a two-stage cascaded neural network with camouflaged object detection mechanisms

BACKGROUND

Whole-body Metabolic Tumor Volume (MTVwb) is an independent prognostic factor for overall survival in lung cancer patients. Automatic segmentation methods have been proposed for MTV calculation. Nevertheless, most of existing methods for patients with lung cancer only segment tumors in the thoracic region.

PURPOSE

In this paper, we present a Two-Stage cascaded neural network integrated with Camouflaged Object Detection mEchanisms (TS-Code-Net) for automatic segmenting tumors from whole-body PET/CT images.

METHODS

Firstly, tumors are detected from the Maximum Intensity Projection (MIP) images of PET/CT scans, and tumors' approximate localizations along z-axis are identified. Secondly, the segmentations are performed on PET/CT slices that contain tumors identified by the first step. Camouflaged object detection mechanisms are utilized to distinguish the tumors from their surrounding regions that have similar Standard Uptake Values (SUV) and texture appearance. Finally, the TS-Code-Net is trained by minimizing the total loss that incorporates the segmentation accuracy loss and the class imbalance loss.

RESULTS

The performance of the TS-Code-Net is tested on a whole-body PET/CT image data-set including 480 Non-Small Cell Lung Cancer (NSCLC) patients with five-fold cross-validation using image segmentation metrics. Our method achieves 0.70, 0.76, and 0.70, for Dice, Sensitivity and Precision, respectively, which demonstrates the superiority of the TS-Code-Net over several existing methods related to metastatic lung cancer segmentation from whole-body PET/CT images.

CONCLUSIONS

The proposed TS-Code-Net is effective for whole-body tumor segmentation of PET/CT images. Codes for TS-Code-Net are available at: https://github.com/zyj19/TS-Code-Net.

Quantitative PET-based biomarkers in lymphoma: getting ready for primetime

The use of functional quantitative biomarkers extracted from routine PET-CT scans to characterize clinical responses in patients with lymphoma is gaining increased attention, and these biomarkers can outperform established clinical risk factors. Total metabolic tumour volume enables individualized estimation of survival outcomes in patients with lymphoma and has shown the potential to predict response to therapy suitable for  risk-adapted treatment approaches in clinical trials. The deployment of machine learning tools in molecular imaging research can assist in recognizing complex patterns and, with image classification, in tumour identification and segmentation of data from PET-CT scans. Initial studies using fully automated approaches to calculate metabolic tumour volume and other PET-based biomarkers have demonstrated appropriate correlation with calculations from experts, warranting further testing in large-scale studies. The extraction of computer-based quantitative tumour characterization through radiomics can provide a comprehensive view of phenotypic heterogeneity that better captures the molecular and functional features of the disease. Additionally, radiomics can be integrated with genomic data to provide more accurate prognostic information. Further improvements in PET-based biomarkers are imminent, although their incorporation into clinical decision-making currently has methodological shortcomings that need to be addressed with confirmatory prospective validation in selected patient populations. In this Review, we discuss the current knowledge, challenges and opportunities in the integration of quantitative PET-based biomarkers in clinical trials and the routine management of patients with lymphoma.

Advances in positron emission tomography and radiomics

Positron emission tomography is established for staging and response evaluation in lymphoma using visual evaluation and semi-quantitative analysis. Radiomic analysis involving quantitative imaging features at baseline, such as metabolic tumor volume and markers of disease dissemination and changes in the standardized uptake value during treatment are emerging as powerful biomarkers. The combination of radiomic features with clinical risk factors and genomic analysis offers the potential to improve clinical risk prediction. This review discusses the state of current knowledge, progress toward standardization of tumor delineation for radiomic analysis and argues that radiomic features, molecular markers and circulating tumor DNA should be included in clinical trial designs to enable the development of baseline and dynamic risk scores that could further advance the field to facilitate testing of novel treatments and personalized therapy in aggressive lymphomas.

PET/CT in Non-Hodgkin Lymphoma: An Update

Non-Hodgkin lymphomas represents a heterogeneous group of lymphoproliferative disorders characterized by different clinical courses, varying from indolent to highly aggressive. ¹⁸F-FDG-PET/CT is the current state-of-the-art diagnostic imaging, for the staging, restaging and evaluation of response to treatment in lymphomas with avidity for ¹⁸F-FDG, despite it is not routinely recommended for surveillance. PET-based response criteria (using five-point Deauville Score) are nowadays uniformly applied in FDG-avid lymphomas. In this review, a comprehensive overview of the role of ¹⁸F-FDG-PET in Non-Hodgkin lymphomas is provided, at each relevant point of patient management, particularly focusing on recent advances on diffuse large B-cell lymphoma and follicular lymphoma, with brief updates also on other histotypes (such as marginal zone, mantle cell, primary mediastinal- B cell lymphoma and T cell lymphoma). PET-derived semiquantitative factors useful for patient stratification and prognostication and emerging radiomics research are also presented.

Multi-scale feature similarity-based weakly supervised lymphoma segmentation in PET/CT images

Accurate lymphoma segmentation in PET/CT images is important for evaluating Diffuse Large B-Cell Lymphoma (DLBCL) prognosis. As systemic multiple lymphomas, DLBCL lesions vary in number and size for different patients, which makes DLBCL labeling labor-intensive and time-consuming. To reduce the reliance on accurately labeled datasets, a weakly supervised deep learning method based on multi-scale feature similarity is proposed for automatic lymphoma segmentation. Weak labeling was performed by randomly dawning a small and salient lymphoma volume for the patient without accurate labels. A 3D V-Net is used as the backbone of the segmentation network and image features extracted in different convolutional layers are fused with the Atrous Spatial Pyramid Pooling (ASPP) module to generate multi-scale feature representations of input images. By imposing multi-scale feature consistency constraints on the predicted tumor regions as well as the labeled tumor regions, weakly labeled data can also be effectively used for network training. The cosine similarity, which has strong generalization, is exploited here to measure feature distances. The proposed method is evaluated with a PET/CT dataset of 147 lymphoma patients. Experimental results show that when using data, half of which have accurate labels and the other half have weak labels, the proposed method performed similarly to a fully supervised segmentation network and achieved an average Dice Similarity Coefficient (DSC) of 71.47%. The proposed method is able to reduce the requirement for expert annotations in deep learning-based lymphoma segmentation.

A Deep Learning-Aided Automated Method for Calculating Metabolic Tumor Volume in Diffuse Large B-Cell Lymphoma

Metabolic tumor volume (MTV) is a robust prognostic biomarker in diffuse large B-cell lymphoma (DLBCL). The available semiautomatic software for calculating MTV requires manual input limiting its routine application in clinical research. Our objective was to develop a fully automated method (AM) for calculating MTV and to validate the method by comparing its results with those from two nuclear medicine (NM) readers. The automated method designed for this study employed a deep convolutional neural network to segment normal physiologic structures from the computed tomography (CT) scans that demonstrate intense avidity on positron emission tomography (PET) scans. The study cohort consisted of 100 patients with newly diagnosed DLBCL who were randomly selected from the Alliance/CALGB 50,303 (NCT00118209) trial. We observed high concordance in MTV calculations between the AM and readers with Pearson's correlation coefficients and interclass correlations comparing reader 1 to AM of 0.9814 (p < 0.0001) and 0.98 (p < 0.001; 95%CI = 0.96 to 0.99), respectively; and comparing reader 2 to AM of 0.9818 (p < 0.0001) and 0.98 (p < 0.0001; 95%CI = 0.96 to 0.99), respectively. The Bland-Altman plots showed only relatively small systematic errors between the proposed method and readers for both MTV and maximum standardized uptake value (SUVmax). This approach may possess the potential to integrate PET-based biomarkers in clinical trials.

Multimodal deep learning model on interim [18F]FDG PET/CT for predicting primary treatment failure in diffuse large B-cell lymphoma

OBJECTIVES

The prediction of primary treatment failure (PTF) is necessary for patients with diffuse large B-cell lymphoma (DLBCL) since it serves as a prominent means for improving front-line outcomes. Using interim ¹⁸F-fluoro-2-deoxyglucose ([¹⁸F]FDG) positron emission tomography/computed tomography (PET/CT) imaging data, we aimed to construct multimodal deep learning (MDL) models to predict possible PTF in low-risk DLBCL.

METHODS

Initially, 205 DLBCL patients undergoing interim [¹⁸F]FDG PET/CT scans and the front-line standard of care were included in the primary dataset for model development. Then, 44 other patients were included in the external dataset for generalization evaluation. Based on the powerful backbone of the Conv-LSTM network, we incorporated five different multimodal fusion strategies (pixel intermixing, separate channel, separate branch, quantitative weighting, and hybrid learning) to make full use of PET/CT features and built five corresponding MDL models. Moreover, we found the best model, that is, the hybrid learning model, and optimized it by integrating the contrastive training objective to further improve its prediction performance.

RESULTS

The final model with contrastive objective optimization, named the contrastive hybrid learning model, performed best, with an accuracy of 91.22% and an area under the receiver operating characteristic curve (AUC) of 0.926, in the primary dataset. In the external dataset, its accuracy and AUC remained at 88.64% and 0.925, respectively, indicating its good generalization ability.

CONCLUSIONS

The proposed model achieved good performance, validated the predictive value of interim PET/CT, and holds promise for directing individualized clinical treatment.

KEY POINTS

• The proposed multimodal models achieved accurate prediction of primary treatment failure in DLBCL patients. • Using an appropriate feature-level fusion strategy can make the same class close to each other regardless of the modal heterogeneity of the data source domain and positively impact the prediction performance. • Deep learning validated the predictive value of interim PET/CT in a way that exceeded human capabilities.