Deep learning auto-segmentation of cervical skeletal muscle for sarcopenia analysis in patients with head and neck cancer

Sauver JL. Abdominal Body Composition Reference Ranges and Association With Chronic Conditions in an Age- and Sex-Stratified Representative Sample of a Geographically Defined American Population

BACKGROUND

Body composition can be accurately quantified from abdominal computed tomography (CT) exams and is a predictor for the development of aging-related conditions and for mortality. However, reference ranges for CT-derived body composition measures of obesity, sarcopenia, and bone loss have yet to be defined in the general population.

METHODS

We identified a population-representative sample of 4 900 persons aged 20 to 89 years who underwent an abdominal CT exam from 2010 to 2020. The sample was constructed using propensity score matching an age and sex stratified sample of persons residing in the 27-county region of Southern Minnesota and Western Wisconsin. The matching included race, ethnicity, education level, region of residence, and the presence of 20 chronic conditions. We used a validated deep learning based algorithm to calculate subcutaneous adipose tissue area, visceral adipose tissue area, skeletal muscle area, skeletal muscle density, vertebral bone area, and vertebral bone density from a CT abdominal section.

RESULTS

We report CT-based body composition reference ranges on 4 649 persons representative of our geographic region. Older age was associated with a decrease in skeletal muscle area and density, and an increase in visceral adiposity. All chronic conditions were associated with a statistically significant difference in at least one body composition biomarker. The presence of a chronic condition was generally associated with greater subcutaneous and visceral adiposity, and lower muscle density and vertebrae bone density.

CONCLUSIONS

We report reference ranges for CT-based body composition biomarkers in a population-representative cohort of 4 649 persons by age, sex, body mass index, and chronic conditions.

Predicting malnutrition in gastric cancer patients using computed tomography(CT) deep learning features and clinical data

OBJECTIVE

The aim of this study is using clinical factors and non-enhanced computed tomography (CT) deep features of the psoas muscles at third lumbar vertebral (L3) level to construct a model to predict malnutrition in gastric cancer before surgery, and to provide a new nutritional status assessment and survival assessment tool for gastric cancer patients.

METHODS

A retrospective analysis of 312 patients of gastric cancer were divided into malnutrition group and normal group based on Nutrition Risk Screening 2002(NRS-2002). 312 regions of interest (ROI) of the psoas muscles at L3 level of non-enhanced CT were delineated. Deep learning (DL) features were extracted from the ROI using a deep migration model and were screened by principal component analysis (PCA) and least-squares operator (LASSO). The clinical predictors included Body Mass Index (BMI), lymphocyte and albumin. Both deep learning model (including deep learning features) and mixed model (including selected deep learning features and selected clinical predictors) were constructed by 11 classifiers. The model was evaluated and selected by calculating receiver operating characteristic (ROC), area under curve (AUC), accuracy, sensitivity and specificity, calibration curve and decision curve analysis (DCA). The Cohen's Kappa coefficient (κ) was using to compare the diagnostic agreement for malnutrition between the mixed model and the GLIM in gastric cancer patients.

RESULT

The results of logistics multivariate analysis showed that BMI [OR = 0.569 (95% CI 0.491-0.660)], lymphocyte [OR = 0.638 (95% CI 0.408-0.998)], and albumin [OR = 0.924 (95% CI 0.859-0.994)] were clinically independent malnutrition of gastric cancer predictor(P < 0.05). Among the 11 classifiers, the Multilayer Perceptron (MLP)were selected as the best classifier. The AUC of the training and test sets for deep learning model were 0.806 (95% CI 0.7485-0.8635) and 0.769 (95% CI 0.673-0.863) and with accuracies were 0.734 and 0.766, respectively. The AUC of the training and test sets for the mixed model were 0.909 (95% CI 0.869-0.948) and 0.857 (95% CI 0.782-0.931) and with accuracies of 0.845 and 0.861, respectively. The DCA confirmed the clinical benefit of the both models. The Cohen's Kappa coefficient (κ) was 0.647 (P < 0.001). Diagnostic agreement for malnutrition between the mixed model and GLIM criteria was good. The mixed model was used to calculate the predicted probability of malnutrition in gastric cancer patients, which was divided into high-risk and low-risk groups by median, and the survival analysis showed that the overall survival time of the high-risk group was significantly lower than that of the low-risk group (P = 0.005).

CONCLUSION

Deep learning based on mixed model may be a potential tool for predicting malnutrition in gastric cancer patients.

Bi-Graph Reasoning for Masticatory Muscle Segmentation From Cone-Beam Computed Tomography

Automated segmentation of masticatory muscles is a challenging task considering ambiguous soft tissue attachments and image artifacts of low-radiation cone-beam computed tomography (CBCT) images. In this paper, we propose a bi-graph reasoning model (BGR) for the simultaneous detection and segmentation of multi-category masticatory muscles from CBCTs. The BGR exploits the local and long-range interdependencies of regions of interest and category-specific prior knowledge of masticatory muscles by reasoning on the category graph and the region graph. The category graph of the learnable muscle prior knowledge handles high-level dependencies of muscle categories, enhancing the feature representation with noise-agnostic category knowledge. The region graph models both local and global dependencies of the candidate muscle regions of interest. The proposed BGR accommodates the high-level dependencies and enhances the region features in the presence of entangled soft tissue and image artifacts. We evaluated the proposed approach by segmenting masticatory muscles on clinically acquired CBCTs. Extensive experimental results show that the BGR effectively segments masticatory muscles with state-of-the-art accuracy.

Development and Validation of an Automated Image-Based Deep Learning Platform for Sarcopenia Assessment in Head and Neck Cancer

Importance

Sarcopenia is an established prognostic factor in patients with head and neck squamous cell carcinoma (HNSCC); the quantification of sarcopenia assessed by imaging is typically achieved through the skeletal muscle index (SMI), which can be derived from cervical skeletal muscle segmentation and cross-sectional area. However, manual muscle segmentation is labor intensive, prone to interobserver variability, and impractical for large-scale clinical use.

Objective

To develop and externally validate a fully automated image-based deep learning platform for cervical vertebral muscle segmentation and SMI calculation and evaluate associations with survival and treatment toxicity outcomes.

Design, Setting, and Participants

For this prognostic study, a model development data set was curated from publicly available and deidentified data from patients with HNSCC treated at MD Anderson Cancer Center between January 1, 2003, and December 31, 2013. A total of 899 patients undergoing primary radiation for HNSCC with abdominal computed tomography scans and complete clinical information were selected. An external validation data set was retrospectively collected from patients undergoing primary radiation therapy between January 1, 1996, and December 31, 2013, at Brigham and Women's Hospital. The data analysis was performed between May 1, 2022, and March 31, 2023.

Exposure

C3 vertebral skeletal muscle segmentation during radiation therapy for HNSCC.

Main Outcomes and Measures

Overall survival and treatment toxicity outcomes of HNSCC.

Results

The total patient cohort comprised 899 patients with HNSCC (median [range] age, 58 [24-90] years; 140 female [15.6%] and 755 male [84.0%]). Dice similarity coefficients for the validation set (n = 96) and internal test set (n = 48) were 0.90 (95% CI, 0.90-0.91) and 0.90 (95% CI, 0.89-0.91), respectively, with a mean 96.2% acceptable rate between 2 reviewers on external clinical testing (n = 377). Estimated cross-sectional area and SMI values were associated with manually annotated values (Pearson r = 0.99; P < .001) across data sets. On multivariable Cox proportional hazards regression, SMI-derived sarcopenia was associated with worse overall survival (hazard ratio, 2.05; 95% CI, 1.04-4.04; P = .04) and longer feeding tube duration (median [range], 162 [6-1477] vs 134 [15-1255] days; hazard ratio, 0.66; 95% CI, 0.48-0.89; P = .006) than no sarcopenia.

Conclusions and Relevance

This prognostic study's findings show external validation of a fully automated deep learning pipeline to accurately measure sarcopenia in HNSCC and an association with important disease outcomes. The pipeline could enable the integration of sarcopenia assessment into clinical decision making for individuals with HNSCC.

Imaging Techniques to Determine Degree of Sarcopenia and Systemic Inflammation in Advanced Renal Cell Carcinoma

PURPOSE OF REVIEW

The purpose of this review is to provide an up-to-date understanding regarding the literature on sarcopenia and inflammation as prognostic factors in the context of renal cell carcinoma (RCC).

RECENT FINDINGS

Sarcopenia is increasingly recognized as a prognostic factor in RCC. Emerging literature suggests monitoring quantity of muscle on successive imaging and examining muscle density may be additionally informative. Inflammation has prognostic ability in RCC and is also considered a key contributor to development and progression of both RCC and sarcopenia. Recent studies suggest these two prognostic factors together may provide additional prognostic ability when used in combination. Ongoing developments include quality control regarding sarcopenia research and imaging, improving understanding of muscle loss mechanisms, and enhancing clinical incorporation of sarcopenia via improving imaging analysis practicality (i.e., artificial intelligence) and feasible biomarkers. Sarcopenia and systemic inflammation are complementary prognostic factors for adverse outcomes in patients with RCC. Further study on high-quality sarcopenia assessment standardization and expedited sarcopenia assessment is desired for eventual routine clinical incorporation of these prognostic factors.

Fully-automated sarcopenia assessment in head and neck cancer: development and external validation of a deep learning pipeline

Purpose

Sarcopenia is an established prognostic factor in patients diagnosed with head and neck squamous cell carcinoma (HNSCC). The quantification of sarcopenia assessed by imaging is typically achieved through the skeletal muscle index (SMI), which can be derived from cervical neck skeletal muscle (SM) segmentation and cross-sectional area. However, manual SM segmentation is labor-intensive, prone to inter-observer variability, and impractical for large-scale clinical use. To overcome this challenge, we have developed and externally validated a fully-automated image-based deep learning (DL) platform for cervical vertebral SM segmentation and SMI calculation, and evaluated the relevance of this with survival and toxicity outcomes.

Materials and Methods

899 patients diagnosed as having HNSCC with CT scans from multiple institutes were included, with 335 cases utilized for training, 96 for validation, 48 for internal testing and 393 for external testing. Ground truth single-slice segmentations of SM at the C3 vertebra level were manually generated by experienced radiation oncologists. To develop an efficient method of segmenting the SM, a multi-stage DL pipeline was implemented, consisting of a 2D convolutional neural network (CNN) to select the middle slice of C3 section and a 2D U-Net to segment SM areas. The model performance was evaluated using the Dice Similarity Coefficient (DSC) as the primary metric for the internal test set, and for the external test set the quality of automated segmentation was assessed manually by two experienced radiation oncologists. The L3 skeletal muscle area (SMA) and SMI were then calculated from the C3 cross sectional area (CSA) of the auto-segmented SM. Finally, established SMI cut-offs were used to perform further analyses to assess the correlation with survival and toxicity endpoints in the external institution with univariable and multivariable Cox regression.

Results

DSCs for validation set (n = 96) and internal test set (n = 48) were 0.90 (95% CI: 0.90 - 0.91) and 0.90 (95% CI: 0.89 - 0.91), respectively. The predicted CSA is highly correlated with the ground-truth CSA in both validation (r = 0.99, p < 0.0001) and test sets (r = 0.96, p < 0.0001). In the external test set (n = 377), 96.2% of the SM segmentations were deemed acceptable by consensus expert review. Predicted SMA and SMI values were highly correlated with the ground-truth values, with Pearson r β 0.99 (p < 0.0001) for both the female and male patients in all datasets. Sarcopenia was associated with worse OS (HR 2.05 [95% CI 1.04 - 4.04], p = 0.04) and longer PEG tube duration (median 162 days vs. 134 days, HR 1.51 [95% CI 1.12 - 2.08], p = 0.006 in multivariate analysis.

Conclusion

We developed and externally validated a fully-automated platform that strongly correlates with imaging-assessed sarcopenia in patients with H&N cancer that correlates with survival and toxicity outcomes. This study constitutes a significant stride towards the integration of sarcopenia assessment into decision-making for individuals diagnosed with HNSCC.

SUMMARY STATEMENT

In this study, we developed and externally validated a deep learning model to investigate the impact of sarcopenia, defined as the loss of skeletal muscle mass, on patients with head and neck squamous cell carcinoma (HNSCC) undergoing radiotherapy. We demonstrated an efficient, fullyautomated deep learning pipeline that can accurately segment C3 skeletal muscle area, calculate cross-sectional area, and derive a skeletal muscle index to diagnose sarcopenia from a standard of care CT scan. In multi-institutional data, we found that pre-treatment sarcopenia was associated with significantly reduced overall survival and an increased risk of adverse events. Given the increased vulnerability of patients with HNSCC, the assessment of sarcopenia prior to radiotherapy may aid in informed treatment decision-making and serve as a predictive marker for the necessity of early supportive measures.

Segmentation stability of human head and neck cancer medical images for radiotherapy applications under de-identification conditions: Benchmarking data sharing and artificial intelligence use-cases

Background

Demand for head and neck cancer (HNC) radiotherapy data in algorithmic development has prompted increased image dataset sharing. Medical images must comply with data protection requirements so that re-use is enabled without disclosing patient identifiers. Defacing, i.e., the removal of facial features from images, is often considered a reasonable compromise between data protection and re-usability for neuroimaging data. While defacing tools have been developed by the neuroimaging community, their acceptability for radiotherapy applications have not been explored. Therefore, this study systematically investigated the impact of available defacing algorithms on HNC organs at risk (OARs).

Methods

A publicly available dataset of magnetic resonance imaging scans for 55 HNC patients with eight segmented OARs (bilateral submandibular glands, parotid glands, level II neck lymph nodes, level III neck lymph nodes) was utilized. Eight publicly available defacing algorithms were investigated: afni_refacer, DeepDefacer, defacer, fsl_deface, mask_face, mri_deface, pydeface, and quickshear. Using a subset of scans where defacing succeeded (N=29), a 5-fold cross-validation 3D U-net based OAR auto-segmentation model was utilized to perform two main experiments: 1.) comparing original and defaced data for training when evaluated on original data; 2.) using original data for training and comparing the model evaluation on original and defaced data. Models were primarily assessed using the Dice similarity coefficient (DSC).

Results

Most defacing methods were unable to produce any usable images for evaluation, while mask_face, fsl_deface, and pydeface were unable to remove the face for 29%, 18%, and 24% of subjects, respectively. When using the original data for evaluation, the composite OAR DSC was statistically higher (p ≤ 0.05) for the model trained with the original data with a DSC of 0.760 compared to the mask_face, fsl_deface, and pydeface models with DSCs of 0.742, 0.736, and 0.449, respectively. Moreover, the model trained with original data had decreased performance (p ≤ 0.05) when evaluated on the defaced data with DSCs of 0.673, 0.693, and 0.406 for mask_face, fsl_deface, and pydeface, respectively.

Conclusion

Defacing algorithms may have a significant impact on HNC OAR auto-segmentation model training and testing. This work highlights the need for further development of HNC-specific image anonymization methods.

Development and validation of a radiomics-based nomogram for the prediction of postoperative malnutrition in stage IB1-IIA2 cervical carcinoma

Objective

In individuals with stage IB1-IIA2 cervical cancer (CC) who received postoperative radiotherapy ± chemotherapy (PORT/CRT), the interaction between sarcopenia and malnutrition remains elusive, let alone employing a nomogram model based on radiomic features of psoas extracted at the level of the third lumbar vertebra (L3). This study was set to develop a radiomics-based nomogram model to predict malnutrition as per the Patient-Generated Subjective Global Assessment (PG-SGA) for individuals with CC.

Methods

In total, 120 individuals with CC underwent computed tomography (CT) scans before PORT/CRT. The radiomic features of psoas at L3 were obtained from non-enhanced CT images. Identification of the optimal features and construction of the rad-score formula were conducted utilizing the least absolute shrinkage and selection operator (LASSO) logistic regression to predict malnutrition in the training dataset (radiomic model). Identification of the major clinical factors in the clinical model was performed by means of binary logistic regression analysis. The radiomics-based nomogram was further developed by integrating radiomic signatures and clinical risk factors (combined model). The receiver operating characteristic (ROC) curves and decision curves analysis (DCA) were employed for the evaluation and comparison of the three models in terms of their predictive performance.

Results

Twelve radiomic features in total were chosen, and the rad-score was determined with the help of the non-zero coefficient from LASSO regression. Multivariate analysis revealed that besides rad-score, age and Eastern Cooperative Oncology Group performance status could independently predict malnutrition. As per the data of this analysis, a nomogram prediction model was constructed. The area under the ROC curves (AUC) values of the radiomic and clinical models were 0.778 and 0.847 for the training and 0.776 and 0.776 for the validation sets, respectively. An increase in the AUC was observed up to 0.972 and 0.805 in the training and validation sets, respectively, in the combined model. DCA also confirmed the clinical benefit of the combined model.

Conclusion

This radiomics-based nomogram model depicted potential for use as a marker for predicting malnutrition in stage IB1-IIA2 CC patients who underwent PORT/CRT and required further investigation with a large sample size.

Muscle and adipose tissue segmentations at the third cervical vertebral level in patients with head and neck cancer

The accurate determination of sarcopenia is critical for disease management in patients with head and neck cancer (HNC). Quantitative determination of sarcopenia is currently dependent on manually-generated segmentations of skeletal muscle derived from computed tomography (CT) cross-sectional imaging. This has prompted the increasing utilization of machine learning models for automated sarcopenia determination. However, extant datasets currently do not provide the necessary manually-generated skeletal muscle segmentations at the C3 vertebral level needed for building these models. In this data descriptor, a set of 394 HNC patients were selected from The Cancer Imaging Archive, and their skeletal muscle and adipose tissue was manually segmented at the C3 vertebral level using sliceOmatic. Subsequently, using publicly disseminated Python scripts, we generated corresponding segmentations files in Neuroimaging Informatics Technology Initiative format. In addition to segmentation data, additional clinical demographic data germane to body composition analysis have been retrospectively collected for these patients. These data are a valuable resource for studying sarcopenia and body composition analysis in patients with HNC.