1
|
Zhao X, Du Y, Yue H. Skeletal Muscle Segmentation at the Level of the Third Lumbar Vertebra (L3) in Low-Dose Computed Tomography: A Lightweight Algorithm. Tomography 2024; 10:1513-1526. [PMID: 39330757 PMCID: PMC11435900 DOI: 10.3390/tomography10090111] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2024] [Revised: 09/04/2024] [Accepted: 09/09/2024] [Indexed: 09/28/2024] Open
Abstract
BACKGROUND The cross-sectional area of skeletal muscles at the level of the third lumbar vertebra (L3) measured from computed tomography (CT) images is an established imaging biomarker used to assess patients' nutritional status. With the increasing prevalence of low-dose CT scans in clinical practice, accurate and automated skeletal muscle segmentation at the L3 level in low-dose CT images has become an issue to address. This study proposed a lightweight algorithm for automated segmentation of skeletal muscles at the L3 level in low-dose CT images. METHODS This study included 57 patients with rectal cancer, with both low-dose plain and contrast-enhanced pelvic CT image series acquired using a radiotherapy CT scanner. A training set of 30 randomly selected patients was used to develop a lightweight segmentation algorithm, and the other 27 patients were used as the test set. A radiologist selected the most representative axial CT image at the L3 level for both the image series for all the patients, and three groups of observers manually annotated the skeletal muscles in the 54 CT images of the test set as the gold standard. The performance of the proposed algorithm was evaluated in terms of the Dice similarity coefficient (DSC), precision, recall, 95th percentile of the Hausdorff distance (HD95), and average surface distance (ASD). The running time of the proposed algorithm was recorded. An open source deep learning-based AutoMATICA algorithm was compared with the proposed algorithm. The inter-observer variations were also used as the reference. RESULTS The DSC, precision, recall, HD95, ASD, and running time were 93.2 ± 1.9% (mean ± standard deviation), 96.7 ± 2.9%, 90.0 ± 2.9%, 4.8 ± 1.3 mm, 0.8 ± 0.2 mm, and 303 ± 43 ms (on CPU) for the proposed algorithm, and 94.1 ± 4.1%, 92.7 ± 5.5%, 95.7 ± 4.0%, 7.4 ± 5.7 mm, 0.9 ± 0.6 mm, and 448 ± 40 ms (on GPU) for AutoMATICA, respectively. The differences between the proposed algorithm and the inter-observer reference were 4.7%, 1.2%, 7.9%, 3.2 mm, and 0.6 mm, respectively, for the averaged DSC, precision, recall, HD95, and ASD. CONCLUSION The proposed algorithm can be used to segment skeletal muscles at the L3 level in either the plain or enhanced low-dose CT images.
Collapse
Affiliation(s)
- Xuzhi Zhao
- School of Electronic and Information Engineering, Beijing Jiaotong University, Beijing 100044, China
| | - Yi Du
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Radiation Oncology, Peking University Cancer Hospital & Institute, Beijing 100142, China
- Institute of Medical Technology, Peking University Health Science Center, Beijing 100191, China
| | - Haizhen Yue
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Radiation Oncology, Peking University Cancer Hospital & Institute, Beijing 100142, China
| |
Collapse
|
2
|
Cespedes Feliciano EM, Popuri K, Cobzas D, Baracos VE, Beg MF, Khan AD, Ma C, Chow V, Prado CM, Xiao J, Liu V, Chen WY, Meyerhardt J, Albers KB, Caan BJ. Evaluation of automated computed tomography segmentation to assess body composition and mortality associations in cancer patients. J Cachexia Sarcopenia Muscle 2020; 11:1258-1269. [PMID: 32314543 PMCID: PMC7567141 DOI: 10.1002/jcsm.12573] [Citation(s) in RCA: 72] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/18/2019] [Revised: 02/26/2020] [Accepted: 03/11/2020] [Indexed: 01/06/2023] Open
Abstract
BACKGROUND Body composition from computed tomography (CT) scans is associated with cancer outcomes including surgical complications, chemotoxicity, and survival. Most studies manually segment CT scans, but Automatic Body composition Analyser using Computed tomography image Segmentation (ABACS) software automatically segments muscle and adipose tissues to speed analysis. Here, we externally evaluate ABACS in an independent dataset. METHODS Among patients with non-metastatic colorectal (n = 3102) and breast (n = 2888) cancer diagnosed from 2005 to 2013 at Kaiser Permanente, expert raters annotated tissue areas at the third lumbar vertebra (L3). To compare ABACS segmentation results to manual analysis, we quantified the proportion of pixel-level image overlap using Jaccard scores and agreement between methods using intra-class correlation coefficients for continuous tissue areas. We examined performance overall and among subgroups defined by patient and imaging characteristics. To compare the strength of the mortality associations obtained from ABACS's segmentations to manual analysis, we computed Cox proportional hazards ratios (HRs) and 95% confidence intervals (95% CI) by tertile of tissue area. RESULTS Mean ± SD age was 63 ± 11 years for colorectal cancer patients and 56 ± 12 for breast cancer patients. There was strong agreement between manual and automatic segmentations overall and within subgroups of age, sex, body mass index, and cancer stage: average Jaccard scores and intra-class correlation coefficients exceeded 90% for all tissues. ABACS underestimated muscle and visceral and subcutaneous adipose tissue areas by 1-2% versus manual analysis: mean differences were small at -2.35, -1.97 and -2.38 cm2 , respectively. ABACS's performance was lowest for the <2% of patients who were underweight or had anatomic abnormalities. ABACS and manual analysis produced similar associations with mortality; comparing the lowest to highest tertile of skeletal muscle from ABACS versus manual analysis, the HRs were 1.23 (95% CI: 1.00-1.52) versus 1.38 (95% CI: 1.11-1.70) for colorectal cancer patients and 1.30 (95% CI: 1.01-1.66) versus 1.29 (95% CI: 1.00-1.65) for breast cancer patients. CONCLUSIONS In the first study to externally evaluate a commercially available software to assess body composition, automated segmentation of muscle and adipose tissues using ABACS was similar to manual analysis and associated with mortality after non-metastatic cancer. Automated methods will accelerate body composition research and, eventually, facilitate integration of body composition measures into clinical care.
Collapse
Affiliation(s)
| | - Karteek Popuri
- School of Engineering, Simon Fraser University, Vancouver, Canada
| | - Dana Cobzas
- Department of Computing Science, MacEwan University, Edmonton, Canada
| | | | - Mirza Faisal Beg
- School of Engineering, Simon Fraser University, Vancouver, Canada
| | - Arafat Dad Khan
- School of Engineering, Simon Fraser University, Vancouver, Canada
| | - Cydney Ma
- School of Engineering, Simon Fraser University, Vancouver, Canada
| | - Vincent Chow
- School of Engineering, Simon Fraser University, Vancouver, Canada
| | - Carla M Prado
- Department of Agricultural, Food and Nutritional Science, University of Alberta, Edmonton, Canada
| | - Jingjie Xiao
- Covenant Health Palliative Institute, Edmonton, Canada
| | - Vincent Liu
- Division of Research, Kaiser Permanente Northern California, Oakland, CA, USA
| | - Wendy Y Chen
- Department of Medical Oncology, Dana Farber Cancer Institute, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA
| | - Jeffrey Meyerhardt
- Department of Medical Oncology, Dana Farber Cancer Institute, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA
| | - Kathleen B Albers
- Division of Research, Kaiser Permanente Northern California, Oakland, CA, USA
| | - Bette J Caan
- Division of Research, Kaiser Permanente Northern California, Oakland, CA, USA
| |
Collapse
|
3
|
Dabiri S, Popuri K, Cespedes Feliciano EM, Caan BJ, Baracos VE, Beg MF. Muscle segmentation in axial computed tomography (CT) images at the lumbar (L3) and thoracic (T4) levels for body composition analysis. Comput Med Imaging Graph 2019; 75:47-55. [PMID: 31132616 PMCID: PMC6620151 DOI: 10.1016/j.compmedimag.2019.04.007] [Citation(s) in RCA: 51] [Impact Index Per Article: 10.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2018] [Revised: 04/07/2019] [Accepted: 04/29/2019] [Indexed: 01/06/2023]
Abstract
In diseases such as cancer, patients suffer from degenerative loss of skeletal muscle (cachexia). Muscle wasting and loss of muscle function/performance (sarcopenia) can also occur during advanced aging. Assessing skeletal muscle mass in sarcopenia and cachexia is therefore of clinical interest for risk stratification. In comparison with fat, body fluids and bone, quantifying the skeletal muscle mass is more challenging. Computed tomography (CT) is one of the gold standard techniques for cancer diagnostics and analysis of progression, and therefore a valuable source of imaging for in vivo quantification of skeletal muscle mass. In this paper, we design a novel deep neural network-based algorithm for the automated segmentation of skeletal muscle in axial CT images at the third lumbar (L3) and the fourth thoracic (T4) levels. A two-branch network with two training steps is investigated. The network's performance is evaluated for three trained models on separate datasets. These datasets were generated by different CT devices and data acquisition settings. To ensure the model's robustness, each trained model was tested on all three available test sets. Errors and the effect of labeling protocol in these cases were analyzed and reported. The best performance of the proposed algorithm was achieved on 1327 L3 test samples with an overlap Jaccard score of 98% and sensitivity and specificity greater than 99%.
Collapse
Affiliation(s)
- Setareh Dabiri
- School of Engineering Science, Simon Fraser University, Canada.
| | - Karteek Popuri
- School of Engineering Science, Simon Fraser University, Canada
| | | | - Bette J Caan
- Division of Research, Kaiser Permanente Northern California, USA
| | | | | |
Collapse
|
4
|
Engelke K, Museyko O, Wang L, Laredo JD. Quantitative analysis of skeletal muscle by computed tomography imaging-State of the art. J Orthop Translat 2018; 15:91-103. [PMID: 30533385 PMCID: PMC6260391 DOI: 10.1016/j.jot.2018.10.004] [Citation(s) in RCA: 113] [Impact Index Per Article: 18.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/17/2018] [Revised: 10/16/2018] [Accepted: 10/19/2018] [Indexed: 02/06/2023] Open
Abstract
The radiological assessment of muscle properties-size, mass, density (also termed radiodensity), composition, and adipose tissue infiltration-is fundamental in muscle diseases. More recently, it also became obvious that muscle atrophy, also termed muscle wasting, is caused by or associated with many other diseases or conditions, such as inactivity, malnutrition, chronic obstructive pulmonary disorder, cancer-associated cachexia, diabetes, renal and cardiac failure, and sarcopenia and even potentially with osteoporotic hip fracture. Several techniques have been developed to quantify muscle morphology and function. This review is dedicated to quantitative computed tomography (CT) of skeletal muscle and only includes a brief comparison with magnetic resonance imaging. Strengths and limitations of CT techniques are discussed in detail, including CT scanner calibration, acquisition and reconstruction protocols, and the various quantitative parameters that can be measured with CT, starting from simple volume measures to advanced parameters describing the adipose tissue distribution within muscle. Finally, the use of CT in sarcopenia and cachexia and the relevance of muscle parameters for the assessment of osteoporotic fracture illustrate the application of CT in two emerging areas of medical interest.
Collapse
Affiliation(s)
- Klaus Engelke
- FAU, Department of Medicine 3, University Hospital, Erlangen, Germany
- Friedrich-Alexander University Erlangen-Nuremberg, Institute of Medical Physics, Erlangen, Germany
| | - Oleg Museyko
- Friedrich-Alexander University Erlangen-Nuremberg, Institute of Medical Physics, Erlangen, Germany
| | - Ling Wang
- Department of Radiology, Beijing Jishuitan Hospital, Beijing, China
| | - Jean-Denis Laredo
- AP-HP, Department of Radiology, Hôpital Lariboisière, Assistance Publique des Hôpitaux de Paris & Université Paris Diderot, Paris, France
| |
Collapse
|
5
|
Kamiya N, Li J, Kume M, Fujita H, Shen D, Zheng G. Fully automatic segmentation of paraspinal muscles from 3D torso CT images via multi-scale iterative random forest classifications. Int J Comput Assist Radiol Surg 2018; 13:1697-1706. [PMID: 30173335 DOI: 10.1007/s11548-018-1852-1] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2018] [Accepted: 08/27/2018] [Indexed: 01/10/2023]
Abstract
PURPOSE To develop and validate a fully automatic method for segmentation of paraspinal muscles from 3D torso CT images. METHODS We propose a novel learning-based method to address this challenging problem. Multi-scale iterative random forest classifications with multi-source information are employed in this study to speed up the segmentation and to improve the accuracy. Here, multi-source images include the original torso CT images and later also the iteratively estimated and refined probability maps of the paraspinal muscles. We validated our method on 20 torso CT data with associated manual segmentation. We randomly partitioned the 20 CT data into two evenly distributed groups and took one group as the training data and the other group as the test data. RESULTS The proposed method achieved a mean Dice coefficient of 93.0%. It took on average 46.5 s to segment a 3D torso CT image with the size ranging from [Formula: see text] voxels to [Formula: see text] voxels. CONCLUSIONS Our fully automatic, learning-based method can accurately segment paraspinal muscles from 3D torso CT images. It generates segmentation results that are better than those achieved by the state-of-the-art methods.
Collapse
Affiliation(s)
- Naoki Kamiya
- School of Information Science and Technology, Aichi Prefectural University, Nagakute, Japan
| | - Jing Li
- Institute for Surgical Technology and Biomechanics, University of Bern, Bern, Switzerland
| | - Masanori Kume
- Department of Electrical, Electronic and Computer Engineering, Faculty of Engineering, Gifu University, Gifu, Japan
| | - Hiroshi Fujita
- Department of Electrical, Electronic and Computer Engineering, Faculty of Engineering, Gifu University, Gifu, Japan
| | - Dinggang Shen
- Department of Brain and Cognitive Engineering, Korea University, Seoul, 02841, Republic of Korea.
| | - Guoyan Zheng
- Institute for Surgical Technology and Biomechanics, University of Bern, Bern, Switzerland.
| |
Collapse
|
6
|
Lee H, Troschel FM, Tajmir S, Fuchs G, Mario J, Fintelmann FJ, Do S. Pixel-Level Deep Segmentation: Artificial Intelligence Quantifies Muscle on Computed Tomography for Body Morphometric Analysis. J Digit Imaging 2018; 30:487-498. [PMID: 28653123 PMCID: PMC5537099 DOI: 10.1007/s10278-017-9988-z] [Citation(s) in RCA: 108] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023] Open
Abstract
Pretreatment risk stratification is key for personalized medicine. While many physicians rely on an “eyeball test” to assess whether patients will tolerate major surgery or chemotherapy, “eyeballing” is inherently subjective and difficult to quantify. The concept of morphometric age derived from cross-sectional imaging has been found to correlate well with outcomes such as length of stay, morbidity, and mortality. However, the determination of the morphometric age is time intensive and requires highly trained experts. In this study, we propose a fully automated deep learning system for the segmentation of skeletal muscle cross-sectional area (CSA) on an axial computed tomography image taken at the third lumbar vertebra. We utilized a fully automated deep segmentation model derived from an extended implementation of a fully convolutional network with weight initialization of an ImageNet pre-trained model, followed by post processing to eliminate intramuscular fat for a more accurate analysis. This experiment was conducted by varying window level (WL), window width (WW), and bit resolutions in order to better understand the effects of the parameters on the model performance. Our best model, fine-tuned on 250 training images and ground truth labels, achieves 0.93 ± 0.02 Dice similarity coefficient (DSC) and 3.68 ± 2.29% difference between predicted and ground truth muscle CSA on 150 held-out test cases. Ultimately, the fully automated segmentation system can be embedded into the clinical environment to accelerate the quantification of muscle and expanded to volume analysis of 3D datasets.
Collapse
Affiliation(s)
- Hyunkwang Lee
- Department of Radiology, Massachusetts General Hospital, 25 New Chardon Street, Suite 400B, Boston, MA 02114 USA
| | - Fabian M. Troschel
- Department of Radiology, Massachusetts General Hospital, 25 New Chardon Street, Suite 400B, Boston, MA 02114 USA
| | - Shahein Tajmir
- Department of Radiology, Massachusetts General Hospital, 25 New Chardon Street, Suite 400B, Boston, MA 02114 USA
| | - Georg Fuchs
- Department of Radiology, Charite - Universitaetsmedizin Berlin, Chariteplatz 1, 10117 Berlin, Germany
| | - Julia Mario
- Department of Radiology, Massachusetts General Hospital, 25 New Chardon Street, Suite 400B, Boston, MA 02114 USA
| | - Florian J. Fintelmann
- Department of Radiology, Massachusetts General Hospital, 25 New Chardon Street, Suite 400B, Boston, MA 02114 USA
| | - Synho Do
- Department of Radiology, Massachusetts General Hospital, 25 New Chardon Street, Suite 400B, Boston, MA 02114 USA
| |
Collapse
|
7
|
Popuri K, Cobzas D, Esfandiari N, Baracos V, Jägersand M. Body Composition Assessment in Axial CT Images Using FEM-Based Automatic Segmentation of Skeletal Muscle. IEEE TRANSACTIONS ON MEDICAL IMAGING 2016; 35:512-520. [PMID: 26415164 DOI: 10.1109/tmi.2015.2479252] [Citation(s) in RCA: 89] [Impact Index Per Article: 11.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
The proportions of muscle and fat tissues in the human body, referred to as body composition is a vital measurement for cancer patients. Body composition has been recently linked to patient survival and the onset/recurrence of several types of cancers in numerous cancer research studies. This paper introduces a fully automatic framework for the segmentation of muscle and fat tissues from CT images to estimate body composition. We developed a novel finite element method (FEM) deformable model that incorporates a priori shape information via a statistical deformation model (SDM) within the template-based segmentation framework. The proposed method was validated on 1000 abdominal and 530 thoracic CT images and we obtained very good segmentation results with Jaccard scores in excess of 90% for both the muscle and fat regions.
Collapse
|