1
|
Liu C, Zhao R, Pang M. Semantic characteristic grading of pulmonary nodules based on deep neural networks. BMC Med Imaging 2023; 23:156. [PMID: 37833636 PMCID: PMC10571455 DOI: 10.1186/s12880-023-01112-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2022] [Accepted: 09/26/2023] [Indexed: 10/15/2023] Open
Abstract
BACKGROUND Accurate grading of semantic characteristics is helpful for radiologists to determine the probabilities of the likelihood of malignancy of a pulmonary nodule. Nevertheless, because of the complex and varied properties of pulmonary nodules, assessing semantic characteristics (SC) is a difficult task. METHOD In this paper, we first analyze a set of important semantic characteristics of pulmonary nodules and extract the important SCs relating to pulmonary nodule malignancy by Pearson's correlation approach. Then, we propose three automatic SC grading models based on deep belief network (DBN) and a multi-branch convolutional neural network (CNN) classifier, MBCNN. The first DBN model takes grayscale and binary nodule images as the input, and the second DBN model takes grayscale nodule images and 72 features extracted from pulmonary nodules as the input. RESULTS Experimental results indicate that our algorithms can achieve satisfying results on semantic characteristic grading. Especially, the MBCNN can obtain higher semantic characteristic grading results with an average accuracy of 89.37%. CONCLUSIONS Quantitative and automatic grading of semantic characteristics proposed in this paper can assist radiologists effectively assess the likelihood of pulmonary nodules being malignant and further promote the early expectant treatment of malignant nodules.
Collapse
Affiliation(s)
- Caixia Liu
- College of Intelligent Education, Jiangsu Normal University, Xuzhou, Jiangsu, China
| | - Ruibin Zhao
- College of Intelligent Education, Jiangsu Normal University, Xuzhou, Jiangsu, China
| | - Mingyong Pang
- Institute of EduInfo Science and Engineering, Nanjing Normal University, Nanjing, China.
| |
Collapse
|
2
|
Fischer M, Küstner T, Pappa S, Niendorf T, Pischon T, Kröncke T, Bette S, Schramm S, Schmidt B, Haubold J, Nensa F, Nonnenmacher T, Palm V, Bamberg F, Kiefer L, Schick F, Yang B. Identification of radiomic biomarkers in a set of four skeletal muscle groups on Dixon MRI of the NAKO MR study. BMC Med Imaging 2023; 23:104. [PMID: 37553619 PMCID: PMC10408104 DOI: 10.1186/s12880-023-01056-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2023] [Accepted: 07/18/2023] [Indexed: 08/10/2023] Open
Abstract
In this work, we propose a processing pipeline for the extraction and identification of meaningful radiomics biomarkers in skeletal muscle tissue as displayed using Dixon-weighted MRI. Diverse and robust radiomics features can be identified that may be of aid in the accurate quantification e.g. varying degrees of sarcopenia in respective muscles of large cohorts. As such, the approach comprises the texture feature extraction from raw data based on well established approaches, such as a nnU-Net neural network and the Pyradiomics toolbox, a subsequent selection according to adequate conditions for the muscle tissue of the general population, and an importance-based ranking to further narrow the amount of meaningful features with respect to auxiliary targets. The performance was investigated with respect to the included auxiliary targets, namely age, body mass index (BMI), and fat fraction (FF). Four skeletal muscles with different fiber architecture were included: the mm. glutaei, m. psoas, as well as the extensors and adductors of the thigh. The selection allowed for a reduction from 1015 available texture features to 65 for age, 53 for BMI, and 36 for FF from the available fat/water contrast images considering all muscles jointly. Further, the dependence of the importance rankings calculated for the auxiliary targets on validation sets (in a cross-validation scheme) was investigated by boxplots. In addition, significant differences between subgroups of respective auxiliary targets as well as between both sexes were shown to be present within the ten lowest ranked features by means of Kruskal-Wallis H-tests and Mann-Whitney U-tests. The prediction performance for the selected features and the ranking scheme were verified on validation sets by a random forest based multi-class classification, with strong area under the curve (AUC) values of the receiver operator characteristic (ROC) of 73.03 ± 0.70 % and 73.63 ± 0.70 % for the water and fat images in age, 80.68 ± 0.30 % and 88.03 ± 0.89 % in BMI, as well as 98.36 ± 0.03 % and 98.52 ± 0.09 % in FF.
Collapse
Affiliation(s)
- Marc Fischer
- Institute of Signal Processing and System Theory, University of Stuttgart, Stuttgart, Germany
| | - Thomas Küstner
- Medical Image and Data Analysis (MIDAS.lab), University Hospital Tübingen, Tübingen, Germany.
| | - Sofia Pappa
- Section on Experimental Radiology, University Hospital Tübingen, Tübingen, Germany
| | - Thoralf Niendorf
- Berlin Ultrahigh Field Facility (B.U.F.F.), Max-Delbrück-Center for Molecular Medicine, Berlin, Germany
| | - Tobias Pischon
- Berlin Ultrahigh Field Facility (B.U.F.F.), Max-Delbrück-Center for Molecular Medicine, Berlin, Germany
| | - Thomas Kröncke
- Department of Diagnostic and Interventional Radiology, University Hospital Augsburg, Augsburg, Germany
- Centre for Advanced Analytics and Predictive Sciences (CAAPS), University Augsburg, Augsburg, Germany
| | - Stefanie Bette
- Department of Diagnostic and Interventional Radiology, University Hospital Augsburg, Augsburg, Germany
| | - Sara Schramm
- Institute for Medical Informatics, Biometry and Epidemiology, Essen University Hospital, Essen, Germany
| | - Börge Schmidt
- Institute for Medical Informatics, Biometry and Epidemiology, Essen University Hospital, Essen, Germany
| | | | | | | | | | | | - Lena Kiefer
- Department of Radiology, University Hospital Tübingen, Tübingen, Germany
| | - Fritz Schick
- Section on Experimental Radiology, University Hospital Tübingen, Tübingen, Germany
| | - Bin Yang
- Institute of Signal Processing and System Theory, University of Stuttgart, Stuttgart, Germany
| |
Collapse
|
3
|
Zhang YP, Zhang XY, Cheng YT, Li B, Teng XZ, Zhang J, Lam S, Zhou T, Ma ZR, Sheng JB, Tam VCW, Lee SWY, Ge H, Cai J. Artificial intelligence-driven radiomics study in cancer: the role of feature engineering and modeling. Mil Med Res 2023; 10:22. [PMID: 37189155 DOI: 10.1186/s40779-023-00458-8] [Citation(s) in RCA: 17] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/22/2022] [Accepted: 05/04/2023] [Indexed: 05/17/2023] Open
Abstract
Modern medicine is reliant on various medical imaging technologies for non-invasively observing patients' anatomy. However, the interpretation of medical images can be highly subjective and dependent on the expertise of clinicians. Moreover, some potentially useful quantitative information in medical images, especially that which is not visible to the naked eye, is often ignored during clinical practice. In contrast, radiomics performs high-throughput feature extraction from medical images, which enables quantitative analysis of medical images and prediction of various clinical endpoints. Studies have reported that radiomics exhibits promising performance in diagnosis and predicting treatment responses and prognosis, demonstrating its potential to be a non-invasive auxiliary tool for personalized medicine. However, radiomics remains in a developmental phase as numerous technical challenges have yet to be solved, especially in feature engineering and statistical modeling. In this review, we introduce the current utility of radiomics by summarizing research on its application in the diagnosis, prognosis, and prediction of treatment responses in patients with cancer. We focus on machine learning approaches, for feature extraction and selection during feature engineering and for imbalanced datasets and multi-modality fusion during statistical modeling. Furthermore, we introduce the stability, reproducibility, and interpretability of features, and the generalizability and interpretability of models. Finally, we offer possible solutions to current challenges in radiomics research.
Collapse
Affiliation(s)
- Yuan-Peng Zhang
- Department of Medical Informatics, Nantong University, Nantong, 226001, Jiangsu, China
- Department of Health Technology and Informatics, the Hong Kong Polytechnic University, Hong Kong, 999077, China
- The Hong Kong Polytechnic University Shenzhen Research Institute, Shenzhen, 518000, Guangdong, China
| | - Xin-Yun Zhang
- Department of Medical Informatics, Nantong University, Nantong, 226001, Jiangsu, China
| | - Yu-Ting Cheng
- Department of Medical Informatics, Nantong University, Nantong, 226001, Jiangsu, China
| | - Bing Li
- Department of Radiation Oncology, the Affiliated Cancer Hospital of Zhengzhou University and Henan Cancer Hospital, Zhengzhou, 450008, Henan, China
| | - Xin-Zhi Teng
- Department of Health Technology and Informatics, the Hong Kong Polytechnic University, Hong Kong, 999077, China
| | - Jiang Zhang
- Department of Health Technology and Informatics, the Hong Kong Polytechnic University, Hong Kong, 999077, China
| | - Saikit Lam
- Department of Health Technology and Informatics, the Hong Kong Polytechnic University, Hong Kong, 999077, China
| | - Ta Zhou
- Department of Health Technology and Informatics, the Hong Kong Polytechnic University, Hong Kong, 999077, China
| | - Zong-Rui Ma
- Department of Health Technology and Informatics, the Hong Kong Polytechnic University, Hong Kong, 999077, China
| | - Jia-Bao Sheng
- Department of Health Technology and Informatics, the Hong Kong Polytechnic University, Hong Kong, 999077, China
| | - Victor C W Tam
- Department of Health Technology and Informatics, the Hong Kong Polytechnic University, Hong Kong, 999077, China
| | - Shara W Y Lee
- Department of Health Technology and Informatics, the Hong Kong Polytechnic University, Hong Kong, 999077, China
| | - Hong Ge
- Department of Radiation Oncology, the Affiliated Cancer Hospital of Zhengzhou University and Henan Cancer Hospital, Zhengzhou, 450008, Henan, China
| | - Jing Cai
- Department of Health Technology and Informatics, the Hong Kong Polytechnic University, Hong Kong, 999077, China.
- The Hong Kong Polytechnic University Shenzhen Research Institute, Shenzhen, 518000, Guangdong, China.
| |
Collapse
|