1
|
Li Y, Chen D, Liu S, Lin J, Wang W, Huang J, Tan L, Liang L, Wang Z, Peng K, Li Q, Jian W, Zhang Y, Peng C, Chen H, Zhang X, Zheng J. Supervised training models with or without manual lesion delineation outperform clinicians in distinguishing pulmonary cryptococcosis from lung adenocarcinoma on chest CT. Mycoses 2024; 67:e13692. [PMID: 38214431 DOI: 10.1111/myc.13692] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Revised: 12/16/2023] [Accepted: 12/22/2023] [Indexed: 01/13/2024]
Abstract
BACKGROUND The role of artificial intelligence (AI) in the discrimination between pulmonary cryptococcosis (PC) and lung adenocarcinoma (LA) warrants further research. OBJECTIVES To compare the performances of AI models with clinicians in distinguishing PC from LA on chest CT. METHODS Patients diagnosed with confirmed PC or LA were retrospectively recruited from three tertiary hospitals in Guangzhou. A deep learning framework was employed to develop two models: an undelineated supervised training (UST) model utilising original CT images, and a delineated supervised training (DST) model utilising CT images with manual lesion annotations provided by physicians. A subset of 20 cases was randomly selected from the entire dataset and reviewed by clinicians through a network questionnaire. The sensitivity, specificity and accuracy of the models and the clinicians were calculated. RESULTS A total of 395 PC cases and 249 LA cases were included in the final analysis. The internal validation results for the UST model showed a sensitivity of 85.3%, specificity of 81.0%, accuracy of 83.6% and an area under the curve (AUC) of 0.93. Similarly, the DST model exhibited a sensitivity of 88.2%, specificity of 88.1%, accuracy of 88.2% and an AUC of 0.94. The external validation of the two models yielded AUC values of 0.74 and 0.77, respectively. The average sensitivity, specificity and accuracy of 102 clinicians were determined to be 63.1%, 53.7% and 59.3%, respectively. CONCLUSIONS Both models outperformed the clinicians in distinguishing between PC and LA on chest CT, with the UST model exhibiting comparable performance to the DST model.
Collapse
Affiliation(s)
- Yun Li
- National Center for Respiratory Medicine, National Clinical Research Center for Respiratory Disease, State Key Laboratory of Respiratory Disease, Guangzhou Institute of Respiratory Health, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Deyan Chen
- Shenyang Neusoft Intelligent Medical Technology Research Institute Co., Ltd, Shenyang, China
| | - Shuyi Liu
- National Center for Respiratory Medicine, National Clinical Research Center for Respiratory Disease, State Key Laboratory of Respiratory Disease, Guangzhou Institute of Respiratory Health, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Junfeng Lin
- National Center for Respiratory Medicine, National Clinical Research Center for Respiratory Disease, State Key Laboratory of Respiratory Disease, Guangzhou Institute of Respiratory Health, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Wei Wang
- School of Biomedical Sciences and Engineering, South China University of Technology, Guangzhou International Campus, Guangzhou, China
- Department of Information, Zhujiang Hospital, Southern Medical University, Guangzhou, China
| | - Jinhai Huang
- National Center for Respiratory Medicine, National Clinical Research Center for Respiratory Disease, State Key Laboratory of Respiratory Disease, Guangzhou Institute of Respiratory Health, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Lunfang Tan
- National Center for Respiratory Medicine, National Clinical Research Center for Respiratory Disease, State Key Laboratory of Respiratory Disease, Guangzhou Institute of Respiratory Health, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Lina Liang
- National Center for Respiratory Medicine, National Clinical Research Center for Respiratory Disease, State Key Laboratory of Respiratory Disease, Guangzhou Institute of Respiratory Health, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Zhufeng Wang
- National Center for Respiratory Medicine, National Clinical Research Center for Respiratory Disease, State Key Laboratory of Respiratory Disease, Guangzhou Institute of Respiratory Health, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Kang Peng
- National Center for Respiratory Medicine, National Clinical Research Center for Respiratory Disease, State Key Laboratory of Respiratory Disease, Guangzhou Institute of Respiratory Health, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Qiasheng Li
- National Center for Respiratory Medicine, National Clinical Research Center for Respiratory Disease, State Key Laboratory of Respiratory Disease, Guangzhou Institute of Respiratory Health, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Wenhua Jian
- National Center for Respiratory Medicine, National Clinical Research Center for Respiratory Disease, State Key Laboratory of Respiratory Disease, Guangzhou Institute of Respiratory Health, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Youwen Zhang
- Department of Neurology, Gaozhou People's Hospital, Gaozhou, China
| | - Chengbao Peng
- Shenyang Neusoft Intelligent Medical Technology Research Institute Co., Ltd, Shenyang, China
| | - Huai Chen
- Department of Radiology, the Second Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Xia Zhang
- Shenyang Neusoft Intelligent Medical Technology Research Institute Co., Ltd, Shenyang, China
| | - Jinping Zheng
- National Center for Respiratory Medicine, National Clinical Research Center for Respiratory Disease, State Key Laboratory of Respiratory Disease, Guangzhou Institute of Respiratory Health, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| |
Collapse
|