1
|
Lee S, Kim EK, Han K, Ryu L, Lee EH, Shin HJ. Factors for increasing positive predictive value of pneumothorax detection on chest radiographs using artificial intelligence. Sci Rep 2024; 14:19624. [PMID: 39179744 PMCID: PMC11343866 DOI: 10.1038/s41598-024-70780-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Accepted: 08/21/2024] [Indexed: 08/26/2024] Open
Abstract
This study evaluated the positive predictive value (PPV) of artificial intelligence (AI) in detecting pneumothorax on chest radiographs (CXRs) and its affecting factors. Patients determined to have pneumothorax on CXR by a commercial AI software from March to December 2021 were included retrospectively. The PPV was evaluated according to the true-positive (TP) and false-positive (FP) diagnosis determined by radiologists. To know the factors that might influence the results, logistic regression with generalized estimating equation was used. Among a total of 87,658 CXRs, 308 CXRs with 331 pneumothoraces from 283 patients were finally included. The overall PPV of AI about pneumothorax was 41.1% (TF:FP = 136:195). The PA view (odds ratio [OR], 29.837; 95% confidence interval [CI], 15.062-59.107), high abnormality score (OR, 1.081; 95% CI, 1.066-1.097), large amount of pneumothorax (OR, 1.005; 95% CI, 1.003-1.007), presence of ipsilateral atelectasis (OR, 3.508; 95% CI, 1.509-8.156) and a small amount of ipsilateral pleural effusion (OR, 5.277; 95% CI, 2.55-10.919) had significant effects on the increasing PPV. Therefore, PPV for pneumothorax diagnosis using AI can vary based on patients' factors, image-acquisition protocols, and the presence of concurrent lesions on CXR.
Collapse
Affiliation(s)
- Seungsoo Lee
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-Daero, Giheung-Gu, Yongin-Si, Gyeonggi-Do, 16995, South Korea
| | - Eun-Kyung Kim
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-Daero, Giheung-Gu, Yongin-Si, Gyeonggi-Do, 16995, South Korea
| | - Kyunghwa Han
- Department of Radiology, Severance Hospital, Research Institute of Radiological Science, Yonsei University College of Medicine, 50-1 Yonsei-Ro, Seodaemun-Gu, Seoul, 03722, South Korea
| | - Leeha Ryu
- Department of Biostatistics and Computing, Yonsei University Graduate School, 50-1 Yonsei-Ro, Seodaemun-Gu, Seoul, 03722, South Korea
| | - Eun Hye Lee
- Division of Pulmonology, Allergy and Critical Care Medicine, Department of Internal Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-Daero, Giheung-Gu, Yongin-Si, Gyeonggi-Do, 16995, South Korea
| | - Hyun Joo Shin
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-Daero, Giheung-Gu, Yongin-Si, Gyeonggi-Do, 16995, South Korea.
- Center for Digital Health, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-Daero, Giheung-Gu, Yongin-Si, Gyeonggi-Do, 16995, South Korea.
| |
Collapse
|
2
|
Kwak SH, Kim KY, Choi JS, Kim MC, Seol CH, Kim SR, Lee EH. Impact of AI-assisted CXR analysis in detecting incidental lung nodules and lung cancers in non-respiratory outpatient clinics. Front Med (Lausanne) 2024; 11:1449537. [PMID: 39170040 PMCID: PMC11335519 DOI: 10.3389/fmed.2024.1449537] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2024] [Accepted: 07/29/2024] [Indexed: 08/23/2024] Open
Abstract
Purpose The use of artificial intelligence (AI) for chest X-ray (CXR) analysis is becoming increasingly prevalent in medical environments. This study aimed to determine whether AI in CXR can unexpectedly detect lung nodule detection and influence patient diagnosis and management in non-respiratory outpatient clinics. Methods In this retrospective study, patients over 18 years of age, who underwent CXR at Yongin Severance Hospital outpatient clinics between March 2021 and January 2023 and were identified to have lung nodules through AI software, were included. Commercially available AI-based lesion detection software (Lunit INSIGHT CXR) was used to detect lung nodules. Results Out Of 56,802 radiographic procedures, 40,191 were from non-respiratory departments, with AI detecting lung nodules in 1,754 cases (4.4%). Excluding 139 patients with known lung lesions, 1,615 patients were included in the final analysis. Out of these, 30.7% (495/1,615) underwent respiratory consultation and 31.7% underwent chest CT scans (512/1,615). As a result of the CT scans, 71.5% (366 cases) were found to have true nodules. Among these, the final diagnoses included 36 lung cancers (7.0%, 36/512), 141 lung nodules requiring follow-up (27.5%, 141/512), 114 active pulmonary infections (22.3%, 114/512), and 75 old inflammatory sequelae (14.6%, 75/512). The mean AI nodule score for lung cancer was significantly higher than that for other nodules (56.72 vs. 33.44, p < 0.001). Additionally, active pulmonary infection had a higher consolidation score, and old inflammatory sequelae had the highest fibrosis score, demonstrating differences in the AI analysis among the final diagnosis groups. Conclusion This study indicates that AI-detected incidental nodule abnormalities on CXR in non-respiratory outpatient clinics result in a substantial number of clinically significant diagnoses, emphasizing AI's role in detecting lung nodules and need for further evaluation and specialist consultation for proper diagnosis and management.
Collapse
Affiliation(s)
- Se Hyun Kwak
- Division of Pulmonology, Allergy and Critical Care Medicine, Department of Internal Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si, Republic of Korea
| | - Kyeong Yeon Kim
- Division of Pulmonology, Allergy and Critical Care Medicine, Department of Internal Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si, Republic of Korea
| | - Ji Soo Choi
- Division of Pulmonology, Allergy and Critical Care Medicine, Department of Internal Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si, Republic of Korea
| | - Min Chul Kim
- Division of Pulmonology, Allergy and Critical Care Medicine, Department of Internal Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si, Republic of Korea
| | - Chang Hwan Seol
- Division of Pulmonology, Allergy and Critical Care Medicine, Department of Internal Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si, Republic of Korea
| | - Sung Ryeol Kim
- Division of Pulmonology, Allergy and Critical Care Medicine, Department of Internal Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si, Republic of Korea
| | - Eun Hye Lee
- Division of Pulmonology, Allergy and Critical Care Medicine, Department of Internal Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si, Republic of Korea
- Center for Digital Health, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si, Gyeonggi-do, Republic of Korea
| |
Collapse
|
3
|
Agrawal R, Mishra S, Strange CD, Ahuja J, Shroff GS, Wu CC, Truong MT. The Role of Chest Radiography in Lung Cancer. Semin Ultrasound CT MR 2024:S0887-2171(24)00047-7. [PMID: 39067623 DOI: 10.1053/j.sult.2024.07.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/30/2024]
Abstract
Chest radiography is one of the most commonly performed imaging tests, and benefits include accessibility, speed, cost, and relatively low radiation exposure. Lung cancer is the third most common cancer in the United States and is responsible for the most cancer deaths. Knowledge of the role of chest radiography in assessing patients with lung cancer is important. This article discusses radiographic manifestations of lung cancer, the utility of chest radiography in lung cancer management, as well as the limitations of chest radiography and when computed tomography (CT) is indicated.
Collapse
Affiliation(s)
- Rishi Agrawal
- Department of Thoracic Imaging, University of Texas MD Anderson Cancer Center, Houston, TX.
| | - Shubendu Mishra
- Department of Radiation Oncology, University of Minnesota, Minneapolis, MN
| | - Chad D Strange
- Department of Thoracic Imaging, University of Texas MD Anderson Cancer Center, Houston, TX
| | - Jitesh Ahuja
- Department of Thoracic Imaging, University of Texas MD Anderson Cancer Center, Houston, TX
| | - Girish S Shroff
- Department of Thoracic Imaging, University of Texas MD Anderson Cancer Center, Houston, TX
| | - Carol C Wu
- Department of Thoracic Imaging, University of Texas MD Anderson Cancer Center, Houston, TX
| | - Mylene T Truong
- Department of Thoracic Imaging, University of Texas MD Anderson Cancer Center, Houston, TX
| |
Collapse
|
4
|
Shin HJ, Lee EH, Han K, Ryu L, Kim EK. Development of a new prognostic model to predict pneumonia outcome using artificial intelligence-based chest radiograph results. Sci Rep 2024; 14:14415. [PMID: 38909087 PMCID: PMC11193777 DOI: 10.1038/s41598-024-65488-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Accepted: 06/20/2024] [Indexed: 06/24/2024] Open
Abstract
This study aimed to develop a new simple and effective prognostic model using artificial intelligence (AI)-based chest radiograph (CXR) results to predict the outcomes of pneumonia. Patients aged > 18 years, admitted the treatment of pneumonia between March 2020 and August 2021 were included. We developed prognostic models, including an AI-based consolidation score in addition to the conventional CURB-65 (confusion, urea, respiratory rate, blood pressure, and age ≥ 65) and pneumonia severity index (PSI) for predicting pneumonia outcomes, defined as 30-day mortality during admission. A total of 489 patients, including 310 and 179 patients in training and test sets, were included. In the training set, the AI-based consolidation score on CXR was a significant variable for predicting the outcome (hazard ratio 1.016, 95% confidence interval [CI] 1.001-1.031). The model that combined CURB-65, initial O2 requirement, intubation, and the AI-based consolidation score showed a significantly high C-index of 0.692 (95% CI 0.628-0.757) compared to other models. In the test set, this model also demonstrated a significantly high C-index of 0.726 (95% CI 0.644-0.809) compared to the conventional CURB-65 and PSI (p < 0.001 and 0.017, respectively). Therefore, a new prognostic model incorporating AI-based CXR results along with traditional pneumonia severity score could be a simple and useful tool for predicting pneumonia outcomes in clinical practice.
Collapse
Affiliation(s)
- Hyun Joo Shin
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, Yongin-si, Gyeonggi-do, 16995, South Korea
- Center for Digital Health, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu16995, Yongin-si, Gyeonggi-do, South Korea
| | - Eun Hye Lee
- Division of Pulmonology, Allergy and Critical Care Medicine, Department of Internal Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, Yongin-si, Gyeonggi-do, 16995, South Korea
- Center for Digital Health, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu16995, Yongin-si, Gyeonggi-do, South Korea
| | - Kyunghwa Han
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Severance Hospital, Yonsei University College of Medicine, 50-1 Yonsei-Ro, Seodaemun-Gu, Seoul, 03722, South Korea
| | - Leeha Ryu
- Department of Biostatistics and Computing, Yonsei University Graduate School, 50-1 Yonsei-Ro, Seodaemun-Gu, Seoul, 03722, South Korea
| | - Eun-Kyung Kim
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, Yongin-si, Gyeonggi-do, 16995, South Korea.
| |
Collapse
|
5
|
Hamanaka R, Oda M. Can Artificial Intelligence Replace Humans for Detecting Lung Tumors on Radiographs? An Examination of Resected Malignant Lung Tumors. J Pers Med 2024; 14:164. [PMID: 38392597 PMCID: PMC10890665 DOI: 10.3390/jpm14020164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2023] [Revised: 01/18/2024] [Accepted: 01/29/2024] [Indexed: 02/24/2024] Open
Abstract
OBJECTIVE Although lung cancer screening trials have showed the efficacy of computed tomography to decrease mortality compared with chest radiography, the two are widely taken as different kinds of clinical practices. Artificial intelligence can improve outcomes by detecting lung tumors in chest radiographs. Currently, artificial intelligence is used as an aid for physicians to interpret radiograms, but with the future evolution of artificial intelligence, it may become a modality that replaces physicians. Therefore, in this study, we investigated the current situation of lung cancer diagnosis by artificial intelligence. METHODS In total, we recruited 174 consecutive patients with malignant pulmonary tumors who underwent surgery after chest radiography that was checked by artificial intelligence before surgery. Artificial intelligence diagnoses were performed using the medical image analysis software EIRL X-ray Lung Nodule version 1.12, (LPIXEL Inc., Tokyo, Japan). RESULTS The artificial intelligence determined pulmonary tumors in 90 cases (51.7% for all patients and 57.7% excluding 18 patients with adenocarcinoma in situ). There was no significant difference in the detection rate by the artificial intelligence among histological types. All eighteen cases of adenocarcinoma in situ were not detected by either the artificial intelligence or the physicians. In a univariate analysis, the artificial intelligence could detect cases with larger histopathological tumor size (p < 0.0001), larger histopathological invasion size (p < 0.0001), and higher maximum standardized uptake values of positron emission tomography-computed tomography (p < 0.0001). In a multivariate analysis, detection by AI was significantly higher in cases with a large histopathological invasive size (p = 0.006). In 156 cases excluding adenocarcinoma in situ, we examined the rate of artificial intelligence detection based on the tumor site. Tumors in the lower lung field area were less frequently detected (p = 0.019) and tumors in the middle lung field area were more frequently detected (p = 0.014) compared with tumors in the upper lung field area. CONCLUSIONS Our study showed that using artificial intelligence, the diagnosis of tumor-associated findings and the diagnosis of areas that overlap with anatomical structures is not satisfactory. While the current standing of artificial intelligence diagnostics is to assist physicians in making diagnoses, there is the possibility that artificial intelligence can substitute for humans in the future. However, artificial intelligence should be used in the future as an enhancement, to aid physicians in the role of a radiologist in the workflow.
Collapse
Affiliation(s)
- Rurika Hamanaka
- Department of Thoracic Surgery, Shin-Yurigaoka General Hospital, 255 Furusawa Asao-ku, Kawasaki 215-0026, Japan
| | - Makoto Oda
- Department of Thoracic Surgery, Shin-Yurigaoka General Hospital, 255 Furusawa Asao-ku, Kawasaki 215-0026, Japan
| |
Collapse
|
6
|
Hwang SH, Shin HJ, Kim EK, Lee EH, Lee M. Clinical outcomes and actual consequence of lung nodules incidentally detected on chest radiographs by artificial intelligence. Sci Rep 2023; 13:19732. [PMID: 37957283 PMCID: PMC10643548 DOI: 10.1038/s41598-023-47194-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Accepted: 11/10/2023] [Indexed: 11/15/2023] Open
Abstract
This study evaluated how often clinically significant lung nodules were detected unexpectedly on chest radiographs (CXR) by artificial intelligence (AI)-based detection software, and whether co-existing findings can aid in differential diagnosis of lung nodules. Patients (> 18 years old) with AI-detected lung nodules at their first visit from March 2021 to February 2022, except for those in the pulmonology or thoracic surgery departments, were retrospectively included. Three radiologists categorized nodules into malignancy, active inflammation, post-inflammatory sequelae, or "other" groups. Characteristics of the nodule and abnormality scores of co-existing lung lesions were compared. Approximately 1% of patients (152/14,563) had unexpected lung nodules. Among 73 patients with follow-up exams, 69.9% had true positive nodules. Increased abnormality scores for nodules were significantly associated with malignancy (odds ratio [OR] 1.076, P = 0.001). Increased abnormality scores for consolidation (OR 1.033, P = 0.040) and pleural effusion (OR 1.025, P = 0.041) were significantly correlated with active inflammation-type nodules. Abnormality scores for fibrosis (OR 1.036, P = 0.013) and nodules (OR 0.940, P = 0.001) were significantly associated with post-inflammatory sequelae categorization. AI-based lesion-detection software of CXRs in daily practice can help identify clinically significant incidental lung nodules, and referring accompanying lung lesions may help classify the nodule.
Collapse
Affiliation(s)
- Shin Hye Hwang
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, Yongin-si, Gyeonggi-do, 16995, Republic of Korea
| | - Hyun Joo Shin
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, Yongin-si, Gyeonggi-do, 16995, Republic of Korea
- Center for Digital Health, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si, Gyeonggi‑do, Republic of Korea
| | - Eun-Kyung Kim
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, Yongin-si, Gyeonggi-do, 16995, Republic of Korea
| | - Eun Hye Lee
- Center for Digital Health, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si, Gyeonggi‑do, Republic of Korea
- Division of Pulmonology, Allergy and Critical Care Medicine, Department of Internal Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si, Gyeonggi-do, Republic of Korea
| | - Minwook Lee
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, Yongin-si, Gyeonggi-do, 16995, Republic of Korea.
| |
Collapse
|
7
|
Shin HJ, Kim MH, Son NH, Han K, Kim EK, Kim YC, Park YS, Lee EH, Kyong T. Clinical Implication and Prognostic Value of Artificial-Intelligence-Based Results of Chest Radiographs for Assessing Clinical Outcomes of COVID-19 Patients. Diagnostics (Basel) 2023; 13:2090. [PMID: 37370985 DOI: 10.3390/diagnostics13122090] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2023] [Revised: 06/15/2023] [Accepted: 06/15/2023] [Indexed: 06/29/2023] Open
Abstract
This study aimed to investigate the clinical implications and prognostic value of artificial intelligence (AI)-based results for chest radiographs (CXR) in coronavirus disease 2019 (COVID-19) patients. Patients who were admitted due to COVID-19 from September 2021 to March 2022 were retrospectively included. A commercial AI-based software was used to assess CXR data for consolidation and pleural effusion scores. Clinical data, including laboratory results, were analyzed for possible prognostic factors. Total O2 supply period, the last SpO2 result, and deterioration were evaluated as prognostic indicators of treatment outcome. Generalized linear mixed model and regression tests were used to examine the prognostic value of CXR results. Among a total of 228 patients (mean 59.9 ± 18.8 years old), consolidation scores had a significant association with erythrocyte sedimentation rate and C-reactive protein changes, and initial consolidation scores were associated with the last SpO2 result (estimate -0.018, p = 0.024). All consolidation scores during admission showed significant association with the total O2 supply period and the last SpO2 result. Early changing degree of consolidation score showed an association with deterioration (odds ratio 1.017, 95% confidence interval 1.005-1.03). In conclusion, AI-based CXR results for consolidation have potential prognostic value for predicting treatment outcomes in COVID-19 patients.
Collapse
Affiliation(s)
- Hyun Joo Shin
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si 16995, Republic of Korea
- Center for Digital Health, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si 16995, Republic of Korea
| | - Min Hyung Kim
- Division of Infectious Diseases, Department of Internal Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si 16995, Republic of Korea
| | - Nak-Hoon Son
- Department of Statistics, Keimyung University, Daegu 42601, Republic of Korea
| | - Kyunghwa Han
- Department of Radiology, Severance Hospital, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul 03722, Republic of Korea
| | - Eun-Kyung Kim
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si 16995, Republic of Korea
| | - Yong Chan Kim
- Division of Infectious Diseases, Department of Internal Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si 16995, Republic of Korea
| | - Yoon Soo Park
- Division of Infectious Diseases, Department of Internal Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si 16995, Republic of Korea
| | - Eun Hye Lee
- Division of Pulmonology, Allergy and Critical Care Medicine, Department of Internal Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si 16995, Republic of Korea
| | - Taeyoung Kyong
- Department of Hospital Medicine, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin-si 16995, Republic of Korea
| |
Collapse
|
8
|
Shin HJ, Han K, Ryu L, Kim EK. The impact of artificial intelligence on the reading times of radiologists for chest radiographs. NPJ Digit Med 2023; 6:82. [PMID: 37120423 PMCID: PMC10148851 DOI: 10.1038/s41746-023-00829-4] [Citation(s) in RCA: 23] [Impact Index Per Article: 23.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2023] [Accepted: 04/19/2023] [Indexed: 05/01/2023] Open
Abstract
Whether the utilization of artificial intelligence (AI) during the interpretation of chest radiographs (CXRs) would affect the radiologists' workload is of particular interest. Therefore, this prospective observational study aimed to observe how AI affected the reading times of radiologists in the daily interpretation of CXRs. Radiologists who agreed to have the reading times of their CXR interpretations collected from September to December 2021 were recruited. Reading time was defined as the duration in seconds from opening CXRs to transcribing the image by the same radiologist. As commercial AI software was integrated for all CXRs, the radiologists could refer to AI results for 2 months (AI-aided period). During the other 2 months, the radiologists were automatically blinded to the AI results (AI-unaided period). A total of 11 radiologists participated, and 18,680 CXRs were included. Total reading times were significantly shortened with AI use, compared to no use (13.3 s vs. 14.8 s, p < 0.001). When there was no abnormality detected by AI, reading times were shorter with AI use (mean 10.8 s vs. 13.1 s, p < 0.001). However, if any abnormality was detected by AI, reading times did not differ according to AI use (mean 18.6 s vs. 18.4 s, p = 0.452). Reading times increased as abnormality scores increased, and a more significant increase was observed with AI use (coefficient 0.09 vs. 0.06, p < 0.001). Therefore, the reading times of CXRs among radiologists were influenced by the availability of AI. Overall reading times shortened when radiologists referred to AI; however, abnormalities detected by AI could lengthen reading times.
Collapse
Affiliation(s)
- Hyun Joo Shin
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, Yongin-si, Gyeonggi-do, 16995, South Korea
- Center for Digital Health, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, Yongin-si, Gyeonggi-do, 16995, South Korea
| | - Kyunghwa Han
- Department of Radiology, Severance Hospital, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, 50-1 Yonsei-Ro, Seodaemun-Gu, Seoul, 03722, South Korea
| | - Leeha Ryu
- Department of Biostatistics and Computing, Yonsei University Graduate School, 50-1 Yonsei-Ro, Seodaemun-Gu, Seoul, 03722, South Korea
| | - Eun-Kyung Kim
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, Yongin-si, Gyeonggi-do, 16995, South Korea.
- Center for Digital Health, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, Yongin-si, Gyeonggi-do, 16995, South Korea.
| |
Collapse
|