Artificial intelligence model on chest imaging to diagnose COVID-19 and other pneumonias: A systematic review and meta-analysis

Validated machine learning tools to distinguish immune checkpoint inhibitor, radiotherapy, COVID-19 and other infective pneumonitis

BACKGROUND

Pneumonitis is a well-described, potentially disabling, or fatal adverse effect associated with both immune checkpoint inhibitors (ICI) and thoracic radiotherapy. Accurate differentiation between checkpoint inhibitor pneumonitis (CIP) radiation pneumonitis (RP), and infective pneumonitis (IP) is crucial for swift, appropriate, and tailored management to achieve optimal patient outcomes. However, correct diagnosis is often challenging, owing to overlapping clinical presentations and radiological patterns.

METHODS

In this multi-centre study of 455 patients, we used machine learning with radiomic features extracted from chest CT imaging to develop and validate five models to distinguish CIP and RP from COVID-19, non-COVID-19 infective pneumonitis, and each other. Model performance was compared to that of two radiologists.

RESULTS

Models to distinguish RP from COVID-19, CIP from COVID-19 and CIP from non-COVID-19 IP out-performed radiologists (test set AUCs of 0.92 vs 0.8 and 0.8; 0.68 vs 0.43 and 0.4; 0.71 vs 0.55 and 0.63 respectively). Models to distinguish RP from non-COVID-19 IP and CIP from RP were not superior to radiologists but demonstrated modest performance, with test set AUCs of 0.81 and 0.8 respectively. The CIP vs RP model performed less well on patients with prior exposure to both ICI and radiotherapy (AUC 0.54), though the radiologists also had difficulty distinguishing this test cohort (AUC values 0.6 and 0.6).

CONCLUSION

Our results demonstrate the potential utility of such tools as a second or concurrent reader to support oncologists, radiologists, and chest physicians in cases of diagnostic uncertainty. Further research is required for patients with exposure to both ICI and thoracic radiotherapy.

The Impact of Artificial Intelligence on Microbial Diagnosis

Traditional microbial diagnostic methods face many obstacles such as sample handling, culture difficulties, misidentification, and delays in determining susceptibility. The advent of artificial intelligence (AI) has markedly transformed microbial diagnostics with rapid and precise analyses. Nonetheless, ethical considerations accompany AI adoption, necessitating measures to uphold patient privacy, mitigate biases, and ensure data integrity. This review examines conventional diagnostic hurdles, stressing the significance of standardized procedures in sample processing. It underscores AI's significant impact, particularly through machine learning (ML), in microbial diagnostics. Recent progressions in AI, particularly ML methodologies, are explored, showcasing their influence on microbial categorization, comprehension of microorganism interactions, and augmentation of microscopy capabilities. This review furnishes a comprehensive evaluation of AI's utility in microbial diagnostics, addressing both advantages and challenges. A few case studies including SARS-CoV-2, malaria, and mycobacteria serve to illustrate AI's potential for swift and precise diagnosis. Utilization of convolutional neural networks (CNNs) in digital pathology, automated bacterial classification, and colony counting further underscores AI's versatility. Additionally, AI improves antimicrobial susceptibility assessment and contributes to disease surveillance, outbreak forecasting, and real-time monitoring. Despite a few limitations, integration of AI in diagnostic microbiology presents robust solutions, user-friendly algorithms, and comprehensive training, promising paradigm-shifting advancements in healthcare.

Machine learning-based computer-aided simple triage (CAST) for COVID-19 pneumonia as compared with triage by board-certified chest radiologists

PURPOSE

Several reporting systems have been proposed for providing standardized language and diagnostic categories aiming for expressing the likelihood that lung abnormalities on CT images represent COVID-19. We developed a machine learning (ML)-based CT texture analysis software for simple triage based on the RSNA Expert Consensus Statement system. The purpose of this study was to conduct a multi-center and multi-reader study to determine the capability of ML-based computer-aided simple triage (CAST) software based on RSNA expert consensus statements for diagnosis of COVID-19 pneumonia.

METHODS

For this multi-center study, 174 cases who had undergone CT and polymerase chain reaction (PCR) tests for COVID-19 were retrospectively included. Their CT data were then assessed by CAST and consensus from three board-certified chest radiologists, after which all cases were classified as either positive or negative. Diagnostic performance was then compared by McNemar's test. To determine radiological finding evaluation capability of CAST, three other board-certified chest radiologists assessed CAST results for radiological findings into five criteria. Finally, accuracies of all radiological evaluations were compared by McNemar's test.

RESULTS

A comparison of diagnosis for COVID-19 pneumonia based on RT-PCR results for cases with COVID-19 pneumonia findings on CT showed no significant difference of diagnostic performance between ML-based CAST software and consensus evaluation (p > 0.05). Comparison of agreement on accuracy for all radiological finding evaluations showed that emphysema evaluation accuracy for investigator A (AC = 91.7%) was significantly lower than that for investigators B (100%, p = 0.0009) and C (100%, p = 0.0009).

CONCLUSION

This multi-center study shows COVID-19 pneumonia triage by CAST can be considered at least as valid as that by chest expert radiologists and may be capable for playing as useful a complementary role for management of suspected COVID-19 pneumonia patients as well as the RT-PCR test in routine clinical practice.

Clinical applications of artificial intelligence in identification and management of bacterial infection: Systematic review and meta-analysis

Pneumonia is declared a global emergency public health crisis in children less than five age and the geriatric population. Recent advancements in deep learning models could be utilized effectively for the timely and early diagnosis of pneumonia in immune-compromised patients to avoid complications. This systematic review and meta-analysis utilized PRISMA guidelines for the selection of ten articles included in this study. The literature search was done through electronic databases including PubMed, Scopus, and Google Scholar from 1st January 2016 till 1 July 2023. Overall studies included a total of 126,610 images and 1706 patients in this meta-analysis. At a 95% confidence interval, for pooled sensitivity was 0.90 (0.85-0.94) and I2 statistics 90.20 (88.56 - 91.92). The pooled specificity for deep learning models' diagnostic accuracy was 0.89 (0.86---0.92) and I2 statistics 92.72 (91.50 - 94.83). I2 statistics showed low heterogeneity across studies highlighting consistent and reliable estimates, and instilling confidence in these findings for researchers and healthcare practitioners. The study highlighted the recent deep learning models single or in combination with high accuracy, sensitivity, and specificity to ensure reliable use for bacterial pneumonia identification and differentiate from other viral, fungal pneumonia in children and adults through chest x-rays and radiographs.

Diagnostic performance of deep learning models versus radiologists in COVID-19 pneumonia: A systematic review and meta-analysis

PURPOSE

Although several studies have compared the performance of deep learning (DL) models and radiologists for the diagnosis of COVID-19 pneumonia on CT of the chest, these results have not been collectively evaluated. We performed a meta-analysis of original articles comparing the performance of DL models versus radiologists in detecting COVID-19 pneumonia.

METHODS

A systematic search was conducted on the three main medical literature databases, Scopus, Web of Science, and PubMed, for articles published as of February 1st, 2023. We included original scientific articles that compared DL models trained to detect COVID-19 pneumonia on CT to radiologists. Meta-analysis was performed to determine DL versus radiologist performance in terms of model sensitivity and specificity, taking into account inter and intra-study heterogeneity.

RESULTS

Twenty-two articles met the inclusion criteria. Based on the meta-analytic calculations, DL models had significantly higher pooled sensitivity (0.933 vs. 0.829, p < 0.001) compared to radiologists with similar pooled specificity (0.905 vs. 0.897, p = 0.746). In the differentiation of COVID-19 versus community-acquired pneumonia, the DL models had significantly higher sensitivity compared to radiologists (0.915 vs. 0.836, p = 0.001).

CONCLUSIONS

DL models have high performance for screening of COVID-19 pneumonia on chest CT, offering the possibility of these models for augmenting radiologists in clinical practice.

Harnessing of Artificial Intelligence for the Diagnosis and Prevention of Hospital-Acquired Infections: A Systematic Review

Healthcare-associated infections (HAIs) are the most common adverse events in healthcare and constitute a major global public health concern. Surveillance represents the foundation for the effective prevention and control of HAIs, yet conventional surveillance is costly and labor intensive. Artificial intelligence (AI) and machine learning (ML) have the potential to support the development of HAI surveillance algorithms for the understanding of HAI risk factors, the improvement of patient risk stratification as well as the prediction and timely detection and prevention of infections. AI-supported systems have so far been explored for clinical laboratory testing and imaging diagnosis, antimicrobial resistance profiling, antibiotic discovery and prediction-based clinical decision support tools in terms of HAIs. This review aims to provide a comprehensive summary of the current literature on AI applications in the field of HAIs and discuss the future potentials of this emerging technology in infection practice. Following the PRISMA guidelines, this study examined the articles in databases including PubMed and Scopus until November 2023, which were screened based on the inclusion and exclusion criteria, resulting in 162 included articles. By elucidating the advancements in the field, we aim to highlight the potential applications of AI in the field, report related issues and shortcomings and discuss the future directions.

Blazing the trail for innovative tuberculosis diagnostics

The COVID-19 pandemic brought diagnostics into the spotlight in an unprecedented way not only for case management but also for population health, surveillance, and monitoring. The industry saw notable levels of investment and accelerated research which sparked a wave of innovation. Simple non-invasive sampling methods such as nasal swabs have become widely used in settings ranging from tertiary hospitals to the community. Self-testing has also been adopted as standard practice using not only conventional lateral flow tests but novel and affordable point-of-care molecular diagnostics. The use of new technologies, including artificial intelligence-based diagnostics, have rapidly expanded in the clinical setting. The capacity for next-generation sequencing and acceptance of digital health has significantly increased. However, 4 years after the pandemic started, the market for SARS-CoV-2 tests is saturated, and developers may benefit from leveraging their innovations for other diseases; tuberculosis (TB) is a worthwhile portfolio expansion for diagnostics developers given the extremely high disease burden, supportive environment from not-for-profit initiatives and governments, and the urgent need to overcome the long-standing dearth of innovation in the TB diagnostics field. In exchange, the current challenges in TB detection may be resolved by adopting enhanced swab-based molecular methods, instrument-based, higher sensitivity antigen detection technologies, and/or artificial intelligence-based digital health technologies developed for COVID-19. The aim of this article is to review how such innovative approaches for COVID-19 diagnosis can be applied to TB to have a comparable impact.

Machine and deep learning methods for clinical outcome prediction based on physiological data of COVID-19 patients: a scoping review

INTRODUCTION

Since the beginning of the COVID-19 pandemic, numerous machine and deep learning (MDL) methods have been proposed in the literature to analyze patient physiological data. The objective of this review is to summarize various aspects of these methods and assess their practical utility for predicting various clinical outcomes.

METHODS

We searched PubMed, Scopus, and Cochrane Library, screened and selected the studies matching the inclusion criteria. The clinical analysis focused on the characteristics of the patient cohorts in the studies included in this review, the specific tasks in the context of the COVID-19 pandemic that machine and deep learning methods were used for, and their practical limitations. The technical analysis focused on the details of specific MDL methods and their performance.

RESULTS

Analysis of the 48 selected studies revealed that the majority (∼54 %) of them examined the application of MDL methods for the prediction of survival/mortality-related patient outcomes, while a smaller fraction (∼13 %) of studies also examined applications to the prediction of patients' physiological outcomes and hospital resource utilization. 21 % of the studies examined the application of MDL methods to multiple clinical tasks. Machine and deep learning methods have been shown to be effective at predicting several outcomes of COVID-19 patients, such as disease severity, complications, intensive care unit (ICU) transfer, and mortality. MDL methods also achieved high accuracy in predicting the required number of ICU beds and ventilators.

CONCLUSION

Machine and deep learning methods have been shown to be valuable tools for predicting disease severity, organ dysfunction and failure, patient outcomes, and hospital resource utilization during the COVID-19 pandemic. The discovered knowledge and our conclusions and recommendations can also be useful to healthcare professionals and artificial intelligence researchers in managing future pandemics.

New trend in artificial intelligence-based assistive technology for thoracic imaging

Although there is no solid agreement for artificial intelligence (AI), it refers to a computer system with intelligence similar to that of humans. Deep learning appeared in 2006, and more than 10 years have passed since the third AI boom was triggered by improvements in computing power, algorithm development, and the use of big data. In recent years, the application and development of AI technology in the medical field have intensified internationally. There is no doubt that AI will be used in clinical practice to assist in diagnostic imaging in the future. In qualitative diagnosis, it is desirable to develop an explainable AI that at least represents the basis of the diagnostic process. However, it must be kept in mind that AI is a physician-assistant system, and the final decision should be made by the physician while understanding the limitations of AI. The aim of this article is to review the application of AI technology in diagnostic imaging from PubMed database while particularly focusing on diagnostic imaging in thorax such as lesion detection and qualitative diagnosis in order to help radiologists and clinicians to become more familiar with AI in thorax.

Quantitative Evaluation of COVID-19 Pneumonia CT Using AI Analysis-Feasibility and Differentiation from Other Common Pneumonia Forms

PURPOSE: To implement the technical feasibility of an AI-based software prototype optimized for the detection of COVID-19 pneumonia in CT datasets of the lung and the differentiation between other etiologies of pneumonia. METHODS: This single-center retrospective case-control-study consecutively yielded 144 patients (58 female, mean age 57.72 ± 18.25 y) with CT datasets of the lung. Subgroups including confirmed bacterial (n = 24, 16.6%), viral (n = 52, 36.1%), or fungal (n = 25, 16.6%) pneumonia and (n = 43, 30.7%) patients without detected pneumonia (comparison group) were evaluated using the AI-based Pneumonia Analysis prototype. Scoring (extent, etiology) was compared to reader assessment. RESULTS: The software achieved an optimal sensitivity of 80.8% with a specificity of 50% for the detection of COVID-19; however, the human radiologist achieved optimal sensitivity of 80.8% and a specificity of 97.2%. The mean postprocessing time was 7.61 ± 4.22 min. The use of a contrast agent did not influence the results of the software (p = 0.81). The mean evaluated COVID-19 probability is 0.80 ± 0.36 significantly higher in COVID-19 patients than in patients with fungal pneumonia (p < 0.05) and bacterial pneumonia (p < 0.001). The mean percentage of opacity (PO) and percentage of high opacity (PHO ≥ -200 HU) were significantly higher in COVID-19 patients than in healthy patients. However, the total mean HU in COVID-19 patients was -679.57 ± 112.72, which is significantly higher than in the healthy control group (p < 0.001). CONCLUSION: The detection and quantification of pneumonia beyond the primarily trained COVID-19 datasets is possible and shows comparable results for COVID-19 pneumonia to an experienced reader. The advantages are the fast, automated segmentation and quantification of the pneumonia foci.

Added value of chest CT in a machine learning-based prediction model to rule out COVID-19 before inpatient admission: A retrospective university network study

PURPOSE

During the coronavirus disease 2019 (COVID-19) pandemic, hospitals still face the challenge of timely identification of infected individuals before inpatient admission. An artificial intelligence approach based on an established clinical network may improve prospective pandemic preparedness.

METHOD

Supervised machine learning was used to construct diagnostic models to predict COVID-19. A pooled database was retrospectively generated from 4437 participant data that were collected between January 2017 and October 2020 at 12 German centers that belong to the radiological cooperative network of the COVID-19 (RACOON) consortium. A total of 692 (15.6 %) participants were COVID-19 positive according to the reference of the reverse transcription-polymerase chain reaction test. The diagnostic models included chest CT features (model R), clinical examination and laboratory test features (model CL), or all three feature categories (model RCL). Performance outcomes included accuracy, sensitivity, specificity, negative and positive predictive value, and area under the receiver operating curve (AUC).

RESULTS

Performance of predictive models improved significantly by adding chest CT features to clinical evaluation and laboratory test features. Without (model CL) and with inclusion of chest CT (model RCL), sensitivity was 0.82 and 0.89 (p < 0.0001), specificity was 0.84 and 0.89 (p < 0.0001), negative predictive value was 0.96 and 0.97 (p < 0.0001), AUC was 0.92 and 0.95 (p < 0.0001), and proportion of false negative classifications was 2.6 % and 1.7 % (p < 0.0001), respectively.

CONCLUSIONS

Addition of chest CT features to machine learning-based predictive models improves the effectiveness in ruling out COVID-19 before inpatient admission to regular wards.

Institutional Strategies to Maintain and Grow Imaging Research During the COVID-19 Pandemic

Understanding imaging research experiences, challenges, and strategies for academic radiology departments during and after COVID-19 is critical to prepare for future disruptive events. We summarize key insights and programmatic initiatives at major academic hospitals across the world, based on literature review and meetings of the Radiological Society of North America Vice Chairs of Research (RSNA VCR) group. Through expert discussion and case studies, we provide suggested guidelines to maintain and grow radiology research in the postpandemic era.