AI Improves Nodule Detection on Chest Radiographs in a Health Screening Population: A Randomized Controlled Trial

Facing an un-met need in lung cancer screening: The never smokers

Lung cancer (LC) is the leading cause of cancer-related deaths worldwide and the second most common cancer in both men and women. In addition to smoking, other risk factors, such as environmental tobacco smoke, air pollution, biomass combustion, radon gas, occupational exposure, lung disease, family history of cancer, geographic variability, and genetic factors, play an essential role in developing LC. Current screening guidelines and eligibility criteria have limited efficacy in identifying LC cases (50 %), as most screening programs primarily target subjects with a smoking history as the leading risk factor. Implementing LC screening programs in people who have never smoked (PNS) can significantly impact cancer-specific survival and early disease detection. However, the available evidence regarding the feasibility and effectiveness of such programs is limited. Therefore, further research on LC screening in PNS is warranted to determine the necessary techniques for accurately identifying individuals who should be included in screening programs.

Added value of artificial intelligence solutions for arterial stenosis detection on head and neck CT angiography: A randomized crossover multi-reader multi-case study

PURPOSE

The purpose of this study was to investigate the added value of artificial intelligence (AI) solutions for the detection of arterial stenosis (AS) on head and neck CT angiography (CTA).

MATERIALS AND METHODS

Patients who underwent head and neck CTA examinations at two hospitals were retrospectively included. CTA examinations were randomized into group 1 (without AI-washout-with AI) and group 2 (with AI-washout-without AI), and six readers (two radiology residents, two non-neuroradiologists, and two neuroradiologists) independently interpreted each CTA examination without and with AI solutions. Additionally, reading time was recorded for each patient. Digital subtraction angiography was used as the standard of reference. The diagnostic performance for AS at lesion and patient levels with four AS thresholds (30 %, 50 %, 70 %, and 100 %) was assessed by calculating sensitivity, false-positive lesions index (FPLI), specificity, and accuracy.

RESULTS

A total of 268 patients (169 men, 63.1 %) with a median age of 65 years (first quartile, 57; third quartile, 72; age range: 28-88 years) were included. At the lesion level, AI improved the sensitivity of all readers by 5.2 % for detecting AS ≥ 30 % (P < 0.001). Concurrently, AI reduced the FPLI of all readers and specifically neuroradiologists for detecting non-occlusive AS (all P < 0.05). At the patient level, AI improved the accuracy of all readers by 4.1 % (73.9 % [1189/1608] without AI vs. 78.0 % [1254/1608] with AI) (P < 0.001). Sensitivity for AS ≥ 30 % and the specificity for AS ≥ 70 % increased for all readers with AI assistance (P = 0.01). The median reading time for all readers was reduced from 268 s without AI to 241 s with AI (P< 0.001).

CONCLUSION

AI-assisted diagnosis improves the performance of radiologists in detecting head and neck AS, and shortens reading time.

Barriers and facilitators to implementing imaging-based diagnostic artificial intelligence-assisted decision-making software in hospitals in China: a qualitative study using the updated Consolidated Framework for Implementation Research

OBJECTIVES

To identify the barriers and facilitators to the successful implementation of imaging-based diagnostic artificial intelligence (AI)-assisted decision-making software in China, using the updated Consolidated Framework for Implementation Research (CFIR) as a theoretical basis to develop strategies that promote effective implementation.

DESIGN

This qualitative study involved semistructured interviews with key stakeholders from both clinical settings and industry. Interview guide development, coding, analysis and reporting of findings were thoroughly informed by the updated CFIR.

SETTING

Four healthcare institutions in Beijing and Shanghai and two vendors of AI-assisted decision-making software for lung nodules detection and diabetic retinopathy screening were selected based on purposive sampling.

PARTICIPANTS

A total of 23 healthcare practitioners, 6 hospital informatics specialists, 4 hospital administrators and 7 vendors of the selected AI-assisted decision-making software were included in the study.

RESULTS

Within the 5 CFIR domains, 10 constructs were identified as barriers, 8 as facilitators and 3 as both barriers and facilitators. Major barriers included unsatisfactory clinical performance (Innovation); lack of collaborative network between primary and tertiary hospitals, lack of information security measures and certification (outer setting); suboptimal data quality, misalignment between software functions and goals of healthcare institutions (inner setting); unmet clinical needs (individuals). Key facilitators were strong empirical evidence of effectiveness, improved clinical efficiency (innovation); national guidelines related to AI, deployment of AI software in peer hospitals (outer setting); integration of AI software into existing hospital systems (inner setting) and involvement of clinicians (implementation process).

CONCLUSIONS

The study findings contributed to the ongoing exploration of AI integration in healthcare from the perspective of China, emphasising the need for a comprehensive approach considering both innovation-specific factors and the broader organisational and contextual dynamics. As China and other developing countries continue to advance in adopting AI technologies, the derived insights could further inform healthcare practitioners, industry stakeholders and policy-makers, guiding policies and practices that promote the successful implementation of imaging-based diagnostic AI-assisted decision-making software in healthcare for optimal patient care.

Artificial intelligence-assisted double reading of chest radiographs to detect clinically relevant missed findings: a two-centre evaluation

OBJECTIVES

To evaluate an artificial intelligence (AI)-assisted double reading system for detecting clinically relevant missed findings on routinely reported chest radiographs.

METHODS

A retrospective study was performed in two institutions, a secondary care hospital and tertiary referral oncology centre. Commercially available AI software performed a comparative analysis of chest radiographs and radiologists' authorised reports using a deep learning and natural language processing algorithm, respectively. The AI-detected discrepant findings between images and reports were assessed for clinical relevance by an external radiologist, as part of the commercial service provided by the AI vendor. The selected missed findings were subsequently returned to the institution's radiologist for final review.

RESULTS

In total, 25,104 chest radiographs of 21,039 patients (mean age 61.1 years ± 16.2 [SD]; 10,436 men) were included. The AI software detected discrepancies between imaging and reports in 21.1% (5289 of 25,104). After review by the external radiologist, 0.9% (47 of 5289) of cases were deemed to contain clinically relevant missed findings. The institution's radiologists confirmed 35 of 47 missed findings (74.5%) as clinically relevant (0.1% of all cases). Missed findings consisted of lung nodules (71.4%, 25 of 35), pneumothoraces (17.1%, 6 of 35) and consolidations (11.4%, 4 of 35).

CONCLUSION

The AI-assisted double reading system was able to identify missed findings on chest radiographs after report authorisation. The approach required an external radiologist to review the AI-detected discrepancies. The number of clinically relevant missed findings by radiologists was very low.

CLINICAL RELEVANCE STATEMENT

The AI-assisted double reader workflow was shown to detect diagnostic errors and could be applied as a quality assurance tool. Although clinically relevant missed findings were rare, there is potential impact given the common use of chest radiography.

KEY POINTS

• A commercially available double reading system supported by artificial intelligence was evaluated to detect reporting errors in chest radiographs (n=25,104) from two institutions. • Clinically relevant missed findings were found in 0.1% of chest radiographs and consisted of unreported lung nodules, pneumothoraces and consolidations. • Applying AI software as a secondary reader after report authorisation can assist in reducing diagnostic errors without interrupting the radiologist's reading workflow. However, the number of AI-detected discrepancies was considerable and required review by a radiologist to assess their relevance.

Advances in early detection of non-small cell lung cancer: A comprehensive review

BACKGROUND

Lung cancer has the highest mortality rate among malignancies globally. In addition, due to the growing number of smokers there is considerable concern over its growth. Early detection is an essential step towards reducing complications in this regard and helps to ensure the most effective treatment, reduce health care costs, and increase survival rates.

AIMS

To define the most efficient and cost-effective method of early detection in clinical practice.

MATERIALS AND METHODS

We collected the Information used to write this review by searching papers through PUBMED that were published from 2021 to 2024, mainly systematic reviews, meta-analyses and clinical-trials. We also included other older but notable papers that we found essential and valuable for understanding.

RESULTS

EB-OCT has a varied sensitivity and specificity-an average of 94.3% and 89.9 for each. On the other hand, detecting biomarkers via liquid biopsy carries an average sensitivity of 91.4% for RNA molecules detection, and 97% for combined methylated DNA panels. Moreover, CTCs detection did not prove to have a significant role as a screening method due to the rarity of CTCs in the bloodstream thus the need for more blood samples and for enrichment techniques.

DISCUSSION

Although low-dose CT scan (LDCT) is the current golden standard screening procedure, it is accompanied by a highly false positive rate. In comparison to other radiological screening methods, Endobronchial optical coherence tomography (EB-OCT) has shown a noticeable advantage with a significant degree of accuracy in distinguishing between subtypes of non-small cell lung cancer. Moreover, numerous biomarkers, including RNA molecules, circulating tumor cells, CTCs, and methylated DNA, have been studied in the literature. Many of these biomarkers have a specific high sensitivity and specificity, making them potential candidates for future early detection approaches.

CONCLUSION

LDCT is still the golden standard and the only recommended screening procedure for its high sensitivity and specificity and proven cost-effectiveness. Nevertheless, the notable false positive results acquired during the LDCT examination caused a presumed concern, which drives researchers to investigate better screening procedures and approaches, particularly with the rise of the AI era or by combining two methods in a well-studied screening program like LDCT and liquid biopsy. we suggest conducting more clinical studies on larger populations with a clear demographical target and adopting approaches for combining one of these new methods with LDCT to decrease false-positive cases in early detection.

Capability of multimodal large language models to interpret pediatric radiological images

BACKGROUND

There is a dearth of artificial intelligence (AI) development and research dedicated to pediatric radiology. The newest iterations of large language models (LLMs) like ChatGPT can process image and video input in addition to text. They are thus theoretically capable of providing impressions of input radiological images.

OBJECTIVE

To assess the ability of multimodal LLMs to interpret pediatric radiological images.

MATERIALS AND METHODS

Thirty medically significant cases were collected and submitted to GPT-4 (OpenAI, San Francisco, CA), Gemini 1.5 Pro (Google, Mountain View, CA), and Claude 3 Opus (Anthropic, San Francisco, CA) with a short history for a total of 90 images. AI responses were recorded and independently assessed for accuracy by a resident and attending physician. 95% confidence intervals were determined using the adjusted Wald method.

RESULTS

Overall, the models correctly diagnosed 27.8% (25/90) of images (95% CI=19.5-37.8%), were partially correct for 13.3% (12/90) of images (95% CI=2.7-26.4%), and were incorrect for 58.9% (53/90) of images (95% CI=48.6-68.5%).

CONCLUSION

Multimodal LLMs are not yet capable of interpreting pediatric radiological images.

Impact of AI-assisted CXR analysis in detecting incidental lung nodules and lung cancers in non-respiratory outpatient clinics

Purpose

The use of artificial intelligence (AI) for chest X-ray (CXR) analysis is becoming increasingly prevalent in medical environments. This study aimed to determine whether AI in CXR can unexpectedly detect lung nodule detection and influence patient diagnosis and management in non-respiratory outpatient clinics.

Methods

In this retrospective study, patients over 18 years of age, who underwent CXR at Yongin Severance Hospital outpatient clinics between March 2021 and January 2023 and were identified to have lung nodules through AI software, were included. Commercially available AI-based lesion detection software (Lunit INSIGHT CXR) was used to detect lung nodules.

Results

Out Of 56,802 radiographic procedures, 40,191 were from non-respiratory departments, with AI detecting lung nodules in 1,754 cases (4.4%). Excluding 139 patients with known lung lesions, 1,615 patients were included in the final analysis. Out of these, 30.7% (495/1,615) underwent respiratory consultation and 31.7% underwent chest CT scans (512/1,615). As a result of the CT scans, 71.5% (366 cases) were found to have true nodules. Among these, the final diagnoses included 36 lung cancers (7.0%, 36/512), 141 lung nodules requiring follow-up (27.5%, 141/512), 114 active pulmonary infections (22.3%, 114/512), and 75 old inflammatory sequelae (14.6%, 75/512). The mean AI nodule score for lung cancer was significantly higher than that for other nodules (56.72 vs. 33.44, p < 0.001). Additionally, active pulmonary infection had a higher consolidation score, and old inflammatory sequelae had the highest fibrosis score, demonstrating differences in the AI analysis among the final diagnosis groups.

Conclusion

This study indicates that AI-detected incidental nodule abnormalities on CXR in non-respiratory outpatient clinics result in a substantial number of clinically significant diagnoses, emphasizing AI's role in detecting lung nodules and need for further evaluation and specialist consultation for proper diagnosis and management.

An Artificial Intelligence (AI)-Integrated Approach to Enhance Early Detection and Personalized Treatment Strategies in Lung Cancer Among Smokers: A Literature Review

Lung cancer (LC) is a significant global health issue, particularly among smokers, and is characterized by high rates of incidence and mortality. This comprehensive review offers detailed insights into the potential of artificial intelligence (AI) to revolutionize early detection and personalized treatment strategies for LC. By critically evaluating the limitations of conventional methodologies, we emphasize the innovative potential of AI-driven risk prediction models and imaging analyses to enhance diagnostic precision and improve patient outcomes. Our in-depth analysis of the current state of AI integration in LC care highlights the achievements and challenges encountered in real-world applications, thereby shedding light on practical implementation. Furthermore, we examined the profound implications of AI on treatment response, survival rates, and patient satisfaction, addressing ethical considerations to ensure responsible deployment. In the future, we will outline emerging technologies, anticipate potential barriers to their adoption, and identify areas for further research, emphasizing the importance of collaborative efforts to fully harness the transformative potential of AI in reshaping LC therapy. Ultimately, this review underscores the transformative impact of AI on LC care and advocates for a collective commitment to innovation, collaboration, and ethical stewardship in healthcare.

Evolving and Novel Applications of Artificial Intelligence in Thoracic Imaging

The advent of artificial intelligence (AI) is revolutionizing medicine, particularly radiology. With the development of newer models, AI applications are demonstrating improved performance and versatile utility in the clinical setting. Thoracic imaging is an area of profound interest, given the prevalence of chest imaging and the significant health implications of thoracic diseases. This review aims to highlight the promising applications of AI within thoracic imaging. It examines the role of AI, including its contributions to improving diagnostic evaluation and interpretation, enhancing workflow, and aiding in invasive procedures. Next, it further highlights the current challenges and limitations faced by AI, such as the necessity of 'big data', ethical and legal considerations, and bias in representation. Lastly, it explores the potential directions for the application of AI in thoracic radiology.

[Clinical Application of Artificial Intelligence-Based Detection Assistance Devices for Chest X-Ray Interpretation: Current Status and Practical Considerations]

Artificial intelligence (AI) technology is actively being applied for the interpretation of medical imaging, such as chest X-rays. AI-based software medical devices, which automatically detect various types of abnormal findings in chest X-ray images to assist physicians in their interpretation, are actively being commercialized and clinically implemented in Korea. Several important issues need to be considered for AI-based detection assistant tools to be applied in clinical practice: the evaluation of performance and efficacy prior to implementation; the determination of the target application, range, and method of delivering results; and monitoring after implementation and legal liability issues. Appropriate decision making regarding these devices based on the situation in each institution is necessary. Radiologists must be engaged as medical assessment experts using the software for these devices as well as in medical image interpretation to ensure the safe and efficient implementation and operation of AI-based detection assistant tools.

Impact of an AI software on the diagnostic performance and reading time for the detection of cerebral aneurysms on time of flight MR-angiography

PURPOSE

To evaluate the impact of an AI-based software trained to detect cerebral aneurysms on TOF-MRA on the diagnostic performance and reading times across readers with varying experience levels.

METHODS

One hundred eighty-six MRI studies were reviewed by six readers to detect cerebral aneurysms. Initially, readings were assisted by the CNN-based software mdbrain. After 6 weeks, a second reading was conducted without software assistance. The results were compared to the consensus reading of two neuroradiological specialists and sensitivity (lesion and patient level), specificity (patient level), and false positives per case were calculated for the group of all readers, for the subgroup of physicians, and for each individual reader. Also, reading times for each reader were measured.

RESULTS

The dataset contained 54 aneurysms. The readers had no experience (three medical students), 2 years experience (resident in neuroradiology), 6 years experience (radiologist), and 12 years (neuroradiologist). Significant improvements of overall specificity and the overall number of false positives per case were observed in the reading with AI support. For the physicians, we found significant improvements of sensitivity on lesion and patient level and false positives per case. Four readers experienced reduced reading times with the software, while two encountered increased times.

CONCLUSION

In the reading with the AI-based software, we observed significant improvements in terms of specificity and false positives per case for the group of all readers and significant improvements of sensitivity and false positives per case for the physicians. Further studies are needed to investigate the effects of the AI-based software in a prospective setting.

[A look into the neighboring discipline: eHealth in oncology]

Digitalization is dramatically changing the entire healthcare system. Keywords such as artificial intelligence, electronic patient files (ePA), electronic prescriptions (eRp), telemedicine, wearables, augmented reality and digital health applications (DiGA) represent the digital transformation that is already taking place. Digital becomes real! This article outlines the state of research and development, current plans and ongoing uses of digital tools in oncology in the first half of 2024. The possibilities for using artificial intelligence and the use of DiGAs in oncology are presented in more detail in this overview according to their stage of development as they already show a noticeable benefit in oncology.

Unravelling the diagnostic pathology and molecular biomarkers in lung cancer

The progress in lung cancer treatment is closely interlinked with the progress in diagnostic methods. There are four steps before commencing lung cancer treatment: estimation of the patient's performance status, assessment of disease stage (tumour, node, metastasis), recognition of histological subtype, and detection of biomarkers. The resection rate in lung cancer is <30% and >70% of patients need systemic therapy, which is individually adjusted. Accurate histological diagnosis is very important and it is the basis of further molecular diagnosis. In many cases only small biopsy samples are available and the rules for their assessment are defined in this review. The use of immunochemistry with at least thyroid transcription factor 1 (TTF1) and p40 is decisive in distinction between lung adenocarcinoma and squamous cell carcinoma. Molecular diagnosis and detection of known driver mutations is necessary for introducing targeted therapy and use of multiplex gene panel assays using next-generation sequencing is recommended. Immunotherapy with checkpoint inhibitors is the second promising method of systemic therapy with best results in tumours with high programmed death-ligand 1 (PD-L1) expression on cancer cells. Finally, the determination of a full tumour pattern will be possible using artificial intelligence in the near future.

AI-assisted Analysis to Facilitate Detection of Humeral Lesions on Chest Radiographs

Purpose To develop an artificial intelligence (AI) system for humeral tumor detection on chest radiographs (CRs) and evaluate the impact on reader performance. Materials and Methods In this retrospective study, 14 709 CRs (January 2000 to December 2021) were collected from 13 468 patients, including CT-proven normal (n = 13 116) and humeral tumor (n = 1593) cases. The data were divided into training and test groups. A novel training method called false-positive activation area reduction (FPAR) was introduced to enhance the diagnostic performance by focusing on the humeral region. The AI program and 10 radiologists were assessed using holdout test set 1, wherein the radiologists were tested twice (with and without AI test results). The performance of the AI system was evaluated using holdout test set 2, comprising 10 497 normal images. Receiver operating characteristic analyses were conducted for evaluating model performance. Results FPAR application in the AI program improved its performance compared with a conventional model based on the area under the receiver operating characteristic curve (0.87 vs 0.82, P = .04). The proposed AI system also demonstrated improved tumor localization accuracy (80% vs 57%, P < .001). In holdout test set 2, the proposed AI system exhibited a false-positive rate of 2%. AI assistance improved the radiologists' sensitivity, specificity, and accuracy by 8.9%, 1.2%, and 3.5%, respectively (P < .05 for all). Conclusion The proposed AI tool incorporating FPAR improved humeral tumor detection on CRs and reduced false-positive results in tumor visualization. It may serve as a supportive diagnostic tool to alert radiologists about humeral abnormalities. Keywords: Artificial Intelligence, Conventional Radiography, Humerus, Machine Learning, Shoulder, Tumor Supplemental material is available for this article. © RSNA, 2024.

Survey on Value Elements Provided by Artificial Intelligence and Their Eligibility for Insurance Coverage With an Emphasis on Patient-Centered Outcomes

OBJECTIVE

This study aims to explore the opinions on the insurance coverage of artificial intelligence (AI), as categorized based on the distinct value elements offered by AI, with a specific focus on patient-centered outcomes (PCOs). PCOs are distinguished from traditional clinical outcomes and focus on patient-reported experiences and values such as quality of life, functionality, well-being, physical or emotional status, and convenience.

MATERIALS AND METHODS

We classified the value elements provided by AI into four dimensions: clinical outcomes, economic aspects, organizational aspects, and non-clinical PCOs. The survey comprised three sections: 1) experiences with PCOs in evaluating AI, 2) opinions on the coverage of AI by the National Health Insurance of the Republic of Korea when AI demonstrated benefits across the four value elements, and 3) respondent characteristics. The opinions regarding AI insurance coverage were assessed dichotomously and semi-quantitatively: non-approval (0) vs. approval (on a 1-10 weight scale, with 10 indicating the strongest approval). The survey was conducted from July 4 to 26, 2023, using a web-based method. Responses to PCOs and other value elements were compared.

RESULTS

Among 200 respondents, 44 (22%) were patients/patient representatives, 64 (32%) were industry/developers, 60 (30%) were medical practitioners/doctors, and 32 (16%) were government health personnel. The level of experience with PCOs regarding AI was low, with only 7% (14/200) having direct experience and 10% (20/200) having any experience (either direct or indirect). The approval rate for insurance coverage for PCOs was 74% (148/200), significantly lower than the corresponding rates for other value elements (82.5%-93.5%; P ≤ 0.034). The approval strength was significantly lower for PCOs, with a mean weight ± standard deviation of 5.1 ± 3.5, compared to other value elements (P ≤ 0.036).

CONCLUSION

There is currently limited demand for insurance coverage for AI that demonstrates benefits in terms of non-clinical PCOs.

Artificial Intelligence in Oncology: Current Landscape, Challenges, and Future Directions

Artificial intelligence (AI) in oncology is advancing beyond algorithm development to integration into clinical practice. This review describes the current state of the field, with a specific focus on clinical integration. AI applications are structured according to cancer type and clinical domain, focusing on the four most common cancers and tasks of detection, diagnosis, and treatment. These applications encompass various data modalities, including imaging, genomics, and medical records. We conclude with a summary of existing challenges, evolving solutions, and potential future directions for the field.

SIGNIFICANCE

AI is increasingly being applied to all aspects of oncology, where several applications are maturing beyond research and development to direct clinical integration. This review summarizes the current state of the field through the lens of clinical translation along the clinical care continuum. Emerging areas are also highlighted, along with common challenges, evolving solutions, and potential future directions for the field.

Impact of Deep Learning Image Reconstruction Methods on MRI Throughput

Purpose To evaluate the effect of implementing two distinct commercially available deep learning reconstruction (DLR) algorithms on the efficiency of MRI examinations conducted in real clinical practice within an outpatient setting at a large, multicenter institution. Materials and Methods This retrospective study included 7346 examinations from 10 clinical MRI scanners analyzed during the pre- and postimplementation periods of DLR methods. Two different types of DLR methods, namely Digital Imaging and Communications in Medicine (DICOM)-based and k-space-based methods, were implemented in half of the scanners (three DICOM-based and two k-space-based), while the remaining five scanners had no DLR method implemented. Scan and room times of each examination type during the pre- and postimplementation periods were compared among the different DLR methods using the Wilcoxon test. Results The application of deep learning methods resulted in significant reductions in scan and room times for certain examination types. The DICOM-based method demonstrated up to a 53% reduction in scan times and a 41% reduction in room times for various study types. The k-space-based method demonstrated up to a 27% reduction in scan times but did not significantly reduce room times. Conclusion DLR methods were associated with reductions in scan and room times in a clinical setting, though the effects were heterogeneous depending on examination type. Thus, potential adopters should carefully evaluate their case mix to determine the impact of integrating these tools. Keywords: Deep Learning MRI Reconstruction, Reconstruction Algorithms, DICOM-based Reconstruction, k-Space-based Reconstruction © RSNA, 2024 See also the commentary by GharehMohammadi in this issue.

Performance of artificial intelligence-based software for the automatic detection of lung lesions on chest radiographs of patients with suspected lung cancer

PURPOSE

This study aimed to evaluate the performance of the commercially available artificial intelligence-based software CXR-AID for the automatic detection of pulmonary nodules on the chest radiographs of patients suspected of having lung cancer.

MATERIALS AND METHODS

This retrospective study included 399 patients with clinically suspected lung cancer who underwent CT and chest radiography within 1 month between June 2020 and May 2022. The candidate areas on chest radiographs identified by CXR-AID were categorized into target (properly detected areas) and non-target (improperly detected areas) areas. The non-target areas were further divided into non-target normal areas (false positives for normal structures) and non-target abnormal areas. The visibility score, characteristics and location of the nodules, presence of overlapping structures, and background lung score and presence of pulmonary disease were manually evaluated and compared between the nodules detected or undetected by CXR-AID. The probability indices calculated by CXR-AID were compared between the target and non-target areas.

RESULTS

Among the 450 nodules detected in 399 patients, 331 nodules detected in 313 patients were visible on chest radiographs during manual evaluation. CXR-AID detected 264 of these 331 nodules with a sensitivity of 0.80. The detection sensitivity increased significantly with the visibility score. No significant correlation was observed between the background lung score and sensitivity. The non-target area per image was 0.85, and the probability index of the non-target area was lower than that of the target area. The non-target normal area per image was 0.24. Larger and more solid nodules exhibited higher sensitivities, while nodules with overlapping structures demonstrated lower detection sensitivities.

CONCLUSION

The nodule detection sensitivity of CXR-AID on chest radiographs was 0.80, and the non-target and non-target normal areas per image were 0.85 and 0.24, respectively. Larger, solid nodules without overlapping structures were detected more readily by CXR-AID.

[The contribution of artificial intelligence (AI) subsequent to the processing of thoracic imaging]

The contribution of artificial intelligence (AI) to medical imaging is currently the object of widespread experimentation. The development of deep learning (DL) methods, particularly convolution neural networks (CNNs), has led to performance gains often superior to those achieved by conventional methods such as machine learning. Radiomics is an approach aimed at extracting quantitative data not accessible to the human eye from images expressing a disease. The data subsequently feed machine learning models and produce diagnostic or prognostic probabilities. As for the multiple applications of AI methods in thoracic imaging, they are undergoing evaluation. Chest radiography is a practically ideal field for the development of DL algorithms able to automatically interpret X-rays. Current algorithms can detect up to 14 different abnormalities present either in isolation or in combination. Chest CT is another area offering numerous AI applications. Various algorithms have been specifically formed and validated for the detection and characterization of pulmonary nodules and pulmonary embolism, as well as segmentation and quantitative analysis of the extent of diffuse lung diseases (emphysema, infectious pneumonias, interstitial lung disease). In addition, the analysis of medical images can be associated with clinical, biological, and functional data (multi-omics analysis), the objective being to construct predictive approaches regarding disease prognosis and response to treatment.

Performance of ChatGPT on the Brazilian Radiology and Diagnostic Imaging and Mammography Board Examinations

This prospective exploratory study conducted from January 2023 through May 2023 evaluated the ability of ChatGPT to answer questions from Brazilian radiology board examinations, exploring how different prompt strategies can influence performance using GPT-3.5 and GPT-4. Three multiple-choice board examinations that did not include image-based questions were evaluated: (a) radiology and diagnostic imaging, (b) mammography, and (c) neuroradiology. Five different styles of zero-shot prompting were tested: (a) raw question, (b) brief instruction, (c) long instruction, (d) chain-of-thought, and (e) question-specific automatic prompt generation (QAPG). The QAPG and brief instruction prompt strategies performed best for all examinations (P < .05), obtaining passing scores (≥60%) on the radiology and diagnostic imaging examination when testing both versions of ChatGPT. The QAPG style achieved a score of 60% for the mammography examination using GPT-3.5 and 76% using GPT-4. GPT-4 achieved a score up to 65% in the neuroradiology examination. The long instruction style consistently underperformed, implying that excessive detail might harm performance. GPT-4's scores were less sensitive to prompt style changes. The QAPG prompt style showed a high volume of the "A" option but no statistical difference, suggesting bias was found. GPT-4 passed all three radiology board examinations, and GPT-3.5 passed two of three examinations when using an optimal prompt style. Keywords: ChatGPT, Artificial Intelligence, Board Examinations, Radiology and Diagnostic Imaging, Mammography, Neuroradiology © RSNA, 2023 See also the commentary by Trivedi and Gichoya in this issue.

Retrospectively assessing evaluation and management of artificial-intelligence detected nodules on uninterpreted chest radiographs in the era of radiologists shortage

PURPOSE

High volumes of chest radiographs (CXR) remain uninterpreted due to severe shortage of radiologists. These CXRs may be informally reported by non-radiologist physicians, or not reviewed at all. Artificial intelligence (AI) software can aid lung nodule detection. Our aim was to assess evaluation and management by non-radiologists of uninterpreted CXRs with AI detected nodules, compared to retrospective radiology reports.

MATERIALS AND METHODS

AI detected nodules on uninterpreted CXRs of adults, performed 30/6/2022-31/1/2023, were evaluated. Excluded were patients with known active malignancy and duplicate CXRs of the same patient. The electronic medical records (EMR) were reviewed, and the clinicians' notes on the CXR and AI detected nodule were documented. Dedicated thoracic radiologists retrospectively interpreted all CXRs, and similarly to the clinicians, they had access to the AI findings, prior imaging and EMR. The radiologists' interpretation served as the ground truth, and determined if the AI-detected nodule was a true lung nodule and if further workup was required.

RESULTS

A total of 683 patients met the inclusion criteria. The clinicians commented on 386 (56.5%) CXRs, identified true nodules on 113 CXRs (16.5%), incorrectly mentioned 31 (4.5%) false nodules as real nodules, and did not mention the AI detected nodule on 242 (35%) CXRs, of which 68 (10%) patients were retrospectively referred for further workup by the radiologist. For 297 patients (43.5%) there were no comments regarding the CXR in the EMR. Of these, 77 nodules (11.3%) were retrospectively referred for further workup by the radiologist.

CONCLUSION

AI software for lung nodule detection may be insufficient without a formal radiology report, and may lead to over diagnosis or misdiagnosis of nodules.

Using AI to Improve Radiologist Performance in Detection of Abnormalities on Chest Radiographs

Background Chest radiography remains the most common radiologic examination, and interpretation of its results can be difficult. Purpose To explore the potential benefit of artificial intelligence (AI) assistance in the detection of thoracic abnormalities on chest radiographs by evaluating the performance of radiologists with different levels of expertise, with and without AI assistance. Materials and Methods Patients who underwent both chest radiography and thoracic CT within 72 hours between January 2010 and December 2020 in a French public hospital were screened retrospectively. Radiographs were randomly included until reaching 500 radiographs, with about 50% of radiographs having abnormal findings. A senior thoracic radiologist annotated the radiographs for five abnormalities (pneumothorax, pleural effusion, consolidation, mediastinal and hilar mass, lung nodule) based on the corresponding CT results (ground truth). A total of 12 readers (four thoracic radiologists, four general radiologists, four radiology residents) read half the radiographs without AI and half the radiographs with AI (ChestView; Gleamer). Changes in sensitivity and specificity were measured using paired t tests. Results The study included 500 patients (mean age, 54 years ± 19 [SD]; 261 female, 239 male), with 522 abnormalities visible on 241 radiographs. On average, for all readers, AI use resulted in an absolute increase in sensitivity of 26% (95% CI: 20, 32), 14% (95% CI: 11, 17), 12% (95% CI: 10, 14), 8.5% (95% CI: 6, 11), and 5.9% (95% CI: 4, 8) for pneumothorax, consolidation, nodule, pleural effusion, and mediastinal and hilar mass, respectively (P < .001). Specificity increased with AI assistance (3.9% [95% CI: 3.2, 4.6], 3.7% [95% CI: 3, 4.4], 2.9% [95% CI: 2.3, 3.5], and 2.1% [95% CI: 1.6, 2.6] for pleural effusion, mediastinal and hilar mass, consolidation, and nodule, respectively), except in the diagnosis of pneumothorax (-0.2%; 95% CI: -0.36, -0.04; P = .01). The mean reading time was 81 seconds without AI versus 56 seconds with AI (31% decrease, P < .001). Conclusion AI-assisted chest radiography interpretation resulted in absolute increases in sensitivity for all radiologists of various levels of expertise and reduced the reading times; specificity increased with AI, except in the diagnosis of pneumothorax. © RSNA, 2023 Supplemental material is available for this article.

Novel research and future prospects of artificial intelligence in cancer diagnosis and treatment

Research into the potential benefits of artificial intelligence for comprehending the intricate biology of cancer has grown as a result of the widespread use of deep learning and machine learning in the healthcare sector and the availability of highly specialized cancer datasets. Here, we review new artificial intelligence approaches and how they are being used in oncology. We describe how artificial intelligence might be used in the detection, prognosis, and administration of cancer treatments and introduce the use of the latest large language models such as ChatGPT in oncology clinics. We highlight artificial intelligence applications for omics data types, and we offer perspectives on how the various data types might be combined to create decision-support tools. We also evaluate the present constraints and challenges to applying artificial intelligence in precision oncology. Finally, we discuss how current challenges may be surmounted to make artificial intelligence useful in clinical settings in the future.

Artificial Intelligence and Lung Cancer: Impact on Improving Patient Outcomes

Lung cancer remains one of the leading causes of cancer-related deaths worldwide, emphasizing the need for improved diagnostic and treatment approaches. In recent years, the emergence of artificial intelligence (AI) has sparked considerable interest in its potential role in lung cancer. This review aims to provide an overview of the current state of AI applications in lung cancer screening, diagnosis, and treatment. AI algorithms like machine learning, deep learning, and radiomics have shown remarkable capabilities in the detection and characterization of lung nodules, thereby aiding in accurate lung cancer screening and diagnosis. These systems can analyze various imaging modalities, such as low-dose CT scans, PET-CT imaging, and even chest radiographs, accurately identifying suspicious nodules and facilitating timely intervention. AI models have exhibited promise in utilizing biomarkers and tumor markers as supplementary screening tools, effectively enhancing the specificity and accuracy of early detection. These models can accurately distinguish between benign and malignant lung nodules, assisting radiologists in making more accurate and informed diagnostic decisions. Additionally, AI algorithms hold the potential to integrate multiple imaging modalities and clinical data, providing a more comprehensive diagnostic assessment. By utilizing high-quality data, including patient demographics, clinical history, and genetic profiles, AI models can predict treatment responses and guide the selection of optimal therapies. Notably, these models have shown considerable success in predicting the likelihood of response and recurrence following targeted therapies and optimizing radiation therapy for lung cancer patients. Implementing these AI tools in clinical practice can aid in the early diagnosis and timely management of lung cancer and potentially improve outcomes, including the mortality and morbidity of the patients.

Deep learning-based automatic detection for pulmonary nodules on chest radiographs: The relationship with background lung condition, nodule characteristics, and location

PURPOSE

Computer-aided diagnosis (CAD), which assists in the interpretation of chest radiographs, is becoming common. However, few studies have evaluated the benefits and pitfalls of CAD in the real world. This study aimed to evaluate the independent performance of commercially available deep learning-based automatic detection (DLAD) software, EIRL Chest X-ray Lung Nodule, in a cohort that included patients with background pulmonary abnormalities often encountered in clinical situations.

METHODS

Patients with clinically suspected lung cancer for whom chest radiography was performed within a month before or after CT scan between June 2020 and May 2022 in our institution were enrolled. The reference standard was created using a bounding box annotated by two radiologists with reference to the CT. The visibility score, characteristics, location of the pulmonary nodules, presence of overlapping structures or pulmonary disease, and background lung score were manually determined.

RESULTS

We included 388 patients. The DLAD software detected 222 of the 322 nodules visible on manual evaluation, with a sensitivity of 0.689 and a false-positive rate of 0.168. The detectability of the DLAD software was significantly lower for small and subsolid and nodules with overlapping structures. The visibility score and sensitivity of detection by the DLAD software were positively correlated. The relationship between the background lung score and detection by the DLAD software was unclear.

CONCLUSION

The standalone performance of DLAD in detecting pulmonary nodules exhibited a sensitivity of 0.689 and a false-positive rate of 0.168. Understanding the characteristics of DLAD is crucial when interpreting chest radiographs with the assistance of the DLAD.

Identification of age-dependent features of human bronchi using explainable artificial intelligence

Background

Ageing induces functional and structural alterations in organs, and age-dependent parameters have been identified in various medical data sources. However, there is currently no specific clinical test to quantitatively evaluate age-related changes in bronchi. This study aimed to identify age-dependent bronchial features using explainable artificial intelligence for bronchoscopy images.

Methods

The present study included 11 374 bronchoscopy images, divided into training and test datasets based on the time axis. We constructed convolutional neural network (CNN) models and evaluated these models using the correlation coefficient between the chronological age and the "bronchial age" calculated from bronchoscopy images. We employed gradient-weighted class activation mapping (Grad-CAM) to identify age-dependent bronchial features that the model focuses on. We assessed the universality of our model by comparing the distribution of bronchial age for each respiratory disease or smoking history.

Results

We constructed deep-learning models using four representative CNN architectures to calculate bronchial age. Although the bronchial age showed a significant correlation with chronological age in each CNN architecture, EfficientNetB3 achieved the highest Pearson's correlation coefficient (0.9617). The application of Grad-CAM to the EfficientNetB3-based model revealed that the model predominantly attended to bronchial bifurcation sites, regardless of whether the model accurately predicted chronological age or exhibited discrepancies. There were no significant differences in the discrepancy between the bronchial age and chronological age among different respiratory diseases or according to smoking history.

Conclusion

Bronchial bifurcation sites are universally important age-dependent features in bronchi, regardless of the type of respiratory disease or smoking history.

Performance of deep learning-based autodetection of arterial stenosis on head and neck CT angiography: an independent external validation study

PURPOSE

To externally validate the performance of automated stenosis detection on head and neck CT angiography (CTA) and investigate the impact factors using an independent bi-center dataset with digital subtraction angiography (DSA) as the ground truth.

MATERIAL AND METHODS

Patients who underwent head and neck CTA and DSA between January 2019 and December 2021 were retrospectively included. The degree of stenosis was automatically evaluated using CerebralDoc based on CTA. The performance of CerebralDoc across levels (per-patient, per-region, per-vessel, and per-segment) and thresholds (≥ 50%, ≥ 70%, and = 100%) was evaluated. Logistic regression was performed to identify independent factors associated with false negative results.

RESULTS

296 patients were analyzed. Specificity across levels and thresholds was high, exceeding 92%. The area under the curve ranged from poor (0.615, 95% CI: 0.544, 0.686; at the region-based analysis for stenosis ≥ 70%) to excellent (0.945, 95% CI: 0.905, 0.985; at the patient-based analysis for stenosis ≥ 50%). Sensitivity ranged from 0.714 (95% CI: 0.675, 0.750) at the segment-based analysis for stenosis ≥ 70% to 0.895 (95% CI: 0.849, 0.919) at the patient-based analysis for stenosis ≥ 50%. The multiple logistic regression analysis revealed that false negative results were primarily more likely to specific stenosis locations (particularly the M2 segment and skull base segment of the internal carotid artery) and occlusion.

CONCLUSIONS

CerebralDoc has the potential to automated stenosis detection on head and neck CTA, but further efforts are needed to optimize its performance.

Redefining Radiology: A Review of Artificial Intelligence Integration in Medical Imaging

This comprehensive review unfolds a detailed narrative of Artificial Intelligence (AI) making its foray into radiology, a move that is catalysing transformational shifts in the healthcare landscape. It traces the evolution of radiology, from the initial discovery of X-rays to the application of machine learning and deep learning in modern medical image analysis. The primary focus of this review is to shed light on AI applications in radiology, elucidating their seminal roles in image segmentation, computer-aided diagnosis, predictive analytics, and workflow optimisation. A spotlight is cast on the profound impact of AI on diagnostic processes, personalised medicine, and clinical workflows, with empirical evidence derived from a series of case studies across multiple medical disciplines. However, the integration of AI in radiology is not devoid of challenges. The review ventures into the labyrinth of obstacles that are inherent to AI-driven radiology-data quality, the 'black box' enigma, infrastructural and technical complexities, as well as ethical implications. Peering into the future, the review contends that the road ahead for AI in radiology is paved with promising opportunities. It advocates for continuous research, embracing avant-garde imaging technologies, and fostering robust collaborations between radiologists and AI developers. The conclusion underlines the role of AI as a catalyst for change in radiology, a stance that is firmly rooted in sustained innovation, dynamic partnerships, and a steadfast commitment to ethical responsibility.

Artificial intelligence in oncology: chances and pitfalls

Artificial intelligence (AI) has been available in rudimentary forms for many decades. Early AI programs were successful in niche areas such as chess or handwriting recognition. However, AI methods had little practical impact on the practice of medicine until recently. Beginning around 2012, AI has emerged as an increasingly important tool in healthcare, and AI-based devices are now approved for clinical use. These devices are capable of processing image data, making diagnoses, and predicting biomarkers for solid tumors, among other applications. Despite this progress, the development of AI in medicine is still in its early stages, and there have been exponential technical advancements since 2022, with some AI programs now demonstrating human-level understanding of image and text data. In the past, technical advances have led to new medical applications with a delay of a few years. Therefore, now we might be at the beginning of a new era in which AI will become even more important in clinical practice. It is essential that this transformation is humane and evidence based, and physicians must take a leading role in ensuring this, particularly in hematology and oncology.

Expanding the Reach and Grasp of Lung Cancer Screening

Low-dose computer tomographic (LDCT) lung cancer screening reduces lung cancer-specific and all-cause mortality among high-risk individuals, but implementation has been challenging. Despite health insurance coverage for lung cancer screening in the United States since 2015, fewer than 10% of eligible persons have participated; striking geographic, racial, and socioeconomic disparities were already evident, especially in the populations at greatest risk of lung cancer and, therefore, most likely to benefit from screening; and adherence to subsequent testing is significantly lower than that reported in clinical trials, potentially reducing the realized benefit. Lung cancer screening is a covered health care benefit in very few countries. Obtaining the full population-level benefit of lung cancer screening will require improved participation of already eligible persons (the grasp of screening) and improved eligibility criteria that more closely match up with the full spectrum of persons at risk (the reach of screening), irrespective of smoking history. We used the socioecological framework of health care to systematically review implementation barriers to lung cancer screening and discuss multilevel solutions. We also discussed guideline-concordant management of incidentally detected lung nodules as a complementary approach to early lung cancer detection that can extend the reach and strengthen the grasp of screening. Furthermore, we discussed ongoing efforts in Asia to explore the possibility of LDCT screening in populations in whom lung cancer risk is relatively independent of smoking. Finally, we summarized innovative technological solutions, including biomarker selection and artificial intelligence strategies, to improve the safety, effectiveness, and cost-effectiveness of lung cancer screening in diverse populations.