Artificial Intelligence and Clinical Decision Support for Radiologists and Referring Providers

The Evolving Role of Artificial Intelligence in Radiotherapy Treatment Planning-A Literature Review

This paper examines the integration of artificial intelligence (AI) in radiotherapy for cancer treatment. The importance of radiotherapy in cancer management and its time-intensive planning process make AI adoption appealing especially with the escalating demand for radiotherapy. This review highlights the efficacy of AI across medical domains, where it surpasses human capabilities in areas such as cardiology and dermatology. Focusing on radiotherapy, the paper details AI's applications in target segmentation, dose optimization, and outcome prediction. It discusses adaptive radiotherapy's benefits and AI's potential to enhance patient outcomes with much improved treatment accuracy. The paper explores ethical concerns, including data privacy and bias, stressing the need for robust guidelines. Educating healthcare professionals and patients about AI's role is crucial as it acknowledges potential job-role changes and concerns about patients' trust in the use of AI. Overall, the integration of AI in radiotherapy holds transformative potential in streamlining processes, improving outcomes, and reducing costs. AI's potential to reduce healthcare costs underscores its significance with impactful change globally. However, successful implementation hinges on addressing ethical and logistical challenges and fostering collaboration among healthcare professionals and patient population data sets for its optimal utilization. Rigorous education, collaborative efforts, and global data sharing will be the compass guiding its' success in radiotherapy and healthcare.

Automatic image segmentation and online survival prediction model of medulloblastoma based on machine learning

OBJECTIVES

To develop a dynamic nomogram containing radiomics signature and clinical features for estimating the overall survival (OS) of patients with medulloblastoma (MB) and design an automatic image segmentation model to reduce labor and time costs.

METHODS

Data from 217 medulloblastoma (MB) patients over the past 4 years were collected and separated into a training set and a test set. Intraclass correlation coefficient (ICC), random survival forest (RSF), and least absolute shrinkage and selection operator (LASSO) regression methods were employed to select variables in the training set. Univariate and multivariate Cox proportional hazard models, as well as Kaplan-Meier analysis, were utilized to determine the relationship among the radiomics signature, clinical features, and overall survival. A dynamic nomogram was developed. Additionally, a 3D-Unet deep learning model was used to train the automatic tumor delineation model.

RESULTS

Higher Rad-scores were significantly associated with worse OS in both the training and validation sets (p < 0.001 and p = 0.047, respectively). The Cox model combined clinical and radiomics signatures ([IBS = 0.079], [C-index = 0.747, SE = 0.045]) outperformed either radiomics signatures alone ([IBS = 0.081], [C-index = 0.738, SE = 0.041]) or clinical features alone ([IBS = 0.085], [C-index = 0.565, SE = 0.041]). The segmentation model had mean Dice coefficients of 0.80, 0.82, and 0.78 in the training, validation, and test sets respectively. A deep learning-based tumor segmentation model was built with Dice coefficients of 0.8372, 0.8017, and 0.7673 on the training set, validation set, and test set, respectively.

CONCLUSIONS

A combination of radiomics features and clinical characteristics enhances the accuracy of OS prediction in medulloblastoma patients. Additionally, building an MRI image automatic segmentation model reduces labor and time costs.

CLINICAL RELEVANCE STATEMENT

A survival prognosis model based on radiomics and clinical characteristics could improve the accuracy of prognosis estimation for medulloblastoma patients, and an MRI-based automatic tumor segmentation model could reduce the cost of time.

KEY POINTS

• A model that combines radiomics and clinical features can predict the survival prognosis of patients with medulloblastoma. • Online nomogram and image automatic segmentation model can help doctors better judge the prognosis of medulloblastoma and save working time. • The developed AI system can help doctors judge the prognosis of diseases and promote the development of precision medicine.

Challenges and strategies for wide-scale artificial intelligence (AI) deployment in healthcare practices: A perspective for healthcare organizations

Healthcare organizations have realized that Artificial intelligence (AI) can provide a competitive edge through personalized patient experiences, improved patient outcomes, early diagnosis, augmented clinician capabilities, enhanced operational efficiencies, or improved medical service accessibility. However, deploying AI-driven tools in the healthcare ecosystem could be challenging. This paper categorizes AI applications in healthcare and comprehensively examines the challenges associated with deploying AI in medical practices at scale. As AI continues to make strides in healthcare, its integration presents various challenges, including production timelines, trust generation, privacy concerns, algorithmic biases, and data scarcity. The paper highlights that flawed business models and wrong workflows in healthcare practices cannot be rectified merely by deploying AI-driven tools. Healthcare organizations should re-evaluate root problems such as misaligned financial incentives (e.g., fee-for-service models), dysfunctional medical workflows (e.g., high rates of patient readmissions), poor care coordination between different providers, fragmented electronic health records systems, and inadequate patient education and engagement models in tandem with AI adoption. This study also explores the need for a cultural shift in viewing AI not as a threat but as an enabler that can enhance healthcare delivery and create new employment opportunities while emphasizing the importance of addressing underlying operational issues. The necessity of investments beyond finance is discussed, emphasizing the importance of human capital, continuous learning, and a supportive environment for AI integration. The paper also highlights the crucial role of clear regulations in building trust, ensuring safety, and guiding the ethical use of AI, calling for coherent frameworks addressing transparency, model accuracy, data quality control, liability, and ethics. Furthermore, this paper underscores the importance of advancing AI literacy within academia to prepare future healthcare professionals for an AI-driven landscape. Through careful navigation and proactive measures addressing these challenges, the healthcare community can harness AI's transformative power responsibly and effectively, revolutionizing healthcare delivery and patient care. The paper concludes with a vision and strategic suggestions for the future of healthcare with AI, emphasizing thoughtful, responsible, and innovative engagement as the pathway to realizing its full potential to unlock immense benefits for healthcare organizations, physicians, nurses, and patients while proactively mitigating risks.

Imagine there is no paperwork… it's easy if you try

Artificial Intelligence (AI) applied to radiology is so vast that it provides applications ranging from becoming a complete replacement for radiologists (a potential threat) to an efficient paperwork-saving time assistant (an evident strength). Nowadays, there are AI applications developed to facilitate the diagnostic process of radiologists without directly influencing (or replacing) the proper diagnostic decision step. These tools may help to reduce administrative workload, in different scenarios ranging from assisting in scheduling, study prioritization, or report communication, to helping with patient follow-up, including recommending additional exams. These are just a few of the highly time-consuming tasks that radiologists have to deal with every day in their routine workflow. These tasks hinder the time that radiologists should spend evaluating images and caring for patients, which will have a direct and negative impact on the quality of reports and patient attention, increasing the delay and waiting list of studies pending to be performed and reported. These types of AI applications should help to partially face this worldwide shortage of radiologists.

Radiology as a Specialty in the Era of Artificial Intelligence: A Systematic Review and Meta-analysis on Medical Students, Radiology Trainees, and Radiologists

RATIONALE AND OBJECTIVES

Artificial intelligence (AI) is changing radiology by automating tasks and assisting in abnormality detection and understanding perceptions of medical students, radiology trainees, and radiologists is vital for preparing them for AI integration in radiology.

MATERIALS AND METHODS

A systematic review and meta-analysis were conducted following established guidelines. PubMed, Scopus, and Web of Science were searched up to March 5, 2023. Eligible studies reporting outcomes of interest were included, and relevant data were extracted and analyzed using STATA software version 17.0.

RESULTS

A meta-analysis of 21 studies revealed that 22.36% of individuals were less likely to choose radiology as a career due to concerns about advances in AI. Medical students showed higher rates of concern (31.94%) compared to radiology trainees and radiologists (9.16%) (P < .01). Radiology trainees and radiologists also demonstrated higher basic AI knowledge (71.84% vs 35.38%). Medical students had higher rates of belief that AI poses a threat to the radiology job market (42.66% vs 6.25%, P < .02). The pooled rate of respondents who believed that "AI will revolutionize radiology in the future" was 79.48%, with no significant differences based on participants' positions. The pooled rate of responders who believed in the integration of AI in medical curricula was 81.75% among radiology trainees and radiologists and 70.23% among medical students.

CONCLUSION

The study revealed growing concerns regarding the impact of AI in radiology, particularly among medical students, which can be addressed by revamping education, providing direct AI experience, addressing limitations, and emphasizing medico-legal issues to prepare for AI integration in radiology.

How AI May Transform Musculoskeletal Imaging

While musculoskeletal imaging volumes are increasing, there is a relative shortage of subspecialized musculoskeletal radiologists to interpret the studies. Will artificial intelligence (AI) be the solution? For AI to be the solution, the wide implementation of AI-supported data acquisition methods in clinical practice requires establishing trusted and reliable results. This implementation will demand close collaboration between core AI researchers and clinical radiologists. Upon successful clinical implementation, a wide variety of AI-based tools can improve the musculoskeletal radiologist's workflow by triaging imaging examinations, helping with image interpretation, and decreasing the reporting time. Additional AI applications may also be helpful for business, education, and research purposes if successfully integrated into the daily practice of musculoskeletal radiology. The question is not whether AI will replace radiologists, but rather how musculoskeletal radiologists can take advantage of AI to enhance their expert capabilities.

Cross-Check QA: A Quality Assurance Workflow to Prevent Missed Diagnoses by Alerting Inadvertent Discordance Between the Radiologist and Artificial Intelligence in the Interpretation of High-Acuity CT Scans

PURPOSE

The aim of this study was to implement and evaluate a quality assurance (QA) workflow that leverages natural language processing to rapidly resolve inadvertent discordance between radiologists and an artificial intelligence (AI) decision support system (DSS) in the interpretation of high-acuity CT studies when the radiologist does not engage with AI DSS output.

METHODS

All consecutive high-acuity adult CT examinations performed in a health system between March 1, 2020, and September 20, 2022, were interpreted alongside an AI DSS (Aidoc) for intracranial hemorrhage, cervical spine fracture, and pulmonary embolus. CT studies were flagged for this QA workflow if they met three criteria: (1) negative results by radiologist report, (2) a high probability of positive results by the AI DSS, and (3) unviewed AI DSS output. In these cases, an automated e-mail notification was sent to our quality team. If discordance was confirmed on secondary review-an initially missed diagnosis-addendum and communication documentation was performed.

RESULTS

Of 111,674 high-acuity CT examinations interpreted alongside the AI DSS over this 2.5-year time period, the frequency of missed diagnoses (intracranial hemorrhage, pulmonary embolus, and cervical spine fracture) uncovered by this workflow was 0.02% (n = 26). Of 12,412 CT studies prioritized as depicting positive findings by the AI DSS, 0.4% (n = 46) were discordant, unengaged, and flagged for QA. Among these discordant cases, 57% (26 of 46) were determined to be true positives. Addendum and communication documentation was performed within 24 hours of the initial report signing in 85% of these cases.

CONCLUSIONS

Inadvertent discordance between radiologists and the AI DSS occurred in a small number of cases. This QA workflow leveraged natural language processing to rapidly detect, notify, and resolve these discrepancies and prevent potential missed diagnoses.

Impact of Predictive Text Clinical Decision Support on Imaging Order Entry in the Emergency Department

PURPOSE

Imaging clinical decision support (CDS) is designed to assist providers in selecting appropriate imaging studies and is now federally required. The aim of this study was to understand the effect of CDS on decisions and workflows in the emergency department (ED).

METHODS

The authors' institution's order entry platform serves up structured indications for imaging orders. Imaging orders are scored by CDS on the basis of appropriate use criteria (AUC). CDS triggers alerts for imaging orders with low AUC scores. Because free text alone cannot be scored by CDS, an artificial intelligence predictive text (AIPT) module was implemented to guide the selection of structured indications when free-text indications are entered. A total of 17,355 imaging orders in the ED over 6 months were retrospectively analyzed.

RESULTS

CDS alerts for low AUC scores were triggered for 3% of all imaging study orders (522 of 17,355). Providers spent an average of 24 seconds interacting with alerts. In 18 of 522 imaging orders with alerts, alternative studies were ordered. After AIPT implementation, the percentage of unscored studies significantly decreased from 81% to 45% (P < .001).

CONCLUSIONS

In a quaternary academic ED, CDS alerts triggered by low AUC scores caused minimal increase in time spent on imaging order entry but had a relatively marginal impact on imaging study selection. AIPT implementation increased the number of scored studies and could potentially enhance CDS effects. CDS implementation enables the collection of novel data regarding which imaging studies receive low AUC scores. Future work could include exploring alternative models of CDS implementation to maximize its impact.

Impact of Artificial Intelligence-Assisted Indication Selection on Appropriateness Order Scoring for Imaging Clinical Decision Support

PURPOSE

The aim of this study was to assess appropriateness scoring and structured order entry after the implementation of an artificial intelligence (AI) tool for analysis of free-text indications.

METHODS

Advanced outpatient imaging orders in a multicenter health care system were recorded 7 months before (March 1, 2020, to September 21, 2020) and after (October 20, 2020, to May 13, 2021) the implementation of an AI tool targeting free-text indications. Clinical decision support score (not appropriate, may be appropriate, appropriate, or unscored) and indication type (structured, free-text, both, or none) were assessed. The χ2 and multivariate logistic regression adjusting for covariables with bootstrapping were used.

RESULTS

In total, 115,079 orders before and 150,950 orders after AI tool deployment were analyzed. The mean patient age was 59.3 ± 15.5 years, and 146,035 (54.9%) were women; 49.9% of orders were for CT, 38.8% for MR, 5.9% for nuclear medicine, and 5.4% for PET. After deployment, scored orders increased to 52% from 30% (P < .001). Orders with structured indications increased to 67.3% from 34.6% (P < .001). On multivariate analysis, orders were more likely to be scored after tool deployment (odds ratio [OR], 2.7, 95% CI, 2.63-2.78; P < .001). Compared with physicians, orders placed by nonphysician providers were less likely to be scored (OR, 0.80; 95% CI, 0.78-0.83; P < .001). MR (OR, 0.84; 95% CI, 0.82-0.87) and PET (OR, 0.12; 95% CI, 0.10-0.13) were less likely to be scored than CT (; P < .001). After AI tool deployment, 72,083 orders (47.8%) remained unscored, 45,186 (62.7%) with free-text-only indications.

CONCLUSIONS

Embedding AI assistance within imaging clinical decision support was associated with increased structured indication orders and independently predicted a higher likelihood of scored orders. However, 48% of orders remained unscored, driven by both provider behavior and infrastructure-related barriers.

Computer-Aided Detection for Chest Radiography to Improve the Quality of Tuberculosis Diagnosis in Vietnam's District Health Facilities: An Implementation Study

In Vietnam, chest radiography (CXR) is used to refer people for GeneXpert (Xpert) testing to diagnose tuberculosis (TB), demonstrating high yield for TB but a wide range of CXR abnormality rates. In a multi-center implementation study, computer-aided detection (CAD) was integrated into facility-based TB case finding to standardize CXR interpretation. CAD integration was guided by a programmatic framework developed for routine implementation. From April through December 2022, 24,945 CXRs from TB-vulnerable populations presenting to district health facilities were evaluated. Physicians interpreted all CXRs in parallel with CAD (qXR 3.0) software, for which the selected TB threshold score was ≥0.60. At three months, there was 47.3% concordance between physician and CAD TB-presumptive CXR results, 7.8% of individuals who received CXRs were referred for Xpert testing, and 858 people diagnosed with Xpert-confirmed TB per 100,000 CXRs. This increased at nine months to 76.1% concordant physician and CAD TB-presumptive CXRs, 9.6% referred for Xpert testing, and 2112 people with Xpert-confirmed TB per 100,000 CXRs. Our programmatic CAD-CXR framework effectively supported physicians in district facilities to improve the quality of referral for diagnostic testing and increase TB detection yield. Concordance between physician and CAD CXR results improved with training and was important to optimize Xpert testing.

Radiology Residents' Perceptions of Artificial Intelligence: Nationwide Cross-Sectional Survey Study

BACKGROUND

Artificial intelligence (AI) is transforming various fields, with health care, especially diagnostic specialties such as radiology, being a key but controversial battleground. However, there is limited research systematically examining the response of "human intelligence" to AI.

OBJECTIVE

This study aims to comprehend radiologists' perceptions regarding AI, including their views on its potential to replace them, its usefulness, and their willingness to accept it. We examine the influence of various factors, encompassing demographic characteristics, working status, psychosocial aspects, personal experience, and contextual factors.

METHODS

Between December 1, 2020, and April 30, 2021, a cross-sectional survey was completed by 3666 radiology residents in China. We used multivariable logistic regression models to examine factors and associations, reporting odds ratios (ORs) and 95% CIs.

RESULTS

In summary, radiology residents generally hold a positive attitude toward AI, with 29.90% (1096/3666) agreeing that AI may reduce the demand for radiologists, 72.80% (2669/3666) believing AI improves disease diagnosis, and 78.18% (2866/3666) feeling that radiologists should embrace AI. Several associated factors, including age, gender, education, region, eye strain, working hours, time spent on medical images, resilience, burnout, AI experience, and perceptions of residency support and stress, significantly influence AI attitudes. For instance, burnout symptoms were associated with greater concerns about AI replacement (OR 1.89; P<.001), less favorable views on AI usefulness (OR 0.77; P=.005), and reduced willingness to use AI (OR 0.71; P<.001). Moreover, after adjusting for all other factors, perceived AI replacement (OR 0.81; P<.001) and AI usefulness (OR 5.97; P<.001) were shown to significantly impact the intention to use AI.

CONCLUSIONS

This study profiles radiology residents who are accepting of AI. Our comprehensive findings provide insights for a multidimensional approach to help physicians adapt to AI. Targeted policies, such as digital health care initiatives and medical education, can be developed accordingly.

From bench to bedside - current clinical and translational challenges in fibula free flap reconstruction

Fibula free flaps (FFF) represent a working horse for different reconstructive scenarios in facial surgery. While FFF were initially established for mandible reconstruction, advancements in planning for microsurgical techniques have paved the way toward a broader spectrum of indications, including maxillary defects. Essential factors to improve patient outcomes following FFF include minimal donor site morbidity, adequate bone length, and dual blood supply. Yet, persisting clinical and translational challenges hamper the effectiveness of FFF. In the preoperative phase, virtual surgical planning and artificial intelligence tools carry untapped potential, while the intraoperative role of individualized surgical templates and bioprinted prostheses remains to be summarized. Further, the integration of novel flap monitoring technologies into postoperative patient management has been subject to translational and clinical research efforts. Overall, there is a paucity of studies condensing the body of knowledge on emerging technologies and techniques in FFF surgery. Herein, we aim to review current challenges and solution possibilities in FFF. This line of research may serve as a pocket guide on cutting-edge developments and facilitate future targeted research in FFF.

Evaluating GPT as an Adjunct for Radiologic Decision Making: GPT-4 Versus GPT-3.5 in a Breast Imaging Pilot

OBJECTIVE

Despite rising popularity and performance, studies evaluating the use of large language models for clinical decision support are lacking. Here, we evaluate ChatGPT (Generative Pre-trained Transformer)-3.5 and GPT-4's (OpenAI, San Francisco, California) capacity for clinical decision support in radiology via the identification of appropriate imaging services for two important clinical presentations: breast cancer screening and breast pain.

METHODS

We compared ChatGPT's responses to the ACR Appropriateness Criteria for breast pain and breast cancer screening. Our prompt formats included an open-ended (OE) and a select all that apply (SATA) format. Scoring criteria evaluated whether proposed imaging modalities were in accordance with ACR guidelines. Three replicate entries were conducted for each prompt, and the average of these was used to determine final scores.

RESULTS

Both ChatGPT-3.5 and ChatGPT-4 achieved an average OE score of 1.830 (out of 2) for breast cancer screening prompts. ChatGPT-3.5 achieved a SATA average percentage correct of 88.9%, compared with ChatGPT-4's average percentage correct of 98.4% for breast cancer screening prompts. For breast pain, ChatGPT-3.5 achieved an average OE score of 1.125 (out of 2) and a SATA average percentage correct of 58.3%, as compared with an average OE score of 1.666 (out of 2) and a SATA average percentage correct of 77.7%.

DISCUSSION

Our results demonstrate the eventual feasibility of using large language models like ChatGPT for radiologic decision making, with the potential to improve clinical workflow and responsible use of radiology services. More use cases and greater accuracy are necessary to evaluate and implement such tools.

Measuring appropriateness of diagnostic imaging: a scoping review

In radiology, the justification of diagnostic imaging is a key performance indicator. To date, specific recommendations on the measurement of appropriateness in diagnostic imaging are missing. To map the study literature concerning the definition, measures, methods and data used for analyses of appropriateness in research of diagnostic imaging. We conducted a scoping review in Medline, EMBASE, Scopus and the Cochrane Central Register of Controlled Trials. Two independent reviewers undertook screening and data extraction. After screening 6021 records, we included 50 studies. National guidelines (n = 22/50) or American College of Radiology Appropriateness Criteria (n = 23/50) were used to define and rate appropriateness. 22/50 studies did not provide methodological details about the appropriateness assessment. The included studies varied concerning modality, amount of reviewed examinations (88-13,941) and body regions. Computed tomography (27 studies, 27,168 examinations) was the most frequently analyzed modality, followed by magnetic resonance imaging (17 studies, 6559 examinations) and radiography (10 studies, 7095 examinations). Heterogeneous appropriateness rates throughout single studies (0-100%), modalities, and body regions (17-95%) were found. Research on pediatric and outpatient imaging was sparse. Multicentric, methodologically robust and indication-oriented studies would strengthen appropriateness research in diagnostic imaging and help to develop reliable key performance indicators.

Applications of Artificial Intelligence in the Radiology Roundtrip: Process Streamlining, Workflow Optimization, and Beyond

There are many impactful applications of artificial intelligence (AI) in the electronic radiology roundtrip and the patient's journey through the healthcare system that go beyond diagnostic applications. These tools have the potential to improve quality and safety, optimize workflow, increase efficiency, and increase patient satisfaction. In this article, we review the role of AI for process improvement and workflow enhancement which includes applications beginning from the time of order entry, scan acquisition, applications supporting the image interpretation task, and applications supporting tasks after image interpretation such as result communication. These non-diagnostic workflow and process optimization tasks are an important part of the arsenal of potential AI tools that can streamline day to day clinical practice and patient care.

Evaluating ChatGPT as an Adjunct for Radiologic Decision-Making

BACKGROUND

ChatGPT, a popular new large language model (LLM) built by OpenAI, has shown impressive performance in a number of specialized applications. Despite the rising popularity and performance of AI, studies evaluating the use of LLMs for clinical decision support are lacking.

PURPOSE

To evaluate ChatGPT's capacity for clinical decision support in radiology via the identification of appropriate imaging services for two important clinical presentations: breast cancer screening and breast pain.

MATERIALS AND METHODS

We compared ChatGPT's responses to the American College of Radiology (ACR) Appropriateness Criteria for breast pain and breast cancer screening. Our prompt formats included an open-ended (OE) format, where ChatGPT was asked to provide the single most appropriate imaging procedure, and a select all that apply (SATA) format, where ChatGPT was given a list of imaging modalities to assess. Scoring criteria evaluated whether proposed imaging modalities were in accordance with ACR guidelines.

RESULTS

ChatGPT achieved an average OE score of 1.83 (out of 2) and a SATA average percentage correct of 88.9% for breast cancer screening prompts, and an average OE score of 1.125 (out of 2) and a SATA average percentage correct of 58.3% for breast pain prompts.

CONCLUSION

Our results demonstrate the feasibility of using ChatGPT for radiologic decision making, with the potential to improve clinical workflow and responsible use of radiology services.

Implementation of Clinical Artificial Intelligence in Radiology: Who Decides and How?

As the role of artificial intelligence (AI) in clinical practice evolves, governance structures oversee the implementation, maintenance, and monitoring of clinical AI algorithms to enhance quality, manage resources, and ensure patient safety. In this article, a framework is established for the infrastructure required for clinical AI implementation and presents a road map for governance. The road map answers four key questions: Who decides which tools to implement? What factors should be considered when assessing an application for implementation? How should applications be implemented in clinical practice? Finally, how should tools be monitored and maintained after clinical implementation? Among the many challenges for the implementation of AI in clinical practice, devising flexible governance structures that can quickly adapt to a changing environment will be essential to ensure quality patient care and practice improvement objectives.

Clinician Adoption of an Artificial Intelligence Algorithm to Detect Left Ventricular Systolic Dysfunction in Primary Care

OBJECTIVE

To compare the clinicians' characteristics of "high adopters" and "low adopters" of an artificial intelligence (AI)-enabled electrocardiogram (ECG) algorithm that alerted for possible low left ventricular ejection fraction (EF) and the subsequent effectiveness of detecting patients with low EF.

METHODS

Clinicians in 48 practice sites of a US Midwest health system were cluster-randomized by the care team to usual care or to receive a notification that suggested ordering an echocardiogram in patients flagged as potentially having low EF based on an AI-ECG algorithm. Enrollment was between June 26, 2019, and July 30, 2019; participation concluded on March 31, 2020. This report is focused on those clinicians randomized to receive the notification of the AI-ECG algorithm. At the patient level, data were analyzed for the proportion of patients with positive AI-ECG results. Adoption was defined as the clinician order of an echocardiogram after prompted by the alert.

RESULTS

A total of 165 clinicians and 11,573 patients were included in this analysis. Among patients with positive AI-ECG, high adopters (n=41) were twice as likely to diagnose patients with low EF (33.9%) vs low adopters, n=124, (16.9%); odds ratio, 1.62; 95% CI, 1.21 to 2.17). High adopters were more often advanced practice providers (eg, nurse practitioners and physician assistants) vs physicians, Family Medicine vs Internal Medicine specialty, and tended to have less complex patients.

CONCLUSION

Clinicians who most frequently followed the recommendations of an AI tool were twice as likely to diagnose low EF. Those clinicians with less complex patients were more likely to be high adopters.

TRIAL REGISTRATION

Clinicaltrials.gov Identifier: NCT04000087.

Artificial intelligence and machine learning in cancer imaging

An increasing array of tools is being developed using artificial intelligence (AI) and machine learning (ML) for cancer imaging. The development of an optimal tool requires multidisciplinary engagement to ensure that the appropriate use case is met, as well as to undertake robust development and testing prior to its adoption into healthcare systems. This multidisciplinary review highlights key developments in the field. We discuss the challenges and opportunities of AI and ML in cancer imaging; considerations for the development of algorithms into tools that can be widely used and disseminated; and the development of the ecosystem needed to promote growth of AI and ML in cancer imaging.

Use of artificial intelligence in emergency radiology: An overview of current applications, challenges, and opportunities

The value of artificial intelligence (AI) in healthcare has become evident, especially in the field of medical imaging. The accelerated pace and acuity of care in the Emergency Department (ED) has made it a popular target for artificial intelligence-driven solutions. Software that helps better detect, report, and appropriately guide management can ensure high quality patient care while enabling emergency radiologists to better meet the demands of quick turnaround times. Beyond diagnostic applications, AI-based algorithms also have the potential to optimize other important steps within the ED imaging workflow. This review will highlight the different types of AI-based applications currently available for use in the ED, as well as the challenges and opportunities associated with their implementation.

Multidisciplinary Tumor Board Smart Virtual Assistant in Locally Advanced Cervical Cancer: A Proof of Concept

Aim

The first prototype of the “Multidisciplinary Tumor Board Smart Virtual Assistant” is presented, aimed to (i) Automated classification of clinical stage starting from different free-text diagnostic reports; (ii) Resolution of inconsistencies by identifying controversial cases drawing the clinician’s attention to particular cases worthy for multi-disciplinary discussion; (iii) Support environment for education and knowledge transfer to junior staff; (iv) Integrated data-driven decision making and standardized language and interpretation.

Patients and Method

Data from patients affected by Locally Advanced Cervical Cancer (LACC), FIGO stage IB2-IVa, treated between 2015 and 2018 were extracted. Magnetic Resonance (MR), Gynecologic examination under general anesthesia (EAU), and Positron Emission Tomography–Computed Tomography (PET-CT) performed at the time of diagnosis were the items from the Electronic Health Records (eHRs) considered for analysis. An automated extraction of eHR that capture the patient’s data before the diagnosis and then, through Natural Language Processing (NLP), analysis and categorization of all data to transform source information into structured data has been performed.

Results

In the first round, the system has been used to retrieve all the eHR for the 96 patients with LACC. The system has been able to classify all patients belonging to the training set and - through the NLP procedures - the clinical features were analyzed and classified for each patient. A second important result was the setup of a predictive model to evaluate the patient’s staging (accuracy of 94%). Lastly, we created a user-oriented operational tool targeting the MTB who are confronted with the challenge of large volumes of patients to be diagnosed in the most accurate way.

Conclusion

This is the first proof of concept concerning the possibility of creating a smart virtual assistant for the MTB. A significant benefit could come from the integration of these automated methods in the collaborative, crucial decision stages.

Ankle MRI and preceding radiographs: an evaluation of physician ordering practices

OBJECTIVE

Multiple guidelines have been published for appropriate imaging in patients with ankle-related symptoms which suggest radiographs as the initial imaging examination for both acute and chronic ankle abnormalities. Few studies have evaluated adherence to these imaging guidelines. This study retrospectively evaluated the utilization of ankle MRI and preceding radiographs based on ordering provider group and MRI indication.

MATERIALS AND METHODS

A total of 4186 ankle MRIs performed over a 9-year period at a single institution were evaluated for the presence of preceding ankle and/or foot radiographs at two time points, within 3 months and within 6 months of the MRI examination. Ankle MRIs were then categorized based on 6 ordering provider groups and 13 MRI indications.

RESULTS

Of the 4186 MRIs evaluated, 68% had preceding radiographs within 3 months and 77% had radiographs within 6 months. Primary care, sports medicine, and podiatry had the lowest rates of preceding radiographs (73%, 68%, and 64%, respectively, within 6 months). Eighty-six percent of ankle MRIs ordered by orthopedic surgery had preceding radiographs within 6 months and 89% of ankle MRIs ordered by emergency medicine and inpatient providers had preceding radiographs. MRIs intended for evaluation of Achilles tendon or plantar fascia abnormalities were among the least likely indications to have preceding radiographs.

CONCLUSION

Based on established clinical guidelines, there was a lower-than-expected rate of obtaining preceding radiographs for ankle MRIs among most provider groups, particularly non-orthopedic outpatient providers. Additional research is needed to address the lack of adherence to clinical imaging guidelines and ensure appropriate imaging.

Optimization of Radiology Workflow with Artificial Intelligence

The potential of artificial intelligence (AI) in radiology goes far beyond image analysis. AI can be used to optimize all steps of the radiology workflow by supporting a variety of nondiagnostic tasks, including order entry support, patient scheduling, resource allocation, and improving the radiologist's workflow. This article discusses several principal directions of using AI algorithms to improve radiological operations and workflow management, with the intention of providing a broader understanding of the value of applying AI in the radiology department.

Retrospective Evaluation of Artificial Intelligence Leveraging Free-Text Imaging Order Entry to Facilitate Federally Required Clinical Decision Support

OBJECTIVE

The Protecting Access to Medicare Act mandates clinical decision support (CDS) at imaging order entry, necessitating the use of structured indications to map CDS scores. We evaluated the performance of a commercially available artificial intelligence (AI) tool leveraging free-text order entry to facilitate provider selection of the necessary structured indications.

METHODS

Our institution implemented an AI tool offering predicted structured indications based upon the ordering provider's entry of a free-text reason for examination. Providers remained able to order via the traditional direct search for structured indications. Alternatively, they could take the new free-text-AI approach allowing them to select from AI-predicted indications, perform additional direct searches, indicate no matching indication, or exit CDS workflow. We hypothesized the free-text-AI approach would be elected more often and the AI tool would be successful in facilitating selection of structured indications. We reviewed advanced imaging orders (n = 40,053) for the first 3 months (February to May 2020) since implementation.

RESULTS

Providers were more likely (P < .001) to choose the free-text-AI approach (23,580; 58.9%) to order entry over direct search for structured indications (16,473; 41.1%). The AI tool yielded alerts with predicted indications in 91.7% (n = 21,631) of orders with free text. Ultimately, providers chose AI-predicted indications in 57.7% (n = 12,490) of cases in which they were offered by the tool.

DISCUSSION

Providers significantly more often elected the new free-text-AI approach to order entry for CDS, suggesting provider preference over the traditional approach. The AI tool commonly predicted indications acceptable to ordering providers.

Computer-Assisted Reporting and Decision Support in Standardized Radiology Reporting for Cancer Imaging

PURPOSE

Recent advances in structured reporting are providing an opportunity to enhance cancer imaging assessment to drive value-based care and improve patient safety.

METHODS

The computer-assisted reporting and decision support (CAR/DS) framework has been developed to enable systematic ingestion of guidelines as clinical decision structured reporting tools embedded within the radiologist's workflow.

RESULTS

CAR/DS tools can reduce the radiology reporting variability and increase compliance with clinical guidelines. The lung cancer use-case is used to describe various scenarios of a cancer imaging structured reporting pathway, including incidental findings, screening, staging, and restaging or continued care. Various aspects of these tools are also described using cancer-related examples for different imaging modalities and applications such as calculators. Such systems can leverage artificial intelligence (AI) algorithms to assist with the generation of structured reports and there are opportunities for new AI applications to be created using the structured data associated with CAR/DS tools.

CONCLUSION

These AI-enabled systems are starting to allow information from multiple sources to be integrated and inserted into structured reports to drive improvements in clinical decision support and patient care.

Workflow Applications of Artificial Intelligence in Radiology and an Overview of Available Tools

In the past decade, there has been tremendous interest in applying artificial intelligence (AI) to improve the field of radiology. Currently, numerous AI applications are in development, with potential benefits spanning all steps of the imaging chain from test ordering to report communication. AI has been proposed as a means to optimize patient scheduling, improve worklist management, enhance image acquisition, and help radiologists interpret diagnostic studies. Although the potential for AI in radiology appears almost endless, the field is still in the early stages, with many uses still theoretical, in development, or limited to single institutions. Moreover, although the current use of AI in radiology has emphasized its clinical applications, some of which are in the distant future, it is increasingly clear that AI algorithms could also be used in the more immediate future for a variety of noninterpretive and quality improvement uses. Such uses include the integration of AI into electronic health record systems to reduce unwarranted variation in radiologists' follow-up recommendations and to improve other dimensions of radiology report quality. In the end, the potential of AI in radiology must be balanced with acknowledgment of its current limitations regarding generalizability and data privacy.

Handoffs in Radiology: Minimizing Communication Errors and Improving Care Transitions

Handoffs are essential to achieving safe care transitions. In radiology practice, frequent transitions of care responsibility among clinicians, radiologists, and patients occur between moments of care such as determining protocol, imaging, interpreting, and consulting. Continuity of care is maintained across these transitions with handoffs, which are the process of communicating patient information and transferring decision-making responsibility. As a leading cause of medical error, handoffs are a major communication challenge that is exceedingly common in both diagnostic and interventional radiology practice. The frequency of handoffs in radiology underscores the importance of using evidence-based strategies to improve patient safety in the radiology department. In this article, reliability science principles and handoff improvement tools are adapted to provide radiology-focused strategies at individual, team, and organizational levels with the goal of minimizing handoff errors and improving care transitions.

Artificial intelligence in oncology: Path to implementation

In recent years, the field of artificial intelligence (AI) in oncology has grown exponentially. AI solutions have been developed to tackle a variety of cancer‐related challenges. Medical institutions, hospital systems, and technology companies are developing AI tools aimed at supporting clinical decision making, increasing access to cancer care, and improving clinical efficiency while delivering safe, high‐value oncology care. AI in oncology has demonstrated accurate technical performance in image analysis, predictive analytics, and precision oncology delivery. Yet, adoption of AI tools is not widespread, and the impact of AI on patient outcomes remains uncertain. Major barriers for AI implementation in oncology include biased and heterogeneous data, data management and collection burdens, a lack of standardized research reporting, insufficient clinical validation, workflow and user‐design challenges, outdated regulatory and legal frameworks, and dynamic knowledge and data. Concrete actions that major stakeholders can take to overcome barriers to AI implementation in oncology include training and educating the oncology workforce in AI; standardizing data, model validation methods, and legal and safety regulations; funding and conducting future research; and developing, studying, and deploying AI tools through multidisciplinary collaboration.

Artificial intelligence in child abuse imaging

There have been rapid advances in artificial intelligence (AI) technology in recent years, and the field of diagnostic imaging is no exception. Just as digital technology revolutionized how radiology is practiced, so these new technologies also appear poised to bring sweeping change. As AI tools make the transition from the theoretical to the everyday, important decisions need to be made about how they will be applied and what their role will be in the practice of radiology. Pediatric radiology presents distinct challenges and opportunities for the application of these tools, and in this article we discuss some of these, specifically as they relate to the prediction, identification and investigation of child abuse.

Clinical decision support system, using expert consensus-derived logic and natural language processing, decreased sedation-type order errors for patients undergoing endoscopy

OBJECTIVE

Determination of appropriate endoscopy sedation strategy is an important preprocedural consideration. To address manual workflow gaps that lead to sedation-type order errors at our institution, we designed and implemented a clinical decision support system (CDSS) to review orders for patients undergoing outpatient endoscopy.

MATERIALS AND METHODS

The CDSS was developed and implemented by an expert panel using an agile approach. The CDSS queried patient-specific historical endoscopy records and applied expert consensus-derived logic and natural language processing to identify possible sedation order errors for human review. A retrospective analysis was conducted to evaluate impact, comparing 4-month pre-pilot and 12-month pilot periods.

RESULTS

22 755 endoscopy cases were included (pre-pilot 6434 cases, pilot 16 321 cases). The CDSS decreased the sedation-type order error rate on day of endoscopy (pre-pilot 0.39%, pilot 0.037%, Odds Ratio = 0.094, P-value < 1e-8). There was no difference in background prevalence of erroneous orders (pre-pilot 0.39%, pilot 0.34%, P = .54).

DISCUSSION

At our institution, low prevalence and high volume of cases prevented routine manual review to verify sedation order appropriateness. Using a cohort-enrichment strategy, a CDSS was able to reduce number of chart reviews needed per sedation-order error from 296.7 to 3.5, allowing for integration into the existing workflow to intercept rare but important ordering errors.

CONCLUSION

A workflow-integrated CDSS with expert consensus-derived logic rules and natural language processing significantly reduced endoscopy sedation-type order errors on day of endoscopy at our institution.

Artificial intelligence in in vitro fertilization: a computer decision support system for day-to-day management of ovarian stimulation during in vitro fertilization

OBJECTIVE

To describe a computer algorithm designed for in vitro fertilization (IVF) management and to assess the algorithm's accuracy in the day-to-day decision making during ovarian stimulation for IVF when compared to evidence-based decisions by the clinical team.

DESIGN

Descriptive and comparative study of new technology.

SETTING

Private fertility practice.

INTERVENTION(S)

None.

PATIENT(S)

Data were derived from monitoring during ovarian stimulation from IVF cycles. The database consisted of 2,603 cycles (1,853 autologous and 750 donor cycles) incorporating 7,376 visits for training. An additional 556 unique cycles were used for challenge and to calculate accuracy. There were 59,706 data points. Input variables included estradiol concentrations in picograms per milliliter; ultrasound measurements of follicle diameters in two dimensions in millimeters; cycle day during stimulation and dose of recombinant follicle-stimulating hormone during ovarian stimulation for IVF.

MAIN OUTCOME MEASURE(S)

Accuracy of the algorithm to predict four critical clinical decisions during ovarian stimulation for IVF: [1] stop stimulation or continue stimulation. If the decision was to stop, then the next automated decision was to [2] trigger or cancel. If the decision was to return, then the next key decisions were [3] number of days to follow-up and [4] whether any dosage adjustment was needed.

RESULT(S)

Algorithm accuracies for these four decisions are as follows: continue or stop treatment: 0.92; trigger and schedule oocyte retrieval or cancel cycle: 0.96; dose of medication adjustment: 0.82; and number of days to follow-up: 0.87. These accuracies are for first iteration of the algorithm.

CONCLUSION(S)

We describe a first iteration of a predictive analytic algorithm that is highly accurate and in agreement with evidence-based decisions by expert teams during ovarian stimulation during IVF. These tools offer a potential platform to optimize clinical decision making during IVF.

Integration of artificial intelligence into clinical patient management: focus on cardiac imaging

Cardiac imaging is a crucial component in the management of patients with heart disease, and as such it influences multiple, inter-related parts of the clinical workflow: physician-patient contact, image acquisition, image pre- and postprocessing, study reporting, diagnostics and outcome predictions, medical interventions, and, finally, knowledge-building through clinical research. With the gradual and ubiquitous infiltration of artificial intelligence into cardiology, it has become clear that, when used appropriately, it will influence and potentially improve-through automation, standardization and data integration-all components of the clinical workflow. This review aims to present a comprehensive view of full integration of artificial intelligence into the standard clinical patient management-with a focus on cardiac imaging, but applicable to all information handling-and to discuss current barriers that remain to be overcome before its widespread implementation and integration.

Restructured society and environment: A review on potential technological strategies to control the COVID-19 pandemic

The emergence of Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) in China at December 2019 had led to a global outbreak of coronavirus disease 2019 (COVID-19) and the disease started to spread all over the world and became an international public health issue. The entire humanity has to fight in this war against the unexpected and each and every individual role is important. Healthcare system is doing exceptional work and the government is taking various measures that help the society to control the spread. Public, on the other hand, coordinates with the policies and act accordingly in most state of affairs. But the role of technologies in assisting different social bodies to fight against the pandemic remains hidden. The intention of our study is to uncover the hidden roles of technologies that ultimately help for controlling the pandemic. On investigating, it is found that the strategies utilizing potential technologies would yield better benefits and these technological strategies can be framed either to control the pandemic or to support the confinement of the society during pandemic which in turn aids in controlling the spreading of infection. This study enlightens the various implemented technologies that assists the healthcare systems, government and public in diverse aspects for fighting against COVID-19. Furthermore, the technological swift that happened during the pandemic and their influence in the environment and society is discussed. Besides the implemented technologies, this work also deals with untapped potential technologies that have prospective applications in controlling the pandemic circumstances. Alongside the various discussion, our suggested solution for certain situational issues is also presented.