Impact of artificial intelligence on radiology: a EuroAIM survey among members of the European Society of Radiology

Knowledge, attitude, and perception of Arab medical students towards artificial intelligence in medicine and radiology: A multi-national cross-sectional study

OBJECTIVES

We aimed to assess undergraduate medical students' knowledge, attitude, and perception regarding artificial intelligence (AI) in medicine.

METHODS

A multi-national, multi-center cross-sectional study was conducted from March to April 2022, targeting undergraduate medical students in nine Arab countries. The study utilized a web-based questionnaire, with data collection carried out with the help of national leaders and local collaborators. Logistic regression analysis was performed to identify predictors of knowledge, attitude, and perception among the participants. Additionally, cluster analysis was employed to identify shared patterns within their responses.

RESULTS

Of the 4492 students surveyed, 92.4% had not received formal AI training. Regarding AI and deep learning (DL), 87.1% exhibited a low level of knowledge. Most students (84.9%) believed AI would revolutionize medicine and radiology, with 48.9% agreeing that it could reduce the need for radiologists. Students with high/moderate AI knowledge and training had higher odds of agreeing to endorse AI replacing radiologists, reducing their numbers, and being less likely to consider radiology as a career compared to those with low knowledge/no AI training. Additionally, the majority agreed that AI would aid in the automated detection and diagnosis of pathologies.

CONCLUSIONS

Arab medical students exhibit a notable deficit in their knowledge and training pertaining to AI. Despite this, they hold a positive perception of AI implementation in medicine and radiology, demonstrating a clear understanding of its significance for the healthcare system and medical curriculum.

CLINICAL RELEVANCE STATEMENT

This study highlights the need for widespread education and training in artificial intelligence for Arab medical students, indicating its significance for healthcare systems and medical curricula.

KEY POINTS

• Arab medical students demonstrate a significant knowledge and training gap when it comes to using AI in the fields of medicine and radiology. • Arab medical students recognize the importance of integrating AI into the medical curriculum. Students with a deeper understanding of AI were more likely to agree that all medical students should receive AI education. However, those with previous AI training were less supportive of this idea. • Students with moderate/high AI knowledge and training displayed increased odds of agreeing that AI has the potential to replace radiologists, reduce the demand for their services, and were less inclined to pursue a career in radiology, when compared to students with low knowledge/no AI training.

Radiologists' perceptions on AI integration: An in-depth survey study

PURPOSE

To assess the perceptions and attitudes of radiologists toward the adoption of artificial intelligence (AI) in clinical practice.

METHODS

A survey was conducted among members of the SIRM Lombardy. Radiologists' attitudes were assessed comprehensively, covering satisfaction with AI-based tools, propensity for innovation, and optimism for the future. The questionnaire consisted of two sections: the first gathered demographic and professional information using categorical responses, while the second evaluated radiologists' attitudes toward AI through Likert-type responses ranging from 1 to 5 (with 1 representing extremely negative attitudes, 3 indicating a neutral stance, and 5 reflecting extremely positive attitudes). Questionnaire refinement involved an iterative process with expert panels and a pilot phase to enhance consistency and eliminate redundancy. Exploratory data analysis employed descriptive statistics and visual assessment of Likert plots, supported by non-parametric tests for subgroup comparisons for a thorough analysis of specific emerging patterns.

RESULTS

The survey yielded 232 valid responses. The findings reveal a generally optimistic outlook on AI adoption, especially among young radiologist (<30) and seasoned professionals (>60, p<0.01). However, while 36.2 % (84 out 232) of subjects reported daily use of AI-based tools, only a third considered their contribution decisive (30 %, 25 out of 84). AI literacy varied, with a notable proportion feeling inadequately informed (36 %, 84 out of 232), particularly among younger radiologists (46 %, p < 0.01). Positive attitudes towards the potential of AI to improve detection, characterization of anomalies and reduce workload (positive answers > 80 %) and were consistent across subgroups. Radiologists' opinions were more skeptical about the role of AI in enhancing decision-making processes, including the choice of further investigation, and in personalized medicine in general. Overall, respondents recognized AI's significant impact on the radiology profession, viewing it as an opportunity (61 %, 141 out of 232) rather than a threat (18 %, 42 out of 232), with a majority expressing belief in AI's relevance to future radiologists' career choices (60 %, 139 out of 232). However, there were some concerns, particularly among breast radiologists (20 of 232 responders), regarding the potential impact of AI on the profession. Eighty-four percent of the respondents consider the final assessment by the radiologist still to be essential.

CONCLUSION

Our results indicate an overall positive attitude towards the adoption of AI in radiology, though this is moderated by concerns regarding training and practical efficacy. Addressing AI literacy gaps, especially among younger radiologists, is essential. Furthermore, proactively adapting to technological advancements is crucial to fully leverage AI's potential benefits. Despite the generally positive outlook among radiologists, there remains significant work to be done to enhance the integration and widespread use of AI tools in clinical practice.

Familiarity, confidence and preference of artificial intelligence feedback and prompts by Australian breast cancer screening readers

Objectives This study explored the familiarity, perceptions and confidence of Australian radiology clinicians involved in reading screening mammograms, regarding artificial intelligence (AI) applications in breast cancer detection. Methods Sixty-five radiologists, breast physicians and radiology trainees participated in an online survey that consisted of 23 multiple choice questions asking about their experience and familiarity with AI products. Furthermore, the survey asked about their confidence in using AI outputs and their preference for AI modes applied in a breast screening context. Participants' responses to questions were compared using Pearson's χ 2 test. Bonferroni-adjusted significance tests were used for pairwise comparisons. Results Fifty-five percent of respondents had experience with AI in their workplaces, with automatic density measurement powered by machine learning being the most familiar AI product (69.4%). The top AI outputs with the highest ranks of perceived confidence were 'Displaying suspicious areas on mammograms with the percentage of cancer possibility' (67.8%) and 'Automatic mammogram classification (normal, benign, cancer, uncertain)' (64.6%). Radiology and breast physicians preferred using AI as second-reader mode (75.4% saying 'somewhat happy' to 'extremely happy') over triage (47.7%), pre-screening and first-reader modes (both with 26.2%) (P  < 0.001). Conclusion The majority of screen readers expressed increased confidence in utilising AI for highlighting suspicious areas on mammograms and for automatically classifying mammograms. They considered AI as an optimal second-reader mode being the most ideal use in a screening program. The findings provide valuable insights into the familiarities and expectations of radiologists and breast clinicians for the AI products that can enhance the effectiveness of the breast cancer screening programs, benefitting both healthcare professionals and patients alike.

Implementing Artificial Intelligence for Emergency Radiology Impacts Physicians' Knowledge and Perception: A Prospective Pre- and Post-Analysis

PURPOSE

The aim of this study was to evaluate the impact of implementing an artificial intelligence (AI) solution for emergency radiology into clinical routine on physicians' perception and knowledge.

MATERIALS AND METHODS

A prospective interventional survey was performed pre-implementation and 3 months post-implementation of an AI algorithm for fracture detection on radiographs in late 2022. Radiologists and traumatologists were asked about their knowledge and perception of AI on a 7-point Likert scale (-3, "strongly disagree"; +3, "strongly agree"). Self-generated identification codes allowed matching the same individuals pre-intervention and post-intervention, and using Wilcoxon signed rank test for paired data.

RESULTS

A total of 47/71 matched participants completed both surveys (66% follow-up rate) and were eligible for analysis (34 radiologists [72%], 13 traumatologists [28%], 15 women [32%]; mean age, 34.8 ± 7.8 years). Postintervention, there was an increase that AI "reduced missed findings" (1.28 [pre] vs 1.94 [post], P = 0.003) and made readers "safer" (1.21 vs 1.64, P = 0.048), but not "faster" (0.98 vs 1.21, P = 0.261). There was a rising disagreement that AI could "replace the radiological report" (-2.04 vs -2.34, P = 0.038), as well as an increase in self-reported knowledge about "clinical AI," its "chances," and its "risks" (0.40 vs 1.00, 1.21 vs 1.70, and 0.96 vs 1.34; all P 's ≤ 0.028). Radiologists used AI results more frequently than traumatologists ( P < 0.001) and rated benefits higher (all P 's ≤ 0.038), whereas senior physicians were less likely to use AI or endorse its benefits (negative correlation with age, -0.35 to 0.30; all P 's ≤ 0.046).

CONCLUSIONS

Implementing AI for emergency radiology into clinical routine has an educative aspect and underlines the concept of AI as a "second reader," to support and not replace physicians.

The Integration of Deep Learning in Radiotherapy: Exploring Challenges, Opportunities, and Future Directions through an Umbrella Review

This study investigates, through a narrative review, the transformative impact of deep learning (DL) in the field of radiotherapy, particularly in light of the accelerated developments prompted by the COVID-19 pandemic. The proposed approach was based on an umbrella review following a standard narrative checklist and a qualification process. The selection process identified 19 systematic review studies. Through an analysis of current research, the study highlights the revolutionary potential of DL algorithms in optimizing treatment planning, image analysis, and patient outcome prediction in radiotherapy. It underscores the necessity of further exploration into specific research areas to unlock the full capabilities of DL technology. Moreover, the study emphasizes the intricate interplay between digital radiology and radiotherapy, revealing how advancements in one field can significantly influence the other. This interdependence is crucial for addressing complex challenges and advancing the integration of cutting-edge technologies into clinical practice. Collaborative efforts among researchers, clinicians, and regulatory bodies are deemed essential to effectively navigate the evolving landscape of DL in radiotherapy. By fostering interdisciplinary collaborations and conducting thorough investigations, stakeholders can fully leverage the transformative power of DL to enhance patient care and refine therapeutic strategies. Ultimately, this promises to usher in a new era of personalized and optimized radiotherapy treatment for improved patient outcomes.

Correlation Aware Relevance-Based Semantic Index for Clinical Big Data Repository

In this paper, we focus on indexing mechanisms for unstructured clinical big integrated data repository systems. Clinical data is unstructured and heterogeneous, which comes in different files and formats. Accessing data efficiently and effectively are critical challenges. Traditional indexing mechanisms are difficult to apply on unstructured data, especially by identifying correlation information between clinical data elements. In this research work, we developed a correlation-aware relevance-based index that retrieves clinical data by fetching most relevant cases efficiently. In our previous work, we designed a methodology that categorizes medical data based on the semantics of data elements and merges them into an integrated repository. We developed a data integration system for medical data sources that combines heterogeneous medical data and provides access to knowledge-based database repositories to different users. In this research work, we designed an indexing system using semantic tags extracted from clinical data sources and medical ontologies that retrieves relevant data from database repositories and speeds up the process of data retrieval. Our objective is to provide an integrated biomedical database repository that can be used by radiologists as a reference, or for patient care, or by researchers. In this paper, we focus on designing a technique that performs data processing for data integration, learn the semantic properties of data elements, and develop a correlation-aware topic index that facilitates efficient data retrieval. We generated semantic tags by identifying key elements from integrated clinical cases using topic modeling techniques. We investigated a technique that identifies tags for merged categories and provides an index to fetch data from an integrated database repository. We developed a topic coherence matrix that shows how well a topic is supported by a corpus from clinical cases and medical ontologies. We were able to find more relevant results using an annotation index from an integrated database repository, and there was a 61% increase in a recall. We evaluated results with the help of experts and compared them with naive index (index with all terms from the corpus). Our approach improved data retrieval quality by providing most relevant results and reduced data retrieval time as we applied correlation-aware index on an integrated data repository. Topic indexing approach proposed in this research work identifies tags based on a correlation between different data elements, improves data retrieval time, and provides most relevant cases as an outcome of this system.

Attitudes towards artificial intelligence in emergency medicine

OBJECTIVE

To assess Australian and New Zealand emergency clinicians' attitudes towards the use of artificial intelligence (AI) in emergency medicine.

METHODS

We undertook a qualitative interview-based study based on grounded theory. Participants were recruited through ED internal mailing lists, the Australasian College for Emergency Medicine Bulletin, and the research teams' personal networks. Interviews were transcribed, coded and themes presented.

RESULTS

Twenty-five interviews were conducted between July 2021 and May 2022. Thematic saturation was achieved after 22 interviews. Most participants were from either Western Australia (52%) or Victoria (16%) and were consultants (96%). More participants reported feeling optimistic (10/25) than neutral (6/25), pessimistic (2/25) or mixed (7/25) towards the use of AI in the ED. A minority expressed scepticism regarding the feasibility or value of implementing AI into the ED. Multiple potential risks and ethical issues were discussed by participants including skill loss from overreliance on AI, algorithmic bias, patient privacy and concerns over liability. Participants also discussed perceived inadequacies in existing information technology systems. Participants felt that AI technologies would be used as decision support tools and not replace the roles of emergency clinicians. Participants were not concerned about the impact of AI on their job security. Most (17/25) participants thought that AI would impact emergency medicine within the next 10 years.

CONCLUSIONS

Emergency clinicians interviewed were generally optimistic about the use of AI in emergency medicine, so long as it is used as a decision support tool and they maintain the ability to override its recommendations.

Assessing radiologists' and radiographers' perceptions on artificial intelligence integration: opportunities and challenges

OBJECTIVES

The objective of this study was to evaluate radiologists' and radiographers' opinions and perspectives on artificial intelligence (AI) and its integration into the radiology department. Additionally, we investigated the most common challenges and barriers that radiologists and radiographers face when learning about AI.

METHODS

A nationwide, online descriptive cross-sectional survey was distributed to radiologists and radiographers working in hospitals and medical centres from May 29, 2023 to July 30, 2023. The questionnaire examined the participants' opinions, feelings, and predictions regarding AI and its applications in the radiology department. Descriptive statistics were used to report the participants' demographics and responses. Five-points Likert-scale data were reported using divergent stacked bar graphs to highlight any central tendencies.

RESULTS

Responses were collected from 258 participants, revealing a positive attitude towards implementing AI. Both radiologists and radiographers predicted breast imaging would be the subspecialty most impacted by the AI revolution. MRI, mammography, and CT were identified as the primary modalities with significant importance in the field of AI application. The major barrier encountered by radiologists and radiographers when learning about AI was the lack of mentorship, guidance, and support from experts.

CONCLUSION

Participants demonstrated a positive attitude towards learning about AI and implementing it in the radiology practice. However, radiologists and radiographers encounter several barriers when learning about AI, such as the absence of experienced professionals support and direction.

ADVANCES IN KNOWLEDGE

Radiologists and radiographers reported several barriers to AI learning, with the most significant being the lack of mentorship and guidance from experts, followed by the lack of funding and investment in new technologies.

Beyond the Clinic Walls: Examining Radiology Technicians' Experiences in Home-Based Radiography

In recent years, the landscape of diagnostic imaging has undergone a significant transformation with the emergence of home radiology, challenging the traditional paradigm. This shift, bringing diagnostic imaging directly to patients, has gained momentum and has been further accelerated by the global COVID-19 pandemic, highlighting the increasing importance and convenience of decentralized healthcare services. This study aims to offer a nuanced understanding of the attitudes and experiences influencing the integration of in-home radiography into contemporary healthcare practices. The research methodology involves a survey administered through Computer-Aided Web Interviewing (CAWI) tools, enabling real-time engagement with a diverse cohort of medical radiology technicians in the health domain. A second CAWI tool is submitted to experts to assess their feedback on the methodology. The survey explores key themes, including perceived advantages and challenges associated with domiciliary imaging, its impact on patient care, and the technological intricacies specific to conducting radiologic procedures outside the conventional clinical environment. Findings from a sample of 26 medical radiology technicians (drawn from a larger pool of 186 respondents) highlight a spectrum of opinions and constructive feedback. Enthusiasm is evident for the potential of domiciliary imaging to enhance patient convenience and provide a more patient-centric approach to healthcare. Simultaneously, this study suggests areas of intervention to improve the diffusion of home-based radiology. The methodology based on CAWI tools proves instrumental in the efficiency and depth of data collection, as evaluated by 16 experts from diverse professional backgrounds. The dynamic and responsive nature of this approach allows for a more allocated exploration of technicians' opinions, contributing to a comprehensive understanding of the evolving landscape of medical imaging services. Emphasis is placed on the need for national and international initiatives in the field, supported by scientific societies, to further explore the evolving landscape of teleradiology and the integration of artificial intelligence in radiology. This study encourages expansion involving other key figures in this practice, including, naturally, medical radiologists, general practitioners, medical physicists, and other stakeholders.

Radiology AI Deployment and Assessment Rubric (RADAR) to bring value-based AI into radiological practice

OBJECTIVE

To provide a comprehensive framework for value assessment of artificial intelligence (AI) in radiology.

METHODS

This paper presents the RADAR framework, which has been adapted from Fryback and Thornbury's imaging efficacy framework to facilitate the valuation of radiology AI from conception to local implementation. Local efficacy has been newly introduced to underscore the importance of appraising an AI technology within its local environment. Furthermore, the RADAR framework is illustrated through a myriad of study designs that help assess value.

RESULTS

RADAR presents a seven-level hierarchy, providing radiologists, researchers, and policymakers with a structured approach to the comprehensive assessment of value in radiology AI. RADAR is designed to be dynamic and meet the different valuation needs throughout the AI's lifecycle. Initial phases like technical and diagnostic efficacy (RADAR-1 and RADAR-2) are assessed pre-clinical deployment via in silico clinical trials and cross-sectional studies. Subsequent stages, spanning from diagnostic thinking to patient outcome efficacy (RADAR-3 to RADAR-5), require clinical integration and are explored via randomized controlled trials and cohort studies. Cost-effectiveness efficacy (RADAR-6) takes a societal perspective on financial feasibility, addressed via health-economic evaluations. The final level, RADAR-7, determines how prior valuations translate locally, evaluated through budget impact analysis, multi-criteria decision analyses, and prospective monitoring.

CONCLUSION

The RADAR framework offers a comprehensive framework for valuing radiology AI. Its layered, hierarchical structure, combined with a focus on local relevance, aligns RADAR seamlessly with the principles of value-based radiology.

CRITICAL RELEVANCE STATEMENT

The RADAR framework advances artificial intelligence in radiology by delineating a much-needed framework for comprehensive valuation.

KEYPOINTS

• Radiology artificial intelligence lacks a comprehensive approach to value assessment. • The RADAR framework provides a dynamic, hierarchical method for thorough valuation of radiology AI. • RADAR advances clinical radiology by bridging the artificial intelligence implementation gap.

A framework to integrate artificial intelligence training into radiology residency programs: preparing the future radiologist

OBJECTIVES

To present a framework to develop and implement a fast-track artificial intelligence (AI) curriculum into an existing radiology residency program, with the potential to prepare a new generation of AI conscious radiologists.

METHODS

The AI-curriculum framework comprises five sequential steps: (1) forming a team of AI experts, (2) assessing the residents' knowledge level and needs, (3) defining learning objectives, (4) matching these objectives with effective teaching strategies, and finally (5) implementing and evaluating the pilot. Following these steps, a multidisciplinary team of AI engineers, radiologists, and radiology residents designed a 3-day program, including didactic lectures, hands-on laboratory sessions, and group discussions with experts to enhance AI understanding. Pre- and post-curriculum surveys were conducted to assess participants' expectations and progress and were analyzed using a Wilcoxon rank-sum test.

RESULTS

There was 100% response rate to the pre- and post-curriculum survey (17 and 12 respondents, respectively). Participants' confidence in their knowledge and understanding of AI in radiology significantly increased after completing the program (pre-curriculum means 3.25 ± 1.48 (SD), post-curriculum means 6.5 ± 0.90 (SD), p-value = 0.002). A total of 75% confirmed that the course addressed topics that were applicable to their work in radiology. Lectures on the fundamentals of AI and group discussions with experts were deemed most useful.

CONCLUSION

Designing an AI curriculum for radiology residents and implementing it into a radiology residency program is feasible using the framework presented. The 3-day AI curriculum effectively increased participants' perception of knowledge and skills about AI in radiology and can serve as a starting point for further customization.

CRITICAL RELEVANCE STATEMENT

The framework provides guidance for developing and implementing an AI curriculum in radiology residency programs, educating residents on the application of AI in radiology and ultimately contributing to future high-quality, safe, and effective patient care.

KEY POINTS

• AI education is necessary to prepare a new generation of AI-conscious radiologists. • The AI curriculum increased participants' perception of AI knowledge and skills in radiology. • This five-step framework can assist integrating AI education into radiology residency programs.

Technical/Algorithm, Stakeholder, and Society (TASS) barriers to the application of artificial intelligence in medicine: A systematic review

INTRODUCTION

The use of artificial intelligence (AI), particularly machine learning and predictive analytics, has shown great promise in health care. Despite its strong potential, there has been limited use in health care settings. In this systematic review, we aim to determine the main barriers to successful implementation of AI in healthcare and discuss potential ways to overcome these challenges.

METHODS

We conducted a literature search in PubMed (1/1/2001-1/1/2023). The search was restricted to publications in the English language, and human study subjects. We excluded articles that did not discuss AI, machine learning, predictive analytics, and barriers to the use of these techniques in health care. Using grounded theory methodology, we abstracted concepts to identify major barriers to AI use in medicine.

RESULTS

We identified a total of 2,382 articles. After reviewing the 306 included papers, we developed 19 major themes, which we categorized into three levels: the Technical/Algorithm, Stakeholder, and Social levels (TASS). These themes included: Lack of Explainability, Need for Validation Protocols, Need for Standards for Interoperability, Need for Reporting Guidelines, Need for Standardization of Performance Metrics, Lack of Plan for Updating Algorithm, Job Loss, Skills Loss, Workflow Challenges, Loss of Patient Autonomy and Consent, Disturbing the Patient-Clinician Relationship, Lack of Trust in AI, Logistical Challenges, Lack of strategic plan, Lack of Cost-effectiveness Analysis and Proof of Efficacy, Privacy, Liability, Bias and Social Justice, and Education.

CONCLUSION

We identified 19 major barriers to the use of AI in healthcare and categorized them into three levels: the Technical/Algorithm, Stakeholder, and Social levels (TASS). Future studies should expand on barriers in pediatric care and focus on developing clearly defined protocols to overcome these barriers.

Radiology Residents' Perceptions of Artificial Intelligence: Nationwide Cross-Sectional Survey Study

BACKGROUND

Artificial intelligence (AI) is transforming various fields, with health care, especially diagnostic specialties such as radiology, being a key but controversial battleground. However, there is limited research systematically examining the response of "human intelligence" to AI.

OBJECTIVE

This study aims to comprehend radiologists' perceptions regarding AI, including their views on its potential to replace them, its usefulness, and their willingness to accept it. We examine the influence of various factors, encompassing demographic characteristics, working status, psychosocial aspects, personal experience, and contextual factors.

METHODS

Between December 1, 2020, and April 30, 2021, a cross-sectional survey was completed by 3666 radiology residents in China. We used multivariable logistic regression models to examine factors and associations, reporting odds ratios (ORs) and 95% CIs.

RESULTS

In summary, radiology residents generally hold a positive attitude toward AI, with 29.90% (1096/3666) agreeing that AI may reduce the demand for radiologists, 72.80% (2669/3666) believing AI improves disease diagnosis, and 78.18% (2866/3666) feeling that radiologists should embrace AI. Several associated factors, including age, gender, education, region, eye strain, working hours, time spent on medical images, resilience, burnout, AI experience, and perceptions of residency support and stress, significantly influence AI attitudes. For instance, burnout symptoms were associated with greater concerns about AI replacement (OR 1.89; P<.001), less favorable views on AI usefulness (OR 0.77; P=.005), and reduced willingness to use AI (OR 0.71; P<.001). Moreover, after adjusting for all other factors, perceived AI replacement (OR 0.81; P<.001) and AI usefulness (OR 5.97; P<.001) were shown to significantly impact the intention to use AI.

CONCLUSIONS

This study profiles radiology residents who are accepting of AI. Our comprehensive findings provide insights for a multidimensional approach to help physicians adapt to AI. Targeted policies, such as digital health care initiatives and medical education, can be developed accordingly.

Are medical oncologists ready for the artificial intelligence revolution? Evaluation of the opinions, knowledge, and experiences of medical oncologists about artificial intelligence technologies

The use of artificial intelligence technologies (AIT) in medicine is increasing worldwide. In this study, it was aimed to evaluate the experiences, opinions, and future expectations of medical oncologists on artificial intelligence (AI). After the reliability and validity analyses were carried out by a pilot study, the main online questionnaire was sent to the members of the "Turkish Society of Medical Oncology" mail group by an invitation e-mail. The anonymized responses of the participants were analyzed. The median age of the 156 participants was 36 (34-43) years and half (51%) were male. Most (45%) were fellows. Forty-six percent were working in university hospitals, 56% were visiting 20-40 patients a day. Medical oncologists' view of AIT was mostly positive (78%). However, some (especially women) had doubts about the reliability of AI (44%) and the establishment of its ethical/legal basis (49%). Sixty-five percent of the participants had no/superficial knowledge about AI. More than half (55%) had never used AI-based applications in their academic or clinical work. However, unlike now, 80% of the participants believed that they would use AIT frequently in their practice in the future and it would be beneficial. The most anticipated (81%) benefit was real-time information processing and real-time access to big data. Sixty-two percent believed that information about AI should be in the education curriculum. The vast majority of respondents (79%) thought that AI would not completely replace medical oncologists in the future. Some differences were found in the perception and experience of oncologists according to age, gender, title, and the number of patients examined per day. About AI, the general opinion of medical oncologists was positive, but their level of knowledge and use was low. However, they thought they would use it frequently in future and needed training.

Analyzing Barriers and Enablers for the Acceptance of Artificial Intelligence Innovations into Radiology Practice: A Scoping Review

OBJECTIVES

This scoping review was conducted to determine the barriers and enablers associated with the acceptance of artificial intelligence/machine learning (AI/ML)-enabled innovations into radiology practice from a physician's perspective.

METHODS

A systematic search was performed using Ovid Medline and Embase. Keywords were used to generate refined queries with the inclusion of computer-aided diagnosis, artificial intelligence, and barriers and enablers. Three reviewers assessed the articles, with a fourth reviewer used for disagreements. The risk of bias was mitigated by including both quantitative and qualitative studies.

RESULTS

An electronic search from January 2000 to 2023 identified 513 studies. Twelve articles were found to fulfill the inclusion criteria: qualitative studies (n = 4), survey studies (n = 7), and randomized controlled trials (RCT) (n = 1). Among the most common barriers to AI implementation into radiology practice were radiologists' lack of acceptance and trust in AI innovations; a lack of awareness, knowledge, and familiarity with the technology; and perceived threat to the professional autonomy of radiologists. The most important identified AI implementation enablers were high expectations of AI's potential added value; the potential to decrease errors in diagnosis; the potential to increase efficiency when reaching a diagnosis; and the potential to improve the quality of patient care.

CONCLUSIONS

This scoping review found that few studies have been designed specifically to identify barriers and enablers to the acceptance of AI in radiology practice. The majority of studies have assessed the perception of AI replacing radiologists, rather than other barriers or enablers in the adoption of AI. To comprehensively evaluate the potential advantages and disadvantages of integrating AI innovations into radiology practice, gathering more robust research evidence on stakeholder perspectives and attitudes is essential.

Artificial Intelligence/Machine Learning Education in Radiology: Multi-institutional Survey of Radiology Residents in the United States

RATIONALE AND OBJECTIVES

To evaluate radiology residents' perspectives regarding inclusion of artificial intelligence/ machine learning (AI/ML) education in the residency curriculum.

MATERIALS AND METHODS

An online anonymous survey was sent to 759 residents at 21 US radiology residency programs. Resident demographics, sub-specialty interests, educational background and research experiences, as well as the awareness, availability, and usefulness of various resources for AI/ML education were collected.

RESULTS

The survey response rate was 27% (209/759). A total of 74% of respondents were male, 80% were training at large university programs, and only a minority (<20) had formal education or research experience in AI/ML. All four years of training were represented (range: 20%-38%). The majority of the residents agreed or strongly agreed (83%) that AI/ML education should be a part of the radiology residency curriculum and that such education should equip them with the knowledge to troubleshoot an AI tool in practice / determine whether a tool is working as intended (82%). Among the residency programs that offer AI/ML education, the most common resources were lecture series (43%), national informatics courses (28%), and in-house/institutional courses (26%). About 24% of the residents reported no AI/ML educational offerings in their residency curriculum. Hands on AI/ML laboratory (67%) and lecture series (61%) were reported as the most beneficial or effective. The majority of the residents preferred AI/ML education offered as a continuous course spanning the radiology residency (R1 to R4) (76%), followed by mini fellowship during R4 (32%) and as a course during PGY1 (21%).

CONCLUSION

Residents largely favor the inclusion of formal AI/ML education in the radiology residency curriculum, prefer hands-on learning and lectures as learning tools, and prefer a continuous AI/ML course spanning R1-R4.

A Machine Learning Approach for Knee Injury Detection from Magnetic Resonance Imaging

The knee is an essential part of our body, and identifying its injuries is crucial since it can significantly affect quality of life. To date, the preferred way of evaluating knee injuries is through magnetic resonance imaging (MRI), which is an effective imaging technique that accurately identifies injuries. The issue with this method is that the high amount of detail that comes with MRIs is challenging to interpret and time consuming for radiologists to analyze. The issue becomes even more concerning when radiologists are required to analyze a significant number of MRIs in a short period. For this purpose, automated tools may become helpful to radiologists assisting them in the evaluation of these images. Machine learning methods, in being able to extract meaningful information from data, such as images or any other type of data, are promising for modeling the complex patterns of knee MRI and relating it to its interpretation. In this study, using a real-life imaging protocol, a machine-learning model based on convolutional neural networks used for detecting medial meniscus tears, bone marrow edema, and general abnormalities on knee MRI exams is presented. Furthermore, the model's effectiveness in terms of accuracy, sensitivity, and specificity is evaluated. Based on this evaluation protocol, the explored models reach a maximum accuracy of 83.7%, a maximum sensitivity of 82.2%, and a maximum specificity of 87.99% for meniscus tears. For bone marrow edema, a maximum accuracy of 81.3%, a maximum sensitivity of 93.3%, and a maximum specificity of 78.6% is reached. Finally, for general abnormalities, the explored models reach 83.7%, 90.0% and 84.2% of maximum accuracy, sensitivity and specificity, respectively.

Perspectives of radiologists in Ghana about the emerging role of artificial intelligence in radiology

Background

The integration of Artificial Intelligence (AI)-based technologies in medicine is advancing rapidly especially in the field of radiology. This however, is at a slow pace in Africa, hence, this study to evaluate the perspectives of Ghanaian radiologists.

Methods

Data for this cross-sectional prospective study was collected between September and November 2021 through an online survey and entered into SPSS for analysis. A Mann-Whitney U test assisted in checking for possible gender differences in the mean Likert scale responses on the radiologists' perspectives about AI in radiology. Statistical significance was set at P ≤ 0.05.

Results

The study comprised 77 radiologists, with more males (71.4%). 97.4% were aware of the concept of AI, with their initial exposure via conferences (42.9%). The majority of the respondents had average awareness (36.4%) and below average expertise (44.2%) in radiological AI usage. Most of the participants (54.5%) stated, they do not use AI in their practices. The respondents disagreed that AI will ultimately replace radiologists in the near future (average Likert score = 3.49, SD = 1.096) and that AI should be an integral part of the training of radiologists (average Likert score = 1.91, SD = 0.830).

Conclusion

Although the radiologists had positive opinions about the capabilities of AI, they exhibited an average awareness of and below average expertise in the usage of AI applications in radiology. They agreed on the potential life changing impact of AI and were of the view that AI will not replace radiologists but serve as a complement. There was inadequate radiological AI infrastructure in Ghana.

A Nationwide Web-Based Survey of Neuroradiologists' Perceptions of Artificial Intelligence Software for Neuro-Applications in Korea

OBJECTIVE

We aimed to investigate current expectations and clinical adoption of artificial intelligence (AI) software among neuroradiologists in Korea.

MATERIALS AND METHODS

In April 2022, a 30-item online survey was conducted by neuroradiologists from the Korean Society of Neuroradiology (KSNR) to assess current user experiences, perceptions, attitudes, and future expectations regarding AI for neuro-applications. Respondents with experience in AI software were further investigated in terms of the number and type of software used, period of use, clinical usefulness, and future scope. Results were compared between respondents with and without experience with AI software through multivariable logistic regression and mediation analyses.

RESULTS

The survey was completed by 73 respondents, accounting for 21.9% (73/334) of the KSNR members; 72.6% (53/73) were familiar with AI and 58.9% (43/73) had used AI software, with approximately 86% (37/43) using 1-3 AI software programs and 51.2% (22/43) having up to one year of experience with AI software. Among AI software types, brain volumetry software was the most common (62.8% [27/43]). Although 52.1% (38/73) assumed that AI is currently useful in practice, 86.3% (63/73) expected it to be useful for clinical practice within 10 years. The main expected benefits were reducing the time spent on repetitive tasks (91.8% [67/73]) and improving reading accuracy and reducing errors (72.6% [53/73]). Those who experienced AI software were more familiar with AI (adjusted odds ratio, 7.1 [95% confidence interval, 1.81-27.81]; P = 0.005). More than half of the respondents with AI software experience (55.8% [24/43]) agreed that AI should be included in training curriculums, while almost all (95.3% [41/43]) believed that radiologists should coordinate to improve its performance.

CONCLUSION

A majority of respondents experienced AI software and showed a proactive attitude toward adopting AI in clinical practice, suggesting that AI should be incorporated into training and active participation in AI development should be encouraged.

Awareness of Artificial Intelligence in Medical Imaging Among Radiologists and Radiologic Technologists

BACKGROUND

Current technological developments in medical imaging are primarily focused on increasing the integration of artificial intelligence (AI) into all medical imaging modalities. They are already considered capable of handling tasks such as image reconstruction, processing (denoising, segmentation), analysis, and predictive modeling. The purpose of this study is to assess the awareness (knowledge, attitudes, and practices) of radiologists and radiologic technologists regarding AI in medical imaging.

MATERIALS AND METHODS

This cross-sectional, qualitative study focuses on radiologists and radiologic technologists in Saudi Arabia, Sudan, and Yemen. A self-administered questionnaire based on published studies was used to collect primary data. Version 25.0 of IBM SPSS Statistics (IBM Corp., Armonk, NY) was used for the statistical analysis. The demographics were summarized as frequency and percentage. Independent samples t-tests and ANOVA tests were used to evaluate and compare the degree of AI awareness among the study groups.

RESULTS

A total of 210 individuals completed the survey. According to demographic information, there were 134 (63.8%) radiologic technologists and 76 radiologists (36.2%). Of the participants, 131 (62%) were male, while 79 (37.6%) were female. A total of 130 (61.9%) of the targeted respondents had a positive attitude, 105 (50%) had appropriate practice, and 122 (58.1%) of them were informed (knowledgeable) about AI in medical imaging. There was a significant difference in knowledge awareness between radiologists and radiologic technologists (p-value: <0.05). Radiologists were more knowledgeable than radiologic technologists, and females were more knowledgeable than males (p-value: 0.049). For attitude awareness, there were no significant differences regarding specialization, gender, age, academic qualification, and experience (p-value > 0.05). Regarding practice awareness, it turned out that females are more knowledgeable than males (p-value: 0.007). Additionally, it was discovered that significant differences indicated that bachelor's degree holders have a higher level of practice awareness than diploma holders (p-value: <0.05).

CONCLUSION

Significant differences between the respondent's knowledge awareness regarding specialization, gender, and experience are linked with relatively sufficient AI-basic knowledge and positive attitude awareness among radiologists and radiologic technologists. Only half of the study participants had appropriate practical awareness; therefore, additional training could enhance practical awareness.

Artificial intelligence in radiology: trainees want more

AIM

To understand the attitudes of UK radiology trainees towards artificial intelligence (AI) in Radiology, in particular, assessing the demand for AI education.

MATERIALS AND METHODS

A survey, which ran over a period of 2 months, was created using the Google Forms platform and distributed via email to all UK training programmes.

RESULTS

The survey was completed by 149 trainee radiologists with at least one response from all UK training programmes. Of the responses, 83.7% were interested in AI use in radiology but 71.4% had no experience of working with AI and 79.9% would like to be involved in AI-based projects. Almost all (98.7%) felt that AI should be taught during their training, yet only one respondent stated that their training programme had implemented AI teaching. Respondents indicated that basic understanding, implementation, and critical appraisal of AI software should be prioritized in teaching. Of the trainees, 74.2% agreed that AI would enhance the job of diagnostic radiologists over the next 20 years. The main concerns raised were information technology/implementation and ethical/regulatory issues.

CONCLUSION

Despite the current limited availability of AI-based activities and teaching within UK training programmes, UK trainees' attitudes towards AI are mostly positive with many showing interest in being involved with AI-based projects, activities, and teaching.

Understanding Prospective Physicians' Intention to Use Artificial Intelligence in Their Future Medical Practice: Configurational Analysis

BACKGROUND

Prospective physicians are expected to find artificial intelligence (AI) to be a key technology in their future practice. This transformative change has caught the attention of scientists, educators, and policy makers alike, with substantive efforts dedicated to the selection and delivery of AI topics and competencies in the medical curriculum. Less is known about the behavioral perspective or the necessary and sufficient preconditions for medical students' intention to use AI in the first place.

OBJECTIVE

Our study focused on medical students' knowledge, experience, attitude, and beliefs related to AI and aimed to understand whether they are necessary conditions and form sufficient configurations of conditions associated with behavioral intentions to use AI in their future medical practice.

METHODS

We administered a 2-staged questionnaire operationalizing the variables of interest (ie, knowledge, experience, attitude, and beliefs related to AI, as well as intention to use AI) and recorded 184 responses at t₀ (February 2020, before the COVID-19 pandemic) and 138 responses at t₁ (January 2021, during the COVID-19 pandemic). Following established guidelines, we applied necessary condition analysis and fuzzy-set qualitative comparative analysis to analyze the data.

RESULTS

Findings from the fuzzy-set qualitative comparative analysis show that the intention to use AI is only observed when students have a strong belief in the role of AI (individually necessary condition); certain AI profiles, that is, combinations of knowledge and experience, attitudes and beliefs, and academic level and gender, are always associated with high intentions to use AI (equifinal and sufficient configurations); and profiles associated with nonhigh intentions cannot be inferred from profiles associated with high intentions (causal asymmetry).

CONCLUSIONS

Our work contributes to prior knowledge by showing that a strong belief in the role of AI in the future of medical professions is a necessary condition for behavioral intentions to use AI. Moreover, we suggest that the preparation of medical students should go beyond teaching AI competencies and that educators need to account for the different AI profiles associated with high or nonhigh intentions to adopt AI.

Computer-Aided Detection of Subsolid Nodules on Chest Computed Tomography: Assessment of Visualization on Vessel-Suppressed Images

OBJECTIVES

This study aimed to clarify the performance of automatic detection of subsolid nodules by commercially available software on computed tomography (CT) images of various slice thicknesses and compare it with visualization on the accompanying vessel-suppression CT (VS-CT) images.

METHODS

A total of 95 subsolid nodules from 84 CT examinations of 84 patients were included. The reconstructed CT image series of each case with 3-, 2-, and 1-mm slice thicknesses were loaded into a commercially available software application (ClearRead CT) for automatic detection of subsolid nodules and generation of VS-CT images. Automatic nodule detection sensitivity was assessed for 95 nodules on each series of images acquired at 3 slice thicknesses. Four radiologists subjectively evaluated visual assessment of the nodules on VS-CT.

RESULTS

ClearRead CT automatically detected 69.5% (66/95 nodules), 68.4% (65/95 nodules), and 70.5% (67/95 nodules) of all subsolid nodules in 3-, 2-, and 1-mm slices, respectively. The detection rate was higher for part-solid nodules than for pure ground-glass nodules at all slice thicknesses. In the visualization assessment on VS-CT, 3 nodules at each slice thickness (3.2%) were judged as invisible, while 26 of 29 (89.7%), 27 of 30 (90.0%), and 25 of 28 (89.3%) nodules, which were missed by computer-aided detection, were judged as visible in 3-, 2-, and 1-mm slices, respectively.

CONCLUSIONS

The automatic detection rate of subsolid nodules by ClearRead CT was approximately 70% at all slice thicknesses. More than 95% of subsolid nodules were visualized on VS-CT, including nodules undetected by the automated software. Computed tomography acquisition at slices thinner than 3 mm did not confer any benefits.

The implementation of artificial intelligence in radiology: a narrative review of patient perspectives

Aim

To synthesise research on the view of the public and patients of the use of artificial intelligence (AI) in radiology investigations.

Methods

A literature review of narrative synthesis of qualitative and quantitative studies that reported views of the public and patients toward the use of AI in radiology.

Results

Only seven studies related to patient and public views were retrieved, suggesting that this is an underexplored area of research. Two broad themes, of confidence in the capabilities of AI, and the accountability and transparency of AI, were identified.

Conclusions

Both optimism and concerns were expressed by participants. Transparency in the implementation of AI, scientific validation, clear regulation and accountability were expected. Combined human and AI interpretation of imaging was strongly favoured over AI acting autonomously. The review highlights the limited engagement of the public in the adoption of AI in a radiology setting. Successful implementation of AI in this field will require demonstrating not only adequate accuracy of the technology, but also its acceptance by patients.

Neurology education in the era of artificial intelligence

PURPOSE OF REVIEW

The practice of neurology is undergoing a paradigm shift because of advances in the field of data science, artificial intelligence, and machine learning. To ensure a smooth transition, physicians must have the knowledge and competence to apply these technologies in clinical practice. In this review, we describe physician perception and preparedness, as well as current state for clinical applications of artificial intelligence and machine learning in neurology.

RECENT FINDINGS

Digital health including artificial intelligence-based/machine learning-based technology has made significant inroads into various aspects of healthcare including neurological care. Surveys of physicians and healthcare stakeholders suggests an overall positive perception about the benefits of artificial intelligence/machine learning in clinical practice. This positive perception is tempered by concerns for lack of knowledge and limited opportunities to build competence in artificial intelligence/machine learning technology. Literature about neurologist's perception and preparedness towards artificial intelligence/machine learning-based technology is scant. There are very few opportunities for physicians particularly neurologists to learn about artificial intelligence/machine learning-based technology.

SUMMARY

Neurologists have not been surveyed about their perception and preparedness to adopt artificial intelligence/machine learning-based technology in clinical practice. We propose development of a practical artificial intelligence/machine learning curriculum to enhance neurologists' competence in these newer technologies.

The time is now: making the case for a UK registry of deployment of radiology artificial intelligence applications

Artificial intelligence (AI)-based healthcare applications (apps) are rapidly evolving, and radiology is a target specialty for their implementation. In this paper, we put the case for a national deployment registry to track the spread of AI apps into clinical use in radiology in the UK. By gathering data on the specific locations, purposes, and people associated with AI app deployment, such a registry would provide greater transparency on their spread in the radiology field. In combination with other regulatory and audit mechanisms, it would provide radiologists and patients with greater confidence and trust in AI apps. At the same time, coordination of this information would reduce costs for the National Health Service (NHS) by preventing duplication of piloting activities. This commentary discusses the need for a UK-wide registry for such apps, its benefits and risks, and critical success factors for its establishment. We conclude by noting that a critical window of opportunity has opened up for the development of a deployment registry, before the current pattern of localised clusters of activity turns into the widespread proliferation of AI apps across clinical practice.

The Use of Artificial Intelligence (AI) in the Radiology Field: What Is the State of Doctor-Patient Communication in Cancer Diagnosis?

BACKGROUND

In the past decade, interest in applying Artificial Intelligence (AI) in radiology to improve diagnostic procedures increased. AI has potential benefits spanning all steps of the imaging chain, from the prescription of diagnostic tests to the communication of test reports. The use of AI in the field of radiology also poses challenges in doctor-patient communication at the time of the diagnosis. This systematic review focuses on the patient role and the interpersonal skills between patients and physicians when AI is implemented in cancer diagnosis communication.

METHODS

A systematic search was conducted on PubMed, Embase, Medline, Scopus, and PsycNet from 1990 to 2021. The search terms were: ("artificial intelligence" or "intelligence machine") and "communication" "radiology" and "oncology diagnosis". The PRISMA guidelines were followed.

RESULTS

517 records were identified, and 5 papers met the inclusion criteria and were analyzed. Most of the articles emphasized the success of the technological support of AI in radiology at the expense of patient trust in AI and patient-centered communication in cancer disease. Practical implications and future guidelines were discussed according to the results.

CONCLUSIONS

AI has proven to be beneficial in helping clinicians with diagnosis. Future research may improve patients' trust through adequate information about the advantageous use of AI and an increase in medical compliance with adequate training on doctor-patient diagnosis communication.

Radiological education in the era of artificial intelligence: A review

In the era of artificial intelligence (AI), a great deal of attention is being paid to AI in radiological practice. There are a large number of AI products on the radiological market based on X-rays, computed tomography, magnetic resonance imaging, and ultrasound. AI will not only change the way of radiological practice but also the way of radiological education. It is still not clearly defined about the exact role AI will play in radiological practice, but it will certainly be consolidated into radiological education in the foreseeable future. However, there are few literatures that have comprehensively summarized the attitudes, opportunities and challenges that AI can pose in the different training phases of radiologists, from university education to continuing education. Herein, we describe medical students' attitudes towards AI, summarize the role of AI in radiological education, and analyze the challenges that AI can pose in radiological education.

Biomedical heterogeneous data categorization and schema mapping toward data integration

Data integration is a well-motivated problem in the clinical data science domain. Availability of patient data, reference clinical cases, and datasets for research have the potential to advance the healthcare industry. However, the unstructured (text, audio, or video data) and heterogeneous nature of the data, the variety of data standards and formats, and patient privacy constraint make data interoperability and integration a challenge. The clinical text is further categorized into different semantic groups and may be stored in different files and formats. Even the same organization may store cases in different data structures, making data integration more challenging. With such inherent complexity, domain experts and domain knowledge are often necessary to perform data integration. However, expert human labor is time and cost prohibitive. To overcome the variability in the structure, format, and content of the different data sources, we map the text into common categories and compute similarity within those. In this paper, we present a method to categorize and merge clinical data by considering the underlying semantics behind the cases and use reference information about the cases to perform data integration. Evaluation shows that we were able to merge 88% of clinical data from five different sources.

ToxNet: an artificial intelligence designed for decision support for toxin prediction

BACKGROUND

Artificial intelligences (AIs) are emerging in the field of medical informatics in many areas. They are mostly used for diagnosis support in medical imaging but have potential uses in many other fields of medicine where large datasets are available.

AIM

To develop an artificial intelligence (AI) "ToxNet", a machine-learning based computer-aided diagnosis (CADx) system, which aims to predict poisons based on patient's symptoms and metadata from our Poison Control Center (PCC) data. To prove its accuracy and compare it against medical doctors (MDs).

METHODS

The CADx system was developed and trained using data from 781,278 calls recorded in our PCC database from 2001 to 2019. All cases were mono-intoxications. Patient symptoms and meta-information (e.g., age group, sex, etiology, toxin point of entry, weekday, etc.) were provided. In the pilot phase, the AI was trained on 10 substances, the AI's prediction was compared to naïve matching, literature matching, a multi-layer perceptron (MLP), and the graph attention network (GAT). The trained AI's accuracy was then compared to 10 medical doctors in an individual and in an identical dataset. The dataset was then expanded to 28 substances and the predictions and comparisons repeated.

RESULTS

In the pilot, the prediction performance in a set of 8995 patients with 10 substances was 0.66 ± 0.01 (F1 micro score). Our CADx system was significantly superior to naïve matching, literature matching, MLP, and GAT (p < 0.005). It outperformed our physicians experienced in clinical toxicology in the individual and identical dataset. In the extended dataset, our CADx system was able to predict the correct toxin in a set of 36,033 patients with 28 substances with an overall performance of 0.27 ± 0.01 (F1 micro score), also significantly superior to naïve matching, literature matching, MLP, and GAT. It also outperformed our MDs.

CONCLUSION

Our AI trained on a large PCC database works well for poison prediction in these experiments. With further research, it might become a valuable aid for physicians in predicting unknown substances and might be the first step into AI use in PCCs.

Artificial Intelligence (AI) in Breast Imaging: A Scientometric Umbrella Review

Artificial intelligence (AI), a rousing advancement disrupting a wide spectrum of applications with remarkable betterment, has continued to gain momentum over the past decades. Within breast imaging, AI, especially machine learning and deep learning, honed with unlimited cross-data/case referencing, has found great utility encompassing four facets: screening and detection, diagnosis, disease monitoring, and data management as a whole. Over the years, breast cancer has been the apex of the cancer cumulative risk ranking for women across the six continents, existing in variegated forms and offering a complicated context in medical decisions. Realizing the ever-increasing demand for quality healthcare, contemporary AI has been envisioned to make great strides in clinical data management and perception, with the capability to detect indeterminate significance, predict prognostication, and correlate available data into a meaningful clinical endpoint. Here, the authors captured the review works over the past decades, focusing on AI in breast imaging, and systematized the included works into one usable document, which is termed an umbrella review. The present study aims to provide a panoramic view of how AI is poised to enhance breast imaging procedures. Evidence-based scientometric analysis was performed in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guideline, resulting in 71 included review works. This study aims to synthesize, collate, and correlate the included review works, thereby identifying the patterns, trends, quality, and types of the included works, captured by the structured search strategy. The present study is intended to serve as a "one-stop center" synthesis and provide a holistic bird's eye view to readers, ranging from newcomers to existing researchers and relevant stakeholders, on the topic of interest.

AI in breast screening mammography: breast screening readers' perspectives

OBJECTIVES

This study surveyed the views of breast screening readers in the UK on how to incorporate Artificial Intelligence (AI) technology into breast screening mammography.

METHODS

An online questionnaire was circulated to the UK breast screening readers. Questions included their degree of approval of four AI implementation scenarios: AI as triage, AI as a companion reader/reader aid, AI replacing one of the initial two readers, and AI replacing all readers. They were also asked to rank five AI representation options (discrete opinion; mammographic scoring; percentage score with 100% indicating malignancy; region of suspicion; heat map) and indicate which evidence they considered necessary to support the implementation of AI into their practice among six options offered.

RESULTS

The survey had 87 nationally accredited respondents across the UK; 73 completed the survey in full. Respondents approved of AI replacing one of the initial two human readers and objected to AI replacing all human readers. Participants were divided on AI as triage and AI as a reader companion. A region of suspicion superimposed on the image was the preferred AI representation option. Most screen readers considered national guidelines (77%), studies using a nationally representative dataset (65%) and independent prospective studies (60%) as essential evidence. Participants' free-text comments highlighted concerns and the need for additional validation.

CONCLUSIONS

Overall, screen readers supported the introduction of AI as a partial replacement of human readers and preferred a graphical indication of the suspected tumour area, with further evidence and national guidelines considered crucial prior to implementation.

An Educational Graphical User Interface to Construct Convolutional Neural Networks for Teaching Artificial Intelligence in Radiology

Deep learning techniques using convolutional neural networks (CNNs) have been successfully developed for various medical image analysis tasks. However, the skills to understand and develop deep learning models are not usually taught during radiology training, which constitutes a barrier for radiologists looking to integrate machine learning (ML) into their research or clinical practice. In this work, we developed and evaluated an educational graphical user interface (GUI) to construct CNNs for teaching deep learning concepts to radiology trainees. The GUI was developed in Python using the PyQt and PyTorch frameworks. The functionality of the GUI was demonstrated through a binary classification task on a dataset of MR images of the brain. The usability of the GUI was assessed through 45-min user testing sessions with 5 neuroradiologists and neuroradiology fellows, assessing mean task completion times, the System Usability Scale (SUS), and a qualitative questionnaire as metrics. Task completion times were compared against a ML expert who performed the same tasks. After a 20-min introduction to CNNs and a walkthrough of the GUI, users were able to perform all assigned tasks successfully. There was no significant difference in task completion time compared to a ML expert. The educational GUI achieved a score of 82.5 on the SUS, suggesting that the system is highly usable. Users indicated that the GUI seems useful as an educational tool to teach ML topics to radiology trainees. An educational GUI allows interactive teaching in ML that can be incorporated into radiology training.

The Use of Artificial Intelligence in Medical Imaging: A Nationwide Pilot Survey of Trainees in Saudi Arabia

Artificial intelligence is dramatically transforming medical imaging. In Saudi Arabia, there are a lack of studies assessing the level of artificial intelligence use and reliably determining the perceived impact of artificial intelligence on the radiology workflow and the profession. We assessed the levels of artificial intelligence use among radiology trainees and correlated the perceived impact of artificial intelligence on the workflow and profession with the behavioral intention to use artificial intelligence. This cross-sectional study enrolled radiology trainees from Saudi Arabia, and a 5-part-structured questionnaire was disseminated. The items concerning the perceived impact of artificial intelligence on the radiology workflow conformed to the six-step standard workflow in radiology, which includes ordering and scheduling, protocoling and acquisition, image interpretation, reporting, communication, and billing. We included 98 participants. Few used artificial intelligence in routine practice (7%). The perceived impact of artificial intelligence on the radiology workflow was at a considerable level in all radiology workflow steps (range, 3.64−3.97 out of 5). Behavioral intention to use artificial intelligence was linearly correlated with the perceptions of its impact on the radiology workflow and on the profession (p < 0.001). Artificial intelligence is used at a low level in radiology. The perceived impact of artificial intelligence on radiology workflow and the profession is correlated to an increase in behavioral intention to use artificial intelligence. Thus, increasing awareness about the positive impact of artificial intelligence can improve its adoption.

Learning rate of students detecting and annotating pediatric wrist fractures in supervised artificial intelligence dataset preparations

The use of artificial intelligence (AI) in image analysis is an intensively debated topic in the radiology community these days. AI computer vision algorithms typically rely on large-scale image databases, annotated by specialists. Developing and maintaining them is time-consuming, thus, the involvement of non-experts into the workflow of annotation should be considered. We assessed the learning rate of inexperienced evaluators regarding correct labeling of pediatric wrist fractures on digital radiographs. Students with and without a medical background labeled wrist fractures with bounding boxes in 7,000 radiographs over ten days. Pediatric radiologists regularly discussed their mistakes. We found F1 scores-as a measure for detection rate-to increase substantially under specialist feedback (mean 0.61±0.19 at day 1 to 0.97±0.02 at day 10, p<0.001), but not the Intersection over Union as a parameter for labeling precision (mean 0.27±0.29 at day 1 to 0.53±0.25 at day 10, p<0.001). The times needed to correct the students decreased significantly (mean 22.7±6.3 seconds per image at day 1 to 8.9±1.2 seconds at day 10, p<0.001) and were substantially lower as annotated by the radiologists alone. In conclusion our data showed, that the involvement of undergraduated students into annotation of pediatric wrist radiographs enables a substantial time saving for specialists, therefore, it should be considered.

Acceptance of clinical artificial intelligence among physicians and medical students: A systematic review with cross-sectional survey

Background

Artificial intelligence (AI) needs to be accepted and understood by physicians and medical students, but few have systematically assessed their attitudes. We investigated clinical AI acceptance among physicians and medical students around the world to provide implementation guidance.

Materials and methods

We conducted a two-stage study, involving a foundational systematic review of physician and medical student acceptance of clinical AI. This enabled us to design a suitable web-based questionnaire which was then distributed among practitioners and trainees around the world.

Results

Sixty studies were included in this systematic review, and 758 respondents from 39 countries completed the online questionnaire. Five (62.50%) of eight studies reported 65% or higher awareness regarding the application of clinical AI. Although, only 10–30% had actually used AI and 26 (74.28%) of 35 studies suggested there was a lack of AI knowledge. Our questionnaire uncovered 38% awareness rate and 20% utility rate of clinical AI, although 53% lacked basic knowledge of clinical AI. Forty-five studies mentioned attitudes toward clinical AI, and over 60% from 38 (84.44%) studies were positive about AI, although they were also concerned about the potential for unpredictable, incorrect results. Seventy-seven percent were optimistic about the prospect of clinical AI. The support rate for the statement that AI could replace physicians ranged from 6 to 78% across 40 studies which mentioned this topic. Five studies recommended that efforts should be made to increase collaboration. Our questionnaire showed 68% disagreed that AI would become a surrogate physician, but believed it should assist in clinical decision-making. Participants with different identities, experience and from different countries hold similar but subtly different attitudes.

Conclusion

Most physicians and medical students appear aware of the increasing application of clinical AI, but lack practical experience and related knowledge. Overall, participants have positive but reserved attitudes about AI. In spite of the mixed opinions around clinical AI becoming a surrogate physician, there was a consensus that collaborations between the two should be strengthened. Further education should be conducted to alleviate anxieties associated with change and adopting new technologies.

Radiographers' knowledge, attitudes and expectations of artificial intelligence in medical imaging

INTRODUCTION

Artificial intelligence (AI) is increasingly utilised in medical imaging systems and processes, and radiographers must embrace this advancement. This study aimed to investigate perceptions, knowledge, and expectations towards integrating AI into medical imaging amongst a sample of radiographers and determine the current state of AI education within the community.

METHODS

A cross-sectional online quantitative study targeting radiographers based in Europe was conducted over ten weeks. Captured data included demographical information, participants' perceptions and understanding of AI, expectations of AI and AI-related educational backgrounds. Both descriptive and inferential statistical techniques were used to analyse the obtained data.

RESULTS

A total of 96 valid responses were collected. Of these, 64% correctly identified the true definition of AI from a range of options, but fewer (37%) fully understood the difference between AI, machine learning and deep learning. The majority of participants (83%) agreed they were excited about the advancement of AI, though a level of apprehensiveness remained amongst 29%. A severe lack of education on AI was noted, with only 8% of participants having received AI teachings in their pre-registration qualification.

CONCLUSION

Overall positive attitudes towards AI implementation were observed. The slight apprehension may stem from the lack of technical understanding of AI technologies and AI training within the community. Greater educational programs focusing on AI principles are required to help increase European radiography workforce engagement and involvement in AI technologies.

IMPLICATIONS FOR PRACTICE

This study offers insight into the current perspectives of European based radiographers on AI in radiography to help facilitate the embracement of AI technology and convey the need for AI-focused education within the profession.

Deep Learning-driven classification of external DICOM studies for PACS archiving

OBJECTIVES

Over the course of their treatment, patients often switch hospitals, requiring staff at the new hospital to import external imaging studies to their local database. In this study, the authors present MOdality Mapping and Orchestration (MOMO), a Deep Learning-based approach to automate this mapping process by combining metadata analysis and a neural network ensemble.

METHODS

A set of 11,934 imaging series with existing anatomical labels was retrieved from the PACS database of the local hospital to train an ensemble of neural networks (DenseNet-161 and ResNet-152), which process radiological images and predict the type of study they belong to. We developed an algorithm that automatically extracts relevant metadata from imaging studies, regardless of their structure, and combines it with the neural network ensemble, forming a powerful classifier. A set of 843 anonymized external studies from 321 hospitals was hand-labeled to assess performance. We tested several variations of this algorithm.

RESULTS

MOMO achieves 92.71% accuracy and 2.63% minor errors (at 99.29% predictive power) on the external study classification task, outperforming both a commercial product (82.86% accuracy, 1.36% minor errors, 96.20% predictive power) and a pure neural network ensemble (72.69% accuracy, 10.3% minor errors, 99.05% predictive power) performing the same task. We find that the highest performance is achieved by an algorithm that combines all information into one vote-based classifier.

CONCLUSION

Deep Learning combined with metadata matching is a promising and flexible approach for the automated classification of external DICOM studies for PACS archiving.

KEY POINTS

• The algorithm can successfully identify 76 medical study types across seven modalities (CT, X-ray angiography, radiographs, MRI, PET (+CT/MRI), ultrasound, and mammograms). • The algorithm outperforms a commercial product performing the same task by a significant margin (> 9% accuracy gain). • The performance of the algorithm increases through the application of Deep Learning techniques.

Promoting Research, Awareness, and Discussion on AI in Medicine Using #MedTwitterAI: A Longitudinal Twitter Hashtag Analysis

Background

Artificial intelligence (AI) has the potential to reshape medical practice and the delivery of healthcare. Online discussions surrounding AI's utility in these domains are increasingly emerging, likely due to considerable interest from healthcare practitioners, medical technology developers, and other relevant stakeholders. However, many practitioners and medical students report limited understanding and familiarity with AI.

Objective

To promote research, events, and resources at the intersection of AI and medicine for the online medical community, we created a Twitter-based campaign using the hashtag #MedTwitterAI.

Methods

In the present study, we analyze the use of #MedTwitterAI by tracking tweets containing this hashtag posted from 26th March, 2019 to 26th March, 2021, using the Symplur Signals hashtag analytics tool. The full text of all #MedTwitterAI tweets was also extracted and subjected to a natural language processing analysis.

Results

Over this time period, we identified 7,441 tweets containing #MedTwitterAI, posted by 1,519 unique Twitter users which generated 59,455,569 impressions. The most common identifiable locations for users including this hashtag in tweets were the United States (378/1,519), the United Kingdom (80/1,519), Canada (65/1,519), India (46/1,519), Spain (29/1,519), France (24/1,519), Italy (16/1,519), Australia (16/1,519), Germany (16/1,519), and Brazil (15/1,519). Tweets were frequently enhanced with links (80.2%), mentions of other accounts (93.9%), and photos (56.6%). The five most abundant single words were AI (artificial intelligence), patients, medicine, data, and learning. Sentiment analysis revealed an overall majority of positive single word sentiments (e.g., intelligence, improve) with 230 positive and 172 negative sentiments with a total of 658 and 342 mentions of all positive and negative sentiments, respectively. Most frequently mentioned negative sentiments were cancer, risk, and bias. Most common bigrams identified by Markov chain depiction were related to analytical methods (e.g., label-free detection) and medical conditions/biological processes (e.g., rare circulating tumor cells).

Conclusion

These results demonstrate the generated considerable interest of using #MedTwitterAI for promoting relevant content and engaging a broad and geographically diverse audience. The use of hashtags in Twitter-based campaigns can be an effective tool to raise awareness of interdisciplinary fields and enable knowledge-sharing on a global scale.

Current practical experience with artificial intelligence in clinical radiology: a survey of the European Society of Radiology

A survey among the members of European Society of Radiology (ESR) was conducted regarding the current practical clinical experience of radiologists with Artificial Intelligence (AI)-powered tools. 690 radiologists completed the survey. Among these were 276 radiologists from 229 institutions in 32 countries who had practical clinical experience with an AI-based algorithm and formed the basis of this study. The respondents with clinical AI experience included 143 radiologists (52%) from academic institutions, 102 radiologists (37%) from regional hospitals, and 31 radiologists (11%) from private practice. The use case scenarios of the AI algorithm were mainly related to diagnostic interpretation, image post-processing, and prioritisation of workflow. Technical difficulties with integration of AI-based tools into the workflow were experienced by only 49 respondents (17.8%). Of 185 radiologists who used AI-based algorithms for diagnostic purposes, 140 (75.7%) considered the results of the algorithms generally reliable. The use of a diagnostic algorithm was mentioned in the report by 64 respondents (34.6%) and disclosed to patients by 32 (17.3%). Only 42 (22.7%) experienced a significant reduction of their workload, whereas 129 (69.8%) found that there was no such effect. Of 111 respondents who used AI-based algorithms for clinical workflow prioritisation, 26 (23.4%) considered algorithms to be very helpful for reducing the workload of the medical staff whereas the others found them only moderately helpful (62.2%) or not helpful at all (14.4%). Only 92 (13.3%) of the total 690 respondents indicated that they had intentions to acquire AI tools. In summary, although the assistance of AI algorithms was found to be reliable for different use case scenarios, the majority of radiologists experienced no reduction of practical clinical workload.

An evaluation of information online on artificial intelligence in medical imaging

Background

Opinions seem somewhat divided when considering the effect of artificial intelligence (AI) on medical imaging. The aim of this study was to characterise viewpoints presented online relating to the impact of AI on the field of radiology and to assess who is engaging in this discourse.

Methods

Two search methods were used to identify online information relating to AI and radiology. Firstly, 34 terms were searched using Google and the first two pages of results for each term were evaluated. Secondly, a Rich Search Site (RSS) feed evaluated incidental information over 3 weeks. Webpages were evaluated and categorized as having a positive, negative, balanced, or neutral viewpoint based on study criteria.

Results

Of the 680 webpages identified using the Google search engine, 248 were deemed relevant and accessible. 43.2% had a positive viewpoint, 38.3% a balanced viewpoint, 15.3% a neutral viewpoint, and 3.2% a negative viewpoint. Peer-reviewed journals represented the most common webpage source (48%), followed by media (29%), commercial sources (12%), and educational sources (8%). Commercial webpages had the highest proportion of positive viewpoints (66%). Radiologists were identified as the most common author group (38.9%). The RSS feed identified 177 posts of which were relevant and accessible. 86% of posts were of media origin expressing positive viewpoints (64%).

Conclusion

The overall opinion of the impact of AI on radiology presented online is a positive one. Consistency across a range of sources and author groups exists. Radiologists were significant contributors to this online discussion and the results may impact future recruitment.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13244-022-01209-4.

Comment on Patel, B.; Makaryus, A.N. Artificial Intelligence Advances in the World of Cardiovascular Imaging. Healthcare 2022, 10, 154

Regarding Dr. Makaryus's interesting review study [...].

Physicians’ preferences and willingness to pay for artificial intelligence-based assistance tools: a discrete choice experiment among german radiologists

Background

Artificial Intelligence (AI)-based assistance tools have the potential to improve the quality of healthcare when adopted by providers. This work attempts to elicit preferences and willingness to pay for these tools among German radiologists. The goal was to generate insights for tool providers and policymakers regarding the development and funding of ideally designed and priced tools. Ultimately, healthcare systems can only benefit from quality enhancing AI when provider adoption is considered.

Methods

Since there is no established market for AI-based assistance tools in radiology yet, a discrete choice experiment was conducted. Respondents from the two major German professional radiology associations chose between hypothetical tools composed of five attributes and a no-choice option. The attributes included: provider, application, quality impact, time savings and price. A conditional logit model was estimated identifying preferences for attribute levels, the no-choice option, and significant subject-related interaction effects.

Results

114 respondents were included for analysis of which 46% were already using an AI-based assistance tool. Average adoption probability for an AI-based tool was 81% (95% CI 77.1% − 84.4%). Radiologists preferred a tool that assists in routine diagnostics performing at above-radiologist-level quality and saves 50% in diagnostics time at a price-point of €3 per study. The provider is not a significant factor in the decisions. Time savings were considered more important than quality improvements (i.e., detecting more anomalies).

Conclusions

Radiologists are overall willing to invest in AI-based assistance tools. Development, funding, and research regarding these tools should, however, consider providers’ preferences for features of immediate everyday and economic relevance like time savings to optimize adoption.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-07769-x.

The Artificial Intelligence in Digital Radiology: Part 1: The Challenges, Acceptance and Consensus

Artificial intelligence is having important developments in the world of digital radiology also thanks to the boost given to the research sector by the COVID-19 pandemic. In the last two years, there was an important development of studies focused on both challenges and acceptance and consensus in the field of Artificial Intelligence. The challenges and acceptance and consensus are two strategic aspects in the development and integration of technologies in the health domain. The study conducted two narrative reviews by means of two parallel points of view to take stock both on the ongoing challenges and on initiatives conducted to face the acceptance and consensus in this area. The methodology of the review was based on: (I) search of PubMed and Scopus and (II) an eligibility assessment, using parameters with 5 levels of score. The results have: (a) highlighted and categorized the important challenges in place. (b) Illustrated the different types of studies conducted through original questionnaires. The study suggests for future research based on questionnaires a better calibration and inclusion of the challenges in place together with validation and administration paths at an international level.

The current state of knowledge on imaging informatics: a survey among Spanish radiologists

Background

There is growing concern about the impact of artificial intelligence (AI) on radiology and the future of the profession. The aim of this study is to evaluate general knowledge and concerns about trends on imaging informatics among radiologists working in Spain (residents and attending physicians). For this purpose, an online survey among radiologists working in Spain was conducted with questions related to: knowledge about terminology and technologies, need for a regulated academic training on AI and concerns about the implications of the use of these technologies.

Results

A total of 223 radiologists answered the survey, of whom 76.7% were attending physicians and 23.3% residents. General terms such as AI and algorithm had been heard of or read in at least 75.8% and 57.4% of the cases, respectively, while more specific terms were scarcely known. All the respondents consider that they should pursue academic training in medical informatics and new technologies, and 92.9% of them reckon this preparation should be incorporated in the training program of the specialty. Patient safety was found to be the main concern for 54.2% of the respondents. Job loss was not seen as a peril by 45.7% of the participants.

Conclusions

Although there is a lack of knowledge about AI among Spanish radiologists, there is a will to explore such topics and a general belief that radiologists should be trained in these matters. Based on the results, a consensus is needed to change the current training curriculum to better prepare future radiologists.

Stakeholders' perspectives on the future of artificial intelligence in radiology: a scoping review

OBJECTIVES

Artificial intelligence (AI) has the potential to impact clinical practice and healthcare delivery. AI is of particular significance in radiology due to its use in automatic analysis of image characteristics. This scoping review examines stakeholder perspectives on AI use in radiology, the benefits, risks, and challenges to its integration.

METHODS

A search was conducted from 1960 to November 2019 in EMBASE, PubMed/MEDLINE, Web of Science, Cochrane Library, CINAHL, and grey literature. Publications reflecting stakeholder attitudes toward AI were included with no restrictions.

RESULTS

Commentaries (n = 32), surveys (n = 13), presentation abstracts (n = 8), narrative reviews (n = 8), and a social media study (n = 1) were included from 62 eligible publications. These represent the views of radiologists, surgeons, medical students, patients, computer scientists, and the general public. Seven themes were identified (predicted impact, potential replacement, trust in AI, knowledge of AI, education, economic considerations, and medicolegal implications). Stakeholders anticipate a significant impact on radiology, though replacement of radiologists is unlikely in the near future. Knowledge of AI is limited for non-computer scientists and further education is desired. Many expressed the need for collaboration between radiologists and AI specialists to successfully improve patient care.

CONCLUSIONS

Stakeholder views generally suggest that AI can improve the practice of radiology and consider the replacement of radiologists unlikely. Most stakeholders identified the need for education and training on AI, as well as collaborative efforts to improve AI implementation. Further research is needed to gain perspectives from non-Western countries, non-radiologist stakeholders, on economic considerations, and medicolegal implications.

KEY POINTS

Stakeholders generally expressed that AI alone cannot be used to replace radiologists. The scope of practice is expected to shift with AI use affecting areas from image interpretation to patient care. Patients and the general public do not know how to address potential errors made by AI systems while radiologists believe that they should be "in-the-loop" in terms of responsibility. Ethical accountability strategies must be developed across governance levels. Students, residents, and radiologists believe that there is a lack in AI education during medical school and residency. The radiology community should work with IT specialists to ensure that AI technology benefits their work and centres patients.

The Artificial Intelligence in Digital Radiology: Part 2: Towards an Investigation of acceptance and consensus on the Insiders

Background. The study deals with the introduction of the artificial intelligence in digital radiology. There is a growing interest in this area of scientific research in acceptance and consensus studies involving both insiders and the public, based on surveys focused mainly on single professionals. Purpose. The goal of the study is to perform a contemporary investigation on the acceptance and the consensus of the three key professional figures approaching in this field of application: (1) Medical specialists in image diagnostics: the medical specialists (MS)s; (2) experts in physical imaging processes: the medical physicists (MP)s; (3) AI designers: specialists of applied sciences (SAS)s. Methods. Participants (MSs = 92: 48 males/44 females, averaged age 37.9; MPs = 91: 43 males/48 females, averaged age 36.1; SAS = 90: 47 males/43 females, averaged age 37.3) were properly recruited based on specific training. An electronic survey was designed and submitted to the participants with a wide range questions starting from the training and background up to the different applications of the AI and the environment of application. Results. The results show that generally, the three professionals show (a) a high degree of encouraging agreement on the introduction of AI both in imaging and in non-imaging applications using both standalone applications and/or mHealth/eHealth, and (b) a different consent on AI use depending on the training background. Conclusions. The study highlights the usefulness of focusing on both the three key professionals and the usefulness of the investigation schemes facing a wide range of issues. The study also suggests the importance of different methods of administration to improve the adhesion and the need to continue these investigations both with federated and specific initiatives.

Information Security in Medical Robotics: A Survey on the Level of Training, Awareness and Use of the Physiotherapist

Cybersecurity is becoming an increasingly important aspect to investigate for the adoption and use of care robots, in term of both patients' safety, and the availability, integrity and privacy of their data. This study focuses on opinions about cybersecurity relevance and related skills for physiotherapists involved in rehabilitation and assistance thanks to the aid of robotics. The goal was to investigate the awareness among insiders about some facets of cybersecurity concerning human-robot interactions. We designed an electronic questionnaire and submitted it to a relevant sample of physiotherapists. The questionnaire allowed us to collect data related to: (i) use of robots and its relationship with cybersecurity in the context of physiotherapy; (ii) training in cybersecurity and robotics for the insiders; (iii) insiders' self-assessment on cybersecurity and robotics in some usage scenarios, and (iv) their experiences of cyber-attacks in this area and proposals for improvement. Besides contributing some specific statistics, the study highlights the importance of both acculturation processes in this field and monitoring initiatives based on surveys. The study exposes direct suggestions for continuation of these types of investigations in the context of scientific societies operating in the rehabilitation and assistance robotics. The study also shows the need to stimulate similar initiatives in other sectors of medical robotics (robotic surgery, care and socially assistive robots, rehabilitation systems, training for health and care workers) involving insiders.