Causability and explainability of artificial intelligence in medicine

The Potential of Artificial Intelligence Tools for Reducing Uncertainty in Medicine and Directions for Medical Education

Unlabelled

In the field of medicine, uncertainty is inherent. Physicians are asked to make decisions on a daily basis without complete certainty, whether it is in understanding the patient's problem, performing the physical examination, interpreting the findings of diagnostic tests, or proposing a management plan. The reasons for this uncertainty are widespread, including the lack of knowledge about the patient, individual physician limitations, and the limited predictive power of objective diagnostic tools. This uncertainty poses significant problems in providing competent patient care. Research efforts and teaching are attempts to reduce uncertainty that have now become inherent to medicine. Despite this, uncertainty is rampant. Artificial intelligence (AI) tools, which are being rapidly developed and integrated into practice, may change the way we navigate uncertainty. In their strongest forms, AI tools may have the ability to improve data collection on diseases, patient beliefs, values, and preferences, thereby allowing more time for physician-patient communication. By using methods not previously considered, these tools hold the potential to reduce the uncertainty in medicine, such as those arising due to the lack of clinical information and provider skill and bias. Despite this possibility, there has been considerable resistance to the implementation of AI tools in medical practice. In this viewpoint article, we discuss the impact of AI on medical uncertainty and discuss practical approaches to teaching the use of AI tools in medical schools and residency training programs, including AI ethics, real-world skills, and technological aptitude.

Disentangled Explanations of Neural Network Predictions by Finding Relevant Subspaces

Explainable AI aims to overcome the black-box nature of complex ML models like neural networks by generating explanations for their predictions. Explanations often take the form of a heatmap identifying input features (e.g. pixels) that are relevant to the model's decision. These explanations, however, entangle the potentially multiple factors that enter into the overall complex decision strategy. We propose to disentangle explanations by extracting at some intermediate layer of a neural network, subspaces that capture the multiple and distinct activation patterns (e.g. visual concepts) that are relevant to the prediction. To automatically extract these subspaces, we propose two new analyses, extending principles found in PCA or ICA to explanations. These novel analyses, which we call principal relevant component analysis (PRCA) and disentangled relevant subspace analysis (DRSA), maximize relevance instead of e.g. variance or kurtosis. This allows for a much stronger focus of the analysis on what the ML model actually uses for predicting, ignoring activations or concepts to which the model is invariant. Our approach is general enough to work alongside common attribution techniques such as Shapley Value, Integrated Gradients, or LRP. Our proposed methods show to be practically useful and compare favorably to the state of the art as demonstrated on benchmarks and three use cases.

New Paradigms in the Clinical Management of Li-Fraumeni Syndrome

Approximately 8.5%-16.2% of childhood cancers are associated with a pathogenic/likely pathogenic germline variant-a prevalence that is likely to rise with improvements in phenotype recognition, sequencing, and variant validation. One highly informative, classical hereditary cancer predisposition syndrome is Li-Fraumeni syndrome (LFS), associated with germline variants in the TP53 tumor suppressor gene, and a >90% cumulative lifetime cancer risk. In seeking to improve outcomes for young LFS patients, we must improve the specificity and sensitivity of existing cancer surveillance programs and explore how to complement early detection strategies with pharmacology-based risk-reduction interventions. Here, we describe novel precision screening technologies and clinical strategies for cancer risk reduction. In particular, we summarize the biomarkers for early diagnosis and risk stratification of LFS patients from birth, noninvasive and machine learning-based cancer screening, and drugs that have shown the potential to be repurposed for cancer prevention.

Exploring home healthcare clinicians' needs for using clinical decision support systems for early risk warning

OBJECTIVES

To explore home healthcare (HHC) clinicians' needs for Clinical Decision Support Systems (CDSS) information delivery for early risk warning within HHC workflows.

METHODS

Guided by the CDS "Five-Rights" framework, we conducted semi-structured interviews with multidisciplinary HHC clinicians from April 2023 to August 2023. We used deductive and inductive content analysis to investigate informants' responses regarding CDSS information delivery.

RESULTS

Interviews with thirteen HHC clinicians yielded 16 codes mapping to the CDS "Five-Rights" framework (right information, right person, right format, right channel, right time) and 11 codes for unintended consequences and training needs. Clinicians favored risk levels displayed in color-coded horizontal bars, concrete risk indicators in bullet points, and actionable instructions in the existing EHR system. They preferred non-intrusive risk alerts requiring mandatory confirmation. Clinicians anticipated risk information updates aligned with patient's condition severity and their visit pace. Additionally, they requested training to understand the CDSS's underlying logic, and raised concerns about information accuracy and data privacy.

DISCUSSION

While recognizing CDSS's value in enhancing early risk warning, clinicians highlighted concerns about increased workload, alert fatigue, and CDSS misuse. The top risk factors identified by machine learning algorithms, especially text features, can be ambiguous due to a lack of context. Future research should ensure that CDSS outputs align with clinical evidence and are explainable.

CONCLUSION

This study identified HHC clinicians' expectations, preferences, adaptations, and unintended uses of CDSS for early risk warning. Our findings endorse operationalizing the CDS "Five-Rights" framework to optimize CDSS information delivery and integration into HHC workflows.

Causality and scientific explanation of artificial intelligence systems in biomedicine

With rapid advances of deep neural networks over the past decade, artificial intelligence (AI) systems are now commonplace in many applications in biomedicine. These systems often achieve high predictive accuracy in clinical studies, and increasingly in clinical practice. Yet, despite their commonly high predictive accuracy, the trustworthiness of AI systems needs to be questioned when it comes to decision-making that affects the well-being of patients or the fairness towards patients or other stakeholders affected by AI-based decisions. To address this, the field of explainable artificial intelligence, or XAI for short, has emerged, seeking to provide means by which AI-based decisions can be explained to experts, users, or other stakeholders. While it is commonly claimed that explanations of artificial intelligence (AI) establish the trustworthiness of AI-based decisions, it remains unclear what traits of explanations cause them to foster trustworthiness. Building on historical cases of scientific explanation in medicine, we here propagate our perspective that, in order to foster trustworthiness, explanations in biomedical AI should meet the criteria of being scientific explanations. To further undermine our approach, we discuss its relation to the concepts of causality and randomized intervention. In our perspective, we combine aspects from the three disciplines of biomedicine, machine learning, and philosophy. From this interdisciplinary angle, we shed light on how the explanation and trustworthiness of artificial intelligence relate to the concepts of causality and robustness. To connect our perspective with AI research practice, we review recent cases of AI-based studies in pathology and, finally, provide guidelines on how to connect AI in biomedicine with scientific explanation.

Student Pharmacists' Perceptions of Artificial Intelligence and Machine Learning in Pharmacy Practice and Pharmacy Education

OBJECTIVE

This study explored student pharmacists' perceptions and attitudes regarding artificial intelligence (AI) and machine learning (ML) in pharmacy practice. Due to AI/ML's promising prospects, understanding students' current awareness, comprehension, and hopes for their use in this field is essential.

METHODS

In April 2024, a Zoom focus group discussion was conducted with 6 student pharmacists using a self-developed interview guide. The guide included questions about the benefits, challenges, and ethical considerations of implementing AI/ML in pharmacy practice and education. The participants' demographic information was collected through a questionnaire. The research team conducted a thematic analysis of the discussion transcript. The results generated by a team member using NVivo were compared with those generated by ChatGPT, and all discrepancies were addressed.

RESULTS

Student pharmacists displayed a generally positive attitude toward the implementation of AI/ML in pharmacy practice but lacked knowledge about AI/ML applications. Participants recognized several advantages of AI/ML implementation in pharmacy practice, including improved accuracy and time-saving for pharmacists. Some identified challenges were alert fatigue, AI/ML-generated errors, and the potential obstacle to person-centered care. The study participants expressed their interest in learning about AI/ML and their desire to integrate these technologies into pharmacy education.

CONCLUSION

The demand for integrating AI/ML into pharmacy practice is increasing. Student and professional pharmacists need additional AI/ML training to equip them with knowledge and practical skills. Collaboration between pharmacists, institutions, and AI/ML companies is essential to address barriers and advance AI/ML implementation in the pharmacy field.

Progress Achieved, Landmarks, and Future Concerns in Biomedical and Health Informatics

BACKGROUND

The biomedical and health informatics (BMHI) fields have been advancing rapidly, a trend particularly emphasised during the recent COVID-19 pandemic, introducing innovations in BMHI. Over nearly 50 years since its establishment as a scientific discipline, BMHI has encountered several challenges, such as mishaps, delays, failures, and moments of enthusiastic expectations and notable successes. This paper focuses on reviewing the progress made in the BMHI discipline, evaluating key milestones, and discussing future challenges.

METHODS

To, Structured, step-by-step qualitative methodology was developed and applied, centred on gathering expert opinions and analysing trends from the literature to provide a comprehensive assessment. Experts and pioneers in the BMHI field were assigned thematic tasks based on the research question, providing critical inputs for the thematic analysis. This led to the identification of five key dimensions used to present the findings in the paper: informatics in biomedicine and healthcare, health data in Informatics, nurses in informatics, education and accreditation in health informatics, and ethical, legal, social, and security issues.

RESULTS

Each dimension is examined through recently emerging innovations, linking them directly to the future of healthcare, like the role of artificial intelligence, innovative digital health tools, the expansion of telemedicine, and the use of mobile health apps and wearable devices. The new approach of BMHI covers newly introduced clinical needs and approaches like patient-centric, remote monitoring, and precision medicine clinical approaches.

CONCLUSIONS

These insights offer clear recommendations for improving education and developing experts to advance future innovations. Notably, this narrative review presents a body of knowledge essential for a deep understanding of the BMHI field from a human-centric perspective and, as such, could serve as a reference point for prospective analysis and innovation development.

AI Algorithms for Modeling the Risk, Progression, and Treatment of Sepsis, Including Early-Onset Sepsis-A Systematic Review

Sepsis remains a significant contributor to neonatal mortality worldwide. However, the nonspecific nature of sepsis symptoms in neonates often leads to the necessity of empirical treatment, placing a burden of ineffective treatment on patients. Furthermore, the global challenge of antimicrobial resistance is exacerbating the situation. Artificial intelligence (AI) is transforming medical practice and in hospital settings. AI shows great potential for assessing sepsis risk and devising optimal treatment strategies. Background/Objectives: This review aims to investigate the application of AI in the detection and management of neonatal sepsis. Methods: A systematic literature review (SLR) evaluating AI methods in modeling and classifying sepsis between 1 January 2014, and 1 January 2024, was conducted. PubMed, Scopus, Cochrane, and Web of Science were systematically searched for English-language studies focusing on neonatal sepsis. Results: The analyzed studies predominantly utilized retrospective electronic medical record (EMR) data to develop, validate, and test AI models to predict sepsis occurrence and relevant parameters. Key predictors included low gestational age, low birth weight, high results of C-reactive protein and white blood cell counts, and tachycardia and respiratory failure. Machine learning models such as logistic regression, random forest, K-nearest neighbor (KNN), support vector machine (SVM), and XGBoost demonstrated effectiveness in this context. Conclusions: The summarized results of this review highlight the great promise of AI as a clinical decision support system for diagnostics, risk assessment, and personalized therapy selection in managing neonatal sepsis.

Toward Explainable Affective Computing: A Review

Affective computing has an unprecedented potential to change the way humans interact with technology. While the last decades have witnessed vast progress in the field, multimodal affective computing systems are generally black box by design. As affective systems start to be deployed in real-world scenarios, such as education or healthcare, a shift of focus toward improved transparency and interpretability is needed. In this context, how do we explain the output of affective computing models? and how to do so without limiting predictive performance? In this article, we review affective computing work from an explainable AI (XAI) perspective, collecting and synthesizing relevant papers into three major XAI approaches: premodel (applied before training), in-model (applied during training), and postmodel (applied after training). We present and discuss the most fundamental challenges in the field, namely, how to relate explanations back to multimodal and time-dependent data, how to integrate context and inductive biases into explanations using mechanisms such as attention, generative modeling, or graph-based methods, and how to capture intramodal and cross-modal interactions in post hoc explanations. While explainable affective computing is still nascent, existing methods are promising, contributing not only toward improved transparency but, in many cases, surpassing state-of-the-art results. Based on these findings, we explore directions for future research and discuss the importance of data-driven XAI and explanation goals, and explainee needs definition, as well as causability or the extent to which a given method leads to human understanding.

Artificial Intelligence in Otolaryngology: Topics in Epistemology & Ethics

To fuel artificial intelligence (AI) potential in clinical practice in otolaryngology, researchers must understand its epistemic limitations, which are tightly linked to ethical dilemmas requiring careful consideration. AI tools are fundamentally opaque systems, though there are methods to increase explainability and transparency. Reproducibility and replicability limitations can be overcomed by sharing computing code, raw data, and data processing methodology. The risk of bias can be mitigated via algorithmic auditing, careful consideration of the training data, and advocating for a diverse AI workforce to promote algorithmic pluralism, reflecting our population's diverse values and preferences.

Twenty years of in vitro nanotoxicology: how AI could make the difference

More than two decades ago, the advent of Nanotechnology has marked the onset of a new and critical field in science and technology, highlighting the importance of multidisciplinary approaches to assess and model the potential human hazard of newly developed advanced materials in the nanoscale, the nanomaterials (NMs). Nanotechnology is, by definition, a multidisciplinary field, that integrates knowledge and techniques from physics, chemistry, biology, materials science, and engineering to manipulate matter at the nanoscale, defined as anything comprised between 1 and 100 nm. The emergence of nanotechnology has undoubtedly led to significant innovations in many fields, from medical diagnostics and targeted drug delivery systems to advanced materials and energy solutions. However, the unique properties of nanomaterials, such as the increased surface to volume ratio, which provides increased reactivity and hence the ability to penetrate biological barriers, have been also considered as potential risk factors for unforeseen toxicological effects, stimulating the scientific community to investigate to which extent this new field of applications could pose a risk to human health and the environment.

Evaluating the performance of herd-specific Long Short-Term Memory models to identify automated health alerts associated with a ketosis diagnosis in early lactation cows

The growing use of automated systems in the dairy industry generates a vast amount of cow-level data daily, creating opportunities for using these data to support real-time decision-making. Currently, various commercial systems offer built-in alert algorithms to identify cows requiring attention. To our knowledge, no work has been done to compare the use of models accounting for herd-level variability on their predictive ability against automated systems. Long Short-Term Memory (LSTM) models are machine learning models capable of learning temporal patterns and making predictions based on time series data. The objective of our study was to evaluate the ability of LSTM models to identify a health alert associated with a ketosis diagnosis (HAK) using deviations of daily milk yield, milk FPR, number of successful milkings, rumination time, and activity index from the herd median by parity and DIM, considering various time series lengths and numbers of d before HAK. Additionally, we aimed to use Explainable Artificial Intelligence method to understand the relationships between input variables and model outputs. Data on daily milk yield, milk fat-to-protein ratio (FPR), number of successful milkings, rumination time, activity, and health events during 0 to 21 d in milk (DIM) were retrospectively obtained from a commercial Holstein dairy farm in northern Indiana from February 2020 to January 2023. A total of 1,743 cows were included in the analysis (non-HAK = 1,550; HAK = 193). Variables were transformed based on deviations from the herd median by parity and DIM. Six LSTM models were developed to identify HAK 1, 2, and 3 d before farm diagnosis using historic cow-level data with varying time series lengths. Model performance was assessed using repeated stratified 10-fold cross-validation for 20 repeats. The Shapley additive explanations framework (SHAP) was used for model explanation. Model accuracy was 83, 74, and 70%, balanced error rate was 17 to 18, 26 to 28, and 34%, sensitivity was 81 to 83, 71 to 74, and 62%, specificity was 83, 74, and 71%, positive predictive value was 38, 25 to 27, and 21%, negative predictive value was 97 to 98, 95 to 96, and 94%, and area under the curve was 0.89 to 0.90, 0.80 to 0.81, and 0.72 for models identifying HAK 1, 2, and 3 d before diagnosis, respectively. Performance declined as the time interval between identification and farm diagnosis increased, and extending the time series length did not improve model performance. Model explanation revealed that cows with lower milk yield, number of successful milkings, rumination time, and activity, and higher milk FPR compared with herdmates of the same parity and DIM were more likely to be classified as HAK. Our results demonstrate the potential of LSTM models in identifying HAK using deviations of daily milk production variables, rumination time, and activity index from the herd median by parity and DIM. Future studies are needed to evaluate the performance of health alerts using LSTM models controlling for herd-specific metrics against commercial built-in algorithms in multiple farms and for other disorders.

Review of machine learning solutions for eating disorders

BACKGROUND

Eating Disorders (EDs) are one of the most complex psychiatric disorders, with significant impairment of psychological and physical health, and psychosocial functioning, and are associated with low rates of early detection, low recovery and high relapse rates. This underscores the need for better diagnostic and treatment methods.

OBJECTIVE

This narrative review explores current Machine Learning (ML) and Artificial Intelligence (AI) applications in the domain of EDs, with a specific emphasis on clinical management in treatment settings. The primary objective are to (i) decrease the knowledge gap between ED researchers and AI-practitioners, by presenting the current state-of-the-art AI applications (including models for causality) in different ED use-cases; (ii) identify limitations of these existing AI interventions and how to address them.

RESULTS

AI/ML methods have been applied in different ED use-cases, including ED risk factor identification and incidence prediction (including the analysis of social media content in the general population), diagnosis, monitoring patients and treatment response and prognosis in clinical populations. A comparative analysis of AI-techniques deployed in these use-cases have been performed, considering factors such as complexity, flexibility, functionality, explainability and adaptability to healthcare constraints.

CONCLUSION

Multiple restrictions have been identified in the existing methods in ML and Causality in terms of achieving actionable healthcare for ED, like lack of good quality and quantity of data for models to train on, while requiring models to be flexible, high-performing, yet being explainable and producing counterfactual explanations, for ensuring the fairness and trustworthiness of its decisions. We conclude that to overcome these limitations and for future AI research and application in clinical management of ED, (i) careful considerations are required with regards to AI-model selection, and (ii) joint efforts from ED researcher and patient community are essential in building better quality and quantity of dedicated ED datasets and secure AI-solution framework.

Preliminary experiments on interpretable ChatGPT-assisted diagnosis for breast ultrasound radiologists

Background

Ultrasound is essential for detecting breast lesions. The American College of Radiology's Breast Imaging Reporting and Data System (BI-RADS) classification system is widely used, but its subjectivity can lead to inconsistency in diagnostic outcomes. Artificial intelligence (AI) models, such as ChatGPT-3.5, may potentially enhance diagnostic accuracy and efficiency in medical settings. This study aimed to assess the utility of the ChatGPT-3.5 model in generating BI-RADS classifications for breast ultrasound reports and its ability to replicate the "chain of thought" (CoT) in clinical decision-making to improve model interpretability.

Methods

Breast ultrasound reports were collected, and ChatGPT-3.5 was used to generate diagnoses and treatment plans. We evaluated GPT-4's performance by comparing its generated reports to those from doctors with various levels of experience. We also conducted a Turing test and a consistency analysis. To enhance the interpretability of the model, we applied the CoT method to deconstruct the decision-making chain of the GPT model.

Results

A total of 131 patients were evaluated, with 57 doctors participating in the experiment. ChatGPT-3.5 showed promising performance in structure and organization (S&O), professional terminology and expression (PTE), treatment recommendations (TR), and clarity and comprehensibility (C&C). However, improvements are needed in BI-RADS classification, malignancy diagnosis (MD), likelihood of being written by a physician (LWBP), and ultrasound doctor artificial intelligence acceptance (UDAIA). Turing test results indicated that AI-generated reports convincingly resembled human-authored reports. Reproducibility experiments displayed consistent performance. Erroneous report analysis revealed issues related to incorrect diagnosis, inconsistencies, and overdiagnosis. The CoT investigation supports the potential of ChatGPT to replicate the clinical decision-making process and offers insights into AI interpretability.

Conclusions

The ChatGPT-3.5 model holds potential as a valuable tool for assisting in the efficient determination of BI-RADS classifications and enhancing diagnostic performance.

Gaps in the Global Regulatory Frameworks for the Use of Artificial Intelligence (AI) in the Healthcare Services Sector and Key Recommendations

Artificial Intelligence (AI) has shown remarkable potential to revolutionise healthcare by enhancing diagnostics, improving treatment outcomes, and streamlining administrative processes. In the global regulatory landscape, several countries are working on regulating AI in healthcare. There are five key regulatory issues that need to be addressed: (i) data security and protection-measures to cover the "digital health footprints" left unknowingly by patients when they access AI in health services; (ii) data quality-availability of safe and secure data and more open database sources for AI, algorithms, and datasets to ensure equity and prevent demographic bias; (iii) validation of algorithms-mapping of the explainability and causability of the AI system; (iv) accountability-whether this lies with the healthcare professional, healthcare organisation, or the personified AI algorithm; (v) ethics and equitable access-whether fundamental rights of people are met in an ethical manner. Policymakers may need to consider the entire life cycle of AI in healthcare services and the databases that were used for the training of the AI system, along with requirements for their risk assessments to be publicly accessible for effective regulatory oversight. AI services that enhance their functionality over time need to undergo repeated algorithmic impact assessment and must also demonstrate real-time performance. Harmonising regulatory frameworks at the international level would help to resolve cross-border issues of AI in healthcare services.

Barriers to and Facilitators of Artificial Intelligence Adoption in Health Care: Scoping Review

BACKGROUND

Artificial intelligence (AI) use cases in health care are on the rise, with the potential to improve operational efficiency and care outcomes. However, the translation of AI into practical, everyday use has been limited, as its effectiveness relies on successful implementation and adoption by clinicians, patients, and other health care stakeholders.

OBJECTIVE

As adoption is a key factor in the successful proliferation of an innovation, this scoping review aimed at presenting an overview of the barriers to and facilitators of AI adoption in health care.

METHODS

A scoping review was conducted using the guidance provided by the Joanna Briggs Institute and the framework proposed by Arksey and O'Malley. MEDLINE, IEEE Xplore, and ScienceDirect databases were searched to identify publications in English that reported on the barriers to or facilitators of AI adoption in health care. This review focused on articles published between January 2011 and December 2023. The review did not have any limitations regarding the health care setting (hospital or community) or the population (patients, clinicians, physicians, or health care administrators). A thematic analysis was conducted on the selected articles to map factors associated with the barriers to and facilitators of AI adoption in health care.

RESULTS

A total of 2514 articles were identified in the initial search. After title and abstract reviews, 50 (1.99%) articles were included in the final analysis. These articles were reviewed for the barriers to and facilitators of AI adoption in health care. Most articles were empirical studies, literature reviews, reports, and thought articles. Approximately 18 categories of barriers and facilitators were identified. These were organized sequentially to provide considerations for AI development, implementation, and the overall structure needed to facilitate adoption.

CONCLUSIONS

The literature review revealed that trust is a significant catalyst of adoption, and it was found to be impacted by several barriers identified in this review. A governance structure can be a key facilitator, among others, in ensuring all the elements identified as barriers are addressed appropriately. The findings demonstrate that the implementation of AI in health care is still, in many ways, dependent on the establishment of regulatory and legal frameworks. Further research into a combination of governance and implementation frameworks, models, or theories to enhance trust that would specifically enable adoption is needed to provide the necessary guidance to those translating AI research into practice. Future research could also be expanded to include attempts at understanding patients' perspectives on complex, high-risk AI use cases and how the use of AI applications affects clinical practice and patient care, including sociotechnical considerations, as more algorithms are implemented in actual clinical environments.

Evaluating artificial intelligence's role in lung nodule diagnostics: A survey of radiologists in two pilot tertiary hospitals in China

Objectives

This study assesses the perceptions and attitudes of Chinese radiologists concerning the application of artificial intelligence (AI) in the diagnosis of lung nodules.

Material and Methods

An anonymous questionnaire, consisting of 26 questions addressing the usability of AI systems and comprehensive evaluation of AI technology, was distributed to all radiologists affiliated with Beijing Anzhen Hospital and Beijing Tsinghua Changgung Hospital. The data collection was conducted between July 19, and 21, 2023.

Results

Of the 90 respondents, the majority favored the AI system's convenience and usability, reflected in "good" system usability scale (SUS) scores (Mean ± standard deviation [SD]: 74.3 ± 11.9). General usability was similarly well-received (Mean ± SD: 76.0 ± 11.5), while learnability was rated as "acceptable" (Mean ± SD: 67.5 ± 26.4). Most radiologists noted increased work efficiency (Mean Likert scale score: 4.6 ± 0.6) and diagnostic accuracy (Mean Likert scale score: 4.2 ± 0.8) with the AI system. Views on AI's future impact on radiology careers varied (Mean ± SD: 3.2 ± 1.4), with a consensus that AI is unlikely to replace radiologists entirely in the foreseeable future (Mean ± SD: 2.5 ± 1.1).

Conclusion

Radiologists at two leading Beijing hospitals generally perceive the AI-assisted lung nodule diagnostic system positively, citing its user-friendliness and effectiveness. However, the system's learnability requires enhancement. While AI is seen as beneficial for work efficiency and diagnostic accuracy, its long-term career implications remain a topic of debate.

Artificial Intelligence in Pediatric Liver Transplantation: Opportunities and Challenges of a New Era

Historically, pediatric liver transplantation has achieved significant milestones, yet recent innovations have predominantly occurred in adult liver transplantation due to higher caseloads and ethical barriers in pediatric studies. Emerging methods subsumed under the term artificial intelligence offer the potential to revolutionize data analysis in pediatric liver transplantation by handling complex datasets without the need for interventional studies, making them particularly suitable for pediatric research. This review provides an overview of artificial intelligence applications in pediatric liver transplantation. Despite some promising early results, artificial intelligence is still in its infancy in the field of pediatric liver transplantation, and its clinical implementation faces several challenges. These include the need for high-quality, large-scale data and ensuring the interpretability and transparency of machine and deep learning models. Ethical considerations, such as data privacy and the potential for bias, must also be addressed. Future directions for artificial intelligence in pediatric liver transplantation include improving donor-recipient matching, managing long-term complications, and integrating diverse data sources to enhance predictive accuracy. Moreover, multicenter collaborations and prospective studies are essential for validating artificial intelligence models and ensuring their generalizability. If successfully integrated, artificial intelligence could lead to substantial improvements in patient outcomes, bringing pediatric liver transplantation again to the forefront of innovation in the transplantation community.

Converging deep learning and human-observed tumor-adipocyte interaction as a biomarker in colorectal cancer

BACKGROUND

Tumor-Adipose-Feature (TAF) as well as SARIFA (Stroma AReactive Invasion Front Areas) are two histologic features/biomarkers linking tumor-associated adipocytes to poor outcomes in colorectal cancer (CRC) patients. Whereas TAF was identified by deep learning (DL) algorithms, SARIFA was established as a human-observed histopathologic biomarker.

METHODS

To study the overlap between TAF and SARIFA, we performed a systematic pathological review of TAF based on all published image tiles. Additionally, we analyzed the presence/absence of TAF in SARIFA-negative CRC cases to elucidate the biologic and prognostic role of a direct tumor-adipocyte contact. TCGA-CRC gene expression data is investigated to assess the association of FABP4 (fatty-acid binding protein 4) and CD36 (fatty-acid translocase) with both TAF and CRC prognosis.

RESULTS

By investigating the TAF/SARIFA overlap, we show that many TAF patches correspond to the recently described SARIFA-phenomenon. Even though there is a pronounced morphological and biological overlap, there are differences in the concepts. The presence of TAF in SARIFA-negative CRCs is not associated with poor outcomes in this cohort, potentially highlighting the importance of a direct tumor-adipocyte interaction. Upregulation of FABP4 and CD36 gene expression seem both linked to a poor prognosis in CRC.

CONCLUSIONS

By proving the substantial overlap between human-observed SARIFA and DL-based TAF as morphologic biomarkers, we demonstrate that linking DL-based image features to independently developed histopathologic biomarkers is a promising tool in the identification of clinically and biologically meaningful biomarkers. Adipocyte-tumor-cell interactions seem to be crucial in CRC, which should be considered as biomarkers for further investigations.

Recent advancements to increase success in assisted reproductive technologies in cattle

Assisted reproductive technologies (ART) are fundamental for cattle breeding and sustainable food production. Together with genomic selection, these technologies contribute to reducing the generation interval and accelerating genetic progress. In this paper, we discuss advancements in technologies used in the fertility evaluation of breeding animals, and the collection, processing, and preservation of the gametes. It is of utmost importance for the breeding industry to select dams and sires of the next generation as young as possible, as is the efficient and timely collection of gametes. There is a need for reliable and easily applicable methods to evaluate sexual maturity and fertility. Although gametes processing and preservation have been improved in recent decades, challenges are still encountered. The targeted use of sexed semen and beef semen has obliterated the production of surplus replacement heifers and bull calves from dairy breeds, markedly improving animal welfare and ethical considerations in production practices. Parallel with new technologies, many well-established technologies remain relevant, although with evolving applications. In vitro production (IVP) has become the predominant method of embryo production. Although fundamental improvements in IVP procedures have been established, the quality of IVP embryos remains inferior to their in vivo counterparts. Improvements to facilitate oocyte maturation and development of new culture systems, e.g. microfluidics, are presented in this paper. New non-invasive and objective tools are needed to select embryos for transfer. Cryopreservation of semen and embryos plays a pivotal role in the distribution of genetics, and we discuss the challenges and opportunities in this field. Finally, machine learning (ML) is gaining ground in agriculture and ART. This paper delves into the utilization of emerging technologies in ART, along with the current status, key challenges, and future prospects of ML in both research and practical applications within ART.

CardioRiskNet: A Hybrid AI-Based Model for Explainable Risk Prediction and Prognosis in Cardiovascular Disease

The global prevalence of cardiovascular diseases (CVDs) as a leading cause of death highlights the imperative need for refined risk assessment and prognostication methods. The traditional approaches, including the Framingham Risk Score, blood tests, imaging techniques, and clinical assessments, although widely utilized, are hindered by limitations such as a lack of precision, the reliance on static risk variables, and the inability to adapt to new patient data, thereby necessitating the exploration of alternative strategies. In response, this study introduces CardioRiskNet, a hybrid AI-based model designed to transcend these limitations. The proposed CardioRiskNet consists of seven parts: data preprocessing, feature selection and encoding, eXplainable AI (XAI) integration, active learning, attention mechanisms, risk prediction and prognosis, evaluation and validation, and deployment and integration. At first, the patient data are preprocessed by cleaning the data, handling the missing values, applying a normalization process, and extracting the features. Next, the most informative features are selected and the categorical variables are converted into a numerical form. Distinctively, CardioRiskNet employs active learning to iteratively select informative samples, enhancing its learning efficacy, while its attention mechanism dynamically focuses on the relevant features for precise risk prediction. Additionally, the integration of XAI facilitates interpretability and transparency in the decision-making processes. According to the experimental results, CardioRiskNet demonstrates superior performance in terms of accuracy, sensitivity, specificity, and F1-Score, with values of 98.7%, 98.7%, 99%, and 98.7%, respectively. These findings show that CardioRiskNet can accurately assess and prognosticate the CVD risk, demonstrating the power of active learning and AI to surpass the conventional methods. Thus, CardioRiskNet's novel approach and high performance advance the management of CVDs and provide healthcare professionals a powerful tool for patient care.

AutoCancer as an automated multimodal framework for early cancer detection

Current studies in early cancer detection based on liquid biopsy data often rely on off-the-shelf models and face challenges with heterogeneous data, as well as manually designed data preprocessing pipelines with different parameter settings. To address those challenges, we present AutoCancer, an automated, multimodal, and interpretable transformer-based framework. This framework integrates feature selection, neural architecture search, and hyperparameter optimization into a unified optimization problem with Bayesian optimization. Comprehensive experiments demonstrate that AutoCancer achieves accurate performance in specific cancer types and pan-cancer analysis, outperforming existing methods across three cohorts. We further demonstrated the interpretability of AutoCancer by identifying key gene mutations associated with non-small cell lung cancer to pinpoint crucial factors at different stages and subtypes. The robustness of AutoCancer, coupled with its strong interpretability, underscores its potential for clinical applications in early cancer detection.

Advancing medical imaging: detecting polypharmacy and adverse drug effects with Graph Convolutional Networks (GCN)

Polypharmacy involves an individual using many medications at the same time and is a frequent healthcare technique used to treat complex medical disorders. Nevertheless, it also presents substantial risks of negative medication responses and interactions. Identifying and addressing adverse effects caused by polypharmacy is crucial to ensure patient safety and improve healthcare results. This paper introduces a new method using Graph Convolutional Networks (GCN) to identify polypharmacy side effects. Our strategy involves developing a medicine interaction graph in which edges signify drug-drug intuitive predicated on pharmacological properties and hubs symbolize drugs. GCN is a well-suited profound learning procedure for graph-based representations of social information. It can be used to anticipate the probability of medicate unfavorable impacts and to memorize important representations of sedate intuitive. Tests were conducted on a huge dataset of patients' pharmaceutical records commented on with watched medicate unfavorable impacts in arrange to approve our strategy. Execution of the GCN show, which was prepared on a subset of this dataset, was evaluated through a disarray framework. The perplexity network shows the precision with which the show categories occasions. Our discoveries demonstrate empowering advance within the recognizable proof of antagonistic responses related with polypharmaceuticals. For cardiovascular system target drugs, GCN technique achieved an accuracy of 94.12%, precision of 86.56%, F1-Score of 88.56%, AUC of 89.74% and recall of 87.92%. For respiratory system target drugs, GCN technique achieved an accuracy of 93.38%, precision of 85.64%, F1-Score of 89.79%, AUC of 91.85% and recall of 86.35%. And for nervous system target drugs, GCN technique achieved an accuracy of 95.27%, precision of 88.36%, F1-Score of 86.49%, AUC of 88.83% and recall of 84.73%. This research provides a significant contribution to pharmacovigilance by proposing a data-driven method to detect and reduce polypharmacy side effects, thereby increasing patient safety and healthcare decision-making.

Individual-specific postural discomfort prediction using decision tree models

The objective of the current study was to explore the utilization of the decision tree (DT) algorithm to model posture-discomfort relationships at the individual level. The DT algorithm has the advantage that it makes no assumptions about the distribution of data, is robust in representing non-linear data with noise, and produces white-box models that are interpretable. Individual-level modelling is essential for examining individual-specific postural discomfort perception processes and understanding the inter-individual variability. It also has practical applications, including the development of individual-specific digital human models and more precise and informative population accommodation analysis. Individual-specific DT models were generated using postural discomfort rating data for various seated upper body postures to predict discomfort based on postural and task variables. The individual-specific DT models accurately predicted postural discomfort and revealed large inter-individual variability in the modelling results. DT modelling is expected to greatly facilitate investigating the human discomfort perception process.

Understanding Human Cognition Through Computational Modeling

One important goal of cognitive science is to understand the mind in terms of its representational and computational capacities, where computational modeling plays an essential role in providing theoretical explanations and predictions of human behavior and mental phenomena. In my research, I have been using computational modeling, together with behavioral experiments and cognitive neuroscience methods, to investigate the information processing mechanisms underlying learning and visual cognition in terms of perceptual representation and attention strategy. In perceptual representation, I have used neural network models to understand how the split architecture in the human visual system influences visual cognition, and to examine perceptual representation development as the results of expertise. In attention strategy, I have developed the Eye Movement analysis with Hidden Markov Models method for quantifying eye movement pattern and consistency using both spatial and temporal information, which has led to novel findings across disciplines not discoverable using traditional methods. By integrating it with deep neural networks (DNN), I have developed DNN+HMM to account for eye movement strategy learning in human visual cognition. The understanding of the human mind through computational modeling also facilitates research on artificial intelligence's (AI) comparability with human cognition, which can in turn help explainable AI systems infer humans' belief on AI's operations and provide human-centered explanations to enhance human-AI interaction and mutual understanding. Together, these demonstrate the essential role of computational modeling methods in providing theoretical accounts of the human mind as well as its interaction with its environment and AI systems.

Explanation strategies in humans versus current explainable artificial intelligence: Insights from image classification

Explainable AI (XAI) methods provide explanations of AI models, but our understanding of how they compare with human explanations remains limited. Here, we examined human participants' attention strategies when classifying images and when explaining how they classified the images through eye-tracking and compared their attention strategies with saliency-based explanations from current XAI methods. We found that humans adopted more explorative attention strategies for the explanation task than the classification task itself. Two representative explanation strategies were identified through clustering: One involved focused visual scanning on foreground objects with more conceptual explanations, which contained more specific information for inferring class labels, whereas the other involved explorative scanning with more visual explanations, which were rated higher in effectiveness for early category learning. Interestingly, XAI saliency map explanations had the highest similarity to the explorative attention strategy in humans, and explanations highlighting discriminative features from invoking observable causality through perturbation had higher similarity to human strategies than those highlighting internal features associated with higher class score. Thus, humans use both visual and conceptual information during explanation, which serve different purposes, and XAI methods that highlight features informing observable causality match better with human explanations, potentially more accessible to users.

Effects of multimodal explanations for autonomous driving on driving performance, cognitive load, expertise, confidence, and trust

Advances in autonomous driving provide an opportunity for AI-assisted driving instruction that directly addresses the critical need for human driving improvement. How should an AI instructor convey information to promote learning? In a pre-post experiment (n = 41), we tested the impact of an AI Coach's explanatory communications modeled after performance driving expert instructions. Participants were divided into four (4) groups to assess two (2) dimensions of the AI coach's explanations: information type ('what' and 'why'-type explanations) and presentation modality (auditory and visual). We compare how different explanatory techniques impact driving performance, cognitive load, confidence, expertise, and trust via observational learning. Through interview, we delineate participant learning processes. Results show AI coaching can effectively teach performance driving skills to novices. We find the type and modality of information influences performance outcomes. Differences in how successfully participants learned are attributed to how information directs attention, mitigates uncertainty, and influences overload experienced by participants. Results suggest efficient, modality-appropriate explanations should be opted for when designing effective HMI communications that can instruct without overwhelming. Further, results support the need to align communications with human learning and cognitive processes. We provide eight design implications for future autonomous vehicle HMI and AI coach design.

A systematic review of machine learning models for management, prediction and classification of ARDS

AIM

Acute respiratory distress syndrome or ARDS is an acute, severe form of respiratory failure characterised by poor oxygenation and bilateral pulmonary infiltrates. Advancements in signal processing and machine learning have led to promising solutions for classification, event detection and predictive models in the management of ARDS.

METHOD

In this review, we provide systematic description of different studies in the application of Machine Learning (ML) and artificial intelligence for management, prediction, and classification of ARDS. We searched the following databases: Google Scholar, PubMed, and EBSCO from 2009 to 2023. A total of 243 studies was screened, in which, 52 studies were included for review and analysis. We integrated knowledge of previous work providing the state of art and overview of explainable decision models in machine learning and have identified areas for future research.

RESULTS

Gradient boosting is the most common and successful method utilised in 12 (23.1%) of the studies. Due to limitation of data size available, neural network and its variation is used by only 8 (15.4%) studies. Whilst all studies used cross validating technique or separated database for validation, only 1 study validated the model with clinician input. Explainability methods were presented in 15 (28.8%) of studies with the most common method is feature importance which used 14 times.

CONCLUSION

For databases of 5000 or fewer samples, extreme gradient boosting has the highest probability of success. A large, multi-region, multi centre database is required to reduce bias and take advantage of neural network method. A framework for validating with and explaining ML model to clinicians involved in the management of ARDS would be very helpful for development and deployment of the ML model.

Ethics for AI in Plastic Surgery: Guidelines and Review

INTRODUCTION

Artificial intelligence (AI) holds the potential to revolutionize medicine, offering vast improvements for plastic surgery. While human physicians are limited to one lifetime of experience, AI is poised to soon surpass human capabilities, as it draws on limitless information and continuous learning abilities. Nevertheless, as AI becomes increasingly prevalent in this domain, it gives rise to critical ethical considerations that must be addressed by professionals.

MATERIALS AND METHODS

This work reviews the literature referring to the ethical challenges brought on by the ever-expanding use of AI in plastic surgery and offers guidelines for its application.

RESULTS

Ethical challenges include the disclosure of use of AI by caregivers, validation of decision-making, data privacy, informed consent and autonomy, potential biases in AI systems, the opaque nature of AI models, questions of liability, and the need for regulations.

CONCLUSIONS

There is a lack of consensus for the ethical use of AI in plastic surgery. Guidelines, such as those presented in this work, are needed within each discipline of medicine to respond to important ethical considerations for the safe use of AI.

LEVEL OF EVIDENCE V

This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .

Perspectives on Preparedness for Chemical, Biological, Radiological, and Nuclear Threats in the Middle East and North Africa Region: Application of Artificial Intelligence Techniques

Over the past 3 decades, the diversity of ethnic, religious, and political backgrounds worldwide, particularly in countries of the Middle East and North Africa (MENA), has led to an increase in the number of intercountry conflicts and terrorist attacks, sometimes involving chemical and biological agents. This warrants moving toward a collaborative approach to strengthening preparedness in the region. In disaster medicine, artificial intelligence techniques have been increasingly utilized to allow a thorough analysis by revealing unseen patterns. In this study, the authors used text mining and machine learning techniques to analyze open-ended feedback from multidisciplinary experts in disaster medicine regarding the MENA region's preparedness for chemical, biological, radiological, and nuclear (CBRN) risks. Open-ended feedback from 29 international experts in disaster medicine, selected based on their organizational roles and contributions to the academic field, was collected using a modified interview method between October and December 2022. Machine learning clustering algorithms, natural language processing, and sentiment analysis were used to analyze the data gathered using R language accessed through the RStudio environment. Findings revealed negative and fearful sentiments about a lack of accessibility to preparedness information, as well as positive sentiments toward CBRN preparedness concepts raised by the modified interview method. The artificial intelligence analysis techniques revealed a common consensus among experts about the importance of having accessible and effective plans and improved health sector preparedness in MENA, especially for potential chemical and biological incidents. Findings from this study can inform policymakers in the region to converge their efforts to build collaborative initiatives to strengthen CBRN preparedness capabilities in the healthcare sector.

Artificial intelligence in medical science: a review

Artificial intelligence (AI) is a technique to make intelligent machines, mainly by using smart computer programs. It is based on a statistical analysis of data or machine learning. Using machine learning, software algorithms are designed according to the desired application. These techniques are found to have the potential for advancement in the medical field by generating new and significant perceptions from the data generated using various types of healthcare tests. Artificial intelligence (AI) in medicine is of two types: virtual and physical. The virtual part decides the treatment using electronic health record systems using various sensors whereas the physical part assists robots to perform surgeries, implants, replacement of various organs, elderly care, etc. Using AI, a machine can examine various kinds of health care test reports in one go which could save the time, money, and increase the chances of the patient to be treated without any hassles. At present, artificial intelligence (AI) is used while deciding the treatment, and medications using various tools which could analyze X-rays, CT scans, MRIs, and any other data. During the COVID pandemic, there was a huge/massive demand for AI-supported technologies and many of those were created during that time. This study is focused on various applications of AI in healthcare.

Bayesian Networks in the Management of Hospital Admissions: A Comparison between Explainable AI and Black Box AI during the Pandemic

Artificial Intelligence (AI) and Machine Learning (ML) approaches that could learn from large data sources have been identified as useful tools to support clinicians in their decisional process; AI and ML implementations have had a rapid acceleration during the recent COVID-19 pandemic. However, many ML classifiers are "black box" to the final user, since their underlying reasoning process is often obscure. Additionally, the performance of such models suffers from poor generalization ability in the presence of dataset shifts. Here, we present a comparison between an explainable-by-design ("white box") model (Bayesian Network (BN)) versus a black box model (Random Forest), both studied with the aim of supporting clinicians of Policlinico San Matteo University Hospital in Pavia (Italy) during the triage of COVID-19 patients. Our aim is to evaluate whether the BN predictive performances are comparable with those of a widely used but less explainable ML model such as Random Forest and to test the generalization ability of the ML models across different waves of the pandemic.

A multicenter proof-of-concept study on deep learning-based intraoperative discrimination of primary central nervous system lymphoma

Accurate intraoperative differentiation of primary central nervous system lymphoma (PCNSL) remains pivotal in guiding neurosurgical decisions. However, distinguishing PCNSL from other lesions, notably glioma, through frozen sections challenges pathologists. Here we sought to develop and validate a deep learning model capable of precisely distinguishing PCNSL from non-PCNSL lesions, especially glioma, using hematoxylin and eosin (H&E)-stained frozen whole-slide images. Also, we compared its performance against pathologists of varying expertise. Additionally, a human-machine fusion approach integrated both model and pathologic diagnostics. In external cohorts, LGNet achieved AUROCs of 0.965 and 0.972 in distinguishing PCNSL from glioma and AUROCs of 0.981 and 0.993 in differentiating PCNSL from non-PCNSL lesions. Outperforming several pathologists, LGNet significantly improved diagnostic performance, further augmented to some extent by fusion approach. LGNet's proficiency in frozen section analysis and its synergy with pathologists indicate its valuable role in intraoperative diagnosis, particularly in discriminating PCNSL from glioma, alongside other lesions.

Effects of explainable artificial intelligence in neurology decision support

OBJECTIVE

Artificial intelligence (AI)-based decision support systems (DSS) are utilized in medicine but underlying decision-making processes are usually unknown. Explainable AI (xAI) techniques provide insight into DSS, but little is known on how to design xAI for clinicians. Here we investigate the impact of various xAI techniques on a clinician's interaction with an AI-based DSS in decision-making tasks as compared to a general population.

METHODS

We conducted a randomized, blinded study in which members of the Child Neurology Society and American Academy of Neurology were compared to a general population. Participants received recommendations from a DSS via a random assignment of an xAI intervention (decision tree, crowd sourced agreement, case-based reasoning, probability scores, counterfactual reasoning, feature importance, templated language, and no explanations). Primary outcomes included test performance and perceived explainability, trust, and social competence of the DSS. Secondary outcomes included compliance, understandability, and agreement per question.

RESULTS

We had 81 neurology participants with 284 in the general population. Decision trees were perceived as the more explainable by the medical versus general population (P < 0.01) and as more explainable than probability scores within the medical population (P < 0.001). Increasing neurology experience and perceived explainability degraded performance (P = 0.0214). Performance was not predicted by xAI method but by perceived explainability.

INTERPRETATION

xAI methods have different impacts on a medical versus general population; thus, xAI is not uniformly beneficial, and there is no one-size-fits-all approach. Further user-centered xAI research targeting clinicians and to develop personalized DSS for clinicians is needed.

Diffeomorphic Counterfactuals With Generative Models

Counterfactuals can explain classification decisions of neural networks in a human interpretable way. We propose a simple but effective method to generate such counterfactuals. More specifically, we perform a suitable diffeomorphic coordinate transformation and then perform gradient ascent in these coordinates to find counterfactuals which are classified with great confidence as a specified target class. We propose two methods to leverage generative models to construct such suitable coordinate systems that are either exactly or approximately diffeomorphic. We analyze the generation process theoretically using Riemannian differential geometry and validate the quality of the generated counterfactuals using various qualitative and quantitative measures.

Application of artificial intelligence in the prediction of immunotherapy efficacy in hepatocellular carcinoma: Current status and prospects

Artificial Intelligence (AI) has increased as a potent tool in medicine, with promising oncology applications. The emergence of immunotherapy has transformed the treatment terrain for hepatocellular carcinoma (HCC), offering new hope to patients with this challenging malignancy. This article examines the role and future of AI in forecasting the effectiveness of immunotherapy in HCC. We highlight the potential of AI to revolutionize the prediction of therapy response, thus improving patient selection and clinical outcomes. The article further outlines the challenges and future research directions in this emerging field.

Artificial Intelligence, Intrapartum Ultrasound and Dystocic Delivery: AIDA (Artificial Intelligence Dystocia Algorithm), a Promising Helping Decision Support System

The position of the fetal head during engagement and progression in the birth canal is the primary cause of dystocic labor and arrest of progression, often due to malposition and malrotation. The authors performed an investigation on pregnant women in labor, who all underwent vaginal digital examination by obstetricians and midwives as well as intrapartum ultrasonography to collect four "geometric parameters", measured in all the women. All parameters were measured using artificial intelligence and machine learning algorithms, called AIDA (artificial intelligence dystocia algorithm), which incorporates a human-in-the-loop approach, that is, to use AI (artificial intelligence) algorithms that prioritize the physician's decision and explainable artificial intelligence (XAI). The AIDA was structured into five classes. After a number of "geometric parameters" were collected, the data obtained from the AIDA analysis were entered into a red, yellow, or green zone, linked to the analysis of the progress of labor. Using the AIDA analysis, we were able to identify five reference classes for patients in labor, each of which had a certain sort of birth outcome. A 100% cesarean birth prediction was made in two of these five classes. The use of artificial intelligence, through the evaluation of certain obstetric parameters in specific decision-making algorithms, allows physicians to systematically understand how the results of the algorithms can be explained. This approach can be useful in evaluating the progress of labor and predicting the labor outcome, including spontaneous, whether operative VD (vaginal delivery) should be attempted, or if ICD (intrapartum cesarean delivery) is preferable or necessary.

Machine learning-based clinical decision support using laboratory data

Artificial intelligence (AI) and machine learning (ML) are becoming vital in laboratory medicine and the broader context of healthcare. In this review article, we summarized the development of ML models and how they contribute to clinical laboratory workflow and improve patient outcomes. The process of ML model development involves data collection, data cleansing, feature engineering, model development, and optimization. These models, once finalized, are subjected to thorough performance assessments and validations. Recently, due to the complexity inherent in model development, automated ML tools were also introduced to streamline the process, enabling non-experts to create models. Clinical Decision Support Systems (CDSS) use ML techniques on large datasets to aid healthcare professionals in test result interpretation. They are revolutionizing laboratory medicine, enabling labs to work more efficiently with less human supervision across pre-analytical, analytical, and post-analytical phases. Despite contributions of the ML tools at all analytical phases, their integration presents challenges like potential model uncertainties, black-box algorithms, and deskilling of professionals. Additionally, acquiring diverse datasets is hard, and models' complexity can limit clinical use. In conclusion, ML-based CDSS in healthcare can greatly enhance clinical decision-making. However, successful adoption demands collaboration among professionals and stakeholders, utilizing hybrid intelligence, external validation, and performance assessments.

Reviewing the essential roles of remote phenotyping, GWAS and explainable AI in practical marker-assisted selection for drought-tolerant winter wheat breeding

Marker-assisted selection (MAS) plays a crucial role in crop breeding improving the speed and precision of conventional breeding programmes by quickly and reliably identifying and selecting plants with desired traits. However, the efficacy of MAS depends on several prerequisites, with precise phenotyping being a key aspect of any plant breeding programme. Recent advancements in high-throughput remote phenotyping, facilitated by unmanned aerial vehicles coupled to machine learning, offer a non-destructive and efficient alternative to traditional, time-consuming, and labour-intensive methods. Furthermore, MAS relies on knowledge of marker-trait associations, commonly obtained through genome-wide association studies (GWAS), to understand complex traits such as drought tolerance, including yield components and phenology. However, GWAS has limitations that artificial intelligence (AI) has been shown to partially overcome. Additionally, AI and its explainable variants, which ensure transparency and interpretability, are increasingly being used as recognised problem-solving tools throughout the breeding process. Given these rapid technological advancements, this review provides an overview of state-of-the-art methods and processes underlying each MAS, from phenotyping, genotyping and association analyses to the integration of explainable AI along the entire workflow. In this context, we specifically address the challenges and importance of breeding winter wheat for greater drought tolerance with stable yields, as regional droughts during critical developmental stages pose a threat to winter wheat production. Finally, we explore the transition from scientific progress to practical implementation and discuss ways to bridge the gap between cutting-edge developments and breeders, expediting MAS-based winter wheat breeding for drought tolerance.

An explainable machine learning model for prediction of high-risk nonalcoholic steatohepatitis

Early identification of high-risk metabolic dysfunction-associated steatohepatitis (MASH) can offer patients access to novel therapeutic options and potentially decrease the risk of progression to cirrhosis. This study aimed to develop an explainable machine learning model for high-risk MASH prediction and compare its performance with well-established biomarkers. Data were derived from the National Health and Nutrition Examination Surveys (NHANES) 2017-March 2020, which included a total of 5281 adults with valid elastography measurements. We used a FAST score ≥ 0.35, calculated using liver stiffness measurement and controlled attenuation parameter values and aspartate aminotransferase levels, to identify individuals with high-risk MASH. We developed an ensemble-based machine learning XGBoost model to detect high-risk MASH and explored the model's interpretability using an explainable artificial intelligence SHAP method. The prevalence of high-risk MASH was 6.9%. Our XGBoost model achieved a high level of sensitivity (0.82), specificity (0.91), accuracy (0.90), and AUC (0.95) for identifying high-risk MASH. Our model demonstrated a superior ability to predict high-risk MASH vs. FIB-4, APRI, BARD, and MASLD fibrosis scores (AUC of 0.95 vs. 0.50, 0.50, 0.49 and 0.50, respectively). To explain the high performance of our model, we found that the top 5 predictors of high-risk MASH were ALT, GGT, platelet count, waist circumference, and age. We used an explainable ML approach to develop a clinically applicable model that outperforms commonly used clinical risk indices and could increase the identification of high-risk MASH patients in resource-limited settings.

Advancing Dermatological Diagnostics: Interpretable AI for Enhanced Skin Lesion Classification

A crucial challenge in critical settings like medical diagnosis is making deep learning models used in decision-making systems interpretable. Efforts in Explainable Artificial Intelligence (XAI) are underway to address this challenge. Yet, many XAI methods are evaluated on broad classifiers and fail to address complex, real-world issues, such as medical diagnosis. In our study, we focus on enhancing user trust and confidence in automated AI decision-making systems, particularly for diagnosing skin lesions, by tailoring an XAI method to explain an AI model's ability to identify various skin lesion types. We generate explanations using synthetic images of skin lesions as examples and counterexamples, offering a method for practitioners to pinpoint the critical features influencing the classification outcome. A validation survey involving domain experts, novices, and laypersons has demonstrated that explanations increase trust and confidence in the automated decision system. Furthermore, our exploration of the model's latent space reveals clear separations among the most common skin lesion classes, a distinction that likely arises from the unique characteristics of each class and could assist in correcting frequent misdiagnoses by human professionals.

Charting Tomorrow's Healthcare: A Traditional Literature Review for an Artificial Intelligence-Driven Future

Electronic health record (EHR) systems have developed over time in parallel with general advancements in mainstream technology. As artificially intelligent (AI) systems rapidly impact multiple societal sectors, it has become apparent that medicine is not immune from the influences of this powerful technology. Particularly appealing is how AI may aid in improving healthcare efficiency with note-writing automation. This literature review explores the current state of EHR technologies in healthcare, specifically focusing on possibilities for addressing EHR challenges through the automation of dictation and note-writing processes with AI integration. This review offers a broad understanding of existing capabilities and potential advancements, emphasizing innovations such as voice-to-text dictation, wearable devices, and AI-assisted procedure note dictation. The primary objective is to provide researchers with valuable insights, enabling them to generate new technologies and advancements within the healthcare landscape. By exploring the benefits, challenges, and future of AI integration, this review encourages the development of innovative solutions, with the goal of enhancing patient care and healthcare delivery efficiency.

Integrating clinical pharmacology and artificial intelligence: potential benefits, challenges, and role of clinical pharmacologists

INTRODUCTION

The integration of artificial intelligence (AI) into clinical pharmacology could be a potential approach for accelerating drug discovery and development, improving patient care, and streamlining medical research processes.

AREAS COVERED

We reviewed the current state of AI applications in clinical pharmacology, focusing on drug discovery and development, precision medicine, pharmacovigilance, and other ventures. Key AI applications in clinical pharmacology are examined, including machine learning, natural language processing, deep learning, and reinforcement learning etc. Additionally, the evolving role of clinical pharmacologists, ethical considerations, and challenges in implementing AI in clinical pharmacology are discussed.

EXPERT OPINION

The AI could be instrumental in accelerating drug discovery, predicting drug safety and efficacy, and optimizing clinical trial designs. It can play a vital role in precision medicine by helping in personalized drug dosing, treatment selection, and predicting drug response based on genetic, clinical, and environmental factors. The role of AI in pharmacovigilance, such as signal detection and adverse event prediction, is also promising. The collaboration between clinical pharmacologists and AI experts also poses certain ethical and practical challenges. Clinical pharmacologists can be instrumental in shaping the future of AI-driven clinical pharmacology and contribute to the improvement of healthcare systems.

Application of deep learning in radiation therapy for cancer

In recent years, with the development of artificial intelligence, deep learning has been gradually applied to clinical treatment and research. It has also found its way into the applications in radiotherapy, a crucial method for cancer treatment. This study summarizes the commonly used and latest deep learning algorithms (including transformer, and diffusion models), introduces the workflow of different radiotherapy, and illustrates the application of different algorithms in different radiotherapy modules, as well as the defects and challenges of deep learning in the field of radiotherapy, so as to provide some help for the development of automatic radiotherapy for cancer.

Machine learning on cardiotocography data to classify fetal outcomes: A scoping review

INTRODUCTION

Uterine contractions during labour constrict maternal blood flow and oxygen delivery to the developing baby, causing transient hypoxia. While most babies are physiologically adapted to withstand such intrapartum hypoxia, those exposed to severe hypoxia or with poor physiological reserves may experience neurological injury or death during labour. Cardiotocography (CTG) monitoring was developed to identify babies at risk of hypoxia by detecting changes in fetal heart rate (FHR) patterns. CTG monitoring is in widespread use in intrapartum care for the detection of fetal hypoxia, but the clinical utility is limited by a relatively poor positive predictive value (PPV) of an abnormal CTG and significant inter and intra observer variability in CTG interpretation. Clinical risk and human factors may impact the quality of CTG interpretation. Misclassification of CTG traces may lead to both under-treatment (with the risk of fetal injury or death) or over-treatment (which may include unnecessary operative interventions that put both mother and baby at risk of complications). Machine learning (ML) has been applied to this problem since early 2000 and has shown potential to predict fetal hypoxia more accurately than visual interpretation of CTG alone. To consider how these tools might be translated for clinical practice, we conducted a review of ML techniques already applied to CTG classification and identified research gaps requiring investigation in order to progress towards clinical implementation.

MATERIALS AND METHOD

We used identified keywords to search databases for relevant publications on PubMed, EMBASE and IEEE Xplore. We used Preferred Reporting Items for Systematic Review and Meta-Analysis for Scoping Reviews (PRISMA-ScR). Title, abstract and full text were screened according to the inclusion criteria.

RESULTS

We included 36 studies that used signal processing and ML techniques to classify CTG. Most studies used an open-access CTG database and predominantly used fetal metabolic acidosis as the benchmark for hypoxia with varying pH levels. Various methods were used to process and extract CTG signals and several ML algorithms were used to classify CTG. We identified significant concerns over the practicality of using varying pH levels as the CTG classification benchmark. Furthermore, studies needed to be more generalised as most used the same database with a low number of subjects for an ML study.

CONCLUSION

ML studies demonstrate potential in predicting fetal hypoxia from CTG. However, more diverse datasets, standardisation of hypoxia benchmarks and enhancement of algorithms and features are needed for future clinical implementation.

Artificial intelligence in neuro-oncology: advances and challenges in brain tumor diagnosis, prognosis, and precision treatment

This review delves into the most recent advancements in applying artificial intelligence (AI) within neuro-oncology, specifically emphasizing work on gliomas, a class of brain tumors that represent a significant global health issue. AI has brought transformative innovations to brain tumor management, utilizing imaging, histopathological, and genomic tools for efficient detection, categorization, outcome prediction, and treatment planning. Assessing its influence across all facets of malignant brain tumor management- diagnosis, prognosis, and therapy- AI models outperform human evaluations in terms of accuracy and specificity. Their ability to discern molecular aspects from imaging may reduce reliance on invasive diagnostics and may accelerate the time to molecular diagnoses. The review covers AI techniques, from classical machine learning to deep learning, highlighting current applications and challenges. Promising directions for future research include multimodal data integration, generative AI, large medical language models, precise tumor delineation and characterization, and addressing racial and gender disparities. Adaptive personalized treatment strategies are also emphasized for optimizing clinical outcomes. Ethical, legal, and social implications are discussed, advocating for transparency and fairness in AI integration for neuro-oncology and providing a holistic understanding of its transformative impact on patient care.

Optimized models and deep learning methods for drug response prediction in cancer treatments: a review

Recent advancements in deep learning (DL) have played a crucial role in aiding experts to develop personalized healthcare services, particularly in drug response prediction (DRP) for cancer patients. The DL's techniques contribution to this field is significant, and they have proven indispensable in the medical field. This review aims to analyze the diverse effectiveness of various DL models in making these predictions, drawing on research published from 2017 to 2023. We utilized the VOS-Viewer 1.6.18 software to create a word cloud from the titles and abstracts of the selected studies. This study offers insights into the focus areas within DL models used for drug response. The word cloud revealed a strong link between certain keywords and grouped themes, highlighting terms such as deep learning, machine learning, precision medicine, precision oncology, drug response prediction, and personalized medicine. In order to achieve an advance in DRP using DL, the researchers need to work on enhancing the models' generalizability and interoperability. It is also crucial to develop models that not only accurately represent various architectures but also simplify these architectures, balancing the complexity with the predictive capabilities. In the future, researchers should try to combine methods that make DL models easier to understand; this will make DRP reviews more open and help doctors trust the decisions made by DL models in cancer DRP.