Where is laboratory medicine headed in the next decade? Partnership model for efficient integration and adoption of artificial intelligence into medical laboratories

Artificial intelligence in the clinical laboratory

Laboratory medicine has become a highly automated medical discipline. Nowadays, artificial intelligence (AI) applied to laboratory medicine is also gaining more and more attention, which can optimize the entire laboratory workflow and even revolutionize laboratory medicine in the future. However, only a few commercially available AI models are currently approved for use in clinical laboratories and have drawbacks such as high cost, lack of accuracy, and the need for manual review of model results. Furthermore, there are a limited number of literature reviews that comprehensively address the research status, challenges, and future opportunities of AI applications in laboratory medicine. Our article begins with a brief introduction to AI and some of its subsets, then reviews some AI models that are currently being used in clinical laboratories or that have been described in emerging studies, and explains the existing challenges associated with their application and possible solutions, finally provides insights into the future opportunities of the field. We highlight the current status of implementation and potential applications of AI models in different stages of the clinical testing process.

Machine learning-based clinical decision support using laboratory data

Artificial intelligence (AI) and machine learning (ML) are becoming vital in laboratory medicine and the broader context of healthcare. In this review article, we summarized the development of ML models and how they contribute to clinical laboratory workflow and improve patient outcomes. The process of ML model development involves data collection, data cleansing, feature engineering, model development, and optimization. These models, once finalized, are subjected to thorough performance assessments and validations. Recently, due to the complexity inherent in model development, automated ML tools were also introduced to streamline the process, enabling non-experts to create models. Clinical Decision Support Systems (CDSS) use ML techniques on large datasets to aid healthcare professionals in test result interpretation. They are revolutionizing laboratory medicine, enabling labs to work more efficiently with less human supervision across pre-analytical, analytical, and post-analytical phases. Despite contributions of the ML tools at all analytical phases, their integration presents challenges like potential model uncertainties, black-box algorithms, and deskilling of professionals. Additionally, acquiring diverse datasets is hard, and models' complexity can limit clinical use. In conclusion, ML-based CDSS in healthcare can greatly enhance clinical decision-making. However, successful adoption demands collaboration among professionals and stakeholders, utilizing hybrid intelligence, external validation, and performance assessments.

Machine learning to optimize cerebrospinal fluid dilution for analysis of MRZH reaction

OBJECTIVES

To create a supervised machine learning algorithm aimed at predicting an optimal cerebrospinal fluid (CSF) dilution when determining virus specific antibody indices to reduce the need for repeated tests.

METHODS

The CatBoost model was trained, optimized, and tested on a dataset with five input variables: albumin quotient, immunoglobulin G (IgG) in CSF, IgG quotient (QIgG), intrathecal synthesis (ITS) and limes quotient (LIM IgG). Albumin and IgG concentrations in CSF and serum were performed by immunonephelometry on Atellica NEPH 630 (Siemens Healthineers, Erlangen, Germany) and ITS and LIM IgG were calculated according to Reiber. Concentrations of IgG antibodies to measles, rubella, varicella zoster and herpes simplex 1/2 viruses were analysed in CSF and serum by ELISA (Euroimmun, Lübeck, Germany). Optimal CSF dilution was defined for each virus and used as a classification variable while the standard operating procedure was set to start at 2×-dilution of CSF.

RESULTS

The dataset included 571 samples with the imbalanced distribution of the optimal CSF dilutions: 2× dilution n=440, 3× dilution n=109, 4× dilution n=22. The optimized CatBoost model achieved an area under the curve (AUC) score of 0.971, and a test accuracy of 0.900. The model falsely classified 14 (9.9 %) samples of the testing set but reduced the need for repeated testing compared to the standard protocol by 42 %. The output of the CatBoost model is mostly dependant on the QIgG, ITS and CSF IgG variables.

CONCLUSIONS

An accurate algorithm was achieved for predicting the optimal CSF dilution, which reduces the number of test repeats.

Insights from semi-structured interviews on integrating artificial intelligence in clinical chemistry laboratory practices

BACKGROUND

Artificial intelligence (AI) is gradually transforming the practises of healthcare providers. Over the last two decades, the advent of AI into numerous aspects of pathology has opened transformative possibilities in how we practise laboratory medicine. Objectives of this study were to explore how AI could impact the clinical practices of professionals working in Clinical Chemistry laboratories, while also identifying effective strategies in medical education to facilitate the required changes.

METHODS

From March to August 2022, an exploratory qualitative study was conducted at the Section of Clinical Chemistry, Department of Pathology and Laboratory Medicine, Aga Khan University, Karachi, Pakistan, in collaboration with Keele University, Newcastle, United Kingdom. Semi-structured interviews were conducted to collect information from diverse group of professionals working in Clinical Chemistry laboratories. All interviews were audio recorded and transcribed verbatim. They were asked what changes AI would involve in the laboratory, what resources would be necessary, and how medical education would assist them in adapting to the change. A content analysis was conducted, resulting in the development of codes and themes based on the analyzed data.

RESULTS

The interviews were analysed to identify three primary themes: perspectives and considerations for AI adoption, educational and curriculum adjustments, and implementation techniques. Although the use of diagnostic algorithms is currently limited in Pakistani Clinical Chemistry laboratories, the application of AI is expanding. All thirteen participants stated their reasons for being hesitant to use AI. Participants stressed the importance of critical aspects for effective AI deployment, the need of a collaborative integrative approach, and the need for constant horizon scanning to keep up with AI developments.

CONCLUSIONS

Three primary themes related to AI adoption were identified: perspectives and considerations, educational and curriculum adjustments, and implementation techniques. The study's findings give a sound foundation for making suggestions to clinical laboratories, scientific bodies, and national and international Clinical Chemistry and laboratory medicine organisations on how to manage pathologists' shifting practises because of AI.

Artificial intelligence in the pre-analytical phase: State-of-the art and future perspectives

The use of artificial intelligence (AI) has become widespread in many areas of science and medicine, including laboratory medicine. Although it seems obvious that the analytical and post-analytical phases could be the most important fields of application in laboratory medicine, a kaleidoscope of new opportunities has emerged to extend the benefits of AI to many manual labor-intensive activities belonging to the pre-analytical phase, which are inherently characterized by enhanced vulnerability and higher risk of errors. These potential applications involve increasing the appropriateness of test prescription (with computerized physician order entry or demand management tools), improved specimen collection (using active patient recognition, automated specimen labeling, vein recognition and blood collection assistance, along with automated blood drawing), more efficient sample transportation (facilitated by the use of pneumatic transport systems or drones, and monitored with smart blood tubes or data loggers), systematic evaluation of sample quality (by measuring serum indices, fill volume or for detecting sample clotting), as well as error detection and analysis. Therefore, this opinion paper aims to discuss the state-of-the-art and some future possibilities of AI in the preanalytical phase.

Interventions to improve appropriateness of laboratory testing in the intensive care unit: a narrative review

Healthcare expenses are increasing, as is the utilization of laboratory resources. Despite this, between 20% and 40% of requested tests are deemed inappropriate. Improper use of laboratory resources leads to unwanted consequences such as hospital-acquired anemia, infections, increased costs, staff workload and patient stress and discomfort. The most unfavorable consequences result from unnecessary follow-up tests and treatments (overuse) and missed or delayed diagnoses (underuse). In this context, several interventions have been carried out to improve the appropriateness of laboratory testing. To date, there have been few published assessments of interventions specific to the intensive care unit. We reviewed the literature for interventions implemented in the ICU to improve the appropriateness of laboratory testing. We searched literature from 2008 to 2023 in PubMed, Embase, Scopus, and Google Scholar databases between April and June 2023. Five intervention categories were identified: education and guidance (E&G), audit and feedback, gatekeeping, computerized physician order entry (including reshaping of ordering panels), and multifaceted interventions (MFI). We included a sixth category exploring the potential role of artificial intelligence and machine learning (AI/ML)-based assisting tools in such interventions. E&G-based interventions and MFI are the most frequently used approaches. MFI is the most effective type of intervention, and shows the strongest persistence of effect over time. AI/ML-based tools may offer valuable assistance to the improvement of appropriate laboratory testing in the near future. Patient safety outcomes are not impaired by interventions to reduce inappropriate testing. The literature focuses mainly on reducing overuse of laboratory tests, with only one intervention mentioning underuse. We highlight an overall poor quality of methodological design and reporting and argue for standardization of intervention methods. Collaboration between clinicians and laboratory staff is key to improve appropriate laboratory utilization. This article offers practical guidance for optimizing the effectiveness of an intervention protocol designed to limit inappropriate use of laboratory resources.

Diagnostic Test Utilization Management Strategies as an Opportunity for Equitable Access to Molecularly Informed Clinical Care

BACKGROUND

Companion diagnostics are an essential component of oncology. Timing, cost, and adaptability to new drug/biomarker approvals represent challenges in assuring value-based care. Overcoming these challenges requires strategies for equitable access and efficient integration.

METHODS

Based on prior laboratory improvements and payor policy implementations, we define equitable access in laboratory testing and conceptualized a framework for initiatives that optimize diagnostic performance.

RESULTS

We define equitable access as an imperative goal seeking to remove disparities that may arise due to financial hardships, geographical isolation, cultural differences, or other social determinants of health. We distinguish (a) utilization, as the practice pattern of ordered tests, (b) utilization management, as the evidence-based guidance of the utilization decisions, and (c) utilization management strategies, defined as the tools and techniques used to influence decision-making. These 3 dimensions establish a standardized vocabulary to clarify equitable alignment of strategies in specific care pathways. Alignment of logistic, administrative, and financial incentive structures is paramount when creating sustainable personalized care pathway programs.

CONCLUSIONS

Strategies to accomplish equitable and meaningful use of diagnostic tests can help enhance access to timely and accurate diagnoses, ultimately leading to improved patient outcomes.

Exploring knowledge, attitudes, and practices towards artificial intelligence among health professions' students in Jordan

INTRODUCTION

The integration of Artificial Intelligence (AI) in medical education and practice is a significant development. This study examined the Knowledge, Attitudes, and Practices (KAP) of health professions' students in Jordan concerning AI, providing insights into their preparedness and perceptions.

METHODS

An online questionnaire was distributed to 483 Jordanian health professions' students via social media. Demographic data, AI-related KAP, and barriers were collected. Quantile regression models analyzed associations between variables and KAP scores.

RESULTS

Moderate AI knowledge was observed among participants, with specific understanding of data requirements and barriers. Attitudes varied, combining skepticism about AI replacing human teachers with recognition of its value. While AI tools were used for specific tasks, broader integration in medical education and practice was limited. Barriers included lack of knowledge, access, time constraints, and curriculum gaps.

CONCLUSIONS

This study highlights the need to enhance medical education with AI topics and address barriers. Students need to be better prepared for AI integration, in order to enable medical education to harness AI's potential for improved patient care and training.

Potentials and pitfalls of ChatGPT and natural-language artificial intelligence models for the understanding of laboratory medicine test results. An assessment by the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) Working Group on Artificial Intelligence (WG-AI)

OBJECTIVES

ChatGPT, a tool based on natural language processing (NLP), is on everyone's mind, and several potential applications in healthcare have been already proposed. However, since the ability of this tool to interpret laboratory test results has not yet been tested, the EFLM Working group on Artificial Intelligence (WG-AI) has set itself the task of closing this gap with a systematic approach.

METHODS

WG-AI members generated 10 simulated laboratory reports of common parameters, which were then passed to ChatGPT for interpretation, according to reference intervals (RI) and units, using an optimized prompt. The results were subsequently evaluated independently by all WG-AI members with respect to relevance, correctness, helpfulness and safety.

RESULTS

ChatGPT recognized all laboratory tests, it could detect if they deviated from the RI and gave a test-by-test as well as an overall interpretation. The interpretations were rather superficial, not always correct, and, only in some cases, judged coherently. The magnitude of the deviation from the RI seldom plays a role in the interpretation of laboratory tests, and artificial intelligence (AI) did not make any meaningful suggestion regarding follow-up diagnostics or further procedures in general.

CONCLUSIONS

ChatGPT in its current form, being not specifically trained on medical data or laboratory data in particular, may only be considered a tool capable of interpreting a laboratory report on a test-by-test basis at best, but not on the interpretation of an overall diagnostic picture. Future generations of similar AIs with medical ground truth training data might surely revolutionize current processes in healthcare, despite this implementation is not ready yet.

Artificial Intelligence and laboratory data in rheumatic diseases

Artificial intelligence (AI)-based medical technologies are rapidly evolving into actionable solutions for clinical practice. Machine learning (ML) algorithms can process increasing amounts of laboratory data such as gene expression immunophenotyping data and biomarkers. In recent years, the analysis of ML has become particularly useful for the study of complex chronic diseases, such as rheumatic diseases, heterogenous conditions with multiple triggers. Numerous studies have used ML to classify patients and improve diagnosis, to stratify the risk and determine disease subtypes, as well as to discover biomarkers and gene signatures. This review aims to provide examples of ML models for specific rheumatic diseases using laboratory data and some insights into relevant strengths and limitations. A better understanding and future application of these analytical strategies could facilitate the development of precision medicine for rheumatic patients.

Diagnostic quality model (DQM): an integrated framework for the assessment of diagnostic quality when using AI/ML

BACKGROUND

Laboratory medicine has reached the era where promises of artificial intelligence and machine learning (AI/ML) seem palpable. Currently, the primary responsibility for risk-benefit assessment in clinical practice resides with the medical director. Unfortunately, there is no tool or concept that enables diagnostic quality assessment for the various potential AI/ML applications. Specifically, we noted that an operational definition of laboratory diagnostic quality - for the specific purpose of assessing AI/ML improvements - is currently missing.

METHODS

A session at the 3rd Strategic Conference of the European Federation of Laboratory Medicine in 2022 on "AI in the Laboratory of the Future" prompted an expert roundtable discussion. Here we present a conceptual diagnostic quality framework for the specific purpose of assessing AI/ML implementations.

RESULTS

The presented framework is termed diagnostic quality model (DQM) and distinguishes AI/ML improvements at the test, procedure, laboratory, or healthcare ecosystem level. The operational definition illustrates the nested relationship among these levels. The model can help to define relevant objectives for implementation and how levels come together to form coherent diagnostics. The affected levels are referred to as scope and we provide a rubric to quantify AI/ML improvements while complying with existing, mandated regulatory standards. We present 4 relevant clinical scenarios including multi-modal diagnostics and compare the model to existing quality management systems.

CONCLUSIONS

A diagnostic quality model is essential to navigate the complexities of clinical AI/ML implementations. The presented diagnostic quality framework can help to specify and communicate the key implications of AI/ML solutions in laboratory diagnostics.