Comprehensive analysis of rule formalisms to represent clinical guidelines: Selection criteria and case study on antibiotic clinical guidelines

The Application of Computer Technology to Clinical Practice Guideline Implementation: A Scoping Review

Implementation of clinical practice guidelines (CPG) is a complex and challenging task. Computer technology, including artificial intelligence (AI), has been explored to promote the CPG implementation. This study has reviewed the main domains where computer technology and AI has been applied to CPG implementation. PubMed, Embase, Web of science, the Cochrane Library, China National Knowledge Infrastructure database, WanFang DATA, VIP database, and China Biology Medicine disc database were searched from inception to December 2021. Studies involving the utilization of computer technology and AI to promote the implementation of CPGs were eligible for review. A total of 10429 published articles were identified, 117 met the inclusion criteria. 21 (17.9%) focused on the utilization of AI techniques to classify or extract the relative content of CPGs, such as recommendation sentence, condition-action sentences. 47 (40.2%) focused on the utilization of computer technology to represent guideline knowledge to make it understandable by computer. 15 (12.8%) focused on the utilization of AI techniques to verify the relative content of CPGs, such as conciliation of multiple single-disease guidelines for comorbid patients. 34 (29.1%) focused on the utilization of AI techniques to integrate guideline knowledge into different resources, such as clinical decision support systems. We conclude that the application of computer technology and AI to CPG implementation mainly concentrated on the guideline content classification and extraction, guideline knowledge representation, guideline knowledge verification, and guideline knowledge integration. The AI methods used for guideline content classification and extraction were pattern-based algorithm and machine learning. In guideline knowledge representation, guideline knowledge verification, and guideline knowledge integration, computer techniques of knowledge representation were the most used.

Modelling clinical narrative as computable knowledge: The NICE computable implementation guidance project

Introduction

Translating narrative clinical guidelines to computable knowledge is a long-standing challenge that has seen a diverse range of approaches. The UK National Institute for Health and Care Excellence (NICE) Content Advisory Board (CAB) aims ultimately to (1) guide clinical decision support and other software developers to increase traceability, fidelity and consistency in supporting clinical use of NICE recommendations, (2) guide local practice audit and intervention to reduce unwarranted variation, (3) provide feedback to NICE on how future recommendations should be developed.

Objectives

The first phase of work was to explore a range of technical approaches to transition NICE toward the production of natively digital content.

Methods

Following an initial 'collaborathon' in November 2022, the NICE Computable Implementation Guidance project (NCIG) was established. We held a series of workstream calls approximately fortnightly, focusing on (1) user stories and trigger events, (2) information model and definitions, (3) horizon-scanning and output format. A second collaborathon was held in March 2023 to consolidate progress across the workstreams and agree residual actions to complete.

Results

While we initially focussed on technical implementation standards, we decided that an intermediate logical model was a more achievable first step in the journey from narrative to fully computable representation. NCIG adopted the WHO Digital Adaptation Kit (DAK) as a technology-agnostic method to model user scenarios, personae, processes and workflow, core data elements and decision-support logic. Further work will address indicators, such as prescribing compliance, and implementation in document templates for primary care patient record systems.

Conclusions

The project has shown that the WHO DAK, with some modification, is a promising approach to build technology-neutral logical specifications of NICE recommendations. Implementation of concurrent computable modelling by multidisciplinary teams during guideline development poses methodological and cultural questions that are complex but tractable given suitable will and leadership.

Machine Learning-Enabled Clinical Information Systems Using Fast Healthcare Interoperability Resources Data Standards: Scoping Review

Background

Machine learning-enabled clinical information systems (ML-CISs) have the potential to drive health care delivery and research. The Fast Healthcare Interoperability Resources (FHIR) data standard has been increasingly applied in developing these systems. However, methods for applying FHIR to ML-CISs are variable.

Objective

This study evaluates and compares the functionalities, strengths, and weaknesses of existing systems and proposes guidelines for optimizing future work with ML-CISs.

Methods

Embase, PubMed, and Web of Science were searched for articles describing machine learning systems that were used for clinical data analytics or decision support in compliance with FHIR standards. Information regarding each system's functionality, data sources, formats, security, performance, resource requirements, scalability, strengths, and limitations was compared across systems.

Results

A total of 39 articles describing FHIR-based ML-CISs were divided into the following three categories according to their primary focus: clinical decision support systems (n=18), data management and analytic platforms (n=10), or auxiliary modules and application programming interfaces (n=11). Model strengths included novel use of cloud systems, Bayesian networks, visualization strategies, and techniques for translating unstructured or free-text data to FHIR frameworks. Many intelligent systems lacked electronic health record interoperability and externally validated evidence of clinical efficacy.

Conclusions

Shortcomings in current ML-CISs can be addressed by incorporating modular and interoperable data management, analytic platforms, secure interinstitutional data exchange, and application programming interfaces with adequate scalability to support both real-time and prospective clinical applications that use electronic health record platforms with diverse implementations.

Taxonomy of hybrid architectures involving rule-based reasoning and machine learning in clinical decision systems: A scoping review

BACKGROUND

As the application of Artificial Intelligence (AI) technologies increases in the healthcare sector, the industry faces a need to combine medical knowledge, often expressed as clinical rules, with advances in machine learning (ML), which offer high prediction accuracy at the expense of transparency of decision making.

PURPOSE

This paper seeks to review the present literature, identify hybrid architecture patterns that incorporate rules and machine learning, and evaluate the rationale behind their selection to inform future development and research on the design of transparent and precise clinical decision systems.

METHODS

PubMed, IEEE Explore, and Google Scholar were queried in search for papers from 1992 to 2022, with the keywords: "clinical decision system", "hybrid clinical architecture", "machine learning and clinical rules". Excluded articles did not use both ML and rules or did not provide any explanation of employed architecture. A proposed taxonomy was used to organize the results, analyze them, and depict them in graphical and tabular form. Two researchers, one with expertise in rule-based systems and another in ML, reviewed identified papers and discussed the work to minimize bias, and the third one re-reviewed the work to ensure consistency of reporting.

RESULTS

The authors screened 957 papers and reviewed 71 that met their criteria. Five distinct architecture archetypes were determined: Rules are Embedded in ML architecture (REML) (most used), ML pre-processes input data for Rule-Based inference (MLRB), Rule-Based method pre-processes input data for ML prediction (RBML), Rules influence ML training (RMLT), Parallel Ensemble of Rules and ML (PERML), which was rarely observed in clinical contexts.

CONCLUSIONS

Most architectures in the reviewed literature prioritize prediction accuracy over explainability and trustworthiness, which has led to more complex embedded approaches. Alternatively, parallel (PERML) architectures may be employed, allowing for a more transparent system that is easier to explain to patients and clinicians. The potential of this approach warrants further research.

OTHER

A limitation of the study may be that it reviews scientific literature, while algorithms implemented in clinical practice may present different distributions of motivations and implementations of hybrid architectures.

Business Process Model and Notation and openEHR Task Planning for Clinical Pathway Standards in Infections: Critical Analysis

Background

Clinical pathways (CPs) are usually expressed by means of workflow formalisms, providing health care personnel with an easy-to-understand, high-level conceptual model of medical steps in specific patient conditions, thereby improving overall health care process quality in clinical practice. From a standardized perspective, the business process model and notation (BPMN), a widely spread general-purpose process formalism, has been used for conceptual modeling in clinical domains, mainly because of its easy-to-use graphical notation, facilitating the common understanding and communication of the parties involved in health care. However, BPMN is not particularly oriented toward the peculiarities of complex clinical processes such as infection diagnosis and treatment, in which time plays a critical role, which is why much of the BPMN clinical-oriented research has revolved around how to extend the standard to address these special needs. The shift from an agnostic, general-purpose BPMN notation to a natively clinical-oriented notation such as openEHR Task Planning (TP) could constitute a major step toward clinical process improvement, enhancing the representation of CPs for infection treatment and other complex scenarios.

Objective

Our work aimed to analyze the suitability of a clinical-oriented formalism (TP) to successfully represent typical process patterns in infection treatment, identifying domain-specific improvements to the standard that could help enhance its modeling capabilities, thereby promoting the widespread adoption of CPs to improve medical practice and overall health care quality.

Methods

Our methodology consisted of 4 major steps: identification of key features of infection CPs through literature review, clinical guideline analysis, and BPMN extensions; analysis of the presence of key features in TP; modeling of relevant process patterns of catheter-related bloodstream infection as a case study; and analysis and proposal of extensions in view of the results.

Results

We were able to easily represent the same logic applied in the extended BPMN-based process models in our case study using out-of-the-box standard TP primitives. However, we identified possible improvements to the current version of TP to allow for simpler conceptual models of infection CPs and possibly of other complex clinical scenarios.

Conclusions

Our study showed that the clinical-oriented TP specification is able to successfully represent the most complex catheter-related bloodstream infection process patterns depicted in our case study and identified possible extensions that can help increase its adequacy for modeling infection CPs and possibly other complex clinical conditions.

The Evolution of Clinical Knowledge During COVID-19: Towards a Global Learning Health System

OBJECTIVES

We examine the knowledge ecosystem of COVID-19, focusing on clinical knowledge and the role of health informatics as enabling technology. We argue for commitment to the model of a global learning health system to facilitate rapid knowledge translation supporting health care decision making in the face of emerging diseases.

METHODS AND RESULTS

We frame the evolution of knowledge in the COVID-19 crisis in terms of learning theory, and present a view of what has occurred during the pandemic to rapidly derive and share knowledge as an (underdeveloped) instance of a global learning health system. We identify the key role of information technologies for electronic data capture and data sharing, computational modelling, evidence synthesis, and knowledge dissemination. We further highlight gaps in the system and barriers to full realisation of an efficient and effective global learning health system.

CONCLUSIONS

The need for a global knowledge ecosystem supporting rapid learning from clinical practice has become more apparent than ever during the COVID-19 pandemic. Continued effort to realise the vision of a global learning health system, including establishing effective approaches to data governance and ethics to support the system, is imperative to enable continuous improvement in our clinical care.

Detection-based prioritisation: Framework of multi-laboratory characteristics for asymptomatic COVID-19 carriers based on integrated Entropy-TOPSIS methods

CONTEXT AND BACKGROUND

Corona virus (COVID) has rapidly gained a foothold and caused a global pandemic. Particularists try their best to tackle this global crisis. New challenges outlined from various medical perspectives may require a novel design solution. Asymptomatic COVID-19 carriers show different health conditions and no symptoms; hence, a differentiation process is required to avert the risk of chronic virus carriers.

OBJECTIVES

Laboratory criteria and patient dataset are compulsory in constructing a new framework. Prioritisation is a popular topic and a complex issue for patients with COVID-19, especially for asymptomatic carriers due to multi-laboratory criteria, criterion importance and trade-off amongst these criteria. This study presents new integrated decision-making framework that handles the prioritisation of patients with COVID-19 and can detect the health conditions of asymptomatic carriers.

METHODS

The methodology includes four phases. Firstly, eight important laboratory criteria are chosen using two feature selection approaches. Real and simulation datasets from various medical perspectives are integrated to produce a new dataset involving 56 patients with different health conditions and can be used to check asymptomatic cases that can be detected within the prioritisation configuration. The first phase aims to develop a new decision matrix depending on the intersection between 'multi-laboratory criteria' and 'COVID-19 patient list'. In the second phase, entropy is utilised to set the objective weight, and TOPSIS is adapted to prioritise patients in the third phase. Finally, objective validation is performed.

RESULTS

The patients are prioritised based on the selected criteria in descending order of health situation starting from the worst to the best. The proposed framework can discriminate among mild, serious and critical conditions and put patients in a queue while considering asymptomatic carriers. Validation findings revealed that the patients are classified into four equal groups and showed significant differences in their scores, indicating the validity of ranking.

CONCLUSIONS

This study implies and discusses the numerous benefits of the suggested framework in detecting/recognising the health condition of patients prior to discharge, supporting the hospitalisation characteristics, managing patient care and optimising clinical prediction rule.

Recommendations for enhancing the usability and understandability of process mining in healthcare

Healthcare organizations are confronted with challenges including the contention between tightening budgets and increased care needs. In the light of these challenges, they are becoming increasingly aware of the need to improve their processes to ensure quality of care for patients. To identify process improvement opportunities, a thorough process analysis is required, which can be based on real-life process execution data captured by health information systems. Process mining is a research field that focuses on the development of techniques to extract process-related insights from process execution data, providing valuable and previously unknown information to instigate evidence-based process improvement in healthcare. However, despite the potential of process mining, its uptake in healthcare organizations outside case studies in a research context is rather limited. This observation was the starting point for an international brainstorm seminar. Based on the seminar's outcomes and with the ambition to stimulate a more widespread use of process mining in healthcare, this paper formulates recommendations to enhance the usability and understandability of process mining in healthcare. These recommendations are mainly targeted towards process mining researchers and the community to consider when developing a new research agenda for process mining in healthcare. Moreover, a limited number of recommendations are directed towards healthcare organizations and health information systems vendors, when shaping an environment to enable the continuous use of process mining.