Disseminating medical knowledge: the PROforma approach

The Application of Computer Technology to Clinical Practice Guideline Implementation: A Scoping Review

Implementation of clinical practice guidelines (CPG) is a complex and challenging task. Computer technology, including artificial intelligence (AI), has been explored to promote the CPG implementation. This study has reviewed the main domains where computer technology and AI has been applied to CPG implementation. PubMed, Embase, Web of science, the Cochrane Library, China National Knowledge Infrastructure database, WanFang DATA, VIP database, and China Biology Medicine disc database were searched from inception to December 2021. Studies involving the utilization of computer technology and AI to promote the implementation of CPGs were eligible for review. A total of 10429 published articles were identified, 117 met the inclusion criteria. 21 (17.9%) focused on the utilization of AI techniques to classify or extract the relative content of CPGs, such as recommendation sentence, condition-action sentences. 47 (40.2%) focused on the utilization of computer technology to represent guideline knowledge to make it understandable by computer. 15 (12.8%) focused on the utilization of AI techniques to verify the relative content of CPGs, such as conciliation of multiple single-disease guidelines for comorbid patients. 34 (29.1%) focused on the utilization of AI techniques to integrate guideline knowledge into different resources, such as clinical decision support systems. We conclude that the application of computer technology and AI to CPG implementation mainly concentrated on the guideline content classification and extraction, guideline knowledge representation, guideline knowledge verification, and guideline knowledge integration. The AI methods used for guideline content classification and extraction were pattern-based algorithm and machine learning. In guideline knowledge representation, guideline knowledge verification, and guideline knowledge integration, computer techniques of knowledge representation were the most used.

Categorizing metadata to help mobilize computable biomedical knowledge

INTRODUCTION

Computable biomedical knowledge artifacts (CBKs) are digital objects conveying biomedical knowledge in machine-interpretable structures. As more CBKs are produced and their complexity increases, the value obtained from sharing CBKs grows. Mobilizing CBKs and sharing them widely can only be achieved if the CBKs are findable, accessible, interoperable, reusable, and trustable (FAIR+T). To help mobilize CBKs, we describe our efforts to outline metadata categories to make CBKs FAIR+T.

METHODS

We examined the literature regarding metadata with the potential to make digital artifacts FAIR+T. We also examined metadata available online today for actual CBKs of 12 different types. With iterative refinement, we came to a consensus on key categories of metadata that, when taken together, can make CBKs FAIR+T. We use subject-predicate-object triples to more clearly differentiate metadata categories.

RESULTS

We defined 13 categories of CBK metadata most relevant to making CBKs FAIR+T. Eleven of these categories (type, domain, purpose, identification, location, CBK-to-CBK relationships, technical, authorization and rights management, provenance, evidential basis, and evidence from use metadata) are evident today where CBKs are stored online. Two additional categories (preservation and integrity metadata) were not evident in our examples. We provide a research agenda to guide further study and development of these and other metadata categories.

CONCLUSION

A wide variety of metadata elements in various categories is needed to make CBKs FAIR+T. More work is needed to develop a common framework for CBK metadata that can make CBKs FAIR+T for all stakeholders.

Towards a goal-oriented methodology for clinical-guideline-based management recommendations for patients with multimorbidity: GoCom and its preliminary evaluation

Patients with chronic multimorbidity are becoming more common as life expectancy increases, making it necessary for physicians to develop complex management plans. We are looking at the patient management process as a goal-attainment problem. Hence, our aim is to develop a goal-oriented methodology for providing decision support for managing patients with multimorbidity continuously, as the patient's health state is progressing and new goals arise (e.g., treat ulcer, prevent osteoporosis). Our methodology allows us to detect and mitigate inconsistencies among guideline recommendations stemming from multiple clinical guidelines, while consulting medical ontologies and terminologies and relying on patient information standards. This methodology and its implementation as a decision-support system, called GoCom, starts with computer-interpretable clinical guidelines (CIGs) for single problems that are formalized using the PROforma CIG language. We previously published the architecture of the system as well as a CIG elicitation guide for enriching PROforma tasks with properties referring to vocabulary codes of goals and physiological effects of management plans. In this paper, we provide a formalization of the conceptual model of GoCom that generates, for each morbidity of the patient, a patient-specific goal tree that results from the PROforma engine's enactment of the CIG with the patient's data. We also present the "Controller" algorithm that drives the GoCom system. Given a new problem that a patient develops, the Controller detects inconsistencies among goals pertaining to different comorbid problems and consults the CIGs to generate alternative non-conflicted and goal-oriented management plans that address the multiple goals simultaneously. In this stage of our research, the inconsistencies that can be detected are of two types - starting vs. stopping medications that belong to the same medication class hierarchy, and detecting opposing physiological effect goals that are specified in concurrent CIGs (e.g., decreased blood pressure vs. increased blood pressure). However, the design of GoCom is modular and generic and allows the future introduction of additional interaction detection and mitigation strategies. Moreover, GoCom generates explanations of the alternative non-conflicted management plans, based on recommendations stemming from the clinical guidelines and reasoning patterns. GoCom's functionality was evaluated using three cases of multimorbidity interactions that were checked by our three clinicians. Usefulness was evaluated with two studies. The first evaluation was a pilot study with ten 6th year medical students and the second evaluation was done with 27 6th medical students and interns. The participants solved complex realistic cases of multimorbidity patients: with and without decision-support, two cases in the first evaluation and 6 cases in the second evaluation. Use of GoCom increased completeness of the patient management plans produced by the medical students from 0.44 to 0.71 (P-value of 0.0005) in the first evaluation, and from 0.31 to 0.78 (P-value < 0.0001) in the second evaluation. Correctness in the first evaluation was very high with (0.98) or without the system (0.91), with non-significant difference (P-value ≥ 0.17). In the second evaluation, use of GoCom increased correctness from 0.68 to 0.83 (P-value of 0.001). In addition, GoCom's explanation and visualization were perceived as useful by the vast majority of participants. While GoCom's detection of goal interactions is currently limited to detection of starting vs. stopping the same medication or medication subclasses and detecting conflicting physiological effects of concurrent medications, the evaluation demonstrated potential of the system for improving clinical decision-making for multimorbidity patients.

A layered computer-interpretable guideline model for easing the update of locally adapted clinical guidelines

Maintenance of computer-interpretable guidelines is complicated by evolving medical knowledge and by the requirement to customize content to local practice settings. We developed a framework to support knowledge engineers in customization and maintenance of computer-interpretable guidelines specified in the PROforma formalism. In our layered approach, the computer-interpretable guidelines containing the original clinical guideline serves as the primary layer and local customizations form secondary layers that adhere to its schema while augmenting it. Java code unifies the layers into a single enactable computer-interpretable guidelines. We performed a pilot experiment to verify the effectiveness of a layered framework. In this first attempt, we evaluated the hypothesis that the layered computer-interpretable guidelines framework supports knowledge engineers in maintenance of customized computer-interpretable guidelines. Participants who used the layered framework completed an update process of the primary knowledge in less time and made fewer errors as compared to those using the single-layer framework.

Formalization and acquisition of temporal knowledge for decision support in medical processes

BACKGROUND

In medical practice, long term interventions are common and they require timely planning of the involved processes. Unfortunately, evidence-based statements about time are hard to find in Clinical Practice Guidelines (CPGs) and in other sources of medical knowledge. At the same time, health care centers use medical records and information systems to register data about clinical processes and patients, including time information about the encounters, prescriptions, and other clinical actions. Consequently, medical records and health care information systems are promising sources of data from which we can detect temporal medical knowledge.

OBJECTIVE

The objectives were to (1) Analyze and classify the sorts of time constraints in medical processes, (2) Propose a formalism to represent these sorts of clinical time constraints, (3) Use these formalisms to enable the automatic generation of temporal models from clinical data, and (4) Study the adherence of these intervention models to CPG recommendations.

METHODS

In order to achieve these objectives, we carried out four studies: The identification of the sort of times involved in the long-term diagnostic and therapeutic medical procedures of fifty patients, the supervision of the indications about time contained in six CPGs on chronic diseases, the study of the time structures of two standard data models, as well as ten languages to computerize CPGs. Based on the provided studies, we synthesized two representation formalisms: Micro- and macro-temporality. We developed three algorithms for automatic generation of generalized time constraints in the form of micro- and macro-temporalities from clinical databases, which were double tested.

RESULTS

A full classification of time constraints for medical procedures is proposed. Two formalisms called micro- and macro-temporality are introduced and validated to represent these time constraints. Time constraints were generated automatically from the data about 8781 Arterial Hypertension (AH) patients. The generated macro-temporalities restricted visits to be between 1-7 weeks, whereas CPGs recommend 2-4 weeks. Micro-temporal constraints on drug-dosage therapies distinguished between the initial dosage and the target dosage, with visits every 1-6 weeks, and 2-5 months, respectively. Our algorithms obtained semi-complete maps of dosage increments and the maximum dosages for 7 drug types. Data-based time limits for lifestyle change counsels and blood pressure (BP) check-ups were fixed to 6 and 3 months, for patients with low- and high-BP, respectively, when CPGs specify a general 3-6 month range.

CONCLUSIONS

Experience-based temporal knowledge detected using our algorithms complements the evidence-based knowledge about clinical procedures contained in the CPGs. Our temporal model is simple and highly descriptive when dealing with general or specific time constraints' representations, offering temporal knowledge representation of varying detail. Therefore, it is capable of capturing all the temporal knowledge we can find in medical procedures, when dealing with chronic diseases. With our model and algorithms, an adherence analysis emerges naturally to detect CPG-compliant interventions, but also deviations whose causes and possible rationales can call into question CPG recommendations (e.g., our analysis of AH patients showed that the time between visits recommended by CPGs were too long for a proper drug therapy decision, dosage titration, or general follow-up).

Impulsando las directrices de la Ley de Calidad del SNS: modelos computacionales de guías de práctica clínica

La Ley de cohesión y calidad del Sistema Nacional de Salud promueve la utilización de nuevas tecnologías para hacer posible la aplicación de la evidencia científica por los profesionales sanitarios. En este sentido, existen herramientas tecnológicas, conocidas como modelos computacionales de guías de práctica clínica (computer-interpretable guidelines), que pueden ayudar a la consecución de este objetivo desde un prisma innovador. Su adopción puede llevarse a cabo de forma iterativa, teniendo un gran potencial inicial como herramientas formativas, de calidad y seguridad del paciente, en la toma de decisiones compartidas y, opcionalmente, podrán ser integradas con la historia clínica electrónica una vez sean validadas de forma rigurosa. En este artículo se presentan los avances de dichas herramientas, se revisan proyectos internacionales y experiencias propias en los que han demostrado su valor, y se ponen de manifiesto las ventajas, riesgos y limitaciones que presentan desde un punto de vista clínico.

An Environment for Guidelinebased Decision Support Systems for Outpatients Monitoring

Objectives: We propose an architecture for monitoring outpatients that relies on mobile technologies for acquiring data. The goal is to better control the onset of possible side effects between the scheduled visits at the clinic.

Methods: We analyze the architectural components required to ensure a high level of abstraction from data. Clinical practice guidelines were formalized with Alium, an authoring tool based on the PROforma language, using SNOMED-CT as a terminology standard. The Alium engine is accessible through a set of APIs that may be leveraged for implementing an application based on standard web technologies to be used by doctors at the clinic. Data sent by patients using mobile devices need to be complemented with those already available in the Electronic Health Record to generate personalized recommendations. Thus a middleware pursuing data abstraction is required. To comply with current standards, we adopted the HL7 Virtual Medical Record for Clinical Decision Support Logical Model, Release 2.

Results: The developed architecture for monitoring outpatients includes: (1) a guideline-based Decision Support System accessible through a web application that helps the doctors with prevention, diagnosis and treatment of therapy side effects; (2) an application for mobile devices, which allows patients to regularly send data to the clinic. In order to tailor the monitoring procedures to the specific patient, the Decision Support System also helps physicians with the configuration of the mobile application, suggesting the data to be collected and the associated collection frequency that may change over time, according to the individual patient’s conditions. A proof of concept has been developed with a system for monitoring the side effects of chemo-radiotherapy in head and neck cancer patients.

Conclusions: Our environment introduces two main innovation elements with respect to similar works available in the literature. First, in order to meet the specific patients’ needs, in our work the Decision Support System also helps the physicians in properly configuring the mobile application. Then the Decision Support System is also continuously fed by patient-reported outcomes.

Present Situation and Prospect of Medical Knowledge Based Systems in German-speaking Countries

Background: After a decrease of interest in classical medical expert systems, the publication activity concerning the medical application of Artificial Intelligence and the interest in medical decision support have markedly increased. Nonetheless, no systematic exploratory study has yet been carried out, which directly considers the actual fields of applications, exemplary approaches, obstacles, challenges, and future prospect as seen by pioneering users and developers in a given region.

Objectives: This paper reports the results of an online survey designed to fill this gap with the “Knowledge Based Systems” working group of the German Society for Medical Informatics, Biometry and Epidemiology (GMDS) in 2010.

Methods: The survey was based on an online questionnaire (5 single and multiple choice questions, 8 Likert-scaled items, 7 free text questions) consented to by the working group. The answers were analyzed by descriptive statistics and a qualitative analysis (bottom-up coding). All academic institutions of Medical Informatics in the German-speaking countries and contributors reporting KBS-related projects at the relevant scientific conferences and in a journal specialized in the field were invited to participate.

Results: The survey reached a response rate of 33.4%. The results show a gap between the reported obstacles of medical KBS (mainly low acceptance and rare use in clinical practice) and their future prospect as stated by the participants. Problems previously discussed in the literature like low acceptance, integration, and sustainability of KBS projects were confirmed. The current situation was characterized by naming exemplary existing systems and specifying promising fields of application.

Conclusions: The field of KBS in medicine is more diversified and has evolved beyond expectations in the German-speaking countries.

Building Chronic Kidney Disease Clinical Practice Guidelines Using the openEHR Guideline Definition Language

Background: As a result of the disease‘s high prevalence, chronic kidney disease (CKD) has become a global public health problem. A clinical decision support system that integrates with computer-interpretable guidelines (CIGs) should improve clinical outcomes and help to ensure patient safety.

Objectives: The openEHR guideline definition language (GDL) is a formal language used to represent CIGs. This study explores the feasibility of using a GDL approach for CKD; it also attempts to identify any potential gaps between the ideal concept and reality.

Methods: Using the Kidney Disease Improving Global Outcomes (KDIGO) anemia guideline as material, we designed a development workflow in order to establish a series of GDL guidelines. Focus group discussions were conducted in order to identify important issues related to GDL implementation.

Results: Ten GDL guidelines and 37 archetypes were established using the KDIGO guideline document. For the focus group discussions, 16 clinicians and 22 IT experts were recruited and their perceptions, opinions and attitudes towards the GDL approach were explored. Both groups provided positive feedback regarding the GDL approach, but raised various concerns about GDL implementation.

Conclusions: Based on the findings of this study, we identified some potential gaps that might exist during implementation between the GDL concept and reality. Three directions remain to be investigated in the future. Two of them are related to the openEHR GDL approach. Firstly, there is a need for the editing tool to be made more sophisticated. Secondly, there needs to be integration of the present approach into non openEHR-based hospital information systems. The last direction focuses on the applicability of guidelines and involves developing a method to resolve any conflicts that occur with insurance payment regulations.

Development of a computer-interpretable clinical guideline model for decision support in the differential diagnosis of hyponatremia

INTRODUCTION

Hyponatremia is the most common type of electrolyte imbalance, occurring when serum sodium is below threshold levels, typically 135mmol/L. Electrolyte balance has been identified as one of the most challenging subjects for medical students, but also as one of the most relevant areas to learn about according to physicians and researchers. We present a computer-interpretable guideline (CIG) model that will be used for medical training to learn how to improve the diagnosis of hyponatremia applying an expert consensus document (ECDs).

METHODS

We used the PROForma set of tools to develop the model, using an iterative process involving two knowledge engineers (a computer science Ph.D. and a preventive medicine specialist) and two expert endocrinologists. We also carried out an initial validation of the model and a qualitative post-analysis from the results of a retrospective study (N=65 patients), comparing the consensus diagnosis of two experts with the output of the tool.

RESULTS

The model includes over two-hundred "for", "against" and "neutral" arguments that are selectively triggered depending on the input value of more than forty patient-state variables. We share the methodology followed for the development process and the initial validation results, that achieved a high ratio of 61/65 agreements with the consensus diagnosis, having a kappa value of K=0.86 for overall agreement and K=0.80 for first-ranked agreement.

CONCLUSION

Hospital care professionals involved in the project showed high expectations of using this tool for training, but the process to follow for a successful diagnosis and application is not trivial, as reported in this manuscript. Secondary benefits of using these tools are associated to improving research knowledge and existing clinical practice guidelines (CPGs) or ECDs. Beyond point-of-care clinical decision support, knowledge-based decision support systems are very attractive as a training tool, to help selected professionals to better understand difficult diseases that are underdiagnosed and/or incorrectly managed.

COMPOSE: Using temporal patterns for interpreting wearable sensor data with computer interpretable guidelines

This paper describes a novel temporal logic-based framework for reasoning with continuous data collected from wearable sensors. The work is motivated by the Metabolic Syndrome, a cluster of conditions which are linked to obesity and unhealthy lifestyle. We assume that, by interpreting the physiological parameters of continuous monitoring, we can identify which patients have a higher risk of Metabolic Syndrome. We define temporal patterns for reasoning with continuous data and specify the coordination mechanisms for combining different sets of clinical guidelines that relate to this condition. The proposed solution is tested with data provided by twenty subjects, which used sensors for four days of continuous monitoring. The results are compared to the gold standard. The novelty of the framework stands in extending a temporal logic formalism, namely the Event Calculus, with temporal patterns. These patterns are helpful to specify the rules for reasoning with continuous data and in combining new knowledge into one consistent outcome that is tailored to the patient's profile. The overall approach opens new possibilities for delivering patient-tailored interventions and educational material before the patients present the symptoms of the disease.

Towards a quality and safety framework for point of care decision support systems

The development of new paradigms for the electronic dissemination and consultation of clinical knowledge must be accompanied by new methods for ensuring the quality of the information available. This paper sets out a possible framework for ensuring the quality, reliability and safety of machine-enactable electronic guidelines. This addresses the quality of the clinical content and the integrity of the software platform, drawing on the quality assurance principles of conventional medical publishing and formal software engineering.

Heart Cycle: facilitating the deployment of advanced care processes

Current trends in health management improvement demand the standardization of care protocols to achieve better quality and efficiency. The use of Clinical Pathways is an emerging solution for that problem. However, current Clinical Pathways are big manuals written in natural language and highly affected by human subjectivity. These problems make their deployment and dissemination extremely difficult in real practice environments. Furthermore, the intrinsic difficulties for the design of formal Clinical Pathways requires new specific design tools to help making them relly useful and cost-effective. Process Mining techniques can help to automatically infer processes definition from execution samples and, thus, support the automatization of the standardization and continuous control of healthcare processes. This way, they can become a relevant helping tool for clinical experts and healthcare systems for reducing variability in clinical practice and better understand the performance of the system.

Agent-Based Reasoning in Medical Planning and Diagnosis Combining Multiple Strategies

Medical reasoning describes a form of qualitative inquiry that examines the cognitive (thought) processes involved in making medical decision. In this field the goal for diagnostic reasoning is assessing causes of observed conditions in order to make informed choices about treatment. In order to design a diagnostic reasoning method we merge ideas from a hypothetic-deductive method and the Domino model. In this setting, we introduce the so called Hypothetic-Deductive-Domino (HD-D) algorithm. In addition, a multi-agent approach is presented, which takes advantage of the HD-D algorithm for illuminating different standpoints in a diagnostic reasoning and assessment process, and for reaching a well-founded conclusion. This multi-agent approach is based on the so called Observer and Validating agents. The Observer agents are supported by a deductive inference process and the Validating agents are supported by an abductive inference process. The knowledge bases of these agents are captured by a class of possibilistic logic programs. Hence, these agents are able to deal with qualitative information. The approach is illustrated by a real scenario from diagnosing dementia diseases.

A study of diverse clinical decision support rule authoring environments and requirements for integration

Background

Efficient rule authoring tools are critical to allow clinical Knowledge Engineers (KEs), Software Engineers (SEs), and Subject Matter Experts (SMEs) to convert medical knowledge into machine executable clinical decision support rules. The goal of this analysis was to identify the critical success factors and challenges of a fully functioning Rule Authoring Environment (RAE) in order to define requirements for a scalable, comprehensive tool to manage enterprise level rules.

Methods

The authors evaluated RAEs in active use across Partners Healthcare, including enterprise wide, ambulatory only, and system specific tools, with a focus on rule editors for reminder and medication rules. We conducted meetings with users of these RAEs to discuss their general experience and perceived advantages and limitations of these tools.

Results

While the overall rule authoring process is similar across the 10 separate RAEs, the system capabilities and architecture vary widely. Most current RAEs limit the ability of the clinical decision support (CDS) interventions to be standardized, sharable, interoperable, and extensible. No existing system meets all requirements defined by knowledge management users.

Conclusions

A successful, scalable, integrated rule authoring environment will need to support a number of key requirements and functions in the areas of knowledge representation, metadata, terminology, authoring collaboration, user interface, integration with electronic health record (EHR) systems, testing, and reporting.

Clinical care improvement with use of health information technology focusing on evidence based medicine

OBJECTIVES

Healthcare institutions need timely patient information from various sources at the point-of-care. Evidence-based medicine (EBM) is a tool for proper and efficient incorporation of the results of research in decision-making. Characteristics of medical treatment processes and practical experience concerning the effect of EBM in the clinical process are surveyed.

METHODS

A cross sectional survey conducted in Tehran hospitals in February-March 2012 among 51 clinical residents. The respondents were asked to apply EBM in clinical decision-making to answer questions about the effect of EBM in the clinical process. A valid and reliable questionnaire was used in this study.

RESULTS

EBM provides a framework for problem solving and improvement of processes. Most residents (76%) agreed that EBM could improve clinical decision making. Eighty one percent of the respondents believed that EBM resulted in quick updating of knowledge. They believed that EBM was more useful for diagnosis than for treatment. There was a significant association between out-patients and in-patients in using electronic EBM resources.

CONCLUSIONS

Research findings were useful in clinical practice and decision making. The computerized guidelines are important tools for improving clinical process quality. When learning how to use IT, methods of search and evaluation of evidence for diagnosis, treatment and medical education are necessary. Purposeful use of IT in clinical processes reduces workload and improves decision-making.

A comparison between clinical decisions made about lung cancer patients and those inherent in the corresponding Scottish Intercollegiate Guidelines Network (SIGN) guideline

Treatment and survival for patients with lung cancer vary between and within countries. We have undertaken a multifaceted study of a clinical dataset of 635 patients, to see if clinician treatment decisions were being made consistently and in accordance with the appropriate Scottish Intercollegiate Guidelines Network (SIGN) document. Subsequently, we created a dataset of 117 patients who should have undergone surgery according to the SIGN guideline. As analyses of this dataset did not provide clear distinctions between the main treatment groups, a clinician reviewed the case notes and dataset, checking for inconsistencies. The revised dataset was processed by a decision tree algorithm which suggests clinically plausible decisions. Further, statistical analyses compared the 54 patients offered surgery with the 52 who were not. These analyses suggest that there are significant differences: the most discriminating feature is significant co-morbidity (p < 0.001). The article concludes with suggestions for how future guidelines might be enhanced.

Implementation of workflow engine technology to deliver basic clinical decision support functionality

Background

Workflow engine technology represents a new class of software with the ability to graphically model step-based knowledge. We present application of this novel technology to the domain of clinical decision support. Successful implementation of decision support within an electronic health record (EHR) remains an unsolved research challenge. Previous research efforts were mostly based on healthcare-specific representation standards and execution engines and did not reach wide adoption. We focus on two challenges in decision support systems: the ability to test decision logic on retrospective data prior prospective deployment and the challenge of user-friendly representation of clinical logic.

Results

We present our implementation of a workflow engine technology that addresses the two above-described challenges in delivering clinical decision support. Our system is based on a cross-industry standard of XML (extensible markup language) process definition language (XPDL). The core components of the system are a workflow editor for modeling clinical scenarios and a workflow engine for execution of those scenarios. We demonstrate, with an open-source and publicly available workflow suite, that clinical decision support logic can be executed on retrospective data. The same flowchart-based representation can also function in a prospective mode where the system can be integrated with an EHR system and respond to real-time clinical events. We limit the scope of our implementation to decision support content generation (which can be EHR system vendor independent). We do not focus on supporting complex decision support content delivery mechanisms due to lack of standardization of EHR systems in this area. We present results of our evaluation of the flowchart-based graphical notation as well as architectural evaluation of our implementation using an established evaluation framework for clinical decision support architecture.

Conclusions

We describe an implementation of a free workflow technology software suite (available at http://code.google.com/p/healthflow) and its application in the domain of clinical decision support. Our implementation seamlessly supports clinical logic testing on retrospective data and offers a user-friendly knowledge representation paradigm. With the presented software implementation, we demonstrate that workflow engine technology can provide a decision support platform which evaluates well against an established clinical decision support architecture evaluation framework. Due to cross-industry usage of workflow engine technology, we can expect significant future functionality enhancements that will further improve the technology's capacity to serve as a clinical decision support platform.

A scalable architecture for incremental specification and maintenance of procedural and declarative clinical decision-support knowledge

Clinical guidelines have been shown to improve the quality of medical care and to reduce its costs. However, most guidelines exist in a free-text representation and, without automation, are not sufficiently accessible to clinicians at the point of care. A prerequisite for automated guideline application is a machine-comprehensible representation of the guidelines. In this study, we designed and implemented a scalable architecture to support medical experts and knowledge engineers in specifying and maintaining the procedural and declarative aspects of clinical guideline knowledge, resulting in a machine comprehensible representation. The new framework significantly extends our previous work on the Digital electronic Guidelines Library (DeGeL) The current study designed and implemented a graphical framework for specification of declarative and procedural clinical knowledge, Gesher. We performed three different experiments to evaluate the functionality and usability of the major aspects of the new framework: Specification of procedural clinical knowledge, specification of declarative clinical knowledge, and exploration of a given clinical guideline. The subjects included clinicians and knowledge engineers (overall, 27 participants). The evaluations indicated high levels of completeness and correctness of the guideline specification process by both the clinicians and the knowledge engineers, although the best results, in the case of declarative-knowledge specification, were achieved by teams including a clinician and a knowledge engineer. The usability scores were high as well, although the clinicians' assessment was significantly lower than the assessment of the knowledge engineers.

A holistic environment for the design and execution of self-adaptive clinical pathways

One of the main challenges to be confronted by modern health care, so as to increase treatment quality, is the personalization of treatment. The treatment personalization requires the continuous reconfiguration and adaptation of the selected treatment schemes according to the "current" clinical status of each patient and "current" circumstances inside a health care organization that change rapidly, as well as the updated medical knowledge. In this paper, we present an innovative software environment that provides an integrated IT solution concerning the adaptation of health care processes (clinical pathways) during execution time. The software comprises a health care process execution engine assisted by a semantic infrastructure for reconfiguring the clinical pathways. During the execution of clinical pathways, the system reasons over the rules and reconfigures the next steps of the treatment. A graphical designer interface is implemented for the definition of the rule-set for the clinical pathways adaptation in a user-friendly way.

Facilitating pre-operative assessment guidelines representation using SNOMED CT

OBJECTIVE

To investigate whether SNOMED CT covers the terms used in pre-operative assessment guidelines, and if necessary, how the measured content coverage can be improved.

METHODS

Pre-operative assessment guidelines were retrieved from the websites of (inter)national anesthesia-related societies. The recommendations in the guidelines were rewritten to "IF condition THEN action" statements to facilitate data extraction. Terms were extracted from the IF-THEN statements and mapped to SNOMED CT. Content coverage was measured by using three scores: no match, partial match and complete match. Non-covered concepts were evaluated against the SNOMED CT editorial documentation.

RESULTS

From 6 guidelines, 133 terms were extracted, of which 71% (n=94) completely matched with SNOMED CT concepts. Disregarding the vague concepts in the included guidelines SNOMED CT's content coverage was 89%. Of the 39 non-completely covered concepts, 69% violated at least one of SNOMED CT's editorial principles or rules. These concepts were categorized based on four categories: non-reproducibility, classification-derived phrases, numeric ranges, and procedures categorized by complexity.

CONCLUSION

Guidelines include vague terms that cannot be well supported by terminological systems thereby hampering guideline-based decision support systems. This vagueness reduces the content coverage of SNOMED CT in representing concepts used in the pre-operative assessment guidelines. Formalization of the guidelines using SNOMED CT is feasible but to optimize this, first the vagueness of some guideline concepts should be resolved and a few currently missing but relevant concepts should be added to SNOMED CT.

Adopting model checking techniques for clinical guidelines verification

OBJECTIVES

Clinical guidelines (GLs) are assuming a major role in the medical area, in order to grant the quality of the medical assistance and to optimize medical treatments within healthcare organizations. The verification of properties of the GL (e.g., the verification of GL correctness with respect to several criteria) is a demanding task, which may be enhanced through the adoption of advanced Artificial Intelligence techniques. In this paper, we propose a general and flexible approach to address such a task.

METHODS AND MATERIALS

Our approach to GL verification is based on the integration of a computerized GL management system with a model-checker. We propose a general methodology, and we instantiate it by loosely coupling GLARE, our system for acquiring, representing and executing GLs, with the model-checker SPIN.

RESULTS

We have carried out an in-depth analysis of the types of properties that can be effectively verified using our approach, and we have completed an overview of the usefulness of the verification task at the different stages of the GL life-cycle. In particular, experimentation on a GL for ischemic stroke has shown that the automatic verification of properties in the model checking approach is able to discover inconsistencies in the GL that cannot be detected in advance by hand.

CONCLUSION

Our approach thus represents a further step in the direction of general and flexible automated GL verification, which also meets usability requirements.

An ontology-based hierarchical semantic modeling approach to clinical pathway workflows

This paper proposes an ontology-based approach of modeling clinical pathway workflows at the semantic level for facilitating computerized clinical pathway implementation and efficient delivery of high-quality healthcare services. A clinical pathway ontology (CPO) is formally defined in OWL web ontology language (OWL) to provide common semantic foundation for meaningful representation and exchange of pathway-related knowledge. A CPO-based semantic modeling method is then presented to describe clinical pathways as interconnected hierarchical models including the top-level outcome flow and intervention workflow level along a care timeline. Furthermore, relevant temporal knowledge can be fully represented by combing temporal entities in CPO and temporal rules based on semantic web rule language (SWRL). An illustrative example about a clinical pathway for cesarean section shows the applicability of the proposed methodology in enabling structured semantic descriptions of any real clinical pathway.

Versioning computer-interpretable guidelines: semi-automatic modeling of 'Living Guidelines' using an information extraction method

OBJECTIVE

Clinical practice guidelines (CPGs) are means to provide evidence-based medical knowledge. In order to make up-to-date "best" scientific evidence available these documents need to be updated on an ongoing basis. An effective method to accomplish this aim is offered by the so-called "living guidelines": Living guidelines are documents presenting up-to-date and state-of-the-art knowledge to practitioners. To have guidelines implemented by computer-support they have to be formalized in a computer-interpretable form in a first step. Due to the complexity of such formats the formalization process is burdensome and time-consuming. Automating parts of the modeling process and, consequently, modeling updates of these guideline documents are demanded.

METHODS AND MATERIAL

The LASSIE methodology supports this task by formalizing guidelines in several steps from the textual form to the guideline representation language Asbru using a document-centric approach. LASSIE uses information extraction techniques to semi-automatically accomplish these steps. We apply LASSIE to support the implementation of living guidelines.

RESULTS

Based on a living guideline published by the Scottish Intercollegiate Guidelines Network (SIGN) we show that adaptations of previously formalized guidelines can be accomplished easily and fast. Thereby, the different versions of guideline documents are compared and updates are identified. Due to the traceable formalization method of linking text parts and their corresponding formal models, we are able to inherit unchanged models from previously formalized versions. Thus, we only need to formalize updated text parts using the semi-automatic formalization method LASSIE.

CONCLUSION

We propose a simple, time-saving, but effective method called LASSIE to formalize new guideline versions of previously formalized CPGs. Furthermore, models that have been added or modified by knowledge engineers in previous versions can also be transferred easily. This will result in a faster implementation of new guideline versions also known as living guidelines to provide up-to-date knowledge necessary for accomplishing the daily work of health care professionals.

The coming of age of artificial intelligence in medicine

This paper is based on a panel discussion held at the Artificial Intelligence in Medicine Europe (AIME) conference in Amsterdam, The Netherlands, in July 2007. It had been more than 15 years since Edward Shortliffe gave a talk at AIME in which he characterized artificial intelligence (AI) in medicine as being in its "adolescence" (Shortliffe EH. The adolescence of AI in medicine: will the field come of age in the '90s? Artificial Intelligence in Medicine 1993;5:93-106). In this article, the discussants reflect on medical AI research during the subsequent years and characterize the maturity and influence that has been achieved to date. Participants focus on their personal areas of expertise, ranging from clinical decision-making, reasoning under uncertainty, and knowledge representation to systems integration, translational bioinformatics, and cognitive issues in both the modeling of expertise and the creation of acceptable systems.

Vaidurya: a multiple-ontology, concept-based, context-sensitive clinical-guideline search engine

We designed and implemented a generic search engine (Vaidurya), as part of our Digital clinical-Guideline Library (DeGeL) framework. Two search methods were implemented in addition to full-text search: (1) concept-based search, which relies on pre-indexing the guidelines in a clinically meaningful fashion, and (2) context-sensitive search, which relies on first semi-structuring the guidelines according to a given ontology, then searching for terms within specific labeled text segments. The Vaidurya engine is fully functional and is used within the DeGeL system. We describe the Vaidurya ontological and algorithmic framework; we also briefly summarize the results of a detailed evaluation in the clinical-guideline domain, demonstrating that both concept-based and context-sensitive ontology-independent search are highly feasible and significantly improve on free text search retrieval performance. We conclude by analyzing the limitations and advantages of the approach, and the steps that we have started to take to extend it based on user feedback.

A pattern-based analysis of clinical computer-interpretable guideline modeling languages

OBJECTIVES

Languages used to specify computer-interpretable guidelines (CIGs) differ in their approaches to addressing particular modeling challenges. The main goals of this article are: (1) to examine the expressive power of CIG modeling languages, and (2) to define the differences, from the control-flow perspective, between process languages in workflow management systems and modeling languages used to design clinical guidelines.

DESIGN

The pattern-based analysis was applied to guideline modeling languages Asbru, EON, GLIF, and PROforma. We focused on control-flow and left other perspectives out of consideration.

MEASUREMENTS

We evaluated the selected CIG modeling languages and identified their degree of support of 43 control-flow patterns. We used a set of explicitly defined evaluation criteria to determine whether each pattern is supported directly, indirectly, or not at all.

RESULTS

PROforma offers direct support for 22 of 43 patterns, Asbru 20, GLIF 17, and EON 11. All four directly support basic control-flow patterns, cancellation patterns, and some advance branching and synchronization patterns. None support multiple instances patterns. They offer varying levels of support for synchronizing merge patterns and state-based patterns. Some support a few scenarios not covered by the 43 control-flow patterns.

CONCLUSION

CIG modeling languages are remarkably close to traditional workflow languages from the control-flow perspective, but cover many fewer workflow patterns. CIG languages offer some flexibility that supports modeling of complex decisions and provide ways for modeling some decisions not covered by workflow management systems. Workflow management systems may be suitable for clinical guideline applications.

Towards a comprehensive treatment of repetitions, periodicity and temporal constraints in clinical guidelines

OBJECTIVE

In this paper, we define a principled approach to represent temporal constraints in clinical guidelines and to reason (i.e., perform inferences in the form of constraint propagation) on them. We consider different types of constraints, including composite and repeated actions, and propose different types of temporal functionalities (e.g., temporal consistency checking).

BACKGROUND

Constraints about actions, durations, delays and periodic repetitions of actions are an intrinsic part of most clinical guidelines. Although several approaches provide expressive temporal formalisms, only few of them deal with the related temporal reasoning issues.

METHODOLOGY

We first propose a temporal representation formalism and two temporal reasoning algorithms. Then, we consider the trade-off between the expressiveness of the formalism and the computational complexity of the algorithms, in order to devise a correct, complete and tractable approach. Finally, we show how the algorithms can be exploited to provide clinical guideline systems with different types of temporal facilities.

RESULTS

Our approach offers several advantages. During the guideline acquisition phase, it enables to represent temporal constraints, and to check their consistency. In the execution phase, it checks the consistency between the execution times of the actions and the constraints in the guidelines, and provides query answering and simulation facilities.