Are we ready for conformance checking in healthcare? Measuring adherence to clinical guidelines: A scoping systematic literature review

Re-ordered fuzzy conformance checking for uncertain clinical records

Modern hospitals implement clinical pathways to standardize patients' treatments. Conformance checking techniques provide an automated tool to assess whether the actual executions of clinical processes comply with the corresponding clinical pathways. However, clinical processes are typically characterized by a high degree of uncertainty, both in their execution and recording. This paper focuses on uncertainty related to logging clinical processes. The logging of the activities executed during a clinical process in the hospital information system is often performed manually by the involved actors (e.g., the nurses). However, such logging can occur at a different time than the actual execution time, which hampers the reliability of the diagnostics provided by conformance checking techniques. To address this issue, we propose a novel conformance checking algorithm that leverages principles of fuzzy set theory to incorporate experts' knowledge when generating conformance diagnostics. We exploit this knowledge to define a fuzzy tolerance in a time window, which is then used to assess the magnitude of timestamp violations of the recorded activities when evaluating the overall process execution compliance. Experiments conducted on a real-life case study in a Dutch hospital show that the proposed method obtains more accurate diagnostics than the state-of-the-art approaches. We also consider how our diagnostics can be used to stimulate discussion with domain experts on possible strategies to mitigate logging uncertainty in the clinical practice.

Inferring actual treatment pathways from patient records

OBJECTIVE

Treatment pathways are step-by-step plans outlining the recommended medical care for specific diseases; they get revised when different treatments are found to improve patient outcomes. Examining health records is an important part of this revision process, but inferring patients' actual treatments from health data is challenging due to complex event-coding schemes and the absence of pathway-related annotations. The objective of this study is to develop a method for inferring actual treatment steps for a particular patient group from administrative health records - a common form of tabular healthcare data - and address several technique- and methodology-based gaps in treatment pathway-inference research.

METHODS

We introduce Defrag, a method for examining health records to infer the real-world treatment steps for a particular patient group. Defrag learns the semantic and temporal meaning of healthcare event sequences, allowing it to reliably infer treatment steps from complex healthcare data. To our knowledge, Defrag is the first pathway-inference method to utilise a neural network (NN), an approach made possible by a novel, self-supervised learning objective. We also developed a testing and validation framework for pathway inference, which we use to characterise and evaluate Defrag's pathway inference ability, establish benchmarks, and compare against baselines.

RESULTS

We demonstrate Defrag's effectiveness by identifying best-practice pathway fragments for breast cancer, lung cancer, and melanoma in public healthcare records. Additionally, we use synthetic data experiments to demonstrate the characteristics of the Defrag inference method, and to compare Defrag to several baselines, where it significantly outperforms non-NN-based methods.

CONCLUSIONS

Defrag offers an innovative and effective approach for inferring treatment pathways from complex health data. Defrag significantly outperforms several existing pathway-inference methods, but computationally-derived treatment pathways are still difficult to compare against clinical guidelines. Furthermore, the open-source code for Defrag and the testing framework are provided to encourage further research in this area.