Streamlining patient consultations for sleep disorders with a knowledge-based CDSS

A comparative patient-level prediction study in OMOP CDM: applicative potential and insights from synthetic data

The emergence of collaborations, which standardize and combine multiple clinical databases across different regions, provide a wealthy source of data, which is fundamental for clinical prediction models, such as patient-level predictions. With the aid of such large data pools, researchers are able to develop clinical prediction models for improved disease classification, risk assessment, and beyond. To fully utilize this potential, Machine Learning (ML) methods are commonly required to process these large amounts of data on disease-specific patient cohorts. As a consequence, the Observational Health Data Sciences and Informatics (OHDSI) collaborative develops a framework to facilitate the application of ML models for these standardized patient datasets by using the Observational Medical Outcomes Partnership (OMOP) common data model (CDM). In this study, we compare the feasibility of current web-based OHDSI approaches, namely ATLAS and "Patient-level Prediction" (PLP), against a native solution (R based) to conduct such ML-based patient-level prediction analyses in OMOP. This will enable potential users to select the most suitable approach for their investigation. Each of the applied ML solutions was individually utilized to solve the same patient-level prediction task. Both approaches went through an exemplary benchmarking analysis to assess the weaknesses and strengths of the PLP R-Package. In this work, the performance of this package was subsequently compared versus the commonly used native R-package called Machine Learning in R 3 (mlr3), and its sub-packages. The approaches were evaluated on performance, execution time, and ease of model implementation. The results show that the PLP package has shorter execution times, which indicates great scalability, as well as intuitive code implementation, and numerous possibilities for visualization. However, limitations in comparison to native packages were depicted in the implementation of specific ML classifiers (e.g., Lasso), which may result in a decreased performance for real-world prediction problems. The findings here contribute to the overall effort of developing ML-based prediction models on a clinical scale and provide a snapshot for future studies that explicitly aim to develop patient-level prediction models in OMOP CDM.

The Application of Knowledge-Based Clinical Decision Support Systems to Enhance Adherence to Evidence-Based Medicine in Chronic Disease

Among the technology-based solutions, clinical decision support systems (CDSSs) have the ability to keep up with clinicians with the latest evidence in a smart way. Hence, the main objective of our study was to investigate the applicability and characteristics of CDSSs regarding chronic disease. The Web of Science, Scopus, OVID, and PubMed databases were searched using keywords from January 2000 to February 2023. The review was completed according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses checklist. Then, an analysis was done to determine the characteristics and applicability of CDSSs. The quality of the appraisal was assessed using the Mixed Methods Appraisal Tool checklist (MMAT). A systematic database search yielded 206 citations. Eventually, 38 articles from sixteen countries met the inclusion criteria and were accepted for final analysis. The main approaches of all studies can be classified into adherence to evidence-based medicine (84.2%), early and accurate diagnosis (81.6%), identifying high-risk patients (50%), preventing medical errors (47.4%), providing up-to-date information to healthcare providers (36.8%), providing patient care remotely (21.1%), and standardizing care (71.1%). The most common features among the knowledge-based CDSSs included providing guidance and advice for physicians (92.11%), generating patient-specific recommendations (84.21%), integrating into electronic medical records (60.53%), and using alerts or reminders (60.53%). Among thirteen different methods to translate the knowledge of evidence into machine-interpretable knowledge, 34.21% of studies utilized the rule-based logic technique while 26.32% of studies used rule-based decision tree modeling. For CDSS development and translating knowledge, diverse methods and techniques were applied. Therefore, the development of a standard framework for the development of knowledge-based decision support systems should be considered by informaticians.

A pragmatic methodical framework for the user-centred development of an electronic process support for the sleep laboratory patients' management

OBJECTIVE

Limited capacities and ineffective care pathways result in long waiting times for patients and sporadic treatment controls in sleep medicine. As one objective of the 'Telesleep Medicine' project, a portal should be developed, which supports sleep specialists in an efficient and resource-saving patient management. On account of the limited project timeframe, the 'classical' user-centred design and evaluation methods could not be comprehensively implemented. Therefore, a pragmatic methodical framework was developed.

METHODS

For the iterative development of the portal, a combination of low-cost and quick-to-implement methods was used. In chronological order, these were: context interviews, personas, the development of an as-is model, a web search of design standards and good design aspects of similar systems, the development of a to-be model, the creation of an overarching mind map, and the iterative creation of mockups with simplified usability walkthroughs.

RESULTS

The feasibility of the pragmatic methodological framework for the development of a prototype for the portal was demonstrated. The used method combination resulted in a prototype based on the needs and requirements of the sleep specialists, taking into account their specific workflow and the technical implementation conditions.

CONCLUSIONS

The presented pragmatic methodological framework can be a valuable resource for developers of comparable projects. The combination of methods worked well together regarding the limited timeframe and resources for concept development. For the future, we plan to implement and test the portal in the clinical field and thus enrich our framework with additional methods.