Patient similarity analytics for explainable clinical risk prediction

Human-centered Design of a Health Recommender System for Orthopaedic Shoulder Treatment

Background

Rich data on diverse patients and their treatments and outcomes within Electronic Health Record (EHR) systems can be used to generate real world evidence. A health recommender system (HRS) framework can be applied to a decision support system application to generate data summaries for similar patients during the clinical encounter to assist physicians and patients in making evidence-based shared treatment decisions.

Objective

A human-centered design (HCD) process was used to develop a HRS for treatment decision support in orthopaedic medicine, the Informatics Consult for Individualized Treatment (I-C-IT). We also evaluate the usability and utility of the system from the physician's perspective, focusing on elements of utility and shared decision-making in orthopaedic medicine.

Methods

The HCD process for I-C-IT included 6 steps across three phases of analysis, design, and evaluation. A team of informaticians and comparative effectiveness researchers directly engaged with orthopaedic surgeon subject matter experts in a collaborative I-C-IT prototype design process. Ten orthopaedic surgeons participated in a mixed methods evaluation of the I-C-IT prototype that was produced.

Results

The HCD process resulted in a prototype system, I-C-IT, with 14 data visualization elements and a set of design principles crucial for HRS for decision support. The overall standard system usability scale (SUS) score for the I-C-IT Webapp prototype was 88.75 indicating high usability. In addition, utility questions addressing shared decision-making found that 90% of orthopaedic surgeon respondents either strongly agreed or agreed that I-C-IT would help them make data informed decisions with their patients.

Conclusion

The HCD process produced an HRS prototype that is capable of supporting orthopaedic surgeons and patients in their information needs during clinical encounters. Future research should focus on refining I-C-IT by incorporating patient feedback in future iterative cycles of system design and evaluation.

Decision Support for Oropharyngeal Cancer Patients Based on Data-Driven Similarity Metrics for Medical Case Comparison

Making complex medical decisions is becoming an increasingly challenging task due to the growing amount of available evidence to consider and the higher demand for personalized treatment and patient care. IT systems for the provision of clinical decision support (CDS) can provide sustainable relief if decisions are automatically evaluated and processed. In this paper, we propose an approach for quantifying similarity between new and previously recorded medical cases to enable significant knowledge transfer for reasoning tasks on a patient-level. Methodologically, 102 medical cases with oropharyngeal carcinoma were analyzed retrospectively. Based on independent disease characteristics, patient-specific data vectors including relevant information entities for primary and adjuvant treatment decisions were created. Utilizing the ϕK correlation coefficient as the methodological foundation of our approach, we were able to determine the predictive impact of each characteristic, thus enabling significant reduction of the feature space to allow for further analysis of the intra-variable distances between the respective feature states. The results revealed a significant feature-space reduction from initially 19 down to only 6 diagnostic variables (ϕK correlation coefficient ≥ 0.3, ϕK significance test ≥ 2.5) for the primary and 7 variables (from initially 14) for the adjuvant treatment setting. Further investigation on the resulting characteristics showed a non-linear behavior in relation to the corresponding distances on intra-variable level. Through the implementation of a 10-fold cross-validation procedure, we were further able to identify 8 (primary treatment) matching cases with an evaluation score of 1.0 and 9 (adjuvant treatment) matching cases with an evaluation score of 0.957 based on their shared treatment procedure as the endpoint for similarity definition. Based on those promising results, we conclude that our proposed method for using data-driven similarity measures for application in medical decision-making is able to offer valuable assistance for physicians. Furthermore, we consider our approach as universal in regard to other clinical use-cases, which would allow for an easy-to-implement adaptation for a range of further medical decision-making scenarios.