Preferences for Predictive Model Characteristics among People Living with Chronic Lung Disease: A Discrete Choice Experiment

Background. Patients may find clinical prediction models more useful if those models accounted for preferences for false-positive and false-negative predictive errors and for other model characteristics. Methods. We conducted a discrete choice experiment to compare preferences for characteristics of a hypothetical mortality prediction model among community-dwelling patients with chronic lung disease recruited from 3 clinics in Philadelphia. This design was chosen to allow us to quantify "exchange rates" between different characteristics of a prediction model. We provided previously validated educational modules to explain model attributes of sensitivity, specificity, confidence intervals (CI), and time horizons. Patients reported their interest in using prediction models themselves or having their physicians use them. Patients then chose between 2 hypothetical prediction models each containing varying levels of the 4 attributes across 12 tasks. Results. We completed interviews with 200 patients, among whom 95% correctly chose a strictly dominant model in an internal validity check. Patients' interest in predictive information was high for use by themselves (n = 169, 85%) and by their physicians (n = 184, 92%). Interest in maximizing sensitivity and specificity were similar (0.88 percentage points of specificity equivalent to 1 point of sensitivity, 95% CI 0.72 to 1.05). Patients were willing to accept a reduction of 6.10 months (95% CI 3.66 to 8.54) in the predictive time horizon for a 1% increase in specificity. Discussion. Patients with chronic lung disease can articulate their preferences for the characteristics of hypothetical mortality prediction models and are highly interested in using such models as part of their care. Just as clinical care should become more patient centered, so should the characteristics of predictive models used to guide that care.

Use of Patient-Reported Data to Match Depression Screening Intervals With Depression Risk Profiles in Primary Care Patients With Diabetes: Development and Validation of Prediction Models for Major Depression

Background

Clinical guidelines recommend screening for depression in the general adult population but recognizes that the optimum interval for screening is unknown. Ideal screening intervals should match the patient risk profiles.

Objective

This study describes a predictive analytics approach for mining clinical and patient-reported data from a large clinical study for the identification of primary care patients at high risk for depression to match depression screening intervals with patient risk profiles.

Methods

This paper analyzed data from a large safety-net primary care study for diabetes and depression. A regression-based data mining technique was used to examine 53 demographics, clinical variables, and patient-reported variables to develop three prediction models for major depression at 6, 12, and 18 months from baseline. Predictors with the strongest predictive power that require low information collection efforts were selected to develop the prediction models. Predictive accuracy was measured by the area under the receiver operating curve (AUROC) and was evaluated by 10-fold cross-validation. The effectiveness of the prediction algorithms in supporting clinical decision making for six “typical” types of patients was demonstrated.

Results

The analysis included 923 patients who were nondepressed at the study baseline. Five patient-reported variables were selected in the prediction models to predict major depression at 6, 12, and 18 months: (1) Patient Health Questionnaire 2-item score; (2) the Sheehan Disability Scale; (3) previous problems with depression; (4) the diabetes symptoms scale; and (5) emotional burden of diabetes. All three depression prediction models had an AUROC>0.80, comparable with published depression prediction studies. Among the 6 “typical” types of patients, the algorithms suggest that patients who reported impaired daily functioning by health status are at an elevated risk for depression in all three periods.

Conclusions

This study demonstrated that leveraging patient-reported data and prediction models can help improve identification of high-risk patients and clinical decisions about the depression screening interval for diabetes patients. Implementation of this approach can be coupled with application of modern technologies such as telehealth and mobile health assessment for collecting patient-reported data to improve privacy, reducing stigma and costs, and promoting a personalized depression screening that matches screening intervals with patient risk profiles.

A Heart Set on Living

Quality of life is a highly subjective element on which to base health care decision making. This narrative reflection after the death of a family member uses poetry as a prompt to explore themes related to quality of life-including symptom burden, interpersonal relationships in the face of illness, and the will to live. Through penetrating inquiry and reflection, physicians and other care providers can gain insight into the underlying motivations, loyalties, and abilities that lend meaning to patients' lives and shape attitudes toward death and dying. By better recognizing and appreciating these factors, clinicians can develop patient-centered quality-of-life constructs that empower them to honor patient goals and preferences at the end of life. Physicians are encouraged to explore poetry and other artistic media to help foster the reflective capacity required to deeply understand and faithfully serve patients in this regard.