From obligation to opportunity: future of patient-reported outcome measures at the Veterans Health Administration

Awareness of illness moderates self-assessment of psychotic symptoms

OBJECTIVE

Self-reports or patient-reported outcome measures are seldom used in psychosis due to concerns about the ability of patients to accurately report their symptomatology, particularly in cases of low awareness of illness. The aim of this study was to assess the effect of insight on the accuracy of self-reported psychotic symptoms using a computerized adaptive testing tool (CAT-Psychosis).

METHODS

A secondary analysis of data drawn from the CAT-Psychosis development and validation study was performed. The Brief Psychiatric Rating Scale and the Scale of Unawareness of Mental Disorders were administered by clinicians. Patients completed the self-reported version of the CAT-Psychosis. Patients were median-split regarding their insight level to compare the correlation between the two psychosis severity measures. A subgroup sensitivity analysis was performed only on patients with schizophrenia spectrum disorders.

RESULTS

A total of 159 patients with a psychotic disorder who completed both CAT-Psychosis and Scale of Unawareness of Mental Disorders were included. For the whole sample, CAT-Psychosis scores showed convergent validity with Brief Psychiatric Rating Scale ratings (r = 0.517, 95% confidence interval = [0.392, 0.622], p < 0.001). Insight was found to moderate this correlation (β = -0.511, p = 0.005), yet agreement between both measures remained statistically significant for both high (r = 0.621, 95% confidence interval = [0.476, 0.733], p < 0.001) and low insight patients (r = 0.408, 95% confidence interval = [0.187, 0.589], p < 0.001), while psychosis severity was comparable between these groups (for Brief Psychiatric Rating Scale: U = 3057, z = -0.129, p = 0.897; disorganization: U = 2986.5, z = -0.274, p = 0.784 and for CAT-Psychosis: U = 2800.5, z = -1.022, p = 0.307). Subgroup of patients with schizophrenia spectrum disorders showed very similar results.

CONCLUSIONS

Insight moderates the correlation between self-reported and clinician-rated severity of psychosis, yet CAT-Psychosis remains valid in patients with both high and low awareness of illness.

Using patient-reported outcome measures in psychiatric hospital care: an observational study describing an iterative implementation process in Denmark

BACKGROUND

Patient-reported outcomes (PROs) are increasingly recognized as valuable sources of information to enhance our understanding of the quality of healthcare from the patient's perspective.

OBJECTIVE

This study aimed to describe the implementation process of the Danish nationwide PRO-Psychiatry project, including iterative tests of previously developed PRO measurement concept and an online data collection tool. Additional aims were to identify the 'best practice' for the routine use of PROs in hospital-based psychiatry and design information material about the project.

METHODS

We conducted an action-oriented observational study to explore the pilot implementation of the PRO-Psychiatry project, which was initiated in February 2018. The study was based on an iterative plan-do-learn approach. An inpatient unit and an outpatient unit from the same psychiatric department in the North Denmark Region were selected for the pilot implementation. The implementation was anchored in multidisciplinary implementation teams at unit level. These teams managed the implementation process according to four tasks defined by the department management.

RESULTS

The teams designed, tested, evaluated and adjusted the localized work practices relating to the use of PRO-Psychiatry. The comprehensibility of the predesigned PROs, the usability of the Information Technology(IT) system and the routine use of PROs during clinical consultations were repeatedly tested and adjusted until the functionality was satisfactory. Furthermore, the teams designed information material for patients (emails, posters, handouts and webpages) and clinicians (online clinical guidelines). The team members informed their colleagues about the progress of PRO-Psychiatry at staff meetings and rolled out the initiative through one-to-one teaching.

CONCLUSIONS

The pilot implementation was deemed successful. PRO-Psychiatry was rolled out to other units in the region, and a national decision was made to pilot implement the initiative in the other four Danish regions.

Evaluating the implementation and use of patient-reported outcome measures in a mental health hospital in Denmark: a qualitative study

BACKGROUND

Reporting of barriers and successes associated with the implementation and use of patient-reported outcomes (PROs) is limited as a means to ensure enhanced patient involvement, shared decision-making and improved treatment and care. We set out to evaluate the implementation and use of the PRO-Psychiatry initiative on patient-reported outcome measures in Danish mental health care. We aimed to described four specific areas: the quality of the clinical consultations before and after the implementation of PRO-Psychiatry as perceived by the patients (objective A), the motivation for participating in PRO-Psychiatry as perceived by patients and clinicians (objective B), the implementation process as perceived by patients, clinicians and managers (objective C) and suggestions for improvement (objective D).

METHODS

The PRO-Psychiatry initiative was evaluated through a participatory approach, including patients, clinicians and managers. A repeated cross-sectional interview-based survey explored the quality of the clinical consultation before and after the implementation of PRO-Psychiatry. A three-step semi-structured group interview, inspired by the modified mini-Delphi method, was used to establish consensus on the evaluation of the implementation and use of the initiative.

RESULTS

The evaluation pointed at PRO-Psychiatry as a meaningful initiative, which motivated patients and supported clinicians. The patients emphasised the importance of PROs, but they also found that PROs were not used enough. Clinically relevant improvements were detected after the implementation of the initiative; more patients felt heard and experienced that clinicians took a greater interest in their problems. The clinicians valued the easily accessible real-time graphical display of the PRO responses in the electronic health record (EHR). Clinicians and managers agreed that clinical PRO practices, patient compliance and use of PROs in treatment and care should be supported during implementation.

CONCLUSION

The evaluation was overall positive. Patients and clinicians were willing to participate, found the online reporting easy and valued the direct access to PRO responses in the EHR. An essential feature was the integration of well-defined and functional PRO practices into the existing clinical workflow. Using PROs in the clinical sessions in a way that was palpable to the patient was found to be a significant improvement need. At the individual level, PRO-Psychiatry can use patient outcome information to support dialogue, encourage shared decision-making and promote self-management during recovery. At the aggregated patient level, the PROs can be used for monitoring the patient-perceived quality of care and for research.