Personally meaningful recovery in people with psychological trauma: Initial validity and reliability of the Individual Recovery Outcomes Counter (I.ROC)

Personal recovery self-report outcome measures in serious mental illness: A systematic review of measurement properties

BACKGROUND

Personal recovery represents a paradigm shift in mental healthcare. Validated self-report outcome measures (PROMs) are needed to facilitate the transformation towards recovery-oriented practices and services. Objectives were to identify published measures and analyze their measurement properties using a standardized methodology.

METHODS

Following the COSMIN guidelines, we conducted a systematic review of personal recovery PROMs in serious mental illness. The MEDLINE, PMC, PsycINFO, PsycARTICLES, PBSC and Scopus electronic databases were searched for articles published between May 2012 and February 2024. Full-text articles from a previous systematic review were also examined.

RESULTS

91 studies were included in the review, describing 25 PROMs. Ten of them had not been identified in previous reviews. Quality of evidence was globally poor for most PROM measurement properties. Very little evidence was found for cross-cultural validity, measurement invariance, measurement error and criterion validity. The Recovery Assessment Scale and Questionnaire about the Process of Recovery showed the strongest evidence for sufficient psychometric data on a wide range of measurement properties.

CONCLUSIONS

Several personal recovery measures are now available. While research is still needed to enhance their validity on some psychometric properties, the current tools appear sufficient to cover most research and clinical needs.

Mental Health Recovery Using the Individual Recovery Outcomes Counter (I.ROC) in a Community Rehabilitation Team: A Service Evaluation

There are many definitions of recovery in mental health. Community Rehabilitation Teams (CRTs) aim to support the mental health recovery of people. The Individual Recovery Outcomes Counter (I.ROC) is a way to measure recovery. To determine if being supported by a CRT helps mental health recovery for people transitioning from an inpatient service to the community. Individual reliable and clinically meaningful change indices were calculated for a total of 31 people. Two I.ROC questionnaires were completed by 31 people. Of these 31 people, 14 people had three completed I.ROC questionnaires. Of the 31 people, 17 showed a positive reliable change and three people made a clinically meaningful change. Of the 14 people, one had a positive reliable change, two had a negative reliable change, and no-one had a clinically meaningful change. The I.ROC shows the CRT to successfully support recovery in people with mental health difficulties.

Measuring personal recovery in a low-intensity community mental healthcare setting: validation of the Dutch version of the individual recovery outcomes counter (I.ROC)

BACKGROUND

Measuring progress in treatment is essential for systematic evaluation by service users and their care providers. In low-intensity community mental healthcare, a questionnaire to measure progress in treatment should be aimed at personal recovery and should require little effort to complete.

METHODS

The Individual Recovery Outcome Counter (I.ROC) was translated from English into Dutch, and psychometric evaluations were performed. Data were collected on personal recovery (Recovery Assessment Scale), quality of life (Manchester Short Assessment of Quality of Life), and symptoms of mental illness and social functioning (Outcome Questionnaire, OQ-45) for assessing the validity of the I.ROC. Test-retest reliability was evaluated by calculating the Intraclass Correlation Coefficient and internal consistency was evaluated by calculating Cronbach's alpha. Exploratory factor analysis was performed to determine construct validity. To assess convergent validity, the I.ROC was compared to relevant questionnaires by calculating Pearson correlation coefficients. To evaluate discriminant validity, I.ROC scores of certain subgroups were compared using either a t-test or analysis of variance.

RESULTS

There were 764 participants in this study who mostly completed more than one I.ROC (total n = 2,863). The I.ROC aimed to measure the concept of personal recovery as a whole, which was confirmed by a factor analysis. The test-retest reliability was satisfactory (Intraclass Correlation Coefficient is 0.856), as were the internal consistency (Cronbachs Alpha is 0.921) and the convergent validity. Sensitivity to change was small, but comparable to that of the OQ-45.

CONCLUSIONS

The Dutch version of the I.ROC appears to have satisfactory psychometric properties to warrant its use in daily practice. Discriminant validity and sensitivity to change need further research.