Exploration of the psychometric properties of the Clinical Outcomes in Routine Evaluation-Outcome Measure in Ecuador

Routine Outcome Monitoring from Psychotherapists' Perspectives: A Framework Analysis Study of Expected Benefits and Difficulties

Psychotherapists' attitudes and expectations towards routine outcome monitoring can impact the likelihood of its fruitful implementation. While existing studies have predominantly focused on Europe and North America, research in Latin America remains limited. The aim of this study is to explore therapists' expected benefits and difficulties prior to implementing a routine outcome monitoring system in a university psychotherapy service in Ecuador. An exploratory and descriptive cross-sectional qualitative study was carried out with 20 participants aged 21 to 47. Semi-structured interviews were conducted to explore participants' knowledge about routine outcome monitoring, their expectations of the difficulties, benefits, usability and risks of using a monitoring system, as well as their expectations about their role in the process. The data analysis adhered to the framework analysis methodology, leading to the identification of six overarching themes, 36 specific themes and 82 subthemes. The interviews highlighted a spectrum of positive and negative expectations at several levels: institutional/general, therapeutic process, therapists, and clients. Perceived benefits encompassed various aspects, including the availability of supplementary information, continuous adaptation of the therapeutic process, facilitation of organization and treatment planning, opportunities for professional development, and fostering patient trust and empowerment. On the other hand, anticipated difficulties comprised concerns such as discomfort among therapists and clients, increased workload, system usage and technical difficulties, and the risk of excessive quantification. Overall, participants expressed more anticipated benefits than difficulties. We present recommendations that can support and optimize the current local implementation efforts of routine outcome monitoring, both within this service and in other settings. These recommendations consider ways to meet positive expectations and address or mitigate negative ones.

Assessing the suitability and psychometric properties of the Spanish version of the YP-CORE for adolescents in Latin America: a study in Ecuador

BACKGROUND

This study had two main objectives: firstly, to assess the suitability of the Spanish translation of the Young Person's Clinical Outcome in Routine Evaluation (YP-CORE) for use in Latin America, and secondly, to investigate its psychometric properties specifically with Ecuadorian adolescents.

METHODS

The research consisted of two phases. In Phase 1, insights were gathered from 19 adolescents and 12 experts regarding their comprehension of the YP-CORE. Based on the feedback received during this phase, a revised version of the YP-CORE was developed. In Phase 2, a psychometric assessment of this modified version was conducted with 298 adolescents in Ecuador, aged 11 to 17 years.

RESULTS

The psychometric analysis revealed that this adapted version of the YP-CORE demonstrated satisfactory levels of acceptability, internal consistency, and test-retest reliability. The factor analysis favored a two-factor model over a single factor, yet the minimal substantive distinctions between these two factors do not justify the use of subscale scoring. Furthermore, the scores indicated age-related differences, with older adolescents (aged 14 to 17 years) obtaining higher scores, and gender-related variations, with females scoring higher.

CONCLUSIONS

This study addresses the need for, and provides, a Spanish-adapted YP-CORE tailored for use in Latin America. This freely available version has the potential to offer valuable insights into interventions for adolescents in the region and to enhance our understanding of their psychological distress.

Psychometric properties of the Spanish version of the Clinical Outcomes in Routine Evaluation Outcome Measure (CORE-OM) in Chile

OBJECTIVE

To examine the psychometric properties of the Spanish version of the 34-item Clinical Outcomes in Routine Evaluation-Outcome Measure questionnaire (CORE-OM).

METHOD

Psychometric exploration was conducted in two samples: non-clinical (n = 706) and clinical (n = 420) participants. The non-clinical sample comprised a subgroup of community members (n = 308) and students (n = 398). The clinical sample consisted of self-reported patients (n = 209) and outpatients (n = 211). The analysis included both internal and test-retest reliability, convergent validity, and principal component analysis. A reliable change index and clinical cut-off scores were established for assessing clinically significant change.

RESULTS

The Spanish CORE-OM demonstrated good internal consistency and test-retest reliability, along with satisfactory convergent validity against the 45-item Outcome Questionnaire (OQ-45.2). There were strong differentiations between the clinical and non-clinical samples and the four sample subsets. The outpatient group reported the highest scores, while the community group exhibited the lowest scores. There were no marked gender effects. All observed patterns aligned closely with the established Spanish referential data.

CONCLUSION

Our findings provide support for the utilization of the Spanish CORE-OM as a measure for tracking psychotherapeutic progress in the context of Chile.

The Importance of Conducting Practice-oriented Research with Underserved Populations

There has been a growing emphasis on dissemination of empirically supported treatments. Dissemination, however, should not be restricted to treatment. It can and, in the spirit of the scientific-practitioner model, should also involve research. Because it focuses on the investigation of clinical routine as it takes place in local settings and because it can involve the collaboration of several stakeholders, practice-oriented research (POR) can be viewed as an optimal research method to be disseminated. POR has the potential of addressing particularly relevant gaps of knowledge and action when implemented in regions of the world that have limited resources for or experiences with empirical research, and/or in clinical settings that are serving clinical populations who are not typically receiving optimal mental care services - specifically, individuals in rural and inner cities that have limited economic and social resources. The establishment and maintenance of POR in such regions and/or settings, however, come with specific obstacles and challenges. Integrating the experiences acquired from research conducted in various continents (Africa, Europe, Latin America, and North America), the goal of this paper is to describe some of these challenges, strategies that have been implemented to address them, as well as new possible directions to facilitate the creation and growth of POR. It also describes how these challenges and ways to deal with them can provide helpful lessons for already existing POR infrastructures.

Fostering practice-based evidence through routine outcome monitoring in a university psychotherapy service for common mental health problems: a protocol for a naturalistic, observational study

INTRODUCTION

Data-informed psychotherapy and routine outcome monitoring are growing as referents in psychotherapy research and practice. In Ecuador, standardised web-based routine outcome monitoring systems have not been used yet, precluding data-driven clinical decisions and service management. Hence, this project aims at fostering and disseminating practice-based evidence in psychotherapy in Ecuador by implementing a web-based routine outcome monitoring system in a university psychotherapy service.

METHODS AND ANALYSES

This is a protocol for an observational naturalistic longitudinal study. Progress and outcomes of treatment in the Centro de Psicología Aplicada of the Universidad de Las Américas in Quito, Ecuador will be examined. Participants will be adolescents and adults (≥11 years) seeking treatment, as well as therapists and trainees working at the centre between October 2022 and September 2025. Clients' progress will be monitored by a range of key variables: psychological distress, ambivalence to change, family functioning, therapeutic alliance and life satisfaction. Sociodemographic information and satisfaction with treatment data will be collected before and at the end of treatment, respectively. Also, semi-structured interviews to explore therapists' and trainees' perceptions, expectations and experiences will be conducted. We will analyse first contact data, psychometrics of the measures, reliable and clinically significant change, outcome predictors as well as trajectories of changes. Moreover, we will conduct a framework analysis for the interviews.

ETHICS AND DISSEMINATION

The protocol for this study was approved by the Human Research Ethics Committee of the Pontificia Universidad Católica del Ecuador (#PV-10-2022). The results will be disseminated in peer-reviewed scientific articles, at conferences and in workshops.

TRIAL REGISTRATION NUMBER

NCT05343741.

A comparison of mental health of student and not student emerging adults living in Ecuador

Most of the studies about mental health and quality of life of emerging adults have been conducted in developed countries and non-students' population has been neglected, limiting the generalisation of the results to other socioeconomic realities. This paper reports the results of an observational study on differences between the two cohorts (students vs non-students) both on mental health and quality of life measures but also on demographic, lifestyle and mental health variables in emerging adults living in a middle-income country. Associations between variables and interactions in the prediction of both outcomes scores were explored to understand how much other variables may contribute to differences between the two groups. We found poorer mental health and worse health-related quality of life in the students than the non-students, although effect sizes were small. Differences between the groups on some sociodemographic predictor variables were statistically significant, showing fairly strong effects, for social status, sleeping hours and parenting, however, none of the predictor variables showed confounding with group effects on both outcomes. Developing countries are growing and work forces are changing, creating a huge global need to understand these changes and the effects on the mental health and quality of life of this evolving population.Registration: ClinicalTrials.gov (NCT04596345).

Trajectories of success and/or distress: protocol for an observational cohort study investigating changing psychological distress among emerging Ecuadorian adults over a year

INTRODUCTION

Emerging adulthood is a period of instability with changes in personal relationships and often a series of job changes before life trajectories clarify and more lasting decisions are possible. These changes often produce distress, and they might explain why most of the symptoms that impact the individual's mental health throughout their lives appear at this stage, although full-blown disorders are often only diagnosed subsequently. The objective of this study is to analyse the intraindividual changes in psychological distress and health-related quality of life in both student and non-student emerging adults over 1 year. Between-individual differences in variability will be analysed and life events will be recorded to identify possible associations.

METHODS AND ANALYSIS

Participants will be emerging adults (18-29 years of age) students and non-students. The primary outcome will be psychological distress measured using the Clinical Outcomes in Routine Evaluation-Outcome Measure and the secondary outcome will be health-related quality of life measured by the EuroQol five-dimension-three-level. Sociodemographic and life events will be recorded. Information will be collected using an online survey.Analyses, described in a data analysis plan with the registration, will check the psychometric properties of the measures, describe the distribution of scores on the outcome measures, their relationship to group and other demographic variables and how they change over the seven assessment points across a year and explore any relationship between scores and life events.

ETHICS AND DISSEMINATION

This study received ethical approval by the Comité de Ética y Bioética (Ethics and Bioethics Committee) of the Universidad de Las Américas, Quito-Ecuador (2020-0807). Results will be published in peer-reviewed journals and presented at relevant meetings. Brief reports of these publications will be disseminated using social media to reach the community and private or public organisations interested in emerging adults.

TRIAL REGISTRATION NUMBER

NCT04596345.

"Infeliz" or "Triste": A Paradigm for Mixed Methods Exploration of Outcome Measures Adaptation Across Language Variants

The literature on measure translation tends to hold, overtly or covertly, a questionable assumption about the possibility of exact translation and almost completely ignores issues of within language variation. Equally, psychometric methods used to assess cross-cultural validity after translation focus on large sample tests of cross-sectional measurement invariance. Such invariance is often not found and is of dubious pertinence to change/outcome measures usually used in psychotherapy research. We present a sequential process of three substudies using quantitative and qualitative procedures to explore whether an outcome measure needs to be changed when used across language variation. Qualitative data confirmed that an item was not ideal in the new context. However, quantitative exploration showed that, although statistically significant and affected by gender and item order, the impact of changing the item in the overall score was small, allowing retention of the existing Spanish translation. We argue that the myth of perfect translation and over-reliance on large-sample psychometric testing pursuing measurement invariance limit exploration of language effects. We recommend that these be used in the companion of user-based, sequential, mixed-method exploration to support the development of a richer field of understanding of outcomes and change self-report measures across languages and cultures and both across and within languages.

What Happens When Individuals Answer Questionnaires in Two Different Languages

The aim of the present study was to compare scores from the English and the Spanish versions of two well-known measures of psychological distress using a within-subject approach. This method involved bilingual participants completing both measures in four conditions. For two groups of people, measures were offered in the same language both times and for the other two groups, each language version was offered, the order differing between the groups. The measures were the Clinical Outcomes in Routine Evaluation-Outcome Measure and the Schwartz Outcome Scale-10, both originally created in English and then translated to Spanish. In total, 109 bilingual participants (69.7% women) completed the measures in two occasions and were randomly allocated to the four conditions (English-English, English-Spanish, Spanish-English and Spanish-Spanish). Linear mixed effects models were performed to provide a formal null hypothesis test of the effect of language, order of completion and their interaction for each measure. The results indicate that for the total score of the Clinical Outcomes in Routine Evaluation-Outcome Measure just language had a significant effect, but no significant effects were found for completion order or the language by order interaction. For the Schwartz Outcome Scale-10 scores, none of these effects were statistically significant. This method offers some clear advantages over the more prevalent psychometric methods of testing score comparability across measure translations.

Psychological Distress of University Workers during COVID-19 Pandemic in Brazil

The study aimed to explore mental distress during COVID-19 quarantine in a sample of university workers in Brazil. The survey included sets of questions about demographics, health, and support, an open question about major concerns, and the Clinical Outcome Routine Evaluation (CORE-OM), a measure of mental distress. A total of 407 professionals, mean age 40, SD 11.2, fulfilling social distancing (99%) participated in the study. Participants were mostly female (67.8%) and married (64.8%). Using the Consensual Qualitative Research process for simple qualitative data (CQR-M), the main areas of concern were grouped into six domains, as follows: work, health, isolation, personal life and routine, social environment, and future. Many responses were multiple. They form categories indicating specific concerns within these domains. Quantitative data were analyzed by identifying the simple effects of potential predictors of mental distress. The results indicated medium effects of help with household chores (η² = 0.06, 95% confidence interval (CI) (0.022–0.095)), psychiatric treatment (η² = 0.06, CI (0.030–0.110)), age (η² = 0.12, CI (0.070–0.170)), and physical exercise (η² = 0.12, CI (0.079–0.180)). Having someone available to listen was the only variable with a large effect associated with reduced mental suffering (η² = 0.18; CI (0.118–0.227)). Psychological experiences of the pandemic are multifaceted and complex. Thus, substantially larger surveys, with both quantitative and qualitative components, are needed.