Training Consumers to Collect Data in Mental Health Service System Evaluation Research

Patient satisfaction and treatment outcomes as quality indicators for mental health services

In the United States, the patient has emerged as the central focus in evaluations of mental health services (Buckley, 1993). Whereas evaluation research in the 1980s emphasised the structure and process of mental health care, current evaluation research incorporates client-based measurements of treatment outcomes, such as symptom reduction, functional status and quality of life (Chisholm et al, 1997; Campbell, 1998). In addition, patient satisfaction with mental health services is increasingly used as an outcome dimension and an indicator of service quality (Center for Mental Health Services, 1996; Teague et al, 1997; Howard et al, 2003).

Recruitment and retention of older adolescent and young adult female survivors of childhood cancer in longitudinal research

PURPOSE/OBJECTIVES

To describe the challenges encountered in the recruitment and retention of a sample of older adolescent and young adult female survivors of childhood cancer for a longitudinal study testing a targeted psychosocial intervention aimed at enhancing hope.

DATA SOURCES

Published literature on constructing longitudinal intervention studies and strategies in the recruitment and retention of childhood cancer survivors in research was used to develop the protocol of this study.

DATA SYNTHESIS

Using empirical literature to construct the study's design resulted in achieving certain goals for the design, but not in the recruitment and retention of study participants. Using online technology to deliver the intervention and collect data was efficient and effective. Traditional approaches to recruitment and retention of those survivors, however, were not effective. Use of more novel approaches to enroll study participants demonstrated only modest success.

CONCLUSIONS

Additional research is needed on strategies to successfully recruit and retain older adolescents and young adult female survivors of childhood cancer in longitudinal intervention studies.

IMPLICATIONS FOR NURSING

The improvement in the psychological well-being of female survivors of childhood cancer remains an important outcome in ongoing care. The need to continue to identify creative and effective ways to recruit and retain those survivors is warranted.

Participation of mental health consumers in research: training addressed and reliability assessed

INTRODUCTION

A call for active inclusion of consumers in research; recognising and valuing the knowledge that arises through lived experience, is made in the literature. However, genuine inclusion of consumers as members of the research team remains rare. Opponents present two barriers: lack of required knowledge and skills and lack of capacity to conduct rigorous research.

METHODS

This study involved a collaborative process to develop training materials for consumer researchers. Reliability of self-report outcome data collected by five trained consumers was then examined.

RESULTS

Quantitative results suggest that trained consumers can facilitate self-report interviews to the high standard expected by the general research community.

CONCLUSIONS

This study provides both methods and resources to extend occupational therapy consumer-centred practice into the realm of research.

Systematic review of the role of service users as researchers in mental health studies

Aims – Service user involvement in mental health service development and research is becoming more common in countries like the UK. USA and Canada. This systematic review of the international scientific literature has been carried out to assess the stage of development of mental health service users involvement in research. Method – Systematic review of any research project actively involving service users in any part of the research process. Results – Thirty-five studies met the inclusion and exclusion criteria and were included in the systematic review. Nine studies used quantitative techniques, 24 used qualitative techniques and two studies used both quantitative and qualitative techniques. While three studies were user-led, in three other studies the users were simply consulted but did not have any active role in the research. The remaining 29 studies were based on a collaboration between service users and professional researchers. Conclusions – The involvement of mental health service users in the research process is feasible both in quantitative and qualitative research studies. The involvement of service users in research has a number of benefits; such research requires more accurate planning and more time than the traditional research.

Declaration of Interest: none.

Development and validation of a self-reported questionnaire on users' opinions about schizophrenia: a participatory research

BACKGROUND

Although users' involvement in mental health research has repeatedly been acknowledged as having a positive influence on research quality, this rarely happens.

AIMS

To develop and validate a Questionnaire on Users' Opinions (QOU) about schizophrenia, in close collaboration with 279 persons affected by this disorder.

METHODS

A preliminary list of items concerning the opinions of users with schizophrenia regarding causes, treatments and psychosocial consequences of the disorder was developed by 38 users with schizophrenia and 40 professionals who attended a workshop. Psychometric properties of the QOU were tested on 241 users with schizophrenia, 149 of whom were randomly assigned to a test-retest study and 92 to a face-validity study. Content and construct validity were explored in the whole sample.

RESULTS

The final version of the QOU contains: (1) 24 items on the psychosocial consequences of schizophrenia, grouped into six subscales, whose Cronbach's alpha ranged between 0.55 and 0.74; (2) five multiple choice items on the Italian psychiatric law; (3) 12 open questions; and (4) four yes/no skipping items. Items' reliability, measured by Cohen's kappa coefficient, ranged between 0.55 and 0.92.

CONCLUSION

This questionnaire may be useful to assess patients' beliefs about schizophrenia and to target psychosocial interventions for this mental disorder.

Determining the effectiveness of mental health services from a consumer perspective: part 2: barriers to recovery and principles for evaluation

The routine use of standardized outcome measures has been introduced to assess the effectiveness of mental health service delivery throughout Australia. The use of these measures has been criticized for failing to reflect those aspects of treatment consumers consider to affect their recovery. This is the second of a two-part paper. Its aim is to explore the views of consumers regarding factors that impede recovery and to explore the principles that ideally should underpin the evaluation of mental health services. Focus group interviews were conducted with consumers of mental health services (n = 16) from one rural and one metropolitan mental health service in Victoria, Australia. This paper presents the findings, pertaining to aspects of mental health services that pose barriers to recovery. The main themes to emerge were: staffing issues; hearing the person not the illness; lack of safety and security; and, isolation. The main themes to emerge regarding the evaluation of mental health services were: consumer involvement; peer support and more responsive care and treatment. The views of participants suggest that the effective evaluation of mental health services requires an increased focus on the views and opinions of consumers in order to develop more responsive mental health services.

Predictors of satisfaction among adult recipients of medicaid mental health services

This study measured service satisfaction, perceptions of service quality and general health, and overall quality of care among 787 adult recipients of Medicaid mental health services. Methods included cross-sectional retrospective design and stratified random sampling technique. Respondents were satisfied with consumer-provider relationships and were dissatisfied with functional outcomes resulting from treatment. Satisfaction was positively correlated with ratings of mental health care and the mental health component score of the SF-12. Predictors of satisfaction included ratings of mental health care and overall health. Recommendations include coordination of services that promote patient functioning and measurement of consumer satisfaction as an indicator of quality.

Development and testing of patient satisfaction measure for inpatient psychiatry care

Patient satisfaction is one of the most important indicators for service excellence. Investigations have been done with population-specific patient satisfaction tools for psychiatric patients; however, there are few published measures for evaluating inpatient care. We developed and tested a 15-item instrument to evaluate the interdisciplinary care model and therapeutic interventions. Results demonstrated reliability and validity of the tool.

Recruiting vulnerable populations for research: revisiting the ethical issues

The successful recruitment of participants is essential to the research process. To increase the rate of subject participation, investigators have to rely on help from health care providers who often serve as gatekeepers to potential research study subjects. These well-meaning professionals may limit subject participation in a study involving vulnerable populations under the guise of protecting these individuals from harm. We describe some of the characteristics of vulnerable populations affecting their recruitment into research studies. We examine the ethical conflicts that occur when health care professionals control access to these subjects during recruitment for research studies. Finally, we discuss the implications for practice and research designed to protect the rights of vulnerable populations participating in research. We identify collaboration and dialogue between researchers, health care providers, and members of the potential subject populations as most important in recruiting sufficient numbers of subjects to ensure the scientific merit of the study.