1
|
Longworth GR, de Boer J, Goh K, Agnello DM, McCaffrey L, Zapata Restrepo JR, An Q, Chastin S, Davis A, Altenburg T, Verloigne M, Giné-Garriga M. Navigating process evaluation in co-creation: a Health CASCADE scoping review of used frameworks and assessed components. BMJ Glob Health 2024; 9:e014483. [PMID: 38964878 PMCID: PMC11227756 DOI: 10.1136/bmjgh-2023-014483] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Accepted: 05/13/2024] [Indexed: 07/06/2024] Open
Abstract
BACKGROUND Co-creation is seen as a way to ensure all relevant needs and perspectives are included and to increase its potential for beneficial effects and uptake process evaluation is crucial. However, existing process evaluation frameworks have been built on practices characterised by top-down developed and implemented interventions and may be limited in capturing essential elements of co-creation. This study aims to provide a review of studies planning and/or conducting a process evaluation of public health interventions adopting a co-creation approach and aims to derive assessed process evaluation components, used frameworks and insights into formative and/or participatory evaluation. METHODS We searched for studies on Scopus and the Health CASCADE Co-Creation Database. Co-authors performed a concept-mapping exercise to create a set of overarching dimensions for clustering the identified process evaluation components. RESULTS 54 studies were included. Conceptualisation of process evaluation included in studies concerned intervention implementation, outcome evaluation, mechanisms of impact, context and the co-creation process. 22 studies (40%) referenced ten existing process evaluation or evaluation frameworks and most referenced were the frameworks developed by Moore et al (14%), Saunders et al (5%), Steckler and Linnan (5%) and Nielsen and Randall (5%).38 process evaluation components were identified, with a focus on participation (48%), context (40%), the experience of co-creators (29%), impact (29%), satisfaction (25%) and fidelity (24%).13 studies (24%) conducted formative evaluation, 37 (68%) conducted summative evaluation and 2 studies (3%) conducted participatory evaluation. CONCLUSION The broad spectrum of process evaluation components addressed in co-creation studies, covering both the evaluation of the co-creation process and the intervention implementation, highlights the need for a process evaluation tailored to co-creation studies. This work provides an overview of process evaluation components, clustered in dimensions and reflections which researchers and practitioners can use to plan a process evaluation of a co-creation process and intervention.
Collapse
Affiliation(s)
| | - Janneke de Boer
- Department of Movement and Sports Sciences, Ghent University, Gent, Belgium
- Department of Public Health and Primary Care, Ghent University, Gent, Belgium
| | - Kunshan Goh
- Department of Public and Occupational Health, Amsterdam Public Health Research Institute, Amsterdam, Netherlands
| | | | - Lauren McCaffrey
- School of Health and Life Sciences, Glasgow Caledonian University, Glasgow, UK
| | | | - Qingfan An
- Department of Community Medicine and Rehabilitation, Umeå University, Umea, Sweden
| | - Sebastien Chastin
- Department of Movement and Sports Sciences, Ghent University, Gent, Belgium
- Glasgow Caledonian University, Glasgow, UK
| | - Aaron Davis
- UniSA Creative, University of South Australia, Adelaide, South Australia, Australia
| | - Teatske Altenburg
- Department of Public and Occupational Health, Amsterdam Public Health Research Institute, Amsterdam, Netherlands
| | - Maite Verloigne
- Department of Public Health and Primary Care, Ghent University, Gent, Belgium
| | - Maria Giné-Garriga
- Faculty of Psychology, Education and Sport Sciences, Universitat Ramon Llull, Barcelona, Spain
| |
Collapse
|
2
|
Verwijmeren D, Grootens KP. Shifting Perspectives on the Challenges of Shared Decision Making in Mental Health Care. Community Ment Health J 2024; 60:292-307. [PMID: 37550559 PMCID: PMC10821819 DOI: 10.1007/s10597-023-01170-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Accepted: 07/08/2023] [Indexed: 08/09/2023]
Abstract
Although shared decision making (SDM) has become the most preferable way in doctor-patient communication, it is not fully implemented in mental health care likely due to the complex nature of psychiatric syndromes and treatments. In this review we provide a systematic overview of all perceived and reported barriers to SDM in the literature, acknowledging field-specific challenges, and offering perspectives to promote its wider use. We conducted a systematic search of the wider literature in different databases and included all publications mentioning specified barriers to SDM in psychiatric care. Relevant data and opinions were categorised into micro-, meso- and macro-level themes and put into clinical perspective. We derived 20 barriers to SDM from 100 studies and reports. Eight were on micro-level care delivery, seven involved meso-level issues, five concerned macro-level themes. The multitude of perceived and actual barriers to SDM underline the challenges its implementation poses in mental health care, some of which can be resolved while others are inherent to the nature of the care, with its long-term relationships, complex dynamics, and social consequences, all requiring a flexible approach. We present four perspectives to help change views on the potential of SDM in mental health care.
Collapse
Affiliation(s)
- Doris Verwijmeren
- Tranzo, Tilburg School of Social and Behavioral Sciences, Tilburg University, Postbus 90153, 5000 LE, Tilburg, The Netherlands.
- Reinier van Arkel Mental Health Institute, 's-Hertogenbosch, The Netherlands.
| | - Koen P Grootens
- Tranzo, Tilburg School of Social and Behavioral Sciences, Tilburg University, Postbus 90153, 5000 LE, Tilburg, The Netherlands
- Reinier van Arkel Mental Health Institute, 's-Hertogenbosch, The Netherlands
| |
Collapse
|
3
|
Jakobsson CE, Genovesi E, Afolayan A, Bella-Awusah T, Omobowale O, Buyanga M, Kakuma R, Ryan GK. Co-producing research on psychosis: a scoping review on barriers, facilitators and outcomes. Int J Ment Health Syst 2023; 17:25. [PMID: 37644476 PMCID: PMC10466887 DOI: 10.1186/s13033-023-00594-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/10/2022] [Accepted: 07/31/2023] [Indexed: 08/31/2023] Open
Abstract
INTRODUCTION Co-production is a collaborative approach to service user involvement in which users and researchers share power and responsibility in the research process. Although previous reviews have investigated co-production in mental health research, these do not typically focus on psychosis or severe mental health conditions. Meanwhile, people with psychosis may be under-represented in co-production efforts. This scoping review aims to explore the peer-reviewed literature to better understand the processes and terminology employed, as well as the barriers, facilitators, and outcomes of co-production in psychosis research. METHODS Three databases were searched (MEDLINE, EMBASE, PsycINFO) using terms and headings related to psychosis and co-production. All titles, abstracts and full texts were independently double-screened. Disagreements were resolved by consensus. Original research articles reporting on processes and methods of co-production involving adults with psychosis as well as barriers, facilitators, and/or outcomes of co-production were included. Data was extracted using a standardised template and synthesised narratively. Joanna Briggs Institute and the AGREE Reporting Checklist were used for quality assessment. RESULTS The search returned 1243 references. Fifteen studies were included: five qualitative, two cross-sectional, and eight descriptive studies. Most studies took place in the UK, and all reported user involvement in the research process; however, the amount and methods of involvement varied greatly. Although all studies were required to satisfy INVOLVE (2018) principles of co-production to be included, seven were missing several of the key features of co-production and often used different terms to describe their collaborative approaches. Commonly reported outcomes included improvements in mutual engagement as well as depth of understanding and exploration. Key barriers were power differentials between researchers and service users and stigma. Key facilitators were stakeholder buy-in and effective communication. CONCLUSIONS The methodology, terminology and quality of the studies varied considerably; meanwhile, over-representation of UK studies suggests there may be even more heterogeneity in the global literature not captured by our review. This study makes recommendations for encouraging co-production and improving the reporting of co-produced research, while also identifying several limitations that could be improved upon for a more comprehensive review of the literature.
Collapse
Affiliation(s)
- C E Jakobsson
- Department of Psychiatry, Sussex Partnership NHS Foundation Trust, Eastbourne, England, UK.
| | - E Genovesi
- Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, England, UK
| | - A Afolayan
- Centre for Child and Adolescent Mental Health, College of Medicine, University of Ibadan, Ibadan, Nigeria
| | - T Bella-Awusah
- Department of Psychiatry & Centre for Child and Adolescent Mental Health, College of Medicine, University of Ibadan, Ibadan, Nigeria
| | - O Omobowale
- Department of Community Medicine, College of Medicine, University of Ibadan, Ibadan, Nigeria
| | - M Buyanga
- SUCCEED Africa, University of Zimbabwe, Harare, Zimbabwe
| | - R Kakuma
- London School of Hygiene and Tropical Medicine, Centre for Global Mental Health, London, England, UK.
| | - G K Ryan
- London School of Hygiene and Tropical Medicine, Centre for Global Mental Health, London, England, UK.
| |
Collapse
|
4
|
Brooks H, Devereux-Fitzgerald A, Richmond L, Caton N, Cherry MG, Bee P, Lovell K, Downs J, Edwards BM, Vassilev I, Bush L, Rogers A. Exploring the use of social network interventions for adults with mental health difficulties: a systematic review and narrative synthesis. BMC Psychiatry 2023; 23:486. [PMID: 37420228 PMCID: PMC10329398 DOI: 10.1186/s12888-023-04881-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Accepted: 05/17/2023] [Indexed: 07/09/2023] Open
Abstract
BACKGROUND People with mental health difficulties often experience social isolation. The importance of interventions to enhance social networks and reduce this isolation is increasingly being recognised. However, the literature has not yet been systematically reviewed with regards to how these are best used. This narrative synthesis aimed to investigate the role of social network interventions for people with mental health difficulties and identify barriers and facilitators to effective delivery. This was undertaken with a view to understanding how social network interventions might work best in the mental health field. METHODS Systematic searches using combinations of synonyms for mental health difficulties and social network interventions were undertaken across 7 databases (MEDLINE, Embase, PsycINFO, CINAHL, Cochrane Library, Web of Science) and 2 grey literature databases (EThoS and OpenGrey) from their inception to October 2021. We included studies reporting primary qualitative and quantitative data from all study types relating to the use of social network interventions for people with mental health difficulties. The quality of included studies was assessed using the Mixed Methods Appraisal Tool. Data were extracted and synthesised narratively. RESULTS The review included 54 studies, reporting data from 6,249 participants. Social network interventions were generally beneficial for people with mental health difficulties but heterogeneity in intervention type, implementation and evaluation made it difficult to draw definitive conclusions. Interventions worked best when they (1) were personalised to individual needs, interests and health, (2) were delivered outside formal health services and (3) provided the opportunity to engage in authentic valued activities. Several barriers to access were identified which, without careful consideration could exacerbate existing health inequalities. Further research is required to fully understand condition-specific barriers which may limit access to, and efficacy of, interventions. CONCLUSIONS Strategies for improving social networks for people with mental health difficulties should focus on supporting engagement with personalised and supported social activities outside of formal mental health services. To optimise access and uptake, accessibility barriers should be carefully considered within implementation contexts and equality, diversity and inclusion should be prioritised in intervention design, delivery and evaluation and in future research.
Collapse
Affiliation(s)
- Helen Brooks
- Mental Health Research Group, Division of Nursing, Midwifery and Social Work, School of Health Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester Academic Health Science Centre, Manchester, M13 9PL, UK.
| | - Angela Devereux-Fitzgerald
- Mental Health Research Group, Division of Nursing, Midwifery and Social Work, School of Health Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester Academic Health Science Centre, Manchester, M13 9PL, UK
| | - Laura Richmond
- Mental Health Research Group, Division of Nursing, Midwifery and Social Work, School of Health Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester Academic Health Science Centre, Manchester, M13 9PL, UK
- Department of Clinical, Education & Health Psychology, University College London, London, UK
| | - Neil Caton
- Patient and Public Involvement Contributor, University of Manchester, Manchester, UK
| | - Mary Gemma Cherry
- Department of Primary Care and Mental Health, Institute of Population Health, University of Liverpool, Liverpool, UK
- Linda McCartney Centre, Liverpool University Hospitals NHS Trust, Prescot St, Liverpool, UK
| | - Penny Bee
- Mental Health Research Group, Division of Nursing, Midwifery and Social Work, School of Health Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester Academic Health Science Centre, Manchester, M13 9PL, UK
| | - Karina Lovell
- Mental Health Research Group, Division of Nursing, Midwifery and Social Work, School of Health Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester Academic Health Science Centre, Manchester, M13 9PL, UK
- Greater Manchester Mental Health NHS Foundation Trust, Manchester, UK
| | - James Downs
- Patient and Public Involvement Contributor, Cambridge, UK
| | | | - Ivaylo Vassilev
- NIHR CLAHRC Wessex, Faculty of Health Sciences, University of Southampton, Southampton, UK
| | | | - Anne Rogers
- NIHR CLAHRC Wessex, Faculty of Health Sciences, University of Southampton, Southampton, UK
| |
Collapse
|
5
|
Boerkoel A, Brommels M. The processes involved in the establishment of user-provider partnerships in severe psychiatric illnesses: a scoping review. BMC Psychiatry 2022; 22:660. [PMID: 36289473 PMCID: PMC9608879 DOI: 10.1186/s12888-022-04303-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/28/2022] [Accepted: 10/11/2022] [Indexed: 11/30/2022] Open
Abstract
PURPOSE With the rising relevance of person-centred care, initiatives towards user-led decision making and designing of care services have become more frequent. This designing of care services can be done in partnership, but it is unclear how. The aim of this scoping review was to identify for mental health services, what user-provider partnerships are, how they arise in practice and what can facilitate or hinder them. METHODS A scoping review was conducted to obtain a broad overview of user provider partnerships in severe mental illness. Data was inductively analysed using a conventional content analysis approach, in which meaning was found in the texts. RESULTS In total, 1559 titles were screened for the eligibility criteria and the resulting 22 papers found relevant were analysed using conventional content analysis. The identified papers had broad and differing concepts for user-provider partnerships. Papers considered shared decision making and user-involvement as partnerships. Mechanisms such as open communication, organisational top-down support and active participation supported partnerships, but professional identity, power imbalances and stress hindered them. Users can be impeded by their illness, but how to deal with these situations should be formalised through contracts. CONCLUSION The field of research around user-provider partnerships is scattered and lacks consensus on terminology. A power imbalance between a user and a provider is characteristic of partnerships in mental healthcare, which hinders the necessary relationship building allowing partnerships to arise. This power imbalance seems to be closely linked to professional identity, which was found to be difficult to change.
Collapse
Affiliation(s)
- Aletta Boerkoel
- Institute for Community Medicine, University Medicine Greifswald, Greifswald, Germany. .,Department for Learning, Informatics, Management and Ethics, Karolinska Institutet, Solna, Sweden.
| | - Mats Brommels
- grid.465198.7Department for Learning, Informatics, Management and Ethics, Karolinska Institutet, Solna, Sweden
| |
Collapse
|
6
|
Lindström M. Development of the Everyday Life Rehabilitation model for persons with long-term and complex mental health needs: Preliminary process findings on usefulness and implementation aspects in sheltered and supported housing facilities. Front Psychiatry 2022; 13:954068. [PMID: 36051549 PMCID: PMC9424656 DOI: 10.3389/fpsyt.2022.954068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Accepted: 07/15/2022] [Indexed: 11/13/2022] Open
Abstract
UNLABELLED This paper describes the initial phases of the design and development of the Everyday Life Rehabilitation (ELR) intervention, and it presents preliminary findings on usefulness and implementation aspects derived from an ongoing larger trial exploring the effect, cost-effectiveness, and usefulness of ELR. ELR is a model designed to meet the absence of meaningful activities and challenges with integrated, activity- and recovery-oriented rehabilitation in sheltered and supported housing facilities for persons with extensive psychiatric disabilities. The aim of the present study was to examine early experiences of implementing the ELR model from the perspectives of managers, housing staff, and occupational therapists. The paper will sum up preliminary findings based on process data included in an internal pilot prior to a full-scale pragmatic clustered RCT. Four Swedish municipalities with 19 housing facility units were involved and provided process data for the study. Thematic analysis were applied. The informants perceived the methodology to be well suited to the target group and context and to contribute to positive changes in participants' lives. The web-based training was also experienced as relevant and easily accessible to staff, as well as elements of collegial learning and feedback. However, they reported that their municipalities lacked basic conditions for making the whole concept work in such a short time. The ELR is overall perceived as useful, but experiences also make complex difficulties visible regarding integrated, coordinated rehabilitation and organizational readiness. Based on findings, a recommendation on basic prerequisites will be added to the ELR guidance for leadership and management. CLINICAL TRIAL REGISTRATION [ClinicalTrials.gov, 24 September 2021], identifier [NCT05056415].
Collapse
Affiliation(s)
- Maria Lindström
- Department of Community Medicine and Rehabilitation, Umeå University, Umeå, Sweden
| |
Collapse
|
7
|
Scott R, Aboud A. Engagement of mental health service users and carers in care planning - Is it meaningful and adding value? Australas Psychiatry 2021; 29:676-678. [PMID: 34266295 DOI: 10.1177/10398562211028646] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
OBJECTIVE Consider whether mental health service users and carers meaningfully engage in care planning and whether care planning adds value to patient care. CONCLUSION A review of the meta-analyses and systematic reviews of service users and carers identified many barriers to their meaningful engagement in care planning. No research has demonstrated any measurable benefits or positive outcomes linked to mental health care planning.
Collapse
Affiliation(s)
- Russ Scott
- Consultant Forensic Psychiatrist, Brisbane, QLD, Australia
| | - Andrew Aboud
- Consultant Forensic Psychiatrist, Brisbane, QLD, Australia
| |
Collapse
|
8
|
Hurley J, Lakeman R. Making the case for clinical mental health nurses to break their silence on the healing they create: A critical discussion. Int J Ment Health Nurs 2021; 30:574-582. [PMID: 33491322 DOI: 10.1111/inm.12836] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/20/2020] [Revised: 12/12/2020] [Accepted: 12/17/2020] [Indexed: 01/20/2023]
Abstract
This discursive paper aims to clarify what roles mental health nurses identify as being within their scope of practice in clinical settings. It also aims to highlight any consumer benefits arising from these roles. Role theory and its relationship with identity are critically discussed as a framework to explain how contemporary mental health nursing roles are poorly understood and undervalued within mental health services. In order to meet the aims of the paper literature written in the last five years by clinical mental health nurses reporting their roles, and outcomes of those roles were searched. This literature was then considered through the lens of social constructionism that premises truths are accessed and then constructed though relationship based language. Six core mental health nursing roles were identified across international settings. The MHN is a psychotherapist. The MHN is a consumer advocate. The MHN is a physical health therapist. The MHN is a psycho-pharmacological therapist. The MHN is a relationship focussed therapist and finally the MHN is an aggression management therapist. While European and American nurses reported consumer benefit emerging from these roles those from Australia and the United Kingdom did not. The roles reported on were largely instrumental ones that offered little clarity towards the identity of our profession, nor its worth to consumers or funders of services. Mental health nurses will only have their true breadth of clinical capabilities recognized where there is a consistent construction emerging from clinicians in clinical settings on the efficacy of their clinical work.
Collapse
Affiliation(s)
- John Hurley
- School of Health and Human Sciences, Southern Cross University, Coffs Harbour, NSW, Australia
| | - Richard Lakeman
- School of Health and Human Sciences, Southern Cross University, Coffs Harbour, NSW, Australia
| |
Collapse
|
9
|
Irmansyah I, Susanti H, James K, Lovell K, Idaiani S, Imah S, Hargiana G, Keliat BA, Utomo B, Colucci E, Brooks H. Civic engagement and mental health system strengthening in Indonesia: a qualitative examination of the views of health professionals and national key stakeholders. BMC Psychiatry 2020; 20:172. [PMID: 32295558 PMCID: PMC7161291 DOI: 10.1186/s12888-020-02575-3] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/29/2019] [Accepted: 03/30/2020] [Indexed: 01/21/2023] Open
Abstract
BACKGROUND Mental health services in Indonesia are developing rapidly in response to national and global health policy to support people living with psychosis. This presents a unique opportunity for civic engagement, the active involvement of patients, carers and communities in mental health care, to shape emergent services. In-depth explorations of the views of professionals and other key stakeholders in mental health care on the use of civic engagement in Indonesia are lacking which contributes to a limited understanding of its potential in this regard. The study aimed to explore contemporary professionals' and other key stakeholders' perspectives on the current use of and potential for civic engagement to strengthen mental health systems in Indonesia. METHODS Qualitative interviews were undertaken and analysed using thematic analysis underpinned by a critical realist approach. Eighteen multi-disciplinary professionals and lay health workers involved in mental health care in Jakarta and Bogor and 10 national key stakeholders were recruited. RESULTS Despite high levels of awareness of and support for civic engagement amongst mental health professionals and policy makers combined with a nascent grass roots movement, analysis revealed unstructured and insufficient mechanisms for civic engagement which resulted in ad-hoc and mostly superficial levels of involvement activity. Civic engagement was thought to require a marked shift in existing practices as well as organisational and societal cultures. Challenging stigma is a key feature of civic engagement and our analysis highlights the relevance of social contact methods which are locally and culturally contextualised in this regard. Our findings point to a need to expand current definitions of civic engagement which focus on indivdiual enablement to ones that also encompass environmental and organisational enablement to optimise the future use of civic engagement in mental health settings. CONCLUSIONS Key mental health stakeholders have identified that central aspects of Indonesian culture are well aligned to the ethos of civic engagement which has the potential to facilitate the enactment of recent global health policy. However, full realisation is likely to be impeded by prevailing paternalistic cultures in mental health services and high levels of stigma and discrimination towards those with mental illness in Indonesia without intervention.
Collapse
Affiliation(s)
- Irman Irmansyah
- National Institute of Health Research and Development, Jakarta, Indonesia.,Marzoeki Mahdi Hospital, Bogor, Indonesia
| | - Herni Susanti
- Faculty of Nursing, Universitas Indonesia, Depok, Indonesia
| | - Karen James
- Centre for Health and Social Care Research, Faculty of Health, Social Care and Education, Kingston and St Georges, London, UK
| | - Karina Lovell
- Division of Nursing, Midwifery and Social Work, School of Health Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester Academic Health Science Centre, Manchester, UK.,Greater Manchester Mental Health NHS Foundation Trust, Manchester, UK
| | - Sri Idaiani
- National Institute of Health Research and Development, Jakarta, Indonesia
| | - Soimah Imah
- National Institute of Health Research and Development, Jakarta, Indonesia
| | - Giur Hargiana
- Faculty of Nursing, Universitas Indonesia, Depok, Indonesia
| | | | | | | | - Helen Brooks
- Department of Health Services Research, Institute of Population Health Sciences, University of Liverpool, Room B112, Waterhouse Building Block B, Liverpool, UK.
| |
Collapse
|
10
|
Susanti H, James K, Utomo B, Keliat B, Lovell K, Irmansyah I, Rose D, Colucci E, Brooks H. Exploring the potential use of patient and public involvement to strengthen Indonesian mental health care for people with psychosis: A qualitative exploration of the views of service users and carers. Health Expect 2020; 23:377-387. [PMID: 31782266 PMCID: PMC7104636 DOI: 10.1111/hex.13007] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2019] [Revised: 11/12/2019] [Accepted: 11/12/2019] [Indexed: 11/29/2022] Open
Abstract
BACKGROUND Patient and public involvement (PPI) has the potential to strengthen mental health systems in Indonesia and improve care for people living with psychosis. Current evidence from other parts of the world demonstrates the need to understand the contexts in which PPI is to be enacted to ensure optimal implementation. OBJECTIVE To understand service users' and carers' views on the current use and potential applicability of PPI within Indonesian mental health services. DESIGN Qualitative study incorporating focus groups analysed using thematic analysis. SETTING AND PARTICIPANTS Participants included 22 service users and 21 carers recruited from two study sites in Indonesia (Jakarta and Bogor). All participants had experience of psychosis either as a service user or carer. RESULTS Despite the value attributed to PPI in relation to improving services and promoting recovery, current use of such activities in Indonesian mental health services was limited. Participants expressed a desire for greater levels of involvement and more holistic care but felt community organizations were best placed to deliver this because PPI was considered more congruent with the ethos of third-sector organizations. Additional barriers to PPI included stigma and low levels of mental health literacy in both health services and communities. DISCUSSION AND CONCLUSION Participants felt that there was potential value in the use of PPI within Indonesian mental health services with careful consideration of individual contexts. Future aspirations of involvement enactment should ensure a central design and delivery role for third-sector organizations. Facilitators to global collaborative research in the context of the current study are also discussed.
Collapse
Affiliation(s)
- Herni Susanti
- Faculty of NursingUniversitas IndonesiaDepokIndonesia
| | - Karen James
- Faculty of Health, Social Care and EducationCentre for Health and Social Care ResearchKingston and St GeorgesLondonUK
| | | | | | - Karina Lovell
- Division of Nursing, Midwifery and Social WorkSchool of Health SciencesFaculty of Biology, Medicine and HealthUniversity of ManchesterManchester Academic Health Science CentreManchesterUK
- Greater Manchester Mental Health NHS Foundation TrustManchesterUK
| | - I Irmansyah
- National Institute of Health Research and DevelopmentJakartaIndonesia
- Marzoeki Mahdi HospitalBogorIndonesia
| | - Diana Rose
- Department of Health Services ResearchKings College LondonLondonUK
| | | | - Helen Brooks
- Department of Health Services ResearchInstitute of Population Health SciencesUniversity of LiverpoolLiverpoolUK
| |
Collapse
|
11
|
James K, Brooks H, Susanti H, Waddingham J, Irmansyah I, Keliat BA, Utomo B, Rose D, Colucci E, Lovell K. Implementing civic engagement within mental health services in South East Asia: a systematic review and realist synthesis of current evidence. Int J Ment Health Syst 2020; 14:17. [PMID: 32175004 PMCID: PMC7063827 DOI: 10.1186/s13033-020-00352-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/16/2019] [Accepted: 02/29/2020] [Indexed: 12/04/2022] Open
Abstract
INTRODUCTION Civic engagement (CE) has the potential to transform mental health services and could be particularly important for low and middle-income countries (LMICs), which are rapidly developing to respond to the burden of poor mental health. Research from high income countries has found many challenges associated with the meaningful implementation of CE in practice, but this has been underexplored in LIMCS and in South East Asia (SEA) in particular. METHODS We completed a realist synthesis and systematic review of peer reviewed publications and grey literature to identify the context and actions which promote successful implementation of CE approaches in SEA. We used a theory-driven approach-realist synthesis-to analyse data and develop context-mechanism-outcome configurations that can be used to explain how civic engagement approaches operate in South East Asian contexts. We worked closely with patient and public representatives to guide the review from the outset. RESULTS Fifty-seven published and unpublished articles were included, 24 were evaluations of CE, including two Randomized Controlled Trials. The majority of CE interventions featured uptake or adaptation of Western models of care. We identified important cultural differences in the enactment of civic engagement in SEA contexts and four mechanisms which, alongside their contextual barriers and facilitators, can be used to explain how civic engagement produces a range of outcomes for people experiencing mental health problems, their families and communities. Our review illustrates how CE interventions can be successfully implemented in SEA, however Western models should be adapted to fit with local cultures and values to promote successful implementation. Barriers to implementation included distrust of services/outside agencies, stigma, paternalistic cultures, limited resource and infrastructure. CONCLUSION Our findings provide guidance for the implementation of CE approaches within SEA contexts and identify areas for further research. Due to the collectivist nature of many SEA cultures, and the impact of shared traumas on community mental health, CE might best be implemented at community level, with a focus on relational decision making.Registration This review is registered on PROSPERO: CRD42018087841.
Collapse
Affiliation(s)
- Karen James
- Centre for Health and Social Care Research, Faculty of Health, Social Care and Education, Kingston and St Georges, 6th Floor Hunter Wing, Cranmer Terrace, London, UK
| | - Helen Brooks
- Department of Health Services Research, Institute of Population Health Sciences, University of Liverpool, Liverpool, UK
| | - Herni Susanti
- Faculty of Nursing, University of Indonesia, Depok, Indonesia
| | | | - Irman Irmansyah
- National Institute of Health Research and Development, Jakarta, Indonesia
- Marzoeki Mahdi Hospital, Bogor, Indonesia
| | | | - Bagus Utomo
- Komunitas Peduli Skizofrenia Indonesia, Jakarta, Indonesia
| | - Diana Rose
- Department of Health Services Research, Kings College London, London, UK
| | | | - Karina Lovell
- Division of Nursing, Midwifery and Social Work, School of Health Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester Academic Health Science Centre, Manchester, UK
- Greater Manchester Mental Health NHS Foundation Trust, Manchester, UK
| |
Collapse
|
12
|
Brooks HL, Bee P, Lovell K, Rogers A. Negotiating support from relationships and resources: a longitudinal study examining the role of personal support networks in the management of severe and enduring mental health problems. BMC Psychiatry 2020; 20:50. [PMID: 32028906 PMCID: PMC7006131 DOI: 10.1186/s12888-020-2458-z] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/20/2018] [Accepted: 01/23/2020] [Indexed: 01/15/2023] Open
Abstract
BACKGROUND Personal communities or personal support networks comprise a variety of social ties considered important to individuals in their everyday lives. This set of active and significant ties influence the capacity to manage mental health problems because of the potential to access social support. However, little is known in the context of people's everyday management of mental health about how relationships with people, places, objects and activities are navigated and negotiated. This study aimed to explore the nature and negotiation of support from personal communities in the everyday management of severe and enduring mental health problems. METHODS A longitudinal qualitative study undertaken in the UK incorporating 79 interviews with 29 participants based on personal network mapping. 29 users of mental health services with a diagnosis of severe and enduring mental illness were interviewed at three time points. Data was analysed using an inductive thematic approach underpinned by the Network Episode Model. RESULTS The presence and maintenance of interpersonal trust was a fundamental condition of the relational work required to develop, undertake and sustain relationships with others. Whilst relationships with spouses, family members and friends were generally viewed positively, the work required to engage human others was contingent, vicarious and overlain with felt and enacted stigma. Developing relationships with others was hindered by a lack of confidence fuelled by the experience of mental illness and a fear of rejection or failure. By contrast, weaker ties and inanimate objects and places offered and provided a sense of reliability and security. Strategies employed by participants in order to garner sufficient support for condition management in the light of these particular challenges are illuminated by the discussion of who and what is relevant and valued in personal support networks. CONCLUSIONS Access to valued activities, hobbies and things should be considered alongside human relationships in providing a means of ongoing support and resource for the everyday management of life for those experiencing severe and enduring mental health problems.
Collapse
Affiliation(s)
- Helen Louise Brooks
- Department of Health Services Research, Institute of Population Health Sciences, University of Liverpool, Liverpool, UK.
| | - Penny Bee
- grid.5379.80000000121662407Mental Health Research Group, Division of Nursing, Midwifery and Social Work, Faculty of Biology, Medicine and Health, School of Health Sciences, Manchester Academic Health Science Centre, University of Manchester, Manchester, UK
| | - Karina Lovell
- grid.5379.80000000121662407Mental Health Research Group, Division of Nursing, Midwifery and Social Work, Faculty of Biology, Medicine and Health, School of Health Sciences, Manchester Academic Health Science Centre, University of Manchester, Manchester, UK ,grid.450837.d0000 0004 0430 6955Greater Manchester Mental Health NHS Foundation Trust, Manchester, UK
| | - Anne Rogers
- grid.5491.90000 0004 1936 9297NIHR CLAHRC Wessex, Faculty of Environmental and Life Sciences, University of Southampton, Southampton, UK
| |
Collapse
|
13
|
Rushton K, Fraser C, Gellatly J, Brooks H, Bower P, Armitage CJ, Faija C, Welsh C, Bee P. A case of misalignment: the perspectives of local and national decision-makers on the implementation of psychological treatment by telephone in the Improving Access to Psychological Therapies Service. BMC Health Serv Res 2019; 19:997. [PMID: 31878923 PMCID: PMC6933680 DOI: 10.1186/s12913-019-4824-4] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2019] [Accepted: 12/09/2019] [Indexed: 11/10/2022] Open
Abstract
Background Psychological treatment delivered by telephone is recommended by the National Institute for Health and Care Excellence (NICE) for mild to moderate depression and anxiety, and forms a key part of the Improving Access to Psychological Therapy (IAPT) programme in the UK. Despite evidence of clinical effectiveness, patient engagement is often not maintained and psychological wellbeing practitioners (PWPs) report lacking confidence and training to deliver treatment by telephone. This study aimed to explore the perspectives of professional decision makers (both local and national) on the barriers and facilitators to the implementation of telephone treatment in IAPT. Methods Sixteen semi-structured qualitative telephone interviews and one focus group were carried out with decision makers (n = 21) who were involved locally and nationally in policy, practice and research. The interviews and focus group were coded thematically, and then mapped onto the four core constructs of Normalisation Process Theory (NPT). Results The use of telephone for psychological treatment was universally recognised amongst participants as beneficial for improving patient choice and access to treatment. However, at service level, motives for the implementation of telephone treatments are often misaligned with national objectives. Pressure to meet performance targets has become a key driver for the use of telephone treatment, with promises of increased efficiency and cost savings. These service-focussed objectives challenge the integration of telephone treatments, and PWP acceptance of telephone treatments as non-inferior to face-to-face. Ambivalence among a workforce often lacking the confidence to deliver telephone treatments leads to reluctance among PWPs to ‘sell’ treatments to a patient population who are not generally expecting treatment in this form. Conclusions Perceptions of a need to ‘sell’ telephone treatment in IAPT persist from top-level decision makers down to frontline practitioners, despite their conflicting motives for the use of telephone. The need for advocacy to highlight the clinical benefit of telephone treatment, along with adequate workforce support and guidance on best practice for implementation is critical to the ongoing success and sustainability of telephone treatment in primary care mental health programmes.
Collapse
Affiliation(s)
- Kelly Rushton
- School of Health Sciences, Division of Nursing, Midwifery and Social Work, University of Manchester, Manchester Academic Health Science Centre, Manchester, UK.
| | - Claire Fraser
- School of Health Sciences, Division of Nursing, Midwifery and Social Work, University of Manchester, Manchester Academic Health Science Centre, Manchester, UK
| | - Judith Gellatly
- School of Health Sciences, Division of Nursing, Midwifery and Social Work, University of Manchester, Manchester Academic Health Science Centre, Manchester, UK
| | - Helen Brooks
- Department of Health Services Research, Institute of Population Health Sciences, University of Liverpool, Liverpool, UK
| | - Peter Bower
- NIHR School for Primary Care Research, Centre for Primary Care and Centre for Health Informatics, Manchester Academic Health Science Centre, University of Manchester, Manchester, UK
| | - Christopher J Armitage
- School of Health Sciences, Division of Psychology and Mental Health, University of Manchester, Manchester University NHS Foundation Trust, Manchester Academic Health Science Centre, Manchester, UK
| | - Cintia Faija
- School of Health Sciences, Division of Psychology and Mental Health, University of Manchester, Manchester Academic Health Science Centre, Manchester, UK
| | - Charlotte Welsh
- School of Health Sciences, Division of Psychology and Mental Health, University of Manchester, Manchester Academic Health Science Centre, Manchester, UK
| | - Penny Bee
- School of Health Sciences, Division of Nursing, Midwifery and Social Work, University of Manchester, Manchester Academic Health Science Centre, Manchester, UK
| |
Collapse
|
14
|
Lovell K, Bee P, Bower P, Brooks H, Cahoon P, Callaghan P, Carter LA, Cree L, Davies L, Drake R, Fraser C, Gibbons C, Grundy A, Hinsliff-Smith K, Meade O, Roberts C, Rogers A, Rushton K, Sanders C, Shields G, Walker L. Training to enhance user and carer involvement in mental health-care planning: the EQUIP research programme including a cluster RCT. PROGRAMME GRANTS FOR APPLIED RESEARCH 2019. [DOI: 10.3310/pgfar07090] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
Abstract
Background
Service users and carers using mental health services want more involvement in their care and the aim of this research programme was to enhance service user and carer involvement in care planning in mental health services.
Objectives
Co-develop and co-deliver a training intervention for health professionals in community mental health teams, which aimed to enhance service user and carer involvement in care planning. Develop a patient-reported outcome measure of service user involvement in care planning, design an audit tool and assess individual preferences for key aspects of care planning involvement. Evaluate the clinical effectiveness and the cost-effectiveness of the training. Understand the barriers to and facilitators of implementing service user- and carer-involved care planning. Disseminate resources to stakeholders.
Methods
A systematic review, focus groups and interviews with service users/carers/health professionals informed the training and determined the priorities underpinning involvement in care planning. Data from focus groups and interviews were combined and analysed using framework analysis. The results of the systematic review, focus groups/interviews and a review of the training interventions were synthesised to develop the final training intervention. To develop and validate the patient-reported outcome measure, items were generated from focus groups and interviews, and a psychometric analysis was conducted. Patient-reported outcome measure items and a three-round consensus exercise were used to develop an audit tool, and a stated preference survey was undertaken to assess individual preferences for key aspects of care planning. The clinical effectiveness and cost-effectiveness of the training were evaluated using a pragmatic cluster trial with cohort and cross-sectional samples. A nested longitudinal qualitative process evaluation using multiple methods, including semistructured interviews with key informants involved locally and nationally in mental health policy, practice and research, was undertaken. A mapping exercise was used to determine current practice, and semistructured interviews were undertaken with service users and mental health professionals from both the usual-care and the intervention arms of the trial at three time points (i.e. baseline and 6 months and 12 months post intervention).
Results
The results from focus groups (n = 56) and interviews (n = 74) highlighted a need to deliver training to increase the quality of care planning and a training intervention was developed. We recruited 402 participants to develop the final 14-item patient-reported outcome measure and a six-item audit tool. We recruited 232 participants for the stated preference survey and found that preferences were strongest for the attribute ‘my preferences for care are included in the care plan’. The training was delivered to 304 care co-ordinators working in community mental health teams across 10 NHS trusts. The cluster trial and cross-sectional survey recruited 1286 service users and 90 carers, and the primary outcome was the Health Care Climate Questionnaire. Training was positively evaluated. The results showed no statistically significant difference on the primary outcome (the Health Care Climate Questionnaire) (adjusted mean difference –0.064, 95% confidence interval –0.343 to 0.215; p = 0.654) or secondary outcomes at the 6-month follow-up. Overall, the training intervention was associated with a net saving of –£54.00 (95% confidence interval –£193.00 to £84.00), with a net quality-adjusted life-year loss of –0.014 (95% confidence interval –0.034 to 0.005). The longitudinal process evaluation recruited 54 service users, professionals and carers, finding a failure of training to become embedded in routine care.
Limitations
Our pragmatic study was designed to improve service user and care involvement in care planning among routine community mental health services. We intervened in 18 sites with > 300 care co-ordinators. However, our volunteer sites may not be fully representative of the wider population, and we lacked data with which to compare our participants with the eligible population.
Conclusions
We co-developed and co-delivered a training intervention and developed a unidimensional measure of service user and carer involvement in care planning and an audit tool. Despite a high level of satisfaction with the training, no significant effect was found; therefore, the intervention was ineffective. There was a failure of training to become embedded and normalised because of a lack of organisational readiness to accept change. Working with NHS trusts in our ‘Willing Adopters’ programme with enhanced organisational buy-in yielded some promising results.
Future work
Research should focus on developing and evaluating new organisational initiatives in addition to training health-care professionals to address contextual barriers to service and carer involvement in care planning, and explore co-designing and delivering new ways of enhancing service users’ and carers’ capabilities to engage in care planning.
Trial registration
Current Controlled Trials ISRCTN16488358.
Funding
This project was funded by the National Institute for Health Research (NIHR) Programme Grants for Applied Research programme and will be published in full in Programme Grants for Applied Research; Vol. 7, No. 9. See the NIHR Journals Library website for further project information.
Collapse
Affiliation(s)
- Karina Lovell
- Division of Nursing, Midwifery and Social Work, School of Health Sciences, University of Manchester and Greater Manchester Mental Health NHS Foundation Trust, Manchester, UK
| | - Penny Bee
- Division of Nursing, Midwifery and Social Work, School of Health Sciences, University of Manchester and Greater Manchester Mental Health NHS Foundation Trust, Manchester, UK
| | - Peter Bower
- Division of Population Health, Health Services Research and Primary Care, School of Health Sciences, University of Manchester, Manchester, UK
| | - Helen Brooks
- Division of Nursing, Midwifery and Social Work, School of Health Sciences, University of Manchester and Greater Manchester Mental Health NHS Foundation Trust, Manchester, UK
| | - Patrick Cahoon
- Greater Manchester Mental Health NHS Foundation Trust, Manchester, UK
| | | | - Lesley-Anne Carter
- Division of Population Health, Health Services Research and Primary Care, School of Health Sciences, University of Manchester, Manchester, UK
| | - Lindsey Cree
- Division of Nursing, Midwifery and Social Work, School of Health Sciences, University of Manchester and Greater Manchester Mental Health NHS Foundation Trust, Manchester, UK
| | - Linda Davies
- Division of Population Health, Health Services Research and Primary Care, School of Health Sciences, University of Manchester, Manchester, UK
| | - Richard Drake
- Division of Psychology and Mental Health, School of Health Sciences, University of Manchester, Manchester, UK
| | - Claire Fraser
- Division of Nursing, Midwifery and Social Work, School of Health Sciences, University of Manchester and Greater Manchester Mental Health NHS Foundation Trust, Manchester, UK
| | - Chris Gibbons
- Division of Nursing, Midwifery and Social Work, School of Health Sciences, University of Manchester and Greater Manchester Mental Health NHS Foundation Trust, Manchester, UK
| | - Andrew Grundy
- School of Health Sciences, University of Nottingham, Nottingham, UK
| | | | - Oonagh Meade
- School of Health Sciences, University of Nottingham, Nottingham, UK
| | - Chris Roberts
- Division of Population Health, Health Services Research and Primary Care, School of Health Sciences, University of Manchester, Manchester, UK
| | - Anne Rogers
- Faculty of Health Sciences, University of Southampton, Southampton, UK
| | - Kelly Rushton
- Division of Nursing, Midwifery and Social Work, School of Health Sciences, University of Manchester and Greater Manchester Mental Health NHS Foundation Trust, Manchester, UK
| | - Caroline Sanders
- Division of Population Health, Health Services Research and Primary Care, School of Health Sciences, University of Manchester, Manchester, UK
| | - Gemma Shields
- Division of Population Health, Health Services Research and Primary Care, School of Health Sciences, University of Manchester, Manchester, UK
| | - Lauren Walker
- Division of Nursing, Midwifery and Social Work, School of Health Sciences, University of Manchester and Greater Manchester Mental Health NHS Foundation Trust, Manchester, UK
| |
Collapse
|
15
|
Brooks H, Rushton K, Lovell K, McNaughton R, Rogers A. 'He's my mate you see': a critical discourse analysis of the therapeutic role of companion animals in the social networks of people with a diagnosis of severe mental illness. MEDICAL HUMANITIES 2019; 45:326-334. [PMID: 31340997 PMCID: PMC6818524 DOI: 10.1136/medhum-2018-011633] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 06/12/2019] [Indexed: 05/27/2023]
Abstract
There is increasing recognition of the role pets play in the management of mental health conditions. Evidence suggests that pets promote social interaction and provide secure and intimate relationships which support the management of symptoms. This paper aimed to extend this evidence by exploring the phenomenological understanding of relationships and relationality with companion animals as therapeutic agents in the context of people's wider social networks.A qualitative study was undertaken incorporating 35 interviews with 12 participants with a diagnosis of severe mental illness who identified a pet as being important in the management of mental health. Participants took part in three in-depth interviews centred on ego network mapping over a 12-month period (baseline, 6 and 12 months). A critical discourse analysis examined therapeutic relationships with pets in relation to mental health and compared these to other types of support over time. Summative discourse analyses were combined with a cross-case thematic analysis to look for commonalities and differences across individuals.Compared with interactions with other therapeutic agents, relationships with pets were free from the obligations and complexities associated with other types of network members and provided an extension and reinforcement to an individual's sense of self which militated against the negative experiences associated with mental illness. Relationships with human network members were more variable in terms of consistency and capacity to manage demands (eg, network members requiring support themselves) and the emotions of others associated with fluctuations in mental health.This study adds weight to research supporting the inclusion of companion animals in the lexicon of mental health self-management through the therapeutic value attributed to them by participants within a wide personal network of support. The findings point to how consideration might usefully be given to how relationships with companion animals can be incorporated into healthcare planning and delivery.
Collapse
Affiliation(s)
- Helen Brooks
- Department of Health Services Research, Institute of Population Health Sciences, University of Liverpool, Liverpool, UK
| | - Kelly Rushton
- Mental Health Research Group, Division of Nursing, Midwifery and Social Work, School of Health Sciences, University of Manchester, Manchester, UK
| | - Karina Lovell
- Mental Health Research Group, Division of Nursing, Midwifery and Social Work, School of Health Sciences, University of Manchester, Manchester, UK
- Greater Manchester Mental Health NHS Foundation Trust, Manchester, UK
| | | | - Anne Rogers
- NIHR CLAHRC Wessex, University of Southampton, Southampton, UK
| |
Collapse
|