1
|
Graves JM, Abshire DA, Mackelprang JL, Klein TA, Gonzalez C, Parrott K, Eti DU, Ferris JG, Chacon CM, Beck AD. Adult perceptions of mental health access barriers facing youth in rural Washington State: A group concept mapping study. J Rural Health 2024. [PMID: 39138858 DOI: 10.1111/jrh.12866] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2023] [Revised: 07/02/2024] [Accepted: 07/09/2024] [Indexed: 08/15/2024]
Abstract
PURPOSE To explore adult community members' perspectives concerning barriers to mental health care that confront rural-dwelling youth. METHODS Group concept mapping, a participatory community-engaged research method, was used. Adult community members brainstormed and sorted statements describing barriers rural youth encounter in accessing mental health services. Point and cluster maps were created to visualize conceptual similarities between statements. Statements were rated according to their commonness and importance (1: low commonness/importance, 5: high commonness/importance). FINDINGS Thirty-five adults sorted and/or rated 71 barriers facing rural youth in accessing mental health services. Seven conceptual clusters were identified: system-level barriers, knowledge and communication, youth concerns, parent/guardian concerns, parent/guardian barriers, costs and convenience, and school-level barriers. Within youth concerns, community members also identified a subcluster focused on stigma. Common and important statements related to limited after-school programs and community mental health support initiatives. CONCLUSIONS Group concept mapping methodology provides structure for conceptualizing challenges facing rural youth in accessing mental health services. Policies should be informed by rural community concerns and priorities. After-school and support programs may align with mental health needs identified by rural communities.
Collapse
Affiliation(s)
- Janessa M Graves
- WWAMI Rural Health Research Center, Department of Family Medicine, School of Medicine, University of Washington, Seattle, Washington, USA
- Nursing and Systems Science Department, College of Nursing Spokane, Washington State University, Spokane, Washington, USA
| | - Demetrius A Abshire
- Department of Biobehavioral Health & Nursing Science, College of Nursing, University of South Carolina, Columbia, South Carolina, USA
| | - Jessica L Mackelprang
- Department of Psychological Sciences, Swinburne University of Technology, Melbourne, Victoria, Australia
| | - Tracy A Klein
- Nursing and Systems Science Department, College of Nursing Vancouver, Washington State University, Vancouver, Washington, USA
| | - Carmen Gonzalez
- Department of Communications, University of Washington, Seattle, Washington, USA
| | - Kailee Parrott
- Nursing and Systems Science Department, College of Nursing Spokane, Washington State University, Spokane, Washington, USA
- Department of Biochemistry, University of Washington, Seattle, Washington, USA
| | - Deborah U Eti
- Advanced Practice and Community-Based Care Department, College of Nursing Spokane, Washington State University, Spokane, Washington, United States
| | - Jordan G Ferris
- Nursing and Systems Science Department, College of Nursing Spokane, Washington State University, Spokane, Washington, USA
| | - Christina M Chacon
- Advanced Practice and Community-Based Care Department, College of Nursing Tri Cities, Washington State University, Richland, Washington, USA
| | - Ashley D Beck
- Washington State Department of Health, Olympia, Washington, USA
| |
Collapse
|
2
|
Fusar-Poli P, Estradé A, Esposito CM, Rosfort R, Basadonne I, Mancini M, Stanghellini G, Otaiku J, Olanrele O, Allen L, Lamba M, Alaso C, Ieri J, Atieno M, Oluoch Y, Ireri P, Tembo E, Phiri IZ, Nkhoma D, Sichone N, Siadibbi C, Sundi PRIO, Ntokozo N, Fusar-Poli L, Floris V, Mensi MM, Borgatti R, Damiani S, Provenzani U, Brondino N, Bonoldi I, Radua J, Cooper K, Shin JI, Cortese S, Danese A, Bendall S, Arango C, Correll CU, Maj M. The lived experience of mental disorders in adolescents: a bottom-up review co-designed, co-conducted and co-written by experts by experience and academics. World Psychiatry 2024; 23:191-208. [PMID: 38727047 PMCID: PMC11083893 DOI: 10.1002/wps.21189] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 05/13/2024] Open
Abstract
We provide here the first bottom-up review of the lived experience of mental disorders in adolescents co-designed, co-conducted and co-written by experts by experience and academics. We screened first-person accounts within and outside the medical field, and discussed them in collaborative workshops involving numerous experts by experience - representing different genders, ethnic and cultural backgrounds, and continents - and their family members and carers. Subsequently, the material was enriched by phenomenologically informed perspectives and shared with all collaborators. The inner subjective experience of adolescents is described for mood disorders, psychotic disorders, attention-deficit/hyperactivity disorder, autism spectrum disorders, anxiety disorders, eating disorders, externalizing disorders, and self-harm behaviors. The recollection of individuals' past histories also indexes the prodromal (often transdiagnostic) features predating the psychiatric diagnosis. The experience of adolescents with mental disorders in the wider society is described with respect to their family, their school and peers, and the social and cultural context. Furthermore, their lived experience of mental health care is described with respect to receiving a diagnosis of mental disorder, accessing mental health support, receiving psychopharmacological treatment, receiving psychotherapy, experiencing peer support and mental health activism, and achieving recovery. These findings can impact clinical practice, research, and the whole society. We hope that this co-designed, co-conducted and co-written journey can help us maintain our commitment to protecting adolescents' fragile mental health, and can help them develop into a healthy, fulfilling and contributing adult life.
Collapse
Affiliation(s)
- Paolo Fusar-Poli
- Early Psychosis: Interventions and Clinical-detection (EPIC) Lab, Department of Psychosis Studies, King's College London, London, UK
- Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy
- OASIS Service, South London and Maudsley NHS Foundation Trust, London, UK
- Department of Psychiatry and Psychotherapy, University Hospital, Ludwig-Maximilian-University, Munich, Germany
| | - Andrés Estradé
- Early Psychosis: Interventions and Clinical-detection (EPIC) Lab, Department of Psychosis Studies, King's College London, London, UK
| | - Cecilia M Esposito
- Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy
| | - René Rosfort
- S. Kierkegaard Research Centre, University of Copenhagen, Copenhagen, Denmark
| | - Ilaria Basadonne
- Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy
| | - Milena Mancini
- Department of Psychological Sciences, Health and Territory, G. D'Annunzio University of Chieti and Pescara, Chieti, Italy
| | - Giovanni Stanghellini
- Department of Health Sciences, University of Florence, Florence, Italy
- Diego Portales University, Santiago, Chile
| | - Jummy Otaiku
- Young Person's Mental Health Advisory Group, King's College London, London, UK
| | | | - Lucas Allen
- OASIS Service, South London and Maudsley NHS Foundation Trust, London, UK
| | | | | | - Judy Ieri
- Global Mental Health Peer Network, Nairobi, Kenya
| | | | | | - Phides Ireri
- Global Mental Health Peer Network, Nairobi, Kenya
| | - Ephraim Tembo
- Global Mental Health Peer Network, Lusaka, Zambia
- University of Zambia, Lusaka, Zambia
| | | | | | - Noah Sichone
- Global Mental Health Peer Network, Lusaka, Zambia
| | - Candy Siadibbi
- Global Mental Health Peer Network, Lusaka, Zambia
- Psychology Association of Zambia, Lusaka, Zambia
| | | | - Nyathi Ntokozo
- Global Mental Health Peer Network, Bulawayo, Zimbabwe
- Youth Support Network Trust, Bulawayo, Zimbabwe
| | - Laura Fusar-Poli
- Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy
| | - Valentina Floris
- Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy
| | - Martina M Mensi
- National Neurological Institute, IRCCS C. Mondino Foundation, Pavia, Italy
| | - Renato Borgatti
- Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy
- National Neurological Institute, IRCCS C. Mondino Foundation, Pavia, Italy
| | - Stefano Damiani
- Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy
| | - Umberto Provenzani
- Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy
| | - Natascia Brondino
- Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy
| | - Ilaria Bonoldi
- South London and Maudsley NHS Foundation Trust, London, UK
- Department of Psychosis Studies, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| | - Joaquim Radua
- Institut d'Investigacions Biomediques August Pi i Sunyer, CIBERSAM, Instituto de Salud Carlos III, University of Barcelona, Barcelona, Spain
| | - Kate Cooper
- Department of Clinical, Educational and Health Psychology, University College London, London, UK
| | - Jae Il Shin
- Department of Pediatrics, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Samuele Cortese
- Centre for Innovation in Mental Health, School of Psychology, Faculty of Environmental and Life Sciences, University of Southampton, Southampton, UK
- Clinical and Experimental Sciences (CNS and Psychiatry), Faculty of Medicine, University of Southampton, Southampton, UK
- Hassenfeld Children's Hospital at NYU Langone, New York University Child Study Center, New York, NY, USA
- Solent NHS Trust, Southampton, UK
- Department of Precision and Regenerative Medicine and Jonic Area, University of Bari, Bari, Italy
| | - Andrea Danese
- Social, Genetic and Developmental Psychiatry Centre and Department of Child and Adolescent Psychiatry, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
- National and Specialist Child and Adolescent Mental Health Service Clinic for Trauma, Anxiety and Depression, South London and Maudsley NHS Foundation Trust, London, UK
| | - Sarah Bendall
- Orygen, Melbourne, VIC, Australia
- Centre for Youth Mental Health, University of Melbourne, Melbourne, VIC, Australia
| | - Celso Arango
- Institute of Psychiatry and Mental Health, Department of Child and Adolescent Psychiatry, Hospital General Universitario G. Marañón, School of Medicine, Universidad Complutense, CIBERSAM, Madrid, Spain
| | - Christoph U Correll
- Department of Child and Adolescent Psychiatry, Universitätsmedizin Berlin, Berlin, Germany
- Departments of Psychiatry and Molecular Medicine, Zucker School of Medicine at Hofstra/Northwell, Hempstead, NY, USA
- Department of Psychiatry, Zucker Hillside Hospital, Northwell Health, Glen Oaks, NY, USA
| | - Mario Maj
- Department of Psychiatry, University of Campania "Luigi Vanvitelli", Naples, Italy
| |
Collapse
|
3
|
Herlitz L, Ashford E, Powell C, Herbert K, Morris S, Woodman J. Access to primary care for children and young people (CYP) in the UK: a scoping review of CYP's, caregivers' and healthcare professionals' views and experiences of facilitators and barriers. BMJ Open 2024; 14:e081620. [PMID: 38816045 PMCID: PMC11141190 DOI: 10.1136/bmjopen-2023-081620] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Accepted: 03/19/2024] [Indexed: 06/01/2024] Open
Abstract
OBJECTIVES To examine children and young people's (CYP), caregivers' and healthcare professionals' (HCPs) views or experiences of facilitators and barriers to CYP access to UK primary care services to better understand healthcare inequity. To explore differences across CYP subpopulations with greater health needs from deprived areas, identifying as ethnic minorities, with experiences of state care, special educational needs or disabilities, chronic conditions or mental health problems. DESIGN Scoping review. ELIGIBILITY CRITERIA Included studies were in English, published 2012-2022 and reported: the views/experiences of CYP (0-25 years), caregivers or HCPs about accessing UK primary care; using quantitative or qualitative empirical methods. DATA SOURCES PubMed, CINAHL, Web of Science, PsycINFO and Scopus. RESULTS We included 47 reports (46 studies). CYP/caregivers' decision to access care was facilitated by CYP/caregivers' or their family/friends' ability to identify a health issue as warranting healthcare attention. Barriers to accessing care included perceived stigma (eg, being seen as a bad parent), embarrassment and discrimination experiences. CYP and caregivers believed longer opening hours could facilitate more timely access to care. Caregivers and HCPs reported that delayed or rejected referrals to secondary or adult care were a barrier to having needs met, especially for CYP with poor mental health. CYP and caregivers in numerous studies emphasised the importance of communication and trust with HCPs, including taking their concerns seriously, being knowledgeable and providing continuity of care for CYP. Common barriers reported across high-need subpopulations were caregivers needing knowledge and confidence to advocate for their child, gaps in HCP's knowledge and a lack of connectedness between primary and secondary care. CONCLUSIONS Connecting general practices and community health workers/services, improving CYP/caregivers' understanding of common childhood conditions, addressing HCP's knowledge gaps in paediatric care and integrated approaches between primary and secondary care may reduce inequity in access.
Collapse
Affiliation(s)
- Lauren Herlitz
- NIHR Children and Families Policy Research Unit, Population, Policy and Practice, UCL GOS Institute of Child Health, London, UK
| | - Emily Ashford
- Thomas Coram Research Unit, UCL Social Research Institute, London, UK
| | - Claire Powell
- NIHR Children and Families Policy Research Unit, Population, Policy and Practice, UCL GOS Institute of Child Health, London, UK
| | - Kevin Herbert
- Public Health & Primary Care, University of Cambridge, Cambridge, UK
| | - Stephen Morris
- Public Health & Primary Care, University of Cambridge, Cambridge, UK
| | - Jenny Woodman
- Thomas Coram Research Unit, UCL Social Research Institute, London, UK
| |
Collapse
|
4
|
Soneson E, White SR, Howarth E, Ford T, Fazel M, Jones PB. Access to and perceived unmet need for mental health services and support in a community sample of UK adolescents with and without experience of childhood adversity. Epidemiol Psychiatr Sci 2024; 33:e1. [PMID: 38264958 PMCID: PMC7615639 DOI: 10.1017/s2045796024000027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Revised: 11/24/2023] [Accepted: 12/06/2023] [Indexed: 01/25/2024] Open
Abstract
AIMS Children and adolescents with a history of adverse childhood experiences (ACEs) are more likely than their peers to develop mental health difficulties, but not enough is known about their help-seeking behaviours and preferences. We aimed to determine whether ACEs are associated with access to and perceived unmet need for mental health services and support amongst secondary school students. METHODS We used multi-level logistic regression with data from the 2020 OxWell Student Survey to assess whether ACEs were associated with (1) prior access to mental health support and (2) perceived unmet need for mental health services in a community sample of English secondary school students. We assessed ACEs as a cumulative score from the Center for Youth Wellness Adverse Childhood Experiences Questionnaire: Teen Self-Report version and accounted for current mental health difficulties as measured by the 25-item Revised Children's Anxiety and Depression Scale (RCADS). RESULTS Our analysis included 2018 students across 64 schools, of whom 29.9% (598/2002) reported prior access to mental health support. Of those not reporting prior access, 34.1% (469/1377) reported a perceived unmet need for services. In the unadjusted models, cumulative ACE scores were significantly positively associated with both prior access to mental health support (odds ratio (OR) = 1.36; 95% confidence interval (CI): 1.29-1.43) and perceived unmet need for mental health services (OR = 1.47; 95% CI: 1.37-1.59), meaning that students who had experienced adversity had a greater chance of having previously accessed support as well as perceiving an unmet need for services. After adjusting for mental health difficulties and other sociodemographic variables, cumulative ACE scores were positively associated with prior access (adjusted OR (aOR) = 1.25; 95% CI: 1.17-1.34 with a significant interaction between RCADS and ACE scores, aOR = 0.88; 95% CI: 0.84-0.93) as well as perceived unmet need (aOR = 1.32; 95% CI: 1.21-1.43 with a significant interaction between RCADS and ACE scores, aOR = 0.85; 95% CI: 0.78-0.91). CONCLUSIONS Although it is encouraging that adolescents with experience of adversity are more likely than their peers with similar levels of depression and anxiety symptoms to have accessed mental health support, there remains a concern that those who have not accessed support are more likely to perceive an as-yet unmet need for it. Mental health support must be available, accessible and acceptable to all who need it, especially for those groups that traditionally have not accessed services, including the more marginalised and vulnerable populations.
Collapse
Affiliation(s)
- E. Soneson
- Department of Psychiatry, University of Oxford, Oxford, UK
| | - S. R. White
- Department of Psychiatry, University of Cambridge, Cambridge, UK
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
| | - E. Howarth
- School of Psychology, University of Sussex, Brighton, UK
| | - T. Ford
- Department of Psychiatry, University of Cambridge, Cambridge, UK
| | - M. Fazel
- Department of Psychiatry, University of Oxford, Oxford, UK
| | - P. B. Jones
- Department of Psychiatry, University of Cambridge, Cambridge, UK
| |
Collapse
|
5
|
Goodwin J, Cummins J, O'Malley M. "I thought it would just be, like, older men in white coats": A qualitative exploration of first encounters with mental health services. Int J Ment Health Nurs 2023. [PMID: 37114682 DOI: 10.1111/inm.13157] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/23/2023] [Revised: 03/28/2023] [Accepted: 04/13/2023] [Indexed: 04/29/2023]
Abstract
Individuals whose mental health is becoming a concern may not receive the care they require. Although efforts have been made to reduce barriers to accessing services, including stigma reduction campaigns and healthcare practitioner training, there remains a lack of understanding of individual perspectives regarding help-seeking behaviour. The aim of this study was to explore people's first experiences accessing mental health services. A qualitative descriptive approach was adopted. Interviews were conducted with eight service users. Data were analysed using reflexive thematic analysis. The COREQ checklist guided this study (Tong et al., 2007, International Journal for Quality in Health Care, 19, 349). Three themes were identified: learning to navigate an unfamiliar system, making sense of mental health services, and promoting a positive image for those in need of care. Uncertainty about mental health services and stigmatizing images could be mitigated by developing positive media-based interventions. Systemic barriers need to be addressed and services need to be better resourced to ensure the benefits of early intervention are available to those experiencing mental health challenges. To encourage people to access services earlier, services need to be promoted in a positive way.
Collapse
Affiliation(s)
- John Goodwin
- Catherine McAuley School of Nursing and Midwifery, University College Cork, Cork, Ireland
| | - John Cummins
- Student Health and Wellbeing, University College Cork, Cork, Ireland
| | - Maria O'Malley
- Catherine McAuley School of Nursing and Midwifery, University College Cork, Cork, Ireland
| |
Collapse
|
6
|
'You're on the waiting list': An interpretive phenomenological analysis of young adults' experiences of waiting lists within mental health services in the UK. PLoS One 2022; 17:e0265542. [PMID: 35303040 PMCID: PMC8932552 DOI: 10.1371/journal.pone.0265542] [Citation(s) in RCA: 22] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2021] [Accepted: 03/03/2022] [Indexed: 11/20/2022] Open
Abstract
Waiting lists in mental health services are currently considered too long. Lengthy waits of up to 18 weeks are commonly reported in the UK. Waiting lists have long been associated with a variety of negative psychological responses, however there is little understanding behind young adults’ personal experiences of such delays within mental health services. The current study aimed to explore young adults’ experiences of waiting lists in mental healthcare in the UK. Seven young adults were interviewed in the current study (aged 19–22). Interpretive phenomenological analysis was utilised to explore participant accounts. Three super-ordinate themes were generated: Reliance on Alternative Methods of Support; Inability to Function Sufficiently; and Emergence of Negative Beliefs, Emotions and Thoughts. Participants primarily reported a variety of negative psychological and behavioural consequences associated with waiting lists in mental health services, as well as exacerbated existing physical and psychological health issues. In accordance with the limited number of previous studies, waiting lists are considered by patients to be barriers to mental health support and intervention. Future direction is advised.
Collapse
|
7
|
Hassan SM, Worsley J, Nolan L, Fearon N, Ring A, Shelton J, McEgan D, Yameen F, Khedmati EM, Kullu C. An exploration of young people's, parent/carers', and professionals' experiences of a voluntary sector organisation operating a Youth Information, Advice, and Counselling (YIAC) model in a disadvantaged area. BMC Health Serv Res 2022; 22:383. [PMID: 35321699 PMCID: PMC8941750 DOI: 10.1186/s12913-022-07800-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2021] [Accepted: 03/18/2022] [Indexed: 11/22/2022] Open
Abstract
Background The present evaluation explored young people’s, parents/carers, and healthcare professionals’ perceptions of the Youth Information, Advice and Counselling (YIAC) model operated by a voluntary sector organisation in North West England. With an aim to understand the key components that contribute to enhancing the success of the YIAC model. Method Semi-structured interviews and focus groups with young people, parents/carers, and healthcare professionals were conducted. Data were analysed using thematic analysis. Results Five main themes were identified from the data: 1) Accessibility and flexibility; 2) Non-clinical model and environment; 3) Staff; 4) Partnership working; and 5) Promotion of positive mental health and wellbeing. Conclusion Findings highlight the importance of non-clinical, community-based, ‘one-stop-shop’ hubs for young people in disadvantaged areas. The key components highlighted as facilitating access and engagement include: opportunity to self-refer, choice of location, timely provision of support, non-clinical environment, age appropriate services, a non-hierarchical workforce, inclusive support for family and carers, a focus on wider, often social, issues, and collaboration with partner organisations. These findings suggest that early support hubs for young people’s mental health should have consistent, long-term funding and should exist in every local area. Supplementary Information The online version contains supplementary material available at 10.1186/s12913-022-07800-1.
Collapse
Affiliation(s)
- Shaima M Hassan
- Department of Primary Care and Mental Health, Institute of Population Health Sciences, University of Liverpool, Waterhouse Building, Brownlow Street, L69 3GL, Liverpool, UK. .,NIHR Applied Research Collaboration North West Coast ARC NWC, Liverpool, UK.
| | - Joanne Worsley
- Department of Primary Care and Mental Health, Institute of Population Health Sciences, University of Liverpool, Waterhouse Building, Brownlow Street, L69 3GL, Liverpool, UK.,NIHR Applied Research Collaboration North West Coast ARC NWC, Liverpool, UK
| | - Lisa Nolan
- Liverpool Clinical Commissioning Group, Liverpool, UK
| | | | - Adele Ring
- Department of Primary Care and Mental Health, Institute of Population Health Sciences, University of Liverpool, Waterhouse Building, Brownlow Street, L69 3GL, Liverpool, UK
| | - Jane Shelton
- NIHR Applied Research Collaboration North West Coast ARC NWC, Liverpool, UK
| | - David McEgan
- NIHR Applied Research Collaboration North West Coast ARC NWC, Liverpool, UK
| | - Farheen Yameen
- NIHR Applied Research Collaboration North West Coast ARC NWC, Liverpool, UK
| | | | - Cecil Kullu
- Mersey Care NHS Foundation Trust, Liverpool, UK
| |
Collapse
|
8
|
Lockwood J, Williams L, Martin JL, Rathee M, Hill C. Effectiveness, User Engagement and Experience, and Safety of a Mobile App (Lumi Nova) Delivering Exposure-Based Cognitive Behavioral Therapy Strategies to Manage Anxiety in Children via Immersive Gaming Technology: Preliminary Evaluation Study. JMIR Ment Health 2022; 9:e29008. [PMID: 35072644 PMCID: PMC8822420 DOI: 10.2196/29008] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/22/2021] [Revised: 10/18/2021] [Accepted: 10/18/2021] [Indexed: 01/23/2023] Open
Abstract
BACKGROUND Childhood anxiety disorders are a prevalent mental health problem that can be treated effectively with cognitive behavioral therapy, in which exposure is a key component; however, access to treatment is poor. Mobile-based apps on smartphones or tablets may facilitate the delivery of evidence-based therapy for child anxiety, thereby overcoming the access and engagement barriers of traditional treatment. Apps that deliver therapeutic content via immersive gaming technology could offer an effective, highly engaging, and flexible treatment proposition. OBJECTIVE In this paper, we aim to describe a preliminary multi-method evaluation of Lumi Nova, a mobile app intervention targeting mild to moderate anxiety problems in children aged 7-12 years using exposure therapy delivered via an immersive game. The primary objective is to evaluate the effectiveness, user engagement and experience, and safety of the beta version of Lumi Nova. METHODS Lumi Nova was co-designed with children, parents, teachers, clinicians, game industry experts, and academic partnerships. In total, 120 community-based children with mild to moderate anxiety and their guardians were enrolled to participate in an 8-week pilot study. The outcome measures captured the app's effectiveness (anxiety symptoms, child-identified goal-based outcomes, and functional impairment), user engagement (game play data and ease-of-use ratings), and safety (mood ratings and adverse events). The outcome measures before and after the intervention were available for 30 children (age: mean 9.8, SD 1.7 years; girls: 18/30, 60%; White: 24/30, 80%). Additional game play data were automatically generated for 67 children (age: mean 9.6, SD 1.53 years; girls: 35/67, 52%; White: 42/67, 63%). Postintervention open-response data from 53% (16/30) of guardians relating to the primary objectives were also examined. RESULTS Playing Lumi Nova was effective in reducing anxiety symptom severity over the 8-week period of game play (t29=2.79; P=.009; Cohen d=0.35) and making progress toward treatment goals (z=2.43; P=.02), but there were no improvements in relation to functional impairment. Children found it easy to play the game and engaged safely with therapeutic content. However, the positive effects were small, and there were limitations to the game play data. CONCLUSIONS This preliminary study provides initial evidence that an immersive mobile game app may safely benefit children experiencing mild to moderate anxiety. It also demonstrates the value of the rigorous evaluation of digital interventions during the development process to rapidly improve readiness for full market launch.
Collapse
Affiliation(s)
- Joanna Lockwood
- National Institute of Health Research MindTech MedTech Co-operative, School of Medicine, University of Nottingham, Nottingham, United Kingdom
| | - Laura Williams
- National Institute of Health Research MindTech MedTech Co-operative, School of Medicine, University of Nottingham, Nottingham, United Kingdom
| | - Jennifer L Martin
- National Institute of Health Research MindTech MedTech Co-operative, School of Medicine, University of Nottingham, Nottingham, United Kingdom
| | | | - Claire Hill
- School of Psychology & Clinical Language Sciences, University of Reading, Reading, United Kingdom
| |
Collapse
|
9
|
Sheng Q, Cai C, Li P, Chen L, Zhang X, Wang X, Gong Y. Development and Validation of a Nomogram for Predicting the Unresolved Risk of Parents of Adolescents With Psychiatric Diagnoses. Front Psychiatry 2022; 13:796384. [PMID: 35432017 PMCID: PMC9010732 DOI: 10.3389/fpsyt.2022.796384] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/16/2021] [Accepted: 02/01/2022] [Indexed: 12/29/2022] Open
Abstract
Evaluating the resolution of parents of ill children can help in taking measures to alleviate their distress in a timely manner and promote children's rehabilitation. This study aims to develop and validate a nomogram for predicting the unresolved risk of parents of adolescents with psychiatric diagnoses. The data for 130 parents (modeling dataset = 90; validation dataset = 40) were collected. A nomogram was first developed to predict the unresolved risk for parents based on the logistic regression analysis in the modeling dataset. The internal and external validation then were conducted through quantifying the performance of the nomogram with respect to discrimination and calibration, respectively, in the modeling and validation datasets. Finally, the clinical use was evaluated through decision curve analyses (DCA) in the overall dataset. In the results, the nomogram consisted of six risk factors and provided a good discrimination with areas under the curve of 0.920 (95% CI, 0.862-0.978) in internal validation and 0.886 (95% CI, 0.786-0.986) in external validation. The calibration with good consistency between the observed probability and predicted probability was also found in both internal and external validation. DCA showed that the nomogram had a good clinical utility. In conclusion, the proposed nomogram exhibited a favorable performance with regard to its predictive accuracy, discrimination capability, and clinical utility, and, thus, can be used as a convenient and reliable tool for predicting the unresolved risk of parents of children with psychiatric diagnoses.
Collapse
Affiliation(s)
- Qingqing Sheng
- Guangzhou Institute of Respiratory Health, The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Chunfeng Cai
- School of Health Sciences, Wuhan University, Wuhan, China
| | - Pingdong Li
- Nursing Department, The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Lihua Chen
- Guangzhou Institute of Respiratory Health, The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Xi Zhang
- The First Clinical Medical College, Anhui Medical University, Hefei, China
| | - Xinyu Wang
- School of Health Sciences, Wuhan University, Wuhan, China
| | - Yucui Gong
- Nursing Department, The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| |
Collapse
|
10
|
Radez J, Reardon T, Creswell C, Orchard F, Waite P. Adolescents' perceived barriers and facilitators to seeking and accessing professional help for anxiety and depressive disorders: a qualitative interview study. Eur Child Adolesc Psychiatry 2022; 31:891-907. [PMID: 33502596 PMCID: PMC9209355 DOI: 10.1007/s00787-020-01707-0] [Citation(s) in RCA: 22] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/09/2020] [Accepted: 12/16/2020] [Indexed: 10/29/2022]
Abstract
Anxiety and depressive disorders are the most common mental health disorders in adolescents, yet only a minority of young people with these disorders access professional help. This study aims to address this treatment gap by improving our understanding of barriers and facilitators to seeking/accessing professional help as perceived by adolescents with anxiety/depressive disorders identified in the community. Twenty-two adolescents, aged 11-17 years, who met diagnostic criteria for a current anxiety and/or depressive disorder were identified through school-based screening. In-depth qualitative interviews were conducted one-to-one with each adolescent and adolescents' parents were interviewed separately for the purpose of data triangulation. Data were analysed using reflexive thematic analysis. We identified four themes capturing adolescent perceived barriers and facilitators to seeking/accessing professional help for anxiety and depressive disorders: (1) making sense of difficulties, (2) problem disclosure, (3) ambivalence to seeking help, and (4) the instrumental role of others. Barriers/facilitators identified within each theme reflect important developmental characteristics of adolescence, such as a growing need for autonomy and concerns around negative social evaluation. At the same time, the results highlight adolescents' dependency on other people, mainly their parents and school staff, when it comes to successfully accessing professional help for their mental health difficulties. This study identifies a number of barriers/facilitators that influence help-seeking behaviour of adolescents with anxiety and/or depressive disorders. These factors need to be addressed when targeting treatment utilisation rates in this particular group of young people.
Collapse
Affiliation(s)
- Jerica Radez
- grid.9435.b0000 0004 0457 9566School of Psychology and Clinical Language Sciences, University of Reading, Reading, RG6 6AL UK ,grid.4991.50000 0004 1936 8948The Oxford Institute of Clinical Psychology Training and Research, University of Oxford, Oxford, OX3 7JX UK
| | - Tessa Reardon
- School of Psychology and Clinical Language Sciences, University of Reading, Reading, RG6 6AL, UK. .,Departments of Experimental Psychology and Psychiatry, University of Oxford, Oxford, OX2 6GG, UK.
| | - Cathy Creswell
- grid.4991.50000 0004 1936 8948Departments of Experimental Psychology and Psychiatry, University of Oxford, Oxford, OX2 6GG UK
| | - Faith Orchard
- grid.12082.390000 0004 1936 7590School of Psychology, University of Sussex, Brighton, BN1 9RH UK
| | - Polly Waite
- grid.9435.b0000 0004 0457 9566School of Psychology and Clinical Language Sciences, University of Reading, Reading, RG6 6AL UK ,grid.4991.50000 0004 1936 8948Departments of Experimental Psychology and Psychiatry, University of Oxford, Oxford, OX2 6GG UK
| |
Collapse
|
11
|
Longhurst P, Sumner AL, Smith S, Eilenberg J, Duncan C, Cooper M. ‘They need somebody to talk to’: Parents' and carers' perceptions of school‐based humanistic counselling. COUNSELLING & PSYCHOTHERAPY RESEARCH 2021. [DOI: 10.1002/capr.12496] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Affiliation(s)
- Phaedra Longhurst
- British Association for Counselling and Psychotherapy (BACP) Lutterworth UK
| | | | - Stephanie Smith
- National Children's Bureau (NCB) University of Roehampton London UK
| | - Jon Eilenberg
- National Children's Bureau (NCB) University of Roehampton London UK
| | - Charlie Duncan
- British Association for Counselling and Psychotherapy (BACP) Lutterworth UK
| | - Mick Cooper
- School of Psychology University of Roehampton London UK
| |
Collapse
|
12
|
Hansen AS, Christoffersen CH, Telléus GK, Lauritsen MB. Referral patterns to outpatient child and adolescent mental health services and factors associated with referrals being rejected. A cross-sectional observational study. BMC Health Serv Res 2021; 21:1063. [PMID: 34625073 PMCID: PMC8501731 DOI: 10.1186/s12913-021-07114-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2021] [Accepted: 10/01/2021] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Outpatient child and adolescent mental health services (CAMHS) are faced with the challenge of balancing increasing demands with limited resources. An additional challenge is high rejection rates of referrals which causes frustration for referring agents and families. In order to effectively plan and allocate available resources within CAMHS there is a need for up-to-date knowledge on referral patterns and factors associated with rejection of referrals. METHODS In this cross-sectional observational study we did a retrospective review of all referrals (n = 1825) for children (0-18) referred for assessment at the outpatient CAMHS of the North Denmark Region in 2018. RESULTS The most common referral reasons to CAMHS were attention deficit disorder (ADHD/ADD) (27.9%), autism spectrum disorder (22.4%), affective disorders (14.0%) and anxiety disorders (11.6%). The majority of referrals came from general practitioners, but for neurodevelopmental disorders educational psychologists were the primary referral source. Re-referrals constituted more than a third of all referrals (35.9%). Children in care were overrepresented in this clinical sample and had an increased risk (Adj. OR 2.54) of having their referrals rejected by CAMHS. Referrals from general practitioners were also associated with an increased risk of rejection (Adj. OR 3.29). CONCLUSIONS A high proportion of children with mental disorders have a repeated need for assessment by CAMHS. There is a need for future research on predictors of re-referral to outpatient services to identify potential targets for reducing re-referral rates as well as research on how to optimize service provision for children with a repeated need for assessment. General practitioners are the main gatekeepers to CAMHS and research on interventions to improve the referral process should be aimed towards general practitioners.
Collapse
Affiliation(s)
- Anna Sofie Hansen
- Aalborg University Hospital, Psychiatry, Mølleparkvej 10, 9000, Aalborg, Denmark. .,Department of Clinical Medicine, Aalborg University, Sdr. Skovvej 15, 9000, Aalborg, Denmark.
| | | | - Gry Kjaersdam Telléus
- Aalborg University Hospital, Psychiatry, Mølleparkvej 10, 9000, Aalborg, Denmark.,Psychology, Department of Communication and Psychology, Aalborg University, Rendsburggade 14, 9000, Aalborg, Denmark
| | - Marlene Briciet Lauritsen
- Aalborg University Hospital, Psychiatry, Mølleparkvej 10, 9000, Aalborg, Denmark.,Department of Clinical Medicine, Aalborg University, Sdr. Skovvej 15, 9000, Aalborg, Denmark
| |
Collapse
|
13
|
Parent-perceived barriers to accessing services for their child's mental health problems. Child Adolesc Psychiatry Ment Health 2021; 15:4. [PMID: 33514400 PMCID: PMC7847149 DOI: 10.1186/s13034-021-00357-7] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/27/2020] [Accepted: 01/11/2021] [Indexed: 01/14/2023] Open
Abstract
BACKGROUND Many children and adolescents with impairing mental health disorders are not in contact with specialized child and adolescent mental health services (CAMHS). In order to close the service gap, it is important to increase our knowledge of barriers to access. The aim of this study was to investigate parent perceived barriers to accessing services for their child's mental health problems to identify potential areas for improvement of access to CAMHS. METHOD In this cross-sectional observational study 244 parents of children and adolescents referred to outpatient psychiatric assessment were interviewed using the Children's services interview regarding barriers to accessing child mental health services across healthcare, educational services and social services. Parent reported barriers were analyzed in relation to the child's age, referral reason, symptom duration and impairment of the child. RESULTS The most commonly reported barriers were lack of information about were to seek help (60.3%), the perception that professionals did not listen (59.8%) and professionals refusing to initiate interventions or provide referral to services (53.7%). Lack of knowledge, stigmatization and unavailability of services were common themes across barriers to help-seeking. Long symptom duration and parent rated impairment was associated with increased risk of reporting several barriers to help-seeking. CONCLUSION Parents seeking help for their child's mental health encounter numerous barriers that could explain part of the treatment gap and long duration of mental health problems in children prior to referral to CAMHS.
Collapse
|
14
|
Olson JR, Lucy M, Kellogg MA, Schmitz K, Berntson T, Stuber J, Bruns EJ. What Happens When Training Goes Virtual? Adapting Training and Technical Assistance for the School Mental Health Workforce in Response to COVID-19. SCHOOL MENTAL HEALTH 2021; 13:160-173. [PMID: 33425042 PMCID: PMC7781169 DOI: 10.1007/s12310-020-09401-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/28/2020] [Indexed: 12/19/2022]
Abstract
The Northwest Mental Health Technology Transfer Center (MHTTC) provides workforce training and technical assistance (TA) to support evidence-based school mental health practices. Historically, this support targeted school professionals through in-person and online trainings, workshops, and coaching. However, in response to COVID-19 restrictions, all support moved to online formats, and the Center introduced trainings for families and caregivers. The purpose of this article is to present preliminary process and outcome data that compare the reach and impact of support before and following COVID-19-related restrictions. Results suggest that transition to online support resulted in a wider reach and a more diverse audience, with no decrease in trainee satisfaction and perceived impact. Furthermore, families and caregivers reported positive gains in knowledge and behaviors following participation in a virtual youth suicide prevention training. Together, these findings suggest that online training and TA can provide tangible benefits to professionals and family members who support student mental health.
Collapse
Affiliation(s)
- Jonathan R. Olson
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA USA
| | - Megan Lucy
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA USA
| | - Marianne A. Kellogg
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA USA
| | - Kelcey Schmitz
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA USA
| | - Taylor Berntson
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA USA
| | - Jennifer Stuber
- Forefront Suicide Prevention, University of Washington School of Social Work, Seattle, WA USA
| | - Eric J. Bruns
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA USA
| |
Collapse
|
15
|
Wigham S, Watts P, Zubala A, Jandial S, Bourne J, Hackett S. Using Arts-Based Therapies to Improve Mental Health for Children and Young People With Physical Health Long-Term Conditions: A Systematic Review of Effectiveness. Front Psychol 2020; 11:1771. [PMID: 33101097 PMCID: PMC7545424 DOI: 10.3389/fpsyg.2020.01771] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2020] [Accepted: 06/26/2020] [Indexed: 01/01/2023] Open
Abstract
Background: Children with physical health long-term conditions (LTCs) have increased risk of mental health difficulties relative to healthy peers. However, availability of psychological support integrated into pediatric physical health settings is limited, and there are long waiting times for access to child mental health services. Arts-based therapies involve using creative media to develop a therapeutic relationship, and offer a potential alternative to talking-based therapies. The aim of this systematic review is to establish the effectiveness of arts-based therapies for improving the mental health of children with physical health LTCs. Methods: The review protocol was published on PROSPERO. Four electronic databases were searched (Medline, Embase, Cinahl, and PsycINFO), plus hand searches of two key journals and relevant reviews, and forward/back citations searches of selected articles were conducted. The Effective Public Health Practice Project (EPHPP) Quality Assessment Tool was used to assess bias in selected articles. Second reviewers completed 10% of article screening and 20% of bias assessments. The findings were synthesized narratively. Results: Sixteen studies met inclusion criteria and demonstrated some improvements on indicators of mental health and well-being including quality of life, coping behaviors, anxiety, self-concept, and mood. However, replication across interventions and outcomes was absent. Overall, the quality of evidence of effectiveness in the studies reviewed was moderate/weak. This was due to bias in study design; other limitations included a lack of detail on intervention components, e.g., use of a manual, and single recruitment sites. Conclusions: The heterogeneity of existing research evaluating arts-based therapies for children with physical health LTCs limits conclusions about effectiveness. Suggestions are made to inform the design of future research studies to help build a robust evidence base.
Collapse
Affiliation(s)
- Sarah Wigham
- Faculty of Medical Sciences, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, United Kingdom
| | | | - Ania Zubala
- Institute of Health Research and Innovation, University of the Highlands and Islands, Inverness, United Kingdom
| | - Sharmila Jandial
- Newcastle upon Tyne Hospital NHS Foundation Trust, Newcastle upon Tyne, United Kingdom
| | - Jane Bourne
- Cumbria, Northumberland Tyne and Wear NHS Foundation Trust, Newcastle upon Tyne, United Kingdom
| | - Simon Hackett
- Faculty of Medical Sciences, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, United Kingdom
| |
Collapse
|
16
|
Sheng Q, Zhang X, Cai C, Shi Y. Parents' Experiences of Caring for Their Only Child With Mental Illness in China: A Qualitative Study. J Psychosoc Nurs Ment Health Serv 2020; 59:29-37. [PMID: 33095263 DOI: 10.3928/02793695-20201001-02] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2020] [Accepted: 07/28/2020] [Indexed: 11/20/2022]
Abstract
The current study explored Chinese parents' experiences of caring for their only child with mental illness. Face-to-face interviews with semi-structured questions were conducted to learn about the care experiences of parents whose only child had mental illness. Purposeful sampling was used to recruit parents (n = 14) and thematic analysis was used. Five themes were identified: (1) Having Responsibility to Care for Children, (2) Feeling Guilt and Self-Blame, (3) Experiencing Loneliness and Helplessness, (4) Drained by Caregiving, and (5) Worrying About the Future. Parents who cared for their only child with mental illness experienced considerable emotional and physical challenges. Professionals and health care providers should recognize and understand the experiences of these parents to identity their needs and provide adequate support. Targeted support services and appropriate professional information should be developed and provided for parents to relieve them of negative caregiving experiences and improve their psychological and physical well-being. [Journal of Psychosocial Nursing and Mental Health Services, 59(1), 29-37.].
Collapse
|
17
|
Santangelo OE, Provenzano S, Giordano D, Alagna E, Armetta F, Gliubizzi C, Terranova A, D'Anna G, Barresi D, Grigis D, Genovese C, Squeri R, Firenze A. Nursing students and depressive symptomatology: an observational study in University of Palermo. Ment Illn 2019; 11:25-31. [PMID: 32742623 PMCID: PMC7364612 DOI: 10.1108/mij-10-2019-0006] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2019] [Revised: 10/22/2019] [Accepted: 10/22/2019] [Indexed: 12/11/2022] Open
Abstract
Purpose Depression is a common and serious medical illness, considered as a public health issue because it interferes with the interpersonal, social and professional functioning of the individual, and its frequency is constantly increasing. According to a recent review, approximately 34 per cent of nursing students had experienced depression worldwide. The university period may represent a moment in which the mental well-being of students is subjected to stress with a relative predisposition to the development of diseases related to mood disorders. The purpose of this study is to estimate the prevalence and examine the socio-demographic correlates of depressive symptomatology. Design/methodology/approach In April 2019, a questionnaire was administered to all the nursing students of University of Palermo of the three years of course, accompanied by informed consent. Multivariable logistic regression was performed. The statistical significance level chosen for all analyses was 0.05. The results were analyzed using the STATA statistical software version 14. Results are expressed as adjusted odds ratio (aOR) with 95 per cent confidence intervals. Findings The sample consists of 493 students who completed the questionnaire, and the average age of the sample participants is 21.88 years. The multivariable logistic regression model shows that the risk to have depressive symptomatology is significantly associated with the following independent variables: female gender (aOR 1.91), being single (aOR 1.87), second year of study (aOR 1.94), third year of study (aOR 1.92), not performing regular physical activity (aOR 1.78) and perceived low health status (aOR 3.08). Originality/value This study shows that belonging to the female gender, being further along in the years of study, having a chronic illness and perceiving a low state of health are all factors that can increase the risk of developing the symptoms of depression; rather, regular physical activity, friendship and romantic relationships can be considered factors protecting them from the risk of falling into depression that can undermine both the study and work performance. Certainly, it is important to analyze all the involved variables to improve the global health not only of the nursing students but of all the students.
Collapse
|