1
|
Rapee RM, Kuhnert R, Spence SH, Bowsher I, Burns J, Coen J, Dixon J, Kotselas P, Lourey C, McLellan LF, Mihalopoulos C, Peters L, Prendergast T, Roos T, Thomas D, Wuthrich V. The Brief Evaluation of Adolescents and Children Online (BEACON): Psychometric development of a mental health screening measure for school students. J Clin Psychol 2024; 80:1420-1447. [PMID: 38425210 DOI: 10.1002/jclp.23673] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2023] [Revised: 01/22/2024] [Accepted: 02/14/2024] [Indexed: 03/02/2024]
Abstract
This paper describes the development and psychometric evaluation of a brief self-report measure (BEACON) to inform universal mental health screening in schools. Items assess symptoms and impairment associated with anxiety and attention/hyperactivity problems (grades 4-11) as well as depression and eating difficulties (grades 6-11), with optional items for suicidality and self-harm (grades 7-11). Initial item examination based on Item Response Theory (IRT) and classical test theory involved 3844 students in grades 4 through 11 (Study 1) and identified 18 items for grades 4-5 and 31 items for grades 6-11 that fulfilled pre-set criteria. Study 2 extended testing with 10,479 students in grades 4-11 and added an additional four items assessing impairment associated with eating difficulties for older students (grades 6-11) creating a total of 35 items for grades 6-11. All items, for both grade-level versions, met the pre-set criteria for IRT and classical test theory analysis supporting their strength in the measurement of the dimensions of concern. The measure showed good reliability (subscale alphas .87 to .95). Validity was also demonstrated against standard symptom measures, school grades, school absenteeism, and help-seeking. The BEACON appears to be a psychometrically sound measure to use in the first stage of school-based screening for mental health problems.
Collapse
Affiliation(s)
- Ronald M Rapee
- Centre for Emotional Health, School of Psychological Science, Macquarie University, Sydney, New South Wales, Australia
| | - Rebecca Kuhnert
- Centre for Emotional Health, School of Psychological Science, Macquarie University, Sydney, New South Wales, Australia
| | - Susan H Spence
- Australian Institute of Suicide Research and Prevention and School of Applied Psychology, Griffith University, Mount Gravatt, Queensland, Australia
| | - Ian Bowsher
- Sydney Secondary College, Glebe, New South Wales, Australia
| | - John Burns
- Centre for Emotional Health, School of Psychological Science, Macquarie University, Sydney, New South Wales, Australia
| | - Jennifer Coen
- Wellbeing and CVE, Catholic Schools NSW, Sydney, New South Wales, Australia
| | - Julie Dixon
- The Mental Health Commission of NSW, Gladesville, New South Wales, Australia
| | - Pauline Kotselas
- Psychology and Wellbeing Services, NSW Department of Education, Sydney, New South Wales, Australia
| | - Catherine Lourey
- The Mental Health Commission of NSW, Gladesville, New South Wales, Australia
| | - Lauren F McLellan
- Centre for Emotional Health, School of Psychological Science, Macquarie University, Sydney, New South Wales, Australia
| | - Cathrine Mihalopoulos
- Monash University Health Economics Group, School of Public Health and Preventive Medicine, Monash University, Melbourne, Victoria, Australia
| | - Lorna Peters
- Centre for Emotional Health, School of Psychological Science, Macquarie University, Sydney, New South Wales, Australia
| | - Traci Prendergast
- Psychology and Wellbeing Services, NSW Department of Education, Sydney, New South Wales, Australia
| | - Tiffany Roos
- The Association of Independent Schools of NSW, Sydney, New South Wales, Australia
| | - Danielle Thomas
- Perinatal, Child and Youth, Mental Health Branch, NSW Ministry of Health, St Leonards, New South Wales, Australia
| | - Viviana Wuthrich
- Centre for Emotional Health, School of Psychological Science, Macquarie University, Sydney, New South Wales, Australia
| |
Collapse
|
2
|
Baffsky R, Ivers R, Cullen P, McGillivray L, Werner-Seidler A, Calear AL, Batterham PJ, Toumbourou JW, Stokes R, Kotselas P, Prendergast T, Torok M. Co-design and Development of Implementation Strategies: Enhancing the PAX Good Behaviour Game in Australian Schools. J Prev (2022) 2023; 44:679-704. [PMID: 37741909 PMCID: PMC10638156 DOI: 10.1007/s10935-023-00749-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 08/29/2023] [Indexed: 09/25/2023]
Abstract
Effective implementation strategies are important for take-up of programs in schools. However, to date, few implementation strategies have been co-designed with teachers and support staff (including principals) in Australia. The aim of this study was to iteratively co-design multiple implementation strategies to enhance the delivery of mental health prevention program, PAX Good Behaviour Game, in New South Wales primary schools. The secondary aim was to evaluate the acceptability of the implementation strategies from the perspective of school staff. Twenty-nine educational staff (including principals) informed the co-design of the implementation strategies across three phases. Phase 1 involved a rapid review of the literature and stakeholder meetings to agree upon potential evidence-based strategies. Phase 2 involved focus group discussions with educational staff to co-design implementation strategies. Phase 3 involved semi-structured interviews with school staff to assess strategy acceptability after implementation at 6-months post-baseline. Data were analysed using deductive, framework analysis. The final co-designed intervention included nine implementation strategies accessible through a toolkit delivered to the school's leadership team. These strategies were deemed acceptable in school settings that experienced periods of both face-to-face and remote learning due to the changing COVID-19 situation in 2021. This paper contributes to the implementation literature by transparently reporting how educational staff-informed implementation strategies were iteratively co-designed. This will provide a roadmap for other researchers to co-design implementation strategies to further support the delivery of evidence-based prevention programs in schools.
Collapse
Affiliation(s)
- Rachel Baffsky
- School of Population Health, University of New South Wales, Sydney, Samuels Building, F25, Samuel Terry Ave, Kensington, NSW, Australia.
| | - Rebecca Ivers
- School of Population Health, University of New South Wales, Sydney, Samuels Building, F25, Samuel Terry Ave, Kensington, NSW, Australia
| | - Patricia Cullen
- School of Population Health, University of New South Wales, Sydney, Samuels Building, F25, Samuel Terry Ave, Kensington, NSW, Australia
| | | | | | - Alison L Calear
- Centre for Mental Health Research, The Australian National University, Acton, ACT, Australia
| | - Philip J Batterham
- Centre for Mental Health Research, The Australian National University, Acton, ACT, Australia
| | - John W Toumbourou
- School of Psychology and Centre for Social and Early Emotional Development (SEED), Deakin University, Geelong, VIC, Australia
| | - Rhoni Stokes
- Department of Education, New South Wales (NSW), Parramatta, NSW, Australia
| | - Pauline Kotselas
- Department of Education, New South Wales (NSW), Parramatta, NSW, Australia
| | - Traci Prendergast
- Department of Education, New South Wales (NSW), Parramatta, NSW, Australia
| | - Michelle Torok
- Black Dog Institute, University of New South Wales, Sydney, Australia
| |
Collapse
|