1
|
Cho M, Park D, Choo M, Kim J, Han DH. Development and Initial Evaluation of a Digital Phenotype Collection System for Adolescents: Proof-of-Concept Study. JMIR Form Res 2024; 8:e59623. [PMID: 39446465 DOI: 10.2196/59623] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2024] [Revised: 07/31/2024] [Accepted: 08/20/2024] [Indexed: 10/26/2024] Open
Abstract
BACKGROUND The growing concern on adolescent mental health calls for proactive early detection and intervention strategies. There is a recognition of the link between digital phenotypes and mental health, drawing attention to their potential use. However, the process of collecting digital phenotype data presents challenges despite its promising prospects. OBJECTIVE This study aims to develop and validate system concepts for collecting adolescent digital phenotypes that effectively manage inherent challenges in the process. METHODS In a formative investigation (N=34), we observed adolescent self-recording behaviors and conducted interviews to develop design goals. These goals were then translated into system concepts, which included planners resembling interfaces, simplified data input with tags, visual reports on behaviors and moods, and supportive ecological momentary assessment (EMA) prompts. A proof-of-concept study was conducted over 2 weeks (n=16), using tools that simulated the concepts to record daily activities and complete EMA surveys. The effectiveness of the system was evaluated through semistructured interviews, supplemented by an analysis of the frequency of records and responses. RESULTS The interview findings revealed overall satisfaction with the system concepts, emphasizing strong support for self-recording. Participants consistently maintained daily records throughout the study period, with no missing data. They particularly valued the recording procedures that aligned well with their self-recording goal of time management, facilitated by the interface design and simplified recording procedures. Visualizations during recording and subsequent report viewing further enhanced engagement by identifying missing data and encouraging deeper self-reflection. The average EMA compliance reached 72%, attributed to a design that faithfully reflected adolescents' lives, with surveys scheduled at convenient times and supportive messages tailored to their daily routines. The high compliance rates observed and positive feedback from participants underscore the potential of our approach in addressing the challenges of collecting digital phenotypes among adolescents. CONCLUSIONS Integrating observations of adolescents' recording behavior into the design process proved to be beneficial for developing an effective and highly compliant digital phenotype collection system.
Collapse
Affiliation(s)
- Minseo Cho
- Human Computer Interaction Lab, Department of Cognitive Science, Yonsei University, Seoul, Republic of Korea
| | - Doeun Park
- Human Computer Interaction Lab, School of Business, Yonsei University, Seoul, Republic of Korea
| | - Myounglee Choo
- Human Computer Interaction Lab, Department of Cognitive Science, Yonsei University, Seoul, Republic of Korea
- HAII Corp, Seoul, Republic of Korea
| | - Jinwoo Kim
- Human Computer Interaction Lab, School of Business, Yonsei University, Seoul, Republic of Korea
- HAII Corp, Seoul, Republic of Korea
| | - Doug Hyun Han
- College of Medicine, Chung-Ang University, Seoul, Republic of Korea
| |
Collapse
|
2
|
Chen R, Irving M, Christian B, Prabhu N, Kumar H, Sohn W, Spallek H, Marschner S, Chow CK. SmilesUp text message intervention for early childhood dental caries prevention: A protocol for a randomised controlled trial. PLoS One 2024; 19:e0310561. [PMID: 39348422 PMCID: PMC11441676 DOI: 10.1371/journal.pone.0310561] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2024] [Accepted: 09/03/2024] [Indexed: 10/02/2024] Open
Abstract
INTRODUCTION Despite improvements in health outcomes for children, early childhood dental caries (ECC) remains a chronic lifestyle-mediated disease that affects an estimated 600 million children worldwide. Parental influence on oral health-promoting behaviours is pivotal in preventing ECC. The latest WHO publications Ending Early Childhood Dental Caries and Mobile Technologies for Oral Health highlights the opportunity for mobile Health programs (including text message programs) to improve oral health behaviours and oral health self-efficacy. In response, our team of parents, oral health professionals (academics and health promotion experts), and IT specialists co-designed a 12-week, behavioural theory-informed text message program (called SmilesUp) to address behavioural risk factors specific to ECC. This randomised trial aims to assess whether the SmilesUp program improves parents' oral health promoting behaviours (like tooth brushing twice a day with toothpaste) and oral health self-efficacy for their children compared to usual care. METHODS AND ANALYSIS A randomised controlled trial with a 1:1 parallel design will be conducted among 150 parents with children diagnosed with ECC and accessing public dental care in NSW, Australia. Patients will be stratified by hospital site, and modality of care (Dental General Anaesthetic (DGA) or not) and then randomly assigned to either immediately receive the SMILESup text messaging intervention or receive the program at the end of the study period. The primary outcome at 12 weeks is twice daily brushing with fluoride toothpaste. Secondary outcomes include changes in the intake frequency of sugared drinks and foods, oral health promoting bedtime routines and oral health self-efficacy. The primary analysis will follow an intention-to-treat principle. In addition, a process evaluation will examine barriers, enablers, and opportunities to scale the program. ETHICS AND DISSEMINATION Ethics approval has been obtained from the Western Sydney Local Health District Human Research Ethics Committee 2022/ETH01920. Study results will be disseminated via peer-reviewed publications and presentations at conferences. TRIAL REGISTRATION Trial registration number: This clinical trial has been prospectively registered on the ANZCTR from the 27th of March 2023. Registration number: ACTRN12623000325606.
Collapse
Affiliation(s)
- Rebecca Chen
- The University of Sydney, Westmead Applied Research Centre, Westmead, NSW, Australia
- The University of Sydney, School of Dentistry, Camperdown, NSW, Australia
- Oral Health Services, Western Sydney Local Health District, Westmead, NSW, Australia
| | - Michelle Irving
- The University of Sydney, Westmead Applied Research Centre, Westmead, NSW, Australia
| | - Bradley Christian
- The University of Sydney, School of Dentistry, Camperdown, NSW, Australia
| | - Neeta Prabhu
- The University of Sydney, School of Dentistry, Camperdown, NSW, Australia
- Oral Health Services, Western Sydney Local Health District, Westmead, NSW, Australia
| | - Harleen Kumar
- The University of Sydney, School of Dentistry, Camperdown, NSW, Australia
- Sydney Dental Hospital and Oral Health Services, Sydney Local Health District, Sydney, NSW, Australia
| | - Woosung Sohn
- The University of Sydney, School of Dentistry, Camperdown, NSW, Australia
| | - Heiko Spallek
- The University of Sydney, School of Dentistry, Camperdown, NSW, Australia
| | - Simone Marschner
- The University of Sydney, Westmead Applied Research Centre, Westmead, NSW, Australia
| | - Clara K. Chow
- The University of Sydney, Westmead Applied Research Centre, Westmead, NSW, Australia
| |
Collapse
|
3
|
Mautner D, Valanju R, Al Hadaya I, Barani M, Cross A, McMahon E, Ren B, Rose D, Sharda A, Sinnett A, Yan F, Wardak S. Experiences from youth advisors in chronic disease prevention research. RESEARCH INVOLVEMENT AND ENGAGEMENT 2024; 10:56. [PMID: 38849959 PMCID: PMC11157720 DOI: 10.1186/s40900-024-00585-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/08/2024] [Accepted: 05/15/2024] [Indexed: 06/09/2024]
Abstract
Engaging young people in research is a promising approach to tackling issues like chronic disease prevention. Our involvement as youth advisors provided valuable experiences, including being at the forefront of change and learning to work within a research team. Furthermore, our experience provides greater insight and learnings for future youth engagement in research.
Collapse
Affiliation(s)
- Dominik Mautner
- The Health Advisory Panel for Youth at The University of Sydney (HAPYUS), Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
| | - Radhika Valanju
- The Health Advisory Panel for Youth at The University of Sydney (HAPYUS), Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
| | - Imeelya Al Hadaya
- The Health Advisory Panel for Youth at The University of Sydney (HAPYUS), Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
| | - Meera Barani
- The Health Advisory Panel for Youth at The University of Sydney (HAPYUS), Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
| | - Alexi Cross
- The Health Advisory Panel for Youth at The University of Sydney (HAPYUS), Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
| | - Emily McMahon
- The Health Advisory Panel for Youth at The University of Sydney (HAPYUS), Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
| | - Bowen Ren
- The Health Advisory Panel for Youth at The University of Sydney (HAPYUS), Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
| | - Dominique Rose
- The Health Advisory Panel for Youth at The University of Sydney (HAPYUS), Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
| | - Aviral Sharda
- The Health Advisory Panel for Youth at The University of Sydney (HAPYUS), Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
| | - Alexander Sinnett
- The Health Advisory Panel for Youth at The University of Sydney (HAPYUS), Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
| | - Fulin Yan
- The Health Advisory Panel for Youth at The University of Sydney (HAPYUS), Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
| | - Sara Wardak
- Susan Wakil School of Nursing and Midwifery, Faculty of Medicine and Health, The University of Sydney, Level 6, Susan Wakil Building, Sydney, NSW, 2006, Australia.
| |
Collapse
|
4
|
Partridge SR, Mandoh M, Todd A, Raeside R. Engaging adolescents in chronic disease prevention research: insights from researchers about establishing and facilitating a youth advisory group. RESEARCH INVOLVEMENT AND ENGAGEMENT 2024; 10:29. [PMID: 38409196 PMCID: PMC10895760 DOI: 10.1186/s40900-024-00559-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/08/2024] [Accepted: 02/22/2024] [Indexed: 02/28/2024]
Abstract
Our comment discusses our experience establishing a youth advisory group focused on chronic disease prevention research. The comment highlights three key learnings: the need for researchers to adapt their working style, the importance of redefining the power dynamics, and disrupting traditional research structures to align with co-researcher engagement models.
Collapse
Affiliation(s)
- Stephanie R Partridge
- Susan Wakil School of Nursing and Midwifery, Faculty of Medicine and Health, The University of Sydney, Level 8, Susan Wakil Building, Sydney, NSW, 2006, Australia.
- Charles Perkins Centre, The University of Sydney, Sydney, Australia.
| | - Mariam Mandoh
- Susan Wakil School of Nursing and Midwifery, Faculty of Medicine and Health, The University of Sydney, Level 8, Susan Wakil Building, Sydney, NSW, 2006, Australia
| | - Allyson Todd
- Susan Wakil School of Nursing and Midwifery, Faculty of Medicine and Health, The University of Sydney, Level 8, Susan Wakil Building, Sydney, NSW, 2006, Australia
| | - Rebecca Raeside
- Susan Wakil School of Nursing and Midwifery, Faculty of Medicine and Health, The University of Sydney, Level 8, Susan Wakil Building, Sydney, NSW, 2006, Australia
- Charles Perkins Centre, The University of Sydney, Sydney, Australia
| |
Collapse
|
5
|
Raeside R, Spielman K, Maguire S, Mihrshahi S, Steinbeck K, Kang M, Laranjo L, Hyun K, Redfern J, Partridge SR. Correction: A healthy lifestyle text message intervention for adolescents: protocol for the Health4Me randomized controlled trial. BMC Public Health 2024; 24:524. [PMID: 38378539 PMCID: PMC10877784 DOI: 10.1186/s12889-024-17698-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/22/2024] Open
Affiliation(s)
- Rebecca Raeside
- Engagement and Co-Design Research Hub, School of Health Sciences, Faculty of Medicine and Health, University of Sydney, Sydney, NSW, Australia.
| | - Karen Spielman
- Faculty of Medicine and Health, InsideOut Institute, University of Sydney, Sydney, NSW, Australia
| | - Sarah Maguire
- Faculty of Medicine and Health, InsideOut Institute, University of Sydney, Sydney, NSW, Australia
- Sydney Local Health District, Sydney, NSW, Australia
| | - Seema Mihrshahi
- Department of Health Sciences, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, NSW, Australia
| | - Katharine Steinbeck
- Department of Adolescent Medicine, The Children's Hospital at Westmead, Sydney, NSW, Australia
- Specialty of Child and Adolescent Health, Westmead Clinical School, Faculty of Medicine and Health, University of Sydney, Sydney, NSW, Australia
| | - Melissa Kang
- General Practice Clinical School, Sydney Medical School, Faculty of Medicine and Health, University of Sydney, Sydney, NSW, Australia
| | - Liliana Laranjo
- Westmead Applied Research Centre, Faculty of Medicine and Health, University of Sydney, Sydney, NSW, Australia
- Western Sydney Primary Health Network, Sydney, NSW, Australia
| | - Karice Hyun
- Engagement and Co-Design Research Hub, School of Health Sciences, Faculty of Medicine and Health, University of Sydney, Sydney, NSW, Australia
- Department of Cardiology, Concord Repatriation General Hospital, ANZAC Research Institute, Sydney, NSW, Australia
| | - Julie Redfern
- Engagement and Co-Design Research Hub, School of Health Sciences, Faculty of Medicine and Health, University of Sydney, Sydney, NSW, Australia
- The George Institute for Global Health, University of New South Wales, Sydney, NSW, Australia
| | - Stephanie R Partridge
- Engagement and Co-Design Research Hub, School of Health Sciences, Faculty of Medicine and Health, University of Sydney, Sydney, NSW, Australia
- Prevention Research Collaboration, Faculty of Medicine and Health, University of Sydney, Sydney, NSW, Australia
| |
Collapse
|
6
|
Obuobi-Donkor G, Shalaby R, Agyapong B, Dias RDL, Agyapong VIO. Mitigating Psychological Problems Associated with the 2023 Wildfires in Alberta and Nova Scotia: Six-Week Outcomes from the Text4Hope Program. J Clin Med 2024; 13:865. [PMID: 38337558 PMCID: PMC10856019 DOI: 10.3390/jcm13030865] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2023] [Revised: 01/21/2024] [Accepted: 01/30/2024] [Indexed: 02/12/2024] Open
Abstract
Background: In 2023, wildfires led to widespread destruction of property and displacement of residents in Alberta and Nova Scotia, Canada. Previous research suggests that wildfires increase the psychological burden of impacted communities, necessitating population-level interventions. Cognitive Behavioural Therapy (CBT)-based text message interventions, Text4HopeAB and Text4HopeNS, were launched in Alberta and Nova Scotia, respectively, during the 2023 wildfire season to support the mental health of impacted individuals. Objectives: The study examines the effectiveness of Text4HopeNS and Text4HopeAB in alleviating psychological symptoms and improving wellbeing among subscribers. Methods: The study involved longitudinal and naturalistic controlled trial designs. The longitudinal study comprised subscribers who completed program surveys at baseline and six weeks post-enrolment, while the naturalistic controlled study compared psychological symptoms in subscribers who had received daily supportive text messages for six weeks (intervention group) and new subscribers who had enrolled in the program during the same period but had not yet received any text messages (control group). The severity of low resilience, poor mental wellbeing, likely Major Depressive Disorder (MDD), likely Generalized Anxiety Disorder (GAD), likely Post-Traumatic Stress Disorder (PTSD), and suicidal ideation were measured on the Brief Resilience Scale (BRS), the World Health Organization-5 Wellbeing Index (WHO-5), Patient Health Questionnaire 9 (PHQ-9), Generalized Anxiety Disorder 7 (GAD-7) scale, PTSD Checklist-Civilian Version (PCL-C), and the ninth question on the PHQ-9, respectively. The paired and independent sample t-tests were employed in data analysis. Results: The results from the longitudinal study indicated a significant reduction in the mean scores on the PHQ-9 (-12.3%), GAD-7 (-14.8%), and the PCL-C (-5.8%), and an increase in the mean score on the WHO-5, but not on the BRS, from baseline to six weeks. In the naturalistic controlled study, the intervention group had a significantly lower mean score on the PHQ-9 (-30.1%), GAD-7 (-29.4%), PCL-C (-17.5%), and the ninth question on the PHQ-9 (-60.0%) which measures the intensity of suicidal ideation, and an increase in the mean score on the WHO-5 (+24.7%), but not on the BRS, from baseline to six weeks compared to the control group. Conclusions: The results of this study suggests that the Text4Hope program is an effective intervention for mitigating psychological symptoms in subscribers during wildfires. This CBT-based text messaging program can be adapted to provide effective support for individuals' mental health, especially in the context of traumatic events and adverse experiences such as those induced by climate change. Policymakers and mental health professionals should consider these findings when shaping strategies for future disaster response efforts, emphasizing the value of scalable and culturally sensitive mental health interventions.
Collapse
Affiliation(s)
- Gloria Obuobi-Donkor
- Department of Psychiatry, Faculty of Medicine, Dalhousie University, Halifax, NS B3H 4R2, Canada; (G.O.-D.); (R.d.L.D.)
| | - Reham Shalaby
- Department of Psychiatry, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB T6G 2B7, Canada; (R.S.); (B.A.)
| | - Belinda Agyapong
- Department of Psychiatry, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB T6G 2B7, Canada; (R.S.); (B.A.)
| | - Raquel da Luz Dias
- Department of Psychiatry, Faculty of Medicine, Dalhousie University, Halifax, NS B3H 4R2, Canada; (G.O.-D.); (R.d.L.D.)
| | - Vincent Israel Opoku Agyapong
- Department of Psychiatry, Faculty of Medicine, Dalhousie University, Halifax, NS B3H 4R2, Canada; (G.O.-D.); (R.d.L.D.)
- Department of Psychiatry, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB T6G 2B7, Canada; (R.S.); (B.A.)
| |
Collapse
|
7
|
Raeside R, Todd A, Wardak S, Gardner L, Champion KE, Kang M, Mihrshahi S, Steinbeck K, Redfern J, Partridge SR. Striking the right balance: co-designing the Health4Me healthy lifestyle digital health intervention with adolescents. RESEARCH INVOLVEMENT AND ENGAGEMENT 2023; 9:114. [PMID: 38062532 PMCID: PMC10702116 DOI: 10.1186/s40900-023-00524-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Accepted: 11/28/2023] [Indexed: 10/03/2024]
Abstract
BACKGROUND Adolescents are navigating a period of rapid growth and development within an era of digitalization. Mobile phone ownership among adolescents is nearly ubiquitous, and this provides an opportunity to harness text messaging to promote a healthy lifestyle and reduce chronic disease risk factors. Inclusion of adolescents throughout the design process has been recognized as essential for engagement and future implementation of such interventions. This study aimed to co-design a bank of text messages to promote a healthy lifestyle which are useful, acceptable, and engaging for adolescents aged 12-18 years old. METHODS Iterative, mixed-methods design with consumer partnership. Co-design occurred over three stages: text message development, text message review and final refinement and testing. The text message development included literature searches and consumer partnership with an established youth advisory group (n = 16). Participants who gave e-consent participated in text message review. Demographic characteristics were collected, and quantitative surveys were distributed to adolescents (n = up to 50) and health professionals (n = up to 30), who rated text message content for understanding, usefulness and appropriateness (total score out of 15). Final refinement was completed by the research team to edit or remove messages which had low scores and to assess readability and interactivity of the text messages. RESULTS The Heath Advisory Panel for Youth at the University of Sydney (HAPYUS) identified the top six lifestyle health issues for young people today in relation to chronic disease prevention, which became the key content areas for the text message bank and drafted new text messages. Following text message development, 218 messages were available for review. Adolescents (n = 18, mean age 16.3 [SD 1.4]) and healthcare professionals (n = 16) reviewed the text messages. On average, all reviewers found that the text messages were easy to understand (mean = 13.4/15) and useful (mean = 12.7/15). Based on scoring and open ended-feedback, 91 text messages were edited and 42 deleted. The final text message bank included 131 text messages. The overall program is suitable for a seventh-grade reading level, and interactive. CONCLUSIONS This study describes the process of effectively engaging adolescents to co-design a text message bank intervention, which are useful, acceptable and engaging for an adolescent audience. The effectiveness of the co-designed text message bank is currently being tested in the Health4Me RCT.
Collapse
Affiliation(s)
- Rebecca Raeside
- Engagement and Co-design Research Hub, School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, Australia.
| | - Allyson Todd
- Engagement and Co-design Research Hub, School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, Australia
| | - Sara Wardak
- Engagement and Co-design Research Hub, School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, Australia
| | - Lauren Gardner
- The Matilda Centre for Research in Mental Health and Substance Use, University of Sydney, Sydney, NSW, Australia
| | - Katrina E Champion
- The Matilda Centre for Research in Mental Health and Substance Use, University of Sydney, Sydney, NSW, Australia
| | - Melissa Kang
- General Practice Clinical School, Sydney Medical School, Faculty of Medicine and Health, University of Sydney, Sydney, NSW, Australia
| | - Seema Mihrshahi
- Department of Health Sciences, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, NSW, Australia
| | - Katharine Steinbeck
- Specialty of Child and Adolescent Health, Westmead Clinical School, Faculty of Medicine and Health, University of Sydney, Westmead, NSW, Australia
| | - Julie Redfern
- Engagement and Co-design Research Hub, School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, Australia
- The George Institute for Global Health, University of New South Wales, Kensington, NSW, Australia
| | - Stephanie R Partridge
- Engagement and Co-design Research Hub, School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, Australia
- Charles Perkins Centre, University of Sydney, Sydney, NSW, Australia
| |
Collapse
|
8
|
Mandoh M, Raeside R, Todd A, Redfern J, Mihrshahi S, Cheng HL, Phongsavan P, Partridge SR. Evaluating the effect of a 12-month youth advisory group on adolescent's leadership skills and perceptions related to chronic disease prevention research: a mixed-methods study. BMC Public Health 2023; 23:2344. [PMID: 38012583 PMCID: PMC10680352 DOI: 10.1186/s12889-023-17283-2] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2023] [Accepted: 11/21/2023] [Indexed: 11/29/2023] Open
Abstract
BACKGROUND Youth Advisory Groups (YAGs) represent a promising method to engage adolescents in research of relevance to them and their peers. However, YAGs are rarely implemented or evaluated in chronic disease prevention research. The aims of this study were firstly, to evaluate the effect of participation in a 12-month YAG on adolescents' leadership skills and perceptions related to chronic disease prevention research and secondly, to evaluate the process of establishing and facilitating a 12-month YAG and identify barriers and enablers to establishment and facilitation. METHODS This study was a 12-month pre-post study. Eligible participants were adolescents (13-18-years) and current members of an established YAG. Data collection involved online surveys and semi-structured interviews at baseline, six-months and 12-months follow-up. Participatory outcomes such as self-efficacy, leadership skills, and collective participation were derived from Youth Participatory Action Research Principles (YPAR), and the Lansdown-UNICEF conceptual framework for measuring outcomes of adolescent participation. Process evaluation data were captured via meeting minutes, Slack metrics and researcher logs. Quantitative data was analysed using descriptive statistics and qualitative data was thematically analysed using a reflexive thematic analysis approach. RESULTS Thirteen (13/16) YAG youth advisors consented to participate in the evaluation study (mean age 16.0 years, SD 1.3; 62% (8/13) identified as female). Survey data assessing participatory outcomes found an increase in leadership and life skills scores over 12-months (+ 8.90 points). Semi-structured interview data collected over the 12-month term revealed three key themes namely: influence, empowerment, and contribution. Comparison of pre-post themes determined a positive trend at follow-ups, demonstrating improved participatory outcomes. Process indicators revealed that at 12-month follow-up the YAG was implemented as planned. Semi-structured interview data determined barriers to YAG facilitation included time and limited face-to-face components, while enablers to YAG facilitation included flexibility, accessible delivery methods, and a supportive adult facilitator. CONCLUSION This study found that a YAG fostered positive participatory outcomes and unique opportunities for youth participants. A successful YAG based on YPAR principles requires researchers to ensure YAG establishment and facilitation is an iterative process. Taking into consideration important barriers and enablers to YAG facilitation ensures adolescent engagement in a YAG is both meaningful and impactful.
Collapse
Affiliation(s)
- Mariam Mandoh
- School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Camperdown, NSW, 2006, Australia
| | - Rebecca Raeside
- School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Camperdown, NSW, 2006, Australia
| | - Allyson Todd
- School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Camperdown, NSW, 2006, Australia
| | - Julie Redfern
- School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Camperdown, NSW, 2006, Australia
- The George Institute for Global Health, The University of New South Wales, Camperdown, NSW, 2006, Australia
- Charles Perkins Centre, The University of Sydney, Sydney, NSW, 2006, Australia
| | - Seema Mihrshahi
- Department of Health Sciences, Faculty of Medicine Health and Human Sciences, Macquarie University, Sydney, NSW, 2109, Australia
| | - Hoi Lun Cheng
- Sydney Medical School, Faculty of Medicine and Health, Specialty of Child and Adolescent Health, The University of Sydney, Westmead, NSW, 2145, Australia
- Academic Department of Adolescent Medicine, The Children's Hospital at Westmead, Westmead, NSW, 2145, Australia
| | - Philayrath Phongsavan
- Charles Perkins Centre, The University of Sydney, Sydney, NSW, 2006, Australia
- Prevention Research Collaboration, Sydney School of Public Health, Faculty of Medicine and Health, The University of Sydney, Camperdown, NSW, 2006, Australia
| | - Stephanie R Partridge
- School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Camperdown, NSW, 2006, Australia.
- Charles Perkins Centre, The University of Sydney, Sydney, NSW, 2006, Australia.
| |
Collapse
|
9
|
Singleton AC, Raeside R, Hyun KK, Hayes M, Sherman KA, Elder E, Redfern J, Partridge SR. A National Health and Wellness SMS Text Message Program for Breast Cancer Survivors During COVID-19 (EMPOWER-SMS COVID-19): Mixed Methods Evaluation Using the RE-AIM Framework. J Med Internet Res 2023; 25:e45164. [PMID: 37490319 PMCID: PMC10410388 DOI: 10.2196/45164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2022] [Revised: 05/05/2023] [Accepted: 05/23/2023] [Indexed: 07/26/2023] Open
Abstract
BACKGROUND COVID-19 lockdowns caused widespread closures of supportive care services for breast cancer survivors in Australia. In a randomized controlled trial, our team's lifestyle-focused, evidence-based SMS text message support program (EMPOWER-SMS COVID-19) was found to be acceptable and useful for breast cancer survivors, and it was ready for rapid widespread delivery. OBJECTIVE This study aims to evaluate the reach (uptake) of an adapted 3-month lifestyle-focused SMS text message program (EMPOWER-SMS COVID-19) and barriers and enablers to implementation using the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. METHODS A mixed methods pre-post study was conducted to evaluate the EMPOWER-SMS COVID-19 program. The study evaluated the following aspects: (1) reach/representativeness, which refers to the proportion of participant enrollment (ie, number enrolled/number that visited the study website) and demographics (eg, age, sex, ethnicity, time since completing treatment, Index of Relative Socio-economic Advantage and Disadvantage [IRSAD; quintile 1, which refers to most disadvantaged areas, to quintile 5, which refers to least disadvantaged areas, and remoteness); (2) effectiveness, in which participant engagement and acceptability were evaluated using SMS text message reply data and a feedback survey (5-point Likert scale and free-text responses); (3) adoption, which corresponds to the proportion of organizations or health professionals who agreed to promote the program; (4) implementation fidelity and maintenance, which evaluated SMS text message delivery data, opt-outs, costs, and adaptations. Quantitative data were summarized using means and SDs or frequencies and percentages, while qualitative data were analyzed thematically. RESULTS With regard to the reach/representativeness of the program, 841/1340 (62.8%) participants enrolled and provided electronic consent. Participants had a mean age of 58.8 (SD 9.8; range 30-87) years. According to the data collected, most participants identified as female (837/840, 99.6%) and White (736/840, 87.6%) and nearly half (418/841, 49.7%) finished treatment ≤18 months ago. Most resided in major cities (574/838, 68.5%) and 30% (251/838) in IRSAD quintile 1 or 2. In terms of effectiveness, 852 replies were received from 511 unique participants (median 1; range 1-26). The most common replies were participants stating how they heard about the program (467/852, 54.8%) or "thank you" (131/852, 15.4%). None of the replies contained urgent safety concerns. Among participants who provided feedback (449/841, 53.4%), most "(strongly) agreed" the SMS text messages were easy to understand (445/448, 99.3%), useful (373/440, 84.8%), helped participants feel supported (388/448, 86.6%), and motivated participants to be physically active (312/445, 70.1%) and eat healthier (313/457, 68.5%). Free-text responses revealed 5 factors influencing engagement: (1) feeling supported and less alone, (2) motivation and reassurance for health self-management, (3) the variety of information, (4) weblinks to information and resources, and (5) the option to save the SMS text messages. Concerning adoption, 50% (18/36) of organizations/health professionals agreed to promote the program. With regard to implementation/maintenance, SMS text messages were delivered as planned (97.43% [41,257/42,344] of SMS text messages were successfully delivered) with minimal opt-outs (62/838, 7.4%) and low cost (Aus $15.40/participant; Aus $1=US $0.67). No adaptations were made during the intervention period. Postintervention adaptations included adding weblinks and participant-selected customizations. CONCLUSIONS EMPOWER-SMS COVID-19 was implemented quickly, had a broad reach, and had high engagement and acceptability among socioeconomically diverse participants. The program had high fidelity, low cost, and required minimal staff oversight, which may facilitate future implementation. However, further research is needed to evaluate barriers and enablers to adoption and implementation for health professionals and strategies for long-term maintenance.
Collapse
Affiliation(s)
- Anna C Singleton
- Engagement and Co-Design Research Hub, School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
| | - Rebecca Raeside
- Engagement and Co-Design Research Hub, School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
| | - Karice K Hyun
- Engagement and Co-Design Research Hub, School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
- Department of Cardiology, Concord Repatriation General Hospital, Sydney, Australia
| | - Molly Hayes
- Engagement and Co-Design Research Hub, School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
| | - Kerry A Sherman
- Centre for Emotional Health, School of Psychological Sciences, Macquarie University, Sydney, Australia
| | - Elisabeth Elder
- Westmead Breast Cancer Institute, Westmead Hospital, Sydney, Australia
| | - Julie Redfern
- Engagement and Co-Design Research Hub, School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
- The George Institute for Global Health, University of New South Wales, Sydney, Australia
- Research Education Network, Western Sydney Local Health District, Sydney, Australia
| | - Stephanie R Partridge
- Engagement and Co-Design Research Hub, School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
| |
Collapse
|
10
|
Han R, Todd A, Wardak S, Partridge SR, Raeside R. Feasibility and Acceptability of Chatbots for Nutrition and Physical Activity Health Promotion Among Adolescents: Systematic Scoping Review With Adolescent Consultation. JMIR Hum Factors 2023; 10:e43227. [PMID: 37145858 PMCID: PMC10199392 DOI: 10.2196/43227] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2022] [Revised: 03/15/2023] [Accepted: 04/13/2023] [Indexed: 05/06/2023] Open
Abstract
BACKGROUND Reducing lifestyle risk behaviors among adolescents depends on access to age-appropriate health promotion information. Chatbots-computer programs designed to simulate conversations with human users-have the potential to deliver health information to adolescents to improve their lifestyle behaviors and support behavior change, but research on the feasibility and acceptability of chatbots in the adolescent population is unknown. OBJECTIVE This systematic scoping review aims to evaluate the feasibility and acceptability of chatbots in nutrition and physical activity interventions among adolescents. A secondary aim is to consult adolescents to identify features of chatbots that are acceptable and feasible. METHODS We searched 6 electronic databases from March to April 2022 (MEDLINE, Embase, Joanna Briggs Institute, the Cumulative Index to Nursing and Allied Health, the Association for Computing Machinery library, and the IT database Institute of Electrical and Electronics Engineers). Peer-reviewed studies were included that were conducted in the adolescent population (10-19 years old) without any chronic disease, except obesity or type 2 diabetes, and assessed chatbots used nutrition or physical activity interventions or both that encouraged individuals to meet dietary or physical activity guidelines and support positive behavior change. Studies were screened by 2 independent reviewers, with any queries resolved by a third reviewer. Data were extracted into tables and collated in a narrative summary. Gray literature searches were also undertaken. Results of the scoping review were presented to a diverse youth advisory group (N=16, 13-18 years old) to gain insights into this topic beyond what is published in the literature. RESULTS The search identified 5558 papers, with 5 (0.1%) studies describing 5 chatbots meeting the inclusion criteria. The 5 chatbots were supported by mobile apps using a combination of the following features: personalized feedback, conversational agents, gamification, and monitoring of behavior change. Of the 5 studies, 2 (40.0%) studies focused on nutrition, 2 (40.0%) studies focused on physical activity, and 1 (20.0%) focused on both nutrition and physical activity. Feasibility and acceptability varied across the 5 studies, with usage rates above 50% in 3 (60.0%) studies. In addition, 3 (60.0%) studies reported health-related outcomes, with only 1 (20.0%) study showing promising effects of the intervention. Adolescents presented novel concerns around the use of chatbots in nutrition and physical activity interventions, including ethical concerns and the use of false or misleading information. CONCLUSIONS Limited research is available on chatbots in adolescent nutrition and physical activity interventions, finding insufficient evidence on the acceptability and feasibility of chatbots in the adolescent population. Similarly, adolescent consultation identified issues in the design features that have not been mentioned in the published literature. Therefore, chatbot codesign with adolescents may help ensure that such technology is feasible and acceptable to an adolescent population.
Collapse
Affiliation(s)
- Rui Han
- Engagement and Co-Design Research Hub, School of Health Sciences, Faculty of Medicine and Health, University of Sydney, Westmead, Australia
| | - Allyson Todd
- Engagement and Co-Design Research Hub, School of Health Sciences, Faculty of Medicine and Health, University of Sydney, Westmead, Australia
| | - Sara Wardak
- Engagement and Co-Design Research Hub, School of Health Sciences, Faculty of Medicine and Health, University of Sydney, Westmead, Australia
| | - Stephanie R Partridge
- Engagement and Co-Design Research Hub, School of Health Sciences, Faculty of Medicine and Health, University of Sydney, Westmead, Australia
| | - Rebecca Raeside
- Engagement and Co-Design Research Hub, School of Health Sciences, Faculty of Medicine and Health, University of Sydney, Westmead, Australia
| |
Collapse
|