Medium-Term Effects of a Tailored Web-Based Parenting Intervention to Reduce Adolescent Risk of Depression and Anxiety: 12-Month Findings From a Randomized Controlled Trial

Like No Other? A Family-Specific Network Approach to Parenting Adolescents

Numerous theories suggest that parents and adolescents influence each other in diverse ways; however, whether these influences differ between subgroups or are unique to each family remains uncertain. Therefore, this study explored whether data-driven subgroups of families emerged that exhibited a similar daily interplay between parenting and adolescent affective well-being. To do so, Subgrouping Group Iterative Multiple Model Estimation (S-GIMME) was used to estimate family-specific dynamic network models, containing same- and next-day associations among five parenting practices (i.e., warmth, autonomy support, psychological control, strictness, monitoring) and adolescent positive and negative affect. These family-specific networks were estimated for 129 adolescents (Mage = 13.3, SDage = 1.2, 64% female, 87% Dutch), who reported each day on parenting and their affect for 100 consecutive days. The findings of S-GIMME did not identify data-driven subgroups sharing similar parenting-affect associations. Instead, each family displayed a unique pattern of temporal associations between the different practices and adolescent affect. Thus, the ways in which parenting practices were related to adolescents' affect in everyday life were family specific.

A Literature Review of Digital Behavioral Parent Training Programs for Parents of Adolescents

Parents of adolescents are faced with a variety of challenges related to their children's behavior and development. Behavioral parent training (BPT) programs may be effective strategies to mitigate adverse childhood experiences (ACEs) and other common behavioral problems in the adolescent period. Adolescence is the period following the onset of puberty and describes the transition from childhood to adulthood. Digital BPTs, including those delivered via the internet, downloaded digital content, text message, tablet, and video call, may present a unique opportunity to reach a broad audience of parents of adolescents by removing barriers to program accessibility (e.g., cost and transportation). We conducted a literature review to synthesize the existing evidence on digital BPTs for parents of adolescents. We described the digital BPTs, study designs, and evaluation and feasibility outcomes. A structured literature search identified studies meeting the following criteria for inclusion: (a) published between January 2000 and October 2022, (b) peer-reviewed, (c) available in English language, (d) study included a description of a digital BPT methodological approach, (e) study had to identify at least one parent or child behavioral outcome (e.g., parent-reported communication with their child) or feasibility outcome associated with the digital BPT, and (f) study included parents of adolescents aged 10-18 years. We extracted data on the characteristics of the study and demographic characteristics of participants, digital BPT, and evaluation and feasibility outcomes. Twenty-eight studies met inclusion criteria. Twenty-two unique digital BPTs were evaluated across the published studies. Thirteen digital BPTs (59.1%) were developed from or grounded by an identified theory. Six digital BPTs were freely accessible by the public, while the remaining 16 were available through study participation or purchase. One digital BPT was specifically tailored to parents of adolescents of a racial/ethnic minority group. Of the 16 studies that reported either parent or adolescent race/ethnicity, 10 consisted of more than 50% White parent or adolescent participants. Twenty-four (88.9%) studies provided evaluation data for the digital BPT. Fourteen studies (63.6%) employed a randomized control trial study design, and the remaining study designs included quasi-experimental (n = 2), mixed methods (n = 1), open trial (n = 3), case study (n = 1), pretest-posttest design (n = 1), and feasibility and acceptability trial (n = 2). All studies reported improvements in at least one parent-reported or adolescent-reported behavioral outcome or feasibility outcomes, with effect sizes (Cohen's d) ranging from small (e.g., 0.20-0.49) to very large (e.g., > 1.20). The findings of this review illustrate that technology may be a valuable way to deliver BPTs to parents of adolescents. However, few digital BPTs were developed for parents of adolescents from racial/ethnic minority groups, and many digital BPTs were not available without cost or participation in a research study. Considerations for future research are discussed.

Modifiable Parent Factors Associated with Child and Adolescent School Refusal: A Systematic Review

School refusal is a complex problem that refers to difficulty attending/remaining at school due to emotional distress about attendance. Despite its occurrence being associated with negative outcomes, many are unresponsive to the current treatment options. While parent factors have a key role to play in school refusal, they are not adequately addressed in existing treatments. Further research is needed to consolidate understanding and implement new treatments. Employing the PRISMA method, this review aims to identify modifiable parent factors associated with child and/or adolescent school refusal. Eight studies met inclusion criteria from which nine factors were identified. Factors found to be associated with school refusal included: parent psychopathology, family functioning and maternal overprotection (communication subdomain). Other factors such as maternal overprotection (affection, assistance and travel subdomains) and parental self-efficacy had weak or inconsistent results warranting further investigation. Overall, findings call for action in this field that has sparse and dated literature.

The efficacy of online parenting interventions in addressing emotional problems in children and adolescents: A meta-analysis of randomized controlled trials

BACKGROUND

Parenting interventions offer opportunities for reducing emotional problems in children and adolescents, based on addressing parental risk and protective factors. Online parenting interventions were developed more recently to increase access to interventions for parents, and the aim of this systematic review and meta-analysis is to investigate their efficacy.

METHODS

We conducted a meta-analysis pooling studies that tested online parenting interventions having as outcome emotional problems in children/adolescents. We considered as secondary outcome parent mental health and moderation effects for the type of population, intervention characteristics, and risk of bias.

RESULTS

Thirty-one studies met the inclusion criteria and were included in the meta-analysis. For child/adolescent emotional problems, at post-intervention, 13 studies were pooled, yielding an ES of g = -0.26 (95% CI [-0.41, -0.11]; p < .001) favoring the online parental interventions over wait-list, while at follow-up five RCTs were pooled, yielding an ES of g = -0.14 (95% CI [-0.25, -0.02]; p = .015) favoring the parental online interventions over wait-list. Moderation analyses suggest that longer online parenting programs are more effective in improving child emotional problems.

CONCLUSIONS

Online parent programs have positive effects on reducing emotional symptoms in children and adolescents. Future research will need to develop and investigate the efficacy of the programs that can personalize their contents and delivery methods.

Mediators of outcome in adolescent psychotherapy and their implications for theories and mechanisms of change: a systematic review

Psychotherapeutic treatment of adolescents requires age-specific approaches and thus plausibly also involves different change mechanisms than adult psychotherapy. To guide further research and improve therapeutic outcomes for adolescents, we reviewed all RCTs investigating mechanisms of change in the psychological treatment of adolescents to identify the most promising age-, disorder- or treatment-specific mediators. Following the preferred reporting items for systematic reviews (PRISMA), 106 studies were included that reported 252 statistical mediation tests assessed with 181 different measures. Most often studied and significant mediators were cognitive, followed by family-related, and behavioral variables. Several mediators were identified to be promising for future investigations: changes in negative thoughts, dysfunctional beliefs and metacognitive skills; family functioning and parenting skills; as well as successful engagement in therapy activities and increased impulse control. Symptom change during therapy was least often a mediator for other therapeutic changes. Relational and emotional mediators were largely understudied, whereas peer-influence appeared a promising mediator for intervention outcomes. Adolescence-specific mediators were most commonly investigated. Majority of studied mediators were not disorder-specific. There was a tendency to mainly test change mechanisms of specific theoretical models without considering other possible change theories. Further, virtually no studies fulfilled all criteria for rigorously investigating mediation and only nine were classified with an overall good study quality. While bearing in mind the current limitations in study designs, methodological rigor and reporting, there appears to be substantial evidence for transdiagnostic age-specific change models in the psychological treatment of adolescents. For future research, need for consensus on a core set of transdiagnostic and transtheoretical mediators and measures is highlighted. These should address likely core mechanisms of change, as well as take into account age-relevant developmental challenges and biological markers.

Applying technology to promote sexual and reproductive health and prevent gender based violence for adolescents in low and middle-income countries: digital health strategies synthesis from an umbrella review

AIM

Adolescents in low-and-middle-income countries (LMICs) are facing numerous developmental, sexual and reproductive health (SRH) challenges including exposure to multidimensional violence. Gender-based violence (GBV) specifically intimate partner violence (IPV) are both highly prevalent in LMICs and are strongly linked with poor SRH outcomes. However, GBV and IPV interventions have not yet been adequately integrated in SRH due to individual, social, cultural, service, and resource barriers. To promote long-term SRH, a more holistic approach that integrates GBV and IPV, and adolescent development needs is imperative. Digital health has the potential to address multiple service setup, provision, and addressing access barriers through designing and providing integrated SRH care. However, there are no guidelines for an integrated digital SRH and development promotion for adolescents in LMICs.

METHODS

An umbrella review was conducted to synthesize evidence in three inter-related areas of digital health intervention literature: (i) SRH, (ii) GBV specifically IPV as a subset, and (iii) adolescent development and health promotion. We first synthesize findings for each area of research, then further analyze the implications and opportunities to inform approaches to develop an integrated intervention that can holistically address multiple SRH needs of adolescents in LMICs. Articles published in English, between 2010 and 2020, and from PubMed were included.

RESULTS

Seventeen review articles met our review inclusion criterion. Our primary finding is that application of digital health strategies for adolescent SRH promotion is highly feasible and acceptable. Although effectiveness evidence is insufficient to make strong recommendations for interventions and best practices suggestions, some user-centered design guidelines have been proposed for web-based health information and health application design for adolescent use. Additionally, several digital health strategies have also been identified that can be used to further develop integrated GBV-IPV-SRH-informed services to improve adolescent health outcomes. We generated several recommendations and strategies to guide future digital based SRH promotion research from our review.

CONCLUSIONS

Rigorous research that focuses on intervention effectiveness testing using a combination of digital health strategies and standardized albeit contextualized outcome measures would be important. Methodological improvement such as adoption of longitudinal experimental design will be crucial in generating evidence-based intervention and practice guidelines for adolescents in LMICs.

Supporting family and friends of young people with mental health issues using online technology: A rapid scoping literature review

AIM

Family and friends are often the first and/or only support options used by young people (12-25 years) struggling with mental health issues. The overarching aim of this literature review is to map current practice in online interventions specifically targeting family and friends of young people with mental health issues, especially relevant in light of the current worldwide COVID-19 pandemic.

METHODS

A rapid scoping literature review was conducted searching health and psychology databases for online interventions targeting family and friends supporting a young person (12-25 years) struggling with a mental health issue. The search strategy was comprehensive and expert librarian endorsed. The final synthesis comprised 13 articles.

RESULTS

Identified articles were few, reporting a disparate range of research aims, intervention content and delivery modes. Studies addressing caregivers of adolescents with a mental health diagnosis were small-scale, although suggested virtual modalities are positively received and viable alternatives to other delivery methods with potential for equivalent outcomes. Five randomized control trials involving caregivers of 'at-risk' adolescents reported improved parental knowledge, but mixed effects on family functioning.

CONCLUSIONS

Preliminary evidence suggests flexible online options including professional and peer support, to respond to carers' busy lives are needed to maximize benefits. Content that is sufficiently individualized and targeted to address the diverse needs of parents, as well as other caregivers, is also required. Well-being and self-care, in addition to parenting skills should be given more consideration in online interventions. Examination of the value of support from peers is also warranted.

An online parenting intervention to prevent affective disorders in high-risk adolescents: the PIPA trial protocol

BACKGROUND

Adolescent depression can place a young person at high risk of recurrence and a range of psychosocial and vocational impairments in adult life, highlighting the importance of early recognition and prevention. Parents/carers are well placed to notice changes in their child's emotional wellbeing which may indicate risk, and there is increasing evidence that modifiable factors exist within the family system that may help reduce the risk of depression and anxiety in an adolescent. A randomised controlled trial (RCT) of the online personalised 'Partners in Parenting' programme developed in Australia, focused on improving parenting skills, knowledge and awareness, showed that it helped reduce depressive symptoms in adolescents who had elevated symptom levels at baseline. We have adapted this programme and will conduct an RCT in a UK setting.

METHODS

In total, 433 family dyads (parents/carers and children aged 11-15) will be recruited through schools, social media and parenting/family groups in the UK. Following completion of screening measures of their adolescent's depressive symptoms, parents/carers of those with elevated scores will be randomised to receive either the online personalised parenting programme or a series of online factsheets about adolescent development and wellbeing. The primary objective will be to test whether the personalised parenting intervention reduces depressive symptoms in adolescents deemed at high risk, using the parent-reported Short Mood & Feelings Questionnaire. Follow-up assessments will be undertaken at 6 and 15 months and a process evaluation will examine context, implementation and impact of the intervention. An economic evaluation will also be incorporated with cost-effectiveness of the parenting intervention expressed in terms of incremental cost per quality-adjusted life year gained.

DISCUSSION

Half of mental health problems emerge before mid-adolescence and approximately three-quarters by mid-20s, highlighting the need for effective preventative strategies. However, few early interventions are family focused and delivered online. We aim to conduct a National Institute for Health and Care Research (NIHR) funded RCT of the online personalised 'Partners in Parenting' programme, proven effective in Australia, targeting adolescents at risk of depression to evaluate its effectiveness, cost-effectiveness and usability in a UK setting. TRIAL REGISTRATION {2A}: ISRCTN63358736 . Registered 18 September 2019.

The Role of Mindfulness in Mitigating the Detrimental Effects of Harsh Parenting among Chinese Adolescents: Testing a Moderated Mediation Model in a Three-Wave Study

Based on the conservation of resources theory, this study aimed to investigate the mediating role of depressive symptoms and the moderating role of mindfulness in the association between harsh parenting and adolescent suicidal ideation in the Chinese cultural context. Using a three-wave (i.e., three months apart) data collection among 371 Chinese adolescents, this study found that depressive symptoms mediated the relationship between harsh parenting and adolescent suicidal ideation. Moreover, adolescent mindfulness mitigated the effects of harsh parenting on suicidal ideation, as well as the indirect effect of harsh parenting on suicidal ideation via depressive symptoms. The theoretical and practical implications are discussed.

Short-term outcomes of the Therapist-assisted Online Parenting Strategies intervention for parents of adolescents treated for anxiety and/or depression: A single-arm double-baseline trial

OBJECTIVE

This study aimed to evaluate whether the Therapist-assisted Online Parenting Strategies programme increased parenting behaviours known to be supportive of adolescents experiencing anxiety and/or depression. Secondary parenting outcomes of parental self-efficacy, parental accommodation, carer burden, parent-adolescent attachment, family functioning and parent distress were also examined, along with adolescent outcomes of anxiety and depression symptoms, suicidal ideation and sleep.

METHOD

Seventy-one parents (94.4% females) and their adolescents (73.2% females) aged 12-18 years (Mean = 15.02, SD = 1.56) being treated for depression and/or anxiety in Australia were recruited into a single-arm double-baseline open-label trial. Parents received Therapist-assisted Online Parenting Strategies, which comprised up to nine web-based modules each supplemented with coaching sessions via videoconferencing. Outcomes were analysed using latent growth curve modelling to determine if changes to outcomes at post-intervention (4 month post-second baseline) exceeded changes between two baselines measured 1 month apart.

RESULTS

Sixty-five parents (91.6%) completed at least one module of the online parenting intervention and on average received nine coaching sessions (SD = 2). Parenting behaviours targeted by Therapist-assisted Online Parenting Strategies improved at post-intervention (Cohen's d = 1.16, 95% confidence interval [0.78, 1.51]). Parent-reported parental self-efficacy and parent-adolescent attachment increased (Cohen's d = 1.44 [1.05, 1.82] and 0.39 [0.05, 0.74], respectively), while impairments to family functioning and parent distress decreased (Cohen's d = -0.51 [-0.86, -0.16] and -0.84 [-1.23, -0.44], respectively). Changes to adolescent anxiety, depression and sleep were not significant.

CONCLUSION

The Therapist-assisted Online Parenting Strategies intervention improved self-reported parenting behaviours, parental self-efficacy, parent levels of distress, parent-adolescent attachment, and family functioning in parents with adolescents being treated for anxiety and/or depression. However, significant changes in adolescent mental health and sleep outcomes at post-intervention were not observed. The usefulness of a therapist-supported online parenting programme in addressing a service gap for parents seeking professional help is indicated.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry Number (ACTRN) 12618000290291, prospectively registered on 26 February 2018; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=368031.

Characteristics of Mobile Health Platforms for Depression and Anxiety: Content Analysis Through a Systematic Review of the Literature and Systematic Search of Two App Stores

Background

Mobile health (mHealth) platforms show promise in the management of mental health conditions such as anxiety and depression. This has resulted in an abundance of mHealth platforms available for research or commercial use.

Objective

The objective of this review is to characterize the current state of mHealth platforms designed for anxiety or depression that are available for research, commercial use, or both.

Methods

A systematic review was conducted using a two-pronged approach: searching relevant literature with prespecified search terms to identify platforms in published research and simultaneously searching 2 major app stores—Google Play Store and Apple App Store—to identify commercially available platforms. Key characteristics of the mHealth platforms were synthesized, such as platform name, targeted condition, targeted group, purpose, technology type, intervention type, commercial availability, and regulatory information.

Results

The literature and app store searches yielded 169 and 179 mHealth platforms, respectively. Most platforms developed for research purposes were designed for depression (116/169, 68.6%), whereas the app store search reported a higher number of platforms developed for anxiety (Android: 58/179, 32.4%; iOS: 27/179, 15.1%). The most common purpose of platforms in both searches was treatment (literature search: 122/169, 72.2%; app store search: 129/179, 72.1%). With regard to the types of intervention, cognitive behavioral therapy and referral to care or counseling emerged as the most popular options offered by the platforms identified in the literature and app store searches, respectively. Most platforms from both searches did not have a specific target age group. In addition, most platforms found in app stores lacked clinical and real-world evidence, and a small number of platforms found in the published research were available commercially.

Conclusions

A considerable number of mHealth platforms designed for anxiety or depression are available for research, commercial use, or both. The characteristics of these mHealth platforms greatly vary. Future efforts should focus on assessing the quality—utility, safety, and effectiveness—of the existing platforms and providing developers, from both commercial and research sectors, a reporting guideline for their platform description and a regulatory framework to facilitate the development, validation, and deployment of effective mHealth platforms.

Text mining of Reddit posts: Using latent Dirichlet allocation to identify common parenting issues

Parenting interventions offer an evidence-based method for the prevention and early intervention of child mental health problems, but to-date their population-level effectiveness has been limited by poor reach and engagement, particularly for fathers, working mothers, and disadvantaged families. Tailoring intervention content to parents' context offers the potential to enhance parent engagement and learning by increasing relevance of content to parents' daily experiences. However, this approach requires a detailed understanding of the common parenting situations and issues that parents face day-to-day, which is currently lacking. We sought to identify the most common parenting situations discussed by parents on parenting-specific forums of the free online discussion forum, Reddit. We aimed to understand perspectives from both mothers and fathers, and thus retrieved publicly available data from r/Daddit and r/Mommit. We used latent Dirichlet allocation to identify the 10 most common topics discussed in the Reddit posts, and completed a manual text analysis to summarize the parenting situations (defined as involving a parent and their child aged 0-18 years, and describing a potential/actual issue). We retrieved 340 (r/Daddit) and 578 (r/Mommit) original posts. A model with 31 latent Dirichlet allocation topics was best fitting, and 24 topics included posts that met our inclusion criteria for manual review. We identified 45 unique but broadly defined parenting situations. The majority of parenting situations were focused on basic childcare situations relating to eating, sleeping, routines, sickness, and toilet training; or related to how to respond to child negative emotions or difficult behavior. Most situations were discussed in relation to infant or toddler aged children, and there was high consistency in the themes raised in r/Daddit and r/Mommit. Our results offer potential to tailor parenting interventions in a meaningful way, creating opportunities to develop content and resources that are directly relevant to parents' lived experiences.

Relationship between Sleep Problems and Self-Injury: A Systematic Review

Objective/Background: Previous studies suggested that sleep problems were related to non-suicidal self-injury. The current systematic review investigated more thoroughly this relationship.Methods: PubMED and Embase databases were searched. The keywords were "self-injury" OR "self-harm" OR "non-suicidal self-injury" OR "self-injurious behavior" OR "self-destructive behavior" OR "self-mutilation" AND "sleep problem" OR "sleep disturbance" OR insomnia OR nightmare OR "poor sleep quality" or "sleep disorders." A total of 16 studies were included in the present review.Results: The pattern of results indicated that sleep problems such as short sleep duration, sleep disturbances, and poor sleep quality were associated with non-suicidal self-injury. Additionally, emotional dysregulation, depression, and post-traumatic stress disorder appeared to mediate this relationship. Above all adolescents and young adults with sleep disruptions were at higher risk of non-suicidal self-injury.Conclusions:g Interventions to improve sleep quality and sleep duration might concomitantly decrease the risk of non-suicidal self-injury.

Engaging Parents of Lower-Socioeconomic Positions in Internet- and Mobile-Based Interventions for Youth Mental Health: A Qualitative Investigation

Growing literature supports the use of internet- and mobile-based interventions (IMIs) targeting parenting behaviours to prevent child and adolescent mental health difficulties. However, parents of lower-socioeconomic positions (SEP) are underserved by these interventions. To avoid contributing to existing mental health inequalities, additional efforts are needed to understand the engagement needs of lower-SEP parents. This study qualitatively explored lower-SEP parents’ perspectives on how program features could facilitate their engagement in IMIs for youth mental health. We conducted semi-structured interviews with 16 lower-SEP parents of children aged 0–18 to identify important program features. Participants were mostly female (81.3%) and aged between 26 and 56 years. Transcriptions were analysed using inductive thematic analysis. Twenty-three modifiable program features important to lower-SEP parents’ engagement in IMIs were identified. These features aligned with one of three overarching themes explaining their importance to parents’ willingness to engage: (1) It will help my child; (2) I feel like I can do it; (3) It can easily fit into my life. The relative importance of program features varied based on parents’ specific social and economic challenges. These findings offer initial directions for program developers in optimising IMIs to overcome barriers to engagement for lower-SEP parents.

Moderators of psychological and psychoeducational interventions for the prevention of anxiety: A systematic review

The aim of this study was to assess the available evidence on potential moderators of psychological and psychoeducational interventions for the prevention of anxiety. A systematic review using PubMed, PsycINFO, Web of Science, Embase, OpenGrey, and CENTRAL was performed up to October 2019. Two independent researchers assessed the fulfillment of eligibility criteria, extracted the data and performed a quality assessment of the included studies. Outcomes were moderators of the reduction of anxious symptoms or the incidence of anxiety disorders. Fourteen studies reporting results on moderator analyses performed in 13 randomized controlled trials were included. Twenty-seven potential moderators were organized into six categories: sociodemographic, clinical characteristics, cognitive variables, life events, interpersonal functioning and intervention characteristics. The most frequently examined variables were gender, age and baseline anxiety. We found insufficient evidence for all moderator categories studied. In children and adolescents, we found some studies with significant results for the low family support variable and higher levels of anxiety symptoms at baseline, which were both associated with higher effectiveness. Limited conclusions can be drawn about for whom and under what conditions interventions work in the prevention of anxiety. A strong need to improve the methodological quality and the number of moderator studies was identified.

The Therapist-assisted Online Parenting Strategies (TOPS) program for parents of adolescents with clinical anxiety or depression: Development and feasibility pilot

OBJECTIVE

To develop a Therapist-assisted Online Parenting Strategies (TOPS) program that is acceptable to parents whose adolescents have anxiety and/or depressive disorders, using a consumer consultation approach.

METHODS

The TOPS intervention was developed via three linked studies. Study 1 involved content analysis of feedback from participants (N = 56) who received a web-based preventive parenting intervention called Partners in Parenting (PiP), as part of a randomised controlled trial. Study 2 involved stakeholder consultations with: (i) parents of adolescents aged 12-17 years (N = 6), and (ii) mental health professionals (N = 28), to identify adaptations to PiP that are required to make it appropriate for parents of adolescents with anxiety and depressive disorders. Study 3 was a pilot of the resulting TOPS program with professionals (N = 10) and a small sample of parents (N = 3) to assess the acceptability of the program content and format that involved online modules and videoconferencing coaching.

RESULTS

Study 1 indicated a need for an enhanced program for parents whose adolescents are experiencing anxiety and depressive disorders, while findings from Study 2 informed the content of the new TOPS program. In Study 3, mental health professionals endorsed the structure and content, while parents affirmed the acceptability of the TOPS program. Feedback from Studies 2 and 3 indicated that the therapist-coach was a valuable resource to (i) provide parents with strategies that are associated with the alleviation of adolescent anxiety and depression, (ii) discuss difficulties in implementing these strategies, (iii) assist parents with overcoming these difficulties; and (iv) support the development of a relapse prevention plan. Professionals felt that the TOPS program would broaden parental knowledge about how to recognise and respond to symptoms of clinical anxiety and depression in their adolescent.

CONCLUSIONS

This study provided preliminary support for the feasibility, acceptability and perceived usefulness of the TOPS program.