Use of evidence-based assessment for childhood anxiety disorders in community practice

The Youth Anxiety Measure for DSM-5 (YAM-5): An Updated Systematic Review of its Psychometric Properties

The Youth Anxiety Measure for DSM-5 (YAM-5) is a self- and parent-report scale specifically developed to assess symptoms of major anxiety disorders (part 1 or YAM-5-I) and specific phobias/agoraphobia (part 2 or YAM-5-II) in children and adolescents in terms of the contemporary psychiatric classification system. Since its introduction, the measure has been increasingly used in research, making it feasible to provide a summary of its psychometric properties. The present article presents a systematic review of 20 studies that employed the YAM-5, involving 5325 young participants. Overall, the results supported the hypothesized factor structure of both parts of the measure, although there were also some studies that could not fully replicate the original five-factor model of YAM-5-I. The internal consistency of the YAM-5 was generally high for the total scores of both parts, while reliability coefficients for the subscales were more variable across studies. Research also obtained evidence for other psychometric properties, such as test-retest reliability, parent-child agreement, convergent/divergent validity, and discriminant validity. Results further revealed that girls tend to show significantly higher anxiety levels on the YAM-5 than boys. Overall, these findings indicate that the YAM-5 is a promising tool for assessing symptoms of anxiety disorders including specific phobias in young people. Some directions for future research with the YAM-5 and recommendations regarding the use of the measure are given.

Validation of the structured interview section of the penn computerized adaptive test for neurocognitive and clinical psychopathology assessment (CAT GOASSESS)

Large-scale studies and burdened clinical settings require precise, efficient measures that assess multiple domains of psychopathology. Computerized adaptive tests (CATs) can reduce administration time without compromising data quality. We examined feasibility and validity of an adaptive psychopathology measure, GOASSESS, in a clinical community-based sample (N = 315; ages 18-35) comprising three groups: healthy controls, psychosis, mood/anxiety disorders. Assessment duration was compared between the Full and CAT GOASSESS. External validity was tested by comparing how the CAT and Full versions related to demographic variables, study group, and socioeconomic status. The relationships between scale scores and criteria were statistically compared within a mixed-model framework to account for dependency between relationships. Convergent validity was assessed by comparing scores of the CAT and the Full GOASSESS using Pearson correlations. The CAT GOASSESS reduced interview duration by more than 90 % across study groups and preserved relationships to external criteria and demographic variables as the Full GOASSESS. All CAT GOASSESS scales could replace those of the Full instrument. Overall, the CAT GOASSESS showed acceptable psychometric properties and demonstrated feasibility by markedly reducing assessment time compared to the Full GOASSESS. The adaptive version could be used in large-scale studies or clinical settings for intake screening.

A Structural Model of Organization and Clinician Factors Associated with Standardized Measure Use in a National Survey of Youth Mental Health Providers

Standardized assessment measures are important for accurate diagnosis of mental health problems and for treatment planning and evaluation. However, little is known about youth mental health providers' typical use of standardized measures across disciplines and outside the context of evidence-based practice initiatives. A multidisciplinary national survey examined the frequency with which 674 youth mental health providers administer standardized and unstandardized measures, and the extent to which organizational (i.e., implementation climate, rigid hierarchical organizational structure) and provider (i.e., attitudes toward standardized assessment measures, highest degree, practice setting) characteristics are associated with standardized measure use. Providers used unstandardized measures far more frequently than standardized measures. Providers' perceptions (a) that standardized measures are practical or feasible, (b) that their organization supports and values evidence-based practices, and (c) that their organization has a rigid hierarchical structure predicted greater use of standardized measures. Working in schools predicted less frequent SMU, while working in higher education and other professional settings predicted more frequent SMU. Standardized measures were not routinely used in this community-based sample. A rigid hierarchical organizational structure may be conducive to more frequent administration of standardized measures, but it is unclear whether such providers actually utilize these measures for clinical decision-making. Alternative strategies to promote standardized measure use may include promoting organizational cultures that value empirical data and encouraging use of standardized measures and training providers to use pragmatic standardized measures for clinical decision making.

Child posttraumatic stress symptoms in an acute injury sample: Patterns of associations among child report, parent report, and child heart rate parameters

Parent-child agreement on measures of child posttraumatic stress disorder (PTSD) is moderate at best, and understanding of this discrepancy is limited. To address this, we conducted an item-level investigation of parent-child symptom agreement to examine the potential influence of parental posttraumatic stress symptoms (PTSS) on parents' reports of their child's PTSS. We also examined heart rate (HR) indices as possible independent indicators of child PTSD, examining patterns of association with parent versus child report. Parent-child dyads (N = 132, child age: 6-13 years, 91.7% White) were recruited after the child's hospital admission following an acute, single-incident traumatic event. At 1-month posttrauma, questionnaires assessing children's PTSS (self- and parental reports) and parental PTSS were administered. For a subset of participants (n = 70), children's HR recordings were obtained during a trauma narrative task and analyzed. Parent and child reports of child PTSS were weakly positively correlated, r = .25. Parental PTSS were found to be stronger positive predictors of parental reports of child PTSS than the children's own symptom reports, β = 0.60 vs. β = 0.14, and were associated with higher parent-reported child PTSS relative to child reports. Finally, children's self-reported PTSS were associated with HR indices, whereas parent reports were not, βs = -.33-.30 vs. βs = -.15-.01. Taken together, children's self-reported PTSS could be a more accurate reflection of their posttrauma physiological distress than parent reports. The potential influence of parental PTSS on their perceptions of their child's symptoms warrants further consideration.

Comparative effectiveness of cognitive behavioral treatment, serotonin, and serotonin noradrenaline reuptake inhibitors for anxiety in children and adolescents: a network meta-analysis

AIM

Cognitive behavioral treatment (CBT) and selective serotonin reuptake inhibitors (SSRIs) are considered first-line treatments for childhood anxiety disorders (ADs). The objective of this current analysis was to conduct a network meta-analysis to evaluate the comparative effectiveness of CBT, pharmacotherapy, and the combination of the two in treating pediatric ADs.

METHODS

The studies included consisted of randomized controlled trials evaluating non-selective serotonin reuptake inhibitors (e.g. clomipramine), SSRIs, selective noradrenaline reuptake inhibitors, CBT, or a combination of CBT and pharmacotherapy. Studies were eligible for inclusion if participants were 18 years or younger.

RESULTS

A total of 86 studies were included, with a total of 7594 participants, of which 41.51% were females. For remission, all three treatments were significantly more effective than both placebo (ORs ranging from 0.07 and 0.18) and wait-list (ORs ranging from 0.06 and 0.16). In terms of the severity of anxiety symptoms, all treatment forms were significantly more effective for reducing anxiety than wait-list (standardized mean differences (SMDs) ranging from 0.98 and 2.91). Only pharmacotherapy was significantly more effective in reducing anxiety symptoms than placebo (SMD = 2.01, 95% confidence interval, 1.02 to 3.01). Overall, the results demonstrate that CBT, pharmacotherapy, and their combination are effective treatments for childhood ADs. There was no significant difference between the three treatment forms. However, CBT was associated with lower attrition rates.

CONCLUSION

CBT, pharmacotherapy, and the combination of the two should all be considered to treat youths with ADs. However, potential risks and benefits should be considered before devising a treatment plan.

The challenge of ensuring affordability, sustainability, consistency, and adaptability in the common metrics agenda

Mental health research grapples with research waste and stunted field progression caused by inconsistent outcome measurement across studies and clinical settings, which means there is no common language for considering findings. Although recognising that no gold standard measures exist and that all existing measures are flawed in one way or another, anxiety and depression research is spearheading a common metrics movement to harmonise measurement, with several initiatives over the past 5 years recommending the consistent use of specific scales to allow read-across of measurements between studies. For this approach to flourish, however, common metrics must be acceptable and adaptable to a range of contexts and populations, and global access should be as easy and affordable as possible, including in low-income countries. Within a measurement landscape dominated by fixed proprietary measures and with competing views of what should be measured, achieving this goal poses a range of challenges. In this Personal View, we consider tensions between affordability, sustainability, consistency, and adaptability that, if not addressed, risk undermining the common metrics agenda. We outline a three-pronged way forward that involves funders taking more direct responsibility for measure development and dissemination; a move towards managing measure dissemination and adaptation via open-access measure hubs; and transitioning from fixed questionnaires to item banks. We argue that now is the time to start thinking of mental health metrics as 21st century tools to be co-owned and co-created by the mental health community, with support from dedicated infrastructure, coordinating bodies, and funders.

Community Therapist Response to Technology-Assisted Training in Exposure Therapy for Childhood Anxiety Disorders

Despite the efficacy of exposure for childhood anxiety disorders (CADs), dissemination has been unsuccessful. The current study examined community-therapist response to a brief (90-minutes) training in technology-assisted exposure therapy for CADs. The results indicated that therapists found the training in the therapy approach and technology acceptable, despite endorsing mainly non-exposure-based practice prior to the training. Training also increased positive beliefs about exposure, t (23) = 4.32, p < .000, that persisted 6 months later, t (23) = 4.56, p < .000. In addition, the number of therapists reporting an intention to implement exposure increased substantially from baseline (41.7%) to post-training (83.3%), with many therapists (70.8%) reporting use of exposure within the 6 months following training. However, automatically recorded data indicated little use of the technology. Results suggest that a dissemination message focusing on exposure is acceptable and has the potential to increase the use of this central treatment component.

The Use of Evidence-Based Assessment for Anxiety Disorders in an Australian Sample

Anxiety disorders are common and cause considerable functional impairment. Fortunately, evidence-based treatments are available, however, treatment effectiveness is often reliant on the provision of an accurate diagnosis. Accurate diagnosis requires a multi-method evidence-based assessment (EBA). Assessment techniques available to clinicians include a clinical interview, semi-structured diagnostic interview, self-report/clinician-administered rating scales and direct observation. Research demonstrates that only a small number of therapists utilize EBA, and to date this has not been investigated in an Australian sample. One hundred and two registered Australian psychologists (M_age = 40.98; SD = 12.67; 83.6% female) participated in an online study investigating assessment practices. Participants were asked to indicate EBA frequency of use and the obstacles they face to using EBA. The majority of participants (69% working with adult patients and 51% working with pediatric patients) reported partial use of EBA. Few psychologists (21% working with adult patients and 11% working with child patients) indicated complete use of EBA. Thirty-six percent of participants indicated negative beliefs about the usefulness or helpfulness of EBA. Multiple obstacles to the use of EBA were reported including concerns with the time required to complete assessment (27%), and a lack of access to assessment tools (10%). Implications for training and clinical practice are discussed.

Children's Facial Muscular Movements and Risk for Early Psychopathology: Assessing Clinical Utility

Standardized developmentally based assessment systems have transformed the capacity to identify transdiagnostic behavioral markers of mental disorder risk in early childhood, notably, clinically significant irritability and externalizing behaviors. However, behavior-based instruments that both differentiate risk for persistent psychopathology from normative misbehavior, and are feasible for community clinicians to implement, are in nascent phases of development. Young children's facial expressions during frustration challenges may form the basis for novel assessments tools that are flexible, quick, and easy to implement as markers of psychopathology to complement validated questionnaires. However, the accuracy of facial expressions to correctly classify young children falling above and below clinical cut-offs is unknown. Our goal was to test how facial expressions during frustration, defined by different facial muscular movements, related to individual differences in irritability and externalizing behaviors and discriminated children with clinically significant levels from peers. Participants were 79 children (ages 3-7) who completed a short, moderately frustrating computer task while facial expressions were recorded. Only negative facial expressions that included eye constriction related to irritability and externalizing behaviors and were clinically discriminating. Moreover, these expressions significantly discriminated children with and without clinically significant irritability and externalizing symptoms with high Area Under the Curve (AUC) values (> .75) indicating good clinical utility. In contrast, expressions without eye constriction showed no clinical utility. The presence of negative expressions with eye constriction in response to a short frustration prompt may serve as an indicator of early psychopathology, raising the potential for novel assessment tools that may enhance precision of early identification.

Evidence Base Update for Brief, Free, and Accessible Youth Mental Health Measures

Evidence-based assessment (EBA) is foundational to high-quality mental health care for youth and is a critical component of evidence-based practice delivery, yet is underused in the community. Administration time and measure cost are barriers to use; thus, identifying and disseminating brief, free, and accessible measures are critical. This Evidence Base Update evaluates the empirical literature for brief, free, and accessible measures with psychometric support to inform research and practice with youth. A systematic review using PubMed and PsycINFO identified measures in the following domains: overall mental health, anxiety, depression, disruptive behavior, traumatic stress, disordered eating, suicidality, bipolar/mania, psychosis, and substance use. To be eligible for inclusion, measures needed to be brief (50 items or less), free, accessible, and have psychometric support for their use with youth. Eligible measures were evaluated using adapted criteria established by De Los Reyes and Langer (2018) and were classified as having excellent, good, or adequate psychometric properties. A total of 672 measures were identified; 95 (14%) met inclusion criteria. Of those, 21 (22%) were "excellent," 34 (36%) were "good," and 40 (42%) were "adequate." Few measures had support for their use to routinely monitor progress in therapy. Few measures with excellent psychometric support were identified for disordered eating, suicidality, psychosis, and substance use. Future research should evaluate existing measures for use with routine progress monitoring and ease of implementation in community settings. Measure development is needed for disordered eating, suicidality, psychosis, and substance use to increase availability of brief, free, accessible, and validated measures.

Healthcare staff digital literacy levels and their attitudes towards information systems

This study aimed to assess the digital literacy levels and attitudes towards information systems of staff in a health service that will be implementing an electronic health record so that barriers towards implementation could be addressed. A survey measuring staff confidence levels and their attitudes towards information systems was developed. Data were collected over a five-week period, with data analysed using frequency analysis and a chi-square analysis. There were 407 respondents to the survey. The majority (70-80%) of which reported high digital literacy levels, expressing confidence in using technology. Respondents also reported positive attitudes towards information systems. However, one-fifth reported anxiety using information systems. Given poor staff engagement with information systems adversely affects the safety and quality of patient care, health services should provide targeted education and training to address staff with low digital literacy levels and/or confidence with using information systems prior to implementation of an electronic health record system.

Assessing anxiety disorders in children and adolescents

BACKGROUND

Given the relatively high prevalence of anxiety problems among young people and their adverse consequences if left untreated, it is important that clinicians and researchers have access to reliable and valid assessment tools to facilitate early detection, case formulation, treatment design and evaluation of outcomes.

METHOD

This paper presents the findings of a pragmatic review of the literature regarding the assessment of anxiety in young people in multiple contexts, including mental health services, school-based screening and research trials.

RESULTS

Commonly used diagnostic interviews, questionnaire measures and alternative assessment methods are described, along with psychometric properties and practical issues. The review indicates the complexities of assessing anxiety problems given the high level of comorbidity between anxiety disorders and with depression. It also highlights the different approaches required for assessment across different age groups, the need for multiple informants and issues relating to the lack of agreement between reporters. There is a strong evidence-base for several diagnostic instruments and anxiety scales, although the accuracy of youth and parent report scales in forming clinical diagnoses is not sufficiently strong to justify their use in isolation for diagnostic purposes.

CONCLUSIONS

The assessment of youth anxiety should ideally include a multiinformant, multimethod approach, with measures tailored to the age of the child, and the purpose of the evaluation. There is now a sufficiently strong research base to enable clinicians and researchers to ensure that they select evidence-based instruments.

Rapid and Accurate Behavioral Health Diagnostic Screening: Initial Validation Study of a Web-Based, Self-Report Tool (the SAGE-SR)

Background

The Structured Clinical Interview for DSM (SCID) is considered the gold standard assessment for accurate, reliable psychiatric diagnoses; however, because of its length, complexity, and training required, the SCID is rarely used outside of research.

Objective

This paper aims to describe the development and initial validation of a Web-based, self-report screening instrument (the Screening Assessment for Guiding Evaluation-Self-Report, SAGE-SR) based on the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) and the SCID-5-Clinician Version (CV) intended to make accurate, broad-based behavioral health diagnostic screening more accessible within clinical care.

Methods

First, study staff drafted approximately 1200 self-report items representing individual granular symptoms in the diagnostic criteria for the 8 primary SCID-CV modules. An expert panel iteratively reviewed, critiqued, and revised items. The resulting items were iteratively administered and revised through 3 rounds of cognitive interviewing with community mental health center participants. In the first 2 rounds, the SCID was also administered to participants to directly compare their Likert self-report and SCID responses. A second expert panel evaluated the final pool of items from cognitive interviewing and criteria in the DSM-5 to construct the SAGE-SR, a computerized adaptive instrument that uses branching logic from a screener section to administer appropriate follow-up questions to refine the differential diagnoses. The SAGE-SR was administered to healthy controls and outpatient mental health clinic clients to assess test duration and test-retest reliability. Cutoff scores for screening into follow-up diagnostic sections and criteria for inclusion of diagnoses in the differential diagnosis were evaluated.

Results

The expert panel reduced the initial 1200 test items to 664 items that panel members agreed collectively represented the SCID items from the 8 targeted modules and DSM criteria for the covered diagnoses. These 664 items were iteratively submitted to 3 rounds of cognitive interviewing with 50 community mental health center participants; the expert panel reviewed session summaries and agreed on a final set of 661 clear and concise self-report items representing the desired criteria in the DSM-5. The SAGE-SR constructed from this item pool took an average of 14 min to complete in a nonclinical sample versus 24 min in a clinical sample. Responses to individual items can be combined to generate DSM criteria endorsements and differential diagnoses, as well as provide indices of individual symptom severity. Preliminary measures of test-retest reliability in a small, nonclinical sample were promising, with good to excellent reliability for screener items in 11 of 13 diagnostic screening modules (intraclass correlation coefficient [ICC] or kappa coefficients ranging from .60 to .90), with mania achieving fair test-retest reliability (ICC=.50) and other substance use endorsed too infrequently for analysis.

Conclusions

The SAGE-SR is a computerized adaptive self-report instrument designed to provide rigorous differential diagnostic information to clinicians.

Factors associated with practitioners' use of exposure therapy for childhood anxiety disorders

The current study examines factors related to use of exposure therapy by clinicians who treat children with anxiety disorders. A sample of 331 therapists from a variety of backgrounds (i.e., social workers, doctoral psychologists, masters level counselors, and marriage and family therapists) completed a survey regarding use of exposure and other treatment techniques for childhood anxiety disorders, as well as beliefs about exposure and child resiliency. Although the majority of therapists endorsed a CBT orientation (81%) and use of CBT techniques, exposure therapy was rarely endorsed. Holding a PhD in psychology as well as more positive beliefs about exposure and child resiliency were associated with greater use of exposure. The results suggest that exposure-based therapy is rarely offered in community settings and that dissemination should focus on individual evidence-based principles and correcting therapist misconceptions.