Multi-Informant Assessments of Adolescents’ Fears of Negative and Positive Evaluation: Criterion and Incremental Validity in Relation to Observed Behavior

Advancing equity in access to school mental health through multiple informant decision-making

There has been a substantial increase in the number of students with mental health needs, yet significant discrepancies exist in access to timely intervention. Traditional gatekeeping to intervention has been the provenance of single information sources. Multi-informant decision-making is a promising mechanism to improve equitable access. However, critical advancements are necessary to improve decision-making relating to (a) who is identified, (b) what type of need is determined, (c) the type of intervention necessary, and (d) where or under what circumstances to implement the intervention. We review critical components of effective mental health decision-making, contributors to inequities in school mental health services, and offer future directions for research and practice to increase equitable student outcomes.

Bivalent fears of evaluation: A developmentally-informed, multi-informant, and multi-modal examination of associations with safety behaviors

Fears of negative (FNE) and positive (FPE) evaluation and safety behaviors feature prominently in cognitive-behavioral models of social anxiety. However, we have a poor understanding of their associations, particularly given evidence that they both vary in form and function. This study aimed to identify the factor structure of safety behaviors and explore their differential associations with FNE and FPE. We addressed these aims across samples that varied in developmental stage, informant, and assessment modality. We collected self-reported data from college students (n = 349; Mage = 19.42) and adolescent-parent dyads (n = 134; Mage_adolescents = 14.49, Mage_parents = 45.01); parents also completed an ecologically-valid evaluation task. We confirmed a two-factor structure of safety behaviors (i.e., avoidance and impression management) that fit the data well for college students, adolescents, and parents' self-report, but not for parents' report about adolescents. Associations between avoidance and impression management and FNE/FPE were significant within-informants but not between-informants. For parents, in-the-moment arousal following receipt of negative, but not positive, feedback was associated with avoidance and impression management. Findings have implications for integrated measurement of FNE, FPE, and safety behaviors, as well as treatments that target social anxiety through each of these domains.

The Proposed Specifiers for Conduct Disorder - Parent (PSCD-P): Convergent Validity, Incremental Validity, and Reactions to Unfamiliar Peer Confederates

Youth who experience psychopathy display multiple impairments across interpersonal (grandiose-manipulative [GM]), affective (callous-unemotional [CU]), lifestyle (daring-impulsive [DI]), and potentially antisocial and behavioral features. Recently, it has been acknowledged that the inclusion of psychopathic features can offer valuable information in relation to the etiology of Conduct Disorder (CD). Yet, prior work largely focuses on the affective component of psychopathy, namely CU. This focus creates uncertainty in the literature on the incremental value of a multicomponent approach to understanding CD-linked domains. Consequently, researchers developed the Proposed Specifiers for Conduct Disorder (PSCD; Salekin & Hare, 2016) as a multicomponent approach to assess GM, CU, and DI features in combination with CD symptoms. The notion of considering the wider set of psychopathic features for CD specification requires testing whether multiple personality dimensions predict domain-relevant criterion outcomes above-and-beyond a CU-based approach. Thus, we tested the psychometric properties of parents' reports on the PSCD (PSCD-P) in a mixed clinical/community sample of 134 adolescents (M_age = 14.49, 66.4% female). Confirmatory factor analyses resulted in a 19-item PSCD-P displaying acceptable reliability estimates and a bifactor solution consisting of GM, CU, DI, and CD factors. Findings supported the incremental validity of scores taken from the PSCD-P across multiple criterion variables, including (a) an established survey measure of parent-adolescent conflict; and (b) trained independent observers' ratings of adolescents' behavioral reactions to laboratory controlled tasks designed to simulate social interactions with unfamiliar peers. These findings have important implications for future research on the PSCD and links to adolescents' interpersonal functioning.

Assessing Peer-Related Impairments Linked to Adolescent Social Anxiety: Strategic Selection of Informants Optimizes Prediction of Clinically Relevant Domains

Socially anxious adolescents commonly experience impaired interpersonal functioning with unfamiliar, same-age peers. Yet, we lack short screening tools for assessing peer-related impairments. Recent work revealed that a parent-reported, three-item screening tool produced scores that uniquely related to social anxiety concerns. However, this tool ought to go beyond linking impairments to service needs (i.e., social anxiety symptoms). This tool should also inform the goals of services, in particular by linking impairments to key domains relevant to therapeutically addressing adolescents' anxiety-related needs, such as social skills when interacting with unfamiliar peers. This requires an assessment approach that involves strategic selection of informants who vary in their expertise for observing anxiety-related needs, as well as the therapeutic goals for addressing anxiety-related impairments (e.g., social skills within peer interactions). We leveraged parents' reports to link impairments to social anxiety-related needs. To link impairments to social skills, we leveraged informants (i.e., unfamiliar untrained observers [UUOs]) who observed adolescents within tasks designed to simulate interactions with same-age, unfamiliar peers. We tested this approach using a mixed-clinical/community sample of 134 adolescents, ages 14- to 15 years old. We leveraged multi-informant survey reports to assess adolescent social anxiety, and trained independent observers rated adolescents' social skills within unfamiliar peer interactions. Parents' reports performed best when distinguishing adolescents on referral status and predicting survey-reported social anxiety, whereas only UUOs' reports predicted independent observers' social skills ratings. These findings inform the strategic selection of informants for assessing impairments that commonly prompt the need for adolescents to access mental health services for social anxiety.

When Adolescents Experience Co-Occurring Social Anxiety and ADHD Symptoms: Links With Social Skills When Interacting With Unfamiliar Peer Confederates

Adolescents with elevated social anxiety commonly experience peer-related impairments - particularly with same-age, unfamiliar peers - stemming from their avoidant behaviors. Yet, peer-related impairments are not unique to social anxiety. For example, adolescents who experience social anxiety may also experience symptoms of attention deficit/hyperactivity disorder (ADHD), which also increase risk for peer-related impairments. Relative to social anxiety, peer-related impairments linked to ADHD symptoms more likely stem from hyperactivity (i.e., approach behaviors). These distinct pathways point to adolescents with elevated social anxiety and ADHD symptoms (i.e., social anxiety + ADHD) experiencing particularly high peer-related impairments, which commonly manifest as behavioral displays of low social skills when interacting with unfamiliar peers. We tested this notion in a mixed-clinical/community sample of 134 14- to 15-year-old adolescents and their parents. Adolescents participated in a series of social interaction tasks designed to simulate how adolescents interact with same-age, unfamiliar peers. Trained observers independently rated adolescents on observed social skills within these interactions. Both parents and adolescents completed parallel surveys of social anxiety and ADHD symptoms, which we used to identify social anxiety + ADHD adolescents as well as other combinations of social anxiety and ADHD symptoms (i.e., neither, elevated on one but not the other). Adolescents with social anxiety + ADHD displayed significantly lower social skills, relative to all other groups. Among adolescents, social anxiety + ADHD may have a compounding effect on social skills. As such, therapists working with social anxiety + ADHD adolescents should probe for peer-related impairments and factors implicated in the development and maintenance of these impairments.

Integrating multi-informant reports of youth mental health: A construct validation test of Kraemer and colleagues’ (2003) Satellite Model

Accurately assessing youth mental health involves obtaining reports from multiple informants who typically display low levels of correspondence. This low correspondence may reflect situational specificity. That is, youth vary as to where they display mental health concerns and informants vary as to where and from what perspective they observe youth. Despite the frequent need to understand and interpret these informant discrepancies, no consensus guidelines exist for integrating informants’ reports. The path to building these guidelines starts with identifying factors that reliably predict the level and form of these informant discrepancies, and do so for theoretically and empirically relevant reasons. Yet, despite the knowledge of situational specificity, few approaches to integrating multi-informant data are well-equipped to account for these factors in measurement, and those that claim to be well-positioned to do so have undergone little empirical scrutiny. One promising approach was developed roughly 20 years ago by Kraemer and colleagues (2003). Their Satellite Model leverages principal components analysis (PCA) and strategic selection of informants to instantiate situational specificity in measurement, namely components reflecting variance attributable to the context in which informants observe behavior (e.g., home/non-home), the perspective from which they observe behavior (e.g., self/other), and behavior that manifests across contexts and perspectives (i.e., trait). The current study represents the first construct validation test of the Satellite Model. A mixed-clinical/community sample of 134 adolescents and their parents completed six parallel surveys of adolescent mental health. Adolescents also participated in a series of simulated social interactions with research personnel trained to act as same-age, unfamiliar peers. A third informant (unfamiliar untrained observer) viewed these interactions and completed the same surveys as parents and adolescents. We applied the Satellite Model to each set of surveys and observed high internal consistency estimates for each of the six-item trait (α = 0.90), context (α = 0.84), and perspective (α = 0.83) components. Scores reflecting the trait, context, and perspective components displayed distinct patterns of relations to a battery of criterion variables that varied in the context, perspective, and source of measurement. The Satellite Model instantiates situational specificity in measurement and facilitates unifying conceptual and measurement models of youth mental health.

Adolescent Safety Behaviors and Social Anxiety: Links to Psychosocial Impairments and Functioning with Unfamiliar Peer Confederates

Socially anxious adolescents often endure anxiety-provoking situations using safety behaviors: strategies for minimizing in-the-moment distress (e.g., avoiding eye contact, rehearsing statements before entering a conversation). Studies linking safety behaviors to impaired functioning have largely focused on adults. In a sample of one hundred thirty-four 14 to 15 year-old adolescents, we tested whether levels of safety behaviors among socially anxious adolescents relate to multiple domains of impaired functioning. Adolescents, parents, and research personnel completed survey measures of safety behaviors and social anxiety, adolescents and parents reported about adolescents' evaluative fears and psychosocial impairments, and adolescents participated in a set of tasks designed to simulate social interactions with same-age, unfamiliar peers. Relative to other adolescents in the sample, adolescents high on both safety behaviors and social anxiety displayed greater psychosocial impairments, evaluative fears, and observed social skills deficits within social interactions. These findings have important implications for assessing and treating adolescent social anxiety.