Conceptualizing changes in behavior in intervention research: the range of possible changes model

State of the Science in Behavior Therapy: Taking Stock and Looking Forward

The scope and burdens of mental health challenges in today's world are staggering. Among the available psychological treatment approaches, cognitive and behavioral therapies, and their combinations, have garnered the strongest evidence base. That said, progress has not always been linear and most of the work is still ahead of us. Against this backdrop, Behavior Therapy has launched its State of the Science series-an exciting new journal feature offering a curated set of authoritative reviews of research in major areas of relevance to applied cognitive-behavioral science, written by distinguished scientists in each area and peer-reviewed. The vision for the Behavior Therapy State of the Science series is to launch with an initial set of articles that make up this special journal issue, with continued publication of additional State of the Science articles in future journal issues. The current article launches the State of the Science series, providing a brief summary of progress in cognitive and behavioral practice and related areas, as well as various missteps and harmful legacies that remind us that the state of the science for research focused on mental health and the alleviation of human suffering is always in flux and evolving. The 16 inaugural reviews in this special issue are then introduced one by one. Collectively, these State of the Science reviews take stock of what has been learned across key areas in the field, highlight critical knowledge gaps in need of research, and provide expert guidance for improving the effectiveness and reach of care, particularly for marginalized and underserved populations.

Advancing equity in access to school mental health through multiple informant decision-making

There has been a substantial increase in the number of students with mental health needs, yet significant discrepancies exist in access to timely intervention. Traditional gatekeeping to intervention has been the provenance of single information sources. Multi-informant decision-making is a promising mechanism to improve equitable access. However, critical advancements are necessary to improve decision-making relating to (a) who is identified, (b) what type of need is determined, (c) the type of intervention necessary, and (d) where or under what circumstances to implement the intervention. We review critical components of effective mental health decision-making, contributors to inequities in school mental health services, and offer future directions for research and practice to increase equitable student outcomes.

Parent-adolescent discrepancies in positive parenting and adolescent problem behaviors in Chinese families

Based on the discrepancy-maladaptive hypothesis and general strain theory, in this study, we examined two key aspects: first, the mediating role of self-control in the relationship between parent-adolescent discrepancies in positive parenting and adolescent internalizing and externalizing problems, and second, variations in problem behavior among subgroups with different parent-adolescent dyads reporting patterns. The participants were 349 intact Chinese families, with parents as the primary caregivers and teenagers aged 15-18 years who are attending secondary vocational schools. The results revealed that adolescents generally perceived lower levels of caring and behavioral control than parents. Compared to behavioral control, discrepancies in perceived levels of caring had more significant predicting levels of internalizing and externalizing problems, and the relationship between discrepancies of caring and internalizing and externalizing problems was mediated by self-control. Latent profile analysis revealed three parent-adolescent responding patterns (subgroups); compared to the other subgroups, only the subgroup characterized by adolescents perceiving lower caring and behavioral control than parents exhibited higher levels of internalizing and externalizing problems. The findings of this study provide insights on how parent-adolescent discrepancies may lead to adolescent problem behaviors and highlight the importance of self-control as a mediating mechanism.

Introduction to the Special Issue. A Dozen Years of Demonstrating That Informant Discrepancies are More Than Measurement Error: Toward Guidelines for Integrating Data from Multi-Informant Assessments of Youth Mental Health

Validly characterizing youth mental health phenomena requires evidence-based approaches to assessment. An evidence-based assessment cannot rely on a "gold standard" instrument but rather, batteries of instruments. These batteries include multiple modalities of instrumentation (e.g., surveys, interviews, performance-based tasks, physiological readings, structured clinical observations). Among these instruments are those that require soliciting reports from multiple informants: People who provide psychometrically sound data about youth mental health (e.g., parents, teachers, youth themselves). The January 2011 issue of the Journal of Clinical Child and Adolescent Psychology (JCCAP) included a Special Section devoted to the most common outcome of multi-informant assessments of youth mental health, namely discrepancies across informants' reports (i.e., informant discrepancies). The 2011 JCCAP Special Section revolved around a critical question: Might informant discrepancies contain data relevant to understanding youth mental health (i.e., domain-relevant information)? This Special Issue is a "sequel" to the 2011 Special Section. Since 2011, an accumulating body of work indicates that informant discrepancies often contain domain-relevant information. Ultimately, we designed this Special Issue to lay the conceptual, methodological, and empirical foundations of guidelines for integrating multi-informant data when informant discrepancies contain domain-relevant information. In this introduction to the Special Issue, we briefly review the last 12 years of research and theory on informant discrepancies. This review highlights limitations inherent to the most commonly used strategies for integrating multi-informant data in youth mental health. We also describe contributions to the Special Issue, including articles about informant discrepancies that traverse multiple content areas (e.g., autism, implementation science, measurement validation, suicide).

Conceptual, methodological, and measurement factors that disqualify use of measurement invariance techniques to detect informant discrepancies in youth mental health assessments

On page 1 of his classic text, Millsap (2011) states, "Measurement invariance is built on the notion that a measuring device should function the same way across varied conditions, so long as those varied conditions are irrelevant [emphasis added] to the attribute being measured." By construction, measurement invariance techniques require not only detecting varied conditions but also ruling out that these conditions inform our understanding of measured domains (i.e., conditions that do not contain domain-relevant information). In fact, measurement invariance techniques possess great utility when theory and research inform their application to specific, varied conditions (e.g., cultural, ethnic, or racial background of test respondents) that, if not detected, introduce measurement biases, and, thus, depress measurement validity (e.g., academic achievement and intelligence). Yet, we see emerging bodies of work where scholars have "put the cart before the horse" when it comes to measurement invariance, and they apply these techniques to varied conditions that, in fact, may reflect domain-relevant information. These bodies of work highlight a larger problem in measurement that likely cuts across many areas of scholarship. In one such area, youth mental health, researchers commonly encounter a set of conditions that nullify the use of measurement invariance, namely discrepancies between survey reports completed by multiple informants, such as parents, teachers, and youth themselves (i.e., informant discrepancies). In this paper, we provide an overview of conceptual, methodological, and measurement factors that should prevent researchers from applying measurement invariance techniques to detect informant discrepancies. Along the way, we cite evidence from the last 15 years indicating that informant discrepancies reflect domain-relevant information. We also apply this evidence to recent uses of measurement invariance techniques in youth mental health. Based on prior evidence, we highlight the implications of applying these techniques to multi-informant data, when the informant discrepancies observed within these data might reflect domain-relevant information. We close by calling for a moratorium on applying measurement invariance techniques to detect informant discrepancies in youth mental health assessments. In doing so, we describe how the state of the science would need to fundamentally "flip" to justify applying these techniques to detect informant discrepancies in this area of work.

Understanding Irritability in Relation to Anger, Aggression, and Informant in a Pediatric Clinical Population

OBJECTIVE

Despite its clinical relevance to pediatric mental health, the relationship of irritability with anger and aggression remains unclear. We aimed to quantify the relationships between well-validated, commonly used measurements of these constructs and informant effects in a clinically relevant population.

METHOD

A total of 195 children with primary diagnoses of attention-deficit/hyperactivity disorder, disruptive mood dysregulation disorder, or no major disorder and their parents rate irritability, anger, and aggression on measures of each construct. Construct and informant relationships were mapped via multi-trait, multi-method factor analysis.

RESULTS

Parent- and child-reported irritability and child-reported anger are highly associated (r = 0.89) but have some significant differences. Irritability overlaps with outward expression of anger but diverges from anger in anger suppression and control. Aggression has weaker associations with both irritability (r = 0.56) and anger (r = 0.49). Across measures, informant source explains a substantial portion of response variance.

CONCLUSION

Irritability, albeit distinct from aggression, is highly associated with anger, with notable overlap in child-reported outward expression of anger, providing empirical support for formulations of clinical irritability as a proneness to express anger outwardly. Diagnostic and clinical intervention work on this facet of anger can likely translate to irritability. Further research on external validation of divergence of these constructs in anger suppression and control may guide future scale revisions. The proportion of response variance attributable to informant may be an under-recognized confound in clinical research and construct measurement.

Cognitive control training for children with anxiety and depression: A systematic review

Cognitive control training has gained traction as an intervention for reducing anxiety and depression vulnerability in adults. There are, however, a limited number of studies investigating such training interventions for reducing symptomology of anxiety and depression in children and adolescents. Thus, we aimed to provide a robust review and qualitative synthesis of the available research in young people. Twelve articles met the inclusion criteria, and all were randomised control trials. Evidence of the efficacy of cognitive control training for relief of symptoms are reported separately for anxiety, depression, and other related psychological factors, and on the basis of type of cognitive control training paradigm. A lack of standardisation in relation to type of intervention, duration and context, outcome measures and population was observed. Results are discussed in terms of these variations and recommendations for future research are provided.

Informant discrepancies in assessments of psychosocial functioning in school-based services and research: Review and directions for future research

Psychosocial functioning plays a key role in students' wellbeing and performance inside and outside of school. As such, techniques designed to measure and improve psychosocial functioning factor prominently in school-based service delivery and research. Given that the different contexts (e.g., school, home, community) in which students exist vary in the degree to which they influence psychosocial functioning, educators and researchers often rely on multiple informants to characterize intervention targets, monitor intervention progress, and inform the selection of evidence-based services. These informants include teachers, students, and parents. Across research teams, domains, and measurement methodologies, researchers commonly observe discrepancies among informants' reports. We review theory and research-occurring largely outside of school-based service delivery and research-that demonstrates how patterns of informant discrepancies represent meaningful differences that can inform our understanding of psychosocial functioning. In turn, we advance a research agenda to improve use and interpretation of informant discrepancies in school-based services and research.

Improving Interpretability of Subjective Assessments About Psychological Phenomena: A Review and Cross-Cultural Meta-Analysis

Attempts to understand subjectivity have historically involved distinguishing the strengths of subjective methods (e.g., survey ratings from informants) from those of alternative methods (e.g., observational/performance-based tasks). Yet a movement is underway in Psychology that considers the merits of intersubjectivity: Understanding the space between two or more informant’s subjective impressions of a common person or phenomenon. In mental health research, understanding differences between subjective impressions have less to do with informants’ characteristics and more to do with the social environments or contexts germane to the people or phenomena examined. Our article focuses on one relatively understudied social environment: the cultural context. We draw from seminal work on psychological universals, as well as emerging work on cultural norms (i.e., cultural tightness) to understand intersubjectivity effects through a cross-cultural lens. We report a meta-analysis of 314 studies of intersubjectivity effects in mental health, revealing that (a) this work involves independent research teams in more than 30 countries, (b) informants rating a target person’s mental health (e.g., parent and teacher ratings of a child’s behavior) commonly provide diverging estimates of that person’s mental health, and (c) greater convergence between subjective reports relates to a “tighter” or more norms-bound culture. Our article illustrates strategies for understanding divergence between subjective reports. In particular, we highlight theoretical and methodological frameworks for examining patterns of divergence between subjective reports in relation to data from nonsubjective methods. We also describe how research on intersubjectivity informs efforts to improve the interpretability of subjective assessments in multiple subdisciplines in Psychology.

Depression, Anxiety, and Peer Victimization: Bidirectional Relationships and Associated Outcomes Transitioning from Childhood to Adolescence

Experiences of depression, anxiety, and peer victimization have each been found to predict one another, and to predict negative outcomes in the domains of school connectedness, social functioning, quality of life, and physical health. However, the common co-occurrence of depression, anxiety, and peer victimization experiences has made it difficult to disentangle their unique roles in these associations. The present study thus sought to characterize the precise nature of the bidirectional relationships between depressive symptoms, anxiety, and victimization over time, and to examine their unique sequelae during the transition from childhood to early adolescence. Longitudinal multi-informant (child-reported, parent-reported, and teacher-reported) data from a nationally representative sample were analyzed using path analysis when the study child was aged 10-11 (n= 4169; M_age= 10.3; 48.8% female) and aged 12-13 (n= 3956; M_age = 12.4; 48.2% female). Depressive symptoms, anxiety, and peer victimization had small but significant unique bidirectional relationships. All three constructs also uniquely and prospectively predicted poorer life functioning across all domains examined. These results demonstrate that current interventions should broaden their scope to simultaneously target depression, anxiety, and peer victimization, as each of these experiences independently act as additive risk factors for subsequent negative outcomes.

Latino Family Participation in Youth Mental Health Services: Treatment Retention, Engagement, and Response

Although researchers have identified a multitude of factors that contribute to family participation in mental health services, few studies have examined them specifically for Latino youth and their families in the U.S., a population that continues to experience significant disparities related to the availability, accessibility, and quality of mental health services. Latino youth and their families are at greater risk of dropping out of treatment prematurely and demonstrating poor treatment engagement, both of which have subsequent negative effects on treatment response outcomes. In order to help to guide efforts to improve the accessibility and quality of mental health services for Latino youth and their families, the current paper integrates modern conceptualization of family participation in youth mental health services and provides a summary of contextual factors within an ecological framework (Bronfenbrenner in The ecology of human development: experiments by nature and design, Harvard University Press, Cambridge, 1979). The current review aims to integrate empirical research on the impact of various contextual factors across multiple levels (i.e., culture, community, mental health system, family, parent/caregiver, and child/adolescent) on Latino family participation in youth mental health services, including treatment retention, engagement, and response. Clinical implications will be discussed, and an integrated, conceptual model will be presented. Not only does this model help to demonstrate the way in which existing literature is conceptually linked, but it also helps to highlight factors and underlying processes that health care providers, administrators, and policy makers must consider in working to improve mental health services for Latino youth and their families living in the U.S.

Clinicians' Personal Theories of Developmental Disorders Explain Their Judgments of Effectiveness of Interventions

Evidence-based psychotherapy requires clinicians to consider theories of psychopathology and evidence about effectiveness, and their experience when choosing interventions. Research on clinical decision making indicates that clinicians’ theories of disorders might be personal and inform judgments and choices beyond current scientific theory and evidence. We asked 20 child therapists to draw models of how they believed that biological, psychological, environmental, and behavioral factors interact to cause and maintain four common developmental disorders. They were also asked to judge the effectiveness of interventions recommended in the literature. Therapists showed only fair agreement about the factors and a slight to fair agreement about the causal relations between these, and just fair agreement about interventions’ effectiveness. Despite these disagreements, we could predict effectiveness judgments from therapists’ personal theories, which indicates that clinicians use personal theories in decision making. We discuss the implications of these findings for evidence-based practice.

Factors Associated with Healthy and Impaired Social Functioning in Young Adolescents with ADHD

There is variability in the extent to which adolescents with attention-deficit/hyperactivity disorder (ADHD) exhibit social impairment, as the same diagnosis does not necessarily entail impairment in the same area(s) of functioning. The current study entailed a cross-sectional examination of enhancers to healthy social functioning and risk factors to parent- and self-rated social impairment in 324 middle school youth (ages 10-14 years) with ADHD. A series of binary logistic regression analyses were conducted to evaluate a risk-resilience model for social functioning, including testing compensatory (i.e., main; buffering) and protective (i.e., interaction) effects of enhancers in the presence of identified risk factors. Youth conduct problems, youth depression, and negative parenting emerged as risk factors. Self-rated social acceptance, activity participation (breadth and intensity), and parent involvement were enhancers of healthy social functioning. Of these enhancers, activity participation (breadth and intensity) and parent involvement showed buffering effects against the negative impact of the risk factors on social functioning. None of the enhancers displayed protective effects. The findings of this study enhance our understanding of the social functioning of young adolescents with ADHD, who comprise an understudied population relative to younger children with similar problems.

Agreement Between Parent- and Self-Reports of Psychopathic Traits and Externalizing Behaviors in a Clinical Sample

A number of studies have identified discrepancies in informant ratings of externalizing behaviors in youth, but it is unclear whether similar discrepancies exist between informants when rating psychopathic traits. In this study, we examined parent-child agreement on ratings of both psychopathic traits and externalizing behaviors, and examined the factors that influence agreement in both of these domains. A total of 282 children between 7 and 16 years (M = 10.60 years, SD = 1.91) from an outpatient child psychiatric clinic participated in this study. Our findings revealed low levels of parent-child agreement on these measures (ICC values ranging from .02 to .30 for psychopathic traits; ICC values ranging from .09 to .30 for externalizing behaviors). In addition, our findings did not support the moderating effects of child's age, gender, clinical diagnosis, informant, and parental conflict on the relationship between parent- and child-ratings of psychopathic traits and externalizing behaviors. Further research is needed to better understand how parents and child reports of child's externalizing behaviors and psychopathic traits are similar and/or different from one another and factors that influence these agreements.

Introduction to the Special Issue: Discrepancies in Adolescent-Parent Perceptions of the Family and Adolescent Adjustment

Researchers commonly rely on adolescents' and parents' reports to assess family functioning (e.g., conflict, parental monitoring, parenting practices, relationship quality). Recent work indicates that these reports may vary as to whether they converge or diverge in estimates of family functioning. Further, patterns of converging or diverging reports may yield important information about adolescent adjustment and family functioning. This work is part of a larger literature seeking to understand and interpret multi-informant assessments of psychological phenomena, namely mental health. In fact, recent innovations in conceptualizing, measuring, and analyzing multi-informant mental health assessments might meaningfully inform efforts to understand multi-informant assessments of family functioning. Therefore, in this Special Issue we address three aims. First, we provide a guiding framework for using and interpreting multi-informant assessments of family functioning, informed by recent theoretical work focused on using and interpreting multi-informant mental health assessments. Second, we report research on adolescents' and parents' reports of family functioning that leverages the latest methods for measuring and analyzing patterns of convergence and divergence between informants' reports. Third, we report research on measurement invariance and its role in interpreting adolescents' and parents' reports of family functioning. Research and theory reported in this Special Issue have important implications for improving our understanding of the links between multi-informant assessments of family functioning and adolescent adjustment.

All anxiety is not created equal: Correlates of parent/youth agreement vary across subtypes of anxiety

Research has examined patterns and correlates of parent/youth informant discrepancies in the reporting of youth anxiety. However, little work has examined whether it is better to conceptualize patterns and correlates of informant disagreement across anxiety broadly, or more useful to consider disagreement on specific symptom clusters. Using data from the Child Adolescent/Anxiety Multimodal Study (CAMS; N = 488; Walkup et al., 2008), the current study applied the most recent recommended analytic strategies to study informant discrepancies and examined differences in the magnitude and patterns of disagreement for: (a) broadband anxiety symptoms, versus (b) symptoms of specific anxiety diagnoses (or anxiety subtypes; e.g., separation, social anxiety). Correlates of informant discrepancies were also examined. Results indicated that there was variability in agreement across anxiety subtypes, with parent/youth agreement higher on separation anxiety and school refusal symptoms relative to other domains. Parental psychopathology was associated with disagreement on broadband anxiety symptoms, such that parental psychopathology was highest when parents reported higher symptoms than their children; however, this finding was largely driven by a relationship between parental psychopathology and disagreement on separation anxiety symptoms. Age was associated with disagreement on total and separation anxiety symptoms. Gender was not associated with disagreement. Clinical implications are discussed.

Developmental Changes in Discrepancies Between Adolescents' and Their Mothers' Views of Family Communication

Prior work indicates that adolescents perceive the family more negatively than do their parents. These discrepant views comprise some of the most robust observations in psychological science, and are observed on survey reports collected in vastly different cultures worldwide. Yet, whether developmental changes occur with these discrepant views remains unclear. In a sample of 141 adolescents and their mothers, we examined 1-year developmental changes in discrepancies between parents' and adolescents' views of family functioning. We focused on discrepant views about a relatively covert domain of family functioning (i.e., internal views of open communication) and a relatively overt domain of such functioning (i.e., views about observable communication problems). We observed significant developmental changes in discrepant views for open communication, but not for communication problems. These findings have important implications for research examining links between discrepant views of family functioning and whether these discrepancies serve as risk or protective factors for adolescent psychosocial functioning.

Is Using the Strengths and Difficulties Questionnaire in a Community Sample the Optimal Way to Assess Mental Health Functioning?

An important characteristic of a screening tool is its discriminant ability or the measure's accuracy to distinguish between those with and without mental health problems. The current study examined the inter-rater agreement and screening concordance of the parent and teacher versions of SDQ at scale, subscale and item-levels, with the view of identifying the items that have the most informant discrepancies; and determining whether the concordance between parent and teacher reports on some items has the potential to influence decision making. Cross-sectional data from parent and teacher reports of the mental health functioning of a community sample of 299 students with and without disabilities from 75 different primary schools in Perth, Western Australia were analysed. The study found that: a) Intraclass correlations between parent and teacher ratings of children's mental health using the SDQ at person level was fair on individual child level; b) The SDQ only demonstrated clinical utility when there was agreement between teacher and parent reports using the possible or 90% dichotomisation system; and c) Three individual items had positive likelihood ratio scores indicating clinical utility. Of note was the finding that the negative likelihood ratio or likelihood of disregarding the absence of a condition when both parents and teachers rate the item as absent was not significant. Taken together, these findings suggest that the SDQ is not optimised for use in community samples and that further psychometric evaluation of the SDQ in this context is clearly warranted.

The validity of the multi-informant approach to assessing child and adolescent mental health

Child and adolescent patients may display mental health concerns within some contexts and not others (e.g., home vs. school). Thus, understanding the specific contexts in which patients display concerns may assist mental health professionals in tailoring treatments to patients' needs. Consequently, clinical assessments often include reports from multiple informants who vary in the contexts in which they observe patients' behavior (e.g., patients, parents, teachers). Previous meta-analyses indicate that informants' reports correlate at low-to-moderate magnitudes. However, is it valid to interpret low correspondence among reports as indicating that patients display concerns in some contexts and not others? We meta-analyzed 341 studies published between 1989 and 2014 that reported cross-informant correspondence estimates, and observed low-to-moderate correspondence (mean internalizing: r = .25; mean externalizing: r = .30; mean overall: r = .28). Informant pair, mental health domain, and measurement method moderated magnitudes of correspondence. These robust findings have informed the development of concepts for interpreting multi-informant assessments, allowing researchers to draw specific predictions about the incremental and construct validity of these assessments. In turn, we critically evaluated research on the incremental and construct validity of the multi-informant approach to clinical child and adolescent assessment. In so doing, we identify crucial gaps in knowledge for future research, and provide recommendations for "best practices" in using and interpreting multi-informant assessments in clinical work and research. This article has important implications for developing personalized approaches to clinical assessment, with the goal of informing techniques for tailoring treatments to target the specific contexts where patients display concerns. (PsycINFO Database Record

The validity of the multi-informant approach to assessing child and adolescent mental health

Child and adolescent patients may display mental health concerns within some contexts and not others (e.g., home vs. school). Thus, understanding the specific contexts in which patients display concerns may assist mental health professionals in tailoring treatments to patients' needs. Consequently, clinical assessments often include reports from multiple informants who vary in the contexts in which they observe patients' behavior (e.g., patients, parents, teachers). Previous meta-analyses indicate that informants' reports correlate at low-to-moderate magnitudes. However, is it valid to interpret low correspondence among reports as indicating that patients display concerns in some contexts and not others? We meta-analyzed 341 studies published between 1989 and 2014 that reported cross-informant correspondence estimates, and observed low-to-moderate correspondence (mean internalizing: r = .25; mean externalizing: r = .30; mean overall: r = .28). Informant pair, mental health domain, and measurement method moderated magnitudes of correspondence. These robust findings have informed the development of concepts for interpreting multi-informant assessments, allowing researchers to draw specific predictions about the incremental and construct validity of these assessments. In turn, we critically evaluated research on the incremental and construct validity of the multi-informant approach to clinical child and adolescent assessment. In so doing, we identify crucial gaps in knowledge for future research, and provide recommendations for "best practices" in using and interpreting multi-informant assessments in clinical work and research. This article has important implications for developing personalized approaches to clinical assessment, with the goal of informing techniques for tailoring treatments to target the specific contexts where patients display concerns. (PsycINFO Database Record

Practice Guidelines for the Assessment of Clinically Significant Treatment Outcomes in the Children's Mental Health System

The use of program evaluation to monitor client change and improve intervention effectiveness is gaining increasing importance in the mental health field. However, there is a lack of literature available in community-based clinics for those who desire to evaluate the effectiveness of services. Through this article the authors review the literature on the best methods to assess clinically significant treatment outcomes in community-based children's mental health services. The strengths and weaknesses of commonly recommended methods of evaluating change are discussed (i.e., reliable change index, percentage of improvement, normative comparisons, and effect size) using a dataset from a community-based parenting program (N = 308).

Introduction to the special issue: toward implementing physiological measures in clinical child and adolescent assessments

The National Institute of Mental Health recently launched the Research Domain Criteria (RDoC). The RDoC is an initiative to improve classification of mental health concerns by promoting research on the brain mechanisms underlying these concerns, with the ultimate goal of developing interventions that target these brain mechanisms. A key focus of RDoC involves opening new lines of research examining patients' responses on biological measures. The RDoC presents unique challenges to mental health professionals who work with children and adolescents. Indeed, mental health professionals rarely integrate biological measures into clinical assessments. Thus, RDoC's ability to improve patient care rests, in part, on the development of strategies for implementing biological measures within mental health assessments. Further, mental health professionals already carry out comprehensive assessments that frequently yield inconsistent findings. These inconsistencies have historically posed challenges to interpreting research findings as well as assessment outcomes in practice settings. In this introductory article, we review key issues that informed the development of a special issue of articles demonstrating methods for implementing low-cost measures of physiological functioning in clinical child and adolescent assessments. We also outline a conceptual framework, informed by theoretical work on using and interpreting multiple informants' clinical reports (De Los Reyes, Thomas, Goodman, & Kundey, 2013 ), to guide hypothesis testing when using physiological measures within clinical child and adolescent assessments. This special issue and the conceptual model described in this article may open up new lines of research testing paradigms for implementing clinically feasible physiological measures in clinical child and adolescent assessments.

Clinical dysfunction and psychosocial interventions: the interplay of research, methods, and conceptualization of challenges

I describe the development and course of my research in studying clinical dysfunction among children, adolescents, and adults. This is an autobiographical account that highlights programs of research, career moves, and experiences along the way that were particularly influential. Research on specific topics and the methods to study them were inherently fascinating but invariably led me to broader issues well beyond what I was studying. The research alerted me to how and why current methods, assumptions, and research practices might be constraining and perhaps slightly misguided. My research and specific findings in a given area were not necessarily part of any particular breakthrough but rather helped me see how more, different, and better work was needed. Collaborations with a diverse set of colleagues and models from other disciplines than psychology helped me conceptualize the goals of research on a given topic (e.g., developing evidence-based treatments, reducing the burden of mental illness, promoting a sustainable environment to mitigate climate change) and propose a shift from current practices as a means to obtain them.

Evidence-based psychotherapies I: qualifiers and limitations in what we know

Psychosocial interventions have advanced remarkably for the treatment of a broad range of psychiatric disorders and related sources of impairment among children, adolescents, and adults. By one count, over 320 interventions have been identified as evidence-based in light of rigorously controlled studies and replication of treatment effects. Yet, how evidence-based psychotherapies have been evaluated and reported raises questions about their impact. This article evaluates both methodological and substantive issues that limit what can be stated about evidence-based psychotherapies and their effects. Among the methodological topics are the control conditions to which evidence-based psychotherapies are compared, selective reporting of measures, and the limited evidence that evidence-based psychotherapies have clinically significant impact. Among the substantive issues are the paucity of research on moderators that would help us better direct patients to treatments from which they are likely to profit and our limited understanding of the mechanisms responsible for therapeutic change. The issues discussed are fundamental to what can be stated about the impact of evidence-based psychotherapies and impact and the bases for their effects. It is not clear at present whether concerted efforts are in place to alter research in ways that would redress the issues. There are, however, novel new directions for research that build on the evidence-based psychotherapies, and these are addressed in a companion article.

Pharmacological and psychosocial treatments for adolescents with ADHD: an updated systematic review of the literature

Smith, Waschbusch, Willoughby, and Evans (2000) reviewed a small treatment literature on ADHD in adolescents and concluded that methylphenidate stimulant medication was a well-established treatment and behavior therapy (BT) demonstrated preliminary efficacy. This review extends and updates the findings of the prior one based on the previous 15years of research. Studies published since 1999 were identified and coded using standard criteria and effect sizes were calculated where appropriate. Highlights of the last 15years of research include an expansion of pharmacological treatment options and developmentally appropriate psychosocial treatment packages for adolescents with ADHD. Additionally, nonstimulant medications (e.g., atomoxetine) are now approved for the treatment of ADHD in adolescence. The review concludes that medication and BT produce a similar range of therapeutic effects on the symptoms of adolescents with ADHD. However, results suggest that BT may produce greater overall benefits on measures of impairment. There was no evidence that cognitive enhancement trainings, such as working memory training or neurofeedback improved the functioning of adolescents with ADHD. Whether to use medication, BT, or their combination to treat an adolescent with ADHD is complicated and we provide evidence-informed guidelines for treatment selection. The reviewed evidence does not support current American Academy of Pediatrics and American Academy of Child and Adolescent Psychiatry professional guidelines, which state that stimulant medication is the preferred treatment for adolescents with ADHD. Recommendations for assessment, practice guidelines, and future research are discussed.

Evidence-based psychosocial treatments for children and adolescents with attention-deficit/hyperactivity disorder

The purpose of this research was to update the Pelham and Fabiano ( 2008 ) review of evidence-based practices for children and adolescents with attention-deficit/hyperactivity disorder. We completed a systematic review of the literature published between 2007 and 2013 to establish levels of evidence for psychosocial treatments for these youth. Our review included the identification of relevant articles using criteria established by the Society of Clinical Child and Adolescent Psychology (see Southam-Gerow & Prinstein, in press ) using keyword searches and a review of tables of contents. We extend the conceptualization of treatment research by differentiating training interventions from behavior management and by reviewing the growing literature on training interventions. Consistent with the results of the previous review we conclude that behavioral parent training, behavioral classroom management, and behavioral peer interventions are well-established treatments. In addition, organization training met the criteria for a well-established treatment. Combined training programs met criteria for Level 2 (Probably Efficacious), neurofeedback training met criteria for Level 3 (Possibly Efficacious), and cognitive training met criteria for Level 4 (Experimental Treatments). The distinction between behavior management and training interventions provides a method for considering meaningful differences in the methods and possible mechanisms of action for treatments for these youth. Characteristics of treatments, participants, and measures, as well as the variability in methods for classifying levels of evidence for treatments, are reviewed in relation to their potential effect on outcomes and conclusions about treatments. Implications of these findings for future science and practice are discussed.

Strategic objectives for improving understanding of informant discrepancies in developmental psychopathology research

Developmental psychopathology researchers and practitioners commonly conduct behavioral assessments using multiple informants' reports (e.g., parents, teachers, practitioners, children, and laboratory observers). These assessments often yield inconsistent conclusions about important questions in developmental psychopathology research, depending on the informant (e.g., psychiatric diagnoses and risk factors of disorder). Researchers have theorized why informant discrepancies exist and advanced methodological models of informant discrepancies. However, over 50 years of empirical data has uncovered little knowledge about these discrepancies beyond that they exist, complicate interpretations of research findings and assessment outcomes in practice, and correlate with some characteristics of the informants providing reports (e.g., demographics and mood levels). Further, recent studies often yield take-home messages about the importance of taking a multi-informant approach to clinical and developmental assessments. Researchers draw these conclusions from their work, despite multi-informant approaches to assessment long being a part of best practices in clinical and developmental assessments. Consequently, developmental psychopathology researchers and practitioners are in dire need of a focused set of research priorities with the key goal of rapidly advancing knowledge about informant discrepancies. In this paper, I discuss these research priorities, review work indicating the feasibility of conducting research addressing these priorities, and specify what researchers and practitioners would gain from studies advancing knowledge about informant discrepancies in developmental psychopathology research.

Testing informant discrepancies as predictors of early adolescent psychopathology: why difference scores cannot tell you what you want to know and how polynomial regression may

Multiple informants commonly disagree when reporting child and family behavior. In many studies of informant discrepancies, researchers take the difference between two informants' reports and seek to examine the link between this difference score and external constructs (e.g., child maladjustment). In this paper, we review two reasons why difference scores cannot serve as unambiguous predictors of outcomes. Further, we use polynomial regression analyses to both test the validity of difference scores and provide a more direct test of the hypothesis that discrepancies in parent and child reports predict child psychopathology. Data from 218 parent-adolescent dyads (M adolescent age = 11.5 years, 51 % female; 49 % European American, 47 % African American) were used to predict adolescent-reported antisocial behavior and depression from parent and adolescent reports of parent-adolescent conflict, parental knowledge, parental acceptance, adolescent rule-breaking behavior, and adolescent pubertal development. Results demonstrate that analyses using difference scores do not provide valid tests of the utility of informant discrepancies in predicting adolescent psychosocial maladjustment. However, interaction terms in polynomial regression analyses provide evidence that informant discrepancies predict child psychopathology. Parent-adolescent informant discrepancies predict adolescent psychopathology but researchers should avoid using difference scores to measure informant discrepancies. Polynomial regression analyses provide more comprehensive and accurate tests of whether informant discrepancies predict child and adolescent psychopathology.

Informant discrepancies in adult social anxiety disorder assessments: links with contextual variations in observed behavior

Multi-informant assessments of adult psychopathology often result in discrepancies among informants' reports. Among 157 adults meeting criteria for either the generalized (n = 106) or nongeneralized (n = 51) social anxiety disorder (SAD) subtype, we examined whether discrepancies between patients' and clinicians' reports of patients' symptoms related to variations in both SAD subtype and expressions of social skills deficits across multiple social interaction tasks. Latent class analyses revealed two behavioral patterns: (a) context-specific social skills deficits and (b) cross-context social skills deficits. Similarly, patients' symptom reports could be characterized by concordance or discordance with clinicians' reports. Patient-clinician concordance on relatively high levels of patients' symptoms related to an increased likelihood of the patient meeting criteria for the generalized relative to nongeneralized subtype. Further, patient-clinician concordance on relatively high levels of patients' symptoms related to an increased likelihood of consistently exhibiting social skills deficits across social interaction tasks (relative to context-specific social skills deficits). These relations were robust in accounting for patient age, clinical severity, and Axis I and II comorbidity. Further, clinical severity did not completely explain variability in patients' behavior on laboratory tasks or discrepancies between patient and clinician reports. Findings provide the first laboratory-based support for the ability of informant discrepancies to indicate cross-contextual variability in clinical adult assessments, and the first of any developmental period to indicate this for SAD assessments. These findings have important implications for clinical assessment and developmental psychopathology research.

An Experimental Test of Whether Informants can Report About Child and Family Behavior Based on Settings of Behavioral Expression

Researchers and practitioners conduct multi-informant assessments of child and family behavior under the assumption that informants have unique perspectives on these behaviors. These unique perspectives stem, in part, from differences among informants in the settings in which they observe behaviors (e.g., home, school, peer interactions). These differences are assumed to contribute to the discrepancies commonly observed in the outcomes of multi-informant assessments. Although assessments often prompt informants to think about setting-specific behaviors when providing reports about child and family behavior, the notion that differences in setting-based behavioral observations contribute to discrepant reports has yet to be experimentally tested. We trained informants to use setting information as the basis for providing behavioral reports, with a focus on parental knowledge of children's whereabouts and activities. Using a within-subjects controlled design, we randomly assigned 16 mothers and adolescents to the order in which they received a program that trains informants to use setting information when providing parental knowledge reports (Setting-Sensitive Assessment), and a control program involving no training on how to provide reports. Relative to the control program, the Setting-Sensitive Assessment training increased the differences between mother and adolescent reports of parental knowledge, suggesting that mothers and adolescents observe parental knowledge behaviors in different settings. This study provides the first experimental evidence to support the assumption that discrepancies arise because informants incorporate unique setting information into their reports.

Maternal depression and treatment gains following a cognitive behavioral intervention for posttraumatic stress in preschool children

The evidence base for cognitive behavioral therapy (CBT) to treat child emotional and behavioral symptoms following exposure to trauma in youth is compelling, but relatively few studies are available on preschool children and on moderators of treatment outcomes. This paper examines maternal and child characteristics as moderators of posttraumatic stress (PTS) treatment outcomes in preschool children. Outcome data from a previously published randomized trial in three to six year old preschool children with diagnostic interview data from participating mothers were used. Hypotheses were tested via hierarchical linear modeling. Maternal depression was associated with higher initial child posttraumatic stress disorder (PTSD) symptoms, and was associated with increasing PTSD symptom trends at follow up suggesting potential child PTSD symptom relapse. Maternal PTSD symptoms similarly predicted differential child separation anxiety symptom change but not child PTSD symptom change. Targeting dyads with child PTSD symptoms and maternal depression or PTSD symptoms with enhanced interventions may be a useful strategy to improve treatment maintenance.

Principles underlying the use of multiple informants' reports

Researchers use multiple informants' reports to assess and examine behavior. However, informants' reports commonly disagree. Informants' reports often disagree in their perceived levels of a behavior ("low" versus "elevated" mood), and examining multiple reports in a single study often results in inconsistent findings. Although researchers often espouse taking a multi-informant assessment approach, they frequently address informant discrepancies using techniques that treat discrepancies as measurement error. Yet, recent work indicates that researchers in a variety of fields often may be unable to justify treating informant discrepancies as measurement error. In this review, the authors advance a framework (Operations Triad Model) outlining general principles for using and interpreting informants' reports. Using the framework, researchers can test whether or not they can extract meaningful information about behavior from discrepancies among multiple informants' reports. The authors provide supportive evidence for this framework and discuss its implications for hypothesis testing, study design, and quantitative review.

"It Depends on What You Mean by 'Disagree'": Differences between Parent and Child Perceptions of Parent-Child Conflict

We examined a new structured interview of parent-child conflict that assesses parent and child perceptions of behavioral conflict about daily life topics (e.g., doing chores, homework), and whether discrepancies exist on beliefs about these topics. In a sample of 100 parents and children ages 10 to 17 years (M=13.5 years, 52 males, 57 % African-American), informants could reliably distinguish between perceived behavioral conflicts and perceived discrepant beliefs about topics. These scores were also significantly related to questionnaire reports of parent-child conflict. Parent and child questionnaire reports did not significantly differ, yet on the structured interview, parents reported significantly greater levels of perceived conflict and discrepant beliefs relative to child reports. Additionally, structured interview reports of conflict demonstrated incremental validity by relating to child self-reports of delinquent behaviors, when accounting for questionnaire conflict reports. The findings have implications for increasing understanding of the links between parent-child conflict and psychosocial outcomes.

Testing informant discrepancies as predictors of early adolescent psychopathology: why difference scores cannot tell you what you want to know and how polynomial regression may

Multiple informants commonly disagree when reporting child and family behavior. In many studies of informant discrepancies, researchers take the difference between two informants' reports and seek to examine the link between this difference score and external constructs (e.g., child maladjustment). In this paper, we review two reasons why difference scores cannot serve as unambiguous predictors of outcomes. Further, we use polynomial regression analyses to both test the validity of difference scores and provide a more direct test of the hypothesis that discrepancies in parent and child reports predict child psychopathology. Data from 218 parent-adolescent dyads (M adolescent age = 11.5 years, 51 % female; 49 % European American, 47 % African American) were used to predict adolescent-reported antisocial behavior and depression from parent and adolescent reports of parent-adolescent conflict, parental knowledge, parental acceptance, adolescent rule-breaking behavior, and adolescent pubertal development. Results demonstrate that analyses using difference scores do not provide valid tests of the utility of informant discrepancies in predicting adolescent psychosocial maladjustment. However, interaction terms in polynomial regression analyses provide evidence that informant discrepancies predict child psychopathology. Parent-adolescent informant discrepancies predict adolescent psychopathology but researchers should avoid using difference scores to measure informant discrepancies. Polynomial regression analyses provide more comprehensive and accurate tests of whether informant discrepancies predict child and adolescent psychopathology.

Annual research review: embracing not erasing contextual variability in children's behavior--theory and utility in the selection and use of methods and informants in developmental psychopathology

This paper examines the selection and use of multiple methods and informants for the assessment of disruptive behavior syndromes and attention deficit/hyperactivity disorder, providing a critical discussion of (a) the bidirectional linkages between theoretical models of childhood psychopathology and current assessment techniques; and (b) current knowledge concerning the utility of different methods and informants for key clinical goals. There is growing recognition that children's behavior varies meaningfully across situations, and evidence indicates that these differences, in combination with informants' unique perspectives, are at least partly responsible for inter-rater discrepancies in reports of symptomatology. Such data suggest that we should embrace this contextual variability as clinically meaningful information, moving away from models of psychopathology as generalized traits that manifest uniformly across situations and settings, and toward theoretical conceptualizations that explicitly incorporate contextual features, such as considering clinical syndromes identified by different informants to be discrete phenomena. We highlight different approaches to measurement that embrace contextual variability in children's behavior and describe how the use of such tools and techniques may yield significant gains clinically (e.g., for treatment planning and monitoring). The continued development of a variety of feasible, contextually sensitive methods for assessing children's behavior will allow us to determine further the validity of incorporating contextual features into models of developmental psychopathology and nosological frameworks.

Adolescent and parent experiences with a primary care/Internet-based depression prevention intervention (CATCH-IT)

This article describes a mixed-methods approach to understand the experience of adolescents involved in the Internet-based intervention for depression, Competent Adulthood Transition with Cognitive Behavioral Humanistic and Interpersonal Training (CATCH-IT), as well as the experiences of their parents while they were involved. Qualitative analysis was done with grounded theory-based categorization of interview comments and typed program responses (adolescents only) into themes. Quantitative analysis was done with self-report surveys. The article describes the nine themes reflecting the adolescent experience and the three themes reflecting the parent experience. The article also describes the results of the quantitative surveys of helpfulness and attitudes change, which were favorable of the Internet-based intervention. Separate models explaining the psychological transformation of the adolescents and the experience of the parents are proposed. The positive experience of the adolescents and parents involved in CATCH-IT is discussed in the context of growing interest in how best to utilize Internet-based interventions for mental illness, and suggestions are made for future investigation.

Informant discrepancies in clinical reports of youths and interviewers' impressions of the reliability of informants

OBJECTIVE

In this study the authors examined whether discrepancies between parent and youth reports of the youth's emotional and behavioral functioning are related to interviewers' reliability ratings of parents and youths.

METHODS

In a consecutive case series analysis of 328 parents and youths aged 11-17 years, parents and youths provided reports of youth emotional and behavioral functioning and participated in structured clinical interviews. At the conclusion of the interviews, interviewers rated the reliability of informants. Interviewers rated youths' clinical severity and parents and youths provided information on youth demographics. Nominal logistic regressions tested patterns of discrepancies between parent and youth reports (i.e., which informant consistently reported greater degrees of youth emotional and behavioral concerns than the other) as predictors of interviewers' ratings of the reliability of parents and youths. All analyses controlled for variance explained by youth demographics and youth severity.

RESULTS

When parents reported greater degrees of youth emotional and behavioral concerns than youths self-reported, interviewers were likely to rate the youth as an unreliable informant, and were unlikely to rate the youth as an unreliable informant when parents reported less concerns than youths self-reported. However, interviewers' ratings of parents' reliability did not relate to the discrepancies between reports, regardless of which informant reported greater degrees of youth concerns.

CONCLUSIONS

Prior research indicates that informant discrepancies potentially reveal important information of youths' emotional and behavioral concerns, such as the settings in which youths express these concerns. Yet, when parents and youths disagree in their clinical reports of the youth's functioning, this relates to whether a clinical interviewer views the youth as a reliable informant of their own functioning. To increase the cost-effectiveness and clinical utility of multi-informant clinical evaluations, practitioners and researchers should anticipate informant discrepancies and predict what they may represent before conducting clinical evaluations.

Are clinicians' assessments of improvements in children's functioning "global"?

In this study, the authors examined the relations among clinician ratings of treatment improvement and discrepancies between parent and blinded laboratory rater reports of child social functioning administered before and after treatment for social anxiety disorder. Participants included a clinic sample of 101 children (7-16 years old; M = 11.67, SD = 2.57; 51 girls, 81% Caucasian) receiving treatment as part of a two-site controlled trial. Overall, clinician ratings reflected lack of improvement when parents reported persistent (i.e., pre- to posttreament) social functioning deficits not reported by blinded raters. However, when blinded raters reported persistent social skill deficits not reported by parents, we did not observe the same effect on clinician ratings as we did when the direction of discrepant reports was reversed. We replicated these observations in a subset of participants (n = 81) providing parent and child pre-post reports of social anxiety symptoms. These findings have implications for the interpretations of clinical ratings as "primary outcome measures" within controlled trials.