Thresholds and accuracy in screening tools for early detection of psychopathology

Operationalizing Primary Outcomes to Achieve Reach, Effectiveness, and Equity in Multilevel Interventions

When intervention scientists plan a clinical trial of an intervention, they select an outcome metric that operationalizes their definition of intervention success. The outcome metric that is selected has important implications for which interventions are eventually supported for implementation at scale and, therefore, what health benefits (including how much benefit and for whom) are experienced in a population. Particularly when an intervention is to be implemented in a population that experiences a health disparity, the outcome metric that is selected can also have implications for equity. Some outcome metrics risk exacerbating an existing health disparity, while others may decrease disparities for some but have less effect for the larger population. In this study, we use a computer to simulate implementation of a hypothetical multilevel, multicomponent intervention to highlight the tradeoffs that can occur between outcome metrics that reflect different operationalizations of intervention success. In particular, we highlight tradeoffs between overall mean population benefit and the distribution of health benefits in the population, which has direct implications for equity. We suggest that simulations like the one we present can be useful in the planning of a clinical trial for a multilevel and/or multicomponent intervention, since simulated implementation at scale can illustrate potential consequences of candidate operationalization of intervention success, such that unintended consequences for equity can be avoided.

The influence of loss to follow-up in autism screening research: Taking stock and moving forward

BACKGROUND

How best to improve the early detection of autism spectrum disorder (ASD) is the subject of significant controversy. Some argue that universal ASD screeners are highly accurate, whereas others argue that evidence for this claim is insufficient. Relatedly, there is no clear consensus as to the optimal role of screening for making referral decisions for evaluation and treatment. Published screening research can meaningfully inform these questions-but only through careful consideration of children who do not complete diagnostic follow-up.

METHODS

We developed two simulation models that re-analyze the results of a large-scale validation study of the M-CHAT-R/F by Robins et al. (2014, Pediatrics, 133, 37). Model #1 re-analyzes screener accuracy across six scenarios, each reflecting different assumptions regarding loss to follow-up. Model #2 builds on this by closely examining differential attrition at each point of the multi-step detection process.

RESULTS

Estimates of sensitivity ranged from 40% to 94% across scenarios, demonstrating that estimates of accuracy depend on assumptions regarding the diagnostic status of children who were lost to follow-up. Across a range of plausible assumptions, data also suggest that children with undiagnosed ASD may be more likely to complete follow-up than children without ASD, highlighting the role of clinicians and caregivers in the detection process.

CONCLUSIONS

Using simulation modeling as a quantitative method to examine potential bias in screening studies, analyses suggest that ASD screening tools may be less accurate than is often reported. Models also demonstrate the critical importance of every step in a detection process-including steps that determine whether children should complete an additional evaluation. We conclude that parent and clinician decision-making regarding follow-up may contribute more to detection than is widely assumed.

Noninvasive monitoring technologies to identify discomfort and distressing symptoms in persons with limited communication at the end of life: a scoping review

BACKGROUND

Discomfort and distressing symptoms are common at the end of life, while people in this stage are often no longer able to express themselves. Technologies may aid clinicians in detecting and treating these symptoms to improve end-of-life care. This review provides an overview of noninvasive monitoring technologies that may be applied to persons with limited communication at the end of life to identify discomfort.

METHODS

A systematic search was performed in nine databases, and experts were consulted. Manuscripts were included if they were written in English, Dutch, German, French, Japanese or Chinese, if the monitoring technology measured discomfort or distressing symptoms, was noninvasive, could be continuously administered for 4 hours and was potentially applicable for bed-ridden people. The screening was performed by two researchers independently. Information about the technology, its clinimetrics (validity, reliability, sensitivity, specificity, responsiveness), acceptability, and feasibility were extracted.

RESULTS

Of the 3,414 identified manuscripts, 229 met the eligibility criteria. A variety of monitoring technologies were identified, including actigraphy, brain activity monitoring, electrocardiography, electrodermal activity monitoring, surface electromyography, incontinence sensors, multimodal systems, and noncontact monitoring systems. The main indicators of discomfort monitored by these technologies were sleep, level of consciousness, risk of pressure ulcers, urinary incontinence, agitation, and pain. For the end-of-life phase, brain activity monitors could be helpful and acceptable to monitor the level of consciousness during palliative sedation. However, no manuscripts have reported on the clinimetrics, feasibility, and acceptability of the other technologies for the end-of-life phase.

CONCLUSIONS

Noninvasive monitoring technologies are available to measure common symptoms at the end of life. Future research should evaluate the quality of evidence provided by existing studies and investigate the feasibility, acceptability, and usefulness of these technologies in the end-of-life setting. Guidelines for studies on healthcare technologies should be better implemented and further developed.

Mental Health and Well-being Measures for Mean Comparison and Screening in Adolescents: An Assessment of Unidimensionality and Sex and Age Measurement Invariance

Adolescence is a period of increased vulnerability for low well-being and mental health problems, particularly for girls and older adolescents. Accurate measurement via brief self-report is therefore vital to understanding prevalence, group trends, screening efforts, and response to intervention. We drew on data from the #BeeWell study (N = 37,149, aged 12-15) to consider whether sum-scoring, mean comparisons, and deployment for screening were likely to show bias for eight such measures. Evidence for unidimensionality, considering dynamic fit confirmatory factor models, exploratory graph analysis, and bifactor modeling, was found for five measures. Of these five, most showed a degree of non-invariance across sex and age likely incompatible with mean comparison. Effects on selection were minimal, except sensitivity was substantially lower in boys for the internalizing symptoms measure. Measure-specific insights are discussed, as are general issues highlighted by our analysis, such as item reversals and measurement invariance.

When to hold and when to fold: Early prediction of nonresponse to transcranial magnetic stimulation in major depressive disorder

BACKGROUND

Determining when to recommend a change in treatment regimen due to insufficient improvement is a common challenge in therapeutics.

METHODS

In a sample of 7215 patients with major depressive disorder treated with transcranial magnetic stimulation (TMS) and with PHQ-9 scores before, during and after the course, 3 groups were identified based on number of acute course sessions: exactly 36 sessions (N = 3591), more than 36 sessions (N = 975), and less than 36 sessions (N = 2649). Two techniques were used to determine thresholds for percentage change in PHQ-9 scores at assessments after 10, 20, and 30 sessions that optimized prediction of endpoint response status: the Youden index and fixing the false positive rate at 10%. Positive and negative predictive values were calculated to assess the accuracy of identifying final nonresponders and responders, respectively.

RESULTS

There was greater accuracy in predicting final response than nonresponse, especially in the groups that had at least 36 sessions. Substantial proportions of patients with low levels of early improvement were classified as responders at the end of treatment.

LIMITATIONS

The findings should be validated with clinician ratings using a more comprehensive depression severity scale.

CONCLUSIONS

Manifesting clinical improvement early in the TMS course is strongly predictive of final status as a responder, while lack of early improvement is a relatively poor indicator of final nonresponse status. The predictive value of lack of early symptomatic improvement is too low to make reliable recommendations regarding changes in treatment regimen.

Suicidal ideation and its relationship with mental health reported by different informants among children aged 6-12

BACKGROUND

Suicidal ideation in children has received less attention than in adolescents. This study aimed to explore the self-reported prevalence of suicidal ideation among children aged 6-12 and to identify the relationship between self-reported suicidal ideation and children's mental health reported by different informants in Chinese setting.

METHOD

The study sample was 1479 children aged 6-12 from three elementary schools in Tianjin. Children completed the Dominic Interactive to report their mental health and suicidal ideation. Parents and teachers completed the Socio-Demographic Questionnaire and the Strengths and Difficulties Questionnaire (SDQ).

RESULTS

The prevalence of suicidal thoughts and death thoughts was 18.05 % and 16.90 %, respectively. Parent reported emotional symptoms, ADHD and externalized problems were associated with death thoughts, and ADHD was associated with suicidal thoughts. For teacher's reports, emotional symptoms, and impact were associated with death thoughts, and ADHD, peer problems, internalized problems, and internalized and externalized comorbidity were associated with suicidal thoughts. All of the children's self-reported mental health problems were associated with suicidal thoughts and death thoughts.

LIMITATIONS

Causality cannot be inferred in a cross-sectional study.

CONCLUSION

Suicidal ideation is not uncommon in Chinese children. The relationships between mental health problems and suicidal ideation varied in different informants. Suicide prevention in young children should be enhanced, and screening for suicidal ideation is recommended at the onset of different informants who reported specific mental health problems.

Effectiveness of Screening in Early Intervention Settings to Improve Diagnosis of Autism and Reduce Health Disparities

IMPORTANCE

The American Academy of Pediatrics recommends referring children at elevated risk of autism spectrum disorder (ASD) for Part C early intervention (EI) services, but notes that EI services often fail to provide ASD screening.

OBJECTIVE

To evaluate the hypothesis that a multistage screening protocol for ASD implemented in 3 EI settings will increase autism detection, especially among Spanish-speaking families.

DESIGN, SETTING, AND PARTICIPANTS

Difference-in-differences analyses with propensity score weighting of a quasi-experimental design using administrative data on 3 implementation EI agencies and 9 comparison EI agencies from 2012 to 2018 provided by the Massachusetts Department of Public Health. Eligible children were aged 14 to 36 months, enrolled in EI, had no prior ASD diagnosis or medical condition precluding participation, and had parents who spoke English or Spanish. The final analytic sample included 33 326 unique patients assessed across 150 200 person-quarters.

EXPOSURES

Multistage ASD assessment protocol including ASD screening questionnaires, observational screener, and diagnostic evaluation.

MAIN OUTCOMES AND MEASURES

Increased incidence of ASD diagnoses as documented in Department of Public Health records and reductions in language-associated health care disparities.

RESULTS

Implementation of screening at 3 EI sites was associated with a significant increase in the rate of ASD diagnoses (incidence rate ratios [IRR], 1.6; 95% CI, 1.3-2.1; P < .001), representing an additional 8.1 diagnoses per 1000 children per quarter. Among Spanish-speaking families, screening was also associated with a significant increase in the rate of ASD diagnoses (IRR, 2.6; 95% CI, 1.6-4.3; P < .001), representing 15.4 additional diagnoses per 1000 children per quarter-a larger increase than for non-Spanish-speaking families (interaction IRR, 1.8; 95% CI, 1.0-3.1; P = .005). Exploratory analyses revealed that screening was associated with a larger increase in the rate of ASD diagnoses among boys (IRR, 1.8; 95% CI, 1.4-2.3; P < .001) than among girls (IRR, 1.1; 95% CI, 0.6-1.7; P = .84).

CONCLUSIONS AND RELEVANCE

In this study, associations between increased rates of ASD diagnoses and reductions in disparities for Spanish-speaking households support the effectiveness of multistage screening in EI. This study provides a comprehensive evaluation of ASD screening in EI settings as well as a rigorous evaluation of ASD screening in any setting with a no-screening comparison condition. Given that the intervention included multiple components, mechanisms of action warrant further research, as do disparities by child sex.

The Long-Term Outcomes of Prepubertal Depression and Internalizing Problems: A Scoping Review

LEARNING OBJECTIVES

After participating in this activity, learners should be better able to:• Discuss whether prepubertal depression shows longitudinal continuity with depression in adulthood.• Summarize existing literature on adult emotional and functional outcomes of prepubertal depression and internalizing problems.

BACKGROUND

Adolescent- and young adult-onset depression are common, recurrent, and can cause significant distress and psychosocial impairment across the life span, but recognition of prepubertal internalizing problems and depression, along with their prevalence, clinical course, and long-term outcomes, remains elusive.

OBJECTIVE

To examine whether prepubertal depression, which can manifest differently from adult depression, shows longitudinal continuity with depression in adulthood, and to summarize existing literature on adult emotional and functional outcomes of prepubertal depression and internalizing problems.

METHODS

A scoping review was conducted for peer-reviewed cohort articles published between 2000 and 2020 using PubMed and PsycINFO. From 4309 identified references, 17 articles were included.

RESULTS

Prepubertal depression confers increased risk of recurrence of depression in adulthood, with similar findings for prepubertal internalizing problems. No studies found prepubertal depression or internalizing problems predicting adult substance abuse, and no studies asked about adult bipolar diagnoses. More research is needed to draw clear conclusions regarding their implications for other psychiatric, medical, or psychosocial outcomes.

CONCLUSION

The reviewed studies provide limited evidence that prepubertal depression onset predicts adult depression. The small evidence base and heterogeneous methodological assessments may limit, however, the ability to draw meaningful conclusions about the long-term course of prepubertal-onset depression. Well-designed studies with longer follow-up and multiple assessments in adulthood are needed to clarify and assess the potential effects of prepubertal depression on adult health and functioning. This information will eventually become available as the samples in recently initiated longitudinal cohort studies of children mature further.

Children born to women in opioid maintenance treatment: A longitudinal study of child behavioral problems and parenting stress

In the wake of the "opioid epidemic", there is considerable concern regarding potential harmful long-term effects of prenatal opioid exposure. Opioid misuse and addiction confer increased exposure to lifestyle stressors and health burdens. Accordingly, it is challenging to disentangle effects of prenatal opioid exposure per se from factors related to maternal stress. In this study, we followed 36 women enrolled in comprehensive opioid maintenance treatment (OMT) program and their children alongside 36 age-matched mother-child dyads from a community sample (COMP) from pregnancy until child-age 8 years. Across five sessions, we used a battery of well-established questionnaires to investigate trajectories of parenting stress and mental health symptoms as well as child behavior problems. The 8-year retention was relatively high (OMT: 72%, COMP: 67%), and the OMT sample remarkably stable and well-functioning, with minimal concomitant illicit drug use. Mixed effects regressions showed significantly different trajectories of child behavior problems (F = 3.8, p = 0.024) and parenting stress (F = 3.1, p = 0.016) in the two groups. Differences in experienced stress were largely explained by more distress specifically related to the parenting role in the OMT group (F = 9.7, p = 0.003). The OMT sample also reported higher psychological distress (F = 15.6, p < 0.001) than the comparison group, but notably few participants presented with problems that warranted clinical intervention. The results underscore the benefits of tailored follow-up of children prenatally exposed to opioids and their families beyond infancy and toddlerhood. Long-term direct effects of prenatal opioid exposure on behavior problems are likely modest, given an otherwise stable caregiving environment conducive to healthy development.

Behavioural abnormalities among school-age children living with HIV at Tikur Anbessa Specialized Hospital, Addis Ababa, Ethiopia

Background: The human immunodeficiency virus infection has manifestations causing behavioural and cognitive abnormalities among children. The aim of this study was to assess the magnitude and correlates of behavioural abnormalities among school-age children living with HIV attending follow-up at the Pediatric Infectious Diseases Clinic of Tikur Anbessa Specialized Hospital in Addis Ababa, Ethiopia.Methods: A sample of 251 children and their primary caregivers were included in this study. The Strengths and Difficulties Questionnaire was used to assess behavioural abnormalities. Descriptive statistics and bivariate analysis using logistic regression were done to assess the determinants of abnormal behaviour scores.Results: The overall prevalence of any form of behavioural abnormalities was 49%. The prevalence of emotional symptoms was 31.5%, peer problems 21.5% and hyperactivity deficit was 13.1%. Children residing out of Addis Ababa, the capital city (AOR 0.18; 95% CI 0.03-0.94), children having both parents (AOR 0.29; 95% CI 0.12-0.70) and children having either of their parents (AOR 0.39; 95% CI 0.18-0.83) were less likely to have behavioural abnormalities. Moreover, children whose primary caregivers had elementary education or lower were more likely to have any form of behavioural abnormalities (AOR 2.44; 95% CI 1.05-5.69)Conclusions: The magnitude of behavioural abnormalities among children living with HIV is substantial. We recommend that children living with HIV, particularly those with parental losses and those having less-educated primary caregivers, be closely monitored for behavioural problems.

Rapid-cycle systems modeling to support evidence-informed decision-making during system-wide implementation

Background

To “model and simulate change” is an accepted strategy to support implementation at scale. Much like a power analysis can inform decisions about study design, simulation models offer an analytic strategy to synthesize evidence that informs decisions regarding implementation of evidence-based interventions. However, simulation modeling is under-utilized in implementation science. To realize the potential of simulation modeling as an implementation strategy, additional methods are required to assist stakeholders to use models to examine underlying assumptions, consider alternative strategies, and anticipate downstream consequences of implementation. To this end, we propose Rapid-cycle Systems Modeling (RCSM)—a form of group modeling designed to promote engagement with evidence to support implementation. To demonstrate its utility, we provide an illustrative case study with mid-level administrators developing system-wide interventions that aim to identify and treat trauma among children entering foster care.

Methods

RCSM is an iterative method that includes three steps per cycle: (1) identify and prioritize stakeholder questions, (2) develop or refine a simulation model, and (3) engage in dialogue regarding model relevance, insights, and utility for implementation. For the case study, 31 key informants were engaged in step 1, a prior simulation model was adapted for step 2, and six member-checking group interviews (n = 16) were conducted for step 3.

Results

Step 1 engaged qualitative methods to identify and prioritize stakeholder questions, specifically identifying a set of inter-related decisions to promote implementing trauma-informed screening. In step 2, the research team created a presentation to communicate key findings from the simulation model that addressed decisions about programmatic reach, optimal screening thresholds to balance demand for treatment with supply, capacity to start-up and sustain screening, and availability of downstream capacity to provide treatment for those with indicated need. In step 3, member-checking group interviews with stakeholders documented the relevance of the model results to implementation decisions, insight regarding opportunities to improve system performance, and potential to inform conversations regarding anticipated implications of implementation choices.

Conclusions

By embedding simulation modeling in a process of stakeholder engagement, RCSM offers guidance to realize the potential of modeling not only as an analytic strategy, but also as an implementation strategy.

Overview of Ten Child Mental Health Clinical Outcome Measures: Testing of Psychometric Properties with Diverse Client Populations in the U.S

While many standardized assessment measures exist to track child mental health treatment outcomes, the degree to which such tools have been adequately tested for reliability and validity across race, ethnicity, and class is uneven. This paper examines the corpus of published tests of psychometric properties for the ten standardized measures used in U.S. child outpatient care, with focus on breadth of testing across these domains. Our goal is to assist care providers, researchers, and legislators in understanding how cultural mismatch impacts measurement accuracy and how to select tools appropriate to the characteristics of their client populations. We also highlight avenues of needed research for measures that are in common use. The list of measures was compiled from (1) U.S. state Department of Mental Health websites; (2) a survey of California county behavioral health agency directors; and (3) exploratory literature scans of published research. Ten measures met inclusion criteria; for each one a systematic review of psychometrics literature was conducted. Diversity of participant research samples was examined as well as differences in reliability and validity by gender, race or ethnicity, and socio-economic class. All measures showed adequate reliability and validity, however half lacked diverse testing across all three domains and all lacked testing with Asian American/Pacific Islander and Native American children. ASEBA, PSC, and SDQ had the broadest testing.

Screening for distress and needs: Findings from a multinational validation of the Adolescent and Young Adult Psycho-Oncology Screening Tool with newly diagnosed patients

OBJECTIVE

Adolescents and young adults (AYAs) diagnosed with cancer commonly experience elevated psychological distress and need appropriate detection and management of the psychosocial impact of their illness and treatment. This paper describes the multinational validation of the Distress Thermometer (DT) for AYAs recently diagnosed with cancer and the relationship between distress and patient concerns on the AYA-Needs Assessment (AYA-NA).

METHODS

AYA patients (N = 288; 15-29 years, M_age  = 21.5 years, SD_age  = 3.8) from Australia (n = 111), Canada (n = 67), the UK (n = 85) and the USA (n = 25) completed the DT, AYA-NA, Hospital Anxiety Depression Scale (HADS) and demographic measures within 3 months of diagnosis. Using the HADS as a criterion, receiver operating characteristics analysis was used to determine the optimal cut-off score and meet the acceptable level of 0.70 for sensitivity and specificity. Correlations between the DT and HADS scores, prevalence of distress and AYA-NA scores were reported.

RESULTS

The DT correlated strongly with the HADS-Total, providing construct validity evidence (r = 0.65, p < 0.001). A score of 5 resulted in the best clinical screening cut-off on the DT (sensitivity = 82%, specificity = 75%, Youden Index = 0.57). Forty-two percent of AYAs scored at or above 5. 'Loss of meaning or purpose' was the AYA-NA item most likely to differentiate distressed AYAs.

CONCLUSIONS

The DT is a valid distress screening instrument for AYAs with cancer. The AYA-POST (DT and AYA-NA) provides clinicians with a critical tool to assess the psychosocial well-being of this group, allowing for the provision of personalised support and care responsive to individuals' specific needs and concerns.

The decision sampling framework: a methodological approach to investigate evidence use in policy and programmatic innovation

Background

Calls have been made for greater application of the decision sciences to investigate and improve use of research evidence in mental health policy and practice. This article proposes a novel method, “decision sampling,” to improve the study of decision-making and research evidence use in policy and programmatic innovation. An illustrative case study applies the decision sampling framework to investigate the decisions made by mid-level administrators when developing system-wide interventions to identify and treat the trauma of children entering foster care.

Methods

Decision sampling grounds qualitative inquiry in decision analysis to elicit information about the decision-making process. Our case study engaged mid-level managers in public sector agencies (n = 32) from 12 states, anchoring responses on a recent index decision regarding universal trauma screening for children entering foster care. Qualitative semi-structured interviews inquired on questions aligned with key components of decision analysis, systematically collecting information on the index decisions, choices considered, information synthesized, expertise accessed, and ultimately the values expressed when selecting among available alternatives.

Results

Findings resulted in identification of a case-specific decision set, gaps in available evidence across the decision set, and an understanding of the values that guided decision-making. Specifically, respondents described 14 inter-related decision points summarized in five domains for adoption of universal trauma screening protocols, including (1) reach of the screening protocol, (2) content of the screening tool, (3) threshold for referral, (4) resources for screening startup and sustainment, and (5) system capacity to respond to identified needs. Respondents engaged a continuum of information that ranged from anecdote to research evidence, synthesizing multiple types of knowledge with their expertise. Policy, clinical, and delivery system experts were consulted to help address gaps in available information, prioritize specific information, and assess “fit to context.” The role of values was revealed as participants evaluated potential trade-offs and selected among policy alternatives.

Conclusions

The decision sampling framework is a novel methodological approach to investigate the decision-making process and ultimately aims to inform the development of future dissemination and implementation strategies by identifying the evidence gaps and values expressed by the decision-makers, themselves.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-021-01084-5.

Are Developmental Monitoring and Screening Better Together for Early Autism Identification Across Race and Ethnic Groups?

National Surveys of Children's Health (NSCH, 2016-2018) data were analyzed to determine if conjoint monitoring and screening showed stronger associations with children under 5 identified with ASD compared to monitoring alone, screening alone or no monitoring or screening; and investigate relationships between monitoring and screening across racial/ethnic subgroups. 86 of 332 children with ASD received their diagnosis in a timeframe suggesting potential monitoring and screening for identification purposes. Analyses showed that conjoint monitoring and screening and monitoring alone, but not screening alone, was associated with early identified ASD cases across race groups. Caution is warranted as interpreting NSCH monitoring and screening items solely for identification purposes is inaccurate in many cases. More research on monitoring with screening is needed.

Teacher Nominations of Preschool Children at Risk for Mental Health Problems: how False Is a False Positive Nomination and What Make Teachers Concerned?

Identification attempts in populations with a low prevalence of problems usually result in a considerable number of false positives. Thus, the aim of the current study was to investigate the false positive rate following nomination of developmental concerns by preschool teachers and the reasons for which teachers raise developmental concerns about children who display non-clinical levels of mental health problems.A total of 1430 children aged 1 to 6 years in Norwegian childcare centers were classified as true positive, false positive, true negative, or false negative by comparing preschool teachers’ nomination with their ratings on the Caregiver-Teacher Report Form, resulting in 127 (9%) false positives and 1142 (80%) true negatives.Compared to the true negative group, the false positive group received significantly higher scores on internalizing problems, externalizing problems than true negatives, conflict and significantly lower scores on closeness. Children’s internalizing and externalizing problems and age were the main factors that increased the likelihood of teachers raising concerns, while increased closeness in the teacher-child relationship reduced the likelihood of being nominated. Children’s gender and conflict level were not significant when adjusting for other factors.These findings suggest that preschool teachers’ concerns about children’s development should not be discarded as the false positive group did show elevated levels of problem behavior and poorer teacher-child relationship compared to the true negative group. Scrutinizing concerns in collaboration with parents and other mental health professionals may be beneficial to ensure healthy development for children with elevated problem levels.

Brief Report: Use of the Infant-Toddler Checklist in Infant Siblings of Children with Autism Spectrum Disorder

Few studies have explored autism spectrum disorder (ASD) screening in the first year of life. The current investigation examines the psychometric properties of the Infant-Toddler Checklist starting in the first year of life in a sample at elevated and average risk for ASD based on family history. 283 participants were followed from 6 to 36 months, when diagnostic outcome was determined. The results indicated low to moderate sensitivity, specificity, and positive predictive value across ages for broadly distinguishing any delays from typical development, as well as for more narrowly discriminating children with ASD from those who were typically developing. Implications for utilizing ASD screening tools in the first year of life with high risk samples are discussed.

Implications of adverse childhood experiences screening on behavioral health services: A scoping review and systems modeling analysis

Widespread implementation of adverse childhood experiences (ACEs) screening is occurring in the United States in response to policies and practice recommendations. However, limited research has established how these screening efforts impact the health care system and ultimately health outcomes. This article examines the current knowledge base on screening in medical settings. A scoping review of articles reporting on ACEs screening and prevalence in the United States was conducted. Of the 1,643 unique studies across two decades, 12 articles meeting criteria included nine on routine screening in medical settings and three on population-based surveys. A Monte Carlo simulation model was designed to synthesize evidence, identify key areas of uncertainty, and explore service system implications. Results indicated significant heterogeneity in the proportion of respondents who reported ACEs, with 6% to 64% of patients reporting 1+ ACEs and .01% to 40.7% reporting 4+ ACEs. Gaps in the literature were identified regarding cut-scores for referrals and referral completion rates. Three scenarios, modeled based on these data and past research on behavioral health screenings in pediatric primary care, demonstrated how ACEs screening may differentially impact behavioral health care systems. Priorities for future research were highlighted to refine estimates of the likely impact of ACEs screening on health care delivery. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

The development and validation of an algorithm to predict future depression onset in unselected youth

BACKGROUND

Universal depression screening in youth typically focuses on strategies for identifying current distress and impairment. However, these protocols also play a critical role in primary prevention initiatives that depend on correctly estimating future depression risk. Thus, the present study aimed to identify the best screening approach for predicting depression onset in youth.

METHODS

Two multi-wave longitudinal studies (N = 591, AgeM = 11.74; N = 348, AgeM = 12.56) were used as the 'test' and 'validation' datasets among youth who did not present with a history of clinical depression. Youth and caregivers completed inventories for depressive symptoms, adversity exposure (including maternal depression), social/academic impairment, cognitive vulnerabilities (rumination, dysfunctional attitudes, and negative cognitive style), and emotional predispositions (negative and positive affect) at baseline. Subsequently, multi-informant diagnostic interviews were completed every 6 months for 2 years.

RESULTS

Self-reported rumination, social/academic impairment, and negative affect best predicted first depression onsets in youth across both samples. Self- and parent-reported depressive symptoms did not consistently predict depression onset after controlling for other predictors. Youth with high scores on the three inventories were approximately twice as likely to experience a future first depressive episode compared to the sample average. Results suggested that one's likelihood of developing depression could be estimated based on subthreshold and threshold risk scores.

CONCLUSIONS

Most pediatric depression screening protocols assess current manifestations of depressive symptoms. Screening for prospective first onsets of depressive episodes can be better accomplished via an algorithm incorporating rumination, negative affect, and impairment.

Early Detection of Behavioral and Emotional Problems in School-Aged Children and Adolescents: The Parent Questionnaires

Introduction:

Early detection of behavioral and emotional problems in children and adolescents is relevant. For this purpose, the use of questionnaires completed by parents is applicable. Parent questionnaires are also useful preliminary support to the clinical investigation.

Methods:

Validated tools for the analysis of behavioral and emotional problems suitable for school-age subjects are analyzed in their characteristics and possibilities of use.

Results:

The following are the main characteristics of the instruments examined. The Child and Adolescent Symptom Inventory 4&5, Parent Checklist (CASI-4&5) and Behavior Assessment System For Children - Parent Rating Scales 2&3 (BASC-2&3) include a high number of questions, with exploration extended to almost all possible pathologies.

The Child Behavior Check-List (CBCL) has less items (113), but only 48 refer to DSM pathologies. The use of CASI, BASC and CBCL carries a cost because they are copyrighted.

The Pediatric Symptom Checklist (PSC) has 35 items, but only 17 have a reference to 3 clinical areas. The Strength & Difficulties Questionnaire (SDA) is very short (25 items) and concerns only the main externalizing and internalizing disorders. The Child and Adolescent Behavior Inventory (CABI) has 75 items and explores a wide range of psycho-pathological issues, likewise CASI and BASC. PSC, SDA and CABI can be used free of charge.

Conclusion:

The comparison of the characteristics of the aforementioned questionnaires can guide the psychiatrist and the epidemiologist in choosing the most suitable tool for what is proposed to be assessed, in relation to practicability, extension of the areas explored and costs.

Describing the emotional exhaustion, depersonalization, and low personal accomplishment symptoms associated with Maslach Burnout Inventory subscale scores in US physicians: an item response theory analysis

PURPOSE

Current US health policy discussions regarding physician burnout have largely been informed by studies employing the Maslach Burnout Inventory (MBI); yet, there is little in the literature focused on interpreting MBI scores. We described the burnout symptoms and precision associated with MBI scores in US physicians.

METHODS

Using item response theory (IRT) analyses of secondary, cross-sectional survey data, we created response profiles describing the probability of burnout symptoms associated with US physicians' MBI emotional exhaustion (EE), depersonalization (DP), and personal accomplishment (PA) subscale scores. Response profiles were mapped to raw subscale scores and used to predict symptom endorsements at mean scores and commonly used cut-points.

RESULTS

The average US physician was likely to endorse feeling he/she is emotionally drained, used up, frustrated, and working too hard and all PA indicators once weekly or more but was unlikely to endorse feeling any DP symptoms once weekly or more. At the commonly used EE and DP cut-points of 27 and 10, respectively, a physician was unlikely to endorse feeling burned out or any DP symptoms once weekly or more. Each subscale assessed the majority of sample score ranges with ≥ 0.70 reliability.

CONCLUSIONS

We produced a crosswalk mapping raw MBI subscale scores to scaled scores and response profiles calibrated in a US physician sample. Our results can be used to better understand the meaning and precision of MBI scores in US physicians; compare individual/group MBI scores against a reference population of US physicians; and inform the selection of subscale cut-points for defining categorical physician burnout outcomes.

Identification of Preschool Children with Mental Health Problems in Primary Care: Systematic Review and Meta-analysis

OBJECTIVE

Primary care practitioners determine access to care for many preschool children with mental health (MH) problems. This study examined rates of mental health (MH) problem identification in preschoolers within primary healthcare settings, related service use, and MH status at follow-up. The findings may inform evidence-based policy and practice development for preschool MH.

METHOD

For this systematic review, MEDLINE®, EMBASE®, PsycInfo®, and ERIC ® were searched from inception to March 7, 2018 for reports in which a screening measure was used to identify MH problems in children aged 24-72 months, seen in primary and community health care settings. Meta-analyses, using random effects models to provide pooled estimates, were used when three or more studies examined identification rates. Findings on service use and persistence of disorders are summarized.

RESULTS

Thirty-five publications representing 21 studies met the inclusion criteria. MH problems were identified in 17.6% of preschoolers (95% Confidence Interval (CI): 11.1-24.1), Q = 4.9, p > 0.1 by primary/community healthcare practitioners. Psychiatric diagnoses were identified in 18.4% of preschoolers (95% CI: 12.3 - 24.4), Q= 1.6, p > 0.1. Based on three studies, parents of 67-72% of identified children received advice and 26-42% received specialist referrals. In the subset of studies examining persistence of MH disorders, 25-67% of identified children had MH disorders after one to three years.

CONCLUSION

While the identification rate by primary/community practitioners is similar to the diagnostic rate, these may not consistently be the same children. Substantial variability in management and outcomes indicate need for more rigorous evaluation of primary care services for this population.

Combining Two Developmental Screening Tests to Improve Predictive Accuracy

OBJECTIVE

Single developmental screening tests are insufficient for supporting clinical decisions, showing less than 50% of those referred are actually delayed. Combining two tests can address this problem. We used likelihood ratios (LR) to evaluate the predictive value (PV) of combining the Ages and Stages Questionnaires (ASQ) and Parents Evaluation of Developmental Status (PEDS) screening tests.

METHODS

We used data from Limbos and Joyce that included information on the ASQ, PEDS, and an age-appropriate diagnostic assessment of delay on 328 children (ages 12-60 months) drawn from primary care. LRs were calculated for each of the available ASQ/PEDS combinations then rank ordered. PV was examined using different LRs to define referral and nonreferral thresholds.

RESULTS

Setting the referral threshold at LR 2.0 for combined scores decreased the number of false positives from 66 to 28, increased false negatives from 6 to 9 with positive predictive value (PPV) improving significantly from 30% to 47% (P < .05). Sensitivity dropped from 82% to 74% and specificity improved from 72% to 90%. When the LR referral threshold increased, PV improved but an inconclusive group emerged that required more information for decision-making.

CONCLUSIONS

Combining the ASQ and PEDS significantly improved predictive accuracy of a referral in a single threshold analysis. Predictive value improved further as requirements for referral increased and an inconclusive group needing further study was recognized. Systematic research is needed to identify what readily available information will assist decision making in this group.

Comparative Accuracy of Developmental Screening Questionnaires

Importance

Universal developmental screening is widely recommended, yet studies of the accuracy of commonly used questionnaires reveal mixed results, and previous comparisons of these questionnaires are hampered by important methodological differences across studies.

Objective

To compare the accuracy of 3 developmental screening instruments as standardized tests of developmental status.

Design, Setting, and Participants

This cross-sectional diagnostic accuracy study recruited consecutive parents in waiting rooms at 10 pediatric primary care offices in eastern Massachusetts between October 1, 2013, and January 31, 2017. Parents were included if they were sufficiently literate in the English or Spanish language to complete a packet of screening questionnaires and if their child was of eligible age. Parents completed all questionnaires in counterbalanced order. Participants who screened positive on any questionnaire plus 10% of those who screened negative on all questionnaires (chosen at random) were invited to complete developmental testing. Analyses were weighted for sampling and nonresponse and were conducted from October 1, 2013, to January 31, 2017.

Exposures

The 3 screening instruments used were the Ages & Stages Questionnaire, Third Edition (ASQ-3); Parents' Evaluation of Developmental Status (PEDS); and Survey of Well-being of Young Children (SWYC): Milestones.

Main Outcomes and Measures

Reference tests administered were Bayley Scales of Infant and Toddler Development, Third Edition, for children aged 0 to 42 months, and Differential Ability Scales, Second Edition, for older children. Age-standardized scores were used as indicators of mild (80-89), moderate (70-79), or severe (<70) delays.

Results

A total of 1495 families of children aged 9 months to 5.5 years participated. The mean (SD) age of the children at enrollment was 2.6 (1.3) years, and 779 (52.1%) were male. Parent respondents were primarily female (1325 [88.7%]), with a mean (SD) age of 33.4 (6.3) years. Of the 20.5% to 29.0% of children with a positive score on each questionnaire, 35% to 60% also received a positive score on a second questionnaire, demonstrating moderate co-occurrence. Among younger children (<42 months), the specificity of the ASQ-3 (89.4%; 95% CI, 85.9%-92.1%) and SWYC Milestones (89.0%; 95% CI, 86.1%-91.4%) was higher than that of the PEDS (79.6%; 95% CI, 75.7%-83.1%; P < .001 and P = .002, respectively), but differences in sensitivity were not statistically significant. Among older children (43-66 months), specificity of the ASQ-3 (92.1%; 95% CI, 85.1%-95.9%) was higher than that of the SWYC Milestones (70.7%; 95% CI, 60.9%-78.8%) and the PEDS (73.7%; 95% CI, 64.3%-81.3%; P < .001), but sensitivity to mild delays of the SWYC Milestones (54.8%; 95% CI, 38.1%-70.4%) and of the PEDS (61.8%; 95% CI, 43.1%-77.5%) was higher than that of the ASQ-3 (23.5%; 95% CI, 9.0%-48.8%; P = .012 and P = .002, respectively). Sensitivity exceeded 70% only with respect to severe delays, with 73.7% (95% CI, 50.1%-88.6%) for the SWYC Milestones among younger children, 78.9% (95% CI, 55.4%-91.9%) for the PEDS among younger children, and 77.8% (95% CI, 41.8%-94.5%) for the PEDS among older children. Attending to parents' concerns was associated with increased sensitivity of all questionnaires.

Conclusions and Relevance

This study found that 3 frequently used screening questionnaires offer adequate specificity but modest sensitivity for detecting developmental delays among children aged 9 months to 5 years. The results suggest that trade-offs in sensitivity and specificity occurred among the questionnaires, with no one questionnaire emerging superior overall.

Mental health and coping strategies in families of children and young adults with muscular dystrophies

BACKGROUND

Living with a progressive disease as muscular dystrophy (MD) can be challenging for the patient and the entire family from both emotional and practical point of view. We aimed to extend our previously published data about mental health in patients with MDs, also investigating coping profiles of both themselves and their parents. Furthermore, we wanted to verify whether psychological adaptation of patients can be predicted by coping strategies, taking also into account physical impairment, cognitive level and socioeconomic status.

METHODS

112 patients with MDs, aged 2-32 were included. Their emotional and behavioural features were assessed through parent- and self-report Achenbach System for Empirically Based Assessment questionnaires and Strength and Difficulties Questionnaires. Development and Well-Being Assessment or Autism Diagnostic Observation Schedule were administered to confirm suspected diagnoses. Coping profile of both parents and patients was assessed through the self-administered New Italian Version of the Coping Orientation to the Problems Experienced questionnaire and its relationship with emotional/behavioural outcome was examined in linear regression analyses.

RESULTS

High prevalence of intellectual disability and autism spectrum disorders was confirmed in Duchenne MD. Despite the high rate of internalizing symptomatology, we did not report higher rate of psychopathological disorders compared to general population. Parents tend to rely more on positive reinterpretation and less on disengagement coping. Avoidance coping, whether used by parents or patients, and ID, predicted increased emotional/behavioural problems.

CONCLUSIONS

Psychosocial interventions should address problems of anxiety and depression that people with MDs frequently experience, even through fostering parents' and childrens' engagement coping over disengagement coping.

Multi-stage Screening in Early Intervention: A Critical Strategy for Improving ASD Identification and Addressing Disparities

Health disparities in ASD detection affect children's access to subsequent interventions. We examined potential disparities in implementation of a multi-stage ASD screening and diagnostic evaluation protocol in Part C Early Intervention with 4943 children ages 14-36 months (mean 22.0 months; 62.9% boys, 73.3% children of color, 34.9% non-English-primary language, 64.5% publicly-insured). Participation and follow-through were high (64.9% and 65.3% at first- and second-stage screening, respectively, 84.6% at diagnostic evaluation). Logistic regressions identified predictors of screening participation and outcomes at each stage; demographic differences (race, language, public insurance) were observed only at first-stage screening and reflected higher participation for children of color and higher positive screens for publicly-insured children. Results suggest the multi-stage screening protocol shows promise in addressing disparities in early diagnosis.

Examining the Whiteley Index-6 as a screener for DSM-5 presentations of severe health anxiety in primary care

Psychological screening is essential within primary care settings, with growing evidence that health anxiety could be important to screen for in such settings. Brief screeners in primary care settings are considered most viable for routine use. This study provided the first known examination of a version of the Whiteley Index (WI; Pilowksy, 1967) as a screener for primary care patients who are experiencing DSM-5 presentations of severe health anxiety (i.e., somatic symptom disorder, illness anxiety disorder). A six-item short form of the WI (i.e., WI-6), with item responses made using an ordered-category response option, was examined. Consecutively enrolled U.S. patients presenting for treatment at a community health center (N = 202) completed the WI-6 and a semi-structured interview assessing clinically severe health anxiety in the form of somatic symptom disorder and illness anxiety disorder. A total of 61 participants met criteria for clinically severe health anxiety and were compared to patients who did not meet criteria for clinically severe health anxiety. Results from a receiver operating characteristic (ROC) analysis indicated that a cutoff score of 18 on the WI-6 adequately balanced sensitivity (75%) and specificity (77%). The area under the curve (AUC) indicated the WI-6 did a reasonable job discriminating between the two groups (AUC = 0.83, p < .001, 95% confidence interval = 0.77-0.89). Study results offer preliminary support for the WI-6 as a practical screener for identifying cases of severe health anxiety in U.S. primary care settings that may warrant further evaluation.

Establishing New Norms for Developmental Milestones

BACKGROUND AND OBJECTIVES

Pediatric surveillance of young children depends on providers' assessment of developmental milestones, yet normative data are sparse. Our objectives were to develop new norms for common milestones to aid in clinical interpretation of milestone attainment.

METHODS

We analyzed responses to the developmental screening form of the Survey of Well-being of Young Children from 41 465 screens across 3 states. Associations between developmental status and a range of child characteristics were analyzed, and norms for individual questions were compared to guidelines regarding attainment of critical milestones from the Centers for Disease Control and Prevention (CDC).

RESULTS

A contemporary resource of normative data for developmental milestone attainment was established. Lower developmental status was associated with child age in the presence of positive behavioral screening scores (P < .01), social determinants of health (P < .01), Medicaid (P < .01), male sex (P < .01), and child race (P < .01). Comparisons between Survey of Well-being of Young Children developmental questions and CDC guidelines reveal that a high percentage of children are reported to pass milestones by the age at which the CDC states that "most children pass" and that an even higher percentage of children are reported to pass milestones by the age at which the CDC states that parents should "act early." An interactive data visualization tool that can assist clinicians in real-time developmental screening and surveillance interpretation is also provided.

CONCLUSIONS

Detailed normative data on individual developmental milestones can help clinicians guide caregivers' expectations for milestone attainment, thereby offering greater specificity to CDC guidelines.

Establishing New Norms for Developmental Milestones

BACKGROUND AND OBJECTIVES

Pediatric surveillance of young children depends on providers' assessment of developmental milestones, yet normative data are sparse. Our objectives were to develop new norms for common milestones to aid in clinical interpretation of milestone attainment.

METHODS

We analyzed responses to the developmental screening form of the Survey of Well-being of Young Children from 41 465 screens across 3 states. Associations between developmental status and a range of child characteristics were analyzed, and norms for individual questions were compared to guidelines regarding attainment of critical milestones from the Centers for Disease Control and Prevention (CDC).

RESULTS

A contemporary resource of normative data for developmental milestone attainment was established. Lower developmental status was associated with child age in the presence of positive behavioral screening scores (P < .01), social determinants of health (P < .01), Medicaid (P < .01), male sex (P < .01), and child race (P < .01). Comparisons between Survey of Well-being of Young Children developmental questions and CDC guidelines reveal that a high percentage of children are reported to pass milestones by the age at which the CDC states that "most children pass" and that an even higher percentage of children are reported to pass milestones by the age at which the CDC states that parents should "act early." An interactive data visualization tool that can assist clinicians in real-time developmental screening and surveillance interpretation is also provided.

CONCLUSIONS

Detailed normative data on individual developmental milestones can help clinicians guide caregivers' expectations for milestone attainment, thereby offering greater specificity to CDC guidelines.

Psychometric Properties of Two Developmental Screening Instruments for Hispanic Children in the Philadelphia Region

OBJECTIVE

To assess the validity of Spanish versions of the Survey of Well-being of Young Children (SWYC) Milestones and the Ages & Stages Questionnaire, Third Edition (ASQ-3), and to document the rates of developmental delays in an urban cohort of children with Hispanic parents.

METHODS

Spanish-speaking families with a child 9 to 60 months of age (N = 991) were initially screened using Spanish translations of the SWYC Milestones and the ASQ-3. A stratified random sample of 494 of these children subsequently received standardized clinical assessment to confirm the presence of developmental delays. Reverse weighting corrected for the selection bias inherent in the stratification scheme.

RESULTS

Fifty-five percent of toddlers (9 to 41 months of age) and 34.8% of preschoolers (42 to 60 months of age) scored in the moderately to severely delayed range, most frequently in language. Sensitivity and specificity for toddlers with severe delays associated with the SWYC were 0.69 and 0.64, respectively, and 0.55 and 0.75 for the ASQ-3. Sensitivity and specificity for preschoolers with severe delays associated with the SWYC were 0.87 and 0.58, respectively, and 0.71 and 0.86 for the ASQ-3.

CONCLUSIONS

Although psychometric properties of the Spanish translated versions are not as strong as the English versions, the findings suggest that both the SWYC Milestones and ASQ-3 represent promising tools for identifying Hispanic children with developmental delays. The rate of delays were consistent with other studies showing a high percentage of Hispanic children with developmental delays, most frequently in language skills.

Youth Depression Screening with Parent and Self-Reports: Assessing Current and Prospective Depression Risk

Few studies have examined the incremental validity of multi-informant depression screening approaches. In response, we examined how recommendations for using a multi-informant approach may vary for identifying concurrent or prospective depressive episodes. Participants included 663 youth (Age_M = 11.83; Age_SD = 2.40) and their caregiver who independently completed youth depression questionnaires, and clinical diagnostic interviews, every 6 months for 3 years. Receiver operating characteristic (ROC) analyses showed that youth-report best predicted concurrent episodes, and that both youth and parent-report were necessary to adequately forecast prospective episodes. More specifically, youth-reported negative mood symptoms and parent-reported anhedonic symptoms incrementally predicted future depressive episodes. Findings were invariant to youth's sex and age, and results from person and variable-centered analyses suggested that discrepancies between informants were not clinically meaningful. Implications for future research and evidence-based decision making for depression screening initiatives are discussed.

Translating Cognitive Vulnerability Theory Into Improved Adolescent Depression Screening: A Receiver Operating Characteristic Approach

Traditionally, screening research tests how well a given symptom inventory can identify a concurrent depressive episode. Although developmental psychopathology could inform screening protocols for a myriad of depression outcomes (e.g., prospective depressive episodes), approaches typically used in research make it difficult to translate these findings. Using a translational analytic approach and multiwave longitudinal study design, we examined how screening for cognitive vulnerabilities (rumination, dysfunctional attitudes, and attributional style) may improve our ability to identify concurrent depressive episodes, prospective depressive episodes, first lifetime episodes of depression, and recurrent major depressive episodes. There were 473 sixth-grade (early adolescents) and ninth-grade (middle adolescents; AgeM = 13.15, AgeSD = 1.62) students who completed baseline self-report cognitive vulnerability and depressive symptom measures. At baseline and every 6 months for 3 years, pediatric depression interviews were completed by the caregiver and youth. A receiver operating characteristic (ROC) approach was utilized to test our aims. Distinct algorithms best forecasted our depression outcomes. Rumination and attributional style emerged as unique and incrementally valid predictors for prospective episodes after controlling for baseline depressive symptoms. Rumination was the only unique predictor for first lifetime depressive episodes. For recurrent major depression, rumination in early adolescence and attributional style in middle adolescence served as incremental predictors beyond baseline depressive symptoms. Proposed cutoffs and diagnostic likelihood ratios are offered for algorithms for each depression outcome. Assessing cognitive vulnerability represents a feasible method to improve depression screening initiatives. Using an ROC-informed approach can help prevention initiatives better leverage the considerable gains made within developmental psychopathology research.

What Drives Detection and Diagnosis of Autism Spectrum Disorder? Looking Under the Hood of a Multi-stage Screening Process in Early Intervention

U.S. guidelines for detecting autism emphasize screening and also incorporate clinical judgment. However, most research focuses on the former. Among 1,654 children participating in a multi-stage screening protocol for autism, we used mixed methods to evaluate: (1) the effectiveness of a clinical decision rule that encouraged further assessment based not only on positive screening results, but also on parent or provider concern, and (2) the influence of shared decision-making on screening administration. Referrals based on concern alone were cost-effective in the current study, and reported concerns were stronger predictors than positive screens of time-to-complete referrals. Qualitative analyses suggest a dynamic relationship between parents' concerns, providers' concerns, and screening results that is central to facilitating shared decision-making and influencing diagnostic assessment.

Construct validity of a service-setting based measure to identify mental health problems in infancy

Accumulating research document the needs of intervention towards mental health problems in early childhood. The general child health surveillance offers opportunities for early detection of mental health vulnerability, conditioned the availability of feasible and validated measures. The Copenhagen Infant Mental Health Questionnaire, CIMHQ, was developed to be feasible for community health nurses and comprehensive regarding the range of mental health problems seen in infancy. Previous testing of the CIMHQ has documented feasibility and face validity. The aim was to investigate the construct validity of the general population measure by using the Rasch measurement models, and to explore the differential functioning of the CIMHQ relative to a number of characteristics of the infants, local independence of items, and possible latent classes of infants. CIMHQ was tested in 2,973 infants from the general population, aged 9-10 months. The infants were assessed by community health nurses at home visits, in the period from March 2011 to December 2013. Rasch measurement models were used to investigate the construct validity of the CIMHQ. Analyses showed an overall construct valid scale of mental health problems, consisting of seven valid subscales of specific problems concerning eating, sleep, emotional reactions, attention, motor activity, communication, and language, respectively. The CIMHQ fitted a graphical loglinear Rasch model without differential item function. Analyses of local homogeneity identified two latent classes of infants. A simple model with almost no local dependency between items is proposed for infants with few problems, whereas a more complicated model characterizes infants with more problems. The measure CIMHQ differentiates between infants from the general population with few and more mental health problems, and between subgroups of problems that potentially can be targets of preventive intervention.

Altered Functional Connectivity of the Default Mode Network in Patients With Schizo-obsessive Comorbidity: A Comparison Between Schizophrenia and Obsessive-compulsive Disorder

Clinical and neuroimaging data support the idea that schizo-obsessive comorbidity (SOC), similar to obsessive-compulsive disorder (OCD) and schizophrenia (SCZ), may be a distinct brain disorder. In this study, we examined the strength of resting-state functional connectivity (rsFC) between 19 subregions of the default mode network (DMN) and whole brain voxels in 22 patients with SOC features, 20 patients with SCZ alone, 22 patients with OCD, and 22 healthy controls (HC). The main results demonstrated that patients with SOC exhibited the highest rsFC strength within subregions of the DMN and the lowest rsFC strength between the DMN and subregions of the salience network (SN) compared with the other 3 groups. In addition, compared with HCs, all 3 patient groups exhibited increased rsFC between subregions of the DMN and the executive control network (ECN). The SOC and SCZ group both exhibited increased rsFC between subregions of the DMN and the middle temporal gyrus, but the OCD group exhibited decreased rsFC between them. These findings highlight a specific alteration in functional connectivity in the DMN in patients with SOC, and provide new insights into the dysfunctional brain organization of different mental disorders.

A multimethod screening approach for pediatric depression onset: An incremental validity study

OBJECTIVE

Screening protocols that rely on a single informant are inadequate in predicting pediatric depression. Multi-informant and risk factor screening approaches are potentially more sensitive methods for identifying depression risk, but the incremental validity of these protocols has not been adequately tested. Using a translational analytic approach and multimethod, longitudinal study design, we simultaneously tested several multi-indicator approaches to depression screening to identify an optimal algorithm for predicting depression onset in youth.

METHOD

Participants were 222 never-depressed children and adolescents (M_age = 10.75 years old, SD_age = 1.85; female = 50.45%; 82.88% White), who completed baseline questionnaires for depressive symptoms and cognitive vulnerabilities, in addition to a morphed face task to assess pupil dilation. Mothers, meanwhile, completed baseline questionnaires and a semistructured interview to assess maternal and pediatric depression. Follow-up depression diagnostic assessments with both the mother and youth occurred every 6 months for 2 years. Receiver operating characteristics and reclassification analyses were used to test our aims.

RESULTS

Overall, we found moderate support for a multi-informant approach, and convincing evidence that individual differences in pupil dilation uniquely predicted depression onset. Youth with subthreshold depressive symptoms and elevated pupil dilation were over twice as likely to develop a first lifetime episode of depression compared to one's risk rate based on sex and age.

CONCLUSIONS

Our study provides one of the first screening batteries for detecting first lifetime episodes of depression in youth. The unique and incremental validity provided by pupil dilation suggests feasible biological indicators of depression risk can improve primary prevention efforts that target depression, such as universal pediatric depression screening. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Socioemotional developmental surveillance in young children: monitoring and screening best identify young children that require mental health treatment

BACKGROUND

Widely recommended socioemotional developmental surveillance methods include monitoring and development screening techniques. Currently, very little research has compared the effectiveness of monitoring and screening together, and existing research primarily focuses on the relationship between surveillance techniques and referrals or receipt of early intervention (EI). This study investigates the relationship between monitoring and screening and mental health treatment receipt in 3-5 year olds.

METHODS

The authors conducted logistic regression analyses on data from the National Surveys of Children's Health (NSCH; 2007) and NSCH (2011/2012) on the odds of mental health treatment receipt in children aged 3-5 years of age who either received (a) screening only, (b) monitoring only, (c) both monitoring and screening, or (d) no monitoring or screening. Sociodemographic control variables were also considered.

RESULTS

In both 2007 and 2011/2012 datasets, monitoring and screening together was the best predictor of mental health treatment receipt. Neither screening alone nor monitoring alone was associated with mental health treatment receipt.

CONCLUSIONS

Children who received monitoring and screening together had the greatest odds of treatment receipt compared with children receiving screening only, monitoring only, or no monitoring or screening.

Predictive validity of a service-setting-based measure to identify infancy mental health problems: a population-based cohort study

Measures to identify infancy mental health problems are essential to guide interventions and reduce the risk of developmental psychopathology in early years. We investigated a new service-setting-based measure the Copenhagen Infant Mental Health Screening (CIMHS) within the general child health surveillance by community health nurses (CHN). The study population of 2973 infants was assessed by CIMHS at age 9-10 months. A subsample of 416 children was examined at age 1½ years, using parent interviews including the Child Behavior Checklist (CBCL 1½-5), Check List of Autism and Toddlers (CHAT), Infant-Toddler Symptom Checklist (ITSCL), and the Bayley Scales of Infant and Toddler Development (BSID) and observations of behavior, communication, and interaction. Child mental disorders were diagnosed according to ICD-10 and parent-child relationship disorders according to DC:0-3R. Statistical analyses included logistic regression analyses adjusted and weighted to adjust for sampling and bias. CIMHS problems of sleep, feeding and eating, emotions, attention, communication, and language were associated with an up to fivefold increased risk of child mental disorders across the diagnostic spectrum of ICD-10 diagnoses. Homo-type continuity was seen in problems of sleep and feeding and eating being associated with a threefold increased risk of disorders within the same area, OR 3.0 (95% CI 1.6-5.4) and OR 2.7 (95% CI 1.7-4.2), respectively. The sensitivity at high CIMHS problem scores was 32% and specificity 86%. In summary, CIMHS identify a broad range of infants' mental health problems that are amenable to guide intervention within the general child health surveillance.

Attention-Deficit/Hyperactivity Disorder in Preschoolers: The Accuracy of a Short Screener

OBJECTIVE

Although early and accurate screening is required for the remediation of attention-deficit/hyperactivity disorder (ADHD), possible gender differences have not been extensively studied. We examined the classification accuracy of the parent and preschool teacher version of the Strengths and Difficulties Questionnaire (SDQ) hyperactivity-inattention (HI) subscale in girls and boys.

METHOD

The study was part of the Norwegian Mother and Child Cohort Study (MoBa). Parents and preschool teachers rated a total of 238 girls and 276 boys (mean age 3.5 years) with the SDQ HI subscale. Blinded to the parent and teacher ratings, interviewers classified the children by ADHD diagnoses with the Preschool Age Psychiatric Assessment Interview.

RESULTS

Areas under the curves for the parent HI subscale scores were good for both girls and boys (0.87 and 0.80, respectively). Preschool teacher classifications were fair (0.76) for girls and poor (0.62) for boys, a significant difference (p = .017). The subscale accurately identified children without ADHD at low parent scores (≤4), and fairly accurately identified ADHD at high scores (≥9), with maximum probabilities of finding true cases of 0.75 in girls and 0.55 in boys. Intermediate scores gave the best balance between sensitivity and specificity with low probabilities of correctly identifying children with ADHD.

CONCLUSION

The parental SDQ HI subscale was useful for screening for ADHD in preschool girls and boys. For preschool teachers, the subscale was useful for screening girls.

The geometric preference subtype in ASD: identifying a consistent, early-emerging phenomenon through eye tracking

Background

The wide range of ability and disability in ASD creates a need for tools that parse the phenotypic heterogeneity into meaningful subtypes. Using eye tracking, our past studies revealed that when presented with social and geometric images, a subset of ASD toddlers preferred viewing geometric images, and these toddlers also had greater symptom severity than ASD toddlers with greater social attention. This study tests whether this "GeoPref test" effect would generalize across different social stimuli.

Methods

Two hundred and twenty-seven toddlers (76 ASD) watched a 90-s video, the Complex Social GeoPref test, of dynamic geometric images paired with social images of children interacting and moving. Proportion of visual fixation time and number of saccades per second to both images were calculated. To allow for cross-paradigm comparisons, a subset of 126 toddlers also participated in the original GeoPref test. Measures of cognitive and social functioning (MSEL, ADOS, VABS) were collected and related to eye tracking data. To examine utility as a diagnostic indicator to detect ASD toddlers, validation statistics (e.g., sensitivity, specificity, ROC, AUC) were calculated for the Complex Social GeoPref test alone and when combined with the original GeoPref test.

Results

ASD toddlers spent a significantly greater amount of time viewing geometric images than any other diagnostic group. Fixation patterns from ASD toddlers who participated in both tests revealed a significant correlation, supporting the idea that these tests identify a phenotypically meaningful ASD subgroup. Combined use of both original and Complex Social GeoPref tests identified a subgroup of about 1 in 3 ASD toddlers from the "GeoPref" subtype (sensitivity 35%, specificity 94%, AUC 0.75.) Replicating our previous studies, more time looking at geometric images was associated with significantly greater ADOS symptom severity.

Conclusions

Regardless of the complexity of the social images used (low in the original GeoPref test vs high in the new Complex Social GeoPref test), eye tracking of toddlers can accurately identify a specific ASD "GeoPref" subtype with elevated symptom severity. The GeoPref tests are predictive of ASD at the individual subject level and thus potentially useful for various clinical applications (e.g., early identification, prognosis, or development of subtype-specific treatments).

Developing Autism Screening Criteria for the Brief Infant Toddler Social Emotional Assessment (BITSEA)

There is a critical need for evidence-based, broadband behavioral, and ASD screening measures for use in pediatric and early educational settings to ensure that young children at risk for developing social-emotional disorders and/or ASD are provided with early intervention services to optimize long-term outcomes. The BITSEA is a 42-item screener designed to identify social-emotional/behavioral problems and delays/deficits in social-emotional competence among 11-48-month-olds; 19 items describe behaviors consistent with ASD. Secondary data analysis was employed to develop cut-scores for ASD subscales using Receiver Operating Curves, discriminating children with (n = 223) and without (n = 289) ASD. Cut-scores demonstrated moderate-to-high discriminative power, sensitivity, specificity, and PPV. Findings highlight feasibility of using a broadband social-emotional competence and behavior problem screener to improve early detection of ASD.

Is a Positive Developmental-Behavioral Screening Score Sufficient to Justify Referral? A Review of Evidence and Theory

In their recommendations on screening for autism and developmental disabilities, the American Academy of Pediatrics recommends referral subsequent to a positive screening result. In this article, we argue that positive screening results are not always sufficient to justify a referral. We show that although positive predictive values are often low, they actually overstate the probability of having a disorder for many children who screen positive. Moreover, recommended screening thresholds are seldom set to ensure that the benefits of referral will equal or exceed the costs and risk of harm, which is a necessary condition for an optimal threshold in decision analysis. Drawing on recent recommendations for the Institute of Medicine/National Academy of Medicine, we discuss the implications of this argument for pediatric policy, education, and practice. In particular, we recommend that screening policies be revised to ensure that the costs and benefits of actions recommended in the event of a positive screen are appropriate to the screening threshold. We recommend greater focus on clinical decision-making in the education of physicians, including shared decision-making with patients and their families. Finally, we recommend broadening the scope of screening research to encompass not only the accuracy of specific screening instruments, but also their ability to improve decision-making in the context of systems of care.

Assessing mental health in boys with Duchenne muscular dystrophy: Emotional, behavioural and neurodevelopmental profile in an Italian clinical sample

OBJECTIVE

To evaluate through a comprehensive protocol, the psychopathological profile of DMD boys. The primary aim of this observational study was to describe the emotional and behavioural profile and the neurodevelopmental problems of Italian boys with Duchenne Muscular Dystrophy (DMD); the secondary aim was to explore the relation between psychopathological profile and DMD genotype.

METHOD

47 DMD boys, aged 2-18, were included in the study and assessed through structured and validated tools including Wechsler scales or Griffiths for cognitive ability, Child Behavior Check List (CBCL), Youth Self Report (YSR) and Strengths and Difficulties Questionnaire (SDQ) for emotional and behavioural features. Patients "at risk" based on questionnaires scores were evaluated by a clinical structured interview using Development and Well Being Assessment (DAWBA) or Autism Diagnostic Observation Schedule (ADOS), as required.

RESULTS

The 47 enrolled patients, defined with a Full Scale Intelligence Quotient (FSIQ) of 80.38 (one SD below average), and presenting a large and significant difference in FSIQ in relation to the site of mutation along the dystrophin gene (distal mutations associated with a more severe cognitive deficit), were showing Internalizing Problems (23.4%) and Autism Spectrum Disorders (14.8%). Interestingly, an association of internalizing problems with distal deletion of the DMD gene is documented.

CONCLUSION

Even though preliminary, these data show that the use of validated clinical instruments, that focus on the impact of emotional/behaviour problems on everyday life, allows to carefully identify clinically significant psychopathology.

Screening for pickiness - a validation study

Picky eating is prevalent in childhood and is associated with negative health outcomes. Therefore early detection of pickiness is pertinent. Because no psychometric measure of picky/fussy eating has been validated, we aimed to examine the screening efficiency of the 6-item ‘Food Fussiness’ (FF) scale from the Children’s Eating Behavior Questionnaire using structured psychiatric interviews (the Preschool Age Psychiatric Interview), providing meaningful cut-off values based on a large, representative sample of Norwegian 6 year olds (n = 752). Screening efficiency was evaluated using receiver operating characteristic curve analysis, revealing excellent discrimination. The cut-point maximizing the sum of sensitivity and specificity for the scale was found at a score of 3.33 for severe cases and 3.00 when both moderate and severe pickiness were included. The results suggest that the FF scale may provide a tool for identification of clinically significant picky eating, although further assessment may be needed to separate moderate from severe cases.

A system dynamics model of clinical decision thresholds for the detection of developmental-behavioral disorders

Background

Clinical decision-making has been conceptualized as a sequence of two separate processes: assessment of patients’ functioning and application of a decision threshold to determine whether the evidence is sufficient to justify a given decision. A range of factors, including use of evidence-based screening instruments, has the potential to influence either or both processes. However, implementation studies seldom specify or assess the mechanism by which screening is hypothesized to influence clinical decision-making, thus limiting their ability to address unexpected findings regarding clinicians’ behavior. Building on prior theory and empirical evidence, we created a system dynamics (SD) model of how physicians’ clinical decisions are influenced by their assessments of patients and by factors that may influence decision thresholds, such as knowledge of past patient outcomes. Using developmental-behavioral disorders as a case example, we then explore how referral decisions may be influenced by changes in context. Specifically, we compare predictions from the SD model to published implementation trials of evidence-based screening to understand physicians’ management of positive screening results and changes in referral rates. We also conduct virtual experiments regarding the influence of a variety of interventions that may influence physicians’ thresholds, including improved access to co-located mental health care and improved feedback systems regarding patient outcomes.

Results

Results of the SD model were consistent with recent implementation trials. For example, the SD model suggests that if screening improves physicians’ accuracy of assessment without also influencing decision thresholds, then a significant proportion of children with positive screens will not be referred and the effect of screening implementation on referral rates will be modest—results that are consistent with a large proportion of published screening trials. Consistent with prior theory, virtual experiments suggest that physicians’ decision thresholds can be influenced and detection of disabilities improved by increasing access to referral sources and enhancing feedback regarding false negative cases.

Conclusions

The SD model of clinical decision-making offers a theoretically based framework to improve understanding of physicians’ behavior and the results of screening implementation trials. The SD model is also useful for initial testing of hypothesized strategies to increase detection of under-identified medical conditions.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-016-0517-0) contains supplementary material, which is available to authorized users.

The National Institute of Mental Health Research Domain Criteria and Clinical Research in Child and Adolescent Psychiatry

OBJECTIVE

This review discusses the relevance of the National Institute of Mental Health (NIMH) Research Domain Criteria (RDoC) to clinical research in child and adolescent psychiatry.

METHOD

We summarize the characteristics of the NIMH RDoC project and then provide examples of RDoC designs that are of relevance to clinical investigators in child and adolescent psychiatry. The final section addresses questions regarding the impact of RDoC on clinical care.

RESULTS

RDoC encourages investigators to investigate psychopathology dimensionally: greater or lesser degrees of healthy/adapted functioning of neurobiological, cognitive, and behavioral processes (constructs) that cut across current diagnostic categories. Elucidation of the developmental components of RDoC constructs is needed to ensure they are fully validated. Integrating RDoC approaches into clinical research of child and adolescent psychopathology is contributing to our understanding of development as an aspect of the heterogeneity within DSM disorders and commonalities across seemingly disparate disorders. Continued efforts promise to also explain the processes that lead to mental illness in at-risk populations.

CONCLUSION

Incorporating an RDoC approach in clinical research in child and adolescent psychiatry promises to be a fruitful avenue of research into the root causes and manifestations of mental illness, which will eventually lead to more precise treatments. Although the long-term aspiration of RDoC is to help reduce the burden of suffering for those with mental illnesses, it is not intended to be used for practical clinical purposes at this early stage.