Illusory generalizability of clinical prediction models

It is widely hoped that statistical models can improve decision-making related to medical treatments. Because of the cost and scarcity of medical outcomes data, this hope is typically based on investigators observing a model's success in one or two datasets or clinical contexts. We scrutinized this optimism by examining how well a machine learning model performed across several independent clinical trials of antipsychotic medication for schizophrenia. Models predicted patient outcomes with high accuracy within the trial in which the model was developed but performed no better than chance when applied out-of-sample. Pooling data across trials to predict outcomes in the trial left out did not improve predictions. These results suggest that models predicting treatment outcomes in schizophrenia are highly context-dependent and may have limited generalizability.

Assessing the impact of a comprehensive mental health program on frontline health service workers

Mental health issues are a growing concern in the workplace, linked to negative outcomes including reduced productivity, increased absenteeism, and increased turnover. Employer-sponsored mental health benefits that are accessible and proactive may help address these concerns. The aim of this retrospective cohort study was to evaluate the impact of a digital mental health benefit (Spring Health) on frontline healthcare service workers' clinical and workplace outcomes. The benefit was sponsored by a national health services company from 2021-2022 and included mental health screening, care navigation, psychotherapy and/or medication management. We hypothesized program use would be associated with improvements in depression and anxiety symptoms, and increased productivity and retention. Participants were employees enrolled in the benefit program, had at least moderate anxiety or depression, at least 1 treatment appointment, and at least 2 outcome assessments. Clinical improvement measures were PHQ-9 scale (range, 0-27) for depression and GAD-7 scale (range, 0-21) for anxiety; workplace measures were employee retention and the Sheehan Disability Scale (SDS) for functional impairment. A total of 686 participants were included. Participants using the mental health benefit had a 5.60 point (95% CI, 4.40-6.79, d = 1.28) reduction in depression and a 5.48 point (95% CI, 3.88-7.08, d = 1.64) reduction in anxiety across 6 months. 69.9% (95% CI, 61.8%-78.1%) of participants reliably improved (≥5 point change) and 84.1% (95% CI, 78.2%-90.1%) achieved reliable improvement or recovery (<10 points). Participants reported 0.70 (95% CI, 0.26-1.14) fewer workdays per week impacted by mental health issues, corresponding to $3,491 (95% CI, $1305-$5677) salary savings at approximately federal median wage ($50,000). Furthermore, employees using the benefit were retained at 1.58 (95% CI, 1.4-1.76) times the rate of those who did not. Overall, this evaluation suggests that accessible, proactive, and comprehensive mental health benefits for frontline health services workers can lead to positive clinical and workplace outcomes.

Racial and Ethnic Variation in Complementary and Integrative Health Therapy Use Among US Veterans

Importance

White individuals are the greatest users of complementary and integrative health (CIH) therapies in the general population, but this might partially be due to differences in age, health condition, and location. Identifying the nuances in racial and ethnic differences in care is one important step to addressing them.

Objective

To evaluate racial and ethnic differences in Veterans Affairs (VA)-covered CIH therapy use in a more nuanced manner by examining the association of 5 demographic characteristics, health conditions, and medical facility locations with those differences.

Design, Setting, and Participants

Retrospective cross-sectional observational study of VA health care system users, using electronic health record and administrative data at all VA medical facilities and community-based clinics. Participants included veterans with nonmissing race and ethnicity data using VA-funded health care between October 2018 and September 2019. Data were analyzed from June 2022 to April 2023.

Main Outcome and Measure

Any use of VA-covered acupuncture, chiropractic care, massage therapy, yoga, or meditation/mindfulness.

Results

The sample consisted of 5 260 807 veterans with a mean (SD) age of 62.3 (16.4) years and was 91% male (4 788 267 veterans), 67% non-Hispanic White (3 547 140 veterans), 6% Hispanic (328 396 veterans), and 17% Black (903 699 veterans). Chiropractic care was the most used CIH therapy among non-Hispanic White veterans, Hispanic veterans, and veterans of other races and ethnicities, while acupuncture was the most commonly used therapy among Black veterans. When not accounting for the location of the VA medical facilities in which veterans used health care, Black veterans appeared more likely to use yoga and meditation than non-Hispanic White veterans and far less likely to use chiropractic care, while those of Hispanic or other race and ethnicity appeared more likely to use massage than non-Hispanic White veterans. However, those differences mostly disappeared once controlling for medical facility location, with few exceptions-after adjustment Black veterans were less likely than non-Hispanic White veterans to use yoga and more likely to use chiropractic care.

Conclusions and Relevance

This large-scale, cross-sectional study found racial and ethnic differences in use of 4 of 5 CIH therapies among VA health care system users when not considering their medical facility location. Given those differences mostly disappeared once medical facilities were accounted for, the results demonstrated the importance of considering facilities and residential locations when examining racial differences in CIH therapy use. Medical facilities could be a proxy for the racial and ethnic composition of their patients, CIH therapy availability, regional patient or clinician attitudes, or therapy availability.

Structural Inequities in Self-compassion and Parental Burnout

Objectives

When parenting-related stressors and coping resources are chronically imbalanced, there is risk of parental burnout, and consequent negative impact on parent and child wellbeing. The objective of this study was to determine the relations between structural and social determinants of health inequities, self-compassion (a theoretically indicated coping practice), and parental burnout during the COVID-19 pandemic.

Method

Participants were parents (n = 2324) with at least one child aged 4-17 in the household recruited from NORC's AmeriSpeak Panel (a probability-based panel providing coverage of 97% of the US household population). Parents completed an online or telephone questionnaire in English or Spanish in December 2020. Structural equation modeling was used to test a system of relations between income, race and ethnicity, parental burnout, and parent and child mental health. Indirect effects and moderation by self-compassion were also tested.

Results

On average, parents experienced symptoms of burnout several days per week. Symptoms were the most frequent among parents with the least income, as well as female-identified and Asian parents. More self-compassion was associated with less parental burnout, and fewer parent and child mental health difficulties. Black and Hispanic parents were more self-compassionate compared to white parents, helping to explain similar levels of parental burnout and relatively better mental health outcomes, despite comparatively more stressors.

Conclusions

Self-compassion is a potentially promising target for interventions aiming to address parental burnout; however, such efforts must not detract from critical structural changes to reduce parenting stressors, particularly those impacting parents experiencing systemic racism and other forms of socioeconomic disadvantage.

Preregistration

This study is not preregistered.

Supplementary Information

The online version contains supplementary material available at 10.1007/s12671-023-02104-9.

Protocol for a collaborative randomised effectiveness trial of lay-delivered versus clinician-delivered behavioural activation in senior centres

INTRODUCTION

Depression is common among community-dwelling older adults who make use of senior centre services yet remains undertreated due to a lack of acceptable and available treatments. Emerging evidence suggests that lay health providers can offer psychosocial interventions for mental health disorders experienced by older adults. We developed a streamlined Behavioural Activation intervention (called 'Do More, Feel Better'; DMFB) to be delivered by older adult volunteers and propose to compare its effectiveness to that of clinician-delivered behavioural activation (BA).

METHODS AND ANALYSIS

This study is a type I collaborative randomised effectiveness trial testing the effect of DMFB in comparison to BA among 288 senior centre clients (aged 60+). Participant clients will be recruited from 6 Seattle, 6 New York City and 6 Tampa area senior centres serving economically and ethnically diverse communities. Primary outcomes will be increased activity level (target) and decreased depressive symptoms. Secondary outcomes will be functioning and client satisfaction, and an exploratory outcome will be treatment fidelity.

ETHICS AND DISSEMINATION

The study received ethics approval from the University of Washington Institutional Review Board (STUDY00011434). Client, volunteer and clinician participants will all provide informed consent for study procedures through in-person or remote contact with investigators. Results of this study will be presented in peer-reviewed journals and at professional conferences.

TRIAL REGISTRATION NUMBER

NCT04621877; ClinicalTrials.gov.

Clinical and Financial Outcomes Associated With a Workplace Mental Health Program Before and During the COVID-19 Pandemic

IMPORTANCE

Investment in workplace wellness programs is increasing despite concerns about lack of clinical benefit and return on investment (ROI). In contrast, outcomes from workplace mental health programs, which treat mental health difficulties more directly, remain mostly unknown.

OBJECTIVE

To determine whether participation in an employer-sponsored mental health benefit was associated with improvements in depression and anxiety, workplace productivity, and ROI as well as to examine factors associated with clinical improvement.

DESIGN, SETTING, AND PARTICIPANTS

This cohort study included participants in a US workplace mental health program implemented by 66 employers across 40 states from January 1, 2018, to January 1, 2021. Participants were employees who enrolled in the mental health benefit program and had at least moderate anxiety or depression, at least 1 appointment, and at least 2 outcome assessments.

INTERVENTION

A digital platform that screened individuals for common mental health conditions and provided access to self-guided digital content, care navigation, and video and in-person psychotherapy and/or medication management.

MAIN OUTCOMES AND MEASURES

Primary outcomes were the Patient Health Questionnaire-9 for depression (range, 0-27) score and the Generalized Anxiety Disorder 7-item scale (range, 0-21) score. The ROI was calculated by comparing the cost of treatment to salary costs for time out of the workplace due to mental health symptoms, measured with the Sheehan Disability Scale. Data were collected through 6 months of follow-up and analyzed using mixed-effects regression.

RESULTS

A total of 1132 participants (520 of 724 who reported gender [71.8%] were female; mean [SD] age, 32.9 [8.8] years) were included. Participants reported improvements from pretreatment to posttreatment in depression (b = -6.34; 95% CI, -6.76 to -5.91; Cohen d = -1.11; 95% CI, -1.18 to -1.03) and anxiety (b = -6.28; 95% CI, -6.77 to -5.91; Cohen d = -1.21; 95% CI, -1.30 to -1.13). Symptom change per log-day of treatment was similar post-COVID-19 vs pre-COVID-19 for depression (b = 0.14; 95% CI, -0.10 to 0.38) and anxiety (b = 0.08; 95% CI, -0.22 to 0.38). Workplace salary savings at 6 months at the federal median wage was US $3440 (95% CI, $2730-$4151) with positive ROI across all wage groups.

CONCLUSIONS AND RELEVANCE

Results of this cohort study suggest that an employer-sponsored workplace mental health program was associated with large clinical effect sizes for employees and positive financial ROI for employers.

Marriage checkup in integrated primary care: A randomized controlled trial with active-duty military couples

OBJECTIVE

This study assessed the efficacy of the marriage checkup, as adapted to integrated primary care settings and active-duty military couples, for improving relationship health and depressive symptoms.

METHOD

Married couples (N = 244, Mage = 32.4, 67.6% Caucasian) in which at least one member was active-duty Air Force were recruited from bases across the U.S. via online advertisement, emails sent from medical clinics to enrolled beneficiaries, social media posts, and flyers, and randomly assigned to active treatment or waitlist control. Treatment and control couples were linked in pairs sequentially and pairs completed nine sets of questionnaires at baseline, 1-, and 6-month posttreatment. Outcome measures included the Couples Satisfaction Index, Intimate Safety Questionnaire, Responsive Attention Scale, Partner Compassion Scale, Communication Skills Test, and the Center for Epidemiologic Studies Depression Scale.

RESULTS

A three-level multilevel model indicated, after adjustment for multiple comparisons, treatment couples experienced statistically significant small-to-moderate improvements compared to the control group (Cohen's d from 0.21 to 0.55) at 1 month that were sustained at 6 months for relationship satisfaction, responsive attention, compassion toward their partners, communication skills, intimate safety, and depressive symptoms.

CONCLUSIONS

A longitudinal randomized control trial of the MC supports the hypothesis that the MC significantly improves relationship satisfaction, intimacy, communication, partner compassion, responsive attention, and depressive symptoms. Implications for theory, treatment, and dissemination are discussed. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

"Do More, Feel Better": Pilot RCT of Lay-Delivered Behavioral Activation for Depressed Senior Center Clients

This pilot randomized control trial (RCT) tested "Do More, Feel Better" (DMFB), a lay-delivered Behavioral Activation intervention for depressed senior center clients. The study examined: (1) the feasibility of training older lay volunteers to fidelity; and (2) the acceptability, safety, and impact of the intervention. Twenty-one lay volunteers at four senior centers were trained in DMFB. Fifty-six depressed clients were randomized to receive 9 sessions of DMFB or Behavioral Activation delivered by social workers (MSW BA). Research assessments of overall client activity level (BADS) and depression severity (HAM-D) were conducted at baseline and Weeks 3, 6, and 9. Eighty-one percent of lay volunteers who underwent training were formally certified in DMFB. Depressed clients receiving each intervention reported high levels of satisfaction and showed large and clinically significant changes in 9-week activity level (d ≥ 1.35) and depression severity (d ≥ 3.34). Differences between treatment groups were very small for both activity level (d_MSW = 0.16; 95% CI, -0.70 to 1.02) and depression (d_MSW = 0.14; 95% CI, -0.63 to 0.91). Increases in activity level were associated with decreases in depression (β = -0.42; 95% CI, -0.55 to -0.30). Both interventions appeared to work as intended by increasing activity level and reducing depression severity. "Do More, Feel Better" shows the potential of evidence-based behavioral interventions delivered by supervised lay volunteers, and can help address the insufficient workforce available to meet the mental health needs of community-dwelling older adults.

The Patient Mania Questionnaire (PMQ-9): a Brief Scale for Assessing and Monitoring Manic Symptoms

BACKGROUND

Measurement-based care is an effective clinical strategy underutilized for bipolar disorder partly due to lacking a widely adopted patient-reported manic symptom measure.

OBJECTIVE

To report development and psychometric properties of a brief patient-reported manic symptom measure.

DESIGN

Secondary analysis of data collected in a randomized effectiveness trial comparing two treatments for 1004 primary care patients screening positive for bipolar disorder and/or PTSD.

PARTICIPANTS

Two analytic samples included 114 participants with varied diagnoses and test-retest data, and 179 participants with psychiatrist-diagnosed bipolar disorder who had two or more assessments with the nine-item Patient Mania Questionnaire-9 [PMQ-9]).

MAIN MEASURES

Internal and test-retest reliability, concurrent validity, and sensitivity to change were assessed. Minimally important difference (MID) was estimated by standard error of measurement (SEM) and by standard deviation (SD) effect sizes.

KEY RESULTS

The PMQ-9 had high internal reliability (Cronbach's alpha = 0.88) and test-retest reliability (0.85). Concurrent validity correlation with manic symptom measures was high for the Internal State Scale-Activation Subscale (0.70; p<0.0001), and lower for the Altman Mania Rating Scale (0.26; p=0.007). Longitudinally, PMQ-9 was completed at 1511 clinical encounters in 179 patients with bipolar disorder. Mean PMQ-9 score at first and last encounters was 14.5 (SD 6.5) and 10.1 (SD 7.0), a 27% decrease in mean score during treatment, suggesting sensitivity to change. A point estimate of the MID was approximately 3 points (range of 2-4).

CONCLUSIONS

The PMQ-9 demonstrated excellent test-retest reliability, concurrent validity, internal consistency, and sensitivity to change and was widely used and acceptable to patients and clinicians in a pragmatic clinical trial. Combined with the Patient Health Questionnaire-9 (PHQ-9) measure of depressive symptoms this brief measure could inform measurement-based care for individuals with bipolar disorder in primary care and mental health care settings given its ease of administration and familiar self-report response format.

Psychometric properties of the Telepsych User Experience Scale (TUES)

PURPOSE

To develop and psychometrically evaluate a brief measure of the telemental health experience among people receiving psychiatric and psychological care-the Telepsych User Experience Scale (TUES).

METHODS

The TUES was administered at 6 months to 364 study participants who screened positive for posttraumatic stress disorder and/or bipolar disorder and used telepsych services. The factor structure of the TUES was examined using exploratory and confirmatory factor analyses. Psychometric testing of the final scale examined (1) internal reliability, (2) criterion validity, (3) convergent validity, and (4) test-retest reliability using omega coefficients, negative binomial regression, and correlations, respectively. A week after the 12-month follow-up survey was completed, a retest was administered to 29 patients to assess reliability.

FINDINGS

Factor analytic methods indicated a single latent factor (user experience) and correlated error variance (method effect of item wording) for 2 items. To enhance clinical utility, we removed the 2 negatively worded items, resulting in a 5-item scale. Confirmatory analyses indicated excellent fit of the final model, which retained the best performing items from each hypothesized construct. The TUES demonstrated evidence of internal consistency (omega = 0.88-0.90), convergent validity, (r = 0.58), and criterion validity through telepsych engagement (incidence rate ratio = 1.19, P < .001), though test-retest reliability was unacceptable (r = 0.41).

CONCLUSION

The TUES is a pragmatic instrument with evidence of validity and internal reliability. Replication is necessary, but this initial psychometric evaluation suggests the TUES is a promising, brief yet comprehensive measure of telemental health user experience with clinical populations in rural settings.

Comparison of Teleintegrated Care and Telereferral Care for Treating Complex Psychiatric Disorders in Primary Care: A Pragmatic Randomized Comparative Effectiveness Trial

Importance

Only one-third of patients with complex psychiatric disorders engage in specialty mental health care, and only one-tenth receive adequate treatment in primary care. Scalable approaches are critically needed to improve access to effective mental health treatments in underserved primary care settings.

Objective

To compare 2 clinic-to-clinic interactive video approaches to delivering evidence-based mental health treatments to patients in primary care clinics.

Design, Setting, and Participants

This pragmatic comparative effectiveness trial used a sequential, multiple-assignment, randomized trial (SMART) design with patient-level randomization. Adult patients treated at 24 primary care clinics without on-site psychiatrists or psychologists from 12 federally qualified health centers in 3 states who screened positive for posttraumatic stress disorder and/or bipolar disorder and who were not already receiving pharmacotherapy from a mental health specialist were recruited from November 16, 2016, to June 30, 2019, and observed for 12 months.

Interventions

Two approaches were compared: (1) telepsychiatry/telepsychology-enhanced referral (TER), where telepsychiatrists and telepsychologists assumed responsibility for treatment, and (2) telepsychiatry collaborative care (TCC), where telepsychiatrists provided consultation to the primary care team. TER included an adaptive intervention (phone-enhanced referral [PER]) for patients not engaging in treatment, which involved telephone outreach and motivational interviewing.

Main Outcomes and Measures

Survey questions assessed patient-reported outcomes. The Veterans RAND 12-item Health Survey Mental Component Summary (MCS) score was the primary outcome (range, 0-100). Secondary outcomes included posttraumatic stress disorder symptoms, manic symptoms, depressive symptoms, anxiety symptoms, recovery, and adverse effects.

Results

Of 1004 included participants, 701 of 1000 (70.1%) were female, 660 of 994 (66.4%) were White, and the mean (SD) age was 39.4 (12.9) years. Baseline MCS scores were 2 SDs below the US mean; the mean (SD) MCS scores were 39.7 (14.1) and 41.2 (14.2) in the TCC and TER groups, respectively. There was no significant difference in 12-month MCS score between those receiving TCC and TER (β = 1.0; 95% CI, -0.8 to 2.8; P = .28). Patients in both groups experienced large and clinically meaningful improvements from baseline to 12 months (TCC: Cohen d = 0.81; 95% CI, 0.67 to 0.95; TER: Cohen d = 0.90; 95% CI, 0.76 to 1.04). For patients not engaging in TER at 6 months, there was no significant difference in 12-month MCS score between those receiving PER and TER (β = 2.0; 95% CI, -1.7 to 5.7; P = .29).

Conclusions and Relevance

In this comparative effectiveness trial of patients with complex psychiatric disorders randomized to receive TCC or TER, significantly and substantially improved outcomes were observed in both groups. From a health care system perspective, clinical leadership should implement whichever approach is most sustainable.

Trial Registration

ClinicalTrials.gov Identifier: NCT02738944.

The Association Between School Closures and Child Mental Health During COVID-19

IMPORTANCE

In-person schooling has been disrupted for most school-aged youth during the COVID-19 pandemic, with low-income, Black, and Hispanic populations most likely to receive fully remote instruction. Disruptions to in-person schooling may have negatively and inequitably affected children's mental health.

OBJECTIVE

To estimate the association between school closures and child mental health outcomes and how it varies across sociodemographic factors.

DESIGN, SETTING, AND PARTICIPANTS

This cross-sectional population-based survey study included a nationally representative sample of US adults aged 18 to 64 years with at least 1 child in the household. The survey was administered between December 2 and December 21, 2020, via web and telephone in English and Spanish. Participants were recruited from the NORC AmeriSpeak panel, an address-based panel with known probability sampling and coverage of 97% of US households.

EXPOSURES

Schooling modality (in person, fully remote, or hybrid), household income, age.

MAIN OUTCOMES AND MEASURES

Child mental health difficulties were measured with the parent-report version of the Strengths and Difficulties Questionnaire, with small, medium, and large effect sizes defined as 1.3-, 3.3-, and 5.2-point differences, respectively.

RESULTS

A total of 2324 adults completed the survey. Overall, 1671 respondents (71.9%) were women, 244 (10.5%) were Black, 372 (16.0%) were Hispanic, and 421 (18.1%) had a high school education or less. Children attending school in-person had higher household incomes (mean difference, $9719; 95% CI, $4327 to $15 111; P < .001) and were more likely to be White compared with those attending remotely (366 of 556 [65.8%] vs 597 of 1340 [44.5%]; P < .001). Older children in remote schooling had more mental health difficulties than those attending in-person schooling (standardized effect size, 0.23 [95% CI, 0.07 to 0.39] per year older; P = .006), corresponding to small effect sizes in favor of in-person schooling for older children and very small effect sizes favoring remote schooling for younger children. Children from families with higher income benefitted more from attending schools in-person compared with their peers from families with lower income (B = -0.20 [95% CI, -0.10 to -0.30] per $10 000-increase in annual income; P < .001), although this advantage was not apparent for children attending hybrid school (B = -0.05 [95% CI, -0.16 to 0.06] per $10 000-increase in annual income; P = .34), and directionally lower but not significantly different for children attending remote school (B = -0.12 [95% CI, -0.04 to -0.20] per $10 000-increase in annual income; P < .001). Learning pods fully buffered the associations of hybrid schooling (d = -0.25; 95% CI, -0.47 to -0.04) but not remote schooling (d = 0.04; 95% CI, -0.10 to 0.18) with negative mental health outcomes.

CONCLUSIONS AND RELEVANCE

The findings of this study suggest that older and Black and Hispanic children as well as those from families with lower income who attend school remotely may experience greater impairment to mental health than their younger, White, and higher-income counterparts. Ensuring that all students have access to additional educational and mental health resources must be an important public health priority, met with appropriate funding and workforce augmentation, during and beyond the COVID-19 pandemic.

Access and attitudinal barriers to engagement in integrated primary care mental health treatment for rural populations

PURPOSE

Compared to urban areas, rural populations are less likely to engage in mental health care. Using data from the Study to Promote Innovation in Rural Integrated Telepsychiatry, we examined the effect of rurality on engagement in mental health treatment as well as the role of potential mediators.

METHODS

Data were obtained from medical records and surveys. We defined rurality using the rural-urban commuting area codes. Baseline mediators included the Endorsed and Anticipated Stigma Inventory and the Assessment of Perceived Access to Care. Engagement outcomes included number of psychotherapy visits and self-reported medication use. We used path analysis to examine the relationship between rurality and engagement and the influence of mediating variables.

FINDINGS

Rural participants were less likely to initiate psychotherapy (OR = 0.49; adjusted P = .036), although rurality was not associated with number of psychotherapy sessions or medication use. Rurality was associated with a small elevation in negative beliefs about mental health, but this potential mediator was not associated with engagement. Rurality was negatively associated with lower perceived need for treatment (OR = 0.67, adjusted P = .040), which was in turn positively associated with initiating psychotherapy (OR = 1.99, adjusted P = .001).

CONCLUSIONS

Neither rurality itself nor the potential mediators had a large effect on engagement. Federally Qualified Health Centers offering colocated and/or integrated mental health care appear to be mostly mitigating rural-urban disparities in mental health engagement. Improving rates of psychotherapy initiation for rural patients should remain a policy goal.

Genetic susceptibility for major depressive disorder associates with trajectories of depressive symptoms across childhood and adolescence

BACKGROUND

Early-onset depression during childhood and adolescence is associated with a worse course of illness and outcome than adult onset. However, the genetic factors that influence risk for early-onset depression remain mostly unknown. Using data collected over 13 years, we examined whether polygenic risk scores (PRS) that capture genetic risk for depression were associated with depressive symptom trajectories assessed from childhood to adolescence.

METHODS

Data came from the Avon Longitudinal Study of Parents and Children, a prospective, longitudinal birth cohort (analytic sample = 7,308 youth). We analyzed the relationship between genetic susceptibility to depression and three time-dependent measures of depressive symptoms trajectories spanning 4-16.5 years of age (class, onset, and cumulative burden). Trajectories were constructed using a growth mixture model with structured residuals. PRS were generated from the summary statistics of a genome-wide association study of depression risk using data from the Psychiatric Genomics Consortium, UK Biobank, and 23andMe, Inc. We used MAGMA to identify gene-level associations with these measures.

RESULTS

Youth were classified into six classes of depressive symptom trajectories: high/renitent (27.9% of youth), high/reversing (9.1%), childhood decrease (7.3%), late childhood peak (3.3%), adolescent spike (2.5%), and minimal symptoms (49.9%). PRS discriminated between youth in the late childhood peak, high/reversing, and high/renitent classes compared to the minimal symptoms and childhood decrease classes. No significant associations were detected at the gene level.

CONCLUSIONS

This study highlights differences in polygenic loading for depressive symptoms across childhood and adolescence, particularly among youths with high symptoms in early adolescence, regardless of age-independent patterns.

Outcomes of a health informatics technology-supported behavioral activation training for care managers in a collaborative care program

INTRODUCTION

Health informatics-supported strategies for training and ongoing support may aid the delivery of evidence-based psychotherapies. The objective of this study was to describe the development, implementation, and practice outcomes of a scalable health informatics-supported training program for behavioral activation for patients who screened positive for posttraumatic stress disorder and/or bipolar disorder.

METHOD

We trained 34 care managers in 12 rural health centers. They used a registry checklist to document the delivery of 10 behavioral activation skills for 4,632 sessions with 455 patients. Care managers received performance feedback based on registry data. Using encounter-level data reported by care managers, we described the implementation outcomes of patient reach and care manager skill adoption. We used cross-classified multilevel modeling to explore variation in skill delivery accounting for patient characteristics, provider characteristics, and change over time.

RESULTS

Care managers engaged 88% of patients in behavioral activation and completed a minimum course for 57%. The average patient received 5.9 skills during treatment, with substantial variation driven more by providers (63%) than patients (29%). Care managers significantly increased the range of skills offered to patients over time.

DISCUSSION

The registry-based checklist was a feasible training and support tool for community-based providers to deliver behavioral activation. Providers received data-driven performance feedback and demonstrated skill improvement over time, promoting sustainment. Future research will examine patient-level outcomes. Results underscore the potential public health impact of a simple registry-based skills checklist coupled with a scalable remote training program for evidence-based psychotherapy. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Individual Differences in the Stability and Change of Childhood Depression: A Growth Mixture Model With Structured Residuals

Studies of developmental trajectories of depression are important for understanding depression etiology. Existing studies have been limited by short time frames and no studies have explored a key factor: differential patterns of responding to life events. This article introduces a novel analytic technique, growth mixture modeling with structured residuals, to examine the course of youth depression in a large, prospective cohort (N = 11,641, ages 4-16.5, 96% White). Age-specific critical points were identified at ages 8 and 13 where depression symptoms spiked for a minority of children. Most depression risk was due to dynamic responses to environmental events, drawn not from a small pool of persistently depressed children, but a larger pool of children who varied across higher and lower symptom levels.

Treatment receipt patterns among individuals with co-occurring posttraumatic stress disorder (PTSD) and substance use disorders

OBJECTIVE

To determine latent classes of treatment receipt among people with comorbid posttraumatic stress disorder (PTSD) and substance use disorder (SUD) and describe each class by demographics, disease characteristics, and psychiatric diagnoses.

METHOD

Participants were National Epidemiologic Survey on Alcohol and Related Conditions-III respondents with lifetime PTSD and SUD (n = 1,349; mean age 40.3; 62.5% female; 30.9% non-White or Hispanic-White). Cross-sectional data were collected using the DSM-5 Alcohol Use Disorder and Associated Disabilities Interview Schedule. Latent class analysis was used to identify subgroups of participants with different patterns of treatment receipt.

RESULTS

Of the patients, 36% received at least 1 SUD treatment while 84% received at least 1 mental health (MH) treatment. Six latent classes were identified: no treatment (17.3%), outpatient MH (34.0%), outpatient + inpatient MH (17.9%), SUD (7.3%), SUD + outpatient MH (15.7%), and SUD + outpatient MH + inpatient MH (7.7%). The SUD treatment classes evidenced greater social instability, had higher alcohol use disorder symptom severity, and used more drug types than the non-SUD classes. Classes receiving inpatient MH treatment had a greater incidence of additional comorbid conditions and suicidal behaviors. Across all 6 classes, most respondents met diagnostic criteria for chronic PTSD (overall: 68.9%) while fewer met diagnostic criteria for chronic SUD (overall: 38.7%).

CONCLUSIONS

Most people with lifetime PTSD and SUD have sought either SUD or MH treatment or both, with substantially greater receipt of MH treatment. This comorbid group has complex clinical presentations that differ depending upon treatment subgroup, and for most, their PTSD persisted despite high rates of treatment engagement. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Plans of US Parents Regarding School Attendance for Their Children in the Fall of 2020: A National Survey

IMPORTANCE

As schools consider reopening for in-person instruction prior to availability of a coronavirus disease 2019 (COVID-19) vaccine, families may be weighing their priorities regarding school attendance.

OBJECTIVE

To characterize the association of planned in-person school attendance during the COVID-19 pandemic with factors, including family socioeconomic characteristics, and parent attitudes and beliefs about their child's school attendance.

DESIGN, SETTING, AND PARTICIPANTS

Cross-sectional survey study. Data were collected from June 2, 2020, to June 5, 2020, weighted to reflect population norms, and analyzed using ordered probit regression. A sample of US parents (of children ages 5-17 years) were recruited using a nonprobability survey panel with stratification by socioeconomic characteristics.

MAIN OUTCOMES AND MEASURES

The main outcome was parent-reported plan to send their child to school or keep their child home, conditional on their school opening for in-person instruction. Additional measures assessed family socioeconomic characteristics, medical vulnerability, worry about COVID-19 and multisystem inflammatory syndrome, confidence in their child's school, and homeschooling difficulties.

RESULTS

The sample of 730 parents was balanced by parent sex (53% women) with successful oversampling for Black (28%; n = 201) and Hispanic (27%; n = 200) participants. In estimates weighted to US population norms, 31% (95% CI, 27% to 34%) of participants indicated they would probably or definitely keep their child home this fall, and 49% indicated that they would probably or definitely send their child to school this fall. Factors associated with planning to keep children home included lower income (38% with incomes <$50 000 vs 21% with incomes $100 000-$150 000 per year; difference, 17%; 95% CI, 9% to 26%), being unemployed (40% unemployed vs 26% employed; difference, 14%; 95% CI, 5% to 25%), and having a flexible job (33% with flexible jobs vs 19% with inflexible jobs; difference, 14%; 95% CI, 5% to 30%). Planning to keep children home was also associated with fear of COVID-19 (B = 0.19; P < .001), fear of multisystem inflammatory syndrome (B = 0.12; P = .04), confidence in schools (B = -0.22; P < .001), and challenges of homeschooling (B = -0.12; P = .01). Race and ethnicity were not significantly associated with plans to keep children home.

CONCLUSIONS AND RELEVANCE

In this survey study, many parents planned to keep children home in fall 2020. Schools need to act soon to address parental concerns and provide options for what will be available for them should they opt to keep their child home. Structural barriers, such as lack of workplace flexibility and potential school-level inequities in implementation of preventive measures, must be acknowledged and addressed where possible.

Randomized Controlled Trial of the Marriage Checkup: Depression Outcomes

The association between relationship functioning and depressive symptoms is well established. This study examined the effects of the Marriage Checkup, a brief two-session Assessment and Feedback relationship intervention, on depressive symptoms. Two hundred and nine married couples participated in the Marriage Checkup and were randomized into Treatment (N = 108) and Waitlist-Control Conditions (N = 101). Compared to the control condition, intervention participants reported significant improvements in depressive symptoms (d = 0.55), with an even greater effect for those who were reporting more severe baseline depression symptoms (d = 0.67). These outcomes are comparable to those within long-term individual psychotherapy, couple therapy, and pharmacology trials, making this the briefest intervention to date to demonstrate significant improvements in depressive symptoms. Clinical implications are discussed.

Bipolar disorder and PTSD screening and telepsychiatry diagnoses in primary care

OBJECTIVE

To describe clinical diagnoses from telepsychiatrist consultation in safety net primary care settings for adult patients screening positive for bipolar disorder, PTSD, or both.

METHODS

Patients were administered the PTSD Checklist (PCL-6) and the Composite International Diagnostic Interview 3.0 (CIDI) for bipolar disorder. Positive screening result definitions were PCL-6 score of ≥14 and CIDI positive stem question responses and score of ≥8. Patient characteristics were assessed by survey. Psychiatrists consulted in primary care via telehealth and recorded clinical diagnoses.

RESULTS

Among 767 patients attending consultation with a telepsychiatrist, 495 (65%) screened PCL-6 positive only, 249 (32%) screened both PCL-6 and CIDI positive, and 23 (3%) screened CIDI positive. Approximately two-thirds screening PCL-6 positive were diagnosed with PTSD, and most had comorbid mood disorder diagnoses, with bipolar disorder diagnosis occurring more often in those screening CIDI positive compared to negative (42% vs. 15%). Positive predictive values were 64.9% for PCL-6 and 43.8% for CIDI.

CONCLUSION

Most individuals screening positive for PTSD and/or bipolar disorder had two or more psychiatric diagnoses; misclassification exists for both instruments but was greater for CIDI. Psychiatrist consultation early in treatment for individuals screening positive on the PCL-6 and/or CIDI could help clarify diagnoses and improve treatment planning.

An Implementation Study of Relationship Checkups as Home Visitations for Low-Income At-Risk Couples

Couples with the greatest need for relationship health maintenance and intervention are often least able to afford and access it; therefore, accessible, affordable, effective, and brief interventions are needed to improve relationship health for those who need it most. Consequently, this paper examined whether a brief relationship intervention could be effectively implemented with a low-income, underserved population. All enrolled participants (N = 1,312) received the Relationship Checkup, which consists of an assessment and a feedback session delivered in their homes or at a local clinic at their request. Measures assessed relationship satisfaction, communication, psychological and physical aggression, and intimacy at baseline and 1-month follow-up, and program and relationship satisfaction at 6-month follow-up. All participants reported significant improvements on all outcomes with small effect sizes. However, moderation analyses suggested that distressed couples reported significantly larger effects across the board. Overall, participants reported that they were highly satisfied with the intervention both immediately after its delivery and 6 months later. Findings provide preliminary support for the effectiveness of this brief checkup and point to the utility of offering these kinds of low-cost brief interventions in flexible formats for those who might have the most difficulty accessing them.

Trajectories of Depressive Symptoms Among Web-Based Health Risk Assessment Participants

Background

Health risk assessments (HRAs), which often screen for depressive symptoms, are administered to millions of employees and health plan members each year. HRA data provide an opportunity to examine longitudinal trends in depressive symptomatology, as researchers have done previously with other populations.

Objective

The primary research questions were: (1) Can we observe longitudinal trajectories in HRA populations like those observed in other study samples? (2) Do HRA variables, which primarily reflect modifiable health risks, help us to identify predictors associated with these trajectories? (3) Can we make meaningful recommendations for population health management, applicable to HRA participants, based on predictors we identify?

Methods

This study used growth mixture modeling (GMM) to examine longitudinal trends in depressive symptomatology among 22,963 participants in a Web-based HRA used by US employers and health plans. The HRA assessed modifiable health risks and variables such as stress, sleep, and quality of life.

Results

Five classes were identified: A “minimal depression” class (63.91%, 14,676/22,963) whose scores were consistently low across time, a “low risk” class (19.89%, 4568/22,963) whose condition remained subthreshold, a “deteriorating” class (3.15%, 705/22,963) who began at subthreshold but approached severe depression by the end of the study, a “chronic” class (4.71%, 1081/22,963) who remained highly depressed over time, and a “remitting” class (8.42%, 1933/22,963) who had moderate depression to start, but crossed into minimal depression by the end. Among those with subthreshold symptoms, individuals who were male (P<.001) and older (P=.01) were less likely to show symptom deterioration, whereas current depression treatment (P<.001) and surprisingly, higher sleep quality (P<.001) were associated with increased probability of membership in the “deteriorating” class as compared with “low risk.” Among participants with greater symptomatology to start, those in the “severe” class tended to be younger than the “remitting” class (P<.001). Lower baseline sleep quality (P<.001), quality of life (P<.001), stress level (P<.001), and current treatment involvement (P<.001) were all predictive of membership in the “severe” class.

Conclusions

The trajectories identified were consistent with trends in previous research. The results identified some key predictors: we discuss those that mirror prior studies and offer some hypotheses as to why others did not. The finding that 1 in 5 HRA participants with subthreshold symptoms deteriorated to the point of clinical distress during succeeding years underscores the need to learn more about such individuals. We offer additional recommendations for follow-up research, which should be designed to reflect changes in health plan demographics and HRA delivery platforms. In addition to utilizing additional variables such as cognitive style to refine predictive models, future research could also begin to test the impact of more aggressive outreach strategies aimed at participants who are likely to deteriorate or remain significantly depressed over time.

A randomized controlled trial of the Marriage Checkup adapted for private practice

OBJECTIVE

This study examined the effectiveness of the Marriage Checkup (MC), adapted for independent practice.

METHOD

A total of 233 couples were recruited from 2 metropolitan areas of Denmark and randomized to the MC adapted for independent practice (MC-P, n = 116) or a waitlist condition (WL, n = 117). Self-report measures of relationship health were obtained online at 3 (WL) or 6 (MC-P) time points across 54 weeks. MC-P couples received 2 checkups (Week 7 and 51). WL couples received tickets to a movie night (Week 10). Data were analyzed using multilevel growth models.

RESULTS

Following the first checkup, small intervention effects were found on 3 of 4 outcome measures. Between the checkups, the effects on 2 of 3 measures first leveled off then reappeared. Following the second checkup, intervention effects in the small to medium range were found on all 4 measures including the Brief Marital Satisfaction Inventory (Cohen's d = 0.48), the Couple Satisfaction Index (d = 0.20), the Responsiveness and Attention Scale (d = 0.43), and the Intimate Safety Questionnaire (d = 0.21).

CONCLUSIONS

Couples receiving 2 annual checkups across 54 weeks experienced small to medium effects on relationship health when compared to controls. These are the first and preliminary results on a model for conducting regular relationship health checkups in a real-world therapeutic setting. Future studies are needed to investigate the comparative and long-term effects of this approach. (PsycINFO Database Record

Motivating Action and Maintaining Change: The Time-Varying Role of Homework Following a Brief Couples' Intervention

Studies regarding the effectiveness of homework assignments in cognitive-behavioral treatments have demonstrated mixed results. This study investigated predictors of compliance with homework recommendations and the time-varying relationship of recommendation completion with treatment response in a brief couples' intervention (N = 108). More satisfied couples and couples with more motivation to change completed more recommendations, whereas couples with children completed fewer. The association between recommendation completion and treatment response varied with the passage of time, with the strongest effect observed 6 months after the intervention, but no discernible differences at 1 year postintervention. Couples that completed more recommendations experienced more rapid treatment gains, but even those couples doing substantially fewer recommendations ultimately realized equivalent treatment effects, although they progressed more slowly. Implications are discussed.

A longitudinal examination of positive parenting following an acceptance-based couple intervention

Positive parenting practices have been shown to be essential for healthy child development, and yet have also been found to be particularly challenging for parents to enact and maintain. This article explores an innovative approach for increasing positive parenting by targeting specific positive emotional processes within marital relationships. Couple emotional acceptance is a powerful mechanism that has repeatedly been found to improve romantic relationships, but whether these effects extend to the larger family environment is less well understood. The current longitudinal study examined the impact of improved relational acceptance after a couple intervention on mother's and father's positive parenting. Participants included 244 parents (122 couples) in the Marriage Checkup (MC) study, a randomized, controlled, acceptance-based, intervention study. Data indicated that both women and men experienced significantly greater felt acceptance 2 weeks after the MC intervention, treatment women demonstrated greater positive parenting 2 weeks after the intervention, and all treatment participants' positive parenting was better maintained than control couple's 6 months later. Importantly, although mothers' positive parenting was not influenced by different levels of felt acceptance, changes in father's positive parenting were positively associated with changes in felt acceptance. As men felt more accepted by their wives, their levels of positive parenting changed in kind, and this effect on positive parenting was found to be mediated by felt acceptance 2 weeks after the MC. Overall, findings supported the potential benefits of targeting couple acceptance to generate positive cascades throughout the larger family system.

The heart of change: Acceptance and intimacy mediate treatment response in a brief couples intervention

In this study, we examined mediators of a brief couples intervention. Intimate safety, acceptance, and activation were examined in 2 roles: their contribution to marital satisfaction gains in the first 2 weeks after treatment (contemporaneous effects), and how early changes in the mediators influenced longer term changes in marital satisfaction over 2 years of follow-up (lagged effects). Married couples (N = 215) were randomized to either an intervention group or a wait-list control group and followed for 2 years. Latent change-score models were used to examine contemporaneous and time-lagged mediation. A booster intervention in the 2nd year was used for a replication study. Changes in intimate safety and acceptance were uniquely associated with contemporaneous treatment effects on relationship satisfaction in Year 1, but only acceptance was uniquely associated with contemporaneous effects in Year 2. With respect to lagged effects, early changes in acceptance partially mediated later changes in marital satisfaction in Year 1, whereas the same effect for intimate safety was marginally significant. These lagged paths were moderate in size and indirect effects were small. No lagged effects were significant in Year 2. Change in activation was not significant as either a contemporaneous or a lagged predictor of change in relationship satisfaction. We found moderate support for acceptance and more limited support for intimate safety as mediators of short- and long-term treatment response, suggesting that these processes play an important role in sustaining marital health.

Concussion under-reporting and pressure from coaches, teammates, fans, and parents

Concussions from sport present a substantial public health burden given the number of youth, adolescent and emerging adult athletes that participate in contact or collision sports. Athletes who fail to report symptoms of a suspected concussion and continue play are at risk of worsened symptomatology and potentially catastrophic neurologic consequences if another impact is sustained during this vulnerable period. Understanding why athletes do or do not report their symptoms is critical for developing efficacious strategies for risk reduction. Psychosocial theories and frameworks that explicitly incorporate context, as a source of expectations about the outcomes of reporting and as a source of behavioral reinforcement, are useful in framing this problem. The present study quantifies the pressure that athletes experience to continue playing after a head impact--from coaches, teammates, parents, and fans--and assesses how this pressure, both independently and as a system, is related to future concussion reporting intention. Participants in the study were 328 male and female athletes from 19 teams competing in one of seven sports (soccer, lacrosse, basketball, softball, baseball, volleyball, field hockey) at four colleges in the northeast region of the United States. Results found that more than one-quarter of the sample had experienced pressure from at least one source to continue playing after a head impact during the previous year. Results of a latent profile mixture model indicated that athletes who experienced pressure from all four of the measured sources were significantly more likely to intend to continue playing in the future than were athletes who had not experienced pressure from all sources, or only pressure from coaches and teammates. These findings underscore the importance of designing interventions that address the system in which athletes make decisions about concussion reporting, including athletes' parents, rather than focusing solely on modifying the individual's reporting cognitions.

Pilot Randomized Evaluation of Publically Available Concussion Education Materials

Many states and sports leagues are instituting concussion policies aimed at reducing risk of morbidity and mortality; many include mandates about the provision of concussion education to youth athletes. However, there is limited evidence if educational materials provided under these typically vague mandates are in fact effective in changing concussion risk-related behavior or any cognition predictive of risk-related behavior. The purpose of this pilot randomized controlled study was to conduct a theory-driven evaluation of three publically available concussion education materials: two videos and one informational handout. Participants were 256 late adolescent males from 12 teams in a single league of ice hockey competition in the United States. Randomization of educational condition occurred at the team level. Written surveys assessing postimpact symptom reporting behavior, concussion knowledge, and concussion reporting cognitions were completed by participants immediately before receiving their educational intervention, 1 day after, and 1 month after. Results indicated no change in any measure over any time interval, with the exception of perceived underreporting norms. In one of the video conditions, perceived underreporting norms increased significantly 1 day after viewing the video. Possible content and viewing environment-related reasons for this increase are discussed. Across all conditions, perceived underreporting norms increased 1 month after intervention receipt, raising the possibility that late in the competitive season underreporting may be perceived as normative. The need for the development of theory-driven concussion education materials, drawing on best practices from health behavior scholars, is discussed.

The Marriage Checkup: a randomized controlled trial of annual relationship health checkups

OBJECTIVE

This study assessed the efficacy of the Marriage Checkup (MC) for improving relationship health and intimacy.

METHOD

Cohabiting married couples (N = 215, Mage women = 44.5 years, men = 47 years, 93.1% Caucasian) recruited from a northeastern U.S. metropolitan area through print and electronic media were randomly assigned to MC treatment or wait-list control. Treatment but not control couples participated in assessment and feedback visits, at the beginning of the study and again 1 year later. All couples completed 9 sets of questionnaires over 2 years. Outcome measures included the Quality of Marriage Index, the Global Distress subscale of the Marital Satisfaction Inventory-Revised, the Intimate Safety Questionnaire, and the Relational Acceptance Questionnaire.

RESULTS

A latent growth curve model indicated significant between-group differences in intimacy at every measurement point after baseline (d ranged from .20 to .55, Md = .37), significant between-group differences in women's felt acceptance for every measurement point after baseline (d ranged from .17 to .47, Md = .34), significant between-group differences in men's felt acceptance through the 1-year 2-week follow-up (d across follow-up ranged from .11 to .40, Md = .25), and significant between-group differences in relationship distress through 1-year 6-month follow-up (d across follow-up ranged from .11 to .39, Md = .23).

CONCLUSIONS

Longitudinal analysis of the MC supports the hypothesis that the MC significantly improves intimacy, acceptance, and satisfaction. Implications for dissemination are discussed.