Do Rating and Task Measures of Control Abilities Assess the Same Thing?

Neural Sensitivity to Peer Feedback and Depressive Symptoms: Moderation by Executive Function

Theories of adolescent development suggest that elevated neural sensitivity to social evaluation confers tradeoffs for adolescents' wellbeing, promoting adaptation to changing social contexts but increasing risk for emotional distress and depression. This study investigated whether the association between neural processing of peer feedback and depressive symptoms depends on teacher-reported executive function (EF) ability in adolescent girls. Girls showed activation to negative and positive peer feedback in regions implicated in social-emotional processing that interacted with EF to predict depressive symptoms. Specifically, activation predicted more depression in youth with poorer EF but less depression in youth with better EF, suggesting that the impact of increased social sensitivity may depend on youths' ability to regulate this sensitivity in adaptive ways.

Executive functions abilities in preschool-age children are negatively related to parental EF, screen-time and positively related to home literacy environment: an EEG study

Environmental factors such as Home Literacy Environment (HLE), screen time, and parental executive functions (EF) may influence the development of the child's EF. The purpose of this study was to determine the effect of these factors on behavioral and neurobiological measures of EF in 4-year-old children. Electroencephalogram (EEG) data were collected while children performed the Attention Network Task (ANT), showing a smaller difference between incongruent and congruent conditions is related to better EF abilities. Data were analyzed using an Event-Related Potential (ERP) technique focusing on the N200 and P300 components (reflecting executive control and orienting attention, respectively). N200 and P300 differences (delta) between amplitudes and latencies for the incongruent and congruent conditions were computed and correlated with child EF skills, HLE, screen exposure, and parental EF. Screen exposure was associated with lower EF in children and their parents. Additionally, smaller differences between N200 amplitudes and latencies for the incongruent vs. congruent conditions were associated with higher HLE scores. In contrast, greater differences between P300 amplitudes and latencies were related to longer screen time. HLE was positively associated with EF's neurobiological (EEG) and behavioral measures, and screen time was negatively associated with these measures. This study also highlights the important relationship between parental EF (i.e., family predisposition) and EF's neurobiological and behavioral measures in their children.

Mapping neurodevelopmental diversity in executive function

Executive function, an umbrella term used to describe the goal-directed regulation of thoughts, actions, and emotions, is an important dimension implicated in neurodiversity and established malleable predictor of multiple adult outcomes. Neurodevelopmental differences have been linked to both executive function strengths and weaknesses, but evidence for associations between specific profiles of executive function and specific neurodevelopmental conditions is mixed. In this exploratory study, we adopt an unsupervised machine learning approach (self-organising maps), combined with k-means clustering to identify data-driven profiles of executive function in a transdiagnostic sample of 566 neurodivergent children aged 8-18 years old. We include measures designed to capture two distinct aspects of executive function: performance-based tasks designed to tap the state-like efficiency of cognitive skills under optimal conditions, and behaviour ratings suited to capturing the trait-like application of cognitive control in everyday contexts. Three profiles of executive function were identified: one had consistent difficulties across both types of assessments, while the other two had inconsistent profiles of predominantly rating- or predominantly task-based difficulties. Girls and children without a formal diagnosis were more likely to have an inconsistent profile of primarily task-based difficulties. Children with these different profiles had differences in academic achievement and mental health outcomes and could further be differentiated from a comparison group of children on both shared and profile-unique patterns of neural white matter organisation. Importantly, children's executive function profiles were not directly related to diagnostic categories or to dimensions of neurodiversity associated with specific diagnoses (e.g., hyperactivity, inattention, social communication). These findings support the idea that the two types of executive function assessments provide non-redundant information related to children's neurodevelopmental differences and that they should not be used interchangeably. The findings advance our understanding of executive function profiles and their relationship to behavioural outcomes and neural variation in neurodivergent populations.

One Score to Rule Them All? Comparing the Predictive and Concurrent Validity of 30 Hearts and Flowers Scoring Approaches

The Hearts and Flowers (H&F) task is a computerized executive functioning (EF) assessment that has been used to measure EF from early childhood to adulthood. It provides data on accuracy and reaction time (RT) across three different task blocks (hearts, flowers, and mixed). However, there is a lack of consensus in the field on how to score the task that makes it difficult to interpret findings across studies. The current study, which includes a demographically diverse population of kindergarteners from Boston Public Schools (N = 946), compares the predictive and concurrent validity of 30 ways of scoring H&F, each with a different combination of accuracy, RT, and task block(s). Our exploratory results provide evidence supporting the use of a two-vector average score based on Zelazo et al.'s approach of adding accuracy and RT scores together only after individuals pass a certain accuracy threshold. Findings have implications for scoring future tablet-based developmental assessments.

The many foibles of Likert scales challenge claims that self-report measures of self-control are better than performance-based measures

Self-control and executive functioning are often treated as highly related psychological constructs. However, measures of each rarely correlate with one another. This reflects some combination of true separability between the constructs and measurement differences. Traditionally, executive functioning is objectively measured as performance on computer-controlled tasks in the laboratory, whereas self-control is subjectively measured with self-report scales of predispositions and behaviors in everyday life. Self-report measures tend to better predict outcomes that should be affected by individual differences in control. Our two studies show that the original version of Tangney, Baumeister, and Boone's brief self-control scale (consisting of four positive and nine negative items) strongly correlates with self-esteem, mental health, fluid intelligence, but only weakly with satisfaction with life and happiness. Four variants of the original scale were created by reverse-wording the 13 original items and recombining them to form, for example, versions with all positive or all negative items. As the proportion of items with positive valence increased: (1) the outcomes with strong correlations in the original scale weakened and the weak correlations strengthened and (2) the mean overall scores increased. Both studies replicated a common finding that the original scale yields two factors in an exploratory factor analysis. However, the second factor is generated by method differences, namely, having items with both positive and negative valence. The second factor is induced by the common practice of reverse-coding the items with negative valence and the faulty assumption that Likert scales are equal-interval scales with a neutral-point at midscale.

The Longitudinal Interplay between Adverse Peer Experiences and Self-Regulation Facets: A Prospective Analysis during Middle Childhood

Positive peer experiences and self-regulation (SR) skills are crucial for children's healthy development, but little is known about how they interact during middle childhood. Therefore, we examined the prospective links between adverse peer experiences (APEs) and SR, drawing from the dataset of the PIER study. Across three measurement points, 1654 children aged 6-11 (T1), 7-11 (T2), and 9-13 years (T3) were included. We assessed the SR facets updating, flexibility, inhibition, emotional reactivity, inhibitory control, and planning using computerized tasks, parent- and teacher-reports. The latent variable of APEs consisted of measures of peer victimization and peer rejection assessed via self-, parent-, and teacher-report. Separate cross-lagged panel models were calculated, investigating the interplay of each SR facet and APEs. Results indicated that experiencing more APEs at T1 predicted higher emotional reactivity, and lower inhibition, inhibitory control, updating, and flexibility at T2. More APEs at T2 predicted higher emotional reactivity and lower planning at T3. Lower inhibition, updating, and flexibility at T2 predicted more APEs at T3. Accordingly, we found a negative bidirectional relationship between inhibition, updating, and flexibility with APEs. Our findings highlight that during middle childhood more APEs predict lower SR, which in turn predicts more experiences of peer victimization and rejection.

Associations between executive functions assessed in different contexts in a genetically informative sample

Executive functions (EFs) are cognitive functions that help direct goal-related behavior. EFs are usually measured via behavioral tasks assessed in highly controlled laboratory settings under the supervision of a research assistant. Online versions of EF tasks are an increasingly popular alternative to in-lab testing. However, researchers do not have the same control over the testing environment during online EF assessments. To assess the extent to which EFs assessed in-lab and online are related, we used data from the Colorado Online Twin Study (CoTwins; 887 individual twins aged 13.98-19.05) and constructed an Lab Common EF factor and an Online Common EF factor from four EF tasks assessed in-lab and online. The Lab Common and Online Common EF factors were genetically identical (rA = 1.00) but phenotypically separable (r = .77, 95% confidence interval [0.59, 0.94]) indicating that these EF factors have the same genetic underpinnings but may be differentially influenced by environmental factors. We examined phenotypic, genetic, and environmental correlations between the EF factors and a general cognitive ability factor (g) assessed in the lab and found similar relationships between Lab Common EF and g and Online Common EF and g. Overall, these results suggest that Common EF factors assessed in different contexts are highly related to each other and similarly related to other cognitive outcomes. These findings indicate that online task-based EF assessments could be a viable strategy for increasing sample sizes in large-scale studies, particularly genetically informed studies. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

A d factor? Understanding trait distractibility and its relationships with ADHD symptomatology and hyperfocus

People differ substantially in their vulnerability to distraction. Yet, many types of distractions exist, from external stimulation to internal thoughts. How should we characterize individual differences in their distractibility? Two samples of adult participants (total N = 1220) completed a large battery of questionnaires assessing different facets of real-world distractibility. Latent modeling revealed that these measures could be explained by three correlated-yet-distinct factors: external distraction, unwanted intrusive thoughts, and mind-wandering. Importantly, about 80% of the total variance in these three factors could be explained by a single higher-order factor (d) that could be construed in terms of a person's general distractibility, and this general distractibility model was replicated across the two samples. We then applied the general distractibility model to understand the nature of ADHD symptomatology and hyperfocus (an intense state of long-lasting and highly focused attention). d was substantially associated with self-reported ADHD symptoms. Interestingly, d was also positively associated with hyperfocus, suggesting that hyperfocus may, to some degree, reflect attention problems. These results also show marked consistencies across the two samples. Overall, the study provides an important step toward a comprehensive understanding of individual differences in distractibility and related constructs.

Neurocognitive Functioning in Patients with Painful Temporomandibular Disorders

Aim

To investigate psychosocial factors in painful TMD (pTMD) which could have consequences for mastering chronic pain.

Methods

Our study included 22 patients (20 women, 2 men) with pTMD, refractory to conservative treatment, and 19 healthy controls. The control group was matched for gender, age, and educational level, and IQ tested on the Wechsler Abbreviated Scale of Intelligence. Neurocognitive function was tested with the Color-Word Interference Test (CWIT). Pain intensity was reported according to the General Pain Intensity Questionnaire (GPI), using the Numeric Rating Scale (NRS). Self-perceived cognitive difficulties were reported by the Perceived Deficits Questionnaire-Depression 5-item (PDQ-5). Two measures of rumination were included: the Rumination-Reflection Questionnaire (RRQ) and the Ruminative Response Scale (RRS). The Montgomery Åsberg Depression Rating Scale Self-report (MADRS-S) was used to measure depressive symptoms, and the Oral Health Impact Profile-TMD (OHIP-TMD) to measure QoL related to oral health.

Results

There were no statistical differences in age (median pTMD: 55 years, median control: 53 years), educational level, and IQ between pTMD and controls. Median pain intensity in pTMD was NRS 8 at maximum and the median pain duration was 18 years. There were no significant differences in CWIT between pTMD and controls. Self-perceived cognitive function (PDQ) was significantly poorer in pTMD. Rumination scores from both measures, and the depression score from MADRS, were significantly higher in pTMD. The OHIP-TMD score revealed a significantly poorer QoL in pTMD.

Conclusion

The group of pTMD patients have self-perceived cognitive difficulties that may make it more difficult to master chronic pain and common everyday tasks. They reported significantly more self-perceived cognitive difficulties, higher rumination, more depressive symptoms, and lower QoL compared to healthy controls, suggesting that these psychosocial factors could be targeted in treatment and interventions. However, the tested neurocognitive performance was equivalent to the control group.

Improvement in self-reported cognitive functioning but not in rumination following online working memory training in a two-year follow-up study of remitted major depressive disorder

Self-reported subjective cognitive difficulties (subjective deficits) and rumination are central residual cognitive symptoms following major depressive disorder (MDD). These are risk factors for more a severe course of illness, and despite the considerable relapse risk of MDD, few interventions target the remitted phase, a high-risk period for developing new episodes. Online distribution of interventions could help close this gap. Computerized working memory training (CWMT) shows promising results, but findings are inconclusive regarding which symptoms improve following this intervention, and its long-term effects. This study reports results from a longitudinal open-label two-year follow-up pilot-study of self-reported cognitive residual symptoms following 25 sessions (40 min), five times a week of a digitally delivered CWMT intervention. Ten of 29 patients remitted from MDD completed two-year follow-up assessment. Significant large improvements in self-reported cognitive functioning on the behavior rating inventory of executive function-adult version appeared after two-years (d = 0.98), but no significant improvements were found in rumination (d < 0.308) measured by the ruminative responses scale. The former showed moderate non-significant associations to improvement in CWMT both post-intervention (r = 0.575) and at two-year follow-up (r = 0.308). Strengths in the study included a comprehensive intervention and long follow-up time. Limitations were small sample and no control group. No significant differences between completers and drop-outs were found, however, attrition effects cannot be ruled out and demand characteristics could influence findings. Results suggested lasting improvements in self-reported cognitive functioning following online CWMT. Controlled studies with larger samples should replicate these promising preliminary findings.

Conditions under which college students cease learning

Introduction

Effective learning involves the acquisition of information toward a goal and cessation upon reaching that goal. Whereas the process of learning acquisition is well understood, comparatively little is known about how or when learning ceases under naturalistic, open-ended learning conditions in which the criterion for performance is not specified. Ideally, learning should cease once there is no progress toward the goal, although this has never been directly tested in human learners. The present set of experiments explored the conditions under which college students stopped attempting to learn a series of inductive perceptual discrimination problems.

Methods

Each problem varied by whether it was solvable and had a criterion for success. The first problem was solvable and involved a pre-determined criterion. The second problem was solvable, but with no criterion for ending the problem so that learners eventually achieved a highly accurate level of performance (overlearning). The third problem was unsolvable as the correct answer varied randomly across features. Measures included the number of trials attempted and the outcome of each problem.

Results and Discussion

Results revealed that college students rarely ceased learning in the overlearning or unsolvable problems even though there was no possibility for further progress. Learning cessation increased only by manipulating time demands for completion or reducing the opportunity for reinforcement. These results suggest that human learners show laudable, but inefficient and unproductive, attempts to master problems they should cease.

Individual differences in computational psychiatry: a review of current challenges

Bringing precision to the understanding and treatment of mental disorders requires instruments for studying clinically relevant individual differences. One promising approach is the development of computational assays: integrating computational models with cognitive tasks to infer latent patient-specific disease processes in brain computations. While recent years have seen many methodological advancements in computational modelling and many cross-sectional patient studies, much less attention has been paid to basic psychometric properties (reliability and construct validity) of the computational measures provided by the assays. In this review, we assess the extent of this issue by examining emerging empirical evidence. We find that many computational measures suffer from poor psychometric properties, which poses a risk of invalidating previous findings and undermining ongoing research efforts using computational assays to study individual (and even group) differences. We provide recommendations for how to address these problems and, crucially, embed them within a broader perspective on key developments that are needed for translating computational assays to clinical practice.

Why doesn't executive function training improve academic achievement? Rethinking individual differences, relevance, and engagement from a contextual framework

Performance on lab assessments of executive functions predicts academic achievement and other positive life outcomes. A primary goal of research on executive functions has been to design interventions that improve outcomes like academic achievement by improving executive functions. These interventions typically involve extensive practice on abstract lab-based tasks and lead to improvements on these practiced tasks. However, interventions rarely improve performance on non-practiced tasks and rarely benefit outcomes like academic achievement. Contemporary frameworks of executive function development suggest that executive functions develop and are engaged within personal, social, historical, and cultural contexts. Abstract lab-based tasks do not well-capture the real-world contexts that require executive functions and should not be expected to provide generalized benefits outside of the lab. We propose a perspective for understanding individual differences in performance on executive function assessments that focuses on contextual influences on executive functions. We extend this contextual approach to training executive function engagement, rather than training executive functions directly. First, interventions should incorporate task content that is contextually relevant to the targeted outcome. Second, interventions should encourage engaging executive functions through reinforcement and contextual relevance, which may better translate to real-world outcomes than training executive functions directly. While such individualized executive functions interventions do not address systemic factors that greatly impact outcomes like academic achievement, given the extensive resources devoted to improving executive functions, we hypothesize that interventions designed to encourage children's engagement of executive functions hold more promise for impacting real-world outcomes than interventions designed to improve executive function capacities.

Large studies reveal how reference bias limits policy applications of self-report measures

There is growing policy interest in identifying contexts that cultivate self-regulation. Doing so often entails comparing groups of individuals (e.g., from different schools). We show that self-report questionnaires-the most prevalent modality for assessing self-regulation-are prone to reference bias, defined as systematic error arising from differences in the implicit standards by which individuals evaluate behavior. In three studies, adolescents (N = 229,685) whose peers performed better academically rated themselves lower in self-regulation and held higher standards for self-regulation. This effect was not observed for task measures of self-regulation and led to paradoxical predictions of college persistence 6 years later. These findings suggest that standards for self-regulation vary by social group, limiting the policy applications of self-report questionnaires.

Executive functioning and spoken language skills in young children with hearing aids and cochlear implants: Longitudinal findings

Deaf or hard-of-hearing (DHH) children who use auditory-oral communication display considerable variability in spoken language and executive functioning outcomes. Furthermore, language and executive functioning skills are strongly associated with each other in DHH children, which may be relevant for explaining this variability in outcomes. However, longitudinal investigations of language and executive functioning during the important preschool period of development in DHH children are rare. This study examined the predictive, reciprocal associations between executive functioning and spoken language over a 1-year period in samples of 53 DHH and 59 typically hearing (TH) children between ages 3-8 years at baseline. Participants were assessed on measures of receptive spoken language (vocabulary, sentence comprehension, and following spoken directions) and caregiver-completed executive functioning child behavior checklists during two in-person home visits separated by 1 year. In the sample of DHH children, better executive functioning at baseline (Time 1) was associated with better performance on the higher-order language measures (sentence comprehension and following spoken directions) 1 year later (Time 2). In contrast, none of the Time 1 language measures were associated with better executive functioning in Time 2 in the DHH sample. TH children showed no significant language-executive functioning correlations over the 1-year study period. In regression analyses controlling for Time 1 language scores, Time 1 executive functioning predicted Time 2 language outcomes in the combined DHH and TH samples, and for vocabulary, that association was stronger in the DHH than in the TH sample. In contrast, after controlling for Time 1 executive functioning, none of the regression analyses predicting Time 2 executive functioning from Time 1 language were statistically significant. These results are the first findings to demonstrate that everyday parent-rated executive functioning behaviors predict basic (vocabulary) and higher-order (comprehension, following directions) spoken language development 1 year later in young (3-8 year old) DHH children, even after accounting for initial baseline language skills.

Age-Related Variance in Performance versus Ratings of Attention and Impulse Regulation in Children: Implications for the Assessment of ADHD

Executive function task (EF) deficits are hypothesized to underlie difficulties with self-regulation. However, tasks assessing EF impairments have only been weakly correlated with rating scales that index self-regulation difficulties. A community sample of children and youth aged between 8 and 20 years old were assessed longitudinally. Growth curve analyses and correlations were conducted to better understand how these two types of measures relate to one another across development, as well as the impact of age-related variance. EF was assessed using the Stroop Task and Trail Making test and behavioral ratings of self-regulation were captured using the SWAN scale. EF task performance improved steeply until age 14–15, whereas the SWAN Scale showed small age-related decreases. EF task performance was moderately correlated with age among 8–13-year-olds and to a lesser extent among 14–20-year-olds. SWAN scores were not significantly related to age in either group. Correlations were similar in an ADHD “at-risk” subgroup. EF task performance and parent ratings of attention regulation have different developmental trajectories, which may partly explain why correlations are low to modest in these samples. In particular, age-related variance is an important methodological consideration with significant implications for the assessment of self-regulation in children and youth with ADHD.