A general factor of intelligence fails to account for changes in tests’ scores after cognitive practice: A longitudinal multi-group latent-variable study

Personality change through a digital-coaching intervention: Using measurement invariance testing to distinguish between trait domain, facet, and nuance change

Recent intervention research has shown that personality traits can be modified through psychological interventions. However, it is unclear whether reported effects represent changes in the trait domain or only some facets or items. Using data ( N = 552) from a recent intervention trial, the present study examined the effects of a digital-coaching intervention on self- and observer-reported personality facets and items. We focused on participants who wanted to decrease in Negative Emotionality, increase in Conscientiousness or increase in Extraversion. We used measurement invariance testing to examine which level of the trait domain hierarchy changed during the intervention. For the self-reports, we found some heterogeneity in the effects on all three trait domains, but most notably Extraversion and Conscientiousness. Specifically, participants reported to increase strongly on sociability (Extraversion), and moderately on productiveness and organization (Conscientiousness), but not on the other facets of these trait domains. Observers generally reported small but non-significant changes, with no scalar invariance violations except for Extraversion. Overall, this suggests considerable heterogeneity in intervention-related personality change that can be overlooked if only focusing on the trait domain level. We discuss the relevance of measurement invariance testing and measurement approaches for personality development and intervention research.

You Can Play the Game Without Knowing the Rules – But You’re Better Off Knowing Them

Abstract. Due to their high item difficulties and excellent psychometric properties, construction-based figural matrices tasks are of particular interest when it comes to high-stakes testing. An important prerequisite is that test preparation – which is likely to occur in this context – does not impair test fairness or item properties. The goal of this study was to provide initial evidence concerning the influence of test preparation. We administered test items to a sample of N = 882 participants divided into two groups, but only one group was given information about the rules employed in the test items. The probability of solving the items was significantly higher in the test preparation group than in the control group ( M = 0.61, SD = 0.19 vs. M = 0.41, SD = 0.25; t(54) = 3.42, p = .001; d = .92). Nevertheless, a multigroup confirmatory factor analysis, as well as a differential item functioning analysis, indicated no differences between the item properties in the two groups. The results suggest that construction-based figural matrices are suitable in the context of high-stakes testing when all participants are provided with test preparation material so that test fairness is ensured.

How to Get Better: Taking Notes Mediates the Effect of a Video Tutorial on Number Series

In recent studies, test-score increases have been shown in rule-based intelligence test tasks, such as number series, after watching a corresponding video tutorial. An open question remains regarding the mechanisms involved. Specifically, taking notes to describe the relations between numbers might be linked to test scores, and is hypothesized to mediate the effect of a number series video tutorial on number series test scores. Therefore, an experimental group (EG) watching a number series video tutorial (n = 58) was compared with a control group (CG) watching an irrelevant tutorial (n = 52) before working on number series items. Results revealed higher number series scores in the EG than the CG (d = .48), more items with provided notes in the EG than in the CG (d = .41), and substantial correlations between the number of items with notes and the number series sum scores in both groups (EG: r = .66; CG: r = .75). The effect of the video tutorial on the number series sum score was mediated by the number of items with notes (indirect effect = 3.41, SE = 1.74). Theoretical and practical implications as well as future research directions are discussed.

Test Preparation in Figural Matrices Tests: Focus on the Difficult Rules

It is well documented that training the rules employed in figural matrices tests enhances test performance. Previous studies only compare experimental conditions in which all or no rules were trained and therefore ignore the particular influence of knowledge about the easy and difficult rules. With the current study, we wanted to provide some first insights into this topic. Respondents were assigned to four groups that received training for no rules, only the easy rules, only the difficult rules, or for all rules. The results show that a training only for the difficult rules was more effective than the other trainings. This applies also to performance in the easy rules that were actually not part of the training. A possible explanation for this finding is a facilitation of the solution process that is primarily driven by knowledge about the difficult rules. In conclusion, our results demonstrate that taking differences between the rules into account may provide a deeper understanding of the effects of trainings for figural matrices tests.

Persistence and Fade-Out of Educational-Intervention Effects: Mechanisms and Potential Solutions

Some environmental influences, including intentional interventions, have shown persistent effects on psychological characteristics and other socially important outcomes years and even decades later. At the same time, it is common to find that the effects of life events or interventions diminish and even disappear completely, a phenomenon known as fadeout. We review the evidence for persistence and fadeout, drawing primarily on evidence from educational interventions. We conclude that 1) fadeout is widespread, and often co-exists with persistence; 2) fadeout is a substantive phenomenon, not merely a measurement artefact; and 3) persistence depends on the types of skills targeted, the institutional constraints and opportunities within the social context, and complementarities between interventions and subsequent environmental affordances. We discuss the implications of these conclusions for research and policy.

Working Memory Training Does Not Improve Performance on Measures of Intelligence or Other Measures of "Far Transfer": Evidence From a Meta-Analytic Review

It has been claimed that working memory training programs produce diverse beneficial effects. This article presents a meta-analysis of working memory training studies (with a pretest-posttest design and a control group) that have examined transfer to other measures (nonverbal ability, verbal ability, word decoding, reading comprehension, or arithmetic; 87 publications with 145 experimental comparisons). Immediately following training there were reliable improvements on measures of intermediate transfer (verbal and visuospatial working memory). For measures of far transfer (nonverbal ability, verbal ability, word decoding, reading comprehension, arithmetic) there was no convincing evidence of any reliable improvements when working memory training was compared with a treated control condition. Furthermore, mediation analyses indicated that across studies, the degree of improvement on working memory measures was not related to the magnitude of far-transfer effects found. Finally, analysis of publication bias shows that there is no evidential value from the studies of working memory training using treated controls. The authors conclude that working memory training programs appear to produce short-term, specific training effects that do not generalize to measures of "real-world" cognitive skills. These results seriously question the practical and theoretical importance of current computerized working memory programs as methods of training working memory skills.