Investigating the ‘g’-saturation of various stratum-two factors using automatic item generation

Graph Mapping: A novel and simple test to validly assess fluid reasoning

We present Graph Mapping - a simple and effective computerized test of fluid intelligence (reasoning ability). The test requires structure mapping - a key component of the reasoning process. Participants are asked to map a pair of corresponding nodes across two mathematically isomorphic but visually different graphs. The test difficulty can be easily manipulated - the more complex structurally and dissimilar visually the graphs, the higher response error rate. Graph Mapping offers high flexibility in item generation, ranging from trivial to extremally difficult items, supporting progressive item sequences suitable for correlational studies. It also allows multiple item instances (clones) at a fixed difficulty level as well as full item randomization, both particularly suitable for within-subject experimental designs, longitudinal studies, and adaptive testing. The test has short administration times and is unfamiliar to participants, yielding practical advantages. Graph Mapping has excellent psychometric properties: Its convergent validity and reliability is comparable to the three leading traditional fluid reasoning tests. The convenient software allows a researcher to design the optimal test variant for a given study and sample. Graph Mapping can be downloaded from: https://osf.io/wh7zv/.

Fluid Intelligence Emerges from Representing Relations

Based on recent findings in cognitive neuroscience and psychology as well as computational models of working memory and reasoning, I argue that fluid intelligence (fluid reasoning) can amount to representing in the mind the key relation(s) for the task at hand. Effective representation of relations allows for enormous flexibility of thinking but depends on the validity and robustness of the dynamic patterns of argument-object (role-filler) bindings, which encode relations in the brain. Such a reconceptualization of the fluid intelligence construct allows for the simplification and purification of its models, tests, and potential brain mechanisms.

Programming experience associated with neural efficiency during figural reasoning

In the present study, we investigated neural processes underlying programming experience. Individuals with high programming experience might develop a form of computational thinking, which they can apply on complex problem-solving tasks such as reasoning tests. Therefore, N = 20 healthy young participants with previous programming experience and N = 21 participants without any programming experience performed three reasoning tests: Figural Inductive Reasoning (FIR), Numerical Inductive Reasoning (NIR), Verbal Deductive Reasoning (VDR). Using multi-channel EEG measurements, task-related changes in alpha and theta power as well as brain connectivity were investigated. Group differences were only observed in the FIR task. Programmers showed an improved performance in the FIR task as compared to non-programmers. Additionally, programmers exhibited a more efficient neural processing when solving FIR tasks, as indicated by lower brain activation and brain connectivity especially in easy tasks. Hence, behavioral and neural measures differed between groups only in tasks that are similar to mental processes required during programming, such as pattern recognition and algorithmic thinking by applying complex rules (FIR), rather than in tasks that require more the application of mathematical operations (NIR) or verbal tasks (VDR). Our results provide new evidence for neural efficiency in individuals with higher programming experience in problem-solving tasks.

Introducing a Computerized Figural Memory Test Based on Automatic Item Generation: An Analysis With the Rasch Poisson Counts Model

An automatic item generator for figural memory test items called figumem was developed. It is available in R. A cognitive model allowed the generation of hypothetically parallel items within three difficulty levels determined by visual information load. In a pilot study, participants solved three items for each level of visual load. Within an item response theory approach, the Rasch Poisson counts model and modifications of it were fitted to the data. Results showed overall satisfying fit. Visual information load explained most of the variance in item difficulty. Differences in difficulty between items of the same family were comparatively low, displaying the utility of the item generator for the creation of parallel test forms. Implications, limitations, and suggestions for the use and extensions of figumem are discussed.

Externalizing behaviour, task-focused behaviour, and academic achievement: An indirect relation?

BACKGROUND

Although many studies have suggested that students' externalizing (aggressive and rule-breaking) behaviour is detrimental to their academic achievement, the underlying mechanisms have rarely been investigated.

AIMS

We conducted a longitudinal investigation of whether the negative relation between externalizing behaviour and academic achievement operationalized as grades and test scores is mediated by students' task-focused behaviour while controlling for the effects of initial achievement and general cognitive abilities. We conducted separate analyses for different rating perspectives (i.e., parents and teachers) on students' externalizing behaviour to investigate the robustness of effects and determined whether gender moderated the mediation.

SAMPLE

Participants were N = 1,039 students in 55 classes from different school types who were followed from fifth to ninth grade.

METHOD

In fifth grade, parents and teachers rated students' externalizing behaviour, and students were administered standardized tests in mathematics, German, and general cognitive abilities. In seventh grade, teachers rated students' task-focused behaviour. In ninth grade, students were again administered standardized tests in mathematics and German, and their grades were obtained from school registries.

RESULTS

Structural equation models consistently revealed indirect effects of externalizing behaviour via task-focused behaviour on grades and test scores beyond effects of initial achievement and general cognitive abilities. Result patterns were similar for parents' and teachers' ratings of externalizing behaviour and male and female students.

CONCLUSIONS

This study extends knowledge about the negative relation between externalizing behaviour and academic achievement in adolescents by showing that there is an indirect relation through task-focused behaviour. Implications are discussed.

The quadratic relationship between difficulty of intelligence test items and their correlations with working memory

Fluid intelligence (Gf) is a crucial cognitive ability that involves abstract reasoning in order to solve novel problems. Recent research demonstrated that Gf strongly depends on the individual effectiveness of working memory (WM). We investigated a popular claim that if the storage capacity underlay the WM–Gf correlation, then such a correlation should increase with an increasing number of items or rules (load) in a Gf-test. As often no such link is observed, on that basis the storage-capacity account is rejected, and alternative accounts of Gf (e.g., related to executive control or processing speed) are proposed. Using both analytical inference and numerical simulations, we demonstrated that the load-dependent change in correlation is primarily a function of the amount of floor/ceiling effect for particular items. Thus, the item-wise WM correlation of a Gf-test depends on its overall difficulty, and the difficulty distribution across its items. When the early test items yield huge ceiling, but the late items do not approach floor, that correlation will increase throughout the test. If the early items locate themselves between ceiling and floor, but the late items approach floor, the respective correlation will decrease. For a hallmark Gf-test, the Raven-test, whose items span from ceiling to floor, the quadratic relationship is expected, and it was shown empirically using a large sample and two types of WMC tasks. In consequence, no changes in correlation due to varying WM/Gf load, or lack of them, can yield an argument for or against any theory of WM/Gf. Moreover, as the mathematical properties of the correlation formula make it relatively immune to ceiling/floor effects for overall moderate correlations, only minor changes (if any) in the WM–Gf correlation should be expected for many psychological tests.

Intelligence, creativity, and cognitive control: The common and differential involvement of executive functions in intelligence and creativity

Intelligence and creativity are known to be correlated constructs suggesting that they share a common cognitive basis. The present study assessed three specific executive abilities – updating, shifting, and inhibition – and examined their common and differential relations to fluid intelligence and creativity (i.e., divergent thinking ability) within a latent variable model approach. Additionally, it was tested whether the correlation of fluid intelligence and creativity can be explained by a common executive involvement. As expected, fluid intelligence was strongly predicted by updating, but not by shifting or inhibition. Creativity was predicted by updating and inhibition, but not by shifting. Moreover, updating (and the personality factor openness) was found to explain a relevant part of the shared variance between intelligence and creativity. The findings provide direct support for the executive involvement in creative thought and shed further light on the functional relationship between intelligence and creativity.

•

Latent variable analysis relating executive functions, intelligence and creativity

•

Intelligence is predicted by updating, but not inhibition or shifting ability.

•

Creativity is predicted by updating and inhibition, but not shifting ability.

•

Updating explains a relevant part of the intelligence–creativity relationship.

Neural efficiency as a function of task demands

The neural efficiency hypothesis describes the phenomenon that brighter individuals show lower brain activation than less bright individuals when working on the same cognitive tasks. The present study investigated whether the brain activation-intelligence relationship still applies when more versus less intelligent individuals perform tasks with a comparable person-specific task difficulty. In an fMRI-study, 58 persons with lower (n = 28) or respectively higher (n = 30) intelligence worked on simple and difficult inductive reasoning tasks having the same person-specific task difficulty. Consequently, less bright individuals received sample-based easy and medium tasks, whereas bright subjects received sample-based medium and difficult tasks. This design also allowed a comparison of lower versus higher intelligent individuals when working on the same tasks (i.e. sample-based medium task difficulty). In line with expectations, differences in task performance and in brain activation were only found for the subset of tasks with the same sample-based task difficulty, but not when comparing tasks with the same person-specific task difficulty. These results suggest that neural efficiency reflects an (ability-dependent) adaption of brain activation to the respective task demands.

Using Automatic Item Generation to Simultaneously Construct German and English Versions of a Word Fluency Test

There has been an increased interest in psychometric tests that enable the comparison of test scores across different language versions. From a psychometric point of view, this endeavor requires empirical evidence on the full score equivalence of these measures. However, this aim is often rather difficult to achieve. This is particularly true for the assessment of verbal abilities. In the present article, we will outline how automatic item generation can be used to overcome some of the problems researchers face in constructing psychometric tests that are valid in multilingual assessment settings. The feasibility of this approach is illustrated in the context of the construction and empirical evaluation of a German and English word fluency test. The results of the various studies reported in this article indicate that automatic item generation enables the generation of a sufficient amount of word fluency items exhibiting a high psychometric quality in both languages. Furthermore, the item pool constructed for both languages can be linked to each other using a common set of anchor items that are identical to each other with regard to their conceptual, linguistic, and psychometric characteristics, thereby facilitating cross-lingual comparisons of word fluency performance.