Searching for G: A New Evaluation of SPM-LS Dimensionality

Modeling Sequential Dependencies in Progressive Matrices: An Auto-Regressive Item Response Theory (AR-IRT) Approach

Measurement models traditionally make the assumption that item responses are independent from one another, conditional upon the common factor. They typically explore for violations of this assumption using various methods, but rarely do they account for the possibility that an item predicts the next. Extending the development of auto-regressive models in the context of personality and judgment tests, we propose to extend binary item response models-using, as an example, the 2-parameter logistic (2PL) model-to include auto-regressive sequential dependencies. We motivate such models and illustrate them in the context of a publicly available progressive matrices dataset. We find an auto-regressive lag-1 2PL model to outperform a traditional 2PL model in fit as well as to provide more conservative discrimination parameters and standard errors. We conclude that sequential effects are likely overlooked in the context of cognitive ability testing in general and progressive matrices tests in particular. We discuss extensions, notably models with multiple lag effects and variable lag effects.

Brain structural parameters correlate with University Selection Test outcomes in Chilean high school graduates

How well students learn and perform in academic contexts is a focus of interest for the students, their families, and the entire educational system. Although evidence has shown that several neurobiological factors are involved in scholastic achievement (SA), specific brain measures associated with academic outcomes and whether such associations are independent of other factors remain unclear. This study attempts to identify the relationship between brain structural parameters, and the Chilean national University Selection Test (PSU) results in high school graduates within a multidimensional approach that considers socio-economic, intellectual, nutritional, and demographic variables. To this end, the brain morphology of a sample of 102 students who took the PSU test was estimated using Magnetic Resonance Imaging. Anthropometric parameters, intellectual ability (IA), and socioeconomic status (SES) were also measured. The results revealed that, independently of sex, IA, gray matter volume, right inferior frontal gyrus thickness, and SES were significantly associated with SA. These findings highlight the role of nutrition, health, and socioeconomic variables in academic success.

Analysis of an Intelligence Dataset

It is perhaps popular belief—at least among non-psychometricians—that there is a unique or standard way to investigate the psychometric qualities of tests [...]

Investigating the performance of exploratory graph analysis and traditional techniques to identify the number of latent factors: A simulation and tutorial

Exploratory graph analysis (EGA) is a new technique that was recently proposed within the framework of network psychometrics to estimate the number of factors underlying multivariate data. Unlike other methods, EGA produces a visual guide-network plot-that not only indicates the number of dimensions to retain, but also which items cluster together and their level of association. Although previous studies have found EGA to be superior to traditional methods, they are limited in the conditions considered. These issues are addressed through an extensive simulation study that incorporates a wide range of plausible structures that may be found in practice, including continuous and dichotomous data, and unidimensional and multidimensional structures. Additionally, two new EGA techniques are presented: one that extends EGA to also deal with unidimensional structures, and the other based on the triangulated maximally filtered graph approach (EGAtmfg). Both EGA techniques are compared with 5 widely used factor analytic techniques. Overall, EGA and EGAtmfg are found to perform as well as the most accurate traditional method, parallel analysis, and to produce the best large-sample properties of all the methods evaluated. To facilitate the use and application of EGA, we present a straightforward R tutorial on how to apply and interpret EGA, using scores from a well-known psychological instrument: the Marlowe-Crowne Social Desirability Scale. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

A Mokken Scale Analysis of the Last Series of the Standard Progressive Matrices (SPM-LS)

Raven's Standard Progressive Matrices Raven (1941) is a widely used 60-item long measure of general mental ability. It was recently suggested that, for situations where taking this test is too time consuming, a shorter version, comprised of only the last series of the Standard Progressive Matrices (the SPM-LS; Myszkowski and Storme (2018)) could be used, while preserving satisfactory psychometric properties Garcia-Garzon et al. (2019); Myszkowski and Storme (2018). In this study, I argue, however, that some psychometric properties have been left aside by previous investigations. As part of this special issue on the reinvestigation of Myszkowski and Storme's dataset, I propose to use the non-parametric Item Response Theory framework of Mokken Scale Analysis Mokken (1971, 1997) and its current developments Sijtsma and van der Ark (2017) to shed new light on the SPM-LS. Extending previous findings, this investigation indicated that the SPM-LS had satisfactory scalability ( H = 0 . 469 ), local independence and reliability ( M S = 0 . 841 , L C R C = 0 . 874 ). Further, all item response functions were monotonically increasing, and there was overall evidence for invariant item ordering ( H T = 0 . 475 ), supporting the Double Monotonicity Model Mokken (1997). Item 1, however, appeared problematic in most analyses. I discuss the implications of these results, notably regarding whether to discard item 1, whether the SPM-LS sum scores can confidently be used to order persons, and whether the invariant item ordering of the SPM-LS allows to use a stopping rule to further shorten test administration.

Diagnosing a 12-Item Dataset of Raven Matrices: With Dexter

We analyze a 12-item version of Raven’s Standard Progressive Matrices test, traditionally scored with the sum score. We discuss some important differences between assessment in practice and psychometric modelling. We demonstrate some advanced diagnostic tools in the freely available R package, dexter. We find that the first item in the test functions badly—at a guess, because the subjects were not given exercise items before the live test.