Convergent and Predictive Validity of the Big Five Factors Assessed with SingleStimulus and Quasi-Ipsative Questionnaires

Counterproductive Academic Behaviors and Academic Performance: A Meta-Analysis and a Path Analysis Model

Counterproductive academic behaviors (CAB) are a complex phenomenon that affects academic institutions in multiple geographical areas with different cultures, values, and social norms. The high incidence of CAB causes problems of critical importance that transcend the educational domain. The current study aims to contribute to the knowledge of the CAB consequences by focusing on its impact on academic performance (AP). For this purpose, a meta-analysis was conducted in order to examine the relationship between CAB, its facets, and AP. The results show that overall CAB and students' performance are negatively related with a true effect size of ρ = −0.40 (K = 231, N = 127,269). Particularly, absenteeism appeared to be the facet most strongly related to AP (ρ = −0.48, K = 117, N = 69,453). A meta-analytic path analysis model was carried out in order to test the predictive validity of CAB, students' personality characteristics, and intelligence on AP. Results show that conscientiousness and cognitive intelligence have a negative relationship with CAB (β = −0.28 and β = −0.20, respectively), and that conscientiousness, openness to experience, intelligence, and CAB can explain 58% of AP true variance. Meta-analyses of moderator variables and hierarchical meta-analyses are also presented. The implications for research and practice are discussed at the end.

A Meta-Analysis of the Faking Resistance of Forced-Choice Personality Inventories

This study presents a comprehensive meta-analysis on the faking resistance of forced-choice (FC) inventories. The results showed that (1) FC inventories show resistance to faking behavior; (2) the magnitude of faking is higher in experimental contexts than in real-life selection processes, suggesting that the effects of faking may be, in part, a laboratory phenomenon; and (3) quasi-ipsative FC inventories are more resistant to faking than the other FC formats. Smaller effect sizes were found for conscientiousness when the quasi-ipsative format was used (δ = 0.49 vs. δ = 1.27 for ipsative formats). Also, the effect sizes were smaller for the applicant samples than for the experimental samples. Finally, the contributions and practical implications of these findings are discussed.

A genetic algorithm for optimal assembly of pairwise forced-choice questionnaires

The use of multidimensional forced-choice questionnaires has been proposed as a means of improving validity in the assessment of non-cognitive attributes in high-stakes scenarios. However, the reduced precision of trait estimates in this questionnaire format is an important drawback. Accordingly, this article presents an optimization procedure for assembling pairwise forced-choice questionnaires while maximizing posterior marginal reliabilities. This procedure is performed through the adaptation of a known genetic algorithm (GA) for combinatorial problems. In a simulation study, the efficiency of the proposed procedure was compared with a quasi-brute-force (BF) search. For this purpose, five-dimensional item pools were simulated to emulate the real problem of generating a forced-choice personality questionnaire under the five-factor model. Three factors were manipulated: (1) the length of the questionnaire, (2) the relative item pool size with respect to the questionnaire’s length, and (3) the true correlations between traits. The recovery of the person parameters for each assembled questionnaire was evaluated through the squared correlation between estimated and true parameters, the root mean square error between the estimated and true parameters, the average difference between the estimated and true inter-trait correlations, and the average standard error for each trait level. The proposed GA offered more accurate trait estimates than the BF search within a reasonable computation time in every simulation condition. Such improvements were especially important when measuring correlated traits and when the relative item pool sizes were higher. A user-friendly online implementation of the algorithm was made available to the users.

Criterion Validity of Cognitive Reflection for Predicting Job Performance and Training Proficiency: A Meta-Analysis

This article presents a meta-analysis of the validity of cognitive reflection (CR) for predicting job performance and training proficiency. It also examines the incremental validity of CR over cognitive intelligence (CI) for predicting these two occupational criteria. CR proved to be an excellent predictor of job performance and training proficiency, and the magnitude of the true validity was very similar across the two criteria. Results also showed that the type of CR is not a moderator of CR validity. We also found that CR showed incremental variance over CI for the explanation of job performance, although the magnitude of the contribution is small. However, CR shows practically no incremental validity over CI validity in the explanation of training proficiency. Finally, we discuss the implications of these findings for the research and practice of personnel selection.