The Five-Factor Model, forced-choice personality inventories and performance: A comprehensive meta-analysis of academic and occupational validity studies

Linear Factor Analytic Thurstonian Forced-Choice Models: Current Status and Issues

Thurstonian forced-choice modeling is considered to be a powerful new tool to estimate item and person parameters while simultaneously testing the model fit. This assessment approach is associated with the aim of reducing faking and other response tendencies that plague traditional self-report trait assessments. As a result of major recent methodological developments, the estimation of normative trait scores has become possible in addition to the computation of only ipsative scores. This opened up the important possibility of comparisons between individuals with forced-choice assessment procedures. With item response theory (IRT) methods, a multidimensional forced-choice (MFC) format has also been proposed to estimate individual scores. Customarily, items to assess different traits are presented in blocks, often triplets, in applications of the MFC, which is an efficient form of item presentation but also a simplification of the original models. The present study provides a comprehensive review of the present status of Thurstonian forced-choice models and their variants. Critical features of the current models, especially the block models, are identified and discussed. It is concluded that MFC modeling with item blocks is highly problematic and yields biased results. In particular, the often-recommended presentation of blocks with items that are keyed in different directions of a trait proves to be counterproductive considering the goal to reduce response tendencies. The consequences and implications of the highlighted issues are further discussed.

Decoding career success: A personality-based analysis of data science Professional based on ANFIS modeling

Career selection is one of the most important decisions every person faces in their life. Finding the right career path can be a complicated task, particularly in choosing careers with similarly required proficiencies. One of the critical factors affecting a person's career success is their personality, and taking account of this factor is of paramount importance. This study uses the NEO-FFI questionnaire to find personality patterns of software engineering and data science experts based on the Big Five personality traits: Neuroticism, extraversion, openness to experience, agreeableness, and conscientiousness. Afterward, an ANFIS (Adaptive Network-Based Inference System) is conducted using the experts' personality data to match the participants of these fields with their corresponding choices. This study demonstrated that data scientists and software engineers score higher in conscientiousness and agreeableness, respectively. Also, data experts have higher scores in all traits overall. In the end, the ANFIS is tested with another similar dataset and the prediction accuracy of the model is measured.

Though Forced, Still Valid: Examining the Psychometric Performance of Forced-Choice Measurement of Personality in Children and Adolescents

Unveiling the roles personality plays during childhood and adolescence necessitates its accurate measurement, commonly using traditional Likert-type (LK) scales. However, this format is susceptible to various response biases, which can be particularly prevalent in children and adolescents, thus likely undermining measurement accuracy. Forced-choice (FC) scales appear to be a promising alternative because they are largely free from these biases by design. However, some argue that the FC format may not perform satisfactorily in children and adolescents due to its complexity. Little empirical evidence exists regarding the suitability of the FC format for children and adolescents. As such, the current study examined the psychometric performance of an FC measure of the Big Five personality factors in three children and adolescent samples: 5th to 6th graders (N = 428), 7th to 8th graders (N = 449), and 10th to 11th graders (N = 555). Across the three age groups, the FC scale demonstrated a better fit to the Big Five model and better discriminant validity in comparison to the LK counterpart. Personality scores from the FC scale also converged well with those from the LK scale and demonstrated high reliability as well as sizable criterion-related validity. Furthermore, the FC scale had more invariant statements than its LK counterpart across age groups. Overall, we found good evidence showing that FC measurement of personality is suitable for children and adolescents.

An Item Response Theory Model for Incorporating Response Times in Forced-Choice Measures

Forced-choice (FC) measures have been widely used in many personality or attitude tests as an alternative to rating scales, which employ comparative rather than absolute judgments. Several response biases, such as social desirability, response styles, and acquiescence bias, can be reduced effectively. Another type of data linked with comparative judgments is response time (RT), which contains potential information concerning respondents' decision-making process. It would be challenging but exciting to combine RT into FC measures better to reveal respondents' behaviors or preferences in personality measurement. Given this situation, this study aims to propose a new item response theory (IRT) model that incorporates RT into FC measures to improve personality assessment. Simulation studies show that the proposed model can effectively improve the estimation accuracy of personality traits with the ancillary information contained in RT. Also, an application on a real data set reveals that the proposed model estimates similar but different parameter values compared with the conventional Thurstonian IRT model. The RT information can explain these differences.

Less Evaluative Measures of Personality in Job Applicant Contexts: The Effect on Socially Desirable Responding and Criterion Validity

Researchers have long sought to mitigate the detrimental effects of socially desirable responding on personality assessments in high-stakes contexts. This study investigated the effect of reducing the social desirability of personality items on response distortion and criterion validity in a job applicant context. Using a 2 × 2 repeated measures design, participants (n = 584) completed standard (International Personality Item Pool) and less evaluative (Less Evaluative Five Factor Inventory) measures of Big Five personality in a low-stakes context and then several weeks later in a simulated job applicant context. Self-report criteria with objective answers, including university grades, were also obtained. In general, the less evaluative measure showed less response distortion than the standard measure on some metrics, but not on others. Declines in criterion validity in the applicant context were smaller for the less evaluative measure. In the applicant context, however, validities were similar across the two measures. Correlations across contexts for corresponding traits (e.g., low-stakes extraversion with high-stakes extraversion) were also similar for both measures. In summary, reducing socially desirable item content might slightly reduce the substantive content required to predict criteria in low-stakes contexts, but this effect appears to be partly offset by reduced response distortion for less evaluative measures in applicant contexts.

Moving beyond Likert and Traditional Forced-Choice Scales: A Comprehensive Investigation of the Graded Forced-Choice Format

The graded forced-choice (FC) format has recently emerged as an alternative that may preserve the advantages and overcome the issues of the dichotomous FC measures. The current study presented the first large-scale evaluation of the performance of three types of FC measures (FC2, FC4 and FC5 with 2, 4 and 5 response options, respectively) and compared their performance to their Likert (LK) counterparts (LK2, LK4, and LK5) on (1) psychometric properties, (2) respondent reactions, and (3) susceptibility to response styles. Results showed that, compared to LK measures with the same number of response options, the three FC scales provided better support for the hypothesized factor structure, were perceived as more faking-resistant and cognitive demanding, and were less susceptible to response styles. FC4/5 and LK4/5 demonstrated similarly good reliability, while LK2 provided more reliable scores than FC2. When compared across the three FC measures, FC4 and FC5 displayed comparable psychometric performance and respondent reactions. FC4 exhibited a moderate presence of extreme response style, while FC5 had a weak presence of both extreme and middle response styles. Based on these findings, the study recommends the use of graded FC over dichotomous FC and LK, particularly FC5 when extreme response style is a concern.

Multidimensional Forced-Choice CAT With Dominance Items: An Empirical Comparison With Optimal Static Testing Under Different Desirability Matching

Several forced-choice (FC) computerized adaptive tests (CATs) have emerged in the field of organizational psychology, all of them employing ideal-point items. However, despite most items developed historically follow dominance response models, research on FC CAT using dominance items is limited. Existing research is heavily dominated by simulations and lacking in empirical deployment. This empirical study trialed a FC CAT with dominance items described by the Thurstonian Item Response Theory model with research participants. This study investigated important practical issues such as the implications of adaptive item selection and social desirability balancing criteria on score distributions, measurement accuracy and participant perceptions. Moreover, nonadaptive but optimal tests of similar design were trialed alongside the CATs to provide a baseline for comparison, helping to quantify the return on investment when converting an otherwise-optimized static assessment into an adaptive one. Although the benefit of adaptive item selection in improving measurement precision was confirmed, results also indicated that at shorter test lengths CAT had no notable advantage compared with optimal static tests. Taking a holistic view incorporating both psychometric and operational considerations, implications for the design and deployment of FC assessments in research and practice are discussed.

Investigating the Normativity of Trait Estimates from Multidimensional Forced-Choice Data

The Thurstonian item response model (Thurstonian IRT model) allows deriving normative trait estimates from multidimensional forced-choice (MFC) data. In the MFC format, persons must rank-order items that measure different attributes according to how well the items describe them. This study evaluated the normativity of Thurstonian IRT trait estimates both in a simulation and empirically. The simulation investigated normativity and compared Thurstonian IRT trait estimates to those using classical partially ipsative scoring, from dichotomous true-false (TF) data and rating scale data. The results showed that, with blocks of opposite keyed items, Thurstonian IRT trait estimates were normative in contrast to classical partially ipsative estimates. Unbalanced numbers of items per trait, few opposite keyed items, traits correlated positively or assessing fewer traits did not decrease measurement precision markedly. Measurement precision was lower than that of rating scale data. The empirical study investigated whether relative MFC responses provide a better differentiation of behaviors within persons than absolute TF responses. However, criterion validity was equal and construct validity (with constructs measured by rating scales) lower in MFC. Thus, Thurstonian IRT modeling of MFC data overcomes the drawbacks of classical scoring, but gains in validity may depend on eliminating common method biases from the comparison.

Scoring a forced-choice image-based assessment of personality: A comparison of machine learning, regression, and summative approaches

Recent years have seen rapid advancements in the way that personality is measured, resulting in a number of innovative predictive measures being proposed, including using features extracted from videos and social media profiles. In the context of selection, game- and image-based assessments of personality are emerging, which can overcome issues like social desirability bias, lack of engagement and low response rates that are associated with traditional self-report measures. Forced-choice formats, where respondents are asked to rank responses, can also mitigate issues such as acquiescence and social desirability bias. Previously, we reported on the development of a gamified forced-choice image-based assessment of the Big Five personality traits created for use in selection, using Lasso regression for the scoring algorithms. In this study, we compare the machine-learning-based Lasso approach to ordinary least squares regression, as well as the summative approach that is typical of forced-choice formats. We find that the Lasso approach performs best in terms of generalisability and convergent validity, although the other methods have greater discriminate validity. We recommend the use of predictive Lasso regression models for scoring forced-choice image-based measures of personality over the other approaches. Potential further studies are suggested.

Counterproductive Academic Behaviors and Academic Performance: A Meta-Analysis and a Path Analysis Model

Counterproductive academic behaviors (CAB) are a complex phenomenon that affects academic institutions in multiple geographical areas with different cultures, values, and social norms. The high incidence of CAB causes problems of critical importance that transcend the educational domain. The current study aims to contribute to the knowledge of the CAB consequences by focusing on its impact on academic performance (AP). For this purpose, a meta-analysis was conducted in order to examine the relationship between CAB, its facets, and AP. The results show that overall CAB and students' performance are negatively related with a true effect size of ρ = −0.40 (K = 231, N = 127,269). Particularly, absenteeism appeared to be the facet most strongly related to AP (ρ = −0.48, K = 117, N = 69,453). A meta-analytic path analysis model was carried out in order to test the predictive validity of CAB, students' personality characteristics, and intelligence on AP. Results show that conscientiousness and cognitive intelligence have a negative relationship with CAB (β = −0.28 and β = −0.20, respectively), and that conscientiousness, openness to experience, intelligence, and CAB can explain 58% of AP true variance. Meta-analyses of moderator variables and hierarchical meta-analyses are also presented. The implications for research and practice are discussed at the end.

Automatic Personality Assessment through Movement Analysis

Obtaining accurate and objective assessments of an individual's personality is vital in many areas including education, medicine, sports and management. Currently, most personality assessments are conducted using scales and questionnaires. Unfortunately, it has been observed that both scales and questionnaires present various drawbacks. Their limitations include the lack of veracity in the answers, limitations in the number of times they can be administered, or cultural biases. To solve these problems, several articles have been published in recent years proposing the use of movements that participants make during their evaluation as personality predictors. In this work, a multiple linear regression model was developed to assess the examinee's personality based on their movements. Movements were captured with the low-cost Microsoft Kinect camera, which facilitates its acceptance and implementation. To evaluate the performance of the proposed system, a pilot study was conducted aimed at assessing the personality traits defined by the Big-Five Personality Model. It was observed that the traits that best fit the model are Extroversion and Conscientiousness. In addition, several patterns that characterize the five personality traits were identified. These results show that it is feasible to assess an individual's personality through his or her movements and open up pathways for several research.

Agreeableness and Its Consequences: A Quantitative Review of Meta-Analytic Findings

Agreeableness impacts people and real-world outcomes. In the most comprehensive quantitative review to date, we summarize results from 142 meta-analyses reporting effects for 275 variables, which represent N > 1.9 million participants from k > 3,900 studies. Arranging variables by their content and type, we use an organizational framework of 16 conceptual categories that presents a detailed account of Agreeableness’ external relations. Overall, the trait has effects in a desirable direction for 93% of variables (grand mean [Formula: see text]). We also review lower order trait evidence for 42 variables from 20 meta-analyses. Using these empirical findings, in tandem with existing theory, we synthesize eight general themes that describe Agreeableness’ characteristic functioning across variables: self-transcendence, contentment, relational investment, teamworking, work investment, lower results emphasis, social norm orientation, and social integration. We conclude by discussing potential boundary conditions of findings, contributions and limitations of our review, and future research directions.

Big five personality traits and performance: A quantitative synthesis of 50+ meta-analyses

OBJECTIVE

The connection between personality traits and performance has fascinated scholars in a variety of disciplines for over a century. The present research synthesizes results from 54 meta-analyses (k = 2028, N = 554,778) to examine the association of Big Five traits with overall performance.

METHOD

Quantitative aggregation procedures were used to assess the association of Big Five traits with performance, both overall and in specific performance categories.

RESULTS

Whereas conscientiousness yielded the strongest effect (ρ = 0.19), the remaining Big Five traits yielded comparable effects (ρ = 0.10, 0.10, -0.12, and 0.13 for extraversion, agreeableness, neuroticism, and openness). These associations varied dramatically by performance category. Whereas conscientiousness was more strongly associated with academic than job performance (0.28 vs 0.20), extraversion (-0.01 vs 0.14) and neuroticism (-0.03 vs -0.15) were less strongly associated with academic performance. Finally, associations of personality with specific performance outcomes largely replicated across independent meta-analyses.

CONCLUSIONS

Our comprehensive synthesis demonstrates that Big Five traits have robust associations with performance and documents how these associations fluctuate across personality and performance dimensions.

A Meta-Analysis of the Faking Resistance of Forced-Choice Personality Inventories

This study presents a comprehensive meta-analysis on the faking resistance of forced-choice (FC) inventories. The results showed that (1) FC inventories show resistance to faking behavior; (2) the magnitude of faking is higher in experimental contexts than in real-life selection processes, suggesting that the effects of faking may be, in part, a laboratory phenomenon; and (3) quasi-ipsative FC inventories are more resistant to faking than the other FC formats. Smaller effect sizes were found for conscientiousness when the quasi-ipsative format was used (δ = 0.49 vs. δ = 1.27 for ipsative formats). Also, the effect sizes were smaller for the applicant samples than for the experimental samples. Finally, the contributions and practical implications of these findings are discussed.

A genetic algorithm for optimal assembly of pairwise forced-choice questionnaires

The use of multidimensional forced-choice questionnaires has been proposed as a means of improving validity in the assessment of non-cognitive attributes in high-stakes scenarios. However, the reduced precision of trait estimates in this questionnaire format is an important drawback. Accordingly, this article presents an optimization procedure for assembling pairwise forced-choice questionnaires while maximizing posterior marginal reliabilities. This procedure is performed through the adaptation of a known genetic algorithm (GA) for combinatorial problems. In a simulation study, the efficiency of the proposed procedure was compared with a quasi-brute-force (BF) search. For this purpose, five-dimensional item pools were simulated to emulate the real problem of generating a forced-choice personality questionnaire under the five-factor model. Three factors were manipulated: (1) the length of the questionnaire, (2) the relative item pool size with respect to the questionnaire’s length, and (3) the true correlations between traits. The recovery of the person parameters for each assembled questionnaire was evaluated through the squared correlation between estimated and true parameters, the root mean square error between the estimated and true parameters, the average difference between the estimated and true inter-trait correlations, and the average standard error for each trait level. The proposed GA offered more accurate trait estimates than the BF search within a reasonable computation time in every simulation condition. Such improvements were especially important when measuring correlated traits and when the relative item pool sizes were higher. A user-friendly online implementation of the algorithm was made available to the users.

Teachers’ perceived information literacy self-efficacy

The aim of this research was to examine the factors that might correlate with variables that may explain teachers’ perceptions of their information literacy self-efficacy level. The study was conducted among 101 teachers during the 2018 academic year. It used the following questionnaires: information literacy self-efficacy level, being a digital newcomer/native, personality variables taken from the Big Five model, mastery of computer applications, personal characteristics, and participation in a digital program. Researchers used a quantitative methodology. Findings present a correlation between teachers’ perceptions of their information literacy self-efficacy level and openness to experience and neuroticism, teachers’ level of digital skills, and teachers’ participation in a digital program. We propose that the ministry of education should focus on developing pre-service teachers’ and teachers’ information literacy skills, thus enhancing their information literacy self-efficacy.

Criterion Validity of Cognitive Reflection for Predicting Job Performance and Training Proficiency: A Meta-Analysis

This article presents a meta-analysis of the validity of cognitive reflection (CR) for predicting job performance and training proficiency. It also examines the incremental validity of CR over cognitive intelligence (CI) for predicting these two occupational criteria. CR proved to be an excellent predictor of job performance and training proficiency, and the magnitude of the true validity was very similar across the two criteria. Results also showed that the type of CR is not a moderator of CR validity. We also found that CR showed incremental variance over CI for the explanation of job performance, although the magnitude of the contribution is small. However, CR shows practically no incremental validity over CI validity in the explanation of training proficiency. Finally, we discuss the implications of these findings for the research and practice of personnel selection.

Reliability Estimates for IRT-Based Forced-Choice Assessment Scores

Forced-choice (FC) assessments of noncognitive psychological constructs (e.g., personality, behavioral tendencies) are popular in high-stakes organizational testing scenarios (e.g., informing hiring decisions) due to their enhanced resistance against response distortions (e.g., faking good, impression management). The measurement precisions of FC assessment scores used to inform personnel decisions are of paramount importance in practice. Different types of reliability estimates are reported for FC assessment scores in current publications, while consensus on best practices appears to be lacking. In order to provide understanding and structure around the reporting of FC reliability, this study systematically examined different types of reliability estimation methods for Thurstonian IRT-based FC assessment scores: their theoretical differences were discussed, and their numerical differences were illustrated through a series of simulations and empirical studies. In doing so, this study provides a practical guide for appraising different reliability estimation methods for IRT-based FC assessment scores.

Detecting DIF in Multidimensional Forced Choice Measures Using the Thurstonian Item Response Theory Model

Although modern item response theory (IRT) methods of test construction and scoring have overcome ipsativity problems historically associated with multidimensional forced choice (MFC) formats, there has been little research on MFC differential item functioning (DIF) detection, where item refers to a block, or group, of statements presented for an examinee’s consideration. This research investigated DIF detection with three-alternative MFC items based on the Thurstonian IRT (TIRT) model, using omnibus Wald tests on loadings and thresholds. We examined constrained and free baseline model comparisons strategies with different types and magnitudes of DIF, latent trait correlations, sample sizes, and levels of impact in an extensive Monte Carlo study. Results indicated the free baseline strategy was highly effective in detecting DIF, with power approaching 1.0 in the large sample size and large magnitude of DIF conditions, and similar effectiveness in the impact and no-impact conditions. This research also included an empirical example to demonstrate the viability of the best performing method with real examinees and showed how a DIF and a DTF effect size measure can be used to assess the practical significance of MFC DIF findings.

A Bayesian Random Block Item Response Theory Model for Forced-Choice Formats

Based on the framework of testlet models, the current study suggests the Bayesian random block item response theory (BRB IRT) model to fit forced-choice formats where an item block is composed of three or more items. To account for local dependence among items within a block, the BRB IRT model incorporated a random block effect into the response function and used a Markov Chain Monte Carlo procedure for simultaneous estimation of item and trait parameters. The simulation results demonstrated that the BRB IRT model performed well for the estimation of item and trait parameters and for screening those with relatively low scores on target traits. As found in the literature, the composition of item blocks was crucial for model performance; negatively keyed items were required for item blocks. The empirical application showed the performance of the BRB IRT model was equivalent to that of the Thurstonian IRT model. The potential advantage of the BRB IRT model as a base for more complex measurement models was also demonstrated by incorporating gender as a covariate into the BRB IRT model to explain response probabilities. Recommendations for the adoption of forced-choice formats were provided along with the discussion about using negatively keyed items.

Joint modeling of the two-alternative multidimensional forced-choice personality measurement and its response time by a Thurstonian D-diffusion item response model

The two-alternative multidimensional forced-choice measurement of personality has attracted researchers' attention for its tolerance to response bias. Moreover, the response time can be collected along with the item response when personality measurement is conducted with computers. In view of this situation, the objective of this study is to propose a Thurstonian D-diffusion item response theory (IRT) model, which combines two key existing frameworks: the Thurstonian IRT model for forced-choice measurement and the D-diffusion IRT model for the response time in personality measurement. The proposed model reflects the psychological theories behind the data-generating mechanism of the item response and response time. A simulation study reveals that the proposed model can successfully recover the parameters and factor structure in typical application settings. A real data application reveals that the proposed model estimates similar but still different parameter values compared to the original Thurstonian IRT model, and this difference can be explained by the response time information. In addition, the proposed model successfully reflects the distance-difficulty relationship between the response time and the latent relative respondent position.

Cognitive Reflection and General Mental Ability as Predictors of Job Performance

This paper presents a study with four independent samples on the validity of cognitive reflection (CR) for predicting job performance and academic outcomes. The results showed that CR was a valid predictor of academic outcomes (i.e., grades and exam marks) and job performance (i.e., assessment center ratings). The magnitude of the CR validity was similar to the validity of GMA. Moreover, we found that CR and GMA were moderately correlated, and multiple regression analyses showed that CR added a small amount of validity over GMA validity for predicting both types of performance. Finally, we discuss the implications of the findings for the theory and practice of predicting performance and organizational sustainability.

Meta-Analysis of the Validity of General Mental Ability for Five Performance Criteria: Hunter and Hunter (1984) Revisited

This paper presents a series of meta-analyses of the validity of general mental ability (GMA) for predicting five occupational criteria, including supervisory ratings of job performance, production records, work sample tests, instructor ratings, and grades. The meta-analyses were conducted with a large database of 467 technical reports of the validity of the General Aptitude Test Battery (GATB) which included 630 independent samples. GMA showed to be a consistent predictor of the five criteria, but the magnitude of the operational validity was not the same across the five criteria. Results also showed that job complexity is a moderator of the GMA validity for the performance criteria. We also found that the GMA validity estimates are slightly smaller than the previous ones obtained by Hunter and Hunter (1984). Finally, we discuss the implications of these findings for the research and practice of personnel selection.

Meta-Analysis of Interrater Reliability of Supervisory Performance Ratings: Effects of Appraisal Purpose, Scale Type, and Range Restriction

Objectives: This reliability generalization study aimed to estimate the mean and variance of the interrater reliability coefficients (r _yy ) of supervisory ratings of overall, task, contextual, and positive job performance. The moderating effect of the appraisal purpose and the scale type was examined. It was hypothesized that the ratings collected for research purposes and multi-item scales have higher r _yy . It was also examined whether r _yy was similar for the four performance dimensions. Method: A database consisting of 224 independent samples was created and hierarchical sub-grouping meta-analyses were conducted. Results: The appraisal purpose was a moderator of r _yy for the four performance dimensions. Scale type was a moderator of r _yy for overall and task performance collected for research purposes. The findings also suggest that supervisors seem to have less difficulty evaluating overall job performance than task, contextual, and positive performance. The best estimates of the observed r _yy for overall job performance are 0.61 for research-collected ratings and 0.45 for administrative-collected ratings. Conclusions: (1) Appraisal purpose moderates r _yy and researchers and practitioners should be aware of its effects before collecting ratings or using empirically-derived interrater reliability distributions, (2) Scale type seems to moderate r _yy in the case of the ratings collected for research purposes, only, (3) overall job performance is more reliably rated than task, contextual, and positive performance. Implications for research and practice are discussed.

Prevalence and Correlates of Academic Dishonesty: Towards a Sustainable University

Academic dishonesty (AD) is a problem that affects all higher education institutions. It hurts their reputation, undermines integrity programs, and sidelines sustainability efforts. To understand its negative impact, the empirical study of AD is a critical issue. Up to now, the majority of research on AD has taken place in the North American context. The current research analyzes the prevalence of AD in a non-American university and, focusing on individual differences, examines some of its causes and consequences. The results prove that: (1) AD is a problem that occurs frequently among students; (2) three dimensions of the big five personality model correlate with AD. These are conscientiousness (ρ = −0.49, p < 0.01), extraversion (ρ = 0.39, p < 0.01), and agreeableness (ρ = −0.14, p < 0.01); (3) AD is associated to students’ GPA (Grade Point Average) (ρ = −0.34, p < 0.01) and contextual performance (ρ = −0.50, p < 0.01); (4) personality accounts for 30% of AD variance (R = 0.55, p < 0.01); and (5) AD and some of the studied individual differences explain 38% and 41% of GPA and contextual performance variance (R = 0.62, p < 0.01 and R = 0.64, p < 0.01). Implications for research and practice are discussed.

Controlling for Response Biases in Self-Report Scales: Forced-Choice vs. Psychometric Modeling of Likert Items

One important problem in the measurement of non-cognitive characteristics such as personality traits and attitudes is that it has traditionally been made through Likert scales, which are susceptible to response biases such as social desirability (SDR) and acquiescent (ACQ) responding. Given the variability of these response styles in the population, ignoring their possible effects on the scores may compromise the fairness and the validity of the assessments. Also, response-style-induced errors of measurement can affect the reliability estimates and overestimate convergent validity by correlating higher with other Likert-scale-based measures. Conversely, it can attenuate the predictive power over non-Likert-based indicators, given that the scores contain more errors. This study compares the validity of the Big Five personality scores obtained: (1) ignoring the SDR and ACQ in graded-scale items (GSQ), (2) accounting for SDR and ACQ with a compensatory IRT model, and (3) using forced-choice blocks with a multi-unidimensional pairwise preference model (MUPP) variant for dominance items. The overall results suggest that ignoring SDR and ACQ offered the worst validity evidence, with a higher correlation between personality and SDR scores. The two remaining strategies have their own advantages and disadvantages. The results from the empirical reliability and the convergent validity analysis indicate that when modeling social desirability with graded-scale items, the SDR factor apparently captures part of the variance of the Agreeableness factor. On the other hand, the correlation between the corrected GSQ-based Openness to Experience scores, and the University Access Examination grades was higher than the one with the uncorrected GSQ-based scores, and considerably higher than that using the estimates from the forced-choice data. Conversely, the criterion-related validity of the Forced Choice Questionnaire (FCQ) scores was similar to the results found in meta-analytic studies, correlating higher with Conscientiousness. Nonetheless, the FCQ-scores had considerably lower reliabilities and would demand administering more blocks. Finally, the results are discussed, and some notes are provided for the treatment of SDR and ACQ in future studies.

An Exploration of the Relationships Between Multiple Mini-Interview Scores and Personality Traits

Objective. To explore the relationship between pharmacy students' social and behavioral competencies assessed using multiple mini-interviews (MMIs) and their personality traits. Methods. A retrospective study was conducted using data from two Doctor of Pharmacy (PharmD) cohorts. Students' self-reported scores from an externally validated tool completed during their first professional year that assessed five personality traits (openness to experiences, conscientiousness, extraversion, agreeableness, and emotionality) were collected. Students' scores on empathy, integrity, adaptability, critical thinking, and collaboration were collected during MMIs conducted during the admissions process. Analysis of variance was used to test the homogeneity of the sample, and correlation analyses were used to determine the strength of relationships between variables. Results. When examining for associations between students' personality traits and their social and behavioral competencies measured during the MMIs, we found a few significant but very weak correlations with extraversion. Conclusion. Our results revealed weak to negligible correlations between scores on competencies measured during the MMIs and personality traits, potentially because the assessments measured different constructs.

On the Validity of Forced Choice Scores Derived From the Thurstonian Item Response Theory Model

Forced choice (FC) measures may be a desirable alternative to single stimulus (SS) Likert items, which are easier to fake and can have associated response biases. However, classical methods of scoring FC measures lead to ipsative data, which have a number of psychometric problems. A Thurstonian item response theory (TIRT) model has been introduced as a way to overcome these issues, but few empirical validity studies have been conducted to ensure its effectiveness. This was the goal of the current three studies, which used FC measures of domains from popular personality frameworks including the Big Five and HEXACO, and both statement and adjective item stems. We computed TIRT and ipsative scores and compared their validity estimates. Convergent and discriminant validity of the scores were evaluated by correlating them with SS scores, and test-criterion validity evidence was evaluated by examining their relationships with meaningful outcomes. In all three studies, there was evidence for the convergent and test-criterion validity of the TIRT scores, though at times this was on par with the validity of the ipsative scores. The discriminant validity of the TIRT scores was problematic and was often worse than the ipsative scores.

Relationship between Personality and Biological Reactivity to Stress: A Review

Objective Personality traits can be the basis for individual differences in the biological response of stress. To date, many psychobiological studies have been conducted to clarify the relationship between personality and biological reactivity to stress. This review summarizes the most important findings in this area of research. Results Key findings related to the relationship between personality factors and stress-sensitive biological systems in four research models have been summarized; model of psychosocial characteristics, model based on Rumination and Emotional Inhibition, Eysenck's biopsychological model, and Five-Factor Approach of Personality. Conclusion According to the results of this review, it can be concluded that personality typology of individuals influenced their biological reactivity to stressful events. Understanding the biological basis of personality can help to better understand vulnerability to stress. Future research can be continuing based on framework of the four models.

Taking the Test Taker's Perspective: Response Process and Test Motivation in Multidimensional Forced-Choice Versus Rating Scale Instruments

The multidimensional forced-choice (MFC) format has been proposed as an alternative to the rating scale (RS) response format. However, it is unclear how changing the response format may affect the response process and test motivation of participants. In Study 1, we investigated the MFC response process using the think-aloud technique. In Study 2, we compared test motivation between the RS format and different versions of the MFC format (presenting 2, 3, 4, and 5 items simultaneously). The response process to MFC item blocks was similar to the RS response process but involved an additional step of weighing the items within a block against each other. The RS and MFC response format groups did not differ in their test motivation. Thus, from the test taker's perspective, the MFC format is somewhat more demanding to respond to, but this does not appear to decrease test motivation.