1
|
Koschmieder C, Knauder H, Theuerl EM, Neubauer A. Konstruktion und Validierung eines Assessments von Offenheit für Vielfalt für (angehende) Lehrer und Lehrerinnen. ZEITSCHRIFT FUR PADAGOGISCHE PSYCHOLOGIE 2022. [DOI: 10.1024/1010-0652/a000354] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
Zusammenfassung. Vielfalt und Toleranz als solidarisches Grundgerüst einer westlichen Gesellschaft wurden in den letzten Jahren – anhand verschiedener Themen wie Migration, Inklusion in Schulen, unterschiedliche Lebensweisen – medial intensiv diskutiert. Dabei fordert der demographische Trend zur Vielfalt Lehrerinnen und Lehrer zunehmend auf, sich mit der steigenden Diversität der Schüler und Schülerinnen zu befassen. Die vorliegende Studie beschreibt die Entwicklung und Validierung eines Situational Judgment Tests (SJT) zur Erfassung von Offenheit für Vielfalt (OfV) für (angehende) Lehrer und Lehrerinnen. Dieser Test wurde anhand von Fragebögen zu universellen Werten, Persönlichkeitsmerkmalen, sozialen Fähigkeiten, Autoritarismus und sozial erwünschten Antworttendenzen an einer Stichprobe von Schülern und Schülerinnen ( N = 219) validiert. Faktorenanalysen ergeben einen Faktor der allgemeinen oder generalisierten „Offenheit für Vielfalt“ mit einer guten internen Konsistenz (>α = .84). Es zeigen sich Zusammenhänge mit Universalismus, Verträglichkeit, Empathie und Autoritarismus, die bis zu 30% Varianz des Konstrukts Offenheit für Vielfalt über das Geschlecht hinaus aufklären. Der entwickelte Test kann in weiterer Folge dazu dienen, das Konstrukt OfV für weitere Forschung im Bildungsbereich sowie für die Berufsorientierung und die Aus-, Fort- und Weiterbildung von Lehrern und Lehrerinnen zugänglich zu machen.
Collapse
Affiliation(s)
- Corinna Koschmieder
- Institut für Psychologie, Universität Graz, Österreich
- Zentrum für Forschungssupport, Pädagogische Hochschule Steiermark, Graz, Österreich
| | | | | | | |
Collapse
|
2
|
Irvin RL, Roiger AN, Robinson MD. Using a Variant of the Situational Judgment Test to Examine Stress Reactivity Processes: Within-Person Relationships and Relationships Involving BIS and BAS. JOURNAL OF PSYCHOPATHOLOGY AND BEHAVIORAL ASSESSMENT 2022. [DOI: 10.1007/s10862-022-09999-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/12/2023]
|
3
|
Golubovich J, Lake CJ, Seybert J, Anguiano‐Carrasco C. Do situational characteristics affect the validity of personality situational judgment items? INTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT 2022. [DOI: 10.1111/ijsa.12390] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Affiliation(s)
| | - Christopher J. Lake
- Department of Management & Marketing College of Business & Public Policy, University of Alaska Anchorage AK USA
| | | | | |
Collapse
|
4
|
Persich MR, Robinson MD. Five Approaches to Understanding Interpersonal Competence: A Review and Integration. REVIEW OF GENERAL PSYCHOLOGY 2022. [DOI: 10.1177/10892680221085507] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Social connectedness has been linked to beneficial outcomes across domains, ages, and cultures. However, not everyone receives these benefits, as there are large individual differences in the capacities required to create and sustain functional interpersonal relationships. A great deal of research has been devoted to assessing and understanding these differences, often focusing on how competent interpersonal behavior renders it more likely that one will succeed interpersonally. The current paper examines five relevant approaches that have emerged from personality (global traits), social (social cognition), clinical (social skills interventions), developmental (social information processing), and industrial/organizational (situation judgment) areas of psychology. A comparison of these approaches highlights important considerations related to bandwidth and fidelity, whether the focus should be on overt behavior or underlying processes, and whether to emphasize tendencies or their effectiveness. The review concludes with calls for greater integration efforts, which can capitalize on strengths inherent to different approaches.
Collapse
|
5
|
Mielke I, Breil SM, Amelung D, Espe L, Knorr M. Assessing distinguishable social skills in medical admission: does construct-driven development solve validity issues of situational judgment tests? BMC MEDICAL EDUCATION 2022; 22:293. [PMID: 35440029 PMCID: PMC9020047 DOI: 10.1186/s12909-022-03305-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/15/2021] [Accepted: 03/24/2022] [Indexed: 06/14/2023]
Abstract
BACKGROUND Social skills are important for future physicians and are therefore increasingly considered in selection processes. One economic assessment method from which different social skills can be inferred are Situational Judgment Tests (SJTs) in which applicants are asked to rate behavioral responses in context-relevant situations. However, traditional SJTs have so far failed to distinctively measure specified constructs. To address this shortcoming in the medical admission context, we applied a construct-driven approach of SJT development in which test development was deductively guided by agency and communion as target constructs. METHOD The final version of the construct-driven SJT includes 15 items per construct with three behavioral responses. Medical school applicants (N = 1527) completed the construct-driven SJT, a traditional SJT, and an aptitude test under high-stakes condition as part of their application. A subsample (N = 575) participated in a subsequent voluntary online study with self-report measures of personality and past behavior. RESULTS The proposed two-factor structure and internal consistency of the construct-driven SJT was confirmed. Communal SJT scores were positively associated with self-reported communal personality and communal behavior, yet effects were smaller than expected. Findings for agentic SJT scores were mixed with positive small associations to self-reported agentic personality scores and agentic behavior but unexpected negative relations to communal self-reported measures. CONCLUSIONS Results suggest that construct-driven SJTs might overcome validity limitations of traditional SJTs, although their implementation is challenging. Despite first indicators of validity, future research needs to address practical points of application in high-stakes settings, inclusion of other constructs, and especially prediction of actual behavior before the application of construct-driven SJTs for selection purposes in medical admission can be recommended.
Collapse
Affiliation(s)
- Ina Mielke
- Department of Biochemistry and Molecular Cell Biology, University Medical Center Hamburg-Eppendorf, N30, Martinistraße 52, 20246, Hamburg, Germany.
| | - Simon M Breil
- Department of Psychology, University of Münster, Münster, Germany
| | - Dorothee Amelung
- Office of Student Affairs, Heidelberg University Hospital, Heidelberg, Germany
| | - Lia Espe
- Division of Medical Teaching and Education Research, Göttingen University Medical Center, Göttingen, Germany
| | - Mirjana Knorr
- Department of Biochemistry and Molecular Cell Biology, University Medical Center Hamburg-Eppendorf, N30, Martinistraße 52, 20246, Hamburg, Germany
| |
Collapse
|
6
|
An ego effectiveness perspective of successful self-control: An individual difference and its links to social functioning and well-being. JOURNAL OF RESEARCH IN PERSONALITY 2022. [DOI: 10.1016/j.jrp.2022.104207] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
7
|
Landers RN, Collmus AB. Gamifying a personality measure by converting it into a story: Convergence, incremental prediction, faking, and reactions. INTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT 2022. [DOI: 10.1111/ijsa.12373] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Affiliation(s)
- Richard N. Landers
- Department of Psychology University of Minnesota Twin Cities Minneapolis USA
| | | |
Collapse
|
8
|
Freudenstein JP, Mussel P, Krumm S. On the Construct-Related Validity of Implicit Trait Policies. EUROPEAN JOURNAL OF PERSONALITY 2021. [DOI: 10.1177/08902070211056901] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
In response to recent calls to incorporate Implicit Trait Policies (ITPs) into personality research, the current study examined the construct-related validity of ITP measures. ITPs are defined as implicit beliefs about the effectiveness of behaviors that reflect a certain trait. They are assessed by utilizing the methodology of Situational Judgment Tests. We empirically examined ( N = 339) several underlying key assumptions of ITP theory, including trait-specificity, the relation to personality traits, their context-independence, and the relation to general domain knowledge. Overall, our results showed little support for these assumptions. Although we found some confirmation for expected correlations between ITPs and personality traits, most of the observed variance in ITP measures was either method-specific or due to measurement error. We conclude that the herein examined ITP measures lack construct-related validity and discuss implications for ITP theory and assessment.
Collapse
Affiliation(s)
| | - Patrick Mussel
- Freie Universität Berlin Fachbereich Erziehungswissenschaft und Psychologie, Berlin, Germany
- Freie Universitat Berlin, Berlin, Germany
| | - Stefan Krumm
- Freie Universität Berlin Fachbereich Erziehungswissenschaft und Psychologie, Berlin, Germany
| |
Collapse
|
9
|
Heimann AL, Ingold PV, Lievens F, Melchers KG, Keen G, Kleinmann M. Actions define a character: Assessment centers as behavior‐focused personality measures. PERSONNEL PSYCHOLOGY 2021. [DOI: 10.1111/peps.12478] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Affiliation(s)
| | - Pia V. Ingold
- Department of Psychology University of Zurich Zurich Switzerland
| | - Filip Lievens
- Lee Kong Chian School of Business Singapore Management University Singapore
| | | | - Gert Keen
- Independent consultant Amsterdam Netherlands
| | - Martin Kleinmann
- Department of Psychology University of Zurich Zurich Switzerland
| |
Collapse
|
10
|
Schröder VS, Heimann AL, Ingold PV, Kleinmann M. Enhancing Personality Assessment in the Selection Context: A Study Protocol on Alternative Measures and an Extended Bandwidth of Criteria. Front Psychol 2021; 12:643690. [PMID: 33776868 PMCID: PMC7987665 DOI: 10.3389/fpsyg.2021.643690] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2020] [Accepted: 02/15/2021] [Indexed: 11/13/2022] Open
Abstract
Personality traits describe dispositions influencing individuals' behavior and performance at work. However, in the context of personnel selection, the use of personality measures has continuously been questioned. To date, research in selection settings has focused uniquely on predicting task performance, missing the opportunity to exploit the potential of personality traits to predict non-task performance. Further, personality is often measured with self-report inventories, which are susceptible to self-distortion. Addressing these gaps, the planned study seeks to design new personality measures to be used in the selection context to predict a wide range of performance criteria. Specifically, we will develop a situational judgment test and a behavior description interview, both assessing Big Five personality traits and Honesty-Humility to systematically compare these new measures with traditional self-report inventories regarding their criterion-related validity to predict four performance criteria: task performance, adaptive performance, organizational citizenship behavior, and counterproductive work behavior. Data will be collected in a simulated selection procedure. Based on power analyses, we aim for 200 employed study participants, who will allow us to contact their supervisors to gather criterion data. The results of this study will shed light on the suitability of different personality measures (i.e., situational judgment tests and behavior description interviews) to predict an expanded range of performance criteria.
Collapse
|
11
|
Wiernik BM, Ones DS, Marlin BM, Giordano C, Dilchert S, Mercado BK, Stanek KC, Birkland A, Wang Y, Ellis B, Yazar Y, Kostal JW, Kumar S, Hnat T, Ertin E, Sano A, Ganesan DK, Choudhoury T, al’Absi M. Using Mobile Sensors to Study Personality Dynamics. EUROPEAN JOURNAL OF PSYCHOLOGICAL ASSESSMENT 2020. [DOI: 10.1027/1015-5759/a000576] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Abstract. Research interest in personality dynamics over time is rapidly growing. Passive personality assessment via mobile sensors offers an intriguing new approach for measuring a wide variety of personality dynamics. In this paper, we address the possibility of integrating sensor-based assessments to enhance personality dynamics research. We consider a variety of research designs that can incorporate sensor-based measures and address pitfalls and limitations in terms of psychometrics and practical implementation. We also consider analytic challenges related to data quality and model evaluation that researchers must address when applying machine learning methods to translate sensor data into composite personality assessments.
Collapse
Affiliation(s)
| | - Deniz S. Ones
- Department of Psychology, University of Minnesota-Twin Cities, Minneapolis, MN, USA
| | - Benjamin M. Marlin
- College of Information and Computer Sciences, University of Massachusetts, Amherst, MS, USA
| | - Casey Giordano
- Department of Psychology, University of Minnesota-Twin Cities, Minneapolis, MN, USA
| | - Stephan Dilchert
- Department of Management, Zicklin School of Business, Baruch College, CUNY, New York, NY, USA
| | | | | | - Adib Birkland
- Department of Psychology, University of Minnesota-Twin Cities, Minneapolis, MN, USA
| | - Yilei Wang
- Department of Psychology, University of Minnesota-Twin Cities, Minneapolis, MN, USA
| | - Brenda Ellis
- Department of Psychology, University of Minnesota-Twin Cities, Minneapolis, MN, USA
| | - Yagizhan Yazar
- Department of Psychology, University of Minnesota-Twin Cities, Minneapolis, MN, USA
| | - Jack W. Kostal
- Department of Psychology, University of Minnesota-Twin Cities, Minneapolis, MN, USA
| | - Santosh Kumar
- Department of Computer Science, University of Memphis, TN, USA
| | - Timothy Hnat
- Department of Computer Science, University of Memphis, TN, USA
| | - Emre Ertin
- Department of Electrical and Computer Engineering, The Ohio State University, OH, USA
| | - Akane Sano
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
| | - Deepak K. Ganesan
- College of Information and Computer Sciences, University of Massachusetts, Amherst, MS, USA
| | | | - Mustafa al’Absi
- Department of Family Medicine & Biobehavioral Health, Medical School, University of Minnesota-Duluth, Duluth, MN, USA
| |
Collapse
|
12
|
Schäpers P, Freudenstein JP, Mussel P, Lievens F, Krumm S. Effects of situation descriptions on the construct-related validity of construct-driven situational judgment tests. JOURNAL OF RESEARCH IN PERSONALITY 2020. [DOI: 10.1016/j.jrp.2020.103963] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
|
13
|
Golubovich J, Lake CJ, Anguiano-Carrasco C, Seybert J. Measuring Achievement Striving via a Situational Judgment Test: The Value of Additional Context. REVISTA DE PSICOLOGÍA DEL TRABAJO Y DE LAS ORGANIZACIONES 2020. [DOI: 10.5093/jwop2020a15] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
14
|
Freudenstein J, Schäpers P, Roemer L, Mussel P, Krumm S. Is it all in the eye of the beholder? The importance of situation construal for situational judgment test performance. PERSONNEL PSYCHOLOGY 2020. [DOI: 10.1111/peps.12385] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Affiliation(s)
| | - Philipp Schäpers
- Lee Kong Chian School of Business Singapore Management University Singapore
| | - Lena Roemer
- Department of Psychology Humboldt‐Universität zu Berlin Berlin Germany
| | - Patrick Mussel
- Institute of Psychology Freie Universität Berlin Berlin Germany
| | - Stefan Krumm
- Institute of Psychology Freie Universität Berlin Berlin Germany
| |
Collapse
|
15
|
Teng Y, Brannick MT, Borman WC. Capturing Resilience in Context: Development and Validation of a Situational Judgment Test of Resilience. HUMAN PERFORMANCE 2020. [DOI: 10.1080/08959285.2019.1709069] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
16
|
Abstract
Abstract. Two laboratory studies examined the potential differences in the susceptibility to faking between a construct-oriented Situational Judgment Test (SJT) that measured conscientiousness and a traditional self-report measure of personality (NEO-FFI). In both studies, the mean differences between the honest and faked conscientiousness scores indicated that the NEO-FFI was more susceptible to faking than the SJT. In Study 1, we applied a within-subjects design ( N = 137) and analyzed these differences in light of selected predictor variables derived from models of faking behavior. As a result, faking on the SJT was explained by cognitive ability alone, whereas faking on the NEO-FFI was also dependent on other personality traits that are associated with the ability to fake. In Study 2 ( N = 602), the susceptibility to faking was predicted by differences in faking styles. The results of the mixed Rasch model analyses indicated profound differences in the measures in terms of the way the response scale was used.
Collapse
Affiliation(s)
- Nadine Kasten
- Department of Psychology, University of Trier, Germany
| | | | | |
Collapse
|
17
|
Schäpers P, Lievens F, Freudenstein J, Hüffmeier J, König CJ, Krumm S. Removing situation descriptions from situational judgment test items: Does the impact differ for video‐based versus text‐based formats? JOURNAL OF OCCUPATIONAL AND ORGANIZATIONAL PSYCHOLOGY 2019. [DOI: 10.1111/joop.12297] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Affiliation(s)
- Philipp Schäpers
- Lee Kong Chian School of Business Singapore Management University Singapore
| | - Filip Lievens
- Lee Kong Chian School of Business Singapore Management University Singapore
| | | | | | | | - Stefan Krumm
- Institute of Psychology Freie Universität Berlin Germany
| |
Collapse
|
18
|
Oostrom JK, de Vries RE, de Wit M. Development and validation of a HEXACO situational judgment test. HUMAN PERFORMANCE 2018. [DOI: 10.1080/08959285.2018.1539856] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|