Measuring moral reasoning using moral dilemmas: evaluating reliability, validity, and differential item functioning of the behavioural defining issues test (bDIT)

Differential Performance of Social Communication Questionnaire Items in African American/Black vs. White Children

Screening for autism spectrum disorder (ASD) is an essential early step in the identification process and inaccurate screening may lead to significant delays in the onset of treatment. Past research has highlighted discrepancies in the performance of ASD screening tools such as the Social Communication Questionnaire (SCQ) among certain racial and ethnic groups. The current study explored the functioning of the SCQ among African American/Black and White respondents based on item level performance on the measure. Differential Item Functioning (DIF) analyses showed that 16 (41%) items of the SCQ functioned differently for African American/Black respondents when compared to White respondents. Implications, such as the potential for delayed diagnosis and treatment, and the influence on downstream outcomes, are discussed.

To kill or not to kill: A systematic literature review of high-stakes moral decision-making measures and their psychometric properties

Introduction

The present systematic review investigates the psychological tools available for capturing high-stakes decisions involving life-death content and their psychometric properties. Valid measurement of these individual differences will provide crucial information in the personnel selection and training in fields where high-stakes moral issues exist (e.g., military, medicine). To our knowledge, this is the first systematic examination of such instruments.

Methods

Systematic searches of 6 electronic databases were conducted according to the PRISMA guidelines. An appraisal tool evaluated the quality of identified measures. Twenty studies met pre-determined inclusion criteria. Moral decision-making was assessed with either a self-report scale (n = 3) or moral dilemmas (n = 17).

Results

The findings identified two measures, the Defining Issues Test and the Oxford Utilitarianism Scale as psychometrically sound measures of moral decision-making. However, they are unlikely to be considered "gold standard" measures due to their theoretically specific, but limited, scope. Overall, the findings suggest that research in the area has been scattered. There is a lack of consensus on the definition of moral decision-making, and a lack of cross-validation on how different measures of moral decision-making relate to each other. This presents a gap between theory and empirical measurement in moral decision-making. Further work is needed for a unified conceptualization of moral decision-making to pave the way to both theory development and the development of well-validated measurement tools, and this review provides a critical foundation for both.

Testing the Consistency of the Moral Growth Mindset Measure Across People With Different Political Perspectives

Abstract. Although the Moral Growth Mindset (MGM) Measure was tested and validated in general, whether it measures MGM consistently across people with different political perspectives associated with moral foundations, has not been tested. We examined measurement invariance (MI) and differential item functioning (DIF) across different political affiliations to test whether the MGM Measure functioned consistently. We also examined the relationship between MGM, moral foundations, and political affiliation with t-tests and regression analyses. The findings reported that first, at the test level, the strictest MI was achieved, so the measurement structure was consistent between the different political groups. Second, no item showed significant DIF, so the MGM Measure was not biased at the item level. Third, t-tests and regression analyses reported that MGM and its relationship with moral foundations were not significantly associated with political affiliation.

Validity study using factor analyses on the Defining Issues Test-2 in undergraduate populations

INTRODUCTION

The Defining Issues Test (DIT) aimed to measure one's moral judgment development in terms of moral reasoning. The Neo-Kohlbergian approach, which is an elaboration of Kohlbergian theory, focuses on the continuous development of postconventional moral reasoning, which constitutes the theoretical basis of the DIT. However, very few studies have directly tested the internal structure of the DIT, which would indicate its construct validity.

OBJECTIVES

Using the DIT-2, a later revision of the DIT, we examined whether a bi-factor model or 3-factor CFA model showed a better model fit. The Neo-Kohlbergian theory of moral judgment development, which constitutes the theoretical basis for the DIT-2, proposes that moral judgment development occurs continuously and that it can be better explained with a soft-stage model. Given these assertions, we assumed that the bi-factor model, which considers the Schema-General Moral Judgment (SGMJ), might be more consistent with Neo-Kohlbergian theory.

METHODS

We analyzed a large dataset collected from undergraduate students. We performed confirmatory factor analysis (CFA) via weighted least squares. A 3-factor CFA based on the DIT-2 manual and a bi-factor model were compared for model fit. The three factors in the 3-factor CFA were labeled as moral development schemas in Neo-Kohlbergian theory (i.e., personal interests, maintaining norms, and postconventional schemas). The bi-factor model included the SGMJ in addition to the three factors.

RESULTS

In general, the bi-factor model showed a better model fit compared with the 3-factor CFA model although both models reported acceptable model fit indices.

CONCLUSION

We found that the DIT-2 scale is a valid measure of the internal structure of moral reasoning development using both CFA and bi-factor models. In addition, we conclude that the soft-stage model, posited by the Neo-Kohlbergian approach to moral judgment development, can be better supported with the bi-factor model that was tested in the present study.

Development and validation of the English version of the Moral Growth Mindset measure

Background: Moral Growth Mindset (MGM) is a belief about whether one can become a morally better person through efforts. Prior research showed that MGM is positively associated with promotion of moral motivation among adolescents and young adults. We developed and tested the English version of the MGM measure in this study with data collected from college student participants. Methods: In Study 1, we tested the reliability and validity of the MGM measure with two-wave data ( N = 212, Age mean = 24.18 years, SD = 7.82 years). In Study 2, we retested the construct validity of the MGM measure once again and its association with other moral and positive psychological indicators to test its convergent and discriminant validity ( N = 275, Age mean = 22.02 years, SD = 6.34 years). Results: We found that the MGM measure was reliable and valid from Study 1. In Study 2, the results indicated that the MGM was well correlated with other moral and positive psychological indicators as expected. Conclusions: We developed and validated the English version of the MGM measure in the present study. The results from studies 1 and 2 supported the reliability and validity of the MGM measure. Given these, we found that the English version of the MGM measure can well measure one's MGM as we intended.

Development and validation of the English version of the Moral Growth Mindset measure

Background: Moral Growth Mindset (MGM) is a belief about whether one can become a morally better person through efforts. Prior research showed that MGM is positively associated with promotion of moral motivation among adolescents and young adults. We developed and tested the English version of the MGM measure in this study with data collected from college student participants. Methods: In Study 1, we tested the reliability and validity of the MGM measure with two-wave data ( N = 212, Age mean = 24.18 years, SD = 7.82 years). In Study 2, we retested the construct validity of the MGM measure once again and its association with other moral and positive psychological indicators to test its convergent and discriminant validity ( N = 275, Age mean = 22.02 years, SD = 6.34 years). Results: We found that the MGM measure was reliable and valid from Study 1. In Study 2, the results indicated that the MGM was well correlated with other moral and positive psychological indicators as expected. Conclusions: We developed and validated the English version of the MGM measure in the present study. The results from studies 1 and 2 supported the reliability and validity of the MGM measure. Given this, we found that the English version of the MGM measure can measure one's MGM as we intended.

Development and validation of the English version of the Moral Growth Mindset measure

Background: Moral Growth Mindset (MGM) is a belief about whether one can become a morally better person through efforts. Prior research showed that MGM is positively associated with promotion of moral motivation among adolescents and young adults. We developed and tested the English version of the MGM measure in this study with data collected from college student participants. Methods: In Study 1, we tested the reliability and validity of the MGM measure with two-wave data ( N = 212, Age mean = 24.18 years, SD = 7.82 years). In Study 2, we retested the construct validity of the MGM measure once again and its association with other moral and positive psychological indicators to test its convergent and discriminant validity ( N = 275, Age mean = 22.02 years, SD = 6.34 years). Results: We found that the MGM measure was reliable and valid from Study 1. In Study 2, the results indicated that the MGM was well correlated with other moral and positive psychological indicators as expected. Conclusions: We developed and validated the English version of the MGM measure in the present study. The results from studies 1 and 2 supported the reliability and validity of the MGM measure. Given this, we found that the English version of the MGM measure can measure one's MGM as we intended.