From crisis of evidence to a “crisis” of relevance? Incentive-based answers for social psychology’s perennial relevance worries

Power to Detect What? Considerations for Planning and Evaluating Sample Size

ACADEMIC ABSTRACT

In the wake of the replication crisis, social and personality psychologists have increased attention to power analysis and the adequacy of sample sizes. In this article, we analyze current controversies in this area, including choosing effect sizes, why and whether power analyses should be conducted on already-collected data, how to mitigate the negative effects of sample size criteria on specific kinds of research, and which power criterion to use. For novel research questions, we advocate that researchers base sample sizes on effects that are likely to be cost-effective for other people to implement (in applied settings) or to study (in basic research settings), given the limitations of interest-based minimums or field-wide effect sizes. We discuss two alternatives to power analysis, precision analysis and sequential analysis, and end with recommendations for improving the practices of researchers, reviewers, and journal editors in social-personality psychology.

PUBLIC ABSTRACT

Recently, social-personality psychology has been criticized for basing some of its conclusions on studies with low numbers of participants. As a result, power analysis, a mathematical way to ensure that a study has enough participants to reliably "detect" a given size of psychological effect, has become popular. This article describes power analysis and discusses some controversies about it, including how researchers should derive assumptions about effect size, and how the requirements of power analysis can be applied without harming research on hard-to-reach and marginalized communities. For novel research questions, we advocate that researchers base sample sizes on effects that are likely to be cost-effective for other people to implement (in applied settings) or to study (in basic research settings). We discuss two alternatives to power analysis, precision analysis and sequential analysis, and end with recommendations for improving the practices of researchers, reviewers, and journal editors in social-personality psychology.

A registered report survey of open research practices in psychology departments in the UK and Ireland

Open research practices seek to enhance the transparency and reproducibility of research. While there is evidence of increased uptake in these practices, such as study preregistration and open data, facilitated by new infrastructure and policies, little research has assessed general uptake of such practices across psychology university researchers. The current study estimates psychologists' level of engagement in open research practices across universities in the United Kingdom and Ireland, while also assessing possible explanatory factors that may impact their engagement. Data were collected from 602 psychology researchers in the United Kingdom and Ireland on the extent to which they have implemented various practices (e.g., use of preprints, preregistration, open data, open materials). Here we present the summarized descriptive results, as well as considering differences between various categories of researcher (e.g., career stage, subdiscipline, methodology), and examining the relationship between researcher's practices and their self-reported capability, opportunity, and motivation (COM-B) to engage in open research practices. Results show that while there is considerable variability in engagement of open research practices, differences across career stage and subdiscipline of psychology are small by comparison. We observed consistent differences according to respondent's research methodology and based on the presence of institutional support for open research. COM-B dimensions were collectively significant predictors of engagement in open research, with automatic motivation emerging as a consistently strong predictor. We discuss these findings, outline some of the challenges experienced in this study, and offer suggestions and recommendations for future research. Estimating the prevalence of responsible research practices is important to assess sustained behaviour change in research reform, tailor educational training initiatives, and to understand potential factors that might impact engagement.

Towards a social psychology of precarity

This article introduces the special issue 'Towards a Social Psychology of Precarity' that develops an orienting lens for social psychologists' engagement with the concept. As guest editors of the special issue, we provide a thematic overview of how 'precarity' is being conceptualized throughout the social sciences, before distilling the nine contributions to the special issue. In so doing, we trace the ways in which social psychologists are (dis)engaging with the concept of precarity, yet too, explore how precarity constitutes, and is embedded within, the discipline itself. Resisting disciplinary decadence, we collectively explore what a social psychology of precarity could be, and view working with/in precarity as fundamental to addressing broader calls for the social responsiveness of the discipline. The contributing papers, which are methodologically pluralistic and provide rich conceptualisations of precarity, challenge reductionist individualist understandings of suffering and coping and extend social science theorizations on precarity. They also highlight the ways in which social psychology remains complicit in perpetuating different forms of precarity, for both communities and academics. We propose future directions for the social psychological study of precarity through four reflexive questions that we encourage scholars to engage with so that we may both work with/in, and intervene against, 'the precarious'.

Of precarity and conspiracy: Introducing a socio-functional model of conspiracy beliefs

Conspiracy Beliefs (CB) are a key vector of violent extremism, radicalism and unconventional political events. So far, social-psychological research has extensively documented how cognitive, emotional and intergroup factors can promote CB. Evidence also suggests that adherence to CB moves along social class lines: low-income and low-education are among the most robust predictors of CB. Yet, the potential role of precarity-the subjective experience of permanent insecurity stemming from objective material strain-in shaping CB remains largely unexplored. In this paper, we propose for the first time a socio-functional model of CB. We test the hypothesis that precarity could foster increased CB because it undermines trust in government and the broader political 'elites'. Data from the World Value Survey (n = 21,650; Study 1, electoral CB) and from representative samples from polls conducted in France (n = 1760, Study 2a, conspiracy mentality) and Italy (n = 2196, Study 2b, COVID-19 CB), corroborate a mediation model whereby precarity is directly and indirectly associated with lower trust in authorities and higher CB. In addition, these links are robust to adjustment on income, self-reported SES and education. Considering precarity allows for a truly social-psychological understanding of CB as the by-product of structural issues (e.g. growing inequalities). Results from our socio-functional model suggest that implementing solutions at the socio-economic level could prove efficient in fighting CB.

A Failed Cross-Validation Study on the Relationship between LIWC Linguistic Indicators and Personality: Exemplifying the Lack of Generalizability of Exploratory Studies

(1) Background: Previous meta-analytic research found small to moderate relationships between the Big Five personality traits and different linguistic computational indicators. However, previous studies included multiple linguistic indicators to predict personality from an exploratory framework. The aim of this study was to conduct a cross-validation study analyzing the relationships between language indicators and personality traits to test the generalizability of previous results; (2) Methods: 643 Spanish undergraduate students were tasked to write a self-description in 500 words (which was evaluated with the LIWC) and to answer a standardized Big Five questionnaire. Two different analytical approaches using multiple linear regression were followed: first, using the complete data and, second, by conducting different cross-validation studies; (3) Results: The results showed medium effect sizes in the first analytical approach. On the contrary, it was found that language and personality relationships were not generalizable in the cross-validation studies; (4) Conclusions: We concluded that moderate effect sizes could be obtained when the language and personality relationships were analyzed in single samples, but it was not possible to generalize the model estimates to other samples. Thus, previous exploratory results found on this line of research appear to be incompatible with a nomothetic approach.

What Can Educational Psychology Learn From, and Contribute to, Theory Development Scholarship?

One of the field of psychology’s stated goals is to produce scholarship with findings that benefit the world. Over the last 10 years, psychology scholarship and its presumed societal benefits have been called into question due to the field’s history of questionable research practices, racism, and epistemic oppression. Calls for methodological, ethical, and practical reforms are essential to building a psychological science that is just, effective, reliable, and beneficial. Recently, these calls have been complemented by a push to reform how theory is developed and used in psychology. There is great need for better understanding and implementation of theory development, both in the field of psychology broadly as well as in its subdisciplines, including educational psychology. At the same time, educational psychologists have much to contribute to the tripartite calls for methodological, ethical, and theory reforms. In this paper, I explore theory development in psychology by discussing the importance of developing both the descriptive and explanatory aspects of theory as well as the need to refine how theory is evaluated and integrated. Then, I review how innovations and practices in educational psychology can inform the broader theory reform movement in psychology writ large. Finally, I identify important future directions for further advancing theory reform in psychology, including addressing ableism in the field, increasing the field’s hospitability for theory revision, furthering theory development transparency, and more deeply integrating theory development into preparation programs.

Who will I be when I retire? The role of organizational commitment, group memberships and retirement transition framing on older worker’s anticipated identity change in retirement

Retirement is an eagerly awaited life transition for many older workers, but some may anticipate their exit from the workforce will result in loss of meaningful work-based activities and social interactions. For older workers more committed to their organization, retirement might represent a threat to maintaining a consistent, positive identity. Across three pre-registered studies of US adults aged 49 to 75, we investigated the relationship between organizational commitment and anticipated identity changes in retirement. Studies 1 and 2 (N = 1059) found that older workers largely anticipated positive changes to their identity in retirement. In Study 2, we divided older workers into two conditions and used a framing manipulation to present retirement as either a ‘role exit’ or a ‘role entry’. In the ‘role exit’ condition, older workers less committed to their organization anticipated more positive changes when they held more group memberships compared to those with fewer group memberships. Those in the ‘role entry’ condition anticipated significantly more positive changes to their identity in retirement than those in the ‘role exit’ condition, but did not anticipate more positive changes based on organizational commitment or group memberships. More group memberships, but not lower organizational commitment, was associated with more positive anticipation of identity changes in retirement. Study 3 (N = 215) surveyed older adults after they had retired, finding that identity changes experienced post-retirement were less positive than those anticipated by older workers. We discuss the theoretical and applied implications of these findings for older workers’ retirement decisions and wellbeing.

Replicability, Robustness, and Reproducibility in Psychological Science

Replication-an important, uncommon, and misunderstood practice-is gaining appreciation in psychology. Achieving replicability is important for making research progress. If findings are not replicable, then prediction and theory development are stifled. If findings are replicable, then interrogation of their meaning and validity can advance knowledge. Assessing replicability can be productive for generating and testing hypotheses by actively confronting current understandings to identify weaknesses and spur innovation. For psychology, the 2010s might be characterized as a decade of active confrontation. Systematic and multi-site replication projects assessed current understandings and observed surprising failures to replicate many published findings. Replication efforts highlighted sociocultural challenges such as disincentives to conduct replications and a tendency to frame replication as a personal attack rather than a healthy scientific practice, and they raised awareness that replication contributes to self-correction. Nevertheless, innovation in doing and understanding replication and its cousins, reproducibility and robustness, has positioned psychology to improve research practices and accelerate progress. Expected final online publication date for the Annual Review of Psychology, Volume 73 is January 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Pushing Back Against the Microaggression Pushback in Academic Psychology: Reflections on a Concept-Creep Paradox

Echoing the 1960s, the 2020s opened with racial tensions boiling. The Black Lives Matter movement is energized, issuing pleas to listen to Black voices regarding day-to-day discrimination and expressing frustrations over the slow progress of social justice. However, psychological scientists have published only several opinion pieces on racial microaggressions, primarily objections, and strikingly little empirical data. Here I document three trends in psychology that coincide with the academic pushback against microaggressions: concept-creep concerns, especially those regarding expanded notions of harm; the expansion of right-leaning values in moral judgments (moral foundations theory); and an emphasis on prejudice symmetry, with the political left deemed equivalently biased against right-leaning targets (e.g., the rich, police) as the right is against left-leaning targets (e.g., Black people, women, LGBT+ people). Psychological scientists have ignored power dynamics and have strayed from their mission to understand and combat prejudice against disadvantaged populations, rendering researchers distracted and ill-equipped to tackle the microaggression concept. An apparent creep paradox, with calls to both reduce (e.g., harm) and expand (e.g., liberal prejudices, conservative moral foundations) concepts, poses a serious challenge to research on prejudice. I discuss the need for psychology to better capture Black experiences and to "tell it like it is" or risk becoming an irrelevant discipline of study.

Biodiversity conservation as a promising frontier for behavioural science

Human activities are degrading ecosystems worldwide, posing existential threats for biodiversity and humankind. Slowing and reversing this degradation will require profound and widespread changes to human behaviour. Behavioural scientists are therefore well placed to contribute intellectual leadership in this area. This Perspective aims to stimulate a marked increase in the amount and breadth of behavioural research addressing this challenge. First, we describe the importance of the biodiversity crisis for human and non-human prosperity and the central role of human behaviour in reversing this decline. Next, we discuss key gaps in our understanding of how to achieve behaviour change for biodiversity conservation and suggest how to identify key behaviour changes and actors capable of improving biodiversity outcomes. Finally, we outline the core components for building a robust evidence base and suggest priority research questions for behavioural scientists to explore in opening a new frontier of behavioural science for the benefit of nature and human wellbeing.

Spanish Scientists' Opinion about Science and Researcher Behavior

We surveyed 348 Psychology and Education researchers within Spain, on issues such as their perception of a crisis in Science, their confidence in the quality of published results, and the use of questionable research practices (QRP). Their perceptions regarding pressure to publish and academic competition were also collected. The results indicate that a large proportion of the sample of Spanish academics think there is a crisis in Science, mainly due to a lack of economic investment, and doubts the quality of published findings. They also feel strong pressure to publish in high impact factor journals and a highly competitive work climate.

So Useful as a Good Theory? The Practicality Crisis in (Social) Psychological Theory

Practicality was a valued attribute of academic psychological theory during its initial decades, but usefulness has since faded in importance to the field. Theories are now evaluated mainly on their ability to account for decontextualized laboratory data and not their ability to help solve societal problems. With laudable exceptions in the clinical, intergroup, and health domains, most psychological theories have little relevance to people's everyday lives, poor accessibility to policymakers, or even applicability to the work of other academics who are better positioned to translate the theories to the practical realm. We refer to the lack of relevance, accessibility, and applicability of psychological theory to the rest of society as the practicality crisis. The practicality crisis harms the field in its ability to attract the next generation of scholars and maintain viability at the national level. We describe practical theory and illustrate its use in the field of self-regulation. Psychological theory is historically and scientifically well positioned to become useful should scholars in the field decide to value practicality. We offer a set of incentives to encourage the return of social psychology to the Lewinian vision of a useful science that speaks to pressing social issues.

Can Psychological Interventions Improve Intergroup Attitudes Post Terror Attacks?

This research concurrently investigated the effectiveness of three established bias-reducing interventions (i.e., positive affirmation, secure attachment, and cognitive dissonance) in the wake of the Paris and Brussels terror attacks. Using frequentist and Bayesian analyses, Study 1 ( N = 1,676), launched within days of the attacks, found that compared to a control condition, the interventions did not significantly improve intergroup attitudes. Instead, the data showed strong support of the null hypotheses that there were no intervention effects. Proximity to the attacks did not moderate the effect. Study 2 ( N = 285) reexamined the effects of the three interventions 2.5 years after the attacks, generally replicating the pattern of findings in Study 1. Together, this research highlights the challenge of intergroup bias reduction following terror attacks. We conclude by discussing several recommendations for how psychological interventions could play a more impactful role in contexts of heightened conflict.