Toward consensus on pain-related content in the pre-registration, undergraduate physical therapy curriculum: a Delphi-study

BACKGROUND

Access to pain education for healthcare professionals is an International Association for the Study of Pain's key recommendation to improve pain care. The content of preregistration and undergraduate physical therapy pain curricula, however, is highly variable.

OBJECTIVE

This study aimed to develop a list, by consensus, of essential pain-related topics for the undergraduate physical therapy curriculum.

METHODS

A modified Delphi study was conducted in four rounds, including a Delphi Panel (N = 22) consisting of in pain experienced lecturers of preregistration undergraduate physical therapy of Universities of Applied Sciences in the Netherlands, and five Validation Panels. Round 1: topics were provided by the Delphi Panel, postgraduate pain educators, and a literature search. Rounds 2-4: the Delphi Panel rated the topics and commented. All topics were analyzed in terms of importance and degree of consensus. Validation Panels rated the outcome of Round 2.

RESULTS

The Delphi Panel rated 257, 146, and 90 topics in Rounds 2, 3, and 4, respectively. This resulted in 71 topics judged as "not important," 97 as "important," and 89 as "highly important." In total, 63 topics were rated as "highly important" by the Delphi Panel and Validation Panels.

CONCLUSION

A list was developed and can serve as a foundation for the development of comprehensive physical therapy pain curricula.

A Practical Significance Bias in Laypeople's Evaluation of Scientific Findings

People often rely on scientific findings to help them make decisions-however, failing to report effect magnitudes might lead to a potential bias in assuming findings are practically significant. Across two online studies (Prolific; N = 800), we measured U.S. adults' endorsements of expensive interventions described in media reports that led to effects that were small, large, or of unreported magnitude between groups. Participants who viewed interventions with unreported effect magnitudes were more likely to endorse interventions compared with those who viewed interventions with small effects and were just as likely to endorse interventions as those who viewed interventions with large effects, suggesting a practical significance bias. When effect magnitudes were reported, participants on average adjusted their evaluations accordingly. However, some individuals, such as those with low numeracy skills, were more likely than others to act on small effects, even when explicitly prompted to first consider the meaningfulness of the effect.

Effects of Voice Pitch on Social Perceptions Vary With Relational Mobility and Homicide Rate

Fundamental frequency ( fo) is the most perceptually salient vocal acoustic parameter, yet little is known about how its perceptual influence varies across societies. We examined how fo affects key social perceptions and how socioecological variables modulate these effects in 2,647 adult listeners sampled from 44 locations across 22 nations. Low male fo increased men's perceptions of formidability and prestige, especially in societies with higher homicide rates and greater relational mobility in which male intrasexual competition may be more intense and rapid identification of high-status competitors may be exigent. High female fo increased women's perceptions of flirtatiousness where relational mobility was lower and threats to mating relationships may be greater. These results indicate that the influence of fo on social perceptions depends on socioecological variables, including those related to competition for status and mates.

Identity Concealment May Discourage Health-Seeking Behaviors: Evidence From Sexual-Minority Men During the 2022 Global Mpox Outbreak

People who conceal their stigmatized identities often experience worse physical health. One possibility for why is that concealment may render certain health-seeking behaviors more difficult. We tested this possibility during the 2022 global mpox outbreak, a public-health emergency that disproportionately affected sexual-minority men. We recruited adult sexual-minority men from Prolific at two time points near the outbreak's peak and attenuation (n = 864 and n = 685, respectively). We found that men who concealed their minority sexual orientations were less likely to (a) receive a vaccine to protect against mpox, (b) receive an mpox test, and (c) report having received an mpox vaccine. The relationship between concealment and vaccine receipt was serially mediated by reduced community connectedness and reduced knowledge of mpox resources. We call for thoughtful consideration of how to reach stigmatized groups with public-health resources, inclusive of those who conceal.

How Can People Become Happier? A Systematic Review of Preregistered Experiments

Can happiness be reliably increased? Thousands of studies speak to this question. However, many of them were conducted during a period in which researchers commonly "p-hacked," creating uncertainty about how many discoveries might be false positives. To prevent p-hacking, happiness researchers increasingly preregister their studies, committing to analysis plans before analyzing data. We conducted a systematic literature search to identify preregistered experiments testing strategies for increasing happiness. We found surprisingly little support for many widely recommended strategies (e.g., performing random acts of kindness). However, our review suggests that other strategies-such as being more sociable-may reliably promote happiness. We also found strong evidence that governments and organizations can improve happiness by providing underprivileged individuals with financial support. We conclude that happiness research stands on the brink of an exciting new era, in which modern best practices will be applied to develop theoretically grounded strategies that can produce lasting gains in life satisfaction.

Investigating Inattentional Blindness Through the Lens of Fear Chemosignals

Inattentional blindness is a phenomenon wherein people fail to perceive obvious stimuli within their vision, sometimes leading to dramatic consequences. Research on the effects of fear chemosignals suggests that they facilitate receivers' sensory acquisition. We aimed to examine the interplay between these phenomena, investigating whether exposure to fear chemosignals (vs. rest body odors) can reduce the inattentional-blindness handicap. Utilizing a virtual-reality aquarium, we asked participants to count how many morsels a school of fish consumed while two unexpected stimuli swam by. We predicted that participants exposed to fear chemosignals (N = 131) would detect unexpected stimuli significantly more often than participants exposed to rest body odors (N = 125). All participants were adult Portuguese university students aged 18 to 40 years. The results confirmed our hypothesis, χ2(1) = 6.10, p = .014, revealing that exposure to fear chemosignals significantly increased the detection of unexpected stimuli by about 10%. The implications of our findings open a novel avenue for reducing the adverse consequences of inattentional blindness.

Personal Misconduct Elicits Harsher Professional Consequences for Artists (vs. Scientists): A Moral-Decoupling Process

Recent years have brought increased accountability for personal misconduct, yet often, unequal consequences have resulted from similar offenses. Findings from a unique archival data set (N = 619; all university faculty) and three preregistered experiments (N = 2,594) show that the perceived artistic-versus-scientific nature of the offender's professional contributions influences the professional punishment received. In Study 1, analysis of four decades of university sexual-misconduct cases reveals that faculty in artistic (vs. scientific) fields have on average received more severe professional consequences. Study 2 demonstrates this experimentally, offering mediational evidence that greater difficulty morally decoupling art (vs. science) contributes to the phenomenon. Study 3 provides further evidence for this mechanism through experimental moderation. Finally, Study 4 shows that merely framing an individual's work as artistic versus scientific results in replication of these effects. Several potential alternative mechanisms to moral decoupling are tested but not supported. Practical and theoretical implications are discussed.

Reducing bias in secondary data analysis via an Explore and Confirm Analysis Workflow (ECAW): a proposal and survey of observational researchers

Background. Although preregistration can reduce researcher bias and increase transparency in primary research settings, it is less applicable to secondary data analysis. An alternative method that affords additional protection from researcher bias, which cannot be gained from conventional forms of preregistration alone, is an Explore and Confirm Analysis Workflow (ECAW). In this workflow, a data management organization initially provides access to only a subset of their dataset to researchers who request it. The researchers then prepare an analysis script based on the subset of data, upload the analysis script to a registry, and then receive access to the full dataset. ECAWs aim to achieve similar goals to preregistration, but make access to the full dataset contingent on compliance. The present survey aimed to garner information from the research community where ECAWs could be applied-employing the Avon Longitudinal Study of Parents and Children (ALSPAC) as a case example. Methods. We emailed a Web-based survey to researchers who had previously applied for access to ALSPAC's transgenerational observational dataset. Results. We received 103 responses, for a 9% response rate. The results suggest that-at least among our sample of respondents-ECAWs hold the potential to serve their intended purpose and appear relatively acceptable. For example, only 10% of respondents disagreed that ALSPAC should run a study on ECAWs (versus 55% who agreed). However, as many as 26% of respondents agreed that they would be less willing to use ALSPAC data if they were required to use an ECAW (versus 45% who disagreed). Conclusion. Our data and findings provide information for organizations and individuals interested in implementing ECAWs and related interventions. Preregistration. https://osf.io/g2fw5 Deviations from the preregistration are outlined in electronic supplementary material A.

'One size doesn't fit all': Lessons from interaction analysis on tailoring Open Science practices to qualitative research

The Open Science Movement aims to enhance the soundness, transparency, and accessibility of scientific research, and at the same time increase public trust in science. Currently, Open Science practices are mainly presented as solutions to the 'reproducibility crisis' in hypothetico-deductive quantitative research. Increasing interest has been shown towards exploring how these practices can be adopted by qualitative researchers. In reviewing this emerging body of work, we conclude that the issue of diversity within qualitative research has not been adequately addressed. Furthermore, we find that many of these endeavours start with existing solutions for which they are trying to find matching problems to be solved. We contrast this approach with a natural incorporation of Open Science practices within interaction analysis and its constituent research traditions: conversation analysis, discursive psychology, ethnomethodology, and membership categorisation analysis. Zooming in on the development of conversation analysis starting in the 1960s, we highlight how practices for opening up and sharing data and analytic thinking have been embedded into its methodology. On the basis of this presentation, we propose a series of lessons learned for adopting Open Science practices in qualitative research.

FAIR environmental and health registry (FAIREHR)- supporting the science to policy interface and life science research, development and innovation

The environmental impact on health is an inevitable by-product of human activity. Environmental health sciences is a multidisciplinary field addressing complex issues on how people are exposed to hazardous chemicals that can potentially affect adversely the health of present and future generations. Exposure sciences and environmental epidemiology are becoming increasingly data-driven and their efficiency and effectiveness can significantly improve by implementing the FAIR (findable, accessible, interoperable, reusable) principles for scientific data management and stewardship. This will enable data integration, interoperability and (re)use while also facilitating the use of new and powerful analytical tools such as artificial intelligence and machine learning in the benefit of public health policy, and research, development and innovation (RDI). Early research planning is critical to ensuring data is FAIR at the outset. This entails a well-informed and planned strategy concerning the identification of appropriate data and metadata to be gathered, along with established procedures for their collection, documentation, and management. Furthermore, suitable approaches must be implemented to evaluate and ensure the quality of the data. Therefore, the 'Europe Regional Chapter of the International Society of Exposure Science' (ISES Europe) human biomonitoring working group (ISES Europe HBM WG) proposes the development of a FAIR Environment and health registry (FAIREHR) (hereafter FAIREHR). FAIR Environment and health registry offers preregistration of studies on exposure sciences and environmental epidemiology using HBM (as a starting point) across all areas of environmental and occupational health globally. The registry is proposed to receive a dedicated web-based interface, to be electronically searchable and to be available to all relevant data providers, users and stakeholders. Planned Human biomonitoring studies would ideally be registered before formal recruitment of study participants. The resulting FAIREHR would contain public records of metadata such as study design, data management, an audit trail of major changes to planned methods, details of when the study will be completed, and links to resulting publications and data repositories when provided by the authors. The FAIREHR would function as an integrated platform designed to cater to the needs of scientists, companies, publishers, and policymakers by providing user-friendly features. The implementation of FAIREHR is expected to yield significant benefits in terms of enabling more effective utilization of human biomonitoring (HBM) data.

Using preregistration as a tool for transparent fNIRS study design

Significance

The expansion of functional near-infrared spectroscopy (fNIRS) methodology and analysis tools gives rise to various design and analytical decisions that researchers have to make. Several recent efforts have developed guidelines for preprocessing, analyzing, and reporting practices. For the planning stage of fNIRS studies, similar guidance is desirable. Study preregistration helps researchers to transparently document study protocols before conducting the study, including materials, methods, and analyses, and thus, others to verify, understand, and reproduce a study. Preregistration can thus serve as a useful tool for transparent, careful, and comprehensive fNIRS study design.

Aim

We aim to create a guide on the design and analysis steps involved in fNIRS studies and to provide a preregistration template specified for fNIRS studies.

Approach

The presented preregistration guide has a strong focus on fNIRS specific requirements, and the associated template provides examples based on continuous-wave (CW) fNIRS studies conducted in humans. These can, however, be extended to other types of fNIRS studies.

Results

On a step-by-step basis, we walk the fNIRS user through key methodological and analysis-related aspects central to a comprehensive fNIRS study design. These include items specific to the design of CW, task-based fNIRS studies, but also sections that are of general importance, including an in-depth elaboration on sample size planning.

Conclusions

Our guide introduces these open science tools to the fNIRS community, providing researchers with an overview of key design aspects and specification recommendations for comprehensive study planning. As such it can be used as a template to preregister fNIRS studies or merely as a tool for transparent fNIRS study design.

Comparing Foodie Calls in Poland, the United Kingdom, and the United States: A Registered Replication Report

Collisson et al. (2020) found Dark Triad traits and gender role beliefs predicted "foodie calls," a phenomenon where people go on a date with others, to whom they are not attracted, for a free meal. Because gender roles and dating norms differ across cultures, we conducted a registered replication across different cultures by surveying 1838 heterosexual women from Poland, the United Kingdom (UK), and the United States (US). Relying on the structural equation modeling, as conducted in the original study, our findings revealed gender role beliefs best predicted foodie calls and their perceived acceptability, whereas the Dark Triad's general factor was nonsignificant. Analyses at the country level yielded mixed results. The original findings were replicated in the UK and Poland, but not in the US, where only narcissism predicted foodie calls. In the US, gender role beliefs predicted foodie call acceptability, but the Dark Triad general factor did not. Potential reasons for why traditional gender roles, but not the Dark Triad, predicted foodie calls in the US are discussed.

Improving evidence-based practice through preregistration of applied research: Barriers and recommendations

Preregistration is the practice of publicly publishing plans on central components of the research process before access to, or collection, of data. Within the context of the replication crisis, open science practices like preregistration have been pivotal in facilitating greater transparency in research. However, such practices have been applied nearly exclusively to basic academic research, with rare consideration of the relevance to applied and consultancy-based research. This is particularly problematic as such research is typically reported with very low levels of transparency and accountability despite being disseminated as influential gray literature to inform practice. Evidence-based practice is best served by an appreciation of multiple sources of quality evidence, thus the current review considers the potential of preregistration to improve both the accessibility and credibility of applied research toward more rigorous evidence-based practice. The current three-part review outlines, first, the opportunities of preregistration for applied research, and second, three barriers - practical challenges, stakeholder roles, and the suitability of preregistration. Last, this review makes four recommendations to overcome these barriers and maximize the opportunities of preregistration for academics, industry, and the structures they are held within - changes to preregistration templates, new types of templates, education and training, and recognition and structural changes.

Lessons learned: A neuroimaging research center's transition to open and reproducible science

Human functional neuroimaging has evolved dramatically in recent years, driven by increased technical complexity and emerging evidence that functional neuroimaging findings are not generally reproducible. In response to these trends, neuroimaging scientists have developed principles, practices, and tools to both manage this complexity as well as to enhance the rigor and reproducibility of neuroimaging science. We group these best practices under four categories: experiment pre-registration, FAIR data principles, reproducible neuroimaging analyses, and open science. While there is growing recognition of the need to implement these best practices there exists little practical guidance of how to accomplish this goal. In this work, we describe lessons learned from efforts to adopt these best practices within the Brain Imaging Research Center at the University of Arkansas for Medical Sciences over 4 years (July 2018-May 2022). We provide a brief summary of the four categories of best practices. We then describe our center's scientific workflow (from hypothesis formulation to result reporting) and detail how each element of this workflow maps onto these four categories. We also provide specific examples of practices or tools that support this mapping process. Finally, we offer a roadmap for the stepwise adoption of these practices, providing recommendations of why and what to do as well as a summary of cost-benefit tradeoffs for each step of the transition.

Losing Sight of Piecemeal Progress: People Lump and Dismiss Improvement Efforts That Fall Short of Categorical Change-Despite Improving

Fourteen experiments (N = 10,556 adult participants, including more than 20,000 observed choices across 25 issues) documented how people perceive and respond to relative progress out in the world, revealing a robust "negative-lumping" effect. As problematic entities worked to better their ways, participants shifted to dismiss them if they fell short of categorical reform-despite distinctions in improvement. This increased dismissal of relative gains as "all the same" was driven by the belief that falling short signals an eschewal of doing the bare minimum and lacking serious intent to change, making these gains seem less deserving of recognition. Critically, participants then "checked out": They underrewarded and underinvested in efforts toward "merely" incremental improvement. Finally, in all experiments, participants lumped together absolute failures but not absolute successes, highlighting a unique blindness to gradations of badness. When attempts to eradicate a problem fail, people might dismiss smaller but critical steps that were and can still be made.

Seven steps to enhance Open Science practices in animal science

The Open Science movement aims at ensuring accessibility, reproducibility, and transparency of research. The adoption of Open Science practices in animal science, however, is still at an early stage. To move ahead as a field, we here provide seven practical steps to embrace Open Science in animal science. We hope that this paper contributes to the shift in research practices of animal scientists towards open, reproducible, and transparent science, enabling the field to gain additional public trust and deal with future challenges to guarantee reliable research. Although the paper targets primarily animal science researchers, the steps discussed here are also applicable to other research domains.

Survey on Open Science Practices in Functional Neuroimaging

Replicability and reproducibility of scientific findings is paramount for sustainable progress in neuroscience. Preregistration of the hypotheses and methods of an empirical study before analysis, the sharing of primary research data, and compliance with data standards such as the Brain Imaging Data Structure (BIDS), are considered effective practices to secure progress and to substantiate quality of research. We investigated the current level of adoption of open science practices in neuroimaging and the difficulties that prevent researchers from using them. Email invitations to participate in the survey were sent to addresses received through a PubMed search of human functional magnetic resonance imaging studies that were published between 2010 and 2020. 283 persons completed the questionnaire. Although half of the participants were experienced with preregistration, the willingness to preregister studies in the future was modest. The majority of participants had experience with the sharing of primary neuroimaging data. Most of the participants were interested in implementing a standardized data structure such as BIDS in their labs. Based on demographic variables, we compared participants on seven subscales, which had been generated through factor analysis. Exploratory analyses found that experienced researchers at lower career level had higher fear of being transparent and researchers with residence in the EU had a higher need for data governance. Additionally, researchers at medical faculties as compared to other university faculties reported a more unsupportive supervisor with regards to open science practices and a higher need for data governance. The results suggest growing adoption of open science practices but also highlight a number of important impediments.

Devaluation of NoGo stimuli is both robust and fragile

Consistently not responding to stimuli during go/no-go training leads to lower evaluations of these NoGo stimuli. How this NoGo-devaluation-effect can be explained has remained unclear. Here, we ran three experiments to test the hypothesis that people form stimulus-stop-associations during the training, which predict the strength of the devaluation-effect. In Experiment 1, we tried to simultaneously measure the stimulus-stop-associations and NoGo-devaluation, but we failed to find these effects. In Experiment 2, we measured NoGo-devaluation with established procedures from previous work, and stimulus-stop-associations with a novel separate task. Results revealed a clear NoGo-devaluation-effect, which remained visible across multiple rating blocks. Interestingly, this devaluation-effect disappeared when stimulus-stop-associations were measured before stimulus evaluations, and there was no evidence supporting the formation of the stimulus-stop-associations. In Experiment 3, we found evidence for the acquisition of stimulus-stop-associations using an established task from previous work, but this time we found no subsequent NoGo-devaluation-effect. The present research suggests that the NoGo-devaluation-effect and stimulus-stop-associations can be found with standard established procedures, but that these effects are very sensitive to alterations of the experimental protocol. Furthermore, we failed to find evidence for both effects within the same experimental protocol, which has important theoretical and applied implications.

Pathological gaming: a longitudinal study from the perspectives of mental health problems and social stress model

Debates about pathological gaming continues in the wake of the World Health Organization's (WHO) decision to establish a gaming disorder diagnosis. Questions persist whether gaming disorder is best conceived as a stand-alone psychiatric disorder, or whether it heralds or accompanies other, more established conditions, such as depression or ADHD. We tested these hypotheses in a sample of 3,034 youth from Singapore. Evidence suggests that pathological gaming is a somewhat unstable construct, often remitting spontaneously. Youth with preexisting ADHD or depression were more likely to develop later pathological gaming problems, while the inverse was not true, with neither early pathological gaming nor gaming time predictive of later mental health problems. Results suggest that, whenever there is any need to conduct robust evidence-based studies, more evidence should be collected before new disorders are recognized by means of "expert consensus".

Declaration of common standards for the preregistration of animal research-speeding up the scientific progress

Preregistration of studies is a recognized tool in clinical research to improve the quality and reporting of all gained results. In preclinical research, preregistration could boost the translation of published results into clinical breakthroughs. When studies rely on animal testing or form the basis of clinical trials, maximizing the validity and reliability of research outcomes becomes in addition an ethical obligation. Nevertheless, the implementation of preregistration in animal research is still slow. However, research institutions, funders, and publishers start valuing preregistration, and thereby level the way for its broader acceptance in the future. A total of 3 public registries, the OSF registry, preclinicaltrials.eu, and animalstudyregistry.org already encourage the preregistration of research involving animals. Here, they jointly declare common standards to make preregistration a valuable tool for better science. Registries should meet the following criteria: public accessibility, transparency in their financial sources, tracking of changes, and warranty and sustainability of data. Furthermore, registration templates should cover a minimum set of mandatory information and studies have to be uniquely identifiable. Finally, preregistered studies should be linked to any published outcome. To ensure that preregistration becomes a powerful instrument, publishers, funders, and institutions should refer to registries that fulfill these minimum standards.

Conceptual replication of , "Self-efficacy as a mediator in the relationship between self-oriented perfectionism and academic procrastination"

BACKGROUND

Self-oriented perfectionism is the tendency to set high standards for oneself and evaluate one's behaviour accordingly. Based on a study of 692 students in Korea, Seo (2008) reported finding a negative relationship between self-oriented perfectionism and academic procrastination - i.e., the tendency to procrastinate on academic tasks. Furthermore, Seo reported that this relationship was completely mediated by self-efficacy. Seo's study has been influential in the literature but to our knowledge has not yet been independently replicated. In this study we report a preregistered conceptual replication testing five hypotheses based on Seo's key findings.

PARTICIPANTS AND PROCEDURE

A detailed preregistration (including data processing and analysis syntax) was lodged in advance of data collection at https://osf.io/xfvd8. Participants were 575 students recruited from OECD countries using prolific.co. Academic procrastination was measured via an adapted version of the Procrastination Assessment Scale - Students, while self-oriented perfectionism was measured via the 5-item self-oriented perfectionism subscale of the Big Three Perfectionism Scale. Self-efficacy was measured via the New General Self-Efficacy Scale. Both ordinary least squares regression and structural equation modelling were used to test hypotheses.

RESULTS

We found no evidence of a bivariate relationship between self-oriented perfectionism and academic procrastination in either set of analyses. However, we did find evidence of a small and negative indirect effect of self-oriented perfectionism on academic procrastination via self-efficacy.

CONCLUSIONS

We were only able to partially replicate Seo's key findings, having found no evidence of a negative relationship between self-oriented perfectionism and academic procrastination.

Challenges for assessing replicability in preclinical cancer biology

We conducted the Reproducibility Project: Cancer Biology to investigate the replicability of preclinical research in cancer biology. The initial aim of the project was to repeat 193 experiments from 53 high-impact papers, using an approach in which the experimental protocols and plans for data analysis had to be peer reviewed and accepted for publication before experimental work could begin. However, the various barriers and challenges we encountered while designing and conducting the experiments meant that we were only able to repeat 50 experiments from 23 papers. Here we report these barriers and challenges. First, many original papers failed to report key descriptive and inferential statistics: the data needed to compute effect sizes and conduct power analyses was publicly accessible for just 4 of 193 experiments. Moreover, despite contacting the authors of the original papers, we were unable to obtain these data for 68% of the experiments. Second, none of the 193 experiments were described in sufficient detail in the original paper to enable us to design protocols to repeat the experiments, so we had to seek clarifications from the original authors. While authors were extremely or very helpful for 41% of experiments, they were minimally helpful for 9% of experiments, and not at all helpful (or did not respond to us) for 32% of experiments. Third, once experimental work started, 67% of the peer-reviewed protocols required modifications to complete the research and just 41% of those modifications could be implemented. Cumulatively, these three factors limited the number of experiments that could be repeated. This experience draws attention to a basic and fundamental concern about replication - it is hard to assess whether reported findings are credible.

Psychophysiology, cognition, and political differences: Guest editors' introduction to the special issue

We introduce the Politics and the Life Sciences special issue on Psychophysiology, Cognition, and Political Differences. This issue represents the second special issue funded by the Association for Politics and the Life Sciences that adheres to the Open Science Framework for registered reports (RR). Here pre-analysis plans (PAPs) are peer-reviewed and given in-principle acceptance (IPA) prior to data being collected and/or analyzed, and are published contingent upon the preregistration of the study being followed as proposed. Bound by a common theme of the importance of incorporating psychophysiological perspectives into the study of politics, broadly defined, the articles in this special issue feature a unique set of research questions and methodologies. In the following, we summarize the findings, discuss the innovations produced by this research, and highlight the importance of open science for the future of political science research.

Fear of the unknown as a mechanism of the inverse relation between life meaning and psychological distress

BACKGROUND AND OBJECTIVES

Although there is accumulating evidence for an inverse relation between life meaning and psychological distress, little is known about the mechanisms of this relation. Using cross-sectional, observational methods, this research examined fear of uncertainty as one potential mechanism.

DESIGN AND METHODS

Study 1 (N = 141) was completed with a convenience sample, a unidimensional measure of life meaning, and general measures of anxiety and depression. Study 2 (N = 152) was completed with a sample prescreened for anxiety, a multidimensional measure of life meaning, and clinical measures of anxiety and depression.

RESULTS

The results from both studies generally showed an inverse relation between life meaning and psychological distress. Study 2 further indicated that these relations were stronger for the meaning subscale of perceiving life as coherent/comprehensible than the subscales assessing whether participants' lives are perceived as purposeful or significant. Mediation analyses in both studies showed indirect effects of life meaning on psychological distress through fear of uncertainty.

CONCLUSIONS

These findings support and extend previous research by showing that (i) meaning-as-comprehension may be particularly important in regards to psychological distress, and (ii) fear of uncertainty may mediate the inverse relation between meaning and measures of anxiety and depression.

Preregistration in diverse contexts: a preregistration template for the application of cognitive models

In recent years, open science practices have become increasingly popular in psychology and related sciences. These practices aim to increase rigour and transparency in science as a potential response to the challenges posed by the replication crisis. Many of these reforms-including the increasingly used preregistration-have been designed for purely experimental work that tests straightforward hypotheses with standard inferential statistical analyses, such as assessing whether an experimental manipulation has an effect on a variable of interest. But psychology is a diverse field of research. The somewhat narrow focus of the prevalent discussions surrounding and templates for preregistration has led to debates on how appropriate these reforms are for areas of research with more diverse hypotheses and more intricate methods of analysis, such as cognitive modelling research within mathematical psychology. Our article attempts to bridge the gap between open science and mathematical psychology, focusing on the type of cognitive modelling that Crüwell et al. (Crüwell S, Stefan AM, Evans NJ. 2019 Robust standards in cognitive science. Comput. Brain Behav. 2, 255-265) labelled model application, where researchers apply a cognitive model as a measurement tool to test hypotheses about parameters of the cognitive model. Specifically, we (i) discuss several potential researcher degrees of freedom within model application, (ii) provide the first preregistration template for model application and (iii) provide an example of a preregistered model application using our preregistration template. More broadly, we hope that our discussions and concrete proposals constructively advance the mostly abstract current debate surrounding preregistration in cognitive modelling, and provide a guide for how preregistration templates may be developed in other diverse or intricate research contexts.

Invited Commentary: Code Review-An Important Step Toward Reproducible Research

In this issue of the Journal, Vable et al. (Am J Epidemiol. 2021;190(10):2172-2177) discuss a systematic approach to code review as a way to improve reproducibility in epidemiologic research. Reproducibility needs to become a cornerstone of our work. In the present commentary, I discuss some of the implications of their proposal, other methods to reduce coding mistakes, and other methods to improve reproducibility in research in general. Finally, I discuss the fact that no one of these approaches is sufficient on its own; rather, these different steps need to become part of a culture that prioritizes reproducibility in research.

Comparing dream to reality: an assessment of adherence of the first generation of preregistered studies

Preregistration is a method to increase research transparency by documenting research decisions on a public, third-party repository prior to any influence by data. It is becoming increasingly popular in all subfields of psychology and beyond. Adherence to the preregistration plan may not always be feasible and even is not necessarily desirable, but without disclosure of deviations, readers who do not carefully consult the preregistration plan might get the incorrect impression that the study was exactly conducted and reported as planned. In this paper, we have investigated adherence and disclosure of deviations for all articles published with the Preregistered badge in Psychological Science between February 2015 and November 2017 and shared our findings with the corresponding authors for feedback. Two out of 27 preregistered studies contained no deviations from the preregistration plan. In one study, all deviations were disclosed. Nine studies disclosed none of the deviations. We mainly observed (un)disclosed deviations from the plan regarding the reported sample size, exclusion criteria and statistical analysis. This closer look at preregistrations of the first generation reveals possible hurdles for reporting preregistered studies and provides input for future reporting guidelines. We discuss the results and possible explanations, and provide recommendations for preregistered research.

Improving rigor and reproducibility in nonhuman primate research

Nonhuman primates (NHPs) are a critical component of translational/preclinical biomedical research due to the strong similarities between NHP and human physiology and disease pathology. In some cases, NHPs represent the most appropriate, or even the only, animal model for complex metabolic, neurological, and infectious diseases. The increased demand for and limited availability of these valuable research subjects requires that rigor and reproducibility be a prime consideration to ensure the maximal utility of this scarce resource. Here, we discuss a number of approaches that collectively can contribute to enhanced rigor and reproducibility in NHP research.

Nonhuman primates (NHP) are a crucial component of biomedical research due to their similarities with human physiology and pathobiology.

Increased rigor and reproducibility in NHP research are critical to maximizing the information obtained from this scarce and valuable resource.

More widespread adoption of approaches such as normative protocols, preregistration, and data sharing, as well as more extensive training in biostatistics, can enhance rigor and reproducibility in NHP studies.

Beyond Statistical Ritual: Theory in Psychological Science

More than 40 years ago, Paul Meehl (1978) published a seminal critique of the state of theorizing in psychological science. According to Meehl, the quality of theories had diminished in the preceding decades, resulting in statistical methods standing in for theoretical rigor. In this introduction to the special issue Theory in Psychological Science, we apply Meehl's account to contemporary psychological science. We suggest that by the time of Meehl's writing, psychology found itself in the midst of a crisis that is typical of maturing sciences, in which the theories that had been guiding research were gradually cast into doubt. Psychologists were faced with the same general choice when worldviews fail: Face reality and pursue knowledge in the absence of certainty, or shift emphasis toward sources of synthetic certainty. We suggest that psychologists have too often chosen the latter option, substituting synthetic certainties for theory-guided research, in much the same manner as Scholastic scholars did centuries ago. Drawing from our contributors, we go on to make recommendations for how psychological science may fully reengage with theory-based science.

A Plea for Preregistration in Personality Disorders Research: The Case of Psychopathy

In response to a crisis of confidence, several methodological initiatives have been launched to improve the robustness of psychological science. Given its real-world implications, personality disorders research is all too important to not follow suit. The authors offer a plea for preregistration in personality disorders research, using psychopathic personality (psychopathy) as a prominent case example. To suit action to word, the authors report on a preregistered study and use it to help refute common misconceptions about preregistration as well as to illustrate that the key strength of preregistration: transparency outweighs its (perceived) disadvantages. Although preregistration will not conclusively settle the many debates roiling the field of psychopathy and other personality disorders, it can help to verify the robustness of empirical observations that inform such debates.

Where Do Early Career Researchers Stand on Open Science Practices? A Survey Within the Max Planck Society

Open science (OS) is of paramount importance for the improvement of science worldwide and across research fields. Recent years have witnessed a transition toward open and transparent scientific practices, but there is still a long way to go. Early career researchers (ECRs) are of crucial relevance in the process of steering toward the standardization of OS practices, as they will become the future decision makers of the institutional change that necessarily accompanies this transition. Thus, it is imperative to gain insight into where ECRs stand on OS practices. Under this premise, the Open Science group of the Max Planck PhDnet designed and conducted an online survey to assess the stance toward OS practices of doctoral candidates from the Max Planck Society. As one of the leading scientific institutions for basic research worldwide, the Max Planck Society provides a considerable population of researchers from multiple scientific fields, englobed into three sections: biomedical sciences, chemistry, physics and technology, and human and social sciences. From an approximate total population of 5,100 doctoral candidates affiliated with the Max Planck Society, the survey collected responses from 568 doctoral candidates. The survey assessed self-reported knowledge, attitudes, and implementation of different OS practices, namely, open access publications, open data, preregistrations, registered reports, and replication studies. ECRs seemed to hold a generally positive view toward these different practices and to be interested in learning more about them. Furthermore, we found that ECRs' knowledge and positive attitudes predicted the extent to which they implemented these OS practices, although levels of implementation were rather low in the past. We observed differences and similarities between scientific sections. We discuss these differences in terms of need and feasibility to apply these OS practices in specific scientific fields, but additionally in relation to the incentive systems that shape scientific communities. Lastly, we discuss the implications that these results can have for the training and career advancement of ECRs, and ultimately, for the consolidation of OS practices.

A Multilab Replication of the Ego Depletion Effect

There is an active debate regarding whether the ego depletion effect is real. A recent preregistered experiment with the Stroop task as the depleting task and the antisaccade task as the outcome task found a medium-level effect size. In the current research, we conducted a preregistered multilab replication of that experiment. Data from 12 labs across the globe (N = 1,775) revealed a small and significant ego depletion effect, d = 0.10. After excluding participants who might have responded randomly during the outcome task, the effect size increased to d = 0.16. By adding an informative, unbiased data point to the literature, our findings contribute to clarifying the existence, size, and generality of ego depletion.

Disgust and political attitudes Guest Editors' Introduction to the Special Issue

We introduce the Politics and the Life Sciences Special Issue on Disgust and Political Attitudes discussing the importance of understanding state and trait disgust, the innovative and transparent process by which registered reports and preregistered studies were chosen and funded, and the manuscripts that make up this special issue. This essay concludes by discussing future research directions in disgust and political attitudes, as well as the benefits of a transparent review process that avoids the "file drawer problem" of unpublished null findings.

Mechanisms and impacts of an incentive-based conservation program with evidence from a randomized control trial

Conservation science needs more high-quality impact evaluations, especially ones that explore mechanisms of success or failure. Randomized control trials (RCTs) provide particularly robust evidence of the effectiveness of interventions (although they have been criticized as reductionist and unable to provide insights into mechanisms), but there have been few such experiments investigating conservation at the landscape scale. We explored the impact of Watershared, an incentive-based conservation program in the Bolivian Andes, with one of the few RCTs of landscape-scale conservation in existence. There is strong interest in such incentive-based conservation approaches as some argue they can avoid negative social impacts sometimes associated with protected areas. We focused on social and environmental outcomes based on responses from a household survey in 129 communities randomly allocated to control or treatment (conducted both at the baseline in 2010 and repeated in 2015-2016). We controlled for incomplete program uptake by combining standard RCT analysis with matching methods and investigated mechanisms by exploring intermediate and ultimate outcomes according to the underlying theory of change. Previous analyses, focused on single biophysical outcomes, showed that over its first 5 years Watershared did not slow deforestation or improve water quality at the landscape scale. We found that Watershared influenced some outcomes measured using the survey, but the effects were complex, and some were unexpected. We thus demonstrated how RCTs can provide insights into the pathways of impact, as well as whether an intervention has impact. This paper, one of the first registered reports in conservation science, demonstrates how preregistration can help make complex research designs more transparent, avoid cherry picking, and reduce publication bias.

Practical Considerations for Navigating Registered Reports

Recent open science efforts to improve rigor and reliability have sparked great enthusiasm. Among these, the Registered Report publication format integrates best practices in hypothesis-driven research with peer review that occurs before the research is conducted. Here, we detail practical recommendations to help researchers negotiate the mechanics of this developing format.

Publication rate in preclinical research: a plea for preregistration

OBJECTIVES

The ultimate goal of biomedical research is the development of new treatment options for patients. Animal models are used if questions cannot be addressed otherwise. Currently, it is widely believed that a large fraction of performed studies are never published, but there are no data that directly address this question.

METHODS

We have tracked a selection of animal study protocols approved in the University Medical Center Utrecht in the Netherlands, to assess whether these have led to a publication with a follow-up period of 7 years.

RESULTS

We found that 60% of all animal study protocols led to at least one publication (full text or abstract). A total of 5590 animals were used in these studies, of which 26% was reported in the resulting publications.

CONCLUSIONS

The data presented here underline the need for preclinical preregistration, in view of the risk of reporting and publication bias in preclinical research. We plea that all animal study protocols should be prospectively registered on an online, accessible platform to increase transparency and data sharing. To facilitate this, we have developed a platform dedicated to animal study protocol registration: www.preclinicaltrials.eu.

Resting State Cortico-Limbic Functional Connectivity and Dispositional Use of Emotion Regulation Strategies: A Replication and Extension Study

Neuroimaging functional connectivity analyses have shown that the negative coupling between the amygdala and cortical regions is linked to better emotion regulation (ER) in experimental task settings. However, less is known about the neural correlates of ER traits or dispositions. The present study aimed to: (1) replicate the findings of differential cortico-limbic coupling during resting-state depending on the dispositional use of emotion regulation strategies. Furthermore, the study aimed to: (2) extend prior findings by examining whether differences in cortico-limbic coupling during resting-state predict experiential and neuronal ER success in a standard ER task. To this end, N = 107 healthy adults completed the Emotion Regulation Questionnaire (ERQ), underwent an 8-min resting-state fMRI acquisition, and completed a reappraisal task during fMRI. Functional connectivity maps of basolateral and centromedial amygdala nuclei were estimated with a seed-based approach regarding associations with regions of the prefrontal cortex and were then correlated with ERQ scores as well as experiential and neuronal ER success. All hypotheses and the analysis plan are preregistered at https://osf.io/8wsgu. Opposed to prior findings, we were not able to replicate a correlation of dispositional ER strategy use with functional connectivity between the amygdala and PFC regions (p > 0.05, FWE-corrected). Furthermore, there was no association of experiential and neuronal reappraisal success with functional connectivity between amygdala and insula as well as PFC (p > 0.05, FWE-corrected). The present preregistered study calls into question the reported association between individual differences in resting-state cortico-limbic connectivity and dispositional use of ER strategies. However, ongoing advances in functional brain imaging and distributed network approaches may leverage the identification of reliable functional connectivity patterns that underlie successful emotion regulation.

Graded fMRI Neurofeedback Training of Motor Imagery in Middle Cerebral Artery Stroke Patients: A Preregistered Proof-of-Concept Study

Ischemic stroke of the middle cerebral artery (MCA), a major brain vessel that supplies the primary motor and premotor cortex, is one of the most common causes for severe upper limb impairment. Currently available motor rehabilitation training largely lacks satisfying efficacy with over 70% of stroke survivors showing residual upper limb dysfunction. Motor imagery-based functional magnetic resonance imaging neurofeedback (fMRI-NF) has been suggested as a potential therapeutic technique to improve motor impairment in stroke survivors. In this preregistered proof-of-concept study (https://osf.io/y69jc/), we translated graded fMRI-NF training, a new paradigm that we have previously studied in healthy participants, to first-time MCA stroke survivors with residual mild to severe impairment of upper limb motor function. Neurofeedback was provided from the supplementary motor area (SMA) targeting two different neurofeedback target levels (low and high). We hypothesized that MCA stroke survivors will show (1) sustained SMA-region of interest (ROI) activation and (2) a difference in SMA-ROI activation between low and high neurofeedback conditions during graded fMRI-NF training. At the group level, we found only anecdotal evidence for these preregistered hypotheses. At the individual level, we found anecdotal to moderate evidence for the absence of the hypothesized graded effect for most subjects. These null findings are relevant for future attempts to employ fMRI-NF training in stroke survivors. The study introduces a Bayesian sequential sampling plan, which incorporates prior knowledge, yielding higher sensitivity. The sampling plan was preregistered together with a priori hypotheses and all planned analysis before data collection to address potential publication/researcher biases. Unforeseen difficulties in the translation of our paradigm to a clinical setting required some deviations from the preregistered protocol. We explicitly detail these changes, discuss the accompanied additional challenges that can arise in clinical neurofeedback studies, and formulate recommendations for how these can be addressed. Taken together, this work provides new insights about the feasibility of motor imagery-based graded fMRI-NF training in MCA stroke survivors and serves as a first example for comprehensive study preregistration of an (fMRI) neurofeedback experiment.

Addressing selective reporting of experiments through predefined exclusion criteria

The pressure for every research article to tell a clear story often leads researchers in the life sciences to exclude experiments that 'did not work' when they write up their results. However, this practice can lead to reporting bias if the decisions about which experiments to exclude are taken after data have been collected and analyzed. Here we discuss how to balance clarity and thoroughness when reporting the results of research, and suggest that predefining the criteria for excluding experiments might help researchers to achieve this balance.

The effect of preregistration on trust in empirical research findings: results of a registered report

The crisis of confidence has undermined the trust that researchers place in the findings of their peers. In order to increase trust in research, initiatives such as preregistration have been suggested, which aim to prevent various questionable research practices. As it stands, however, no empirical evidence exists that preregistration does increase perceptions of trust. The picture may be complicated by a researcher's familiarity with the author of the study, regardless of the preregistration status of the research. This registered report presents an empirical assessment of the extent to which preregistration increases the trust of 209 active academics in the reported outcomes, and how familiarity with another researcher influences that trust. Contrary to our expectations, we report ambiguous Bayes factors and conclude that we do not have strong evidence towards answering our research questions. Our findings are presented along with evidence that our manipulations were ineffective for many participants, leading to the exclusion of 68% of complete datasets, and an underpowered design as a consequence. We discuss other limitations and confounds which may explain why the findings of the study deviate from a previously conducted pilot study. We reflect on the benefits of using the registered report submission format in light of our results. The OSF page for this registered report and its pilot can be found here: http://dx.doi.org/10.17605/OSF.IO/B3K75.

Origins of the concepts cause, cost, and goal in prereaching infants

We investigated the origins and interrelations of causal knowledge and knowledge of agency in 3-month-old infants, who cannot yet effect changes in the world by reaching for, grasping, and picking up objects. Across 5 experiments, n = 152 prereaching infants viewed object-directed reaches that varied in efficiency (following the shortest physically possible path vs. a longer path), goal (lifting an object vs. causing a change in its state), and causal structure (action on contact vs. action at a distance and after a delay). Prereaching infants showed no strong looking preference between a person's efficient and inefficient reaches when the person grasped and displaced an object. When the person reached for and caused a change in the state of the object on contact, however, infants looked longer when this action was inefficient than when it was efficient. Three-month-old infants also showed a key signature of adults' and older infants' causal inferences: This looking preference was abolished if a short spatial and temporal gap separated the action from its effect. The basic intuition that people are causal agents, who navigate around physical constraints to change the state of the world, may be one important foundation for infants' ability to plan their own actions and learn from the acts of others.

Recommendations for Increasing the Transparency of Analysis of Preexisting Data Sets

Secondary data analysis, or the analysis of preexisting data, provides a powerful tool for the resourceful psychological scientist. Never has this been more true than now, when technological advances enable both sharing data across labs and continents and mining large sources of preexisting data. However, secondary data analysis is easily overlooked as a key domain for developing new open-science practices or improving analytic methods for robust data analysis. In this article, we provide researchers with the knowledge necessary to incorporate secondary data analysis into their methodological toolbox. We explain that secondary data analysis can be used for either exploratory or confirmatory work, and can be either correlational or experimental, and we highlight the advantages and disadvantages of this type of research. We describe how transparency-enhancing practices can improve and alter interpretations of results from secondary data analysis and discuss approaches that can be used to improve the robustness of reported results. We close by suggesting ways in which scientific subfields and institutions could address and improve the use of secondary data analysis.

Curtailing the Use of Preregistration: A Misused Term

Improving the usability of psychological research has been encouraged through practices such as prospectively registering research plans. Registering research aligns with the open-science movement, as the registration of research protocols in publicly accessible domains can result in reduced research waste and increased study transparency. In medicine and psychology, two different terms, registration and preregistration, have been used to refer to study registration, but applying inconsistent terminology to represent one concept can complicate both educational outreach and epidemiological investigation. Consistently using one term across disciplines to refer to the concept of study registration may improve the understanding and uptake of this practice, thereby supporting the movement toward improving the reliability and reproducibility of research through study registration. We recommend encouraging use of the original term, registration, given its widespread and long-standing use, including in national registries.

Preregistration Is Hard, And Worthwhile

Preregistration clarifies the distinction between planned and unplanned research by reducing unnoticed flexibility. This improves credibility of findings and calibration of uncertainty. However, making decisions before conducting analyses requires practice. During report writing, respecting both what was planned and what actually happened requires good judgment and humility in making claims.

The registration continuum in clinical science: A guide toward transparent practices

Clinical scientists can use a continuum of registration efforts that vary in their disclosure and timing relative to data collection and analysis. Broadly speaking, registration benefits investigators by offering stronger, more powerful tests of theory with particular methods in tandem with better control of long-run false positive error rates. Registration helps clinical researchers in thinking through tensions between bandwidth and fidelity that surround recruiting participants, defining clinical phenotypes, handling comorbidity, treating missing data, and analyzing rich and complex data. In particular, registration helps record and justify the reasons behind specific study design decisions, though it also provides the opportunity to register entire decision trees with specific endpoints. Creating ever more faithful registrations and standard operating procedures may offer alternative methods of judging a clinical investigator's scientific skill and eminence because study registration increases the transparency of clinical researchers' work. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Does Really One in Ten Believe Capital Punishment Exists in a Contemporary European Community Country? An Endorsed, Prereviewed, Preregistered Replication Study and Meta-Analysis

BACKGROUND

Till et al. (2016) reported that in an Austrian sample approximately one in ten respondents incorrectly believed that Austria still practices, or recently practiced, the death penalty, and that there is a positive association between the amount of weekly television viewing and this gross misperception of the Austrian justice system.

METHODS

An endorsed, prereviewed, preregistered close (N = 597) served to test the veracity of these reported effects. This was coupled with the conceptual extension part, which (a) investigated the potential influence of watching American crime series, (b) accounted for further possible confounds, and (c) tested the generalizability of the effect of television viewing to online streaming.

RESULTS

Online survey data (N = 597) replicated the one-in-ten prevalence of incorrect answers with the 5-item death penalty questionnaire used in the original study, but not, when asking directly about Austria's death penalty practices (prevalence: 0.3%). Younger age, but not the amount of television viewing or online streaming, suggestibility, or preferred TV genre consistently predicted incorrect answers in the death penalty questionnaire. Incorrect answers were Mokken-scalable (i.e., formed a common scale, complying with a non-parametric item response model) and were highly consistent. In contrast to the replication study results, a small meta-analysis of all available evidence (three studies, including the present replication) suggested that the aggregate effect of television viewing nominally was significant, albeit small.

CONCLUSION

The replication study yielded mixed results, which indicate the perception of a high prevalence of beliefs that there is capital punishment in a country without death penalty probably is due to a faultily designed questionnaire and thus a research artifact. Also, positive associations of television viewing with such beliefs likely are only small at best.