Rewarding Replications

Show me the evidence to guide nutrition practice: Scoping review of macronutrient dietary treatments after metabolic and bariatric surgery

BACKGROUND

Clinical practice recommendations for macronutrient intake in Metabolic and Bariatric Surgery (MBS) are insufficiently grounded in the research, possibly due to a paucity of research in key areas necessary to support macronutrient recommendations. An initial scoping review, prior to any systematic review, was determined to be vital.

OBJECTIVES

To identify topical areas in macronutrients and MBS with a sufficient evidence base to guide nutrition recommendations.

METHODS

PubMed, Cochrane, Ovid Medline, and Embase were initially searched in January 2019 (updated November 1, 2023) with terms encompassing current bariatric surgeries and macronutrients. Out of 757 records identified, 98 were included. A template was created. Five types of outcomes were identified for extraction: dietary intake, anthropometrics, adverse symptoms, health, and metabolic outcomes. All stages of screening and extraction were conducted independently by at least two authors and disagreements were resolved via team discussion. Macronutrient-related dietary treatments were classified as either innovative or standard of care. Descriptions of dietary arms were extracted in detail for a qualitatively generated typology of dietary or nutritional treatments. Heatmaps (treatments by outcomes) were produced to identify promising topics for further systematic analyses.

RESULTS

We identified protein supplementation and "food-focused" (e.g., portion-controlled meals, particular foods in the diet, etc.) topical areas in MBS nutrition care with potentially sufficient evidence to create specific MBS Macronutrients guidelines and identified topical areas with little research.

CONCLUSIONS

Clinical practice regarding macronutrient intake remains guided by consensus and indirect evidence. We detail ways that leadership at the profession level may remedy this.

Adolescent Pornography Exposure, Condom Use, and the Moderating Role of Parental Sexual Health Communication: Replication in a U.S. Probability Sample

Following calls for an increase in replication studies in communication science as well as multiple other disciplines, the present study provides a direct replication of a pragmatically and theoretically important investigation of U.S. adolescents' pornography exposure, parent-adolescent sexual health communication, and condomless sex published in this journal. Parent-adolescent sexual health communication has been suggested as a sexual risk-reduction mechanism, but condomless sex among U.S. adolescents is increasing. Simultaneously, pornography remains an extremely popular media genre and condomless sex is the norm in pornographic depictions. The findings of the present study replicated the findings of the original study, with the most notable replicated finding being an interaction between pornography exposure and parent-adolescent sexual health communication on the likelihood of condomless sex. Both in the original and present study, the association between U.S. adolescents' pornography exposure and likelihood of condomless sex decreased as parental-adolescent sexual health communication increased. Results are discussed in terms of the challenges to examining these particular relationships among U.S. youth and the state of replication in the pornography effects literature.

A guide for social science journal editors on easing into open science

Journal editors have a large amount of power to advance open science in their respective fields by incentivising and mandating open policies and practices at their journals. The Data PASS Journal Editors Discussion Interface (JEDI, an online community for social science journal editors: www.dpjedi.org ) has collated several resources on embedding open science in journal editing ( www.dpjedi.org/resources ). However, it can be overwhelming as an editor new to open science practices to know where to start. For this reason, we created a guide for journal editors on how to get started with open science. The guide outlines steps that editors can take to implement open policies and practices within their journal, and goes through the what, why, how, and worries of each policy and practice. This manuscript introduces and summarizes the guide (full guide: https://doi.org/10.31219/osf.io/hstcx ).

Pornography consumption, premarital sex attitudes, and the moderating role of age: Replication in two U.S. panels

Pornography use, sexual attitudes, and age differences in sexual outcomes have each been of longstanding interest to sexologists. Few sexological studies have considered how the association between pornography consumption and sexual attitudes may be moderated by age differences, however. Further, few pornography scholars have directed their research efforts toward replication studies despite calls for an increased emphasis on replication across the social and behavioral sciences. This rapid communication attempted to replicate one of the earliest longitudinal panel studies of the relationship between pornography consumption and sexual attitudes among U.S. adults and the first to examine whether the prospective association between pornography use and attitudes toward premarital sex varies by the age of the pornography consumer. While the present replication results were largely consistent with the original study, they also reinforced the position that complexity of analysis and nuance of interpretation are dual requirements for informative replication studies.

Is Open Science Neoliberal?

The scientific-reform movement, frequently referred to as open science, has the potential to substantially reshape the nature of the scientific activity. For this reason, its sociopolitical antecedents and consequences deserve serious scholarly attention. In a recently formed literature that professes to meet this need, it has been widely argued that the movement is neoliberal. However, for two reasons it is hard to justify this widescale attribution: First, the critics mistakenly represent the movement as a monolithic structure, and second, the critics' arguments associating the movement with neoliberalism because of the movement's (a) preferential focus on methodological issues, (b) underlying philosophy of science, and (c) allegedly promarket ideological proclivities reflected in the methodology and science-policy proposals do not hold under closer scrutiny. These shortcomings show a lack of sufficient engagement with the reform literature. What is needed is more nuanced accounts of the sociopolitical underpinnings of scientific reform. To address this need, we propose a model for the analysis of reform proposals, which represents scientific methodology, axiology, science policy, and ideology as interconnected but relatively distinct domains, and thus allows for recognizing the divergent tendencies in the movement and the uniqueness of particular proposals.

The replication crisis has led to positive structural, procedural, and community changes

The emergence of large-scale replication projects yielding successful rates substantially lower than expected caused the behavioural, cognitive, and social sciences to experience a so-called 'replication crisis'. In this Perspective, we reframe this 'crisis' through the lens of a credibility revolution, focusing on positive structural, procedural and community-driven changes. Second, we outline a path to expand ongoing advances and improvements. The credibility revolution has been an impetus to several substantive changes which will have a positive, long-term impact on our research environment.

Self-beliefs, Transactive Memory Systems, and Collective Identification in Teams: Articulating the Socio-Cognitive Underpinnings of COHUMAIN

Socio-cognitive theory conceptualizes individual contributors as both enactors of cognitive processes and targets of a social context's determinative influences. The present research investigates how contributors' metacognition or self-beliefs, combine with others' views of themselves to inform collective team states related to learning about other agents (i.e., transactive memory systems) and forming social attachments with other agents (i.e., collective team identification), both important teamwork states that have implications for team collective intelligence. We test the predictions in a longitudinal study with 78 teams. Additionally, we provide interview data from industry experts in human-artificial intelligence teams. Our findings contribute to an emerging socio-cognitive architecture for COllective HUman-MAchine INtelligence (i.e., COHUMAIN) by articulating its underpinnings in individual and collective cognition and metacognition. Our resulting model has implications for the critical inputs necessary to design and enable a higher level of integration of human and machine teammates.

Sensitivity to visual cues within motion events in monolingual and bilingual infants

It is well known that infants undergo developmental change in how they respond to language-relevant visual contrasts. For example, when viewing motion events, infants' sensitivities to background information ("ground-path cues," e.g., whether a background is flat and continuous or bounded) change with age. Prior studies with English and Japanese monolingual infants have demonstrated that 14-month-old infants discriminate between motion events that take place against different ground-paths (e.g., an unbounded field vs a bounded street). By 19 months of age, this sensitivity becomes more selective in monolingual infants; only learners of languages that lexically contrast these categories, such as Japanese, discriminate between such events. In this study, we investigated this progression in bilingual infants. We first replicated past reports of an age-related decline in ground-path sensitivity from 14 to 19 months in English monolingual infants living in a multilingual society. English-Mandarin bilingual infants living in that same society were then tested on discrimination of ground-path cues at 14, 19, and 24 months. Although neither the English nor Mandarin language differentiates motion events based on ground-path cues, bilingual infants demonstrated protracted sensitivity to these cues. Infants exhibited a lack of discrimination at 14 months, followed by discrimination at 19 months and a subsequent decline in discrimination at 24 months. In addition, bilingual infants demonstrated more fine-grained sensitivities to subtle ground cues not observed in monolingual infants.

Reducing Internalized Homonegativity: Refinement and Replication of an Online Intervention for Gay Men

We refined and replicated an efficacious brief intervention to reduce internalized homonegativity (IH) with a sample of gay and exclusively same-sex attracted men recruited from outside of LGBT community networks using Amazon Mechanical Turk. We sought to 1) determine if levels of IH differed between the original study's community-based sample and our non-community-based sample, 2) examine the efficacy of the replicated intervention, and 3) assess for longitudinal effects of the intervention at a 30-day follow-up. Four hundred eighty-four participants completed either the intervention or a stress management control condition. Mean levels of IH were higher in the current sample compared with the earlier study's community sample. The intervention was efficacious at reducing global IH, reducing personal homonegativity, and increasing gay affirmation. Ninety-six participants completed the follow-up; follow-up results were not significant and may have been affected by high rates of attrition. Implications for research and practice are discussed.

The Role of Open Science Practices in Scaling Evidence-Based Prevention Programs

The goal of creating evidence-based programs is to scale them at sufficient breadth to support population-level improvements in critical outcomes. However, this promise is challenging to fulfill. One of the biggest issues for the field is the reduction in effect sizes seen when a program is taken to scale. This paper discusses an economic perspective that identifies the underlying incentives in the research process that lead to scale up problems and to deliver potential solutions to strengthen outcomes at scale. The principles of open science are well aligned with this goal. One prevention program that has begun to scale across the USA is early childhood home visiting. While there is substantial impact research on home visiting, overall average effect size is .10 and a recent national randomized trial found attenuated effect sizes in programs implemented under real-world conditions. The paper concludes with a case study of the relevance of the economic model and open science in developing and scaling evidence-based home visiting. The case study considers how the traditional approach for testing interventions has influenced home visiting's evolution to date and how open science practices could have supported efforts to maintain impacts while scaling home visiting. It concludes by considering how open science can accelerate the refinement and scaling of home visiting interventions going forward, through accelerated translation of research into policy and practice.

Methodology over metrics: current scientific standards are a disservice to patients and society

Covid-19 research made it painfully clear that the scandal of poor medical research, as denounced by Altman in 1994, persists today. The overall quality of medical research remains poor, despite longstanding criticisms. The problems are well known, but the research community fails to properly address them. We suggest that most problems stem from an underlying paradox: although methodology is undeniably the backbone of high-quality and responsible research, science consistently undervalues methodology. The focus remains more on the destination (research claims and metrics) than on the journey. Notwithstanding, research should serve society more than the reputation of those involved. While we notice that many initiatives are being established to improve components of the research cycle, these initiatives are too disjointed. The overall system is monolithic and slow to adapt. We assert that top-down action is needed from journals, universities, funders and governments to break the cycle and put methodology first. These actions should involve the widespread adoption of registered reports, balanced research funding between innovative, incremental and methodological research projects, full recognition and demystification of peer review, improved methodological review of reports, adherence to reporting guidelines, and investment in methodological education and research. Currently, the scientific enterprise is doing a major disservice to patients and society.

Are business and management journals anti-replication? An analysis of editorial policies

Purpose

This study aims to explore the degree to which the editorial policies of business and management journals explicitly or implicitly discourage replication studies.

Design/methodology/approach

The paper examines differences in editorial policy toward replication studies relative to journal quality, age and sub-discipline area. A total of 600 journals (listed as Q1 and Q2 in Scopus) were selected for the current study.

Findings

The results reveal that out of 600 selected journals, only 28 (4.7%) were explicitly open to considering replication studies, while 331 (55.2%) were neutral, being neither explicitly nor implicitly dismissive of replication studies. A further 238 (39.7%) were implicitly dismissive of replication studies, and the remaining 3 (0.5%) journals were explicitly disinterested in considering replication studies for publication. CiteScore and Source Normalized Impact per Paper (SNIP) of neutral journals were significantly lower than those of journals, which were implicitly discouraging replication research. With regard to the journals implicitly discouraging replications (238), journals in the subcategory of business and international management (51) had the highest percentage (21.4%) followed by strategy and management 30 (12.6%) and Organizational Behavior (OB) and Human Resource (HR) 25 (10.5%).

Originality/value

The available literature does not explore the degree to which the editorial policies of business and management journals explicitly or implicitly discourage replication studies. The current study attempts to address this gap in the literature. Given the lack of support for replications among business and management journals, the current paper sets forth the suggested steps which are deemed crucial for moving beyond the replication crisis in the business and management field.

Measurement invariance of the Phubbing Scale across 20 countries

Mobile phone addiction is a robust phenomenon observed throughout the world. The social aspect of mobile phone use is crucial; therefore, phubbing is a part of the mobile phone addiction phenomenon. Phubbing is defined as ignoring an interlocutor by glancing at one's mobile phone during a face-to-face conversation. The main aim of this study was to investigate how the Phubbing Scale (containing 10 items) might vary across countries, and between genders. Data were collected in 20 countries: Belarus, Brazil, China, Croatia, Ecuador, India, Israel, Italy, Netherlands, Pakistan, Poland, Portugal, Serbia, Slovakia, Slovenia, Spain, Turkey, UK, Ukraine and USA. The mean age across the sample (N = 7696, 65.8% women, 34.2% men) was 25.32 years (SD = 9.50). The cross-cultural invariance of the scale was investigated using multigroup confirmatory factor analyses (MGCFA) as well as the invariance analyses. Additionally, data from each country were assessed individually via confirmatory factor analyses (CFAs). We obtained two factors, based on only eight of the items: (a) communication disturbances and (b) phone obsession. The 8 items Phubbing Scale.

Programas de intervención y replicabilidad: consideraciones sobre su evaluación en psicología

En este trabajo se hace un repaso acerca de qué es la evaluación de programas de intervención, así como el procedimiento y finalidad que se ha buscado brindarle desde la psicología; y el procedimiento utilizado para llevar a cabo la replicación de estos estudios, especialmente en psicología, para así poder dar contexto a la llamada “crisis de confianza” en psicología. Esto con la finalidad de proponer que la replicabilidad de programas de intervención no podría lograrse de forma satisfactoriamente sin antes llevar a cabo un proceso de evaluación del estudio original. Para esto, se proponen tres parámetros, Factor de Bayes, Tamaño del efecto e Intervalos de Confianza; que han mostrado su utilidad en la literatura de habla inglesa, pero, sin embargo, no se ha difundido de manera extensa en aquella de habla hispana. Se propone lograr una mayor difusión de la estadística Bayesiana para solventar las problemáticas ocasionadas por la estadística frecuentista de prueba de significancia de hipótesis nula, puesto que una de las finalidades del teorema de Bayes es la acumulación y actualización continua del conocimiento obtenido de replicaciones, sin dejar de lado la evaluación de los grados de certeza de los resultados obtenidos. Así, este trabajo está dirigido para profesionistas nuevos y veteranos en el ámbito de la evaluación, que empiezan a adentrarse en la estadística como una forma de evaluar programas de investigación e intervención, por lo que se ha buscado explicar los parámetros propuestos de la forma más clara y concisa posible.

Programas de intervención y replicabilidad: consideraciones sobre su evaluación en psicología

En este trabajo se hace un repaso acerca de qué es la evaluación de programas de intervención, así como el procedimiento y finalidad que se ha buscado brindarle desde la psicología; y el procedimiento utilizado para llevar a cabo la replicación de estos estudios, especialmente en psicología, para así poder dar contexto a la llamada “crisis de confianza” en psicología. Esto con la finalidad de proponer que la replicabilidad de programas de intervención no podría lograrse de forma satisfactoriamente sin antes llevar a cabo un proceso de evaluación del estudio original. Para esto, se proponen tres parámetros, Factor de Bayes, Tamaño del efecto e Intervalos de Confianza; que han mostrado su utilidad en la literatura de habla inglesa, pero, sin embargo, no se ha difundido de manera extensa en aquella de habla hispana. Se propone lograr una mayor difusión de la estadística Bayesiana para solventar las problemáticas ocasionadas por la estadística frecuentista de prueba de significancia de hipótesis nula, puesto que una de las finalidades del teorema de Bayes es la acumulación y actualización continua del conocimiento obtenido de replicaciones, sin dejar de lado la evaluación de los grados de certeza de los resultados obtenidos. Así, este trabajo está dirigido para profesionistas nuevos y veteranos en el ámbito de la evaluación, que empiezan a adentrarse en la estadística como una forma de evaluar programas de investigación e intervención, por lo que se ha buscado explicar los parámetros propuestos de la forma más clara y concisa posible.

Stigmatization of Paraphilias and Psychological Conditions Linked to Sexual Offending

Except for pedophilia, little is known about public attitudes toward paraphilias and psychological conditions that are considered risk factors for sexual offending. In the present study we sought to compare the stigma attached to pedophilia with attitudes toward sexual sadism and antisocial tendencies (Study 1, N = 720) and with attitudes toward necrophilia and zoophilia (Study 2, N = 210) in convenience samples of community individuals. When investigating social distance intentions both studies explicitly referred to people with paraphilic sexual interests or antisocial tendencies who had not committed any crimes. In both studies, people with pedophilia emerged as highly stigmatized even though most participants showed awareness that pedophilic interests cannot be chosen or changed at will. The present studies solidify the evidence that pedophilia occupies a place in the public consciousness as less deserving of acceptance than most other sexual offending risk-relevant conditions, including ones that compare in terms of rarity.

Biological sensitivity to context: A test of the hypothesized U-shaped relation between early adversity and stress responsivity

We conducted signal detection analyses to test for curvilinear, U-shaped relations between early experiences of adversity and heightened physiological responses to challenge, as proposed by biological sensitivity to context theory. Based on analysis of an ethnically diverse sample of 338 kindergarten children (4-6 years old) and their families, we identified levels and types of adversity that, singly and interactively, predicted high (top 25%) and low (bottom 25%) rates of stress reactivity. The results offered support for the hypothesized U-shaped curve and conceptually replicated and extended the work of Ellis, Essex, and Boyce (2005). Across both sympathetic and adrenocortical systems, a disproportionate number of children growing up under conditions characterized by either low or high adversity (as indexed by restrictive parenting, family stress, and family economic condition) displayed heightened stress reactivity, compared with peers growing up under conditions of moderate adversity. Finally, as hypothesized by the adaptive calibration model, a disproportionate number of children who experienced exceptionally stressful family conditions displayed blunted cortisol reactivity to stress.

Time to Throw in the Towel? No Evidence for Automatic Conceptual Metaphor Access in Idiom Processing

The goal of the current research was to determine if conceptual metaphors are activated when people read idioms within a text. Participants read passages that included idioms that were consistent (blow your top) or inconsistent (bite his head off) with an underlying conceptual metaphor (ANGER IS HEATED FLUID IN A CONTAINER) followed by target words that were related (heat) or unrelated (lead) to the conceptual metaphor. Reading time (Experiment 1) or lexical decision time (Experiment 2) for the target words were measured. We found no evidence supporting conceptual metaphor activation. Target word reading times were unaffected by whether they were related or unrelated to underlying conceptual metaphors. Lexical decision times were facilitated for related target words in both the consistent and inconsistent idiom conditions. We suggest that the conceptual (target) domain, not a specific underlying conceptual metaphor, facilitates processing of related target words.

Replicability in psychological research: a reflection

Background: In recent years, psychological science has suffered a crisis of confidence that has been marked by the low rate of replicability demonstrated in collaborative projects that attempted to quantify this problem, evidencing the difficulty in making replications and the existence of a possible excess of false positives published in the scientific literature. Method: This opinion article aimed to review the panorama of the replicability crisis in psychology, as well as its possible causes. Conclusions: It began from the state of the replicability crisis, then some possible causes and their repercussions on the advancement of psychological science were highlighted, discussing various associated issues, such as individual biases on the part of researchers, the lack of incentives to replicability studies and the priority standards that journals would currently have for novel and positive studies. Finally, the existing alternatives to reverse this situation are mentioned, among them the opening to new statistical approaches, the restructuring of incentives, and the development of editorial policies that facilitate the means for replication.

Stability versus Fluidity of Adolescent Romantic and Sexual Attraction and the Role of Religiosity: A Longitudinal Assessment in Two Independent Samples of Croatian Adolescents

The manner in which individuals report their sexual attraction, self-label their sexual identity, or behave in sexual situations can vary over time, and particularly, adolescents may change their reported sexual attraction or sexual orientation identity over the course of their development. It is important to better understand the social factors that may influence these changes, such as one's religiosity. The present study thus aimed to assess the fluidity of adolescent romantic and sexual attraction over time and to explore the role of religiosity in this dynamic using two independent panel samples of Croatian high school students (N = 849 and N = 995). Response items for sexual and romantic attraction were categorized based on the Kinsey scale, and religiosity was assessed with a standard one-item indicator. Results demonstrated that changes in attraction were substantially more prevalent among non-exclusively heterosexual participants compared to exclusively heterosexual participants in both panels. Although more female than male adolescents reported non-heterosexual attraction, gender differences in attraction fluidity were inconsistent. Religiosity was associated with initial sexual attraction (more religious individuals were more likely to report exclusively heterosexual attraction), but not with changes in romantic and sexual attraction over time. Given that the understanding of adolescent sexual development can play an important role in reducing their vulnerability to sexual risk taking, stigmatization, and abuse, this study's findings have relevance for teachers, parents, and counselors working with adolescents, and in particular for sexual minority youth.

Unburdening the Shoulders of Giants: A Quest for Disconnected Academic Psychology

In current academic psychology, scholars typically develop their research and ideas by drawing on the work of other contemporary and preceding psychological scientists and by following certain conventions of the field. I refer to this variant of psychology as connected because the emphasis is on connecting various research findings and ideas generated by different scholars (e.g., by showing how they are related to each other via referencing). In this article, I argue that, although connected psychology advances psychological knowledge, it restricts the total amount of knowledge that could eventually be produced and therefore limits the potential of the discipline to improve the understanding of psychological phenomena. As a solution, I propose that, alongside the currently existing connected psychology, disconnected psychology should be established. In disconnected psychology, researchers develop their ideas by following the main principles of psychological method, but they are disconnected from a “field” consisting of other psychologists and therefore do not follow the discipline’s norms and conventions. By drawing on one of the core constructs from information theory—information entropy—I argue that combining the two streams of psychology would result in the most significant advancement of psychological knowledge.

Research data management in Turkey: A survey to build an effective national data repository

Research data management is an important topic for funding agencies, universities and researchers. In this context, the main aim of this study is to collect preliminary information for Aperta, which is being developed by the Scientific and Technological Research Council of Turkey, to fulfil the following goals: determine the research data management awareness levels of researchers in Turkey; understand current research data management practices in their research environments; and find out their experiences of policy issues. For this, a questionnaire was distributed to 37,223 researchers, with 1577 researchers completing it. The results indicated that researchers who spend more time with data have more concerns about data management issues. The levels of experience of creating a data management plan were quite low. The importance of this study lies in how it is able to show the current research data management practices of Turkish scholars during the new repository’s foundational development stage.

What Crisis? Management Researchers' Experiences with and Views of Scholarly Misconduct

This research presents the results of a survey regarding scientific misconduct and questionable research practices elicited from a sample of 1215 management researchers. We find that misconduct (research that was either fabricated or falsified) is not encountered often by reviewers nor editors. Yet, there is a strong prevalence of misrepresentations (method inadequacy, omission or withholding of contradictory results, dropping of unsupported hypotheses). When it comes to potential methodological improvements, those that are skeptical about the empirical body of work being published see merit in replication studies. Yet, a sizeable majority of editors and authors eschew open data policies, which points to hidden costs and limited incentives for data sharing in management research.

The Foot-in-the-Door Phenomenon 40 and 50 Years Later: A Direct Replication of the Original Freedman and Fraser Study in Poland and in Ukraine

Since the original Freedman and Fraser studies were published, a great amount of research using the foot-in-the-door tactic has revealed its effectiveness. Nevertheless, the effect sizes reported in meta-analysis studies tend to be low and the effect size obtained by Freedman and Fraser in their studies has never been obtained again. We conducted a direct replication of the original foot-in-the-door experiment in two time intervals and in two countries. The results indicate a drop of compliance over time. The results reveal that, while in 2003 the foot-in-the-door strategy was effective in Ukraine and ineffective in Poland, in 2013, the effect was insignificant in both Ukraine and Poland. The results are explained by high ecological validity of the foot-in-the-door procedure.

Does It Matter Whether You or Your Brain Did It? An Empirical Investigation of the Influence of the Double Subject Fallacy on Moral Responsibility Judgments

Despite progress in cognitive neuroscience, we are still far from understanding the relations between the brain and the conscious self. We previously suggested that some neuroscientific texts that attempt to clarify these relations may in fact make them more difficult to understand. Such texts-ranging from popular science to high-impact scientific publications-position the brain and the conscious self as two independent, interacting subjects, capable of possessing opposite psychological states. We termed such writing 'Double Subject Fallacy' (DSF). We further suggested that such DSF language, besides being conceptually confusing and reflecting dualistic intuitions, might affect people's conceptions of moral responsibility, lessening the perception of guilt over actions. Here, we empirically investigated this proposition with a series of three experiments (pilot and two preregistered replications). Subjects were presented with moral scenarios where the defendant was either (1) clearly guilty, (2) ambiguous, or (3) clearly innocent while the accompanying neuroscientific evidence about the defendant was presented using DSF or non-DSF language. Subjects were instructed to rate the defendant's guilt in all experiments. Subjects rated the defendant in the clearly guilty scenario as guiltier than in the two other scenarios and the defendant in the ambiguously described scenario as guiltier than in the innocent scenario, as expected. In Experiment 1 (N = 609), an effect was further found for DSF language in the expected direction: subjects rated the defendant less guilty when the neuroscientific evidence was described using DSF language, across all levels of culpability. However, this effect did not replicate in Experiment 2 (N = 1794), which focused on different moral scenario, nor in Experiment 3 (N = 1810), which was an exact replication of Experiment 1. Bayesian analyses yielded strong evidence against the existence of an effect of DSF language on the perception of guilt. Our results thus challenge the claim that DSF language affects subjects' moral judgments. They further demonstrate the importance of good scientific practice, including preregistration and-most critically-replication, to avoid reaching erroneous conclusions based on false-positive results.

Generalizability is not optional: insights from a cross-cultural study of social discounting

Current scientific reforms focus more on solutions to the problem of reliability (e.g. direct replications) than generalizability. Here, we use a cross-cultural study of social discounting to illustrate the utility of a complementary focus on generalizability across diverse human populations. Social discounting is the tendency to sacrifice more for socially close individuals-a phenomenon replicated across countries and laboratories. Yet, when adapting a typical protocol to low-literacy, resource-scarce settings in Bangladesh and Indonesia, we find no independent effect of social distance on generosity, despite still documenting this effect among US participants. Several reliability and validity checks suggest that methodological issues alone cannot explain this finding. These results illustrate why we must complement replication efforts with investment in strong checks on generalizability. By failing to do so, we risk developing theories of human nature that reliably explain behaviour among only a thin slice of humanity.

Memory Decline and Depression Onset in U.S. and European Older Adults

Objectives: We explore the association between different patterns of change in depressive symptoms and memory trajectories in US and European Mediterranean (Spain, France, Italy, and Israel) and non-Mediterranean (Sweden, Denmark, Netherlands, Germany, Belgium, Switzerland, and Austria) older adults. Methods: Samples consisted of 3,466 participants from the Health Retirement Study (HRS) and 3,940 participants from the Survey of Health, Aging and Retirement (SHARE). Individuals were grouped as follows: non-case depression (NO DEP), persistent depression (DEP), depression onset (ONSET), depression recovery (RECOV), and fluctuating (FLUCT). Memory was measured using immediate and delayed recall tests. Linear mixed models were used. Results: DEP and RECOV had significantly lower baseline memory scores compared to NO DEP, at intercept level. At slope level, ONSET had a significantly faster decline in both tasks compared to NO DEP. Discussion: Cross-cohort robust and consistent new empirical evidence on the association between depression onset and faster decline in memory scores is provided.

Cross-Cultural Study of Information Processing Biases in Chronic Fatigue Syndrome: Comparison of Dutch and UK Chronic Fatigue Patients

Purpose

This study aims to replicate a UK study, with a Dutch sample to explore whether attention and interpretation biases and general attentional control deficits in chronic fatigue syndrome (CFS) are similar across populations and cultures.

Method

Thirty eight Dutch CFS participants were compared to 52 CFS and 51 healthy participants recruited from the UK. Participants completed self-report measures of symptoms, functioning, and mood, as well as three experimental tasks (i) visual-probe task measuring attentional bias to illness (somatic symptoms and disability) versus neutral words, (ii) interpretive bias task measuring positive versus somatic interpretations of ambiguous information, and (iii) the Attention Network Test measuring general attentional control.

Results

Compared to controls, Dutch and UK participants with CFS showed a significant attentional bias for illness-related words and were significantly more likely to interpret ambiguous information in a somatic way. These effects were not moderated by attentional control. There were no significant differences between the Dutch and UK CFS groups on attentional bias, interpretation bias, or attentional control scores.

Conclusion

This study replicated the main findings of the UK study, with a Dutch CFS population, indicating that across these two cultures, people with CFS demonstrate biases in how somatic information is attended to and interpreted. These illness-specific biases appear to be unrelated to general attentional control deficits.

Who Should Do Replication Labor?

Scientists, for the most part, want to get it right. However, the social structures that govern their work undermine that aim, and this leads to nonreplicable findings in many fields. Because the social structure of science is a decentralized system, it is difficult to intervene. In this article, I discuss how we might do so, focusing on self-corrective-labor schemes (i.e., ways of distributing replication efforts within the scientific community). First, I argue that we need to implement a scheme that makes replication work outcome independent, systematic, and sustainable. Second, I use these three criteria to evaluate extant proposals, which place the responsibility for replication on original researchers, consumers of their research, students, or many labs. Third, on the basis of a philosophical analysis of the reward system of science and the benefits of the division of cognitive labor, I propose a scheme that satisfies the criteria better: the professional scheme. This scheme has two main components. First, the scientific community is organized into two groups: discovery researchers, who produce new findings, and confirmation researchers, whose primary function is to do confirmation work (i.e., replication, reproduction, meta-analysis). Second, a distinct reward system is established for confirmation researchers so that their career advancement is separated from whether they obtain positive experimental results.

Three Central Dimensions of Sexual Recidivism Risk: Understanding the Latent Constructs of Static-99R and Static-2002R

The most commonly used risk assessment tools for predicting sexual violence focus almost exclusively on static, historical factors. Consequently, they are assumed to be unable to directly inform the selection of treatment targets, or evaluate change. However, researchers using latent variable models have identified three dimensions in static actuarial scales for sexual offenders: Sexual Criminality, General Criminality, and a third dimension centered on young age and aggression to strangers. In the current study, we examined the convergent and predictive validity of these dimensions, using psychological features of the offender (e.g., antisocial traits, hypersexuality) and recidivism outcomes. Results indicated that (a) Sexual Criminality was related to dysregulation of sexuality toward atypical objects, without intent to harm; (b) General Criminality was related to antisocial traits; and (c) Youthful Stranger Aggression was related to a clear intent to harm the victim. All three dimensions predicted sexual recidivism, although only General Criminality and Youthful Stranger Aggression predicted nonsexual recidivism. These results indicate that risk tools for sexual violence are multidimensional, and support a shift from an exclusive focus on total scores to consideration of subscales measuring psychologically meaningful constructs.

Examining Implicit and Explicit Evaluations of Sexual Aggression and Sexually Aggressive Behavior in Men Recruited Online

The purpose of the current study was to explore the relationship between implicit and explicit evaluations of sexual aggression and indicators of sexually aggressive behavior in samples of students and community men recruited online. Participants were male undergraduate students recruited online from a Canadian University ( N = 150) and men recruited from the community via an online panel ( N = 378). Participants completed measures of implicit and explicit evaluations of sexual aggression, cognitive distortions regarding rape, self-reported past sexually aggressive behavior, and self-reported proclivity to commit sexually aggressive behavior. We found that more positive explicit evaluations and more cognitive distortions were moderately to strongly associated with sexual aggression; however, this was not the case for implicit evaluations of rape. Our results suggest that explicit evaluations of sexual aggression and cognitive distortions may be relevant for understanding sexual aggression against adults, and that more research is needed exploring whether or not implicit evaluations are associated with sexually aggressive behavior.

Open Science Is Liberating and Can Foster Creativity

Some scholars think that Open Science practices constrain researchers in ways that reduce their creativity, arguing, for instance, that preregistration discourages data exploration and so stifles discovery. In this article, we argue the opposite: Open Science practices are liberating and can foster creativity. Open Science practices are liberating because they (a) enable us to explore data transparently and comfortably; (b) reward quality, which is under our control, rather than outcomes, which are not; and (c) reduce the choke hold of needing to find "positive" results for career advancement. Open Science practices can foster creativity because they cultivate an open and flexible mind-set, create a more collaborative and constructive climate, and generate more accurate information and make it more accessible. In sum, Open Science liberates researchers more than it constrains them.

Failure to Replicate the Association Between Fractional Anisotropy and the Serotonin Transporter Gene (5-HTTLPR, rs25531)

Recent work underlines the importance of alterations in white matter (e.g., measured by fractional anisotropy (FA)) as a neural vulnerability marker for psychiatric disorders. In this context, the uncinate fasciculus (UF), which connects the limbic system with prefrontal areas, has repeatedly been linked to psychiatric disorders, fear processing, and anxiety-related traits. Individual differences in FA may partly be genetically determined. Variation in the promoter region of the serotonin transporter gene (serotonin transporter-linked polymorphic region [5-HTTLPR]) is a particularly promising candidate in this context, which has been linked to psychiatric disorders as well as to limbic and prefrontal reactivity. However, findings on the association between the 5-HTTLPR and FA within the UF-tract have been heterogeneous. The present study investigated this relationship and extended previous work by considering different genetic classification approaches as well as sex effects in a human sample (n = 114). All participants were genotyped for the 5-HTTLPR and the rs25531 polymorphism. As a main result, we did not find any significant relationship between the 5-HTTLPR and FA in the UF-tract although power analyses showed an adequate power. In addition, genotype effects were neither found when different classification approaches were used nor when analyses were carried out in males or females only. The present findings suggest that the association of the 5-HTTLPR and FA seems to be a more labile phenomenon than previously assumed. Possible explanations and limitations are discussed.

Strengthening the Practice of Exercise and Sport-Science Research

Exercise and sport sciences continue to grow as a collective set of disciplines investigating a broad array of basic and applied research questions. Despite the progress, there is room for improvement. A number of problems pertaining to reliability and validity of research practices hinder advancement and the potential impact of the field. These problems include inadequate validation of surrogate outcomes, too few longitudinal and replication studies, limited reporting of null or trivial results, and insufficient scientific transparency. The purpose of this review is to discuss these problems as they pertain to exercise and sport sciences based on their treatment in other disciplines, namely psychology and medicine, and to propose a number of solutions and recommendations.

Improving the Replicability of Psychological Science Through Pedagogy

Replications are important to science, but who will do them? One proposal is that students can conduct replications as part of their training. As a proof of concept for this idea, here we report a series of 11 preregistered replications of findings from the 2015 volume of Psychological Science, all conducted as part of a graduate-level course. As was expected given larger, more systematic prior efforts, the replications typically yielded effects that were smaller than the original ones: The modal outcome was partial support for the original claim. This work documents the challenges facing motivated students as they attempt to replicate previously published results on a first attempt. We describe the workflow and pedagogical methods that were used in the class and discuss implications both for the adoption of this pedagogical model and for replication research more broadly.

Optimizing Research Payoff

In this article, we present a model for determining how total research payoff depends on researchers' choices of sample sizes, α levels, and other parameters of the research process. The model can be used to quantify various trade-offs inherent in the research process and thus to balance competing goals, such as (a) maximizing both the number of studies carried out and also the statistical power of each study, (b) minimizing the rates of both false positive and false negative findings, and (c) maximizing both replicability and research efficiency. Given certain necessary information about a research area, the model can be used to determine the optimal values of sample size, statistical power, rate of false positives, rate of false negatives, and replicability, such that overall research payoff is maximized. More specifically, the model shows how the optimal values of these quantities depend upon the size and frequency of true effects within the area, as well as the individual payoffs associated with particular study outcomes. The model is particularly relevant within current discussions of how to optimize the productivity of scientific research, because it shows which aspects of a research area must be considered and how these aspects combine to determine total research payoff.