Learning from failures of protocol in cross-cultural research

A practical guide to cross-cultural and multi-sited data collection in the biological and behavioural sciences

Researchers in the biological and behavioural sciences are increasingly conducting collaborative, multi-sited projects to address how phenomena vary across ecologies. These types of projects, however, pose additional workflow challenges beyond those typically encountered in single-sited projects. Through specific attention to cross-cultural research projects, we highlight four key aspects of multi-sited projects that must be considered during the design phase to ensure success: (1) project and team management; (2) protocol and instrument development; (3) data management and documentation; and (4) equitable and collaborative practices. Our recommendations are supported by examples from our experiences collaborating on the Evolutionary Demography of Religion project, a mixed-methods project collecting data across five countries in collaboration with research partners in each host country. To existing discourse, we contribute new recommendations around team and project management, introduce practical recommendations for exploring the validity of instruments through qualitative techniques during piloting, highlight the importance of good documentation at all steps of the project, and demonstrate how data management workflows can be strengthened through open science practices. While this project was rooted in cross-cultural human behavioural ecology and evolutionary anthropology, lessons learned from this project are applicable to multi-sited research across the biological and behavioural sciences.

Misperception of peer beliefs reinforces inequitable gender norms among Tanzanian men

Gender role ideology, i.e. beliefs about how genders should behave, is shaped by social learning. Accordingly, if perceptions about the beliefs of others are inaccurate this may impact trajectories of cultural change. Consistent with this premise, recent studies report evidence of a tendency to overestimate peer support for inequitable gender norms, especially among men, and that correcting apparent 'norm misperception' promotes transitions to relatively egalitarian beliefs. However, supporting evidence largely relies on self-report measures vulnerable to social desirability bias. Consequently, observed patterns may reflect researcher measurement error rather than participant misperception. Addressing this shortcoming, we examine men's gender role ideology using both conventional self-reported and a novel wife-reported measure of men's beliefs in an urbanising community in Tanzania. We confirm that participants overestimate peer support for gender inequity. However, the latter measure, which we argue more accurately captures men's true beliefs, implies that this tendency is relatively modest in magnitude and scope. Overestimation was most pronounced among men holding relatively inequitable beliefs, consistent with misperception of peer beliefs reinforcing inequitable norms. Furthermore, older and poorly educated men overestimated peer support for gender inequity the most, suggesting that outdated and limited social information contribute to norm misperception in this context.

Statistical learning and children's emergent literacy in rural Côte d'Ivoire

Studies of non-linguistic statistical learning (SL) have often linked performance in SL tasks with differences in language outcomes. Most of these studies have focused on Western and high-income educational contexts, but children worldwide learn in radically different educational systems and communities, and often in a second language. In the west African nation of Côte d'Ivoire, children enter fifth grade (CM-1) with widely varying ages and literacy skills. Across three iteratively-developed experiments, 157 children, age 8-15 years, in rural communities in the greater-Adzópe region of Côte d'Ivoire watched sequences of cartoon images with embedded triplet patterns on touchscreen tablets, while performing a target-detection task. We assessed these tablet-based adaptations of non-linguistic visual SL and asked whether the children's individual differences in performance on the SL tasks were related to their first and second language and literacy skills. We found group-level evidence that children used the statistical regularities in the image sequence to gradually decrease their response times, but their responses on post-test discrimination did not reflect this learning. When evaluating the correlation between SL and language skills, individual differences related to other task demands predicted oral language skills shared by first and second languages, while SL better predicted second language print skills. These findings suggest that non-linguistic SL paradigms can measure similar skills in Ivorian children as previous samples, but they also echo recent calls for further cross-cultural validation, greater internal reliability, and tests for confounding variables (such as processing speed) in studies of individual differences in statistical learning. RESEARCH HIGHLIGHTS: We iteratively adapted three visual statistical learning studies for children in rural Côte d'Ivoire. Group-level analyses indicates that the children learn the underlying statistical regularities. Individual-differences analyses reveal some evidence that the statistical learning measure is also correlated with task demands that may be driven by cross-cultural differences. Like previous research, statistical learning is correlated with second language literacy, but we did not find a relationship between SL and oral language skills in first and second languages.

Evidence for a universal association of auditory roughness with musical stability

We provide evidence that the roughness of chords-a psychoacoustic property resulting from unresolved frequency components-is associated with perceived musical stability (operationalized as finishedness) in participants with differing levels and types of exposure to Western or Western-like music. Three groups of participants were tested in a remote cloud forest region of Papua New Guinea (PNG), and two groups in Sydney, Australia (musicians and non-musicians). Unlike prominent prior studies of consonance/dissonance across cultures, we framed the concept of consonance as stability rather than as pleasantness. We find a negative relationship between roughness and musical stability in every group including the PNG community with minimal experience of musical harmony. The effect of roughness is stronger for the Sydney participants, particularly musicians. We find an effect of harmonicity-a psychoacoustic property resulting from chords having a spectral structure resembling a single pitched tone (such as produced by human vowel sounds)-only in the Sydney musician group, which indicates this feature's effect is mediated via a culture-dependent mechanism. In sum, these results underline the importance of both universal and cultural mechanisms in music cognition, and they suggest powerful implications for understanding the origin of pitch structures in Western tonal music as well as on possibilities for new musical forms that align with humans' perceptual and cognitive biases. They also highlight the importance of how consonance/dissonance is operationalized and explained to participants-particularly those with minimal prior exposure to musical harmony.

Navigational Experience and the Preservation of Spatial Abilities into Old Age Among a Tropical Forager-Farmer Population

Navigational performance responds to navigational challenges, and both decline with age in Western populations as older people become less mobile. But mobility does not decline everywhere; Tsimané forager-farmers in Bolivia remain highly mobile throughout adulthood, traveling frequently by foot and dugout canoe for subsistence and social visitation. We, therefore, measured both natural mobility and navigational performance in 305 Tsimané adults, to assess differences with age and to test whether greater mobility was related to better navigational performance across the lifespan. Daily mobility was measured by GPS tracking, regional mobility through interview, navigational performance through pointing accuracy and perspective taking in environmental space, and mental rotation by a computerized task. Although mental rotation and spatial perspective taking declined with age, mobility and pointing accuracy remained high from mid-life through old age. Greater regional mobility was associated with greater accuracy at pointing and perspective taking, suggesting that spatial experience at environmental scales may help maintain navigational performance in later adulthood.

Emotional responses in Papua New Guinea show negligible evidence for a universal effect of major versus minor music

Music is a vital part of most cultures and has a strong impact on emotions [1–5]. In Western cultures, emotive valence is strongly influenced by major and minor melodies and harmony (chords and their progressions) [6–13]. Yet, how pitch and harmony affect our emotions, and to what extent these effects are culturally mediated or universal, is hotly debated [2, 5, 14–20]. Here, we report an experiment conducted in a remote cloud forest region of Papua New Guinea, across several communities with similar traditional music but differing levels of exposure to Western-influenced tonal music. One hundred and seventy participants were presented with pairs of major and minor cadences (chord progressions) and melodies, and chose which of them made them happier. The experiment was repeated by 60 non-musicians and 19 musicians in Sydney, Australia. Bayesian analyses show that, for cadences, there is strong evidence that greater happiness was reported for major than minor in every community except one: the community with minimal exposure to Western-like music. For melodies, there is strong evidence that greater happiness was reported for those with higher mean pitch (major melodies) than those with lower mean pitch (minor melodies) in only one of the three PNG communities and in both Sydney groups. The results show that the emotive valence of major and minor is strongly associated with exposure to Western-influenced music and culture, although we cannot exclude the possibility of universality.

Social hierarchies and social networks in humans

Across species, social hierarchies are often governed by dominance relations. In humans, where there are multiple culturally valued axes of distinction, social hierarchies can take a variety of forms and need not rest on dominance relations. Consequently, humans navigate multiple domains of status, i.e. relative standing. Importantly, while these hierarchies may be constructed from dyadic interactions, they are often more fundamentally guided by subjective peer evaluations and group perceptions. Researchers have typically focused on the distinct elements that shape individuals' relative standing, with some emphasizing individual-level attributes and others outlining emergent macro-level structural outcomes. Here, we synthesize work across the social sciences to suggest that the dynamic interplay between individual-level and meso-level properties of the social networks in which individuals are embedded are crucial for understanding the diverse processes of status differentiation across groups. More specifically, we observe that humans not only navigate multiple social hierarchies at any given time but also simultaneously operate within multiple, overlapping social networks. There are important dynamic feedbacks between social hierarchies and the characteristics of social networks, as the types of social relationships, their structural properties, and the relative position of individuals within them both influence and are influenced by status differentiation. This article is part of the theme issue 'The centennial of the pecking order: current state and future prospects for the study of dominance hierarchies'.

Vocal communication across cultures: theoretical and methodological issues

The study of human vocal communication has been conducted primarily in Western, educated, industrialized, rich, democratic (WEIRD) societies. Recently, cross-cultural investigations in several domains of voice research have been expanding into more diverse populations. Theoretically, it is important to understand how universals and cultural variations interact in vocal production and perception, but cross-cultural voice research presents many methodological challenges. Experimental methods typically used in WEIRD societies are often not possible to implement in many populations such as rural, small-scale societies. Moreover, theoretical and methodological issues are often unnecessarily intertwined. Here, I focus on three areas of cross-cultural voice modulation research: (i) vocal signalling of formidability and dominance, (ii) vocal emotions, and (iii) production and perception of infant-directed speech. Research in these specific areas illustrates challenges that apply more generally across the human behavioural sciences but also reveals promise as we develop our understanding of the evolution of human communication. This article is part of the theme issue 'Voice modulation: from origin and mechanism to social impact (Part II)'.

Distinguishing Intergroup and Long-Distance Relationships

Intergroup and long-distance relationships are both central features of human social life, but because intergroup relationships are emphasized in the literature, long-distance relationships are often overlooked. Here, we make the case that intergroup and long-distance relationships should be studied as distinct, albeit related, features of human sociality. First, we review the functions of both kinds of relationship: while both can be conduits for difficult-to-access resources, intergroup relationships can reduce intergroup conflict whereas long-distance relationships are especially effective at buffering widespread resource shortfalls. Second, to illustrate the importance of distinguishing the two relationship types, we present a case study from rural Bolivia. Combining ethnography and two different experimental techniques, we find that the importance of intergroup relationships-and the salience of group membership itself-varies across populations and across methods. Although ethnography revealed that participants often rely on long-distance relationships for resource access, we were unable to capture participant preferences for these relationships with a forced-choice technique. Taken together, our review and empirical data highlight that (1) intergroup and long-distance relationships can have different functions and can be more or less important in different contexts and (2) validating experimental field data with ethnography is crucial for work on human sociality. We close by outlining future directions for research on long-distance relationships in humans.

A 21st century cognitive portrait of the Himba, a remote people of Namibia

This research sketches the cognitive portrait of the Himba, a remote population from Northern Namibia living in a non-industrial society almost completely devoid of modern artefacts. We compared the Himba sample to a French sample, exploring cognitive reflection, moral judgement, cooperative behaviour, paranormal beliefs, and happiness. We looked for both differences and similarities across cultures, and for the way cognitive functioning is associated with a range of demographic variables. Results showed some important group differences, with the Himba being more intuitive, more religious, happier, and less utilitarian than the French participants. Further, the predictors of these beliefs and behaviours differed between the two groups. The present results provide additional support to the recent line of research targeting cultural variations and similarities, and call for the need to expand psychology research beyond the Western world.

Elements of Neuroanthropology

Neuroanthropology is the integration of neuroscience into anthropology and aims to understand “brains in the wild.” This interdisciplinary field examines patterns of human variation in field settings and provides empirical research that complements work done in clinical and laboratory settings. Neuroanthropology often uses ethnography in combination with theories and methods from cognitive science as a way to capture how culture, mind, and brain interact. This article describes nine elements that outline how to do neuroanthropology research: (1) integrating biology and culture through neuroscience and biocultural anthropology; (2) extending focus of anthropology on what people say and do to include what people process; (3) sizing culture appropriately, from broad patterns of culture to culture in small-scale settings; (4) understanding patterns of cultural variation, in particular how culture produces patterns of shared variation; (5) considering individuals in interaction with culture, with levels of analysis that can go from biology to social structures; (6) focusing on interactive elements that bring together biological and cultural processes; (7) conceptual triangulation, which draws on anthropology, psychology, and neuroscience in conjunction with field, clinic, and laboratory; (8) critical complementarity as a way to integrate the strengths of critical scholarship with interdisciplinary work; and (9) using methodological triangulation as a way to advance interdisciplinary research. These elements are illustrated through three case studies: research on US combat veterans and how they use Brazilian Jiu Jitsu as a way to manage the transition to becoming civilians, work on human-raptor interactions to understand how and why these interactions can prove beneficial for human handlers, and adapting cue reactivity research on addiction to a field-based approach to understand how people interact with cues in naturalistic settings.

Psychology Within and Without the State

Psychological research in small-scale societies is crucial for what it stands to tell us about human psychological diversity. However, people in these communities, typically Indigenous communities in the global South, have been underrepresented and sometimes misrepresented in psychological research. Here I discuss the promises and pitfalls of psychological research in these communities, reviewing why they have been of interest to social scientists and how cross-cultural comparisons have been used to test psychological hypotheses. I consider factors that may be undertheorized in our research, such as political and economic marginalization, and how these might influence our data and conclusions. I argue that more just and accurate representation of people from small-scale communities around the world will provide us with a fuller picture of human psychological similarity and diversity, and it will help us to better understand how this diversity is shaped by historical and social processes. Expected final online publication date for the Annual Review of Psychology, Volume 73 is January 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

A critical review of measures of childhood vaccine confidence

The World Health Organization and global partners sought to identify existing measures of confidence in childhood vaccines, as part of a broader effort to measure the range of behavioural and social drivers of vaccination. We identified 14 confidence measures applicable to childhood vaccination in general, all published between 2010 and 2019. The measures examined 1-5 constructs and included a mean of 12 items. Validation studies commonly examined factor structure, internal consistency reliability, and criterion-related validity. Fewer studies examined convergent and discriminant validity, test-retest reliability, or used cognitive interviewing. Most measures were developed and validated only in high-income countries. These findings highlight the need for a childhood vaccine confidence measure validated for use in diverse global contexts.

Out of the empirical box: A mixed-methods study of tool innovation among Congolese BaYaka forager and Bondongo fisher-farmer children

Tool innovation has played a crucial role in human adaptation. Yet, this capacity seems to arise late in development. Before 8 years of age, many children struggle to solve the hook task, a common measure of tool innovation that requires modification of a straight pipe cleaner into a hook to extract a prize. Whether these findings are generalizable beyond postindustrialized Western children remains unclear. In many small-scale subsistence societies, children engage in daily tool use and modification, experiences that theoretically could enhance innovative capabilities. Although two previous studies found no differences in innovative ability between children from Western and small-scale subsistence societies, these did not account for the latter's inexperience with pipe cleaners. Thus, the current study investigated how familiarity with pipe cleaners affected hook task success in 132 Congolese BaYaka foragers (57 girls) and 59 Bondongo fisher-farmers (23 girls) aged 4-12 years. We contextualized these findings within children's interview responses and naturalistic observations of how pipe cleaners were incorporated into daily activities. Counter to our expectation, prior exposure did not improve children's performance during the hook task. Bondongo children innovated significantly more hooks than BaYaka children, possibly because they participate in hook-and-line fishing. Observations and interviews showed that children imagined and innovated novel uses for pipe cleaners outside the experimental context, including headbands, bracelets, and suspenders. We relate our findings to ongoing debates regarding systematic versus unsystematic tool innovation, the importance of prior experience for the ontogeny of tool innovation, and the external validity of experimental paradigms.

Parental expectations for children with intellectual disability or autism in Ghana and Zambia: A concept mapping study

INTRODUCTION

Parent expectations have an important impact on children's outcomes. Despite a wealth of research on the familial experience of children with disabilities in African countries, very few studies have examined expectations these children's parents hold for them.

AIMS

This study explores parental expectations for children with intellectual disability, or autism and assesses their perceived importance and likelihood of attainment.

METHODS AND PROCEDURES

Concept mapping methodology with focus groups comprised of parents of children with intellectual disability or autism were employed.

OUTCOMES AND RESULTS

Results revealed several expectation themes: independence, acceptance and inclusion, public awareness, education, governmental assistance, resources, and healthcare. Whereas some expectations were congruent with themes in the broader literature, nuances within themes reflected cultural and societal conditions. Themes unique to each country also emerged, and importance and likelihood ratings revealed some cultural variation across the two countries. Expectations and the value placed on them differ across countries.

IMPLICATIONS

This study represents an important first step in efforts to understand the developmental contexts of children with disabilities on the African continent. Findings inform future research and potential strategies for policy and practice.

Why Hypothesis Testers Should Spend Less Time Testing Hypotheses

For almost half a century, Paul Meehl educated psychologists about how the mindless use of null-hypothesis significance tests made research on theories in the social sciences basically uninterpretable. In response to the replication crisis, reforms in psychology have focused on formalizing procedures for testing hypotheses. These reforms were necessary and influential. However, as an unexpected consequence, psychological scientists have begun to realize that they may not be ready to test hypotheses. Forcing researchers to prematurely test hypotheses before they have established a sound "derivation chain" between test and theory is counterproductive. Instead, various nonconfirmatory research activities should be used to obtain the inputs necessary to make hypothesis tests informative. Before testing hypotheses, researchers should spend more time forming concepts, developing valid measures, establishing the causal relationships between concepts and the functional form of those relationships, and identifying boundary conditions and auxiliary assumptions. Providing these inputs should be recognized and incentivized as a crucial goal in itself. In this article, we discuss how shifting the focus to nonconfirmatory research can tie together many loose ends of psychology's reform movement and help us to develop strong, testable theories, as Paul Meehl urged.

Pupillary and Attentional Responses to Infant Facial Expressions in Mothers Across Socioeconomic Variations

Maternal responses to infant facial expressions were examined in two socioeconomically diverse samples of South African mothers (Study I, N = 111; and Study II, N = 214; age: 17-44 years) using pupil and gaze tracking. Study I showed increased pupil response to infant distress expressions in groups recruited from private as compared to public maternity clinics, possibly reflecting underlying differences in socioeconomic status (SES) across the groups. Study II, sampling uniformly low-SES neighborhoods, found increased pupil dilation and faster orientation to expressions of infant distress, but only in the highest income group. These results are consistent with maternal physiological and attentional sensitivity to infant distress cues but challenge the universality of this sensitivity across socioeconomic diversity.

Culture and human development: Where did it go? And where is it going?

Culture and human development blossomed as a research enterprise in the last quarter of the 20th century; the energy and innovation of that enterprise are less evident now. Where did it go, and where is it going? In this essay, we examine the shifting fields of cross-cultural psychology, psychological anthropology, cultural psychology, indigenous psychology, and the surge of research on Individualism/Collectivism. Offering both academic and personal perspectives, we reflect on the importance of "culture" as a construct, and the value of focusing on individual development in that context. The way forward now, we suggest, is international and intercultural collaboration of scientists. The challenge for training new researchers from diverse backgrounds, however, is to equip them with the knowledge and insights gained from cross-cultural psychology, psychological anthropology, and their own cultures, rather than simply making the next generation of scholars into new representatives of Western theories of development.

All Human, yet Different

Abstract. Only little social psychological research is conducted outside so-called WEIRD (Western, Educated, Industrialized, Rich and Democratic societies) cultures (e.g., in the “Global South”). Although cross-cultural replication of social psychological theorizing and findings is thus essential for higher external validity of the field, valid cross-cultural replications are not straightforward to do. Indeed, they require more than “copy-and-pasting” the same research design in different countries. To facilitate valid cross-cultural replications, we present a collection of concrete recommendations that integrate emic and etic approaches: (1) establishing an egalitarian and respectful partnership with representatives of the local community, (2) examining whether constructs carry the same meaning are relevant in and across contexts, and (3) preparing culture-sensitive research materials and procedures. These recommendations aim to inform and improve purely “etic” approaches.

Navigating cross-cultural research: methodological and ethical considerations

The intensifying pace of research based on cross-cultural studies in the social sciences necessitates a discussion of the unique challenges of multi-sited research. Given an increasing demand for social scientists to expand their data collection beyond WEIRD (Western, educated, industrialized, rich and democratic) populations, there is an urgent need for transdisciplinary conversations on the logistical, scientific and ethical considerations inherent to this type of scholarship. As a group of social scientists engaged in cross-cultural research in psychology and anthropology, we hope to guide prospective cross-cultural researchers through some of the complex scientific and ethical challenges involved in such work: (a) study site selection, (b) community involvement and (c) culturally appropriate research methods. We aim to shed light on some of the difficult ethical quandaries of this type of research. Our recommendation emphasizes a community-centred approach, in which the desires of the community regarding research approach and methodology, community involvement, results communication and distribution, and data sharing are held in the highest regard by the researchers. We argue that such considerations are central to scientific rigour and the foundation of the study of human behaviour.

Preferences and constraints: the value of economic games for studying human behaviour

As economic games have spread from experimental economics to other social sciences, so too have critiques of their usefulness for drawing inferences about the 'real world'. What these criticisms often miss is that games can be used to reveal individuals' private preferences in ways that observational and interview data cannot; furthermore, economic games can be designed such that they do provide insights into real-world behaviour. Here, we draw on our collective experience using economic games in field contexts to illustrate how researchers can strategically alter the framing or design of economic games to draw inferences about private-world or real-world preferences. A detailed case study from coastal Colombia provides an example of the subtleties of game design and how games can be combined fruitfully with self-report data. We close with a list of concrete recommendations for how to modify economic games to better match particular research questions and research contexts.

Beyond Western, Educated, Industrial, Rich, and Democratic (WEIRD) Psychology: Measuring and Mapping Scales of Cultural and Psychological Distance

In this article, we present a tool and a method for measuring the psychological and cultural distance between societies and creating a distance scale with any population as the point of comparison. Because psychological data are dominated by samples drawn from Western, educated, industrialized, rich, and democratic (WEIRD) nations, and overwhelmingly, the United States, we focused on distance from the United States. We also present distance from China, the country with the largest population and second largest economy, which is a common cultural comparison. We applied the fixation index (F_ST), a meaningful statistic in evolutionary theory, to the World Values Survey of cultural beliefs and behaviors. As the extreme WEIRDness of the literature begins to dissolve, our tool will become more useful for designing, planning, and justifying a wide range of comparative psychological projects. Our code and accompanying online application allow for comparisons between any two countries. Analyses of regional diversity reveal the relative homogeneity of the United States. Cultural distance predicts various psychological outcomes.

Social information use in adolescents: The impact of adults, peers and household composition

Social learning strategies are key for making adaptive decisions, but their ontogeny remains poorly understood. We investigate how social information use depends on its source (adults vs. peer), and how it is shaped by household composition (extended vs. nuclear), a factor known to modulate social development. Using a simple estimation task, we show that social information strongly impacts the behaviour of adolescents aged 11 to 15 years (N = 256), especially when its source is an adult. However, social information use does not depend on household composition: the relative impact of adults and peers was similar in adolescents from both household types. Furthermore, adolescents were found to directly copy others' estimates surprisingly frequently. This study provides novel insights into adolescents' social information use and contributes to understanding the ontogeny of social learning strategies.

Disseminating Cultural Neuropsychology Research: Five Key Recommendations for Skill Development

Objective

Cultural neuropsychology has been called upon to meet the demand for more empirical tools and frameworks to use with our diverse populations. While much is being done, we have largely been “playing a game of catch-up” (Manly, 2008) and researchers have been encouraged to reinvent their approaches (Suchy, 2016). In this regard, one area of opportunity is promoting the development of cultural neuropsychology research dissemination.

Method

Relevant literature and professional experiences were used to identify cultural neuropsychology research dissemination barriers and solutions.

Outcomes

(1) Researches should use empirically supported knowledge dissemination frameworks to guide their approaches (Wilson et al., 2010). (2) Care should be taken to report study variables in internationally compatible/meaningful units (e.g., education, socioeconomic status; UNESCOIS, 2012). Researchers are also encouraged to find opportunities to comment on the purposeful exclusion of “North-American” variables (e.g., ethnicity) as well as the lessons learned from research “failures” (Hruschka et al., 2018). (3) Findings should be presented in ways that make clinical application easily comprehensible and implementable, even for those not specializing in cultural neuropsychology (e.g., use clear titles, clarify “insider” knowledge). (4) Researchers can and should negotiate with journals to make available the translated manuscripts and supplemental materials to improve research accessibility. (5) Professional collaboration and research visibility are fundamental to the success of dissemination (Tripathy et al., 2017).

Discussion

Neuropsychologists are eager for more culturally informed and clinically applicable research. Thus, cultural neuropsychology researchers focusing on developing their dissemination skills in these five highlighted areas are well positioned to increase the impact of their work and promote growth within cultural neuropsychology specifically, and neuropsychology broadly.

References

Hruschka, D. J., Munira, S., Jesmin, K., Hackman, J., & Tiokhin, L. (2018). Learning from failures of protocol in cross-cultural research. Proceedings of the National Academy of Sciences, 115(45), 11428-11434. Manly, J. J. (2008). Critical issues in cultural neuropsychology: profit from diversity. Neuropsychological Review, 18(3), 179-183. Suchy, Y. (2016). Population-based norms in crisis. The Clinical Neuropsychologist, 30(7), 973-974. Tripathy, J. P., Bhatnagar, A., Shewade, H. D., Kumar, A. M. V., Zachariah, R., & Harries, A. D. (2017). Ten tips to improve the visibility and dissemination of research for policy makers and practitioners. Public Health Action, 7(1), 10-14. UNESCO Institute for Statistics. (2012). International Standard Classification of Education: ISCED 2011. Montreal: UNESCO Institute for Statistics. Wilson, P. M., Petticrew, M., Calnan, M. W., & Nazareth, I. (2010). Disseminating research findings: what should researchers do? A systematic scoping review of conceptual frameworks. Implementation Science, 5(1), 91.

Generalizability is not optional: insights from a cross-cultural study of social discounting

Current scientific reforms focus more on solutions to the problem of reliability (e.g. direct replications) than generalizability. Here, we use a cross-cultural study of social discounting to illustrate the utility of a complementary focus on generalizability across diverse human populations. Social discounting is the tendency to sacrifice more for socially close individuals-a phenomenon replicated across countries and laboratories. Yet, when adapting a typical protocol to low-literacy, resource-scarce settings in Bangladesh and Indonesia, we find no independent effect of social distance on generosity, despite still documenting this effect among US participants. Several reliability and validity checks suggest that methodological issues alone cannot explain this finding. These results illustrate why we must complement replication efforts with investment in strong checks on generalizability. By failing to do so, we risk developing theories of human nature that reliably explain behaviour among only a thin slice of humanity.