Why Hypothesis Testers Should Spend Less Time Testing Hypotheses

Why do people engage with the suffering of strangers? Exploring epistemic, eudaimonic, social, and affective motives

Reading violent stories or watching a war documentary are examples in which people voluntarily engage with the suffering of others whom they do not know. Using a mixed-methods approach, we investigated why people make these decisions, while also mapping the characteristics of strangers' suffering to gain a rich understanding. In Study 1 (N = 247), participants described situations of suffering and their reasons to engage with it. Using qualitative thematic analysis, we developed a typology of the stranger (who), the situation (what), the source (how), and the reason(s) for engaging with the situation (why). We categorised the motives into four overarching themes - epistemic, eudaimonic, social, and affective - reflecting diversity in the perceived functionality of engaging with a stranger's suffering. Next, we tested the robustness of the identified motives in a quantitative study. In Study 2, participants (N = 250) recalled a situation in which they engaged with the suffering of a stranger and indicated their endorsement with a variety of possible motives. Largely mirroring Study 1, Study 2 participants engaged to acquire knowledge, for personal and social utility, and to feel positive and negative emotions. We discuss implications for understanding the exploration of human suffering as a motivated phenomenon.

Advancing the understanding and treatment of post-traumatic stress disorder with computational modelling

The existing theories of post-traumatic stress disorder (PTSD) have inspired large volumes of research and have contributed substantially to our current knowledge base. However, most of the theories are of a qualitative and verbal nature, and may be difficult to evaluate and compare with each other. In this paper, we propose that one way forward is to use computational modelling to formulate more precise theories of PTSD that can be evaluated by (1) assessing whether the model can explain fundamental phenomena related to PTSD, and (2) comparing simulated outcomes with real data. Computational modelling can force us to describe processes more precisely and achieve stronger theories that are viable for testing. Establishing the theoretical groundwork before undertaking empirical studies can help us to avoid doing research with low probability of valid results, and counteract the replicability crisis in psychology. In conclusion, computational modelling is a promising avenue for advancing the understanding and treatment of PTSD.

Using theoretical constraints and the TASI taxonomy to delineate predictably replicable findings

The focus of the present article is not on failures to replicate but on the more optimistically framed and more fruitful question: What stable findings can be reproduced reliably and can be trusted by decision makers, managers, health agents, or politicians? We propagate the working hypothesis that a twofold key to stable and replicable findings lies in the existence of theoretical constraints and, no less important, in researchers' sensitivity to metatheoretical, auxiliary assumptions. We introduce a hierarchy of four levels of theoretical constraints-a priori principles, psychophysical, empirical, and modelling constraints-combined with the TASI taxonomy of theoretical, auxiliary, statistical, and inferential assumptions Trafimow, Journal for the Theory of Social Behaviour, 52, 37-48, (2022). Although theoretical constraints clearly facilitate stable and replicable research findings, TASI reminds us of various reasons why even perfectly valid hypotheses need not always be borne out. The presented framework should help researchers to operationalize conditions under which theoretical constraints render empirical findings most predictable.

What factors are associated with infant hearing aid use? A parent survey using the Theoretical Domains Framework

OBJECTIVE

Hearing aid use is lowest in 0-3-year-olds with hearing loss, placing spoken language development at risk. Existing interventions lack effectiveness and are typically not based on a theoretically driven, comprehensive understanding of the factors influencing infant hearing aid use. The present study is the first to address this gap in understanding.

DESIGN AND STUDY SAMPLE

A 55-item online survey based on the Theoretical Domains Framework (TDF) was completed by 56 parents of 0-3-year-old hearing aid users.

RESULTS

Participants reported a wide range of barriers across TDF domains, which were associated with parent-reported hearing aid use and more pronounced in parents of lower hearing aid users. The most strongly reported domains across participants were "emotion" (e.g. feelings of worry when using hearing aids), "beliefs about capabilities" (e.g. belief in ability to use hearing aids consistently), and "environmental context and resources" (e.g. child removing hearing aids).

CONCLUSIONS

Parents report a wider range of barriers to infant hearing aid use than existing investigations suggest and current interventions address. Interventions would benefit from: (i) targeting a wider range of TDF domains in their design; and (ii) implementing the present TDF survey to identify and target family-specific barriers to infant hearing aid use.

High Velocity Passive Stretching Mimics Eccentric Exercise in Cerebral Palsy and May Be Used to Increase Spastic Muscle Fascicle Length

Muscle fascicles are shorter and stiffer than normal in spastic Cerebral Palsy (CP). Increasing fascicle length (FL) has been attempted in CP, the outcomes of which have been unsatisfactory. In healthy muscles, FL can be increased using eccentric exercise at high velocities (ECC). Three conditions are possibly met during such ECC: muscle micro-damage, positive fascicle strain, and momentary muscle deactivation during lengthening. Participants with and without CP underwent a single bout of passive stretching at (appropriately) high velocities using isokinetic dynamometry, during which we examined muscle and fascicle behaviour. Vastus lateralis (VL) FL change was measured using ultrasonography and showed positive fascicle strain. Measures of muscle creatine kinase were used to establish whether micro-damage occurred in response to stretching, but the results did not confirm damage in either group. Vastus medialis (VM) and biceps femoris muscle activity were measured using electromyography in those with CP. Results supported momentary spastic muscle deactivation during lengthening: all participants experienced at least one epoch (60 ms) of increased activation followed by activation inhibition/deactivation of the VM during knee flexion. We argue that high-velocity passive stretching in CP provides a movement context which mimics ECC and could be used to increase spastic FL with training.

Intergenerational Storytelling as a Developmental Resource in LGBTQ+ Communities

LGBTQ+ people continue to be threatened by systemic censorship and erasure in public spaces and discourses, making community-based resources for positive development crucial. In this study, we examined one such developmental resource-LGBTQ+ intergenerational storytelling about cultural-historical events. LGBTQ+ adults (N = 495) ranging in age from 17 to 80 years (M = 39.22, SD = 19.89) responded to an online survey about LGBTQ+ intergenerational storytelling and relationships. Results showed that although LGBTQ+ intergenerational storytelling was reported to occur infrequently, sharing stories across generations was considered important, and LGBTQ+ people desired even greater intergenerational connection. Intergenerational narratives reported by participants were primarily about cultural-historical events involving adversity and oppression (e.g. AIDS crisis), policy and legislation (e.g. marriage equality), and protest, resistance, and activism (e.g. Stonewall uprising). Stories were mostly told by older friends in private or social settings for the purpose of passing on LGBTQ+ history. Lessons learned through storytelling were diverse but tended to focus on appreciation and affirmation. Valuing intergenerational storytelling was associated with positive psychosocial identity. This study suggests that intergenerational storytelling may be an important developmental resource for LGBTQ+ people and other marginalized communities.

Sleep Disruption Persists and Relates to Memory Disability After Traumatic Brain Injury: A Cross-Sectional Study of Adults in the Chronic Phase of Injury

OBJECTIVE

To examine sleep disruption in chronic traumatic brain injury (TBI) across 3 aims: (1) to examine differences in self-reported sleep disruption between adults with and without a chronic history of TBI; (2) to query reported changes in sleep after TBI; and (3) to explore the relationship between self-reported sleep disruption and memory failures in daily life.

SETTING

Community-dwelling participants completed self-report sleep and memory surveys as part of their participation in a larger patient registry.

PARTICIPANTS

This study included 258 participants, and half (n = 129) of them have a chronic history of moderate-severe TBI (mean time since injury is 5.1 [SD 6.5] years).

DESIGN

We report descriptive statistics from this matched cross-sectional study on sleep in the chronic phase of injury. We also used planned Wilcoxon ranked-sum tests and exploratory correlations to examine the relationships of sleep disruption with TBI diagnosis, injury chronicity, and memory.

MAIN MEASURES

We used the Pittsburgh Sleep Quality Index to measure sleep disruption and the Epworth Sleepiness Scale to measure daytime sleepiness. Participants answered questions about postinjury sleep and responded to the Everyday Memory Questionnaire as a measure of memory failures in daily life.

RESULTS

Individuals with TBI had significantly higher rates of sleep disruption than those without TBI, as measured by the Pittsburgh Sleep Quality Index but not on the Epworth Sleepiness Scale. Sleep disruption in TBI manifested more in sleep quality than quantity. Half of the participants with TBI reported a negative change in sleep postinjury. In an exploratory analysis, sleep disruption was related to memory failure in daily life in the TBI sample.

CONCLUSIONS

Sleep disruption persists long after TBI but may be under-recognized in people with chronic TBI. Given that sleep is critical for memory and rehabilitation outcomes well into the chronic phase of injury, steps to improve the identification and management of sleep disruption are needed. Key words:chronic, memory, sleep, traumatic brain injury.

Why do Middle-Aged Adults Report Worse Mental Health and Wellbeing than Younger Adults? An Exploratory Network Analysis of the Swiss Household Panel Data

Despite the growing consensus that midlife appears to be a particularly vulnerable life phase for lower mental health and wellbeing, little is known about the potential reasons for this phenomenon or who the individuals at higher risk are. Our study used six waves (2013-2018) of the Swiss Household Panel (n = 5,315), to compare the distribution of mental health and wellbeing, as well as their key correlates, between midlife (40-55 years) and younger adults (25-39 years) in Switzerland. Moreover, using network analysis to investigate interrelationships across life domains, we describe the complex interrelations between multiple domain-specific correlates and indicators of both mental health and wellbeing across the two age groups. Middle-aged (age 40-55) individuals reported lower life satisfaction and joy, as well as higher anger, sadness, and worry than young adults (age 25-39), with the effect sizes reaching up to 0.20 Cohen's d. They also reported lower social support, relationships satisfaction, health satisfaction, and higher job demands and job insecurity. Relationships satisfaction and social support were the most consistent correlates across all three indicators of wellbeing in both age groups. Health satisfaction was more strongly, and directly, interrelated with energy and optimism in midlife compared with young adulthood (0.21 vs 0.12, p = 0.007). Job demands were more strongly linked with anger and sadness in midlife. The network model helped us to identify correlates or their clusters with direct and strong links to mental health and wellbeing. We hypothesised that health satisfaction, relationships satisfaction, social support, and job demands may help to explain worse mental health and wellbeing in midlife.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11482-024-10274-4.

Avoidance of causality outside experiments: Hypotheses from cognitive dissonance reduction

The avoidance of causality in the design, analysis and interpretation of non-experimental studies has often been criticised as an untenable scientific stance, because theories are based on causal relations (and not associations) and a rich set of methodological tools for causal analysis has been developed in recent decades. Psychology researchers (n = 106 with complete data) participated in an online study presenting a causal statement about the results of a fictitious paper on the potential effect of drinking clear water for years on the risk of dementia. Two randomised groups of participants were then asked to reflect on the conflict between the goal of approaching a causal answer and the prevailing norm of avoiding doing so. One of the two groups was also instructed to think about possible benefits of addressing causality. Both groups then responded to a list of 19 items about attitudes to causal questions in science. A control group did this without reflecting on conflict or benefits. Free-text assessments were also collected during reflection, giving some indication of how and why causality is avoided. We condense the exploratory findings of this study into five new hypotheses about the how and why, filtered through what can be explained by cognitive dissonance reduction theory. These concern the cost of addressing causality, the variety of ways in which dissonance can be reduced, the need for profound intervention through teaching and social aspects. Predictions are derived from the hypotheses for confirmation trials in future studies and recommendations for teaching causality. Open data are provided for researchers' own analyses.

Mapping visual working memory models to a theoretical framework

The body of research on visual working memory (VWM)-the system often described as a limited memory store of visual information in service of ongoing tasks-is growing rapidly. The discovery of numerous related phenomena, and the many subtly different definitions of working memory, signify a challenge to maintain a coherent theoretical framework to discuss concepts, compare models and design studies. A lack of robust theory development has been a noteworthy concern in the psychological sciences, thought to be a precursor to the reproducibility crisis (Oberauer & Lewandowsky, Psychonomic Bulletin & Review, 26, 1596-1618, 2019). I review the theoretical landscape of the VWM field by examining two prominent debates-whether VWM is object-based or feature-based, and whether discrete-slots or variable-precision best describe VWM limits. I share my concerns about the dualistic nature of these debates and the lack of clear model specification that prevents fully determined empirical tests. In hopes of promoting theory development, I provide a working theory map by using the broadly encompassing memory for latent representations model (Hedayati et al., Nature Human Behaviour, 6, 5, 2022) as a scaffold for relevant phenomena and current theories. I illustrate how opposing viewpoints can be brought into accordance, situating leading models of VWM to better identify their differences and improve their comparison. The hope is that the theory map will help VWM researchers get on the same page-clarifying hidden intuitions and aligning varying definitions-and become a useful device for meaningful discussions, development of models, and definitive empirical tests of theories.

On the importance of being clear about the level of analysis of interest: An illustration using the case of self-compassion

OBJECTIVE

Theories about within-person (WP) variation are often tested using between-person (BP) research, despite the well-established fact that results may not generalize across levels of analysis. One possible explanation is vague theories that do not specify which level of analysis is of interest. We illustrate such a case using the construct of self-compassion. The factor structure at the BP level has been highly debated, although the theory is actually concerned with relationships at the WP level.

METHOD

Multilevel confirmatory factor analysis was applied to experience-sampling data of self-compassion (N = 213, with n = 4052 measurement occasions).

RESULTS

At both levels of analysis, evidence for a two-factor model was found. However, the factors were moderately related at the WP level (r = 0.37, p < 0.001) but largely independent at the BP level (r = 0.04, p = 0.696). Exploratory analyses revealed considerable heterogeneity in the WP relationship among individuals.

CONCLUSION

We discuss how our results provide new impulses to move the debate around self-compassion forward. Lastly, we outline how the WP level-which is of major interest for self-compassion and other constructs in psychology-can guide the conceptualization and assessment to promote advancements of the theory and resulting applications.

Decoding the content of working memory in school-aged children

Developmental improvements in working memory (WM) maintenance predict many real-world outcomes, including educational attainment. It is thus critical to understand which WM mechanisms support these behavioral improvements, and how WM maintenance strategies might change through development. One challenge is that specific WM neural mechanisms cannot easily be measured behaviorally, especially in a child population. However, new multivariate decoding techniques have been designed, primarily in adult populations, that can sensitively decode the contents of WM. The goal of this study was to deploy multivariate decoding techniques known to decode memory representations in adults to decode the contents of WM in children. We created a simple computerized WM game for children, in which children maintained different categories of information (visual, spatial or verbal). We collected electroencephalography (EEG) data from 20 children (7-12-year-olds) while they played the game. Using Multivariate Pattern Analysis (MVPA) on children's EEG signals, we reliably decoded the category of the maintained information during the sensory and maintenance period. Across exploratory reliability and validity analyses, we examined the robustness of these results when trained on less data, and how these patterns generalized within individuals throughout the testing session. Furthermore, these results matched theory-based predictions of WM across individuals and across ages. Our proof-of-concept study proposes a direct and age-appropriate potential alternative to exclusively behavioral WM maintenance measures in children. Our study demonstrates the utility of MVPA to measure and track the uninstructed representational content of children's WM. Future research could use our technique to investigate children's WM maintenance and strategies.

Cognitive-communication difficulties due to traumatic brain injury sustained in adults 55 years and older: A survey of speech-language pathology professional practice in Australia

PURPOSE

Limited research informs management of cognitive-communication difficulties following traumatic brain injury (TBI) in older adulthood. The purpose of this study was to understand the characteristics and practice of speech-language pathologists (SLPs) working with people who sustained TBI at ≥55 years and more specifically their management of cognitive-communication difficulties with this population. This included assessment and treatment practices, resource needs, barriers to practice, and impact to service delivery from COVID-19 restrictions.

METHOD

A cross-sectional survey-based design with non-probability sampling of SLPs working in Australia with adults with TBI was utilised. Descriptive statistics and content analysis were used for analysis of survey data.

RESULT

Fifty responses were eligible for inclusion. Participants predominantly worked in inpatient rehabilitation (48%), acute (40%), and community settings (36%). Service delivery to adults who sustained TBI at ≥55 years commonly included cognitive-communication management. Assessment and treatment trends are described. Most SLPs (74%) perceived barriers to cognitive-communication management, often relating to time and funding, that existed prior to the COVID-19 pandemic. Pandemic restrictions presented additional challenges.

CONCLUSION

Research relating to cognitive-communication difficulties following TBI in older adulthood is required to support evidence-based practice and inform services for older adults who sustain TBI.

Does the Position of the Ankle Matter During the Single Gluteal Bridge in Futsal Players? An Electromyographic Analysis

CONTEXT

The aim of this study was to analyze the muscle activity of the hamstring muscles and the lateral gastrocnemius during different variants of the single-leg bridge (SLB) in futsal players.

DESIGN

Cross-sectional study.

METHODS

Twenty-two futsal players (age = 24.8 [3.9] y) volunteered to participate in this study. The participants performed 3 variations of the SLB with the knee flexed at 45°. The first position was performed with the ankle in plantar position with flat support, the second with the ankle in dorsiflexion (DF) with heel support, and the third with the ankle in DF and external rotation (ER) with heel support. The Wilcoxon rank-sum test assessed the difference between variables for samples with the rank-biserial correlation effect size. Spearman correlation coefficients were used to examine the associations of the percentage maximal voluntary isometric contraction for each muscle with peak force and rate of force development with 3 different variances of the SLB.

RESULTS

The variation of ankle DF and ER with heel support generated higher muscle activity in BF in concentric (P < .01, effect size [ES] = -0.613); isometric (P < .042, ES = -0.494); and eccentric (P < .005, ES = -0.668) contraction than ankle DF with heel support. In contrast, the variation of ankle DF and ER with heel support generated fewer muscle activity in lateral gastrocnemius in concentric (P < .001, ES = 0.779); isometric (P < .003, ES = 0.708); and eccentric (P < .014, ES = 0.589) contraction than ankle DF with heel support.

CONCLUSIONS

The position of DF and ER was the best position in SLB to train the BF. It could be convenient to start rehabilitation of the BF with flat foot postition or ankle in DF with heel support and progress with the position of the ankle in DF and ER with heel support.

Adapting Open Science and Pre-registration to Longitudinal Research

Open science practices, such as pre-registration and data sharing, increase transparency and may improve the replicability of developmental science. However, developmental science has lagged behind other fields in implementing open science practices. This lag may arise from unique challenges and considerations of longitudinal research. In this paper, preliminary guidelines are provided for adapting open science practices to longitudinal research to facilitate researchers' use of these practices. The guidelines propose a serial and modular approach to registration that includes an initial pre-registration of the methods and focal hypotheses of the longitudinal study, along with subsequent pre- or co-registered questions, hypotheses, and analysis plans associated with specific papers. Researchers are encouraged to share their research materials and relevant data with associated papers, and to report sufficient information for replicability. In addition, there should be careful consideration about requirements regarding the timing of data sharing, to avoid disincentivizing longitudinal research.

Open Science Considerations for Descriptive Research in Developmental Science

Descriptive developmental research seeks to document, describe, and analyze the conditions under which infants and children live and learn. Here, we articulate how open-science practices can be incorporated into descriptive research to increase its transparency, reliability, and replicability. To date, most open-science practices have been oriented toward experimental rather than descriptive studies, and it can be confusing to figure out how to translate open-science practices (e.g., preregistration) for research that is more descriptive in nature. We discuss a number of unique considerations for descriptive developmental research, taking inspiration from existing open-science practices and providing examples from recent and ongoing studies. By embracing a scientific culture where descriptive research and open science coexist productively, developmental science will be better positioned to generate comprehensive theories of development and understand variability in development across communities and cultures.

Exercise as the sum of our choices between behavioral alternatives: The Decisional Preferences in Exercising (DPEX) test

Exercising can be theorized as the result of choosing one behavior over alternative behaviors. The Decisional Preferences in Exercising (DPEX) test is a computerized, easy-to-use, publicly available (open source Python code: https://osf.io/ahbjr/) and highly adaptive research tool based on this rationale. In the DPEX, participants are asked to choose between two images by pressing a key on the computer keyboard, one showing a physical exercise and the other showing a non-exercise behavioral alternative in a series of trials. Combinations are randomly assembled from two definable pools of stimuli trial-per-trial. The test can be scored either based on a crossed random effects model (facilitating the use of different stimulus material in different studies without compromising the comparability of test scores) or with a simple proportion score. Data from diverse study samples (N = 451) showed strong correlations of DPEX scores with past and future exercise behavior (r = 0.42 and 0.47 respectively) as well as with affective experiences with exercise (e.g., 'pleasure-displeasure': r = 0.47). DPEX test scores discriminated between exercisers and non-exercisers according to receiver operating curve (ROC) analysis. The DPEX may be used to examine research questions derived from dual process theories, the effects of psychological states on behavioral choices can be tested, or the effects of behavior change interventions can be evaluated. The DPEX helps to avoid common method bias in the assessment of exercise behavior, for example, when psychological variables are measured with questionnaires.

Associations of religious and existential variables with psychosocial factors and biomarkers of cardiovascular risk in bereavement

Bereavement increases in prevalence as people age and is associated with multiple psychological and health risks, including cardiovascular risk. Religious and existential variables may play an important role in the health impacts of bereavement. Theorized pathways linking religious and existential variables with health have suggested these associations are due to intermediary psychosocial variables, but have not been tested in bereavement. This research empirically tested these pathways in a bereaved population. In N = 73 adults within 1 year of bereavement (mean age = 64.36), this study examined associations between (1) religious and existential characteristics (religious and spiritual struggles, intrinsic religiosity, and existential quest) and intermediary psychosocial variables (depression, loneliness, and difficulties in emotion regulation), and between (2) intermediary psychosocial variables and bereavement-relevant health outcomes (self-reported health, change in health since last year, grief severity, and cardiovascular biomarkers). Cardiovascular biomarkers (heart rate, heart rate variability, and blood pressure) were collected before, during, and after a laboratory grief recall emotion elicitation. Anticipated associations between self-reported religious and existential characteristics and intermediary variables, and between intermediary variables and self-reported bereavement-relevant outcomes, were consistently observed. However, associations between intermediary variables and cardiovascular biomarkers were largely unobserved. This study examined the role of religious and existential variables in whole-person health after bereavement and is among the first to include biomarkers of cardiovascular risk. Results suggest that although religious and existential variables are associated with important bereavement-related outcomes, these associations may be "skin-deep," and extensions to cardiovascular functioning should be re-examined.

Cleaning up the Brickyard: How Theory and Methodology Shape Experiments in Cognitive Neuroscience of Language

The capacity for language is a defining property of our species, yet despite decades of research, evidence on its neural basis is still mixed and a generalized consensus is difficult to achieve. We suggest that this is partly caused by researchers defining "language" in different ways, with focus on a wide range of phenomena, properties, and levels of investigation. Accordingly, there is very little agreement among cognitive neuroscientists of language on the operationalization of fundamental concepts to be investigated in neuroscientific experiments. Here, we review chains of derivation in the cognitive neuroscience of language, focusing on how the hypothesis under consideration is defined by a combination of theoretical and methodological assumptions. We first attempt to disentangle the complex relationship between linguistics, psychology, and neuroscience in the field. Next, we focus on how conclusions that can be drawn from any experiment are inherently constrained by auxiliary assumptions, both theoretical and methodological, on which the validity of conclusions drawn rests. These issues are discussed in the context of classical experimental manipulations as well as study designs that employ novel approaches such as naturalistic stimuli and computational modeling. We conclude by proposing that a highly interdisciplinary field such as the cognitive neuroscience of language requires researchers to form explicit statements concerning the theoretical definitions, methodological choices, and other constraining factors involved in their work.

Formalizing theories of child development: Introduction to the special section

Here we introduce a Special Section of Child Development entitled "Formalizing Theories of Child Development." This Special Section features five papers that use mathematical models to advance our understanding of central questions in the study of child development. This landmark collection is timely: it signifies growing awareness that rigorous empirical bricks are not enough; we need solid theory to build the house. By stating theory in mathematical terms, formal models make concepts, assumptions, and reasoning more explicit than verbal theory does. This increases falsifiability, promotes cumulative science, and enables integration with mathematical theory in allied disciplines. The Special Section contributions cover a range of topics: the developmental origins of counting, interactions between mathematics and language development, visual exploration and word learning in infancy, referent identification by toddlers, and the emergence of typical and atypical development. All are written in an accessible manner and for a broad audience.

Defining aphasia: Content analysis of six aphasia diagnostic batteries

Clear operational definitions of constructs are necessary to ensure that research findings are meaningful and interpretable. In the field of aphasiology, aphasia is often defined to the effect of "aphasia is an acquired language disorder often due to brain injury that affects expressive and receptive language." To contribute to our understanding of the construct of aphasia, we conducted a content analysis of six diagnostic aphasia tests: the Minnesota Test for the Differential Diagnosis of Aphasia, the Porch Index of Communicative Ability, the Boston Diagnostic Aphasia Examination, the Western Aphasia Battery, the Comprehensive Aphasia Test, and the Quick Aphasia Battery. These chosen tests have historical prominence, with several in regular clinical and research use today. We hypothesized that the content of the aphasia tests should be very similar since they all purport to identify and characterize (if present) aphasia, with recognition that there may be some subtle differences in test content stemming in large part to epistemological differences in the test makers' views of aphasia. Instead, we found predominantly weak Jaccard indices, a similarity correlation coefficient, between test targets. Only five test targets were found in all six aphasia tests: auditory comprehension of words and sentences, repetition of words, confrontation naming of nouns, and reading comprehension of words. The qualitative and quantitative results suggest that the content across aphasia tests may be more disparate than expected. We conclude by discussing the implication of our results for the field, including the importance of updating, if necessary, the operational definition of aphasia through conversation with a broad audience of interested and affected people.

Enhancing precision in human neuroscience

Human neuroscience has always been pushing the boundary of what is measurable. During the last decade, concerns about statistical power and replicability - in science in general, but also specifically in human neuroscience - have fueled an extensive debate. One important insight from this discourse is the need for larger samples, which naturally increases statistical power. An alternative is to increase the precision of measurements, which is the focus of this review. This option is often overlooked, even though statistical power benefits from increasing precision as much as from increasing sample size. Nonetheless, precision has always been at the heart of good scientific practice in human neuroscience, with researchers relying on lab traditions or rules of thumb to ensure sufficient precision for their studies. In this review, we encourage a more systematic approach to precision. We start by introducing measurement precision and its importance for well-powered studies in human neuroscience. Then, determinants for precision in a range of neuroscientific methods (MRI, M/EEG, EDA, Eye-Tracking, and Endocrinology) are elaborated. We end by discussing how a more systematic evaluation of precision and the application of respective insights can lead to an increase in reproducibility in human neuroscience.

On the scope of scientific hypotheses

Hypotheses are frequently the starting point when undertaking the empirical portion of the scientific process. They state something that the scientific process will attempt to evaluate, corroborate, verify or falsify. Their purpose is to guide the types of data we collect, analyses we conduct, and inferences we would like to make. Over the last decade, metascience has advocated for hypotheses being in preregistrations or registered reports, but how to formulate these hypotheses has received less attention. Here, we argue that hypotheses can vary in specificity along at least three independent dimensions: the relationship, the variables, and the pipeline. Together, these dimensions form the scope of the hypothesis. We demonstrate how narrowing the scope of a hypothesis in any of these three ways reduces the hypothesis space and that this reduction is a type of novelty. Finally, we discuss how this formulation of hypotheses can guide researchers to formulate the appropriate scope for their hypotheses and should aim for neither too broad nor too narrow a scope. This framework can guide hypothesis-makers when formulating their hypotheses by helping clarify what is being tested, chaining results to previous known findings, and demarcating what is explicitly tested in the hypothesis.

Increased consumption despite fewer occasions: A longitudinal analysis of COVID-19 lockdown effects on soft drink consumption in England

We examined the impact of a COVID-19 lockdown in England on the frequency of consumption occasions and amount of soft drinks consumed. Beverage consumption is strongly associated with specific, often social, consumption situations (e.g., going out). We reasoned that lockdown would affect consumption behaviour because it removed typical soft drink consumption situations. Specifically, we hypothesised that soft drink consumption occasions and amount would be reduced during lockdown compared to before and after lockdown, especially in typical soft drink consumption situations. In two surveys (Dec. 2020 and May 2021) among the same participants (N = 211, N = 160; consuming soft drinks at least once/week), we assessed the frequency of soft drink and water consumption occasions before, during, and after the Nov./Dec. 2020 lockdown, across typical soft drink and water drinking situations. This presents a detailed picture of the situations in which participants drink soft drinks and water, and how this was affected by a lockdown. We also assessed the daily amount of soft drinks and water consumed in each period, and perceived habitualness of drinking soft drinks and water. As predicted, participants reported fewer occasions of drinking soft drinks during lockdown compared to before and after, especially in typical soft drink consumption situations. Unexpectedly, however, the daily amount of soft drinks consumed increased during lockdown, compared to before and after, especially among participants with stronger perceived habitualness of soft drink consumption. Exploratory analyses suggest that during lockdown, participants increased their soft drink consumption at home. Water consumption, on the other hand, was not systematically affected by the lockdown. These findings suggest that even if some typical consumption situations disappear, consumption may be hard to disrupt if the behaviour is rewarding.

Speech Segmentation and Cross-Situational Word Learning in Parallel

Language learners track conditional probabilities to find words in continuous speech and to map words and objects across ambiguous contexts. It remains unclear, however, whether learners can leverage the structure of the linguistic input to do both tasks at the same time. To explore this question, we combined speech segmentation and cross-situational word learning into a single task. In Experiment 1, when adults (N = 60) simultaneously segmented continuous speech and mapped the newly segmented words to objects, they demonstrated better performance than when either task was performed alone. However, when the speech stream had conflicting statistics, participants were able to correctly map words to objects, but were at chance level on speech segmentation. In Experiment 2, we used a more sensitive speech segmentation measure to find that adults (N = 35), exposed to the same conflicting speech stream, correctly identified non-words as such, but were still unable to discriminate between words and part-words. Again, mapping was above chance. Our study suggests that learners can track multiple sources of statistical information to find and map words to objects in noisy environments. It also prompts questions on how to effectively measure the knowledge arising from these learning experiences.

The replication crisis has led to positive structural, procedural, and community changes

The emergence of large-scale replication projects yielding successful rates substantially lower than expected caused the behavioural, cognitive, and social sciences to experience a so-called 'replication crisis'. In this Perspective, we reframe this 'crisis' through the lens of a credibility revolution, focusing on positive structural, procedural and community-driven changes. Second, we outline a path to expand ongoing advances and improvements. The credibility revolution has been an impetus to several substantive changes which will have a positive, long-term impact on our research environment.

Perspectives on scientific error

Theoretical arguments and empirical investigations indicate that a high proportion of published findings do not replicate and are likely false. The current position paper provides a broad perspective on scientific error, which may lead to replication failures. This broad perspective focuses on reform history and on opportunities for future reform. We organize our perspective along four main themes: institutional reform, methodological reform, statistical reform and publishing reform. For each theme, we illustrate potential errors by narrating the story of a fictional researcher during the research cycle. We discuss future opportunities for reform. The resulting agenda provides a resource to usher in an era that is marked by a research culture that is less error-prone and a scientific publication landscape with fewer spurious findings.

The mismatch negativity to abstract relationship of tone pairs is independent of attention

The mismatch negativity (MMN) implicating a comparison process between the deviant and the memory trace of the standard can be elicited by not only changes in physical features but also violations of abstract patterns. It is considered pre-attentive, yet the use of the passive design makes it difficult to exclude the possibility of attention leak. In contrast to how this issue has been well addressed with the MMN to physical changes, much less research directly investigated the attentional effect on the MMN to abstract relationships. Here we conducted an electroencephalography (EEG) experiment to study whether and how the MMN to abstract relationships is modulated by attention. We adapted the oddball paradigm of Kujala et al. by presenting occasional descending tone pairs among frequent ascending tone pairs, while additionally implementing a novel control of attention. Participants' attention was either directed away from the sounds (with an engaging task of visual target detection, so that the sounds were task-irrelevant) or toward the sounds (with a conventional task of auditory deviant detection, so that the sounds were task-relevant). The MMN to abstract relationships appeared regardless of attention, confirming the pre-attentive assumption. The attention-independence of the frontocentral and supratemporal components of the MMN supported the notion that attention is not required to generate the MMN. At the individual level, a relatively equal number of participants showed attention enhancement and attention suppression. It is unlike the attentional modulation on the P3b, which was robustly elicited in the attended condition only. The concurrent collection of these two neurophysiological markers in both unattended and attended conditions might be potentially suitable for testing clinical populations showing heterogeneous deficits in auditory function independent/dependent of attention.

Exploring the meaning of unresolved loss and trauma in more than 1,000 Adult Attachment Interviews

Unresolved states of mind regarding experiences of loss/abuse (U/d) are identified through lapses in the monitoring of reasoning, discourse, and behavior surrounding loss/abuse in response to the Adult Attachment Interview. Although the coding system for U/d has been widely used for decades, the individual indicators of unresolved loss/abuse have not been validated independently of the development sample. This study examined the psychometric validity of U/d, using individual participant data from 1,009 parent-child dyads across 13 studies. A latent class analysis showed that subsets of commonly occurring U/d indicators could differentiate interviewees with or without unresolved loss/abuse. Predictive models suggested a psychometric model of U/d consisting of a combination of these common indicators, with disbelief and psychologically confused statements regarding loss being especially important indicators of U/d. This model weakly predicted infant disorganized attachment. Multilevel regression analysis showed no significant association between ratings of unresolved other trauma and infant disorganized attachment, over and above ratings of unresolved loss/abuse. Altogether, these findings suggest that the coding system of U/d may have been overfitted to the initial development sample. Directions for further articulation and optimization of U/d are provided.

Personality and Mating Orientations in Monogamy and Consensual Non-Monogamy in Young Spanish University Students

Consensual non-monogamy (CNM) is a non-normative relationship that can generally be defined as relationships in which the involved individuals have openly agreed that they can have other sexual and/or affective partners. Despite growing interest in CNM, little research has been conducted regarding characteristics of the involved individuals, as well as comparing CNM individuals and monogamous individuals' characteristics. Expanding this research is important, as CNM constitutes a sizeable minority group, and CNM individuals and relationships are subject to stigma and dehumanization. The present study compared CNM and monogamous individuals in terms of personality (including "dark" personality) and mating orientations (sociosexuality and long-term mating) in young Spanish university students. Main results indicated that CNM individuals did not differ much in personality nor were they prone to higher "dark" personality traits when compared to monogamous individuals. Regarding mating orientations, CNM individuals were prone to higher sociosexuality levels and lower levels of long-term mating. Interestingly, results showed positive correlations between sociosexuality and "dark" personality in monogamous individuals, but not in CNM individuals. In conclusion, young Spanish university CNM individuals seem to be more pro-sex than monogamous people and less committed to the romantic love narrative of long-term mating, but these individuals were not more untrustworthy, self-centered, ruthless, or malevolent. Results were also discussed regarding their implications in the stigma and dehumanization of CNM people.

Using preregistration as a tool for transparent fNIRS study design

Significance

The expansion of functional near-infrared spectroscopy (fNIRS) methodology and analysis tools gives rise to various design and analytical decisions that researchers have to make. Several recent efforts have developed guidelines for preprocessing, analyzing, and reporting practices. For the planning stage of fNIRS studies, similar guidance is desirable. Study preregistration helps researchers to transparently document study protocols before conducting the study, including materials, methods, and analyses, and thus, others to verify, understand, and reproduce a study. Preregistration can thus serve as a useful tool for transparent, careful, and comprehensive fNIRS study design.

Aim

We aim to create a guide on the design and analysis steps involved in fNIRS studies and to provide a preregistration template specified for fNIRS studies.

Approach

The presented preregistration guide has a strong focus on fNIRS specific requirements, and the associated template provides examples based on continuous-wave (CW) fNIRS studies conducted in humans. These can, however, be extended to other types of fNIRS studies.

Results

On a step-by-step basis, we walk the fNIRS user through key methodological and analysis-related aspects central to a comprehensive fNIRS study design. These include items specific to the design of CW, task-based fNIRS studies, but also sections that are of general importance, including an in-depth elaboration on sample size planning.

Conclusions

Our guide introduces these open science tools to the fNIRS community, providing researchers with an overview of key design aspects and specification recommendations for comprehensive study planning. As such it can be used as a template to preregister fNIRS studies or merely as a tool for transparent fNIRS study design.

Capturing the Dynamics of the Social Environment Through Experience Sampling Methods, Passive Sensing, and Egocentric Networks: Scoping Review

BACKGROUND

Social interactions are important for well-being, and therefore, researchers are increasingly attempting to capture people's social environment. Many different disciplines have developed tools to measure the social environment, which can be highly variable over time. The experience sampling method (ESM) is often used in psychology to study the dynamics within a person and the social environment. In addition, passive sensing is often used to capture social behavior via sensors from smartphones or other wearable devices. Furthermore, sociologists use egocentric networks to track how social relationships are changing. Each of these methods is likely to tap into different but important parts of people's social environment. Thus far, the development and implementation of these methods have occurred mostly separately from each other.

OBJECTIVE

Our aim was to synthesize the literature on how these methods are currently used to capture the changing social environment in relation to well-being and assess how to best combine these methods to study well-being.

METHODS

We conducted a scoping review according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines.

RESULTS

We included 275 studies. In total, 3 important points follow from our review. First, each method captures a different but important part of the social environment at a different temporal resolution. Second, measures are rarely validated (>70% of ESM studies and 50% of passive sensing studies were not validated), which undermines the robustness of the conclusions drawn. Third, a combination of methods is currently lacking (only 15/275, 5.5% of the studies combined ESM and passive sensing, and no studies combined all 3 methods) but is essential in understanding well-being.

CONCLUSIONS

We highlight that the practice of using poorly validated measures hampers progress in understanding the relationship between the changing social environment and well-being. We conclude that different methods should be combined more often to reduce the participants' burden and form a holistic perspective on the social environment.

The epistemic and pragmatic function of dichotomous claims based on statistical hypothesis tests

Researchers commonly make dichotomous claims based on continuous test statistics. Many have branded the practice as a misuse of statistics and criticize scientists for the widespread application of hypothesis tests to tentatively reject a hypothesis (or not) depending on whether a p-value is below or above an alpha level. Although dichotomous claims are rarely explicitly defended, we argue they play an important epistemological and pragmatic role in science. The epistemological function of dichotomous claims consists in transforming data into quasibasic statements, which are tentatively accepted singular facts that can corroborate or falsify theoretical claims. This transformation requires a prespecified methodological decision procedure such as Neyman-Pearson hypothesis tests. From the perspective of methodological falsificationism these decision procedures are necessary, as probabilistic statements (e.g., continuous test statistics) cannot function as falsifiers of substantive hypotheses. The pragmatic function of dichotomous claims is to facilitate scrutiny and criticism among peers by generating contestable claims, a process referred to by Popper as “conjectures and refutations.” We speculate about how the surprisingly widespread use of a 5% alpha level might have facilitated this pragmatic function. Abandoning dichotomous claims, for example because researchers commonly misuse p-values, would sacrifice their crucial epistemic and pragmatic functions.

How Do People Come to Judge What Is "Reasonable"? Effects of Legal and Sociological Systems on Human Psychology

How do people decide what is reasonable? People often have to make those judgments, judgments that can influence tremendously consequential decisions-such as whether to indict someone in a legal proceeding. In this article, we take a situated cognition lens to review and integrate findings from social psychology, judgment and decision-making, communication, law, and sociology to generate a new framework for conceptualizing judgments of reasonableness and their implications for how people make decisions, particularly in the context of the legal system. We theorize that differences in structural and social contexts create information asymmetries that shape people's priors about what is and is not reasonable and how they update their priors in the face of new information. We use the legal system as a context for exploring the implications of the framework for both individual and collective decision-making and for considering the practical implications of the framework for inequities in law and social policy.

Biological and psychological predictors of heart rate patterns during physical activity

Objective

Latent class modeling (LCM) offers a promising approach for examining correlates of heart rate (HR) patterns over multiple exercise sessions. This research examined biological and psychological variables associated with different patterns of HR response to physical activity (PA).

Methods

In a three-arm randomized controlled trial (exercise video games vs. standard exercise vs. non-exercise control), HR was recorded during PA sessions over a 12-week period. LCM identified three patterns of HR during PA across 189 participants in active arms: 1) high HR across sessions with low variability within sessions, 2) linear increase in HR across sessions with low variability within sessions, and 3) high variability in HR across all sessions. Associations with biological (resting heart rate, blood pressure, BMI, age, cholesterol, triglycerides, HbA1c) and psychological (depression, motivations for PA, PA-induced feelings) predictors of latent class membership were iteratively tested.

Results

Psychological variables played as important a role in the final model as biological variables for predicting latent class membership. Few differences were found between LC1 and LC2, but LC3 differed from the other two groups in that participants were likelier to report that feel revitalized after PA (vs. LC1 and LC2), to be less motivated for PA (vs. LC1), reported greater depression (vs. LC1 and LC2), and were younger (vs. LC1).

Conclusions

These findings demonstrate the potential of LCM to identify biological and psychological factors associated with chronotropic responses to PA, and advance understanding of the role of psychological factors in chronotropic PA outcomes.

Contextual Specificity of (Un)Healthy Food/Drink Intake in Everyday Life: A Study Based on Episodic Memories

Identifying the contexts of episodes of (un)healthy food/drink intake could inform strategies for eating more healthily. This study assessed memories of recent episodes of healthy and unhealthy eating from adults in Mexico. For each (un)healthy eating episode participants recalled place, time of day, people present and food/drink intake. Categories were formed for the contextual features and foods/drinks that were reported, then the relative frequency of each category was tested between healthy and unhealthy eating episodes. Overall, there was a large set of categories of (un)healthy food/drink choices, and there were more healthy eating episodes with family at home and unhealthy eating episodes with friends out of home. However, as expected, a more specific context as well as food/drink intake was identified for each sort of recalled (un)healthy eating episode of the day. Additionally, eating out of home, later in the day and with people present were features related to higher estimated energy content across (un)healthy eating episodes. These findings support the assessment of self-reported memories of recent eating episodes to generate evidence that contribute to contexts that support healthy eating habits.

I'm not sure that curve means what you think it means: Toward a [more] realistic understanding of the role of eye-movement generation in the Visual World Paradigm

The Visual World Paradigm (VWP) is a powerful experimental paradigm for language research. Listeners respond to speech in a "visual world" containing potential referents of the speech. Fixations to these referents provides insight into the preliminary states of language processing as decisions unfold. The VWP has become the dominant paradigm in psycholinguistics and extended to every level of language, development, and disorders. Part of its impact is the impressive data visualizations which reveal the millisecond-by-millisecond time course of processing, and advances have been made in developing new analyses that precisely characterize this time course. All theoretical and statistical approaches make the tacit assumption that the time course of fixations is closely related to the underlying activation in the system. However, given the serial nature of fixations and their long refractory period, it is unclear how closely the observed dynamics of the fixation curves are actually coupled to the underlying dynamics of activation. I investigated this assumption with a series of simulations. Each simulation starts with a set of true underlying activation functions and generates simulated fixations using a simple stochastic sampling procedure that respects the sequential nature of fixations. I then analyzed the results to determine the conditions under which the observed fixations curves match the underlying functions, the reliability of the observed data, and the implications for Type I error and power. These simulations demonstrate that even under the simplest fixation-based models, observed fixation curves are systematically biased relative to the underlying activation functions, and they are substantially noisier, with important implications for reliability and power. I then present a potential generative model that may ultimately overcome many of these issues.

Reducing bias, increasing transparency and calibrating confidence with preregistration

Flexibility in the design, analysis and interpretation of scientific studies creates a multiplicity of possible research outcomes. Scientists are granted considerable latitude to selectively use and report the hypotheses, variables and analyses that create the most positive, coherent and attractive story while suppressing those that are negative or inconvenient. This creates a risk of bias that can lead to scientists fooling themselves and fooling others. Preregistration involves declaring a research plan (for example, hypotheses, design and statistical analyses) in a public registry before the research outcomes are known. Preregistration (1) reduces the risk of bias by encouraging outcome-independent decision-making and (2) increases transparency, enabling others to assess the risk of bias and calibrate their confidence in research outcomes. In this Perspective, we briefly review the historical evolution of preregistration in medicine, psychology and other domains, clarify its pragmatic functions, discuss relevant meta-research, and provide recommendations for scientists and journal editors.

These Are Not the Effects You Are Looking for: Causality and the Within-/Between-Persons Distinction in Longitudinal Data Analysis

In psychological science, researchers often pay particular attention to the distinction between within- and between-persons relationships in longitudinal data analysis. Here, we aim to clarify the relationship between the within- and between-persons distinction and causal inference and show that the distinction is informative but does not play a decisive role in causal inference. Our main points are threefold. First, within-persons data are not necessary for causal inference; for example, between-persons experiments can inform about (average) causal effects. Second, within-persons data are not sufficient for causal inference; for example, time-varying confounders can lead to spurious within-persons associations. Finally, despite not being sufficient, within-persons data can be tremendously helpful for causal inference. We provide pointers to help readers navigate the more technical literature on longitudinal models and conclude with a call for more conceptual clarity: Instead of letting statistical models dictate which substantive questions researchers ask, researchers should start with well-defined theoretical estimands, which in turn determine both study design and data analysis.

Designing evidence-based support aids for social media access for individuals with moderate-severe traumatic brain injury: A preliminary acceptability study

Background

Adults with traumatic brain injury (TBI) report significant barriers to using current social media platforms, including cognitive overload and challenges in interpreting social cues. Rehabilitation providers may be tasked with helping to address these barriers.

Objectives

To develop technological supports to increase social media accessibility for people with TBI-related cognitive impairments and to obtain preliminary data on the perceived acceptability, ease of use, and utility of proposed technology aids.

Methods

We identified four major barriers to social media use among individuals with TBI: sensory overload, memory impairments, misreading of social cues, and a lack of confidence to actively engage on social media platforms. We describe the process of developing prototypes of support aids aimed at reducing these specific social media barriers. We created mock-ups of these prototypes and asked 46 community-dwelling adults with TBI (24 females) to rate the proposed aids in terms of their acceptability, ease of use, and utility.

Results

Across all aids, nearly one-third of respondents agreed they would use the proposed aids frequently, and the majority of respondents rated the proposed aids as easy to use. Respondents indicated that they would be more likely to use the memory and post-writing aids than the attention and social cue interpretation aids.

Conclusions

Findings provide initial support for social-media-specific technology aids to support social media access and social participation for adults with TBI. Results from this study have design implications for future development of evidence-based social media support aids. Future work should develop and deploy such aids and investigate user experience.

A critique of using the labels confirmatory and exploratory in modern psychological research

Psychological science is experiencing a rise in the application of complex statistical models and, simultaneously, a renewed focus on applying research in a confirmatory manner. This presents a fundamental conflict for psychological researchers as more complex forms of modeling necessarily eschew as stringent of theoretical constraints. In this paper, I argue that this is less of a conflict, and more a result of a continued adherence to applying the overly simplistic labels of exploratory and confirmatory. These terms mask a distinction between exploratory/confirmatory research practices and modeling. Further, while many researchers recognize that this dichotomous distinction is better represented as a continuum, this only creates additional problems. Finally, I argue that while a focus on preregistration helps clarify the distinction, psychological research would be better off replacing the terms exploratory and confirmatory with additional levels of detail regarding the goals of the study, modeling details, and scientific method.

Establishing ground truth in the traumatic brain injury literature: if replication is the answer, then what are the questions?

The replication crisis poses important challenges to modern science. Central to this challenge is re-establishing ground truths or the most fundamental theories that serve as the bedrock to a scientific community. However, the goal to identify hypotheses with the greatest support is non-trivial given the unprecedented rate of scientific publishing. In this era of high-volume science, the goal of this study is to sample from one research community within clinical neuroscience (traumatic brain injury) and track major trends that have shaped this literature over the past 50 years. To do so, we first conduct a decade-wise (1980-2019) network analysis to examine the scientific communities that shape this literature. To establish the robustness of our findings, we utilized searches from separate search engines (Web of Science; Semantic Scholar). As a second goal, we sought to determine the most highly cited hypotheses influencing the literature in each decade. In a third goal, we then searched for any papers referring to 'replication' or efforts to reproduce findings within our >50 000 paper dataset. From this search, 550 papers were analysed to determine the frequency and nature of formal replication studies over time. Finally, to maximize transparency, we provide a detailed procedure for the creation and analysis of our dataset, including a discussion of each of our major decision points, to facilitate similar efforts in other areas of neuroscience. We found that the unparalleled rate of scientific publishing within the brain injury literature combined with the scarcity of clear hypotheses in individual publications is a challenge to both evaluating accepted findings and determining paths forward to accelerate science. Additionally, while the conversation about reproducibility has increased over the past decade, the rate of published replication studies continues to be a negligible proportion of the research. Meta-science and computational methods offer the critical opportunity to assess the state of the science and illuminate pathways forward, but ultimately there is structural change needed in the brain injury literature and perhaps others.

Better Inference in Neuroscience: Test Less, Estimate More

Null-hypothesis significance testing (NHST) has become the main tool of inference in neuroscience, and yet evidence suggests we do not use this tool well: tests are often planned poorly, conducted unfairly, and interpreted invalidly. This editorial makes the case that in addition to reforms to increase rigor we should test less, reserving NHST for clearly confirmatory contexts in which the researcher has derived a quantitative prediction, can provide the inputs needed to plan a quality test, and can specify the criteria not only for confirming their hypothesis but also for rejecting it. A reduction in testing would be accompanied by an expansion of the use of estimation [effect sizes and confidence intervals (CIs)]. Estimation is more suitable for exploratory research, provides the inputs needed to plan strong tests, and provides important contexts for properly interpreting tests.