The tainted altruism effect: a successful pre-registered replication

Newman and Cain (Newman, Cain 2014 Psychol. Sci. 25, 648-655 (doi:10.1177/0956797613504785)) reported that observers view a person's choices as less ethical when that person has acted in response to both altruistic and selfish (commercial) motivations, as compared with purely selfish interests. The altruistic component reduces the observers' approval rather than raising it. This puzzling phenomenon termed the 'tainted altruism' effect, has attracted considerable interest but no direct replications in prior research. We report direct replications of Newman and Cain's Experiments 2 and 3, using a larger sample (n = 501) intended to be fairly representative of the US population. The results confirm the original findings in considerable detail.

Mitigating cue competition effects in human category learning

When people learn perceptual categories, if one feature makes it easy to determine the category membership, learning about other features can be reduced. In three experiments, we asked whether this cue competition effect could be fully eradicated with simple instructions. For this purpose, in a pilot experiment, we adapted a classical overshadowing paradigm into a human category learning task. Unlike previous reports, we demonstrate a robust cue competition effect with human learners. In Experiments 1 and 2, we created a new warning condition that aimed at eradicating the cue competition effect through top-down instructions. With a medium-size overshadowing effect, Experiment 1 shows a weak mitigation of the overshadowing effect. We replaced the stimuli in Experiment 2 to obtain a larger overshadowing effect and showed a larger warning effect. Nevertheless, the overshadowing effect could not be fully eradicated. These experiments suggest that cue competition effects can be a stubborn roadblock in human category learning. Theoretical and practical implications are discussed.

A consensus-based transparency checklist

We present a consensus-based checklist to improve and document the transparency of research reports in social and behavioural research. An accompanying online application allows users to complete the form and generate a report that they can submit with their manuscript or post to a public repository.

Perceptions of newsworthiness are contaminated by a political usefulness bias

Are people's perceptions of the newsworthiness of events biased by a tendency to rate as more important any news story that seems likely to lead others to share their own political attitudes? To assess this, we created six pairs of hypothetical news stories, each describing an event that seemed likely to encourage people to adopt attitudes on the opposite side of a particular controversial issue (e.g. affirmative action and gay marriage). In total, 569 subjects were asked to evaluate the importance of these stories 'to the readership of a general-circulation newspaper', disregarding how interesting they happened to find the event. Subjects later indicated their own personal attitudes to the underlying political issues. Predicted crossover interactions were confirmed for all six issues. All the interactions took the form of subjects rating stories offering 'ammunition' for their own side of the controversial issue as possessing greater intrinsic news importance.

Comment on McLeod and Hume, Overlapping Mental Operations in Serial Performance with Preview: Typing

This paper deals with the claim made by McLeod and Hume (this issue) that, for a skilled typist, the rate of responding is controlled by a limit on the number of responses that can be executed simultaneously, not by a limit on response selection. I point out that McLeod and Hume's observations are consistent with various interpretations, including one in which response rates are limited by response selection. I also note the importance of trying to distinguish structural and strategic bottlenecks in speeded responding.

Chronometric Evidence for Central Postponement in Temporally Overlapping Tasks

When the stimuli from two tasks arrive in rapid succession (the overlapping tasks paradigm), response delays are typically observed. Two general types of models have been proposed to account for these delays. Postponement models suppose that processing stages in the second task are delayed due to a single-channel bottleneck. Capacity-sharing models suppose that processing on both tasks occurs at reduced rates because of sharing of common resources. Postponement models make strong and distinctive predictions for the behaviour of variables slowing particular second-task stages, when assessed in single- and dual-task conditions. In Experiment 1, subjects were required to make manual classification responses to a tone (S1) and a letter (S2), presented at stimulus onset asynchronies of 50, 100, and 400 msec, making R1 responses to S1 as promptly as possible. The second response, R2, but not R1, was delayed in the dual task condition, and the effects of two S2 variables (degradation and repetition) on R2 response times in dual- and single-task conditions closely matched the predictions of a postponement model with a processing bottleneck at the decision/response-selection stage. In Experiment 2, subjects were encouraged to emit both responses close together in time. Use of this response grouping procedure had little effect on the magnitude of R2 response times, or on the pattern of stimulus factor effects on R2, supporting the hypothesis that the same underlying postponement process was operating. R1 response times were, however, dramatically delayed, and were now affected by S2 difficulty variables. The results provide strong support for postponement models of dual-task interference in the overlapping tasks paradigm, even when response times are delayed on both tasks.

How effective is incidental learning of the shape of probability distributions?

The idea that people learn detailed probabilistic generative models of the environments they interact with is intuitively appealing, and has received support from recent studies of implicit knowledge acquired in daily life. The goal of this study was to see whether people efficiently induce a probability distribution based upon incidental exposure to an unknown generative process. Subjects played a 'whack-a-mole' game in which they attempted to click on objects appearing briefly, one at a time on the screen. Horizontal positions of the objects were generated from a bimodal distribution. After 180 plays of the game, subjects were unexpectedly asked to generate another 180 target positions of their own from the same distribution. Their responses did not even show a bimodal distribution, much less an accurate one (Experiment 1). The same was true for a pre-announced test (Experiment 2). On the other hand, a more extreme bimodality with zero density in a middle region did produce some distributional learning (Experiment 3), perhaps reflecting conscious hypothesis testing. We discuss the challenge this poses to the idea of efficient accurate distributional learning.

Learning to exploit a hidden predictor in skill acquisition: Tight linkage to conscious awareness

It is often assumed that implicit learning of skills based on predictive relationships proceeds independently of awareness. To test this idea, four groups of subjects played a game in which a fast-moving "demon" made a brief appearance at the bottom of the computer screen, then disappeared behind a V-shaped occluder, and finally re-appeared briefly on either the upper-left or upper-right quadrant of the screen. Points were scored by clicking on the demon during the final reappearance phase. Demons differed in several visible characteristics including color, horn height and eye size. For some subjects, horn height perfectly predicted which side the demon would reappear on. For subjects not told the rule, the subset who demonstrated at the end of the experiment that they had spontaneously discovered the rule showed strong evidence of exploiting it by anticipating the demon's arrival and laying in wait for it. Those who could not verbalize the rule performed no better than a control group for whom the demons moved unpredictably. The implications of this tight linkage between conscious awareness and implicit skill learning are discussed.

Increasing Retention Without Increasing Study Time

Because people forget much of what they learn, students could benefit from learning strategies that yield long-lasting knowledge. Yet surprisingly little is known about how long-term retention is most efficiently achieved. Here we examine how retention is affected by two variables: the duration of a study session and the temporal distribution of study time across multiple sessions. Our results suggest that a single session devoted to the study of some material should continue long enough to ensure that mastery is achieved but that immediate further study of the same material is an inefficient use of time. Our data also show that the benefit of distributing a fixed amount of study time across two study sessions—the spacing effect—depends jointly on the interval between study sessions and the interval between study and test. We discuss the practical implications of both findings, especially in regard to mathematics learning.

Central Interference in Driving

Participants attempted to perform two tasks concurrently during simulated driving. In the choice task, they responded either manually or vocally to the number of times a visual or auditory stimulus occurred; in the braking task, they depressed a brake pedal in response to the lead car's brake lights. The time delay between the onset of the tasks' stimuli, or stimulus onset asynchrony (SOA), was varied. The tasks were differentially affected by the manipulations. Brake reaction times increased as SOA was reduced, showing the psychological refractory period effect, whereas the choice task showed large effects of the stimulus and response modalities but only a small effect of SOA. These results demonstrate that a well-practiced “simple” task such as vehicle braking is subject to dual-task slowing and extend the generality of the central-bottleneck model.

Attention and the Processing of Emotional Words and Names

Previous research has suggested that a person's own name or emotionally charged stimuli automatically “grab” attention, potentially challenging limited-capacity theories of perceptual processing. In this study, subjects were shown two digits surrounding a word and asked to make a speeded judgment about whether the parity of the two digits matched. When the subject's own name was presented on a few scattered trials, responses were markedly slowed (replicating a previous study). However, in a subsequent block of trials in which half the words were the subject's name, the slowing did not occur. The same slowing occurred (but even more fleetingly) when an emotionally charged word was presented between the digits. When the name was embedded among multiple distractor words, it ceased to slow reaction times. The results suggest that perceptual analysis of high-priority stimuli is subject to the usual capacity limitations of other stimuli, but when enough capacity is available for a high-priority stimulus to be perceived, a transient surprise reaction may interrupt ongoing processing.

Do subtle reminders of money change people's political views?

A number of researchers have reported studies showing that subtle reminders of money can alter behaviors and beliefs that are seemingly unrelated to money. In 1 set of studies published in this journal, Caruso, Vohs, Baxter, and Waytz (2013) found that incidental exposures to money led subjects to indicate greater support for inequality, socioeconomic differences, group-based discrimination, and free market economies. We conducted high-powered replication attempts of these 4 money priming effects and found no evidence of priming (weighted Cohen's d = 0.03). We later learned that Caruso et al. also found several null effects in their line of research that were not reported in the original article. In addition, the money priming effect observed in the first study of Caruso et al. was included in the Many Labs Replication Project (Klein et al., 2014), and only 1 of the 36 labs was able to find the effect.

With practice, keyboard shortcuts become faster than menu selection: A crossover interaction

It is widely believed that a graphical user interface (GUI) is superior to a command line interface (CLI) for novice users, but less efficient than the CLI after practice. However, there appears to be no detailed study of the crossover interaction that this implies. The rate of learning may shed light on the reluctance of experienced users to adopt keyboard shortcuts, even though, when mastered, shortcut use would reduce task completion times. We report 2 experiments examining changes in the efficiency of and preference for keyboard input versus GUI with practice. Experiment 1 had separate groups of subjects make speeded choice responses to words on a 20-item list either by clicking on a tab in a dropdown menu (GUI version) or by entering a preassigned keystroke combination (CLI version). The predicted crossover was observed after approximately 200 responses. Experiment 2 showed that following training all but 1 subject in the CLI-trained group chose to continue using shortcuts. These results suggest that frequency of shortcut use is a function of ease of retrieval, which develops over the course of multiple repetitions of the command. We discuss possible methods for promoting shortcut learning and the practical implications of our results.

Improving students' long-term knowledge retention through personalized review

Human memory is imperfect; thus, periodic review is required for the long-term preservation of knowledge and skills. However, students at every educational level are challenged by an ever-growing amount of material to review and an ongoing imperative to master new material. We developed a method for efficient, systematic, personalized review that combines statistical techniques for inferring individual differences with a psychological theory of memory. The method was integrated into a semester-long middle-school foreign-language course via retrieval-practice software. Using a cumulative exam administered after the semester's end, we compared time-matched review strategies and found that personalized review yielded a 16.5% boost in course retention over current educational practice (massed study) and a 10.0% improvement over a one-size-fits-all strategy for spaced study.

Two failures to replicate high-performance-goal priming effects

Bargh et al. (2001) reported two experiments in which people were exposed to words related to achievement (e.g., strive, attain) or to neutral words, and then performed a demanding cognitive task. Performance on the task was enhanced after exposure to the achievement related words. Bargh and colleagues concluded that better performance was due to the achievement words having activated a "high-performance goal". Because the paper has been cited well over 1100 times, an attempt to replicate its findings would seem warranted. Two direct replication attempts were performed. Results from the first experiment (n = 98) found no effect of priming, and the means were in the opposite direction from those reported by Bargh and colleagues. The second experiment followed up on the observation by Bargh et al. (2001) that high-performance-goal priming was enhanced by a 5-minute delay between priming and test. Adding such a delay, we still found no evidence for high-performance-goal priming (n = 66). These failures to replicate, along with other recent results, suggest that the literature on goal priming requires some skeptical scrutiny.

Reviewing erroneous information facilitates memory updating

Reviewing information stored in memory will generally strengthen that information, so it seems reasonable that reviews should make it harder to replace the information in memory if it is later found to be erroneous. In Experiment 1, subjects learned three facts about each of 12 topics. On Day 2, the same facts were either reread, tested, or not reviewed; then the facts were "corrected" with new replacement facts. A test on the replacement facts given 1week later disclosed that both rereading and testing the to-be-replaced Day-1 facts enhanced memory for the Day-2 facts which supplanted them, although rereading (but not testing) the Day-1 facts also led to more intrusions of Day-1 facts on the final test. In Experiment 2, subjects were unexpectedly asked (in the final test) to recollect both original and replacement facts; old facts were often retrieved, especially when reviewed. It is suggested that review may promote development of a secondary retrieval route for the corrected information.

Effects of spaced versus massed training in function learning

A robust finding in the literature is that spacing material leads to better retention than massing; however, the benefit of spacing for concept learning is less clear. When items are massed, it may help the learner to discover the relationship between instances, leading to better abstraction of the underlying concept. Two experiments addressed this question through a typical function learning task in which subjects were trained via presentations of input points (cue values) for which output responses (criterion values) were required. Subjects were trained either using spaced points, strategically massed points (points were paired in training such that they occurred on the same side of the underlying V-shaped function), or randomly massed points (points were randomly paired during training). All subjects were then tested on repeated training points, new (interpolation) points within the training range, and extrapolation points that fell outside the training range. Spacing led to superior interpolation and extrapolation performance, with random massing leading to the worst performance on all test trial types. These results suggest that, at least for function concepts, massed training is not superior to spaced training for concept learning.

When does fading enhance perceptual category learning?

Training that uses exaggerated versions of a stimulus discrimination (fading) has sometimes been found to enhance category learning, mostly in studies involving animals and impaired populations. However, little is known about whether and when fading facilitates learning for typical individuals. This issue was explored in 7 experiments. In Experiments 1 and 2, observers discriminated stimuli based on a single sensory continuum (time duration and line length, respectively). Adaptive fading dramatically improved performance in training (unsurprisingly) but did not enhance learning as assessed in a final test. The same was true for nonadaptive linear fading (Experiment 3). However, when variation in length (predicting category membership) was embedded among other (category-irrelevant) variation, fading dramatically enhanced not only performance in training but also learning as assessed in a final test (Experiments 4 and 5). Fading also helped learners to acquire a color saturation discrimination amid category-irrelevant variation in hue and brightness, although this learning proved transitory after feedback was withdrawn (Experiment 7). Theoretical implications are discussed, and we argue that fading should have practical utility in naturalistic category learning tasks, which involve extremely high dimensional stimuli and many irrelevant dimensions.

Is the Replicability Crisis Overblown? Three Arguments Examined

We discuss three arguments voiced by scientists who view the current outpouring of concern about replicability as overblown. The first idea is that the adoption of a low alpha level (e.g., 5%) puts reasonable bounds on the rate at which errors can enter the published literature, making false-positive effects rare enough to be considered a minor issue. This, we point out, rests on statistical misunderstanding: The alpha level imposes no limit on the rate at which errors may arise in the literature (Ioannidis, 2005b). Second, some argue that whereas direct replication attempts are uncommon, conceptual replication attempts are common—providing an even better test of the validity of a phenomenon. We contend that performing conceptual rather than direct replication attempts interacts insidiously with publication bias, opening the door to literatures that appear to confirm the reality of phenomena that in fact do not exist. Finally, we discuss the argument that errors will eventually be pruned out of the literature if the field would just show a bit of patience. We contend that there are no plausible concrete scenarios to back up such forecasts and that what is needed is not patience, but rather systematic reforms in scientific practice.

Priming of social distance? Failure to replicate effects on social and food judgments

Williams and Bargh (2008) reported an experiment in which participants were simply asked to plot a single pair of points on a piece of graph paper, with the coordinates provided by the experimenter specifying a pair of points that lay at one of three different distances (close, intermediate, or far, relative to the range available on the graph paper). The participants who had graphed a more distant pair reported themselves as being significantly less close to members of their own family than did those who had plotted a more closely-situated pair. In another experiment, people's estimates of the caloric content of different foods were reportedly altered by the same type of spatial distance priming. Direct replications of both results were attempted, with precautions to ensure that the experimenter did not know what condition the participant was assigned to. The results showed no hint of the priming effects reported by Williams and Bargh (2008).

Learning Styles

The term “learning styles” refers to the concept that individuals differ in regard to what mode of instruction or study is most effective for them. Proponents of learning-style assessment contend that optimal instruction requires diagnosing individuals' learning style and tailoring instruction accordingly. Assessments of learning style typically ask people to evaluate what sort of information presentation they prefer (e.g., words versus pictures versus speech) and/or what kind of mental activity they find most engaging or congenial (e.g., analysis versus listening), although assessment instruments are extremely diverse. The most common—but not the only—hypothesis about the instructional relevance of learning styles is the meshing hypothesis, according to which instruction is best provided in a format that matches the preferences of the learner (e.g., for a “visual learner,” emphasizing visual presentation of information).

The learning-styles view has acquired great influence within the education field, and is frequently encountered at levels ranging from kindergarten to graduate school. There is a thriving industry devoted to publishing learning-styles tests and guidebooks for teachers, and many organizations offer professional development workshops for teachers and educators built around the concept of learning styles.

The authors of the present review were charged with determining whether these practices are supported by scientific evidence. We concluded that any credible validation of learning-styles-based instruction requires robust documentation of a very particular type of experimental finding with several necessary criteria. First, students must be divided into groups on the basis of their learning styles, and then students from each group must be randomly assigned to receive one of multiple instructional methods. Next, students must then sit for a final test that is the same for all students. Finally, in order to demonstrate that optimal learning requires that students receive instruction tailored to their putative learning style, the experiment must reveal a specific type of interaction between learning style and instructional method: Students with one learning style achieve the best educational outcome when given an instructional method that differs from the instructional method producing the best outcome for students with a different learning style. In other words, the instructional method that proves most effective for students with one learning style is not the most effective method for students with a different learning style.

Our review of the literature disclosed ample evidence that children and adults will, if asked, express preferences about how they prefer information to be presented to them. There is also plentiful evidence arguing that people differ in the degree to which they have some fairly specific aptitudes for different kinds of thinking and for processing different types of information. However, we found virtually no evidence for the interaction pattern mentioned above, which was judged to be a precondition for validating the educational applications of learning styles. Although the literature on learning styles is enormous, very few studies have even used an experimental methodology capable of testing the validity of learning styles applied to education. Moreover, of those that did use an appropriate method, several found results that flatly contradict the popular meshing hypothesis.

We conclude therefore, that at present, there is no adequate evidence base to justify incorporating learning-styles assessments into general educational practice. Thus, limited education resources would better be devoted to adopting other educational practices that have a strong evidence base, of which there are an increasing number. However, given the lack of methodologically sound studies of learning styles, it would be an error to conclude that all possible versions of learning styles have been tested and found wanting; many have simply not been tested at all. Further research on the use of learning-styles assessment in instruction may in some cases be warranted, but such research needs to be performed appropriately.

Reversing the attention effect in figure-ground perception

Human visual perception is sometimes ambiguous, switching between different perceptual structures, and shifts of attention sometimes favor one perceptual structure over another. It has been proposed that, in figure-ground segmentation, attention to certain regions tends to cause those regions to be perceived as closer to the observer. Here, we show that this attention effect can be reversed under certain conditions. To account for these phenomena, we propose an alternative principle: The visual system chooses the interpretation that maximizes simplicity of the attended regions.

Spacing effects in learning: a temporal ridgeline of optimal retention

To achieve enduring retention, people must usually study information on multiple occasions. How does the timing of study events affect retention? Prior research has examined this issue only in a spotty fashion, usually with very short time intervals. In a study aimed at characterizing spacing effects over significant durations, more than 1,350 individuals were taught a set of facts and--after a gap of up to 3.5 months--given a review. A final test was administered at a further delay of up to 1 year. At any given test delay, an increase in the interstudy gap at first increased, and then gradually reduced, final test performance. The optimal gap increased as test delay increased. However, when measured as a proportion of test delay, the optimal gap declined from about 20 to 40% of a 1-week test delay to about 5 to 10% of a 1-year test delay. The interaction of gap and test delay implies that many educational practices are highly inefficient.

Optimizing Distributed Practice

More than a century of research shows that increasing the gap between study episodes using the same material can enhance retention, yet little is known about how this so-called distributed practice effect unfolds over nontrivial periods. In two three-session laboratory studies, we examined the effects of gap on retention of foreign vocabulary, facts, and names of visual objects, with test delays up to 6 months. An optimal gap improved final recall by up to 150%. Both studies demonstrated nonmonotonic gap effects: Increases in gap caused test accuracy to initially sharply increase and then gradually decline. These results provide new constraints on theories of spacing and confirm the importance of cumulative reviews to promote retention over meaningful time periods.

Does the Central Bottleneck Encompass Voluntary Selection of Hedonically Based Choices?

A large literature on multitasking bottlenecks suggests that people cannot generally make decisions or select responses in two different tasks at the same time. However, these tasks have all involved retrieving preinstructed responses, rather than spontaneously choosing actions based on anticipated hedonic consequences. To assess whether the same bottlenecks encompasses voluntary choices, a gambling decision was utilized as the second of two tasks in a psychological refractory period (PRP) design. Three decision-related factors were identified that affected latency of responding in the gambling task. All proved to be additive with stimulus-onset asynchrony (SOA) in dual-task blocks. The results indicate that making a choice to try to optimize outcomes is subject to the same processing bottleneck as the retrieval of preinstructed responses that has been the mainstay of attention and performance research.