Reliable gains? Evidence for substantially underpowered designs in studies of working memory training transfer to fluid intelligence

Can we enhance working memory? Bias and effectiveness in cognitive training studies

Meta-analyses have found that working memory (WM) can be improved with cognitive training; however, some authors have suggested that these improvements are mostly driven by biases in the measurement of WM, especially the use of similar tasks for assessment and training. In the present meta-analysis, we investigated whether WM, fluid intelligence, executive functions, and short-term memory can be improved by cognitive training and evaluated the impact of possible sources of bias. We performed a risk of bias assessment of the included studies and took special care in controlling for practice effects. Data from 52 independent comparisons were analyzed, including cognitive training aimed at different cognitive functions. Our results show small improvements in WM after training (SMD = 0.18). Much larger effects were observed when the analysis was restricted to assessment tasks similar to those used for training (SMD = 1.15). Fluid intelligence was not found to improve as a result of training, and improvements in WM were not related to changes in fluid intelligence. Our analyses did however indicate that cognitive training can improve specific executive functions. Contrary to expectations, a set of meta-regressions indicated that characteristics of the training programme, such as dosage and type of training, do not have an impact on the effectiveness of training. The risk of bias assessment revealed some concerns in the randomization process and possible selective reporting among studies. Overall, our results identified various potential sources of bias, with the most significant being the choice of assessment tasks.

Audiovisual n-Back Training Alters the Neural Processes of Working Memory and Audiovisual Integration: Evidence of Changes in ERPs

(1) Background: This study investigates whether audiovisual n-back training leads to training effects on working memory and transfer effects on perceptual processing. (2) Methods: Before and after training, the participants were tested using the audiovisual n-back task (1-, 2-, or 3-back), to detect training effects, and the audiovisual discrimination task, to detect transfer effects. (3) Results: For the training effect, the behavioral results show that training leads to greater accuracy and faster response times. Stronger training gains in accuracy and response time using 3- and 2-back tasks, compared to 1-back, were observed in the training group. Event-related potentials (ERPs) data revealed an enhancement of P300 in the frontal and central regions across all working memory levels after training. Training also led to the enhancement of N200 in the central region in the 3-back condition. For the transfer effect, greater audiovisual integration in the frontal and central regions during the post-test rather than pre-test was observed at an early stage (80-120 ms) in the training group. (4) Conclusion: Our findings provide evidence that audiovisual n-back training enhances neural processes underlying a working memory and demonstrate a positive influence of higher cognitive functions on lower cognitive functions.

Shared Characteristics of Intrinsic Connectivity Networks Underlying Interoceptive Awareness and Empathy

Awareness of internal bodily sensations (interoceptive awareness; IA) and its connection to complex socioemotional abilities like empathy has been postulated, yet the functional neural circuitry they share remains poorly understood. The present fMRI study employs independent component analysis (ICA) to investigate which empathy facet (Cognitive or Affective) shares resting-state functional connectivity (rsFC) and/or BOLD variability (rsBOLD) with IA. Healthy participants viewed an abstract nonsocial movie demonstrated to evoke strong rsFC in brain networks resembling rest (InScapes), and resultant rsFC and rsBOLD data were correlated with self-reported empathy and IA questionnaires. We demonstrate a bidirectional behavioral and neurobiological relationship between empathy and IA, depending on the type of empathy interrogated: Affective empathy and IA share both rsFC and rsBOLD, while Cognitive empathy and IA only share rsBOLD. Specifically, increased rsFC in the right inferior frontal operculum (rIFO) of a larger attention network was associated with increased vicarious experience but decreased awareness of inner body sensations. Furthermore, increased rsBOLD between brain regions of an interoceptive network was related to increased sensitivity to internal sensations along with decreased Affective empathy. Finally, increased rsBOLD between brain regions subserving a mentalizing network related to not only an improved ability to take someone's perspective, but also a better sense of mind-body interconnectedness. Overall, these findings suggest that the awareness of one's own internal body changes (IA) is related to the socioemotional ability of feeling and understanding another's emotional state (empathy) and critically, that this relationship is reflected in the brain's resting state neuroarchitecture. Methodologically, this work highlights the importance of utilizing rsBOLD as a complementary window alongside rsFC to better understand neurological phenomena. Our results may be beneficial in aiding diagnosis in clinical populations such as autism spectrum disorder (ASD), where participants may be unable to complete tasks or questionnaires due to the severity of their symptoms.

Neurophysiological indices of the transfer of cognitive training gains to untrained tasks

Targeted training of working memory (WM) may improve performance and modulate brain function in untrained cognitive modalities. Demanding cognitive training protocols that do not target WM may also improve performance on untrained cognitive tests, but the delineation between transfer effects that are unique to WM training and effects that are shared among different cognitive training modalities has not been well-established. To address this, we examined the effects of twenty sessions of either WM training (visual n-back task with letter stimuli) or selective attention training (visual search task with letter array stimuli) on brain function during untrained WM and cognitive control tasks. Event-related potentials (ERPs) were obtained at baseline (pretest) and after the training period (posttest) for two untrained tasks - a Spatial 3-back task measuring spatial WM, and a Go/NoGo Flanker task measuring cognitive control. The n-back training group had more pronounced pretest-to-posttest performance improvements on the Spatial 3-back task compared to the search training group. N-back training was also associated with pretest-to-posttest enhancement of N1 amplitude and reduced N2 latency on trials of the task in which where there was a stimulus match, as well as enhancement of a late positive potential (550-750 msec post-stimulus) for all trials of the task. These ERP effects suggest that n-back training resulted in enhancement of attention to spatial locations, earlier onset of conflict monitoring processes, and changes in the engagement of neural activity during the retention interval, respectively. Both groups had faster reaction time on Go trials of the Go/NoGo Flanker task at posttest compared to pretest. Relatively subtle training-related effects were observed for N2 amplitude on this task, in line with the notion that training (particularly n-back training) was associated with improved conflict monitoring. Further, search training resulted in earlier onset of P2 and P3 latency at posttest compared to pretest. Taken together, the ERP findings for both tasks identify specific cognitive processes that are associated with transfer to untrained tasks after distinct forms of cognitive training.

The role of proactive interference in working memory training and transfer

Recent work on working memory training has produced conflicting results regarding the degree and generality of transfer to other cognitive processes. However, few studies have investigated possible mechanisms underlying transfer. The current study was designed to test the role of proactive interference in working memory training and transfer. Eighty-six young adults participated in a pretest-posttest design, with ten training sessions in between. In the two working memory training conditions, subjects performed an operation span task, with one condition requiring recall of letters on every trial (operation-letters), whereas the other condition alternated between letters, digits, and words as the to-be-remembered items across trials (operation-mix). These groups were compared to an active-control group (visual-search). Working memory, verbal fluency, and reading comprehension measures were administered in pretest and posttest sessions. All groups significantly increased their performance over the ten training sessions. There was evidence of strategy-specific benefits on transfer, such that transfer to working memory measures was higher for the operation-letters group on tasks specifically involving letters, and no differential transfer to working memory tests without letters, to verbal fluency, or to reading comprehension. The results indicate that proactive interference does not appear to play a causal role in determining transfer from working memory training, and instead a strategy account based on stimulus content provides a more parsimonious explanation for the pattern of training and transfer.

Working memory training revisited: A multi-level meta-analysis of n-back training studies

The efficacy of working memory (WM) training has been a controversial and hotly debated issue during the past years. Despite a large number of training studies and several meta-analyses, the matter has not yet been solved. We conducted a multi-level meta-analysis on the cognitive transfer effects in healthy adults who have been administered WM updating training with n-back tasks, the most common experimental WM training paradigm. Thanks to this methodological approach that has not been employed in previous meta-analyses in this field, we were able to include effect sizes from all relevant tasks used in the original studies. Altogether 203 effect sizes were derived from 33 published, randomized, controlled trials. In contrast to earlier meta-analyses, we separated task-specific transfer (here untrained n-back tasks) from other WM transfer tasks. Two additional cognitive domains of transfer that we analyzed consisted of fluid intelligence (Gf) and cognitive control tasks. A medium-sized transfer effect was observed to untrained n-back tasks. For other WM tasks, Gf, and cognitive control, the effect sizes were of similar size and very small. Moderator analyses showed no effects of age, training dose, training type (single vs. dual), or WM and Gf transfer task contents (verbal vs. visuospatial). We conclude that a substantial part of transfer following WM training with the n-back task is task-specific and discuss the implications of the results to WM training research.

Working Memory Updating Training Improves Mathematics Performance in Middle School Students With Learning Difficulties

Working memory (WM) deficit is considered the key cause of learning difficulties (LDs). Studies have shown that WM is plastic and thus can be improved through training. This positive effect is transferable to fluid intelligence and academic performance. This study investigated whether WM updating ability and academic performance in children with LDs could be improved through WM updating training and explored the effects of this training on the children’s brain activity. We used a running memory task lasting approximately 40 min per day for 28 days to train a group of 23 children with LDs (TLDs group). We also selected two control groups of 22 children with LDs (CLDs group) and 20 children without LDs (normal control [NC] group). The behavioral results of a pretest indicated that WM updating ability and academic performance in the TLDs and CLDs groups were significantly lower than those in the NC group before training. Compared with the CLDs group, the TLDs group exhibited significant performance improvement in a 2-back WM task, as well as in mathematical ability. Event-related potentials (ERPs) results suggested that the amplitudes of N160 (representative of visual recognition) and P300 (representative of updating processing, which is a valid index for updating WM) in the TLDs and CLDs groups were markedly lower than those in the NC group before training. In the TLDs group, these two components increased considerably after training, approaching levels similar to those in the NC group. The results of this study suggest that WM updating training can improve WM updating ability in children with LDs and the training effect can transfer to mathematical performance in such children. Furthermore, the participants’ brain activity levels can exhibit positive changes. This article provides experimental evidence that WM updating training could mitigate the symptoms of LDs to a certain degree.

No Effect of Commercial Cognitive Training on Brain Activity, Choice Behavior, or Cognitive Performance

Increased preference for immediate over delayed rewards and for risky over certain rewards has been associated with unhealthy behavioral choices. Motivated by evidence that enhanced cognitive control can shift choice behavior away from immediate and risky rewards, we tested whether training executive cognitive function could influence choice behavior and brain responses. In this randomized controlled trial, 128 young adults (71 male, 57 female) participated in 10 weeks of training with either a commercial web-based cognitive training program or web-based video games that do not specifically target executive function or adapt the level of difficulty throughout training. Pretraining and post-training, participants completed cognitive assessments and functional magnetic resonance imaging during performance of the following validated decision-making tasks: delay discounting (choices between smaller rewards now vs larger rewards in the future) and risk sensitivity (choices between larger riskier rewards vs smaller certain rewards). Contrary to our hypothesis, we found no evidence that cognitive training influences neural activity during decision-making; nor did we find effects of cognitive training on measures of delay discounting or risk sensitivity. Participants in the commercial training condition improved with practice on the specific tasks they performed during training, but participants in both conditions showed similar improvement on standardized cognitive measures over time. Moreover, the degree of improvement was comparable to that observed in individuals who were reassessed without any training whatsoever. Commercial adaptive cognitive training appears to have no benefits in healthy young adults above those of standard video games for measures of brain activity, choice behavior, or cognitive performance.SIGNIFICANCE STATEMENT Engagement of neural regions and circuits important in executive cognitive function can bias behavioral choices away from immediate rewards. Activity in these regions may be enhanced through adaptive cognitive training. Commercial brain training programs claim to improve a broad range of mental processes; however, evidence for transfer beyond trained tasks is mixed. We undertook the first randomized controlled trial of the effects of commercial adaptive cognitive training (Lumosity) on neural activity and decision-making in young adults (N = 128) compared with an active control (playing on-line video games). We found no evidence for relative benefits of cognitive training with respect to changes in decision-making behavior or brain response, or for cognitive task performance beyond those specifically trained.

Working memory training in healthy young adults: Support for the null from a randomized comparison to active and passive control groups

Training of working memory as a method of increasing working memory capacity and fluid intelligence has received much attention in recent years. This burgeoning field remains highly controversial with empirically-backed disagreements at all levels of evidence, including individual studies, systematic reviews, and even meta-analyses. The current study investigated the effect of a randomized six week online working memory intervention on untrained cognitive abilities in a community-recruited sample of healthy young adults, in relation to both a processing speed training active control condition, as well as a no-contact control condition. Results of traditional null hypothesis significance testing, as well as Bayesian factor analyses, revealed support for the null hypothesis across all cognitive tests administered before and after training. Importantly, all three groups were similar at pre-training for a variety of individual variables purported to moderate transfer of training to fluid intelligence, including personality traits, motivation to train, and expectations of cognitive improvement from training. Because these results are consistent with experimental trials of equal or greater methodological rigor, we suggest that future research re-focus on: 1) other promising interventions known to increase memory performance in healthy young adults, and; 2) examining sub-populations or alternative populations in which working memory training may be efficacious.

Training on Working Memory and Inhibitory Control in Young Adults

Different types of interventions have focused on trying to improve Executive Functions (EFs) due to their essential role in human cognition and behavior regulation. Although EFs are thought to be diverse, most training studies have targeted cognitive processes related to working memory (WM), and fewer have focused on training other control mechanisms, such as inhibitory control (IC). In the present study, we aimed to investigate the differential impact of training WM and IC as compared with control conditions performing non-executive control activities. Young adults were divided into two training (WM/IC) and two (active/passive) control conditions. Over six sessions, the training groups engaged in three different computer-based adaptive activities (WM or IC), whereas the active control group completed a program with low control-demanding activities that mainly involved processing speed. In addition, motivation and engagement were monitored through the training. The WM-training activities required maintenance, updating and memory search processes, while those from the IC group engaged response inhibition and interference control. All participants were pre- and post-tested in criterion tasks (n-back and Stroop), near transfer measures of WM (Operation Span) and IC (Stop-Signal). Non-trained far transfer outcome measures included an abstract reasoning test (Raven’s Advanced Progressive Matrices) and a well-validated experimental task (AX-CPT) that provides indices of cognitive flexibility considering proactive/reactive control. Training results revealed that strongly motivated participants reached higher levels of training improvements. Regarding transfer effects, results showed specific patterns of near transfer effects depending on the type of training. Interestingly, it was only the IC training group that showed far transfer to reasoning. Finally, all trained participants showed a shift toward a more proactive mode of cognitive control, highlighting a general effect of training on cognitive flexibility. The present results reveal specific and general modulations of executive control mechanisms after brief training intervention targeting either WM or IC.

There is no convincing evidence that working memory training is effective: A reply to Au et al. (2014) and Karbach and Verhaeghen (2014)

The possible cognitive benefits of working memory training programs have been the subject of intense interest and controversy. Recently two meta-analyses have claimed that working memory training can be effective in enhancing cognitive skills in adulthood (Au et al. Behavioural Brain Research 228:(1) 107-115, 2014) and stemming cognitive decline in old age (Karbach & Verhaeghen Psychological Science 25:2027-2037, 2014). The current article critically evaluates these claims. We argue that these meta-analyses produce misleading results because of (1) biases in the studies included, (2) a failure to take account of baseline differences when calculating effect sizes, and (3) a failure to emphasize the difference between studies with treated versus untreated control groups. We present new meta-analyses and conclude that there is no convincing evidence that working memory training produces general cognitive benefits.

There is no convincing evidence that working memory training is NOT effective: A reply to Melby-Lervåg and Hulme (2015)

Our recent meta-analysis concluded that training on working memory can improve performance on tests of fluid intelligence (Au et al., Psychon Bull Rev, 22(2), 366-377, 2015). Melby-Lervåg and Hulme (Psychon Bull Rev, doi: 10.3758/s13423-015-0862-z ) challenge this conclusion on the grounds that it did not take into consideration baseline differences on a by-study level and that the effects were primarily driven by purportedly less rigorous studies that did not include active control groups. Their re-analysis shows that accounting for baseline differences produces a statistically significant, but considerably smaller, overall effect size (g = 0.13 vs g = 0.24 in Au et al.), which loses significance after excluding studies without active controls. The present report demonstrates that evidence of impact variation by the active/passive nature of control groups is ambiguous and also reveals important discrepancies between Melby-Lervåg and Hulme's analysis and our original meta-analysis in terms of the coding and organization of data that account for the discrepant effect sizes. We demonstrate that there is in fact no evidence that the type of control group per se moderates the effects of working memory training on measures of fluid intelligence and reaffirm the original conclusions in Au et al., which are robust to multiple methods of calculating effect size, including the one proposed by Melby-Lervåg and Hulme.