The effects of static and adaptive performance feedback in game-based training

Effects of adaptive scaffolding on performance, cognitive load and engagement in game-based learning: a randomized controlled trial

BACKGROUND

While game-based learning has demonstrated positive outcomes for some learners, its efficacy remains variable. Adaptive scaffolding may improve performance and self-regulation during training by optimizing cognitive load. Informed by cognitive load theory, this study investigates whether adaptive scaffolding based on interaction trace data influences learning performance, self-regulation, cognitive load, test performance, and engagement in a medical emergency game.

METHODS

Sixty-two medical students from three Dutch universities played six game scenarios. They received either adaptive or nonadaptive scaffolding in a randomized double-blinded matched pairs yoked control design. During gameplay, we measured learning performance (accuracy, speed, systematicity), self-regulation (self-monitoring, help-seeking), and cognitive load. Test performance was assessed in a live scenario assessment at 2- and 6-12-week intervals. Engagement was measured after completing all game scenarios.

RESULTS

Surprisingly, the results unveiled no discernible differences between the groups experiencing adaptive and nonadaptive scaffolding. This finding is attributed to the unexpected alignment between the nonadaptive scaffolding and the needs of the participants in 64.9% of the scenarios, resulting in coincidentally tailored scaffolding. Exploratory analyses suggest that, compared to nontailored scaffolding, tailored scaffolding improved speed, reduced self-regulation, and lowered cognitive load. No differences in test performance or engagement were found.

DISCUSSION

Our results suggest adaptive scaffolding may enhance learning by optimizing cognitive load. These findings underscore the potential of adaptive scaffolding within GBL environments, cultivating a more tailored and effective learning experience. To leverage this potential effectively, researchers, educators, and developers are recommended to collaborate from the outset of designing adaptive GBL or computer-based simulation experiences. This collaborative approach facilitates the establishment of reliable performance indicators and enables the design of suitable, preferably real-time, scaffolding interventions. Future research should confirm the effects of adaptive scaffolding on self-regulation and learning, taking care to avoid unintended tailored scaffolding in the research design.

TRIAL REGISTRATION

This study was preregistered with the Center for Open Science prior to data collection. The registry may be found at https://osf.io/7ztws/ .

Adaptive training instructional interventions: A meta-analysis

The United States military services are modernizing their training and education curricula by leveraging advances in technology to deliver instruction that is more engaging and responsive to trainees' needs and better prepares them for the future fight. Adaptive training (AT), or training tailored to the strengths and weaknesses of individual trainees, is a promising technique to meet these modernization goals. The research literature, however, is sporadic and does not clearly prescribe best practices for its employment. Therefore, we conducted a meta-analysis to examine the effectiveness of various AT instructional interventions (i.e. adapting difficulty, feedback, scaffolding, etc.) on learning outcomes. There were 30 peer-reviewed publications included in the analysis. We grouped studies by the adaptive intervention examined and reported the associated effects on learning outcomes. Overall, the results revealed that the effectiveness of AT varied considerably across the instructional interventions. Specifically, studies that implemented adaptive difficulty techniques were the most effective, followed by adaptive scaffolding and remediation/test-out techniques. Based on these findings, we identify design recommendations for future AT systems.

Motivation of UK graduate students in education: self-compassion moderates pathway from extrinsic motivation to intrinsic motivation

Academic motivation is recognised as a key factor for academic success and wellbeing. Highly motivated students actively engage with academic activities and maintain good wellbeing. Despite the importance of motivation in education, its relationship with engagement and wellbeing remains to be evaluated. Accordingly, this study explored the relationships between motivation, engagement, self-criticism and self-compassion among UK education postgraduate students. Of 120 postgraduate students approached, 109 completed three self-report scales regarding those constructs. Correlation, regression and moderation analyses were performed. Intrinsic and extrinsic motivation were positively associated with engagement, whereas amotivation was negatively associated with it. Engagement positively predicted intrinsic motivation. Self-criticism and self-compassion moderated the pathway from extrinsic motivation to intrinsic motivation: higher self-criticism weakened the pathway, while higher self-compassion strengthened it. Findings suggest the importance of engagement in relation to cultivating intrinsic motivation of education students. Moreover, enhancing self-compassion and reducing self-criticism can help transfer extrinsic to intrinsic motivation.

Interactive Effects of Team Virtuality and Work Design on Team Functioning

This review study aimed to investigate how team work design shapes the impact of team virtuality on team functioning. Based on 48 studies, we identified key work design variables that influence both team functioning, that is, team performance and intermediary outcomes (i.e., team processes and emergent states), under conditions of high virtuality (or in interaction with virtuality). First, while outcome interdependence showed positive effects on the functioning of virtual teams, particularly via motivational increases, task interdependence showed mixed results. Second, high levels of knowledge characteristics (e.g., task complexity) appear to worsen team functioning within virtual contexts, likely because these characteristics add to the demands of an already demanding context. Third, job resources (e.g., feedback) showed positive associations with team functioning, suggesting these variables might buffer the high demands of virtual work. Given these results, more investigations that explicitly examine the interaction between work design and team virtuality are needed.

Computer Games in Education

Visionaries offer strong claims for the educational benefits of computer games, but there is a need to test those claims with rigorous scientific research and ground them in evidence-based theories of how people learn. Three genres of game research are ( a) value-added research, which compares the learning outcomes of groups that learn academic material from playing a base version of a game to the outcomes of those playing the same game with one feature added; ( b) cognitive consequences research, which compares improvements in cognitive skills of groups that play an off-the-shelf game to the skill improvements of those who engage in a control activity; and ( c) media comparison research, which compares the learning outcomes of groups that learn academic material in a game to the outcomes of those who learn with conventional media. Value-added research suggests five promising features to include in educational computer games: modality, personalization, pretraining, coaching, and self-explanation. Cognitive consequences research suggests two promising approaches to cognitive training with computer games: using first-person shooter games to train perceptual attention skills and using spatial puzzle games to train two-dimensional mental rotation skills. Media comparison research suggests three promising areas where games may be more effective than conventional media: science, mathematics, and second-language learning. Future research is needed to pinpoint the cognitive, motivational, affective, and social processes that underlie learning with educational computer games.