How crucial is the response format for the testing effect?

Delayed Metacomprehension Judgments Do Not Directly Improve Learning from Texts

Making judgments of learning (JOLs) after studying can directly improve learning. This JOL reactivity has been shown for simple materials but has scarcely been investigated with educationally relevant materials such as expository texts. The few existing studies have not yet reported any consistent gains in text comprehension due to providing JOLs. In the present study, we hypothesized that increasing the chances of covert retrieval attempts when making JOLs after each of five to-be-studied text passages would produce comprehension benefits at 1 week compared to restudy. In a between-subjects design, we manipulated both whether participants (N = 210) were instructed to covertly retrieve the texts, and whether they made delayed target-absent JOLs. The results indicated that delayed, target-absent JOLs did not improve text comprehension after 1 week, regardless of whether prior instructions to engage in covert retrieval were provided. Based on the two-stage model of JOLs, we reasoned that participants' retrieval attempts during metacomprehension judgments were either insufficient (i.e., due to a quick familiarity assessment) or were ineffective (e.g., due to low retrieval success).

Vocabulary Learning During Reading: Benefits of Contextual Inferences Versus Retrieval Opportunities

Retrieval practice of isolated words (e.g., with flashcards) enhances foreign vocabulary learning. However, vocabulary is often encountered in context. We investigated whether retrieval opportunities also enhance contextualized word learning. In two within‐subjects experiments, participants encoded 24 foreign words and then read a story to further strengthen word knowledge. The story contained eight target words in a retrieval context, which required participants to recall word meaning from memory to understand the text (e.g., “She borrowed aknyga”), and eight target words in an inference context from which meaning could be inferred (e.g., “She read aknyga” [book]). After 1 to 2 days, a posttest measured word retention. Reading the words in either the retrieval or inference context increased retention, compared to control words not included in the story. Moreover, in Experiment 1, retention was significantly higher in the inference than in the retrieval condition. In Experiment 2, in which encoding before reading was more extensive and feedback was available, no differences in retention were found between the inference and retrieval + feedback condition (both increased retention, compared to control words). Overall, the findings suggest that the benefits of retrieval may be less pronounced during incidental, contextualized learning than during intentional exercises and that retrieval success must be considered when adding retrieval opportunities to contextualized learning. Under low retrieval success, the better comprehension afforded by an informative context may outweigh the benefits of retrieval opportunities (Exp.1). Yet even when retrieval success was enhanced and feedback was added (Exp. 2), retrieval opportunities were only as beneficial as exposure to rich contextual information.

Abrufeffekte im Gedächtnis: Ein Überblick zur aktuellen Grundlagenforschung

Zusammenfassung. Der Frage, wie Erinnern das Gedächtnis formt, wurde in der Kognitiven Psychologie in letzter Zeit große Aufmerksamkeit gewidmet. Testungseffekte, die in einer durch Gedächtnisabruf in der Folge verbesserten Zugänglichkeit von Gedächtniseinträgen bestehen, wurden in diesem Zusammenhang insbesondere auch hinsichtlich ihres pädagogischen Potentials diskutiert. Neben erleichterter Zugänglichkeit kann Gedächtnisabruf allerdings auch Vergessen nicht abgerufener Information verursachen. Der aktuelle Stand der Grundlagenforschung zu Abrufeffekten wird in diesem Überblicksartikel dargestellt und eine integrative Betrachtung unterschiedlicher Arten von Abrufeffekten unter Berücksichtigung wichtiger Moderatorvariablen versucht.

Testing the Retrieval Effort Theory

Abstract. Testing effect refers to the phenomenon that, relative to relearning, retrieval practice enhances delayed memory performance. In two experiments, this study tested the retrieval effort theory proposed to explain the enhancement effect of testing. In Experiment 1, participants learned English words with their corresponding Chinese definitions. Then they were tested on half of the encoded items and restudied the remaining half under three delays after encoding (0 min, 20 min, and 40 min). All participants took delayed memory tests 60 min after the end of the initial encoding phase. The result showed that testing conducted 20 min after encoding, but not immediately or 40 min after encoding, enhanced memory retention. In Experiment 2, feedback was provided to ensure more equitable exposure across the conditions, and then the final memory test was conducted 24 h after the end of learning. The result showed that testing enhanced memory retention across the three delay conditions, and that the size of the testing effect increased with the extension of the interval between initial learning and retrieval practice, thus providing support for the retrieval theory.

Effects of retrieval practice and presentation modality on verbal learning: testing the limits of the testing effect

The testing effect refers to improved memory after retrieval practice and has been researched primarily with visual stimuli. In two experiments, we investigated whether the testing effect can be replicated when the to-be-learned information is presented auditorily, or visually + auditorily. Participants learned Swahili-English word pairs in one of three presentation modalities - visual, auditory, or visual + auditory. This was manipulated between-participants in Experiment 1 and within-participants in Experiment2. All participants studied the word pairs during three study trials. Half of participants practiced recalling the English translations in response to the Swahili cue word twice before the final test whereas the other half simply studied the word pairs twice more. Results indicated an improvement in final test performance in the repeated test condition, but only in the visual presentation modality (Experiments 1 and 2) and in the visual + auditory presentation modality (Experiment 2). This suggests that the benefits of practiced retrieval may be limited to information presented in a visual modality.

A dual memory theory of the testing effect

A new theoretical framework for the testing effect-the finding that retrieval practice is usually more effective for learning than are other strategies-is proposed, the empirically supported tenet of which is that separate memories form as a consequence of study and test events. A simplest case quantitative model is derived from that framework for the case of cued recall. With no free parameters, that model predicts both proportion correct in the test condition and the magnitude of the testing effect across 10 experiments conducted in our laboratory, experiments that varied with respect to material type, retention interval, and performance in the restudy condition. The model also provides the first quantitative accounts of (a) the testing effect as a function of performance in the restudy condition, (b) the upper bound magnitude of the testing effect, (c) the effect of correct answer feedback, (d) the testing effect as a function of retention interval for the cases of feedback and no feedback, and (e) the effect of prior learning method on subsequent learning through testing. Candidate accounts of several other core phenomena in the literature, including test-potentiated learning, recognition versus cued recall training effects, cued versus free recall final test effects, and other select transfer effects, are also proposed. Future prospects and relations to other theories are discussed.

The Direct Testing Effect Is Pervasive in Action Memory: Analyses of Recall Accuracy and Recall Speed

Successful retrieval from memory is a desirably difficult learning event that reduces the recall decrement of studied materials over longer delays more than restudying does. The present study was the first to test this direct testing effect for performed and read action events (e.g., "light a candle") in terms of both recall accuracy and recall speed. To this end, subjects initially encoded action phrases by either enacting them or reading them aloud (i.e., encoding type). After this initial study phase, they received two practice phases, in which the same number of action phrases were restudied or retrieval-practiced (Exp. 1-3), or not further processed (Exp. 3; i.e., practice type). This learning session was ensued by a final cued-recall test both after a short delay (2 min) and after a long delay (1 week: Exp. 1 and 2; 2 weeks: Exp. 3). To test the generality of the results, subjects retrieval practiced with either noun-cued recall of verbs (Exp. 1 and 3) or verb-cued recall of nouns (Exp. 2) during the intermediate and final tests (i.e., test type). We demonstrated direct benefits of testing on both recall accuracy and recall speed. Repeated retrieval practice, relative to repeated restudy and study-only practice, reduced the recall decrement over the long delay, and enhanced phrases' recall speed already after 2 min, and this independently of type of encoding and recall test. However, a benefit of testing on long-term retention only emerged (Exp. 3), when prolonging the recall delay from 1 to 2 weeks, and using different sets of phrases for the immediate and delayed final tests. Thus, the direct testing benefit appears to be highly generalizable even with more complex, action-oriented stimulus materials, and encoding manipulations. We discuss these results in terms of the distribution-based bifurcation model.

Improving Dental Students' Long-Term Retention of Pharmacy Knowledge with "Medication Minutes"

A major challenge in foundational science courses in dental curricula is the application of information from the classroom to a clinical setting. To bridge this gap, the aim of this study was to increase students' learning in a foundational pharmacology course through increasing clinical relevance and using formative assessment. Second-year dental students in an introductory pharmacology course were presented material in a traditional basic science lecture format and in brief examples of pharmacy-generated clinical content (Medication Minutes). Short-term retention was assessed with a series of five post-class session, non-graded quizzes, each containing four questions: two knowledge-based (one from basic science material and one Medication Minute) and two application-based (one from basic science material and one Medication Minute). Ten knowledge-based (basic science material) questions and ten application-based (Medication Minutes) questions were included on exams throughout the semester. The primary outcome was to measure long-term retention using performance on these questions on an assessment the following semester. Additionally, the impact of student engagement on examination performance was evaluated based on the number of quizzes each student completed. Students who completed three or more quizzes (n=43, 53%) were designated as "highly engaged," while students who completed less than three quizzes (n=36, 44%) were defined as "less engaged." Two students (3%) were excluded for not completing the long-term assessment or not consenting to the study. On short-term retention measures, the students performed better on the Medication Minute (M=0.76) than basic science (M=0.58) (p<0.001) material; however, on the in-semester examinations, there was no difference in performance. On long-term retention measures, the students performed better on Medication Minute material (M=0.64) than basic science material (M=0.33) (p<0.001); this was true for both highly engaged and less-engaged students. These results suggest that teaching pharmacology in a clinical context yielded better long-term retention than teaching with a non-clinical focus.

Assessing Boundary Conditions of the Testing Effect: On the Relative Efficacy of Covert vs. Overt Retrieval

Repeated testing during learning often improves later memory, which is often referred to as the testing effect. To clarify its boundary conditions, we examined whether the testing effect was selectively affected by covert (retrieved but not articulated) or overt (retrieved and articulated) response format. In Experiments 1 and 2, we compared immediate (5 min) and delayed (1 week) cued recall for paired associates following study-only, covert, and overt conditions, including two types of overt articulation (typing and writing). A clear testing effect was observed in both experiments, but with no selective effects of response format. In Experiments 3 and 4, we compared covert and overt retrieval under blocked and random list orders. The effect sizes were small in both experiments, but there was a significant effect of response format, with overt retrieval showing better final recall performance than covert retrieval. There were no significant effects of blocked vs. random list orders with respect to the testing effect produced. Taken together, these findings suggest that, under specific circumstances, overt retrieval may lead to a greater testing effect than that of covert retrieval, but because of small effect sizes, it appears that the testing effect is mainly the result of retrieval processes and that articulation has fairly little to add to its magnitude in a paired-associates learning paradigm.

Rethinking the Use of Tests: A Meta-Analysis of Practice Testing

The testing effect is a well-known concept referring to gains in learning and retention that can occur when students take a practice test on studied material before taking a final test on the same material. Research demonstrates that students who take practice tests often outperform students in nontesting learning conditions such as restudying, practice, filler activities, or no presentation of the material. However, evidence-based meta-analysis is needed to develop a comprehensive understanding of the conditions under which practice tests enhance or inhibit learning. This meta-analysis fills this gap by examining the effects of practice tests versus nontesting learning conditions. Results reveal that practice tests are more beneficial for learning than restudying and all other comparison conditions. Mean effect sizes were moderated by the features of practice tests, participant and study characteristics, outcome constructs, and methodological features of the studies. Findings may guide the use of practice tests to advance student learning, and inform students, teachers, researchers, and policymakers. This article concludes with the theoretical and practical implications of the meta-analysis.

Test-potentiated learning of motor sequences

We investigated effects of retrieving body movements from memory on subsequent re-encoding of these movements (i.e., test-potentiated learning). In Experiment 1, participants first learned to perform 12 sequential finger movements as responses to letter stimuli. Eight of these movements then had to be recalled in response to their stimuli (initial test). Subsequently, learning trials were repeated for four of the previously to-be-retrieved movements as well as the previously not-to-be-retrieved movements. Restudy benefited from prior retrieval. In a final test, again requiring motoric recall in response to letter stimuli, performance was better for restudied items that were previously cued for retrieval as compared to items that had been restudied without prior retrieval. However, no such indirect testing benefit occurred when initial and final testing formats were incongruent, that is, when participants had to recall the stimuli in response to movements as cues at the final test. In Experiment 2, we replicated the finding of test-potentiated learning with a different design, manipulating initial-testing status between participants.