Identifying the psychological mechanisms of utility-value activities to inform educational research and practice

BACKGROUND

Utility-value interventions have been shown to promote students' achievement and motivation in mathematics through encouraging them to identify connections between course content and their real lives. To extend the benefits of these interventions, additional research is necessary to test their efficacy in diverse high school contexts, as well as investigate the psychological mechanisms through which they benefit students.

AIMS

To inform efforts within broader learning contexts to develop activities and messages based on utility-value interventions that effectively target the psychological mechanisms that support student learning.

SAMPLES

Study 1 (N = 375) and Study 2 (N = 2894) include racially and socioeconomically diverse samples of students enrolled in mathematics courses across four high schools in the United States.

METHODS

We conducted two randomized field experiments to test the effects of brief utility-value activities on students' motivation. Using multi-level path analyses, we then investigated the mechanisms through which utility-value activities bolster students' interest and achievement in mathematics.

RESULTS

In pre-registered analyses, we found that the utility-value activities promoted students' perceived value of mathematics, as well as their novel engagement and sense of social identity congruence with mathematics. In turn, these outcomes mediated the indirect effects of the activities on students' grades and interest in mathematics.

CONCLUSIONS

Our results underscore the potential of utility-value activities to promote students' success. Based on our mediation findings, we also provide a roadmap for how learning contexts can develop activities and messages that effectively target key processes to advance student success.

Race, academic achievement and the issue of inequitable motivational payoff

As racial inequities continue to pervade school systems around the world, further research is necessary to understand the factors undergirding this pressing issue. Here across three studies conducted in the United States (N = 8,293), we provide evidence that race-based differences in student achievement do not stem from a lack of motivation among Black, Latinx and Indigenous (BLI) students, but a lack of equitable motivational payoff. Even when BLI and non-BLI students have the same levels of motivation, BLI students still receive maths grades that are an average of 9% lower than those of their non-BLI peers (95% confidence interval 7 to 11%). This pattern was not explained by differences in students' aptitude, effort or prior achievement but was instead linked to teachers' diminished expectations for their BLI students' academic futures. We conclude by discussing statistical power limitations and the implications of the current findings for how researchers consider the sources of, and solutions for, educational inequity.

Inside the STEM pipeline: Changes in students' biomedical career plans across the college years

Researchers often invoke the metaphor of a pipeline when studying participation in careers in science, technology, engineering, and mathematics (STEM), focusing on the important issue of students who "leak" from the pipeline, but largely ignoring students who persist in STEM. Using interview, survey, and institutional data over 6 years, we examined the experiences of 921 students who persisted in biomedical fields through college graduation and planned to pursue biomedical careers. Despite remaining in the biomedical pipeline, almost half of these students changed their career plans, which was almost twice the number of students who abandoned biomedical career paths altogether. Women changed plans more often and were more likely than men to change to a career requiring fewer years of post-graduate education. Results highlight the importance of studying within-pipeline patterns rather than focusing only on why students leave STEM fields.

Choose Your Own Intervention: Using Choice to Enhance the Effectiveness of a Utility-Value Intervention

Utility-value interventions, in which students are asked to make connections between course material and their lives, are useful for improving students' academic outcomes in science courses. These interventions are thought to be successful in part because the intervention activities afford students autonomy while they complete them, but no research has explored directly whether interventions that include more support for autonomy are more effective. In this study, the degree of choice incorporated in a utility-value intervention was systematically varied in order to test this possibility. We assigned college biology students (n = 406) to a high-choice utility-value intervention condition (choose between two formats- essay or letter- for each of 3 writing assignments), one of two low-choice intervention conditions (complete either an essay and then a letter, or vice versa, and choose a format for the third assignment), or a control condition (summarize course material 3 times). Students in the high-choice condition reported significantly higher perceived utility value and interest for biology course content compared to students in the low-choice conditions. There were also significant, but small, indirect effects of choice on students' final course grades and enrollment in the next course in the biology sequence via perceived utility value and interest. Results suggest that social-psychological interventions which include more choice are likely to be more effective than those which include less choice.

College Students' Reasons for Leaving Biomedical Fields: Disenchantment with Biomedicine or Attraction to Other Fields?

This study examined whether students who left biomedical fields of study during college did so primarily because they became disenchanted with those fields or because they felt attracted to alternative fields of study. We identified 1193 students intending to pursue biomedical fields of study early in college, collected data about their beliefs and performance throughout college, and interviewed them near graduation about their future plans. Descriptively, we examined the topics students discussed as affecting their attrition decisions. Predictive research aims were to determine how academic performance, interest, and demographic factors predicted students' likelihood of overall attrition and likelihood of reporting distinct reasons for attrition. Among the 192 students who left biomedical fields, 62.5% described leaving only in terms of feeling disenchanted, whereas 37.4% expressed that they left at least in part due to feeling attracted towards non-biomedical fields. Most students who left biomedical fields expressed changing plans for reasons related to interest; this was especially prevalent among students who reported leaving due to attraction towards non-biomedical fields. Predictive analyses showed that interest in biology and grades at the end of an introductory biology course predicted the likelihood of overall attrition and likelihood of leaving due to feeling disenchantment, whereas underrepresented ethnic minority status predicted these outcomes positively. Interest and course grades also predicted the likelihood of students leaving due to feeling attraction towards other fields, but interest was a stronger predictor relative to grades. Results highlight distinct types of attrition that may have implications for policies to promote STEM retention.

Promoting Persistence in the Biological and Medical Sciences: An Expectancy-Value Approach to Intervention

A wide range of occupations require science, technology, engineering, and mathematics (STEM) skills, yet almost half of students who intend to pursue a post-secondary STEM education abandon these plans before graduating from college. This attrition is especially pronounced among underrepresented groups (i.e., racial/ethnic minorities and first-generation college students). We conducted a two-year follow-up of a utility-value intervention that had been implemented in an introductory biology course. This intervention was previously shown to improve performance in the course, on average and especially among underrepresented students, reducing the achievement gap. The goal of the present study was to examine whether the intervention also impacted persistence in the biomedical track throughout college. The intervention had a more positive impact on long-term persistence for students who were more confident that they could succeed at the beginning of the course, and this effect was partially driven by the extent to which students reflected on the personal relevance of biological topics in their essays. This mechanism was distinct from the process that had been found to underlie intervention effects on performance - engagement with course material - suggesting that utility-value interventions may affect different academic outcomes by initiating distinct psychological processes. Although we did not find that the intervention was differentially effective for underrepresented students in terms of persistence, we found that positive effects on performance were associated with increased persistence for these students. Results suggest that utility-value interventions in an introductory course can be an effective strategy to promote persistence in the biomedical sciences throughout college.

The Benefits of Combining Value for the Self and Others in Utility-Value Interventions

Utility-value interventions, in which students complete writing assignments about the personal usefulness of course material, show great promise for promoting interest and performance in introductory college science courses, as well as persistence in STEM fields. As researchers move toward scaling up this intervention, it's important to understand which features are key to its effectiveness. For example, prior studies have used different types of utility-value assignments (i.e., self-focused essays and other-focused letters) and different assignment structures (i.e., over time, researchers provided a variety of tasks or choices between tasks), without comparing them. It is not known whether these assignment features are incidental details or key aspects of the intervention that impact its effectiveness. In the current study, we systematically compared different utility-value assignments, as well as ways of combining them, in a randomized controlled trial in an introductory college biology course (N = 590). Specifically, we compared different versions of the intervention in terms of their relative effectiveness for promoting course performance and the motivational mechanisms through which they operated. The intervention was most effective when students had opportunities to write about utility for both the self and others. Grades were higher in conditions in which students were either assigned a variety of self-focused and other-focused assignments or given the choice between the two. Among students with low performance expectations, grades were higher when students were assigned a specific combination: a self-focused assignment followed by other-focused assignments. Results suggest that different versions of the intervention may work through different mechanisms.

The longitudinal effects of STEM identity and gender on flourishing and achievement in college physics

BACKGROUND

Drawing on social identity theory and positive psychology, this study investigated women's responses to the social environment of physics classrooms. It also investigated STEM identity and gender disparities on academic achievement and flourishing in an undergraduate introductory physics course for STEM majors. One hundred sixty undergraduate students enrolled in an introductory physics course were administered a baseline survey with self-report measures on course belonging, physics identification, flourishing, and demographics at the beginning of the course and a post-survey at the end of the academic term. Students also completed force concept inventories, and physics course grades were obtained from the registrar.

RESULTS

Women reported less course belonging and less physics identification than men. Physics identification and grades evidenced a longitudinal bidirectional relationship for all students (regardless of gender) such that when controlling for baseline physics knowledge: (a) students with higher physics identification were more likely to earn higher grades; and (b) students with higher grades evidenced more physics identification at the end of the term. Men scored higher on the force concept inventory than women; although no gender disparities emerged for course grades. For women, higher physics (versus lower) identification was associated with more positive changes in flourishing over the course of the term. High-identifying men showed the opposite pattern: negative change in flourishing was more strongly associated with high identifiers than low identifiers.

CONCLUSIONS

Overall, this study underlines gender disparities in physics both in terms of belonging and physics knowledge. It suggests that strong STEM identity may be associated with academic performance and flourishing in undergraduate physics courses at the end of the term, particularly for women. A number of avenues for future research are discussed.

Improving Performance and Retention in Introductory Biology with a Utility-Value Intervention

One way to encourage performance and persistence in STEM fields is to have students write about the utility value (UV) or personal relevance of course topics to their life. This intervention has been shown to increase engagement and performance in introductory courses. However, questions remain about the longevity of the effects and how best to implement the intervention in terms of dosage and timing. We tested a UV intervention in the first semester of a two-semester introductory biology sequence. For each of three units across the semester, students (N = 577) were randomly assigned to receive either a UV writing assignment, in which they explained why course material was useful to them personally, or a control assignment, in which they summarized course material. This fully crossed design tested the effect of UV dosage level (0, 1, 2, or 3 UV assignments) as well as the effect of timing (e.g., UV first, control first). We found that students exposed to any dosage of UV earned higher grades in the course, were more likely to enroll in the second course of the biology sequence, and were less likely to abandon their STEM major than students who did not receive any UV assignments. In terms of timing, students with a history of poor performance benefitted from writing a UV essay in the beginning of the semester, whereas higher-performing students benefitted from a UV essay at the end of the semester. Recommendations for practice are discussed.

Different Institutions and Different Values: Exploring First-Generation Student Fit at 2-Year Colleges

First-generation (FG) college students (students for whom neither parent has a 4-year degree) face a number of challenges as they attempt to obtain a post-secondary degree. They are more likely to come from working-class backgrounds or poverty (Reardon, 2011) and attend lower quality high schools (Warburton et al., 2001) while not benefiting from the guidance of a parent who successfully navigated the path to higher education. FG college students also contend with belonging or “fitting in” concerns due a perceived mismatch between their own values and the values implicit in institutions of higher education (Stephens et al., 2012a). Specifically, prior research has demonstrated that FG college students face an unseen disadvantage that can be attributed to the fact that middle-class norms of independence reflected in American institutions of higher education can be experienced as threatening by many FG students who have been socialized with more interdependent values commonly espoused in working-class populations. The present research examines this theory (cultural mismatch theory) in the understudied context of 2-year colleges and tests if a values-affirmation intervention (i.e., an intervention that has shown promise in addressing identity threats and belonging concerns) can be effective for FG college students at these 2-year campuses. By considering the tenets of cultural mismatch theory in the creation of the values-affirmation interventions we were able to vary different aspects of the intervention in order to examine how its effectiveness may depend on the nature and magnitude of a perceived cultural mismatch. Results from surveying faculty and students at 2-year colleges indicated that compared to traditional 4-year institutions, the norms of 2-year colleges and the motivations of FG students may be different. That is, FG student motives may be more consistent (and thus less mismatched) with the cultural context of 2-year colleges which could result in fewer belonging concerns when compared to FG students at 4-year institutions. This may carry implications for the efficacy of values-affirmation interventions and could help explicate why FG students in the current sample perceived a greater match with their college when they reflected on their interdependent values.

Broadening Participation in the Life Sciences with Social-Psychological Interventions

Randomized controlled trials (RCTs) have recently documented the positive effects of social-psychological interventions on the performance and retention of underrepresented students in the life sciences. We review two types of social-psychological interventions that address either students' well-being in college science courses or students' engagement in science content. Interventions that have proven effective in RCTs in science courses (namely, utility-value [UV] and values-affirmation [VA] interventions) emphasize different types of student values-students' perceptions of the value of curricular content and students' personal values that shape their educational experiences. Both types of value can be leveraged to promote positive academic outcomes for underrepresented students. For example, recent work shows that brief writing interventions embedded in the curriculum can increase students' perceptions of UV (the perceived importance or usefulness of a task for future goals) and dramatically improve the performance of first-generation (FG) underrepresented minority students in college biology. Other work has emphasized students' personal values in brief essays written early in the semester. This VA intervention has been shown to close achievement gaps for women in physics classes and for FG students in college biology. By reviewing recent research, considering which interventions are most effective for different groups, and examining the causal mechanisms driving these positive effects, we hope to inform life sciences educators about the potential of social-psychological interventions for broadening participation in the life sciences.

Closing achievement gaps with a utility-value intervention: Disentangling race and social class

Many college students abandon their goal of completing a degree in science, technology, engineering, or math (STEM) when confronted with challenging introductory-level science courses. In the U.S., this trend is more pronounced for underrepresented minority (URM) and first-generation (FG) students, and contributes to persisting racial and social-class achievement gaps in higher education. Previous intervention studies have focused exclusively on race or social class, but have not examined how the 2 may be confounded and interact. This research therefore investigates the independent and interactive effects of race and social class as moderators of an intervention designed to promote performance, measured by grade in the course. In a double-blind randomized experiment conducted over 4 semesters of an introductory biology course (N = 1,040), we tested the effectiveness of a utility-value intervention in which students wrote about the personal relevance of course material. The utility-value intervention was successful in reducing the achievement gap for FG-URM students by 61%: the performance gap for FG-URM students, relative to continuing generation (CG)-Majority students, was large in the control condition, .84 grade points (d = .98), and the treatment effect for FG-URM students was .51 grade points (d = 0.55). The UV intervention helped students from all groups find utility value in the course content, and mediation analyses showed that the process of writing about utility value was particularly powerful for FG-URM students. Results highlight the importance of intersectionality in examining the independent and interactive effects of race and social class when evaluating interventions to close achievement gaps and the mechanisms through which they may operate. (PsycINFO Database Record

Affirming independence: Exploring mechanisms underlying a values affirmation intervention for first-generation students

First-generation college students (students for whom neither parent has a 4-year college degree) earn lower grades and worry more about whether they belong in college, compared with continuing-generation students (who have at least 1 parent with a 4-year college degree). We conducted a longitudinal follow-up of participants from a study in which a values-affirmation intervention improved performance in a biology course for first-generation college students, and found that the treatment effect on grades persisted 3 years later. First-generation students in the treatment condition obtained a GPA that was, on average, .18 points higher than first-generation students in the control condition, 3 years after values affirmation was implemented (Study 1A). We explored mechanisms by testing whether the values-affirmation effects were predicated on first-generation students reflecting on interdependent values (thus affirming their values that are consistent with working-class culture) or independent values (thus affirming their values that are consistent with the culture of higher education). We found that when first-generation students wrote about their independence, they obtained higher grades (both in the semester in which values affirmation was implemented and in subsequent semesters) and felt less concerned about their background. In a separate laboratory experiment (Study 2) we manipulated the extent to which participants wrote about independence and found that encouraging first-generation students to write more about their independence improved their performance on a math test. These studies highlight the potential of having FG students focus on their own independence. (PsycINFO Database Record

Closing the Social Class Achievement Gap for First-Generation Students in Undergraduate Biology

Many students start college intending to pursue a career in the biosciences, but too many abandon this goal because they struggle in introductory biology. Interventions have been developed to close achievement gaps for underrepresented minority students and women, but no prior research has attempted to close the gap for first-generation students, a population that accounts for nearly a fifth of college students. We report a values affirmation intervention conducted with 798 U.S. students (154 first-generation) in an introductory biology course for majors. For first-generation students, values affirmation significantly improved final course grades and retention in the second course in the biology sequence, as well as overall GPA for the semester. This brief intervention narrowed the achievement gap between first-generation and continuing generation students for course grades by 50% and increased retention in a critical gateway course by 20%. Our results suggest that educators can expand the pipeline for first-generation students to continue studying in the biosciences with psychological interventions.

HARNESSING VALUES TO PROMOTE MOTIVATION IN EDUCATION

PURPOSE

We review the interventions that promote motivation in academic contexts, with a focus on two primary questions: How can we motivate students to take more STEM courses? Once in those STEM courses, how can we keep students motivated and promote their academic achievement?

DESIGN/METHODOLOGY/APPROACH

We have approached these two motivational questions from several perspectives, examining the theoretical issues with basic laboratory research, conducting longitudinal questionnaire studies in classrooms, and developing interventions implemented in different STEM contexts. Our research is grounded in three theories that we believe are complementary: expectancy-value theory (Eccles & Wigfield, 2002), interest theory (Hidi & Renninger, 2006), and self-affirmation theory (Steele, 1988). As social psychologists, we have focused on motivational theory and used experimental methods, with an emphasis on values - students' perceptions of the value of academic tasks and students' personal values that shape their experiences in academic contexts.

FINDINGS

We review the experimental field studies in high-school science and college psychology classes, in which utility-value interventions promoted interest and performance for high-school students in science classes and for undergraduate students in psychology courses. We also review a randomized intervention in which parents received information about the utility value of math and science for their teens in high school; this intervention led students to take nearly one semester more of science and mathematics, compared with the control group. Finally, we review an experimental study of values affirmation in a college biology course and found that the intervention improved performance and retention for first-generation college students, closing the social-class achievement gap by 50%. We conclude by discussing the mechanisms through which these interventions work.

ORIGINALITY/VALUE

These interventions are exciting for their broad applicability in improving students' academic choices and performance, they are also exciting regarding their potential for contributions to basic science. The combination of laboratory experiments and field experiments is advancing our understanding of the motivational principles and almost certainly will continue to do so. At the same time, interventions may benefit from becoming increasingly targeted at specific motivational processes that are effective with particular groups or in particular contexts.