Cues Matter: Learning Assistants Influence Introductory Biology Student Interactions during Clicker-Question Discussions

Here Is the Biology, Now What is the Mechanism? Investigating Biology Undergraduates' Mechanistic Reasoning within the Context of Biofilm Development

Understanding molecular processes and coordinating the various activities across levels of organization in biological systems is a complicated task, yet many curricular guidelines indicate that undergraduate students should master it. Employing mechanistic reasoning can facilitate describing and investigating biological phenomena. Biofilms are an important system in microbiology and biology education. However, few empirical studies have been conducted on student learning of biofilms or how students utilize mechanistic reasoning related to systems thinking to explain biofilm formation. Using mechanistic reasoning and the theory of knowledge integration as conceptual and analytical frameworks, we examined the features of 9 undergraduate biology students' mechanistic models of a specific transition point in biofilm development. From these data, we constructed a model of knowledge integration in the context of biofilms, which categorizes students' knowledge based on features of their descriptions (e.g., entities, correct connections, and the nature of connections). We found that 4 of 9 students produced a fragmented model, 4 of 9 students produced a transitional model, and 1 student produced a connected model. Overall, students often did not discuss cell-cell communication mechanics in their mechanistic models and rarely included the role of gene regulation. Most connections were considered nonnormative and lacked important entities, leading to an abundance of unspecified causal connections. We recommend increasing instructional support of mechanistic reasoning within systems (e.g., identifying entities across levels of organization and their relevant activities) and creating opportunities for students to grapple with their understanding of various biological concepts and to explore how processes interact and connect in a complex system.

"Oh, that makes sense": Social Metacognition in Small-Group Problem Solving

Stronger metacognition, or awareness and regulation of thinking, is related to higher academic achievement. Most metacognition research has focused at the level of the individual learner. However, a few studies have shown that students working in small groups can stimulate metacognition in one another, leading to improved learning. Given the increased adoption of interactive group work in life science classrooms, there is a need to study the role of social metacognition, or the awareness and regulation of the thinking of others, in this context. Guided by the frameworks of social metacognition and evidence-based reasoning, we asked: 1) What metacognitive utterances (words, phrases, statements, or questions) do students use during small-group problem solving in an upper-division biology course? 2) Which metacognitive utterances are associated with small groups sharing higher-quality reasoning in an upper-division biology classroom? We used discourse analysis to examine transcripts from two groups of three students during breakout sessions. By coding for metacognition, we identified seven types of metacognitive utterances. By coding for reasoning, we uncovered four categories of metacognitive utterances associated with higher-quality reasoning. We offer suggestions for life science educators interested in promoting social metacognition during small-group problem solving.

Institutionalizing evidence-based STEM reform through faculty professional development and support structures

BACKGROUND

Even though student-centered instruction leads to positive student outcomes, direct instruction methods are still prevalent. Multiple barriers prevent faculty from further adopting evidence-based student-centered practices and holistic approaches to faculty support are necessary to promote faculty change. The Collaborative for Institutionalizing Scientific Learning (CISL) is an HHMI-funded program to reform undergraduate science and mathematics education at a large Hispanic-Serving public research university. The program has established a Faculty Scholar support model to impact the number of science and mathematics faculty using evidence-based practices in their classrooms. Through this program, Scholars are selected to undertake a transformation of a course of their choice and conduct an assessment of the impact of the reform on students-while receiving multiple supports including summer salary, undergraduate Learning Assistants, professional development, course assessment and education research support, and opportunities to develop manuscripts on their course transformations.

RESULTS

CISL has supported over 40 Faculty Scholars in the transformation of both introductory and upper division biology, chemistry, physics and mathematics courses. Faculty are motivated to transform a course due to factors related to their own experiences and beliefs, their students' needs, the course structure, and/or departmental elements. Quantitative analysis of the impact of the project on student success show that, overall, students in CISL-supported courses have higher passing rates compared to students in traditional classrooms. Survey and interviews of Faculty Scholars identified that the most valuable elements of the program were the personnel support from undergraduate Learning Assistants during reform implementation and guidance from the program's Assistant Director during design, implementation and evaluation.

CONCLUSIONS

The CISL program provides an example of significant effort sustained over several years to systematically improve the quality and culture of undergraduate education in a large research-intensive Hispanic Serving Institution. The program has had an overall positive impact on the professional development of Faculty Scholars and led to an increase in the number of STEM courses implementing evidence-based teaching practices, thus, taking a step towards solidifying a culture of evidence-based instructional strategies in STEM departments.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1186/s40594-022-00353-z.

Successful Problem Solving in Genetics Varies Based on Question Content

Problem solving is a critical skill in many disciplines but is often a challenge for students to learn. To examine the processes both students and experts undertake to solve constructed-response problems in genetics, we collected the written step-by-step procedures individuals used to solve problems in four different content areas. We developed a set of codes to describe each cognitive and metacognitive process and then used these codes to describe more than 1800 student and 149 expert answers. We found that students used some processes differently depending on the content of the question, but reasoning was consistently predictive of successful problem solving across all content areas. We also confirmed previous findings that the metacognitive processes of planning and checking were more common in expert answers than student answers. We provide suggestions for instructors on how to highlight key procedures based on each specific genetics content area that can help students learn the skill of problem solving.

Meta-analysis of Gender Performance Gaps in Undergraduate Natural Science Courses

To investigate patterns of gender-based performance gaps, we conducted a meta-analysis of published studies and unpublished data collected across 169 undergraduate biology and chemistry courses. While we did not detect an overall gender gap in performance, heterogeneity analyses suggested further analysis was warranted, so we investigated whether attributes of the learning environment impacted performance disparities on the basis of gender. Several factors moderated performance differences, including class size, assessment type, and pedagogy. Specifically, we found evidence that larger classes, reliance on exams, and undisrupted, traditional lecture were associated with lower grades for women. We discuss our results in the context of natural science courses and conclude by making recommendations for instructional practices and future research to promote gender equity.

Student Behaviors and Interactions Influence Group Discussions in an Introductory Biology Lab Setting

Past research on group work has primarily focused on promoting change through implementation of interventions designed to increase performance. Recently, however, education researchers have called for more descriptive analyses of group interactions. Through detailed qualitative analysis of recorded discussions, we studied the natural interactions of students during group work in the context of a biology laboratory course. We analyzed multiple interactions of 30 different groups as well as data from each of the 91 individual participants to characterize the ways students engage in discussion and how group dynamics promote or prevent meaningful discussion. Using a set of codes describing 15 unique behaviors, we determined that the most common behavior seen in student dialogue was analyzing data, followed by recalling information and repeating ideas. We also classified students into one of 10 different roles for each discussion, determined by their most common behaviors. We found that, although students cooperated with one another by exchanging information, they less frequently fully collaborated to explain their conclusions through the exchange of reasoning. Within this context, these findings show that students working in groups generally choose specific roles during discussions and focus on data analysis rather than constructing logical reasoning chains to explain their conclusions.

Using Students' Concept-building Tendencies to Better Characterize Average-Performing Student Learning and Problem-Solving Approaches in General Chemistry

We previously reported that students' concept-building approaches, identified a priori using a cognitive psychology laboratory task, extend to learning complex science, technology, engineering, and mathematics topics. This prior study examined student performance in both general and organic chemistry at a select research institution, after accounting for preparation. We found that abstraction learners (defined cognitively as learning the theory underlying related examples) performed higher on course exams than exemplar learners (defined cognitively as learning by memorizing examples). In the present paper, we further examined this initial finding by studying a general chemistry course using a different pedagogical approach (process-oriented guided-inquiry learning) at an institution focused on health science majors, and then extended our studies via think-aloud interviews to probe the effect concept-building approaches have on problem-solving behaviors of average exam performance students. From interviews with students in the average-achieving group, using problems at three transfer levels, we found that: 1) abstraction learners outperformed exemplar learners at all problem levels; 2) abstraction learners relied on understanding and exemplar learners dominantly relied on an algorithm without understanding at all problem levels; and 3) both concept-building-approach students had weaknesses in their metacognitive monitoring accuracy skills, specifically their postperformance confidence level in their solution accuracy.

Undergraduate teaching assistants can provide support for reformed practices to raise student learning

Graduate students who serve as teaching assistants are a critical part of STEM (science, technology, engineering, mathematics) education and research at large universities in the U.S. Yet just like faculty, graduate students are not immune to the publish or perish paradigm, which can compete with one's dedication to teaching. While in recent years many STEM faculty members have become aware of how well undergraduates can assist instructors in their teaching, many, if not most, university faculty still teach in traditional settings, where graduate students are the norm and use of undergraduates is a completely unexploited opportunity. Undergraduates can serve as effective teaching assistants and may bring unique skills and experience to undergraduate instruction not held by graduate students. Undergraduate teaching assistants (UTAs) can provide additional support for reformed practices, which raise student learning. Based on cost, prior experience and success as students in same course, and shared vision with professors, a number of institutions have initiated UTA programs and reported increased student learning. The audience of this paper is faculty who are not familiar with the use of UTAs in university teaching, and the purpose is to review the literature on UTAs, contrast the contributions of UTAs and graduate teaching assistants, and examine the potential value of UTAs in undergraduate education.

Peer Leader Reflections on Promoting Discussion in Peer Group-Learning Sessions: Reflective and Practiced Advice through Collaborative Annual Peer-Advice Books

As research has shown, collaborative peer learning is effective for improving student learning. Peer-led team learning (PLTL) is one well-known collaborative-group approach in which groups are facilitated by trained undergraduate peer leaders. This paper contributes to the literature on peer-leader training by examining how peer leaders for a large introductory science course translate their training into practice during their sessions. By conducting qualitative analysis on annual advice books written by emergent peer leaders, we examined the practiced advice and strategies of these peer leaders as they facilitate PLTL groups in a university-level general chemistry course. These advice books are passed on to future peer instructors, creating a community of practice between new and more experienced peer leaders. From the analysis, we discovered that peer leaders focus on developing robust student-student discussion during complex problem solving by 1) creating a community-oriented social and intellectual environment, 2) adapting their tactics and the collaborative-learning strategies to balance different personalities and promote equal participation among all students, and 3) modifying collaborative group approaches when facilitating their sessions. Also, in their correspondence across cohorts, peer leaders provided near-peer support to one another. These annual books disseminate practiced advice between peer-leader generations and are used during new peer-leader training.

Improving Academic Performance, Belonging, and Retention through Increasing Structure of an Introductory Biology Course

Integration of active-learning approaches into increased-structure postsecondary classrooms significantly improves student academic outcomes. We describe here two parallel sections of Introductory Biology that shared learning objectives and content but varied in course structure. The large-enrollment traditional course consisted of four 50-minute lectures coupled with minimal active-learning techniques, while an increased-structure intervention course integrated multiple active-learning approaches, had limited enrollment, and comprised three 50-minute lectures combined with a fourth peer-led team-learning discussion section. Additionally, the intervention course employed weekly review quizzes and multiple in-class formative assessments. The academic impact of these two course formats was evaluated by use of common exam questions, final grade, and student retention. We showed that academic achievement and retention of participants enrolled in the intervention course was significantly improved when compared with the traditional section. Further, we explored whether promoting in-class student-student/student-instructor interactions and peer-led discussion sections fostered a greater sense of belonging. At the end of the course, participants in the intervention course reported greater perceptions of classroom belonging. Therefore, this study begins to characterize the importance of combining pedagogical methods that promote both academic success and belonging to effectively improve retention in science, technology, engineering, and mathematics majors.

Contrasting Cases: Students' Experiences in an Active-Learning Biology Classroom

In this qualitative study, we examined the process of active learning from the perspective of undergraduate students in a high-enrollment introductory biology class. Eight students participated in a series of five interviews throughout the semester that examined their experiences during and after class. Grades were collected for each student at regular time points throughout the semester. Here, we present in-depth case studies of four students who described profoundly different responses to the same in-class learning tasks. We particularly highlight variation in students' self-reported engagement, as engagement is thought to be a key element of successful active learning. Finally, we map each student's self-reported engagement and the grades that he or she received. In each case, we found that grades failed to capture some aspects of the active-learning experience that students found important.

Small changes, big gains: A curriculum-wide study of teaching practices and student learning in undergraduate biology

A growing body of evidence has shown that active learning has a considerable advantage over traditional lecture for student learning in undergraduate STEM classes, but there have been few large-scale studies to identify the specific types of activities that have the greatest impact on learning. We therefore undertook a large-scale, curriculum-wide study to investigate the effects of time spent on a variety of classroom activities on learning gains. We quantified classroom practices and related these to student learning, assessed using diagnostic tests written by over 3700 students, across 31 undergraduate biology classes at a research-intensive university in the Pacific Northwest. The most significant positive predictor of learning gains was the use of group work, supporting the findings of previous studies. Strikingly, we found that the addition of worksheets as an active learning tool for in-class group activities had the strongest impact on diagnostic test scores. This particular low-tech activity promotes student collaboration, develops problem solving skills, and can be used to inform the instructor about what students are struggling with, thus providing opportunities for valuable and timely feedback. Overall, our results indicate that group activities with low barriers to entry, such as worksheets, can result in significant learning gains in undergraduate science.

Characterizing Students' Ideas about the Effects of a Mutation in a Noncoding Region of DNA

Understanding student ideas in large-enrollment biology courses can be challenging, because easy-to-administer multiple-choice questions frequently do not fully capture the diversity of student ideas. As part of the Automated Analysis of Constructed Responses (AACR) project, we designed a question prompting students to describe the possible effects of a mutation in a noncoding region of DNA. We characterized answers from 1127 students enrolled in eight different large-enrollment introductory biology courses at three different institutions over five semesters and generated an analytic scoring system containing three categories of correct ideas and five categories of incorrect ideas. We iteratively developed a computer model for scoring student answers and tested the model before and after implementing an instructional activity designed to help a new set of students explore this concept. After completing a targeted activity and re-answering the question, students showed improvement from preassessment, with 64% of students in incorrect and 67% of students in partially incorrect (mixed) categories shifting to correct ideas only. This question, computer-scoring model, and instructional activity can now be reliably used by other instructors to better understand and characterize student ideas on the effects of mutations outside a gene-coding region.

A Bridge to Active Learning: A Summer Bridge Program Helps Students Maximize Their Active-Learning Experiences and the Active-Learning Experiences of Others

National calls to improve student academic success in college have sparked the development of bridge programs designed to help students transition from high school to college. We designed a 2-week Summer Bridge program that taught introductory biology content in an active-learning way. Through a set of exploratory interviews, we unexpectedly identified that Bridge students had developed sophisticated views of active learning, even though this was not an explicit goal of the program. We conducted an additional set of semistructured interviews that focused on active learning and compared the interviews of Bridge students with those from non-Bridge students who had been eligible for but did not participate in the program. We used the constant comparative method to identify themes from the interviews. We found that Bridge students perceived that, because they knew how to approach active learning and viewed it as important, they benefited more from active learning in introductory biology than non-Bridge students. Specifically, Bridge students seemed to be more aware of their own learning gains from participating in active learning. Compared with the majority of non-Bridge students, the majority of Bridge students described using a greater variety of strategies to maximize their experiences in active learning. Finally, in contrast to non-Bridge students, Bridge students indicated that they take an equitable approach to group work. These findings suggest that we may be able to prime students to maximize their own and other's experiences in active learning.

Implementation of a Learning Assistant Program Improves Student Performance on Higher-Order Assessments

Learning assistant (LA) programs have been implemented at a range of institutions, usually as part of a comprehensive curricular transformation accompanied by a pedagogical switch to active learning. While this shift in pedagogy has led to increased student learning gains, the positive effect of LAs has not yet been distinguished from that of active learning. To determine the effect that LAs would have beyond a student-centered instructional modality that integrated active learning, we introduced an LA program into a large-enrollment introductory molecular biology course that had already undergone a pedagogical transformation to a highly structured, flipped (HSF) format. We used questions from a concept test (CT) and exams to compare student performance in LA-supported HSF courses with student performance in courses without LAs. Students in the LA-supported course did perform better on exam questions common to both HSF course modalities but not on the CT. In particular, LA-supported students' scores were higher on common exam questions requiring higher-order cognitive skills, which LAs were trained to foster. Additionally, underrepresented minority (URM) students particularly benefited from LA implementation. These findings suggest that LAs may provide additional learning benefits to students beyond the use of active learning, especially for URM students.

Characterizing College Science Assessments: The Three-Dimensional Learning Assessment Protocol

Many calls to improve science education in college and university settings have focused on improving instructor pedagogy. Meanwhile, science education at the K-12 level is undergoing significant changes as a result of the emphasis on scientific and engineering practices, crosscutting concepts, and disciplinary core ideas. This framework of “three-dimensional learning” is based on the literature about how people learn science and how we can help students put their knowledge to use. Recently, similar changes are underway in higher education by incorporating three-dimensional learning into college science courses. As these transformations move forward, it will become important to assess three-dimensional learning both to align assessments with the learning environment, and to assess the extent of the transformations. In this paper we introduce the Three-Dimensional Learning Assessment Protocol (3D-LAP), which is designed to characterize and support the development of assessment tasks in biology, chemistry, and physics that align with transformation efforts. We describe the development process used by our interdisciplinary team, discuss the validity and reliability of the protocol, and provide evidence that the protocol can distinguish between assessments that have the potential to elicit evidence of three-dimensional learning and those that do not.

Does the Room Matter? Active Learning in Traditional and Enhanced Lecture Spaces

SCALE-UP-type classrooms, originating with the Student-Centered Active Learning Environment with Upside-down Pedagogies project, are designed to facilitate active learning by maximizing opportunities for interactions between students and embedding technology in the classroom. Positive impacts when active learning replaces lecture are well documented, both in traditional lecture halls and SCALE-UP-type classrooms. However, few studies have carefully analyzed student outcomes when comparable active learning-based instruction takes place in a traditional lecture hall and a SCALE-UP-type classroom. Using a quasi-experimental design, we compared student perceptions and performance between sections of a nonmajors biology course, one taught in a traditional lecture hall and one taught in a SCALE-UP-type classroom. Instruction in both sections followed a flipped model that relied heavily on cooperative learning and was as identical as possible given the infrastructure differences between classrooms. Results showed that students in both sections thought that SCALE-UP infrastructure would enhance performance. However, measures of actual student performance showed no difference between the two sections. We conclude that, while SCALE-UP-type classrooms may facilitate implementation of active learning, it is the active learning and not the SCALE-UP infrastructure that enhances student performance. As a consequence, we suggest that institutions can modify existing classrooms to enhance student engagement without incorporating expensive technology.

A Campus-Wide Investigation of Clicker Implementation: The Status of Peer Discussion in STEM Classes

At the University of Maine, middle and high school teachers observed more than 250 university science, technology, engineering, and mathematics classes and collected information on the nature of instruction, including how clickers were being used. Comparisons of classes taught with (n = 80) and without (n = 184) clickers show that, while instructional behaviors differ, the use of clickers alone does not significantly impact the time instructors spend lecturing. One possible explanation stems from the observation of three distinct modes of clicker use: peer discussion, in which students had the opportunity to talk with one another during clicker questions; individual thinking, in which no peer discussion was observed; and alternative collaboration, in which students had time for discussion, but it was not paired with clicker questions. Investigation of these modes revealed differences in the range of behaviors, the amount of time instructors lecture, and how challenging the clicker questions were to answer. Because instructors can vary their instructional style from one clicker question to the next, we also explored differences in how individual instructors incorporated peer discussion during clicker questions. These findings provide new insights into the range of clicker implementation at a campus-wide level and how such findings can be used to inform targeted professional development for faculty.

The College Science Learning Cycle: An Instructional Model for Reformed Teaching

Finding the time for developing or locating new class materials is one of the biggest barriers for instructors reforming their teaching approaches. Even instructors who have taken part in training workshops may feel overwhelmed by the task of transforming passive lecture content to engaging learning activities. Learning cycles have been instrumental in helping K-12 science teachers design effective instruction for decades. This paper introduces the College Science Learning Cycle adapted from the popular Biological Sciences Curriculum Study 5E to help science, technology, engineering, and mathematics faculty develop course materials to support active, student-centered teaching approaches in their classrooms. The learning cycle is embedded in backward design, a learning outcomes-oriented instructional design approach, and is accompanied by resources and examples to help faculty transform their teaching in a time-efficient manner.

Active Learning Outside the Classroom: Implementation and Outcomes of Peer-Led Team-Learning Workshops in Introductory Biology

Study group meetings (SGMs) are voluntary-attendance peer-led team-learning workshops that supplement introductory biology lectures at a selective liberal arts college. While supporting all students' engagement with lecture material, specific aims are to improve the success of underrepresented minority (URM) students and those with weaker backgrounds in biology. Peer leaders with experience in biology courses and training in science pedagogy facilitate work on faculty-generated challenge problems. During the eight semesters assessed in this study, URM students and those with less preparation attended SGMs with equal or greater frequency than their counterparts. Most agreed that SGMs enhanced their comprehension of biology and ability to articulate solutions. The historical grade gap between URM and non-URM students narrowed slightly in Biology 2, but not in other biology and science, technology, engineering, and mathematics courses. Nonetheless, URM students taking introductory biology after program implementation have graduated with biology majors or minors at the same rates as non-URM students, and have enrolled in postcollege degree programs at equal or greater rates. These results suggest that improved performance as measured by science grade point average may not be necessary to improve the persistence of students from underrepresented groups as life sciences majors.

Group Random Call Can Positively Affect Student In-Class Clicker Discussions

Understanding how instructional techniques and classroom norms influence in-class student interactions has the potential to positively impact student learning. Many previous studies have shown that students benefit from discussing their ideas with one another in class. In this study of introductory biology students, we explored how using an in-class accountability system might affect the nature of clicker-question discussions. Clicker-question discussions in which student groups were asked to report their ideas voluntarily (volunteer call) were compared with discussions in which student groups were randomly selected to report their ideas (random call). We hypothesized that the higher-accountability condition (random call) would impress upon students the importance of their discussions and thus positively influence how they interacted. Our results suggest that a higher proportion of discussions in the random call condition contained exchanges of reasoning, some forms of questioning, and both on- and off-topic comments compared with discussion in the volunteer call condition. Although group random call does not impact student performance on clicker questions, the positive impact of this instructional approach on exchanges of reasoning and other features suggests it may encourage some types of student interactions that support learning.