How to Assess Your CURE: A Practical Guide for Instructors of Course-Based Undergraduate Research Experiences

Diversifying laboratory assessment modes broadens engagement with practical competencies in life science students

Laboratory practicals in life science subjects are traditionally assessed by written reports that reflect disciplinary norms for documenting experimental activities. However, the exclusive application of this assessment has the potential to engage only a narrow range of competencies. In this study, we explored how multiple modes of laboratory assessment might affect student perceptions of learned skills in a life science module. We hypothesized that while a mixture of assessments may not impact student summative performance, it might positively influence student perceptions of different skills that varied assessments allowed them to practice. This was informed by universal design for learning and teaching for understanding frameworks. In our study, in a third-year Bioscience program, written reports were complemented with group presentations and online quizzes via Moodle. Anonymous surveys evaluated whether this expanded portfolio of assessments promoted awareness of, and engagement with, a broader range of practical competencies. Aspects that influenced student preferences in assessment mode included time limitations, time investment, ability to practice new skills, links with lecture material, and experience of assessment anxiety. In particular, presentations were highlighted as promoting collaboration and communication and the quiz as an effective means of diversifying assessment schedules. A key takeaway from students was that while reports were important, an overreliance on them was detrimental. This study suggests that undergraduate life science students can benefit significantly from a holistic assessment strategy that complements reports with performance-based approaches that incorporate broader competencies and allow for greater student engagement and expression in undergraduate modules.NEW & NOTEWORTHY This study suggests that undergraduate life science students can benefit significantly from a holistic assessment strategy that complements reports with performance-based approaches that incorporate broader competencies and allow for greater student engagement and expression in undergraduate modules.

DNA at the whim of the water: environmental DNA as a course-based undergraduate research experience

Course-based undergraduate research experiences (CUREs) increase student access to high impact research experiences. CUREs engage students in the scientific process by learning how to pose scientific questions, develop hypotheses, and generate data to test them. Environmental DNA (eDNA) is a growing field of research that is gaining accessibility through decreasing laboratory costs, which can make a foundation for multiple, engaging CUREs. This manuscript describes three case studies that used eDNA in an upper year undergraduate course. The first focusses on a systematic literature review of eDNA metadata reporting. The second describes the biomonitoring of brook trout in southern Ontario using eDNA. The third involves eDNA metabarcoding for freshwater fish detection in southern Ontario. Undergraduates were involved in the development and execution of experiments, scientific communication, the peer review process, and fundraising. Through this manuscript, we show the novel application of eDNA CUREs and provide a roadmap for other instructors interested in implementing similar projects. Interviews with seven students from these courses indicate the benefits experienced from taking these courses. We argue that the use of eDNA in CUREs should be expanded in undergraduate biology programs due to the benefit to students and the increasing accessibility of this technology.

A framework for leveraging network course-based undergraduate research experience (CURE) faculty to develop, validate, and administer an assessment instrument

Over the last several years, nationally disseminated course-based undergraduate research experiences (CUREs) have emerged as an alternative to developing a novel CURE from scratch, but objective assessment of these multi-institution (network) CUREs across institutions is challenging due to differences in student populations, instructors, and fidelity of implementation. The time, money, and skills required to develop and validate a CURE-specific assessment instrument can be prohibitive. Here, we describe a co-design process for assessing a network CURE [the Prevalence of Antibiotic Resistance in the Environment (PARE)] that did not require support through external funding, was a relatively low time commitment for participating instructors, and resulted in a validated instrument that is usable across diverse PARE network institution types and implementation styles. Data collection efforts have involved over two dozen unique institutions, 42 course offerings, and over 1,300 pre-/post-matched assessment record data points. We demonstrated significant student learning gains but with small effect size in both content and science process skills after participation in the two laboratory sessions associated with the core PARE module. These results show promise for the efficacy of short-duration CUREs, an educational research area ripe for further investigation, and may support efforts to lower barriers for instructor adoption by leveraging a CURE network for developing and validating assessment tools.

Ten simple rules for leading a successful undergraduate-intensive research lab

Participating in mentored research is an enormous benefit to undergraduate students. These immersive experiences can dramatically improve retention and completion rates, especially for students from traditionally underserved populations in STEM disciplines. Scientists typically do not receive any formal training in management or group dynamics before taking on the role of a lab head. Thus, peer forums and shared wisdom are crucial for developing the vision and skills involved with mentorship and leading a successful research lab. Faculty at any institution can help improve student outcomes and the success of their labs by thoughtfully including undergraduates in their research programs. Moreover, faculty at primarily undergraduate institutions have special challenges that are not often acknowledged or addressed in public discussions about best practices for running a lab. Here, we present 10 simple rules for fostering a successful undergraduate research lab. While much of the advice herein is applicable to mentoring undergraduates in any setting, it is especially tailored to the special circumstances found at primarily undergraduate institutions.

Developing scientific literacy with a cyclic independent study assisted CURE detecting SARS-CoV-2 in wastewater

The COVID-19 pandemic has exposed a high level of scientific illiteracy and mistrust that pervades the scientific and medical communities. This finding has proven the necessity of updating current methods used to expose undergraduates to research. The research in traditional course-based undergraduate research experiences (CUREs) is limited by undergraduate time constraints, skill level, and course structure, and consequently it does not attain the learning objectives or the high-impact, relevant studies achieved in graduate-level laboratories using a cyclic trainee/trainer model. Although undergraduate independent study (ISY) research more closely matches the structure and learning objectives of graduate-level research, they are uncommon as professors and universities typically view them as a significant time and resource burden with limited return. Cyclic independent study-assisted CUREs (CIS-CUREs) combine many positive aspects of ISY graduate-level research, and CUREs by pre-training ISY research lead to facilitate CURE proposal and project semesters in a cyclic model. The CIS-CURE approach allowed undergraduate students at Stetson University to perform and disseminate more rigorous, involved, long-term, and challenging research projects, such as the surveillance of SARS-CoV-2 in wastewater. In doing so, all students would have the opportunity to participate in a high-impact research project and consequently gain a more comprehensive training, reach higher levels of research dissemination, and increase their competitiveness after graduating. Together, CIS-CUREs generate graduates with higher scientific literacy and thus combat scientific mistrust in communities.

Preparing Teaching Assistants to Facilitate Course-based Undergraduate Research Experiences (CUREs) in the Biological Sciences: A Call to Action

Course-based undergraduate research experiences (CUREs) offer an expanding avenue to engage students in real-world scientific practices. Increasingly, CUREs are instructed by graduate teaching assistants (TAs), yet TAs may be underprepared to facilitate and face unique barriers when teaching CUREs. Consequently, unless TAs are provided professional development (PD) and resources to teach CUREs effectively, they and their students may not reap the assumed benefits of CURE instruction. Here, we describe three perspectives - that of the CURE TA, the CURE designer/facilitator, and the CURE student - that are collectively intended to inform the development of tentative components of CURE TA PD. We compare these perspectives to previous studies in the literature in an effort to identify commonalities across all sources and offer potential insights for advancing CURE TA PD efforts across a diversity of institutional environments. We propose that the most effective CURE TA PD programs will promote the use of CURE-specific instructional strategies as benchmarks for guiding change in teaching practices and should focus on three major elements: 1) enhancement of research and teaching acumen, 2) development of effective and inclusive mentoring practices, and 3) identification and understanding of the factors that make CUREs a unique learning experience.

A Call to Assess the Impacts of Course-Based Undergraduate Research Experiences for Career and Technical Education, Allied Health, and Underrepresented Students at Community Colleges

Course-based undergraduate research experiences (CUREs) have the potential to impact student success and reduce barriers for students to participate in undergraduate research. Literature review has revealed that, while CUREs are being implemented at both community colleges (CCs) and bachelor's degree-granting institutions, there are limited published studies on the differential impacts CUREs may have on CC students in allied health programs, career and technical education, and nursing pathways (termed "workforce" in this essay). This essay summarizes proposed outcomes of CURE instruction and explores possible reasons for limited reporting on outcomes for CC and workforce students. It also provides recommendations to guide action and effect change regarding CURE implementation and assessment at CCs. This essay is a call to action to expand the science, technology, engineering, and mathematics career development pathway to include workforce students, implement CUREs designed for workforce students, and assess the differential impacts CUREs may have on workforce student populations at CCs.

Research Anxiety Predicts Undergraduates' Intentions to Pursue Scientific Research Careers

Undergraduate research is lauded as a high-impact practice owing to the array of benefits that students can reap from participating. One unexplored construct that may affect student intent to persist in research is research anxiety, defined as the sense of worry or apprehension associated with conducting research. In this study, we surveyed 1272 undergraduate researchers across research-intensive, master's-granting, and primarily undergraduate institutions to assess the relationship among student demographics, research anxiety, and intent to pursue a research career. Using structural equation modeling, we identified that women and students with higher grade point averages (GPAs) were more likely to report higher levels of research anxiety compared with men and students with lower GPAs, respectively. Additionally, research anxiety was significantly and negatively related to student intent to pursue a research-related career. We coded students' open-ended responses about what alleviates and exacerbates their anxiety and found that experiencing failure in the context of research and feeling underprepared increased their research anxiety, while a positive lab environment and mentor-mentee relationships decreased their anxiety. This is the first study to examine undergraduate anxiety in the context of research at scale and to establish a relationship between research anxiety and students' intent to persist in scientific research careers.

Not the same CURE: Student experiences in course-based undergraduate research experiences vary by graduate teaching assistant

To expose all undergraduate science students to the benefits of participating in research, many universities are integrating course-based undergraduate research experiences (CUREs) into their introductory biology laboratory curriculum. At large institutions, the bulk of introductory labs are instructed by graduate teaching assistants (GTAs). Graduate students, who are often teachers and researchers in training, may vary in their capacity to effectively teach undergraduates via the CURE model. To explore variation in GTA teaching and the subsequent outcomes for students, we used a case study research design at one institution where introductory biology students participate in GTA-taught CURE lab sections. We used multiple data sources, including in-class focus groups, worksheets, and surveys to explore student perceptions of the GTA-led CURE. Students perceived variation both in the ability of their GTAs to create a supportive and comfortable learning environment, and in the instructional priorities of their GTAs. We also compared student and GTA perspectives of student engagement with research elements in the CURE. While GTAs were divided in their perceptions of whether the CURE provided students with the opportunity to experience the element of relevant discovery, most students—regardless of their GTA—did not perceive that relevant discovery was emphasized in the CURE. Finally, individual GTAs seemed to influence how students perceived why they were participating in the CURE. These data imply that students in CUREs may have vastly different and potentially inequitable research experiences depending on their instructor.

Undergraduates' Experiences with Online and in-Person Courses Provide Opportunities for Improving Student-Centered Biology Laboratory Instruction

Biology laboratory courses with hands-on activities faced many challenges when switched to online instruction during the COVID-19 pandemic. The transition back to in-person instruction presents an opportunity to redesign courses with greater student input. Undergraduates in an ∼350-student laboratory course were surveyed about their preferences for online or in-person instruction of specific laboratory course components. We predicted that students who have taken a virtual laboratory course prefer keeping some of the components online. We also hypothesized that their preferences are affected by their experience with online-only or with both online and in-person instruction. The results showed that students would like to move the laboratory component and group meetings back to in-person instruction, even if they never experienced college-level in-person courses. Also, many components, including the lectures, exams, assignment submission, and office hours are preferred to be held online. Surprisingly, students who have only taken online courses would rather give group presentations in person, while those who experienced both online and in-person instruction were undecided. Group presentations were the only component where the preference of the two groups significantly differed. Self-assessed learning gains showed that students performed very well in both the online semesters and the in-person semesters. Therefore, the preferences measured in this study were likely developed based on students' future expectations and personal gains, and not only on their metacognitive decisions and academic performances. This study provides considerations for redesigning components of laboratory courses to be more student-centered after the pandemic.

Empowering Undergraduates to Fight Climate Change with Soil Microbes

The burning of fossil fuels to meet a growing demand for energy has created a climate crisis that threatens Earth's fragile ecosystems. While most undergraduate students are familiar with solar and wind energy as sustainable alternatives to fossil fuels, many are not aware of a climate solution right beneath their feet-soil-dwelling microbes! Microbial fuel cells (MFCs) harness energy from the metabolic activity of microbes in the soil to generate electricity. Recently, the coronavirus disease 2019 (COVID-19) pandemic transformed the traditional microbiology teaching laboratory into take-home laboratory kits and online modes of delivery, which could accommodate distance learning. This laboratory exercise combined both virtual laboratory simulations and a commercially available MFC kit to challenge undergraduate students to apply fundamental principles in microbiology to real-world climate solutions.

Course-based Undergraduate Research Experiences (CUREs) in General Education Courses

While much of the promotion for undergraduate research (UR) originates from the natural sciences, this high-impact practice should also occur in social science to prepare students for graduate school/ the workforce and should be integrated into lower-division general education courses. Our study examines content and skills gained by students from two course-based undergraduate research experiences (CUREs) in Introduction to Sociology courses. Pre- and post-course survey analyses, post-survey student outcomes of a CURE class compared against students enrolled in three non-CURE Introduction to Sociology classes, and a content analysis of end-of-semester papers indicate student knowledge gain in specific topical areas, methodological skills, and major sociology theoretical perspectives. We conclude that UR enhances research- and sociology-related knowledge.

MUREs: a new member of the URE-CURE family of research opportunities for undergrads

Undergraduate research experiences are important for the development of scientific identity, appreciation of authentic research, and improvement of persistence toward science careers. We identified a gap in experiential research opportunities for undergraduate Biology students who were seeking a formal yet small-scale research experience that was unique to their own interests and career aspirations. These opportunities may be especially worthwhile for of science, technology, engineering, and mathematics (STEM) students aspiring to nonresearch scientific careers (i.e., medicine, dentistry, forensics, and communication) and underrepresented STEM students. Here, we reflect on the use of small-scale, individualized undergraduate research experiences that are based on established methods. These experiences have helped to fill this gap and create problem-centered learning opportunities for undergraduate students that are as unique as the students themselves.

A resource for understanding and evaluating outcomes of undergraduate field experiences

Undergraduate field experiences (UFEs) are a prominent element of science education across many disciplines; however, empirical data regarding the outcomes are often limited. UFEs are unique in that they typically take place in a field setting, are often interdisciplinary, and include diverse students. UFEs range from courses, to field trips, to residential research experiences, and thereby have the potential to yield a plethora of outcomes for undergraduate participants. The UFE community has expressed interest in better understanding how to assess the outcomes of UFEs. In response, we developed a guide for practitioners to use when assessing their UFE that promotes an evidence-based, systematic, iterative approach. This essay guides practitioners through the steps of: identifying intended UFE outcomes, considering contextual factors, determining an assessment approach, and using the information gained to inform next steps. We provide a table of common learning outcomes with aligned assessment tools, and vignettes to illustrate using the assessment guide. We aim to support comprehensive, informed assessment of UFEs, thus leading to more inclusive and reflective UFE design, and ultimately improved student outcomes. We urge practitioners to move toward evidence-based advocacy for continued support of UFEs.

An at-home laboratory in plant biology designed to engage students in the process of science

The COVID-19 pandemic prompted a transition to remote delivery of courses that lack immersive hands-on research experiences for undergraduate science students, resulting in a scientific research skills gap. In this report, we present an option for an inclusive and authentic, hands-on research experience that all students can perform off-campus. Biology students in a semester-long (13 weeks) sophomore plant physiology course participated in an at-home laboratory designed to study the impacts of nitrogen addition on growth rates and root nodulation by wild nitrogen-fixing Rhizobia in Pisum sativum (Pea) plants. This undergraduate research experience, piloted in the fall semester of 2020 in a class with 90 students, was created to help participants learn and practice scientific research skills during the COVID-19 pandemic. Specifically, the learning outcomes associated with this at-home research experience were: (1) generate a testable hypothesis, (2) design an experiment to test the hypothesis, (3) explain the importance of biological replication, (4) perform meaningful statistical analyses using R, and (5) compose a research paper to effectively communicate findings to a general biology audience. Students were provided with an at-home laboratory kit containing the required materials and reagents, which were chosen to be accessible and affordable in case students were unable to access our laboratory kit. Students were guided through all aspects of research, including hypothesis generation, data collection, and data analysis, with video tutorials and live virtual sessions. This at-home laboratory provided students an opportunity to practice hands-on research with the flexibility to collect and analyze their own data in a remote setting during the COVID-19 pandemic. This, or similar laboratories, could also be used as part of distance learning biology courses.

A Course-Based Undergraduate Research Experience in CRISPR-Cas9 Experimental Design to Support Reverse Genetic Studies in Arabidopsis thaliana

Gene-editing tools such as CRISPR-Cas9 have created unprecedented opportunities for genetic studies in plants and animals. We designed a course-based undergraduate research experience (CURE) to train introductory biology students in the concepts and implementation of gene-editing technology as well as develop their soft skills in data management and scientific communication. We present two versions of the course that can be implemented with twice-weekly meetings over a 5-week period. In the remote-learning version, students performed homology searches, designed guide RNAs (gRNAs) and primers, and learned the principles of molecular cloning. This version is appropriate when access to laboratory equipment or in-person instruction is limited, such as during closures that have occurred in response to the COVID-19 pandemic. In person, students designed gRNAs, cloned CRISPR-Cas9 constructs, and performed genetic transformation of Arabidopsis thaliana. Students learned how to design effective gRNA pairs targeting their assigned gene with an 86% success rate. Final exams tested students' ability to apply knowledge of an unfamiliar genome database to characterize gene structure and to properly design gRNAs. Average final exam scores of ∼73% and ∼84% for in-person and remote-learning CUREs, respectively, indicated that students met learning outcomes. The highly parallel nature of the CURE makes it possible to target dozens to hundreds of genes, depending on the number of sections. Applying this approach in a sensitized mutant background enables focused reverse genetic screens for genetic suppressors or enhancers. The course can be adapted readily to other organisms or projects that employ gene editing.

Virology in the Classroom: Current Approaches and Challenges to Undergraduate- and Graduate-Level Virology Education

The pervasive effects of the current coronavirus disease 2019 pandemic are but one reason for educators to refocus their efforts on virology teaching. Additionally, it is critical to understand how viruses function and to elucidate the relationship between virus and host. An understanding of current virology education may improve pedagogical approaches for educating our students and trainees. Faculty who teach undergraduate microbiology indicate that approximately 10% of the course content features viruses; stand-alone virology courses are infrequently offered to undergraduates. Fortunately, virology taught to undergraduates includes foundational material; several approaches for delivery of lecture- and lab-based content exist. At the graduate education level, there is growing appreciation that an emphasis on logic, reasoning, inference, and statistics must be reintroduced into the curriculum to create a generation of scientists who have a greater capacity for creativity and innovation. Educators also need to remove barriers to student success, at all levels of education. Expected final online publication date for the Annual Review of Virology, Volume 8 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Is This Science? Students' Experiences of Failure Make a Research-Based Course Feel Authentic

Course-based undergraduate research experiences (CUREs) and inquiry-based curricula both expose students to the scientific process. CUREs additionally engage students in novel and scientifically relevant research, with the intention of providing an "authentic" research experience. However, we have little understanding of which course design elements impact students' beliefs that they are experiencing "authentic" research. We designed a study to explore introductory biology students' perceptions of research authenticity in CURE and inquiry classes. Using the Laboratory Course Assessment Survey, we found that students in CURE sections perceived higher levels of authentic research elements than students in inquiry-based sections. To identify specific factors that impact perceptions of research authenticity, we administered weekly reflection questions to CURE students. Coding of reflection responses revealed that experiences of failure, iteration, using scientific practices, and the relevant discoveries in their projects enhanced students' perceived authenticity of their research experiences. Although failure and iteration can occur in both CUREs and inquiry-based curricula, our findings indicate these experiences-in conjunction with the Relevant Discovery element of a CURE-may be particularly powerful in enhancing student perceptions of research authenticity in a CURE.

Science Bootcamp Goes Virtual: a Compressed, Interdisciplinary Online CURE Promotes Psychosocial Gains in STEM Transfer Students

Course-based undergraduate research experiences (CUREs) are well-documented as high-impact practices that can broaden participation and success in STEM. Drawing primarily from a community of practice theoretical framework, we previously developed an interdisciplinary CURE course (Science Bootcamp) for STEM majors focused entirely on the scientific process. Among first-year students, Science Bootcamp leads to psychosocial gains and increased retention. In the current study, we test whether an online Science Bootcamp also improved outcomes for STEM transfer students-a group that faces "transfer shock," which can negatively impact GPA, psychosocial outcomes, and retention. To this end, we redesigned Science Bootcamp to a 2-week course for STEM transfer students to complete prior to beginning the fall semester at our 4-year institution. Due to the COVID-19 pandemic, the course was conducted in an entirely virtual format, using primarily synchronous instruction. Despite the course being virtual, the diverse group of STEM majors worked in small groups to conduct rigorous, novel empirical research projects from start to finish, even presenting their results in a poster symposium. Assessment data confirmed the compressed, online Science Bootcamp contained key CURE components-opportunities for collaboration, discovery and relevance, and iteration-and that students were highly satisfied with the course. Moreover, in line with our hypothesis, STEM transfer students who participated in the online Science Bootcamp experienced a range of psychosocial gains (e.g., belonging to STEM). In sum, these findings suggest our online Science Bootcamp promotes positive STEM outcomes, representing a highly flexible and affordable CURE that can be scaled for use at institutions of any size.

Integrating Research into the Undergraduate Curriculum: 3. Research Training in the Upper-level Neuroscience Curriculum

The benefits of undergraduate training in research are significant. Integration of such training into the undergraduate experience, however, can be challenging at institutions without extensive research programs, and may inadvertently exclude some populations of students. Therefore, inclusion of research into the academic curriculum ensures all students can access this important training. The 2019 annual meeting of the Society for Neuroscience included a workshop on integrating research into the curriculum at primarily undergraduate institutions (PUIs). In this last article of a three-part series, we describe models for integrating research into advanced stages of the undergraduate curriculum, specifically for juniors and seniors. First, we describe multiple models of faculty-mentored group-based research. Second, we detail a peer-mentored research system, in which seniors mentor groups of first through third year students. Third, we describe multiple examples of integrating research into "capstone" courses for seniors. Fourth, we describe models in which a senior thesis is a graduation requirement for all students. Lastly, we describe several models of implementing an optional honors thesis for students. Although similarities exist across these programs, their differences allow for specific secondary objectives to be met, which are often unique to institutions and/or departments. Therefore, for each of these examples, we describe the context, specific design, and required student assessments. We conclude by discussing some of the key successes and challenges of developing programs that facilitate undergraduate research by upper-level students, and suggest a number of concepts that should be considered by individuals developing and assessing new programs.

Propelling a Course-Based Undergraduate Research Experience Using an Open-Access Online Undergraduate Research Journal

The University of British Columbia has developed a course-based undergraduate research experience (CURE) that engages students in authentic molecular microbiology research. This capstone course is uniquely built around an open-access online undergraduate research journal entitled Undergraduate Journal of Experimental Microbiology and Immunology (UJEMI). Students work in teams to derive an original research question, formulate a testable hypothesis, draft a research proposal, carry out experiments in the laboratory, and publish their results in UJEMI. The CURE operates in a feed forward manner whereby student-authored UJEMI publications drive research questions in subsequent terms of the course. Progress toward submission of an original manuscript is scaffolded using a series of communication assignments which facilitate formative development. We present a periodic model of our CURE that guides students through a research cycle. We review two ongoing course-based projects to highlight how UJEMI publications prime new research questions in the course. A journal-driven CURE represents a broadly applicable pedagogical tool that immerses students in the process of doing science.

Is Community Relevance Enough? Civic and Science Identity Impact of Microbiology CUREs Focused on Community Environmental Justice

Course-based undergraduate research experiences (CUREs) often involve a component where the outcomes of student research are broadly relevant to outside stakeholders. We wanted to see if building courses around an environmental justice issue relevant to the local community would impact students' sense of civic engagement and appreciation of the relevance of scientific research to the community. In this quasi-experimental study, we assessed civic engagement and scientific identity gains (N = 98) using pre- and post-semester surveys and open-ended interview responses in three different CUREs taught simultaneously at three different universities. All three CURES were focused on an environmental heavy metal pollution issue predominantly affecting African-Americans in Birmingham, Alabama. While we found increases in students' sense of science efficacy and identity, our team was unable to detect meaningful changes in civic engagement levels, all of which were initially quite high. However, interviews suggested that students were motivated to do well in their research because the project was of interest to outside stakeholders. Our observations suggest that rather than directly influencing students' civic engagement, the "broadly relevant" component of our CUREs engaged their pre-existing high levels of engagement to increase their engagement with the material, possibly influencing gains in science efficacy and science identity. Our observations are consistent with broader community relevance being an important component of CURE success, but do not support our initial hypothesis that CURE participation would influence students' attitudes toward the civic importance of science.

BioSkills Guide: Development and National Validation of a Tool for Interpreting the Vision and Change Core Competencies

To excel in modern science, technology, engineering, and mathematics careers, biology majors need a range of transferable skills, yet competency development is often a relatively underdeveloped facet of the undergraduate curriculum. We have elaborated the Vision and Change core competency framework into a resource called the BioSkills Guide, a set of measurable learning outcomes that can be more readily implemented by faculty. Following an iterative review process including more than 200 educators, we gathered evidence of the BioSkills Guide's content validity using a national survey of more than 400 educators. Rates of respondent support were high (74.3-99.6%) across the 77 outcomes in the final draft. Our national sample during the development and validation phases included college biology educators representing more than 250 institutions, including 73 community colleges, and a range of course levels and biology subdisciplines. Comparison of the BioSkills Guide with other science competency frameworks reveals significant overlap but some gaps and ambiguities. These differences may reflect areas where understandings of competencies are still evolving in the undergraduate biology community, warranting future research. We envision the BioSkills Guide supporting a variety of applications in undergraduate biology, including backward design of individual lessons and courses, competency assessment development, and curriculum mapping and planning.

Fermentation revival in the classroom: investigating ancient human practices as CUREs for modern diseases

A course-based undergraduate research experience (CURE) was designed to integrate key microbiological principles and techniques into an authentic research experience in a classroom setting and was implemented in an undergraduate microbiology laboratory course. Students conducted a 6-week study in order to determine the identity and quantity of unique probiotic species from various types of kefir. This course module followed an inquiry-based pedagogical approach in which students use the scientific process to investigate an unknown question with no predetermined outcome. During each lab, relevant microbiological topics and laboratory concepts were presented. Students then performed various laboratory techniques, reinforcing the lecture material with hands-on experience. In addition, students participated in reflection through group presentation of their results, bioinformatic analysis and literature review. Based on data collected from pre- and post-study survey responses, both student knowledge and attitudes towards the topics covered improved due to participation in this CURE. Importantly, this CURE can be implemented at many levels of education, requiring only minimal resources and common laboratory equipment.

A Learning Community Involving Collaborative Course-Based Research Experiences for Foundational Chemistry Laboratories

Numerous American national committees have recommended the replacement of traditional labs with a more engaging curriculum that inspires inquiry and enhances scientific skills (examples include the President’s Council of Advisors on Science and Technology (PCAST)’s Engage to Excel program and American Association for the Advancement of Science (AAAS) Vision and Change, among others), due to a large body of evidence that shows significant enhancements in student learning and affective outcomes. The implementation of Course-Based Undergraduate Research Experiences (CUREs) is a creative way to scale up the deployment of authentic research experiences to students. Another highly regarded high-impact practice in postsecondary education is the addition of learning communities. The integration of a three-course learning community and authentic research experiences to laboratory courses adds both a community of scholarship and a development of scientific communication and process skills. This study describes a course that blends these two high-impact practices in higher education in order to promote greater post-course gains in essential elements of a CURE curriculum. This collaborative course shows large post-course gains in essential elements, such as scientific communication and working collaboratively.

Bringing immersive science to undergraduate laboratory courses using CRISPR gene knockouts in frogs and butterflies

The use of CRISPR/Cas9 for gene editing offers new opportunities for biology students to perform genuine research exploring the gene-to-phenotype relationship. It is important to introduce the next generation of scientists, health practitioners and other members of society to the technical and ethical aspects of gene editing. Here, we share our experience leading hands-on undergraduate laboratory classes, where students formulate hypotheses regarding the roles of candidate genes involved in development, perform loss-of-function experiments using programmable nucleases and analyze the phenotypic effects of mosaic mutant animals. This is enabled by the use of the amphibian Xenopus laevis and the butterfly Vanessa cardui, two organisms that reliably yield hundreds of large and freshly fertilized eggs in a scalable manner. Frogs and butterflies also present opportunities to teach key biological concepts about gene regulation and development. To complement these practical aspects, we describe learning activities aimed at equipping students with a broad understanding of genome editing techniques, their application in fundamental and translational research, and the bioethical challenges they raise. Overall, our work supports the introduction of CRISPR technology into undergraduate classrooms and, when coupled with classroom undergraduate research experiences, enables hypothesis-driven research by undergraduates.

Fear of the CURE: A Beginner's Guide to Overcoming Barriers in Creating a Course-Based Undergraduate Research Experience

Over the past decade, growing evidence has shown that there are many benefits to undergraduate students engaging in scientific research, including increased persistence in pursuing STEM careers and successful outcomes in graduate study. With these benefits in mind, there has been a significant push toward providing research opportunities for students in STEM majors. To address this need, an increasing number of undergraduate courses have been developed to provide students with research experiences in a class setting, also known as course-based undergraduate research experiences, or CUREs. Despite the growing success of these courses, a number of barriers remain that deter faculty from developing and implementing CUREs. Here, we will review the perceived challenges of developing a CURE and provide practical strategies to overcome these challenges.

Increased Scaffolding and Inquiry in an Introductory Biology Lab Enhance Experimental Design Skills and Sense of Scientific Ability

We present a model for the process of redesigning the laboratory curriculum in Introductory Organismal Biology to increase opportunities for meaningful inquiry and increase student recognition of their scientific skill development. We created scaffolded modules and assignments to allow students to build and practice key skills in experimental design, data analysis, and scientific writing. Using the Tool for Interrelated Experimental Design, we showed significantly higher gains in experimental design scores in the redesigned course and a more consistent pattern of gains across a range of initial student scores compared with the original format. Students who completed the redesigned course rated themselves significantly higher in experimental design, data collection, and data analysis skills compared with students in the original format. Scores on the Laboratory Course Activity Survey were high for both formats and did not significantly differ. However, on written course evaluations, students in the redesigned course were more likely to report that they engaged in "real science" and their "own experiments." They also had increased recognition of their specific analytical and writing skill development. Our results demonstrate that intentional, scaffolded instruction using inquiry modules can increase experimental design skills and sense of scientific ability in an introductory biology course.

Students Who Analyze Their Own Data in a Course-Based Undergraduate Research Experience (CURE) Show Gains in Scientific Identity and Emotional Ownership of Research

While it has been established that course-based undergraduate research experiences (CUREs) lead to student benefits, it is less clear what aspects of CUREs lead to such gains. In this study, we aimed to understand the effect of students analyzing their own data, compared with students analyzing data that had been collected by professional scientists. We compared the experiences of students in a CURE investigating whether the extinction risk status of terrestrial mammals and birds is associated with their ecological traits. Students in the CURE were randomly assigned to analyze either data that they had collected or data previously collected by professional scientists. All other aspects of the student experience were designed to be identical. We found that students who analyzed their own data showed significantly greater gains in scientific identity and emotional ownership than students who analyzed data collected by professional scientists.

A laboratory competency examination in microbiology

The American Society for Microbiology's curricular guidelines for Introductory Microbiology highlighted key laboratory skills in the isolation, visualization and identification of microorganisms as core learning objectives in the discipline. Since the publication of these guidelines in 2012, there has been a paucity of diagnostic assessment tools in the literature that can be used to assess competencies in the microbiology laboratory. This project aimed to establish a laboratory competency examination for introductory microbiology, with tasks specifically aligned to laboratory skills and learning outcomes outlined in curricular guidelines for microbiology. A Laboratory Competency Examination assessing student skills in light microscopy, Gram-staining, pure culture, aseptic technique, serial dilution, dilution calculations and pipetting was developed at The University of Queensland, Australia. The Laboratory Competency Examination was field-tested in a large introductory microbiology subject (∼400 students), and student performance and learning gains data were collected from 2016 to 2017 to evaluate the validity of the assessment. The resulting laboratory assessment is presented as an endpoint diagnostic tool for assessing laboratory competency that can be readily adapted towards different educational contexts.

Adding Authenticity to Inquiry in a First-Year, Research-Based, Biology Laboratory Course

Course-based undergraduate research experiences (CUREs) are an effective way to integrate research into an undergraduate science curriculum and extend research experiences to a large, diverse group of early-career students. We developed a biology CURE at the University of Miami (UM) called the UM Authentic Research Laboratories (UMARL), in which groups of first-year students investigated novel questions and conducted projects of their own design related to the research themes of the faculty instructors. Herein, we describe the implementation and student outcomes of this long-running CURE. Using a national survey of student learning through research experiences in courses, we found that UMARL led to high student self-reported learning gains in research skills such as data analysis and science communication, as well as personal development skills such as self-confidence and self-efficacy. Our analysis of academic outcomes revealed that the odds of students who took UMARL engaging in individual research, graduating with a degree in science, technology, engineering, or mathematics (STEM) within 4 years, and graduating with honors were 1.5-1.7 times greater than the odds for a matched group of students from UM's traditional biology labs. The authenticity of UMARL may have fostered students' confidence that they can do real research, reinforcing their persistence in STEM.

The Graph Rubric: Development of a Teaching, Learning, and Research Tool

As undergraduate biology curricula increasingly aim to provide students with access to courses and experiences that engage them in the practices of science, tools are needed for instruction, evaluation, and research around student learning. One of the important skills for undergraduate biology students to master is the selection and creation of appropriate graphs to summarize data they acquire through investigations in their course work and research experiences. Graphing is a complex skill, and there are few, discipline-informed tools available for instructors, students, and researchers to use. Here, we describe the development of a graph rubric informed by literature from the learning sciences, statistics, representations literature, and feedback and use of the rubric by a variety of users. The result is an evidence-based, analytic rubric that consists of categories essential for graph choice and construction: graph mechanics, graph communication, and graph choice. Each category of the rubric can be evaluated at three levels of achievement. Our analysis demonstrates the potential for the rubric to provide formative feedback to students and allow instructors to gauge and guide learning and instruction. We further discuss and identify potentially interesting research targets for science education researchers.

Development of a Tool to Assess Interrelated Experimental Design in Introductory Biology

Designing experiments and applying the process of science are core competencies for many introductory courses and course-based undergraduate research experiences (CUREs). However, experimental design is a complex process that challenges many introductory students. We describe the development of a tool to assess interrelated experimental design (TIED) in an introductory biology lab course. We describe the interrater reliability of the tool, its effectiveness in detecting variability and growth in experimental-design skills, and its adaptability for use in various contexts. The final tool contained five components, each with multiple criteria in the form of a checklist such that a high-quality response-in which students align the different components of their experimental design-satisfies all criteria. The tool showed excellent interrater reliability and captured the full range of introductory-student skill levels, with few students hitting the assessment ceiling or floor. The scoring tool detected growth in student skills from the beginning to the end of the semester, with significant differences between pre- and post-assessment scores for the Total Score and for the Data Collection and Observations component scores. This authentic assessment task and scoring tool provide meaningful feedback to instructors about the strengths, gaps, and growth in introductory students' experimental-design skills and can be scored reliably by multiple instructors. The TIED can also be adapted to a number of experimental-design prompts and learning objectives, and therefore can be useful for a variety of introductory courses and CUREs.

Anticipated learning outcomes for a biochemistry course-based undergraduate research experience aimed at predicting protein function from structure: Implications for assessment design

Several course-based undergraduate research experiences (CUREs) have been published in the literature. However, only limited attempts have been made to rigorously identify the discovery-type research abilities that students actually develop during such experiences. Instead, there has been a greater focus on technical or procedural-type knowledge or general CURE skills that are too comprehensive to effectively assess. Before the extent of discovery-type learning outcomes can be established in students (termed verified learning outcomes or VLOs), it is important to rigorously identify the anticipated learning outcomes (ALOs) and to then develop student assessments that target each ALO to reveal the nature of such student learning. In this article we present a matrix of 43 ALOs, or course-based undergraduate research abilities (CURAs), that instructors anticipate students will develop during a recently-developed biochemistry CURE focusing on the prediction of protein function from structure. The CURAs were identified using the process for identifying course-based undergraduate research abilities (PICURA) and classified into seven distinct themes that enabled the characterization of the CURE and a comparison to other published inventories of research competencies and CURE aspects. These themes and the CURE protocols aligning to the CURAs were used to form the ALO matrix that was, in turn, used to inform the design of an assessment that revealed evidence that a student had developed some of the targeted CURAs. Future research will focus on further assessment development that targets other identified CURAs. This approach has potential applications to other CUREs both in biochemistry and other science disciplines. © 2018 International Union of Biochemistry and Molecular Biology, 46(5):478-492, 2018.

A standardized workflow for submitting data to the Minimum Information about a Biosynthetic Gene cluster (MIBiG) repository: prospects for research-based educational experiences

Microorganisms utilize complex enzymatic pathways to biosynthesize structurally complex and pharmacologically relevant molecules. These pathways are encoded by gene clusters and are found in a diverse set of organisms. The Minimum Information about a Biosynthetic Gene cluster repository facilitates standardized and centralized storage of experimental data on these gene clusters and their molecular products, by utilizing user-submitted data to translate scientific discoveries into a format that can be analyzed computationally. This accelerates the processes of connecting genes to chemical structures, understanding biosynthetic gene clusters in the context of environmental diversity, and performing computer-assisted design of synthetic gene clusters. Here, we present a Standard Operating Procedure, Excel templates, a tutorial video, and a collection of relevant review literature to support scientists in their efforts to submit data into MiBIG. Further, we provide tools to integrate gene cluster annotation projects into the classroom environment, including workflows and assessment materials.

How to Identify the Research Abilities That Instructors Anticipate Students Will Develop in a Biochemistry Course-Based Undergraduate Research Experience (CURE)

Course-based undergraduate research experiences (CUREs) have been described in a range of educational contexts. Although various anticipated learning outcomes (ALOs) have been proposed, processes for identifying them may not be rigorous or well documented, which can lead to inappropriate assessment and speculation about what students actually learn from CUREs. In this essay, we offer a user-friendly and rigorous approach based on evidence and an easy process to identify ALOs, namely, a five-step Process for Identifying Course-Based Undergraduate Research Abilities (PICURA), consisting of a content analysis, an open-ended survey, an interview, an alignment check, and a two-tiered Likert survey. The development of PICURA was guided by four criteria: 1) the process is iterative, 2) the overall process gives more insight than individual data sources, 3) the steps of the process allow for consensus across the data sources, and 4) the process allows for prioritization of the identified abilities. To address these criteria, we collected data from 10 participants in a multi-institutional biochemistry CURE. In this essay, we use two selected research abilities to illustrate how PICURA was used to identify and prioritize such abilities. PICURA could be applied to other CUREs in other contexts.

Course-based undergraduate research experiences in molecular biosciences-patterns, trends, and faculty support

Inquiry-driven learning, research internships and course-based undergraduate research experiences all represent mechanisms through which educators can engage undergraduate students in scientific research. In life sciences education, the benefits of undergraduate research have been thoroughly evaluated, but limitations in infrastructure and training can prevent widespread uptake of these practices. It is not clear how faculty members can integrate complex laboratory techniques and equipment into their unique context, while finding the time and resources to implement undergraduate research according to best practice guidelines. This review will go through the trends and patterns in inquiry-based undergraduate life science projects with particular emphasis on molecular biosciences-the research-aligned disciplines of biochemistry, molecular cell biology, microbiology, and genomics and bioinformatics. This will provide instructors with an overview of the model organisms, laboratory techniques and research questions that are adaptable for semester-long projects, and serve as starting guidelines for course-based undergraduate research.

Collaborating with Undergraduates To Contribute to Biochemistry Community Resources

Course-based undergraduate research experiences (CUREs) have gained traction as effective ways to expand the impact of undergraduate research while fulfilling pedagogical goals. In this Perspective, we present innovative ways to incorporate fundamental benefits and principles of CUREs into a classroom environment through information/technology-based research projects that lead to student-generated contributions to digital community resources (CoRes). These projects represent an attractive class of CUREs because they are less resource-intensive than laboratory-based CUREs, and the projects align with the expectations of today's students to create rapid and publicly accessible contributions to society. We provide a detailed discussion of two example types of CoRe projects that can be implemented in courses to impact research and education at the chemistry-biology interface: bioinformatics annotations and development of educational tools. Finally, we present current resources available for faculty interested in incorporating CUREs or CoRe projects into their pedagogical practices. In sharing these stories and resources, we hope to lower the barrier for widespread adoption of CURE and CoRe approaches and generate discussions about how to utilize the classroom experience to make a positive impact on our students and the future of the field of biochemistry.

Define Your Goals Before You Design a CURE: A Call to Use Backward Design in Planning Course-Based Undergraduate Research Experiences

We recommend using backward design to develop course-based undergraduate research experiences (CUREs). The defining hallmark of CUREs is that students in a formal lab course explore research questions with unknown answers that are broadly relevant outside the course. Because CUREs lead to novel research findings, they represent a unique course design challenge, as the dual nature of these courses requires course designers to consider two distinct, but complementary, sets of goals for the CURE: 1) scientific discovery milestones (i.e., research goals) and 2) student learning in cognitive, psychomotor, and affective domains (i.e., pedagogical goals). As more undergraduate laboratory courses are re-imagined as CUREs, how do we thoughtfully design these courses to effectively meet both sets of goals? In this Perspectives article, we explore this question and outline recommendations for using backward design in CURE development.

A Call to Develop Course-Based Undergraduate Research Experiences (CUREs) for Nonmajors Courses

Course-based undergraduate research experiences (CUREs) for non-science majors (nonmajors) are potentially distinct from CUREs for developing scientists in their goals, learning objectives, and assessment strategies. While national calls to improve science, technology, engineering, and mathematics education have led to an increase in research revealing the positive effects of CUREs for science majors, less work has specifically examined whether nonmajors are impacted in the same way. To address this gap in our understanding, a working group focused on nonmajors CUREs was convened to discuss the following questions: 1) What are our laboratory-learning goals for nonmajors? 2) What are our research priorities to determine best practices for nonmajors CUREs? 3) How can we collaborate to define and disseminate best practices for nonmajors in CUREs? We defined three broad student outcomes of prime importance to the nonmajors CURE: improvement of scientific literacy skills, proscience attitudes, and evidence-based decision making. We evaluated the state of knowledge of best practices for nonmajors, and identified research priorities for the future. The report that follows is a summary of the conclusions and future directions from our discussion.

Multi-Institutional, Multidisciplinary Study of the Impact of Course-Based Research Experiences

Numerous national reports have called for reforming laboratory courses so that all students experience the research process. In response, many course-based research experiences (CREs) have been developed and implemented. Research on the impact of these CREs suggests that student benefits can be similar to those of traditional apprentice-model research experiences. However, most assessments of CREs have been in individual courses at individual institutions or across institutions using the same CRE model. Furthermore, which structures and components of CREs result in the greatest student gains is unknown. We explored the impact of different CRE models in different contexts on student self-reported gains in understanding, skills, and professional development using the Classroom Undergraduate Research Experience (CURE) survey. Our analysis included 49 courses developed and taught at seven diverse institutions. Overall, students reported greater gains for all benefits when compared with the reported national means for the Survey of Undergraduate Research Experiences (SURE). Two aspects of these CREs were associated with greater student gains: 1) CREs that were the focus of the entire course or that more fully integrated modules within a traditional laboratory and 2) CREs that had a higher degree of student input and results that were unknown to both students and faculty.