Effects of an educational intervention on female biomedical scientists' research self-efficacy

An Assessment of Clinical Research Self-Efficacy among Researchers at the Largest Healthcare Institute in Qatar: Recommendations and Future Actions

OBJECTIVES

Clinical research professionals must be equipped with adequate training in sound scientific methods and appropriate ethics. In this study, we aimed to assess the current clinical research self-efficacy of researchers at Hamad Medical Corporation (HMC). We also evaluated the effects of training courses on researchers' self-efficacy.

METHODS

Utilizing a cross-sectional design, we used the shortened Clinical Research Appraisal Inventory (CRAI-12) through an online survey to assess the current clinical research self-efficacy of 600 researchers at HMC, Doha, Qatar. After conducting descriptive analyses, unpaired t test and ANOVA were used to determine significant mean percentages between variables. Pearson correlation coefficients were also calculated to measure the association among the interval variables. All tests were 2-sided, and significance was defined as P < .05.

RESULTS

For all questions, except those related to "funding," most participants scored on the upper half of the scale (>5), reflecting higher self-efficacy for the topics covered in CRAI. Gender differences were significant across all factors, with males reporting higher levels of self-assessed efficacy and in clinical research. Other factors such as higher education degrees and previous (external) clinical research training were also associated with higher self-reported clinical research efficacy.

CONCLUSIONS

The findings of this study indicate that researchers at HMC possess high clinical research self-efficacy overall, but lower self-efficacy in securing funding. Gender and education level positively influence self-efficacy across CRAI factors. Notably, clinical research training boosts self-efficacy, especially when obtained outside HMC. In conclusion, healthcare providers are strongly encouraged to engage in effective clinical research training courses, both within and outside of their healthcare institutions, to improve their clinical research efficacy and enhance clinical practice.

The Rare Disease Research Scholars Program: A training curriculum for clinical researchers with mixed methods evaluation study

Rare disease clinician investigators are essential to ensure appropriate diagnosis, care, and treatment for the rapidly growing rare disease population. As these researchers are spread across many specialties, learning the unique skill set for rare disease research (RDR) can be a hurdle and may hinder progress in the field. The need for an RDR focused training program for investigators in many specialties and backgrounds was identified in a needs assessment of trainees in the NIH funded Rare Diseases Clinical Research Network. Based on this information, the Rare Disease Research Scholars Program (RDRSP) was developed. We describe the needs assessment, curriculum creation, scholar recruitment, and outcome evaluation based on four years of programmatic data (2015–2019). This one year-long RDRSP uses a blended approach that includes in-person, web-based, synchronous and asynchronous learning. We evaluated the RDRSP using quantitative and qualitative approaches. Quantitative measures included pre and post questionnaires about knowledge, self-efficacy, and intent to remain in RDR. Data were analyzed using descriptive statistics and a paired t-test. Qualitative semi-structured interviews explored the RDR scholars’ perceptions of the RDRSP; thematic analysis examined the textual data. Quantitative pre- and post-measures were statistically significant in the following areas: 1) improved knowledge content in RDR, 2) enhanced self-efficacy in clinical research, and 3) intent to remain in the field of RDR. Qualitative data analysis found the program supported the development of the scholar’s research skills as well as ‘soft-skills’. By combining training of skills unique to RDR with the more general topics of leadership, mentorship and collaboration among participants in diverse specialties, we created a program that supports the development of the next generation of rare disease clinician investigators and serves as a model for training in other niche research areas.

Physician-scientist or basic scientist? Exploring the nature of clinicians' research engagement

Theoretical understanding of what motivates clinician researchers has met with some success in launching research careers, but it does not account for professional identification as a factor determining sustained research engagement over the long-term. Deeper understanding of clinicians' research-related motivation may better foster their sustained research engagement post-training and, by extension, the advancement of medicine and health outcomes. This study used an integrated theoretical framework (Social Cognitive Career Theory and Professional Identity Formation) and appreciative inquiry to explore the interplay of professional identification and research context in shaping post-training research success narratives. To foreground professional identification, 19 research-active clinicians and 17 basic scientists served as interviewees. A multi-institutional, multi-national design was used to explore how contextual factors shape external valuation of research success. The findings suggest that research-active clinicians do not identify as the career scientists implied by the modern physician-scientist construct and the goal of many clinician research-training programs. Their primary identification as care providers shapes their definition of research success around extending their clinical impact; institutional expectations and prevailing healthcare concerns that value this aim facilitate their sustained research engagement. Integrated developmental and organizational interventions adaptive to research context and conducive to a wider range of medical inquiry may better leverage clinicians' direct involvement in patient care and advance progress toward human health and well-being.

Interventions to Optimize Mentoring Relationships for Diverse Biomedical Researchers

The articles in this special issue provide insights from a variety of mentoring interventions that were implemented across the NIH Diversity Program Consortium (DPC). Many of the articles highlight examples of how the Entering Mentoring and Entering Research curricular materials, available through the National Research Mentoring Network (NRMN), were adapted and implemented for research mentors and research trainees at Building Infrastructure Leading to Diversity (BUILD) institutions. Other articles report the outcomes of programs developed and offered more broadly by the NRMN. This overview provides background information on NIH DPC-wide efforts and the Entering Mentoring and Entering Research curricula.

The Impact of Grantsmanship Self-Efficacy on Early Stage Investigators of The National Research Mentoring Network Steps Toward Academic Research (NRMN STAR)

The NRMN STAR program was created to address the persistent underrepresentation in grant submissions and receipt of National Institutes of Health (NIH) awards by racial/ethnic minority groups. In our current study, we assessed program impact on trainees' self-efficacy related to grant writing. The program was conducted with two cohorts: one in June 2014 and one in June 2015. We used a 19-item grant writing self-efficacy scale drawn from the 88-item Clinical Research Assessment Inventory of three domains (conceptualizing, designing, and funding a study) to predict whether self-efficacy influences researchers' grant submissions. Trainees were assessed prior to and following program completion with subsequent assessments at 6 and 12 months beyond participation. The majority of trainees were Black (62%), female (62%), and had obtained a PhD (90%). More than half (52%) were assistant professors and 57% had none or <1 year of research experience beyond postdoctoral training. However, 24% of trainees reported no postdoctoral research training. NRMN STAR trainees' self-efficacy significantly improved on all three domains exhibiting a 2.0-point mean change score on two domains (conceptualizing and design) and 3.7 point mean change score on the domain, funding a study. Findings suggest that NRMN's STAR provides impactful, confidence-building training for diverse, early stage investigators with little-to-no skills, experiences, or low self-efficacy in writing research grants.

Career choices of underrepresented and female postdocs in the biomedical sciences

The lack of diversity among faculty at universities and medical schools in the United States is a matter of growing concern. However, the factors that influence the career choices of underrepresented minority and female postdoctoral researchers have received relatively little attention. Here we report the results of a survey of 1284 postdocs working in the biomedical sciences in the US. Our findings highlight possible reasons why some underrepresented minority and female postdocs choose not to pursue careers in academic research, and suggest interventions that could be taken in the early stages of postdoctoral training to prevent this attrition of underrepresented groups.

Early career biomedical grantsmanship self-efficacy: validation of an abbreviated self-assessment tool

A hallmark of success for early career biomedical researchers is the acquisition of research funding. There are marked disparities among principal investigators who submit grants and the likelihood of receiving national funding. The National Research Mentoring Network was funded by the National Institutes of Health to diversify the biomedical research workforce and included grantsmanship training for early career researchers. Self-efficacy in developing research grant applications is significantly improved over time with training and experience. We created a 19-item self-efficacy assessment inventory. Our aims were to confirm the internal consistency of a three-factor solution for grantsmanship confidence and to test the likelihood that self-efficacy influences grant proposal submission timing. We gathered data from 190 diverse biomedical trainees who completed NRMN grantsmanship training between August 2015 and June 2017. Findings revealed high internal consistency for items in each of three factors. There was a statistically significant association between self-efficacy mean scores and grant submission timing predicting that, for every one-point increase in the mean score, the odds of submitting a grant 6 months post-training increased by 69%. An abbreviated inventory of grantsmanship skills self-efficacy is a promising tool for monitoring changes over time in early career researchers and for promoting tailored grantsmanship interventions.

Right from primary school, I liked science: understanding health research capacity building in sub-Saharan Africa through Kenyan training experiences

Defining research career paths that enable Africans to address local and global health issues is essential for population health. This study was conducted to better understand how international health training programs contribute to human resource capacity building in health research. Research career motivations, decision-making and experiences were explored among a small group of Kenyan HIV/AIDS researchers who had completed an international training program. We found that intersecting social dynamics within specific geographic spaces influenced individual training decision-making and motivated research career decisions over time. The concept that 'geo-social motivation' is an important determinant of success for an African considering a research career developed from this study, and may be used to tailor future health research human resource capacity-building programs.

Research self-efficacy and its relationship with academic performance in postgraduate students of Tehran University of Medical Sciences in 2016

BACKGROUND

Research self-efficacy is one of the main factors influencing the successful conduction of research and following it in students. This study was performed with the aim of determining the research self-efficacy and its relationship with academic performance in postgraduate students of Tehran University of Medical Sciences (TUMS) in 2016.

MATERIALS AND METHODS

This cross-sectional study was performed on 320 postgraduate students of TUMS in 2016. Proportional stratified sampling was done with simple random sampling from each school. The data were gathered with Phillips and Russell's research self-efficacy questionnaire, demographic questions, and grade point average (GPA) and were analyzed with independent t-tests, ANOVA, Pearson's correlation, and multiple linear regressions in SPSS 18.

RESULTS

Out of 320 students participating in this study, 152 patients (47.5%) were male and 168 (52.5%) were female with the mean age of 27.83 ± 4.3 years. The mean of research self-efficacy score was 186.18 ± 59.5 which was significant depended on college degrees and was significantly higher in doctorate students (P = 0.0001). However, no significant difference was seen in research self-efficacy score of students due to gender (P = 0.754) and school (P = 0.364). There was a significant direct relationship between students' GPA and research self-efficacy score (r = 0.393, P = 0.0001).

CONCLUSIONS

Results of this study showed that the research self-efficacy score of TUMS postgraduate students is at an acceptable level, except the quantitative and computer skills that need appropriate educational interventions. As a direct and significant relationship existed between research self-efficacy score and student's academic performance, improving the research self-efficacy will also increase students' academic performance.

Academic career intentions in the life sciences: Can research self-efficacy beliefs explain low numbers of aspiring physician and female scientists?

A lack of physician scientists as well as a high female dropout rate from academic medicine and basic life sciences is a concern in many countries. The current study analyzes academic career intentions within a sample of recent doctoral graduates from medicine and basic life sciences (N = 1109), focusing on research self-efficacy beliefs as explanatory variable of gender and disciplinary differences. To ensure that differences in research self-efficacy could not be attributed solely to objective scientific performance, we controlled for number of publications and dissertation grade. The results of multivariate analyses pointed to a strong and significant association between research self-efficacy and academic career intentions (ß = 0.49, p<0.001). The lower academic career intentions of medical doctoral graduates were no longer significant when controlling for research self-efficacy. Within the field of medicine, female doctoral graduates expressed lower research self-efficacy beliefs and academic career intentions. When controlling for research self-efficacy, the correlation between gender and academic career intention was no longer significant. In contrast, no gender differences were found within the basic life sciences with respect to neither academic career intentions nor research self-efficacy.

Examining Summer Laboratory Research Apprenticeships for High School Students as a Factor in Entry to MD/PhD Programs at Matriculation

Do summer laboratory research apprenticeships during high school have an impact on entry into MD/PhD programs? Apart from the nearly decade-long span of time between high school and matriculation into an MD/PhD program, young people have many life-shaping experiences that presumably impact their education and career trajectories. This quantitative study (n = 236,432) examines the connection between early laboratory research apprenticeship experiences at the high school level and matriculation into one of the more rigorous educational programs for scientific research training. The span of time covered by this analysis reaches across more than a decade, examining the potential importance of research experiences during the precollege years in the educational trajectory of young people. Intertwined with this question on research experiences is a second major concern regarding diversity in the life sciences research corps. Diversity in this wide-ranging discipline refers specifically to the underrepresentation of Blacks/African Americans, Hispanics/Latino/as, and American Indians/Alaska Natives among the ranks of research scientists. Thus, this study includes analyses that specifically focus on research apprenticeships of Blacks/African Americans and Hispanics/Latino/as and their entrance into MD/PhD programs.

Defining Attributes and Metrics of Effective Research Mentoring Relationships

Despite evidence of mentoring's importance in training researchers, studies to date have not yet determined which mentoring relationships have the most impact and what specific factors in those mentoring relationships contribute to key outcomes, such as the commitment to and persistence in research career paths for emerging researchers from diverse populations. Efforts to broaden participation and persistence in biomedical research careers require an understanding of why and how mentoring relationships work and their impact, not only to research training but also to promoting career advancement. This paper proposes core attributes of effective mentoring relationships, as supported by the literature and suggested by theoretical models of academic persistence. In addition, both existing and developing metrics for measuring the effectiveness of these attributes within mentoring relationships across diverse groups are presented, as well as preliminary data on these metrics from the authors' work.

Association of research self-efficacy with medical student career interests, specialization, and scholarship: a case study

This study used variables proposed in social cognitive career theory (SCCT) to focus the evaluation of a research curriculum at the Cleveland Clinic Lerner College of Medicine of Case Western Reserve University (CCLCM). Eight cohorts of CCLCM medical students completed a web-based version of the six-scale Clinical Research Appraisal Inventory-Short Form (CRAI-SF) items at matriculation (n = 128) or graduation (n = 111) during 2009-2013. Parametric statistics were used to compare CRAI-SF scales to domains proposed in SCCT: trainees' characteristics (gender, training level, advanced degree), career interests, career intentions (medical specialty), and performance (peer-reviewed publications and required thesis topic). A number of lessons emerged in using theory to frame the evaluation of a complex educational program. Graduates rated their research self-efficacy significantly higher on all six CRAI-SF scales with large effect sizes (>.90) on five scales (Conceptualizing a Study, Study Design and Analysis, Responsible Research Conduct, Collaborating with Others, and Reporting a Study). Women and men did not have significantly different scores on CRAI-SF scales (p > .05), suggesting that the research program provides adequate supports for women students. Most thesis projects addressed clinical (36.9 %, n = 41) or translational (34.2 %, n = 38) research topics. The CRAI-SF discriminated between medical school matriculates and graduates, suggesting that research self-efficacy increases with mastery experiences. No significant relationships occurred between CRAI-SF scores and graduates' thesis topics or chosen clinical specialty. Correlations demonstrated significant relationships between graduates' perceptions of research self-efficacy and their interest in clinical research careers.

A Pharmacology-Based Enrichment Program for Undergraduates Promotes Interest in Science

There is a strong need to increase the number of undergraduate students who pursue careers in science to provide the "fuel" that will power a science and technology-driven U.S. economy. Prior research suggests that both evidence-based teaching methods and early undergraduate research experiences may help to increase retention rates in the sciences. In this study, we examined the effect of a program that included 1) a Summer enrichment 2-wk minicourse and 2) an authentic Fall research course, both of which were designed specifically to support students' science motivation. Undergraduates who participated in the pharmacology-based enrichment program significantly improved their knowledge of basic biology and chemistry concepts; reported high levels of science motivation; and were likely to major in a biological, chemical, or biomedical field. Additionally, program participants who decided to major in biology or chemistry were significantly more likely to choose a pharmacology concentration than those majoring in biology or chemistry who did not participate in the enrichment program. Thus, by supporting students' science motivation, we can increase the number of students who are interested in science and science careers.

The Role of Scientific Communication Skills in Trainees' Intention to Pursue Biomedical Research Careers: A Social Cognitive Analysis

Scientific communication (SciComm) skills are indispensable for success in biomedical research, but many trainees may not have fully considered the necessity of regular writing and speaking for research career progression. Our purpose was to investigate the relationship between SciComm skill acquisition and research trainees' intentions to remain in research careers. We used social cognitive career theory (SCCT) to test a model of the relationship of SciComm skills to SciComm-related cognitive variables in explaining career intentions. A sample of 510 graduate students and postdoctoral fellows at major academic health science centers in the Texas Medical Center, Houston, Texas, were surveyed online. Results suggested that interest in performing SciComm tasks, SciComm outcome expectations (SCOEs), and SciComm productivity predicted intention to remain in a research career, while SciComm self-efficacy did not directly predict career intention. SCOEs also predicted interest in performing SciComm tasks. As in other SCCT studies, SciComm self-efficacy predicted SCOEs. We conclude that social cognitive factors of SciComm skill acquisition and SciComm productivity significantly predict biomedical trainees' intentions to pursue research careers whether within or outside academia. While further studies are needed, these findings may lead to evidence-based interventions to help trainees remain in their chosen career paths.

A shortened version of the Clinical Research Appraisal Inventory: CRAI-12

PURPOSE

The original Clinical Research Appraisal Inventory (CRAI), which assesses the self-confidence of trainees in performing different aspects of clinical research, comprises 92 items. Completing the lengthy CRAI is time-consuming and represents a considerable burden to respondents, yet the CRAI provides useful data for evaluating research training programs. The purpose of this study is to develop a shortened version of the CRAI and to test its validity and reliability.

METHOD

Trainees in clinical research degree and career development programs at the University of Pittsburgh's Institute for Clinical Research Education completed the 92-item CRAI between 2007 and 2012, inclusive. The authors conducted, first, exploratory factor analysis on a training dataset (2007-2010) to reduce the number of items and, then, confirmatory factor analyses on a testing dataset (2011-2012) to test the psychometric properties of the shortened version.

RESULTS

Of 546 trainees, 394 (72%) provided study data. Exploratory factor analysis revealed six distinct factors, and confirmatory factor analysis identified the two items with the highest loadings per factor, for a total of 12 items. Cronbach alpha for the six new factors ranged from 0.80 to 0.94. Factors in the 12-item CRAI were strongly and significantly associated with factors in the 92-item CRAI; correlations ranged from 0.82 to 0.96 (P < .001 for each).

CONCLUSIONS

The 12-item CRAI is faster and less burdensome to complete but retains the strong psychometric properties of the original CRAI.

Does stereotype threat affect women in academic medicine?

Multiple complex factors contribute to the slow pace of women's advancement into leadership positions in academic medicine. In this article, the authors propose that stereotype threat--under which individuals who are members of a group characterized by negative stereotypes in a particular domain perform below their actual abilities in that domain when group membership is emphasized--may play an important role in the underrepresentation of women in leadership positions in academic medicine. Research to objectively assess the impact of stereotype threat for women in academic medicine is feasible and necessary to confirm this hypothesis. Still, a number of conditions present in the academic medicine community today have been shown to trigger stereotype threat in other settings, and stereotype threat fits with existing research on gender in academic medicine. In the meantime, academic health centers should implement relatively simple measures supported by experimental evidence from other settings to reduce the risk of stereotype threat, including (1) introducing the concept of stereotype threat to the academic medicine community, (2) engaging all stakeholders, male and female, to promote identity safety by enacting and making faculty aware of policies to monitor potential instances of discrimination, and training faculty to provide performance feedback that is free of gender bias, (3) counteracting the effects of sex segregation at academic health centers by increasing exposure to successful female leaders, (4) reducing gender stereotype priming by avoiding stereotypically male criteria for promotion, grants, and awards, and (5) building leadership efficacy among female physicians and scientists.

Implementation of the medical research curriculum in graduate medical school

PURPOSE

The purpose of this study was to analyze the effect of the medical research curriculum on the students' satisfaction and the research self-efficacy.

METHODS

The curriculum was implemented to 79 graduate medical school students who entered in 2007 and 2008. This curriculum is implemented through 3 years consisting of 5 different sub-courses: Research design, Research ethics, Medical statistics, Writing medical paper, and Presentation. The effect of this program was measured with 2 self-administered surveys to students: the course satisfaction survey and the self-efficacy inventories. The Research Self-Efficacy Scale consisted of 18 items from 4 categories: Research design, Research ethics, Data analysis, and Result presentation. The descriptive statistics, paired t-test, and analysis of covariance (ANCOVA) were implemented.

RESULTS

The average point of satisfaction of the course was 2.74 out of 4, which told us that students generally satisfied with the course. The frequencies of tutoring for research course were 2 or 3 times on average and each session of tutorial lasted 1.5 to 2 hours. The research self-efficacy in three categories (Research design, Research ethics, and Result presentation) increased significantly (p<0.1). The self-efficacy of the male students was higher than females' one. The self-efficacy was not significantly different by the experience of research paper writing at undergraduate level.

CONCLUSION

The curriculum showed positive results in cultivating research self-efficacy of students. There is a need for improvement of the class of Statistical analysis as students reported that it was difficult.

Integrating theory and practice to increase scientific workforce diversity: a framework for career development in graduate research training

Few, if any, educational interventions intended to increase underrepresented minority (URM) graduate students in biological and behavioral sciences are informed by theory and research on career persistence. Training and Education to Advance Minority Scholars in Science (TEAM-Science) is a program funded by the National Institute of General Medical Sciences at the University of Wisconsin-Madison with the twin goals of increasing the number of URM students entering and completing a PhD in BBS and increasing the number of these students who pursue academic careers. A framework for career development in graduate research training is proposed using social cognitive career theory. Based on this framework, TEAM-Science has five core components: 1) mentor training for the research advisor, 2) eight consensus-derived fundamental competencies required for a successful academic career, 3) career coaching by a senior faculty member, 4) an individualized career development plan that aligns students' activities with the eight fundamental competencies, and 5) a strengths, weaknesses, opportunities, and threats personal career analysis. This paper describes the theoretical framework used to guide development of these components, the research and evaluation plan, and early experience implementing the program. We discuss the potential of this framework to increase desired career outcomes for URM graduate trainees in mentored research programs and, thereby, strengthen the effectiveness of such interventions on participants' career behaviors.