Show Me the Money: Successfully Obtaining Grant Funding in Medical Education

Supporting Medical Education Innovation: Evaluation of a Grants Initiative

PROBLEM

Medical education must evolve to meet the changing needs of patients and communities. Innovation is a critical component of that evolution. As medical educators pursue innovative curricula, assessments, and evaluation techniques, the impact of innovations may be limited by minimal funding. The American Medical Association (AMA) Innovation Grant Program, launched in 2018, seeks to address the gap in funding and stimulate educational innovation and research in medical education.

APPROACH

In 2018 and 2019, the Innovation Grant Program targeted innovation in content areas including health systems science, competency-based medical education, coaching, learning environment, and emerging technology. The authors reviewed the content of applications and final reports for the 27 projects completed during the first 2 years of the program. They also noted measures of success (completion of project, achievement of grant objectives, development of transferrable educational product, dissemination).

OUTCOMES

In 2018, the AMA received 52 submissions and funded 13 proposals, dispersing $290,000 ($10,000 and $30,000 grants). In 2019, the AMA received 80 submissions and funded 15 proposals, dispersing $345,000. Among the 27 completed grants, 17 (63%) supported innovations related to health systems science. Fifteen (56%) were used to create educational products that could be shared, such as new assessment tools, curricula, and teaching modules. Five grant recipients (29%) published articles and 15 (56%) presented at national conferences.

NEXT STEPS

The grant program advanced educational innovations, particularly in health systems science. The next steps will involve examining the long-term outcomes and impact of the completed projects on medical students, patients, and the health system; the professional development of the grantees; and the adoption and dissemination of the innovations.

Autonomy lessons: Tips and tricks for building self-determination through the lens of a first time principal investigator

Early career faculty face many challenges, including establishing a career direction, building skills, balancing work and personal life demands, finding mentors, and establishing collegial relationships within their departments. Early career funding has been shown to augment future success in academia; less is known about the impact of early career funding on the social, emotional, and professional identity aspects of work life. One theoretical perspective to examine this issue is self-determination theory, a broad psychological paradigm explaining motivation, well-being, and development. Self-determination theory is predicated on the idea that fulfillment of three basic needs leads to the achievement of integrated well-being. Optimizing autonomy (a sense of choice and control), competence (sense of mastery), and relatedness (a sense of belonging) accompanies greater motivation, productivity, and perceived success. The authors share how applying for and implementing an early career grant affected these three constructs. Early career funding manifested challenges and beneficial outcomes in relationship to each of the three psychological needs and led to important lessons that may be generally applicable to faculty across a wide range of disciplines. The authors offer broad principles as well as specific grant-related strategies for optimizing autonomy, competence, and relatedness while applying for and executing a grant.[Box: see text].

An analysis of vascular surgery education publications reveals an educational shortage

BACKGROUND

As vascular surgery training continues to evolve with the growth of integrated vascular surgery residency (0+5) programs and the consolidation of fellowship programs, optimizing all aspects of the education for vascular surgery trainees, both fellows and 0+5 residents, has become increasingly important. In the present study, we aimed to determine the prevalence, quality, and content of vascular surgery education publications across journals.

METHODS

Journal websites (n = 26) and PubMed were queried to identify vascular surgery education publications from 2012 to 2021. The publications were organized into 11 content categories: (1) curriculum, (2) simulation, (3) trainee assessment, (4) program evaluation, (5) wellness/burnout, (6) diversity/inclusion, (7) mentorship/career, (8) case outcomes, (9) perceptions of training, (10) social media, and (11) other. Publication interactivity and quality were measured via PlumX data and Medical Education Research Study Quality Instrument scores. The data were analyzed via univariate analysis and linear regression.

RESULTS

A total of 115 vascular surgery education publications (0.2% [interquartile range (IQR), 0.04%-0.5%] of total publications) were identified from the selected journals. The Journal of Vascular Surgery had the highest proportion (0.8%) of vascular surgery education publications, followed by the Journal of Surgical Education (0.7%) and Annals of Vascular Surgery (0.6%). Vascular surgery journals constituted most (79%) of the publications. Of the authors, 15% (IQR, 0%-25%) had a master's or doctorate degree in education. Senior authors were more often identified as male gender (77%), and more first authors (41%) were identified as female gender. An interactivity analysis showed that there were 10.3 citations (IQR, 12), 33.1 captures (IQR, 34), and 8.4 social media interactions (IQR 14) per publication. The educational quality had a median Medical Education Research Study Quality Instrument score of 11 (IQR, 9-12.5), with 49% of publications having a score greater than the median. Publications on training (44% curriculum and 20% simulation) were significantly more frequent than other topics (P < .001), with no change in the publication content over 10 years (P = .29). The volume of vascular surgery education publications did not change during the study period (P = .13) despite the ongoing changes in the educational environment.

CONCLUSIONS

Despite the increasing importance placed on vascular surgery education by national vascular societies, publications on vascular surgery education have remained sparse among all journals. Also, the vascular surgery educational content has not changed during the past 10 years, with a primary focus on curriculum and simulation training. Further promotion of vascular surgery educational research is required to increase the quality, volume, and diversity of education publications.

Plastic Surgeons as Medical Directors: A Natural Transition into Medical Leadership

With the growing complexity of the U.S. health care system, highly motivated medical directors with strong leadership skills are vital to the success of health care facilities. Presently, there are no articles assessing a plastic surgeon's qualifications for the role of medical director. In addition, there is a paucity of literature comparing the responsibilities of medical directors across various types of health care institutions. Herein, we outline why plastic surgeons have the unique skillset to succeed in this role and highlight the differences between medical director positions across the vast landscape of health care. While the intricacies of this position vary greatly across different landscapes of the health care industry, successful medical directors lead by following a set of universal principles predisposing them for success. Plastic surgeons innately exhibit a subset of particular traits deeming them suitable candidates for the medical director position. While transitioning from the role of a surgeon to that of a medical director does require some show of adaptation, plastic surgeons are ultimately highly likely to find intrinsic benefit from serving as a medical director.

Quantifying teaching quality in medical education: The impact of learning gain calculation

BACKGROUND

Student performance is a mirror of teaching quality. The pre-/post-test design allows a pragmatic approach to comparing the effects of interventions. However, the calculation of current knowledge gain scores introduces varying degrees of distortion. Here we present a new metric employing a linear weighting coefficient to reduce skewness on outcome interpretation.

METHODS

We compared and contrasted a number of common scores (raw and relative gain scores) with our new method on two datasets, one simulated and the other empirical from a previous intervention study (n = 180) employing a pre-/post-test design.

RESULTS

The outcomes of the common scores were clearly different, demonstrating a significant dependency on pre-test scores. Only the new metric revealed a linear relationship to the knowledge baseline, was less skewed on the upper or lower extremes, and proved well suited to allow the calculation of negative learning gains. Employing the empirical dataset, the new method also confirmed the interaction effect of teaching formats with specific subgroups of learner characteristics.

CONCLUSION

This work introduces a new weighted metric enabling meaningful comparisons between interventions based on a linear transformation. This method will form the basis to intertwine the calculation of test performance closely with the outcome of learning as an important factor reflecting teaching quality and efficacy. Its regular use can improve the transparency of teaching activities and outcomes, contribute to forming rounded judgements of students' acquisition of knowledge and skills and enable valuable feedforward to develop and enhance curricular concepts.

Beyond the CLAIM: A comprehensive needs assessment strategy for creating an Advanced Medical Education Research Training Program (ARMED-MedEd)

BACKGROUND

The health professions education (HPE) landscape has shifted substantively with increasing professionalization of research and scholarship. Clinician educators seeking to become competitive in this domain often pursue fellowships and master's degrees in HPE, but there are few resources for the continuing professional development (CPD) of those who seek to continue developing their scholarly practice within HPE. Acknowledging the multiple players in this landscape, the authors sought to design a new "beyond beginners" HPE research program using a novel needs assessment planning process.

METHODS

The authors developed and conducted a new three-phase, five-step process that sets forth a programmatic approach to conducting a needs assessment for a CPD course in HPE research. The five steps of the CLAIM method are: Competitive analysis, Literature review with thematic analysis, Ask stakeholders, Internal review by experts, and Mapping of a curriculum. These steps are organized into three phases (Discovery, Convergence, and Synthesis).

RESULTS

Over a 12-month period, the authors completed a comprehensive needs assessment. The CLAIM process revealed that longitudinal digital connection, diverse and in depth exposure to HPE research methods, skills around scholarly publishing, and leadership and management of research would be beneficial to our design.

CONCLUSIONS

The CLAIM method provided scaffolding to help the authors create a robust curriculum that adopts a scholarly approach for developing a HPE research course. This needs assessment methodology may be useful in other CPD contexts.

The sticky surgical floor: An analysis of female authorship trends in vascular surgery

OBJECTIVE

Prior research in vascular surgery has identified significant gender disparities in leadership positions, but few data exist regarding gender disparities in vascular publications. This study aims to evaluate authorship trends by gender in the three highest impact factor vascular surgery journals.

METHODS

In this bibliometric analysis, PubMed was searched for articles published in the European Journal of Vascular and Endovascular Surgery, the Journal of Vascular Surgery, and Annals of Vascular Surgery from 2015 to 2019. The web-based application Genderize used predictive algorithms to classify names of first and last authors as male or female. Statistical analyses regarding trends in authorship were performed using Stata16.

RESULTS

A total of 6457 articles were analyzed, with first author gender predicted with >90% confidence in 83% (4889/5796) and last author gender in 88% (5078/5796). Overall, 25% (1223/4889) of articles had women first authors, and 10% (501/5078) had women last authors. From 2015 to 2019, there was a slight increase in the proportion of articles written by women first authors (P = .001), but no increase in the proportion of articles written by women last authors (P = .204). The proportion of articles written by women last authors was lower than the proportion of active women vascular surgeons in 2015 (8% of articles vs 11% of surgeons; P = .015), 2017 (9% of articles vs 13% of surgeons; P < .001), and 2019 (11% of articles vs 15% of practicing surgeons; P < .001). The average number of last-author publications was higher for men (2.35 ± 3.76) than for women (1.62 ± 1.88, P = .001). The proportion of unique authors who were women was less than the proportion of active women vascular surgeons in 2017 (10% unique authors vs 13% surgeons; P = .047), but not in 2015 (9% unique authors vs 11% surgeons; P = .192) or 2019 (13% unique authors vs 15% surgeons; P = .345). Notably, a woman last author was associated with 1.45 higher odds of having a woman first author (95% confidence interval, 1.17-1.79; P = .001).

CONCLUSIONS

Over the past 5 years, there has been no significant increase in women last authors among top-tier journals in vascular surgery. Women remain under-represented as last authors in terms of proportion of published articles, but not in terms of proportion of unique authors. Nevertheless, women last authors are more likely to publish with women first authors, indicating the importance of women-led mentorship in achieving publication gender equity. Support for women surgeons through grants and promotions is essential not only for advancing last authorship gender equity, but for advancing junior faculty and trainee academic careers.

Addressing barriers to the conduct and application of research in complementary and alternative medicine: a scoping review

BACKGROUND

Over the past few decades, the popularity of complementary and alternative medicine (CAM) has grown considerably and along with it, scrutiny regarding its evidence base. While this is to be expected, and is in line with other health disciplines, research in CAM is confronted by numerous obstacles. This scoping review aims to identify and report the strategies implemented to address barriers to the conduct and application of research in CAM.

METHODS

The scoping review was undertaken using the Arksey and O'Malley framework. The search was conducted using MEDLINE, EMBASE, EMCARE, ERIC, Scopus, Web of Science, The Cochrane Library, JBI and the grey literature. Two reviewers independently screened the records, following which data extraction was completed for the included studies. Descriptive synthesis was used to summarise the data.

RESULTS

Of the 7945 records identified, 15 studies met the inclusion criteria. Using the oBSTACLES instrument as a framework, the included studies reported diverse strategies to address barriers to the conduct and application of research in CAM. All included studies reported the use of educational strategies and collaborative initiatives with CAM stakeholders, including targeted funding, to address a range of barriers.

CONCLUSIONS

While the importance of addressing barriers to the conduct and application of research in CAM has been recognised, to date, much of the focus has been limited to initiatives originating from a handful of jurisdictions, for a small group of CAM disciplines, and addressing few barriers. Myriad barriers continue to persist, which will require concerted effort and collaboration across a range of CAM stakeholders and across multiple sectors. Further research can contribute to the evidence base on how best to address these barriers to promote the conduct and application of research in CAM.

The power of interdependence: Linking health systems, communities, and health professions educational programs to better meet the needs of patients and populations

Promoting optimal health outcomes for diverse patients and populations requires the acknowledgement and strengthening of interdependent relationships between health professions education programs, health systems, and the communities they serve. Educational programs must recognize their role as integral components of a larger system. Educators must strive to break down silos and synergize efforts to foster a health care workforce positioned for collaborative, equitable, community-oriented practice. Sharing interprofessional and interinstitutional strategies can foster wide propagation of educational innovation while accommodating local contexts. This paper outlines how member schools of the American Medical Association Accelerating Change in Medical Education Consortium leveraged interdependence to accomplish transformative innovations catalyzed by systems thinking and a community of innovation.

Emergency Medicine Education Research Since the 2012 Consensus Conference: How Far Have We Come and What's Next?

In 2012, the Society for Academic Emergency Medicine convened a consensus conference on the state of medical education research with goals of defining and advancing a future research agenda. Since that time, emergency medicine (EM) education research has grown significantly. A task force of EM education experts was assembled and sought to understand the current state of EM education research and future directions. Among the advances are increases in medical education fellowships, advanced degree and certification programs, faculty development programs, publication venues, and funding. These findings are discussed in light of the prior objectives from the 2012 consensus conference, and recommendations for future directions are provided.