The evaluation of scholarship in academic promotion and tenure processes: Past, present, and future

From group mentoring to collective liberation: The imperative to decolonize nursing academia

BACKGROUND

Four Black early-career faculty members, one Black doctoral student, and a Black senior faculty member, (herein referred to as scholars), previously engaged in cross-cultural mentoring with a White senior researcher to bolster their scholarship.

PURPOSE

In the years following the 2020 racial reckoning, the scholars were motivated to reconvene by the realization that traditional scholarship activities of academia ignore historical educational oppression and fail to account for the contemporary effects of racism and discrimination rooted in American colonialism.

METHODS

Collaborative autoethnography, a decolonizing qualitative approach to research, was used to explicate our journeys in academia. The tenets of Freire's critical pedagogy (conscientização, scholarship, praxis) framed our collective experiences.

DISCUSSION

We describe resisting academic structures of power, discrimination, and disadvantage through reformation, crafting a vision statement, and utilizing positions of influence.

CONCLUSION

To decolonize nursing academia, we implore the scholarly community to pursue liberation and contest structures that center Whiteness and marginalize collectivism and collaboration.

A call for open science in forensics

The modern canon of open science consists of five "schools of thought" that justify unfettered access to the fruits of scientific research: i) public engagement, ii) democratic right of access, iii) efficiency of knowledge gain, iv) shared technology, and v) better assessment of impact. Here, we introduce a sixth school: due process. Due process under the law includes a right to "discovery" by a defendant of potentially exculpatory evidence held by the prosecution. When such evidence is scientific, due process becomes a Constitutional mandate for open science. To illustrate the significance of this new school, we present a case study from forensics, which centers on a federally funded investigation that reports summary statistics indicating that identification decisions made by forensic firearms examiners are highly accurate. Because of growing concern about validity of forensic methods, the larger scientific community called for public release of the complete analyzable dataset for independent audit and verification. Those in possession of the data opposed release for three years while summary statistics were used by prosecutors to gain admissibility of evidence in criminal trials. Those statistics paint an incomplete picture and hint at flaws in experimental design and analysis. Under the circumstances, withholding the underlying data in a criminal proceeding violates due process. Following the successful open-science model of drug validity testing through "clinical trials," which place strict requirements on experimental design and timing of data release, we argue for registered and open "forensic trials" to ensure transparency and accountability.

A framework for understanding an open scientific community using automated harvesting of public artifacts

Background

The Observational Health Data Sciences and Informatics (OHDSI) community has emerged as a leader in observational research on real-world clinical data for promoting evidence for healthcare and decision-making. The community has seen rapid growth in publications, citations, and the number of authors. Components of its successful uptake have been attributed to an open science and collaborative culture for research and development. Investigating the adoption of OHDSI as a field of study provides an opportunity to understand how communities embrace new ideas, onboard new members, and enhance their impact.

Objective

To track, study, and evaluate an open scientific community's growth and impact.

Method

We present a modern architecture leveraging open application programming interfaces to capture publicly available data (PubMed, YouTube, and EHDEN) on open science activities (publication, teaching, and engagement).

Results

Three interactive dashboard were implemented for each publicly available artifact (PubMed, YouTube, and EHDEN). Each dashboard provides longitudinal summary analysis and has a searchable table, which differs in the available features related to each public artifact.

Conclusion

We discuss the insights enabled by our approach to monitor the growth and impact of the OHDSI community by capturing artifacts of learning, teaching, and creation. We share the implications for different users based on their functional needs. As other scientific networks adopt open-source frameworks, our framework serves as a model for tracking the growth of their community, driving the perception of their development, engaging their members, and attaining higher impact.

Barriers to Scholarship Among Health Profession Faculty at a Public Institution of Higher Learning

Like any other career, pursuing a career in academia comes with positives and negatives. Faculty members teaching in higher education come from various backgrounds, with different skill sets and training. While barriers to scholarly production exist at many levels, and for various reasons, not much is known about faculty members teaching in clinical and health professions programs mainly due to the limited availability of data on this topic. This research aimed to explore the barriers to scholarly productivity faced by faculty members teaching in health professions programs at a public academic institution. A qualitative inductive approach using thematic analysis was used for this research. Participants from the Physician Assistant, Nursing, Clinical Laboratory Science, Occupational Therapy, and Social Work programs were recruited to share their experiences through an in-depth, one-on-one interview. Four main themes emerged from the data regarding barriers to scholarship among health profession faculty members. These are the need for mentorship, resource availability, time constraints, and the lack of discipline-specific guidance. Navigating the reappointment, tenure, and promotion grid can be challenging for many in academia, particularly those new to the profession. It is important for academic institutions to provide faculty members with the flexibility, tools, resources, and appropriate mentorship to boost their buy-in, morale, productivity, and self-esteem, all of which are expected to create a positive environment within the institution.

A scoping review to identify barriers and facilitators of research participation among chiropractic faculty

OBJECTIVE

To describe peer-reviewed literature on chiropractic faculty participation in research and identify important barriers and facilitators.

METHODS

We conducted a scoping review using comprehensive searches of relevant databases from inception through November 2022. English language publications of any design were included, with search terms consisting of subject headings specific to each database and free text words related to chiropractic, faculty, and research. Primary and secondary reviewer teams performed article screening and data abstraction using Covidence software, with primary reviewers responsible for consensus. Data were entered into evidence tables and analyzed descriptively.

RESULTS

A total of 330 articles were screened, with 14 deemed eligible including 8 cross-sectional/correlational studies and 6 narrative reviews/editorials. Article publication dates ranged from 1987 to 2017. No intervention studies were identified. Facilitators of chiropractic faculty research included research assignment as primary role, institutional culture promoting research, and dedicated release time. Barriers included teaching/clinic assignments, lack of incentives and mentorship, and teaching load. Qualitative results identified 5 domains impacting faculty research: demographics/professional roles; personal empowerment; research culture; institutional setting/policies; and research training.

CONCLUSION

Our scoping review found a paucity of recently published articles on chiropractic faculty participation in research. Educational institutions building research capacity among chiropractic faculty must establish cultural environments where scholarship is expected, rewarded, and valued. Tangible support, such as research policies, resources, and space, advanced training, funding, and release time, must be available. Faculty are encouraged to build upon key facilitators, evaluate interventions to address barriers to chiropractic faculty research, and publish their results.

Trends in research grant applications and outcomes among medical students in the United Kingdom: a national self-reported cross-sectional survey

BACKGROUND

Research funding disparities contribute to clinical academic workforce inequalities. Hence, our study explores the association between student demographics and research grant application rates and outcomes among UK medical students.

METHODS

This is a national multicentre cross-sectional survey of UK medical students in the 2020-21 academic year. Multiple zero-inflated negative binomial regression and generalized linear model (binomial distribution; logit link) were utilized to investigate the association between student demographics, number of grant applications submitted, and successful grant applications (yes or no). P-values less than a Bonferroni-corrected significance level of 0.05/36 = 0.0014 were considered to be statistically significant.

RESULTS

A total of 1528 students participated from 36 medical schools. One hundred fifty-one respondents (9.9%) had applied for research grants. Black students submitted applications 2.90 times more often than white students [Incident rate ratio (IRR): 2.90, 95% confidence interval (CI): 1.37-6.16], with no ethnic disparity in the odds of successful applications. Gender did not influence application rates significantly (P = .248), but women were 4.61 times more likely to secure a grant than men [odds ratio: 4.61, 95% CI: 2.04-10.4]. Being a PubMed-indexed author was associated with increased grant application submission rates [IRR: 3.61, 95% CI: 2.20- 5.92] while conducting more research was associated with greater odds of securing a grant [odds ratio: 1.42, 95% CI: 1.17- 1.73].

CONCLUSION

Although black students submitted more applications, ethnicity did not influence success rates. Gender did not influence application rates, but women were more successful. These findings underscore the need for strategies supporting women and underrepresented students for continued academic achievement after graduation.

KEY MESSAGES

What is already known on this topic Research funding for post-PhD researchers is believed to be a major driver of gender and ethnic inequalities in the clinical academic workforce.Students who receive research grants are more likely to receive postgraduate research grants.What this study adds Black students applied for more research grants than white students, but there were no ethnic differences in the odds of securing a grant.There were no gender differences in the research grant application rates. However, female students had greater odds of securing research grants compared to male students.How this study might affect research, practice or policy Medical schools should incorporate grant writing skills into the undergraduate research curriculum. Also, to sustain women's academic success post medical school, the NIHR and affiliates should provide research award extensions and childcare support for women when required.

Relationships among cost, citation, and access in journal publishing by an ecology and evolutionary biology department at a U.S. university

Background

Optimizing access to high-quality scientific journals has become an important priority for academic departments, including the ability to read the scientific literature and the ability to afford to publish papers in those journals. In this contribution, we assess the question of whether institutional investment in scientific journals aligns with the journals where researchers send their papers for publication, and where they serve as unpaid reviewers and editors.

Methods

We assembled a unique suite of information about the publishing habits of our Department of Ecology and Evolutionary Biology, including summaries of 3,540 journal publications by 35 faculty members. These data include economic costs of journals to institutions and to authors, benefits to authors in terms of journal prestige and citation rates, and considerations of ease of reading access for individuals both inside and outside the university. This dataset included data on institutional costs, including subscription pricing (rarely visible to scholars), and "investment" by scholars in supporting journals, such as time spent as editors and reviewers.

Results

Our results highlighted the complex set of relationships between these factors, and showed that institutional costs often do not match well with payoffs in terms of benefits to researchers (e.g., citation rate, prestige of journal, ease of access). Overall, we advocate for greater cost-benefit transparency to help compare different journals and different journal business models; such transparency would help both researchers and their institutions in investing wisely the limited resources available to academics.

Addressing Diversity, Equity, and Inclusivity Contributions in Academic Review

BACKGROUND

The nursing profession and academic environments are increasingly calling for nurse educators to incorporate diversity, equity, and inclusion (DEI) goals and actions into their professional practice. Such work aligns with institutional and professional missions of social justice and antiracism.

PROBLEM

Historically, there has been an undervaluing and lack of recognition in academia of DEI contributions and qualitative or community-based research focused on health equity. This lack of recognition may disproportionately impact faculty who focus their scholarship and research on marginalized communities.

APPROACH

The current state of the academic review of DEI contributions for appointment, promotion, and tenure is presented. Examples for teaching, research and scholarship, practice, and service are provided.

OUTCOMES

Recommendations include expanding recognition and evaluation of academic scholarship and advocacy against efforts to dismantle social justice and antiracism advances within academia.

CONCLUSION

Examining hegemonic norms is vital to promote more equitable power structures in academic environments.

COVID-19 as a chronic stressor and the importance of individual identity: A data-driven look at academic productivity during the pandemic

The COVID-19 pandemic impacted personal and professional life. For academics, research, teaching, and service tasks were upended and we all had to navigate the altered landscape. However, some individuals faced a disproportionate burden, particularly academics with minoritized identities or those who were early career, were caregivers, or had intersecting identities. As comparative endocrinologists, we determine how aspects of individual and species-level variation influence response to, recovery from, and resilience in the face of stressors. Here, we flip that framework and apply an integrative biological lens to the impact of the COVID-19 chronic stressor on our endocrine community. We address how the pandemic altered impact factors of academia (e.g., scholarly products) and relatedly, how factors of impact (e.g., sex, gender, race, career stage, caregiver status, etc.) altered the way in which individuals could respond. We predict the pandemic will have long-term impacts on the population dynamics, composition, and landscape of our academic ecosystem. Impact factors of research, namely journal submissions, were altered by COVID-19, and women authors saw a big dip. We discuss this broadly and then report General and Comparative Endocrinology (GCE) manuscript submission and acceptance status by gender and geographic region from 2019 to 2023. We also summarize how the pandemic impacted individuals with different axes of identity, how academic institutions have responded, compile proposed solutions, and conclude with a discussion on what we can all do to (re)build the academy in an equitable way. At GCE, the first author positions had gender parity, but men outnumbered women at the corresponding author position. Region of manuscript origin mattered for submission and acceptance rates, and women authors from Asia and the Middle East were the most heavily impacted by the pandemic. The number of manuscripts submitted dropped after year 1 of the pandemic and has not yet recovered. Thus, COVID-19 was a chronic stressor for the GCE community.

A Mixed-Methods Analysis of the Promotion and Tenure Process for Experiential Education Faculty

OBJECTIVE

To understand the process of the promotion and tenure (P&T) as experienced by faculty members in experiential education (EE).

METHODS

A quantitative survey of EE faculty at any academic rank investigated the general landscape of experiences in P&T. Phenomenological qualitative interviews with faculty who currently work in EE and who achieved promotion to full professor while working within EE provided additional context. Analysis was completed using a mixed-methods approach. Incomplete survey responses were excluded.

RESULTS

Survey respondents indicated feeling different from other clinical faculty, particularly in the need to justify their work to the P&T committee (26/38; 68%). Respondents noted how challenging the P&T process was and perceived a lack of understanding of EE work among P&T committee members, chairs, and/or colleagues. In qualitative interviews, 3 themes emerged, which were characterizing a misunderstood role; navigating an unclear process with creativity and courage; and seeking outside-of-the-box mentoring.

CONCLUSION

Experiential education faculty may require specific guidance and a thoughtful approach in tailoring their dossier for the P&T process, especially in accounting for administrative work and other unique aspects of the role. To promote inclusivity and retention of EE faculty, greater understanding of the EE role is needed as it applies to guidelines for P&T. Furthermore, EE faculty and others with unique roles should receive guidance to meaningfully apply P&T guidelines in a manner that best represents their role.

Female Representation at the Association of Program Directors in Surgery Annual Meeting: Moving Towards Gender Equality

OBJECTIVE

This study aims to evaluate the state and changes over time of female representation in Association of Program Directors in Surgery (APDS) leadership and annual meeting presenters and session leaders.

DESIGN, SETTING, AND PARTICIPANTS

APDS conference programs from 2013 to 2022 were reviewed to identify society leadership and meeting presenters and session leaders. Verified online profiles were used to gather professional role and reported gender. Descriptive statistics and t-tests compared female representation in the first half (2013-2017, prior) and second half of data (2018-2022, current).

RESULTS

Leadership of APDS was an average 22% women, increasing from 13% in 2013 to 37% in 2022, and significantly increased from prior to current period (p = 0.0004). Conference presenters and session leaders were 42% women overall, increasing from 30% in 2013 to 52% in 2022. An average 33% staff surgeons, 54% trainees, 64% education scientists, and 51% medical student participants were female. Staff were 44% female in 2022 from 24% in 2013, significantly increased from prior to current period (p = 0.021). Comparing prior and current period cohorts, female presenters for paper sessions increased from 38% to 55% (p = 0.011), moderators from 15% to 39% (p = 0.046), and last author listed on presentation sessions from 18% to 32% (p = 0.010), while panelists, workshop directors, and presenters at all sessions increased without statistical significance. Female poster presenters decreased over time.

CONCLUSIONS

Female representation at APDS meetings has increased over time. Women are well represented compared to the 2022 member population of 36% women. While positions typically held by more senior members, such as leadership, panelists, moderators, and last authors remain lower than other roles, increases over time are encouraging. APDS female representation compares favorably to many other surgical societies. Translation of successful practices regarding gender representation utilized by APDS to other surgical organizations could expedite progress toward gender parity in the field.

Development and Validation of an Automated Tool to Retrieve and Curate Faculty Publications of Academic Departments

Introduction Academic departments need to monitor their faculty's academic productivity for various purposes, such as reporting to the medical school dean, assessing the allocation of non-clinical research time, evaluating for rank promotion, and reporting to the Accreditation Council for Graduate Medical Education (ACGME). Our objective was to develop and validate a simple method that automatically generates query strings to identify and process distinct department faculty publications listed in PubMed and Scopus. Methods We created a macro-enabled Excel workbook (Microsoft, Redmond, WA) to automate the retrieval of faculty publications from the PubMed and Scopus bibliometric databases (available at https://bit.ly/get-pubs). Where the returned reference includes the digital object identifier (doi), a link is provided in the workbook. Duplicate publications are removed automatically, and false attributions are managed. Results At the University of Miami, between 2020 and 2021, there were 143 anesthesiology faculty-authored publications with a PubMed identifier (PMID), 95.8% identified by the query and 4.2% missed. At Vanderbilt University Medical Center, between 2019 and 2021, there were 760 anesthesiology faculty-authored publications with a PMID, 94.3% identified by the query and 5.7% missed. Recall, precision, and the F1 score were all above 93% at both medical centers. Conclusions We developed a highly accurate, simple, transportable, scalable method to identify publications in PubMed and Scopus authored by anesthesiology faculty. Manual checking and faculty feedback are required because not all names can be disambiguated, and some references are missed. This process can greatly reduce the burden of curating a list of faculty publications. The methodology applies to other academic departments that track faculty publications.

Viewing research assessment, the academic reward system, and academic publishing through the power/knowledge lens of Foucault

The academic research assessment system, the academic reward system, and the academic publishing system are interrelated mechanisms that facilitate the scholarly production of knowledge. This article considers these systems using a Foucauldian lens to examine the power/knowledge relationships found within and through these systems. A brief description of the various systems is introduced followed by examples of instances where Foucault's power, knowledge, discourse, and power/knowledge concepts are useful to provide a broader understanding of the norms and rules associated with each system, how these systems form a network of power relationships that reinforce and shape one another.

Analysis of Teaching-Related Criteria Within Promotion and Tenure Documents from US Pharmacy Schools

OBJECTIVE

To describe teaching-related criteria within promotion and tenure (PT) guidance documents from US-based colleges/schools of pharmacy.

METHODS

PT guidance documents were retrieved from college/school websites or via electronic mail. Institutional characteristics were compiled using available online data. Using qualitative content analysis, a systematic review of PT guidance documents was conducted to identify how teaching and teaching excellence were considered in decision of promotion and/or tenure at each institution.

RESULTS

PT guidance documents were analyzed from 121 (85%) colleges/schools of pharmacy. Of these, 40% included a requirement that faculty must achieve excellence in teaching for promotion and/or tenure, though excellence was infrequently defined (14% of colleges/schools). Criteria specific to didactic teaching were most frequently included (94% of institutions). Criteria specific to experiential (50%), graduate student (48%), postgraduate (41%), and interprofessional (13%) teaching were less frequently included. Institutions frequently required student (58%) and peer (50%) evaluations of teaching to be considered in PT decisions. Most institutions acknowledged many teaching accomplishments as examples indicating teaching success rather than strictly requiring specific criteria to be fulfilled.

CONCLUSION

Teaching-related criteria within PT criteria of colleges/schools of pharmacy often lack clear guidance regarding quantitative or qualitative requirements for advancement. This lack of clearly specified requirements may result in faculty members' inability to self-assess for readiness for promotion and inconsistent application of criteria in PT decisions by review committees and administrators.

Female authorship trends in the field of colorectal surgery: A retrospective bibliometric study

Background

Gender disparity and hidden discrimination remained in the surgical subspecialties. This study aimed to explore the authorship gender composition in four high-impact colorectal surgery journals over the past two decades.

Method

This cross-sectional study queried the Web of Science Core Collection database and PubMed (MEDLINE) for articles published in four high-impact colorectal surgery specialty journals between 2000 and 2021 (Database accessed at July 2022). Extracted data included authors' full names, institutions, year of publication and total citation numbers. Authors' genders were assigned via gendrize.io, a third-party name predictor tool.

Results

100,325 authorship records were included in the final analysis. 21.8% of writers were identified as female, an increase from 11.4% (95% CI, 9.4%-13.3%) in 2000 to 26.5% (95% CI, 25.6%-27.4%) in 2021. Female authorship has risen in all authorship types, but women physicians were less likely to be the last authors than the first (OR, 0.63; 95%CI, 0.6-0.67) or middle authors (OR, 0.57; 95%CI, 0.55-0.60). Female authorship has also increased substantially in different document types, but female authorships were less likely in editorials than original articles (OR, 0.76; 95%CI, 0.7-0.83) and reviews (OR, 0.83; 95%CI, 0.74-0.94). Compared with male physicians, females were more likely to author in publications with reportable funding, either as first authors (OR, 1.46; 95%CI, 1.12-1.78) or last authors (OR, 1.51; 95%CI, 1.22-1.89). Authorship varied geographically, and countries with the highest female authorship percentage were mainly in Europe and North America.

Conclusion

Female authorship has grown substantially in colorectal surgery literature. However, female physicians were still underrepresented and less likely to assume senior or leading authorship roles.

Defining Scholarship for Today and Tomorrow

ABSTRACT

Scholarship, required for academic advancement, has traditionally been defined narrowly, not keeping pace with the expansion of faculty academic activities in health professions schools. How can we refine the definition of scholarship so that it better aligns with the scope of current faculty practice within academic health systems? Revision of the academic policies for promotion and tenure at the University of Massachusetts Chan Medical School afforded an opportunity to redefine scholarship such that a broader platform was available for faculty recognition, aligning with current academic standards, yet providing flexibility for the future. The authors describe the historical context of the definition of scholarship and their institution's process to construct a definition of scholarship with three essential elements: advancement of knowledge, dissemination for critical review, and impact on a discipline, practice, or community. Application of this definition to team science and digital scholarship is also described. Following a widespread continuing education initiative, implementation of the new definition within promotion and tenure processes of the medical, nursing, and graduate schools resulted in broad acceptance across the institution. This forum article provides lessons in leading an academic health sciences institution to reassess academic processes and is a resource for advancing the vigorous debate on the evolving meaning and evaluation of scholarship.

Could the altmetrics wave bring a flood of confusion for anatomists?

Altmetrics are non-traditional metrics that can capture downloads, social media shares, and other modern measures of research impact and reach. Despite most of the altmetrics literature focusing on evaluating the relationship between research outputs and academic impact/influence, the perceived and actual value of altmetrics among academicians remains nebulous and inconsistent. This work proposes that ambiguities surrounding the value and use of altmetrics may be explained by a multiplicity of altmetrics definitions communicated by journal publishers. A root cause analysis was initiated to compare altmetrics definitions between anatomy and medical education journal publishers' websites and to determine the comparability of the measurement and platform sources used for computing altmetrics values. A scoping content analysis of data from across eight publishers' websites revealed wide variability in definitions and heterogeneity among altmetrics measurement sources. The incongruencies among publishers' altmetrics definitions and their value demonstrate that publishers may be one of the root cause of ambiguity perpetuating confusion around the value and use of altmetrics. This review highlights the need to more deeply explore the root causes of altmetrics ambiguities within academia and makes a compelling argument for establishing a ubiquitous altmetrics definition that is concise, clear, and specific.

Best practices in scholarly publishing for promotion or tenure: Avoiding predatory journals

BACKGROUND

Predatory publishing has adverse impacts on scientific literature including nursing literature. These publishers have been described as having questionable publication standards. Many faculty have expressed challenges associated with assessing publisher and journal quality.

PURPOSE

The purpose of this article is to describe the development and implementation of faculty retention, promotion, and tenure guidelines offering explicit instructions and guidance for faculty on assessing the quality of publishers and journals.

METHOD

An appointed committee representing research, teaching, and practice scholarship performed a literature review on the topics of journal quality, scholarship for promotion and tenure, and best practices for evaluating scholarship in academic institutions.

RESULTS

The committee developed additional guidance to support and assist faculty assessing journal quality. Based on these guidelines, the faculty retention, promotion, and tenure guidelines for each of the research, teaching, and practice tracks were edited to reflect these practices.

CONCLUSIONS

The guidelines provided clarity for our promotion and tenure review committee and faculty.

Toward equitable open research: stakeholder co-created recommendations for research institutions, funders and researchers

Open Research aims to make research more accessible, transparent, reproducible, shared and collaborative. Doing so is meant to democratize and diversify access to knowledge and knowledge production, and ensure that research is useful outside of academic contexts. Increasing equity is therefore a key aim of the Open Research movement, yet mounting evidence demonstrates that the practices of Open Research are implemented in ways that undermine this. In response, we convened a diverse community of researchers, research managers and funders to co-create actionable recommendations for supporting the equitable implementation of Open Research. Using a co-creative modified Delphi method, we generated consensus-driven recommendations that address three key problem areas: the resource-intensive nature of Open Research, the high cost of article processing charges, and obstructive reward and recognition practices at funders and research institutions that undermine the implementation of Open Research. In this paper, we provide an overview of these issues, a detailed description of the co-creative process, and present the recommendations and the debates that surrounded them. We discuss these recommendations in relation to other recently published ones and conclude that implementing ours requires 'global thinking' to ensure that a systemic and inclusive approach to change is taken.

Valuation regimes in academia: Researchers’ attitudes towards their diversity of activities and academic performance

Evaluation systems have been long criticized for abusing and misusing bibliometric indicators. This has created a culture by which academics are constantly exposing their daily work to the standards they are expected to perform. In this study, we investigate whether researchers’ own values and expectations are in line with the expectations of the evaluation system. We conduct a multiple case study of five departments in two Dutch universities to examine how they balance between their own valuation regimes and the evaluation schemes. For this, we combine curriculum analysis with a series of semi-structured interviews. We propose a model to study the diversity of academic activities and apply it to the multiple case study to understand how such diversity is shaped by discipline and career stage. We conclude that the observed misalignment is not only resulting from an abuse of metrics but also by a lack of tools to evaluate performance in a contextualized and adaptable way.

A social-psychological examination of academic precarity as an organizational practice and subjective experience

Research and teaching conditions have, particularly for those who are junior or from disadvantaged backgrounds, deteriorated considerably over the years in the higher education sector. Unequal opportunities in access and advancement in careers have led to increasing levels of precarity in the higher education sector. Although the concept of precarity has been grasped in many other disciplines, the social-psychological understanding of this concept remains unexplored. In this paper, we aim to develop a social-psychological understanding of precarity to examine how identity dynamics and intergroup relations, as well as associated organizational controls, reinforce inequality regimes and power structures that create precarious conditions in academia. In doing so, we use social identity theory and system justification theory under an inequality regime framework. We argue that even though change towards equality and equity in academia should be possible, it is difficult to achieve this because of entrenched identity interests by power holders and the perceived legitimacy of the existing system. Therefore, academic precarity should be recognized both as a subjective experience and as an organizational practice to make inequalities more visible and decrease the perceptions of legitimacy-and to eventually achieve a fundamental positive transformation in academia.

Guidelines: The Do's, Don'ts and Don't Knows of Creating Open Educational Resources

Background

In medical education, there is a growing global demand for Open Educational Resources (OERs). However, OER creators are challenged by a lack of uniform standards. In this guideline, the authors curated the literature on how to produce OERs for medical education with practical guidance on the Do's, Don'ts and Don't Knows for OER creation in order to improve the impact and quality of OERs in medical education.

Methods

We conducted a rapid literature review by searching OVID MEDLINE, EMBASE, and Cochrane Central database using keywords "open educational resources" and "OER". The search was supplemented by hand searching the identified articles' references. We organized included articles by theme and extracted relevant content. Lastly, we developed recommendations via an iterative process of peer review and discussion: evidence-based best practices were designated Do's and Don'ts while gaps were designated Don't Knows. We used a consensus process to quantify evidentiary strength.

Results

The authors performed full text analysis of 81 eligible studies. A total of 15 Do's, Don't, and Don't Knows guidelines were compiled and presented alongside relevant evidence about OERs.

Discussion

OERs can add value for medical educators and their learners, both as tools for expanding teaching opportunities and for promoting medical education scholarship. This summary should guide OER creators in producing high-quality resources and pursuing future research where best practices are lacking.

The effect of the Covid-19 pandemic on STEM faculty: Productivity and work-life balance

The disruption caused by the COVID-19 pandemic impacted STEM professionals in numerous ways, affecting research, teaching, publications, patents, and work-life balance. A survey was conducted to determine the changes approximately one year into the pandemic shutdown in USA. Results indicate that the quarantine, limitations, and restrictions led to decreased work productivity and increased stress, anxiety, and family obligations. There was a significant difference between male and female faculty experience with women reporting more child-care, schoolwork assistance, and care for elderly relatives.

African-Centered Social Work in the 21st Century: A Content Analysis

Endorsement of African-centered theory and practice are widespread within Black communities across the United States. The usage of African-centered frameworks is also common among many Black social workers. However, past research suggests that African-centered theory and subsequent models of practice are marginalized within social work literature and curricula. Since advocacy began for the inclusion of African-centered approaches to practice during the mid to late 1990s, there have been no strategic analyses tracing how African-centered scholarship has advanced within social work. This study sought to examine to what extent the African-centered framework is included within scholarship among prominent social work journals. A content analysis was conducted of articles in six major social work journals published between 2000 and 2019. A total of 42 articles met the criteria for inclusion. While there has been a level of change in the number of published articles of African-centered social work, findings suggest that relative to other practice modalities/models, African-centered scholarship is noticeably lacking in social work literature. The article concludes with implications to advance culturally responsive research and practice with communities of African descent.

The call for science communication and public scholarship

This commentary calls for a collective shift in the sciences and academia to prioritize and invest in communicating research in ways that are engaging, relevant, and accessible to public audiences. We provide the context and rationale for increasing and enhancing science communication, and identify barriers that prevent health researchers, educators, and practitioners from engaging with the public. Academic institutions need to develop and implement policies that encourage and support science communication and public scholarship initiatives that are sustainable and scalable.

Metrics to evaluate implementation scientists in the USA: what matters most?

Background

Implementation science has grown rapidly as a discipline over the past two decades. An examination of how publication patterns and other scholarly activities of implementation scientists are weighted in the tenure and promotion process is needed given the unique and applied focus of the field.

Methods

We surveyed implementation scientists (mostly from the USA) to understand their perspectives on the following matters: (1) factors weighted in tenure and promotion for implementation scientists, (2) how important these factors are for success as an implementation scientist, (3) how impact is defined for implementation scientists, (4) top journals in implementation science, and (5) how these journals are perceived with regard to their prestige. We calculated univariate descriptive statistics for all quantitative data, and we used Wilcoxon signed-rank tests to compare the participants’ ratings of various factors. We analyzed open-ended qualitative responses using content analysis.

Results

One hundred thirty-two implementation scientists completed the survey (response rate = 28.9%). Four factors were rated as more important for tenure and promotion decisions: number of publications, quality of publication outlets, success in obtaining external funding, and record of excellence in teaching. Six factors were rated as more important for overall success as an implementation scientist: presentations at professional meetings, involvement in professional service, impact of the implementation scientist’s scholarship on the local community and/or state, impact of the implementation scientist’s scholarship on the research community, the number and quality of the implementation scientist’s community partnerships, and the implementation scientist’s ability to disseminate their work to non-research audiences. Participants most frequently defined and described impact as changing practice and/or policy. This expert cohort identified Implementation Science as the top journal in the field.

Conclusions

Overall, there was a significant mismatch between the factors experts identified as being important to academic success (e.g., tenure and promotion) and the factors needed to be a successful implementation scientist. Findings have important implications for capacity building, although they are largely reflective of the promotion and tenure process in the USA.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00323-0.

Recognition of knowledge translation practice in Canadian health sciences tenure and promotion: A content analysis of institutional policy documents

BACKGROUND AND OBJECTIVE

There has been growing emphasis on increasing impacts of academic health research by integrating research findings in healthcare. The concept of knowledge translation (KT) has been widely adopted in Canada to guide this work, although lack of recognition in tenure and promotion (T&P) structures have been identified as barrier to researchers undertaking KT. Our objective was to explore how KT is considered in institutional T&P documentation in Canadian academic health sciences.

METHODS

We conducted content analysis of T&P documents acquired from 19 purposively sampled research-intensive or largest regional Canadian institutions in 2020-2021. We coded text for four components of KT (synthesis, dissemination, exchange, application). We identified clusters of related groups of documents interpreted together within the same institution. We summarized manifest KT content with descriptive statistics and identified latent categories related to how KT is considered in T&P documentation.

RESULTS

We acquired 89 unique documents from 17 institutions that formed 48 document clusters. Most of the 1057 text segments were categorized as dissemination (n = 851, 81%), which was included in 47 document clusters (98%). 15 document clusters (31%) included all four KT categories, while one (2%) did not have any KT categories identified. We identified two latent categories: primarily implicit recognition of KT; and an overall lack of clarity on KT.

CONCLUSIONS

Our analysis of T&P documents from primarily research-intensive Canadian universities showed a lack of formal recognition for a comprehensive approach to KT and emphasis on traditional dissemination. We recommend that institutions explicitly and comprehensively consider KT in T&P and align documentation and procedures to reflect these values.

Retention, mobility, and successful transition to independence of health sciences postdocs

INTRODUCTION

Obtaining a tenure track faculty position (TTFP) after postdoctoral appointment (PDA) completion is considered an indicator of successful transition to independence (TTI). Whether cross-institutional mobility (CIM)-moving to a different institution from that of the PDA-contributes to TTI is unclear, as data evaluating retention and mobility is lacking. We tested the hypothesis that, for postdocs (PDs) at R1 institutions, CIM is a significant predictor of successful TTI defined as TTFP-status 3 years post-PDA.

MATERIALS AND METHODS

Using University of Pittsburgh data for health sciences PDs we tested the association of CIM at PDA completion (moved to a different institution (CIM = 1) or retained at Pitt (CIM = 0)) with TTFP-status 3 years post-PDA (TTFP, non-TTFP, or left faculty position) using multinomial logistic regression models.

RESULTS

Among all 622 Pitt PDs, 3-year retention in a faculty position at Pitt was 21%, while 14% had a faculty position outside of Pitt. Among the analytic sample of PDs with an academic career outcome during the study period (N = 238; 50% women, 8% underrepresented minorities (URM)), at baseline PDA completion 39% moved to a different institution (CIM = 1), and 61% remained at Pitt (CIM = 0) in any job type. Those with CIM = 1 had greater odds of having a TTFP at follow-up than those with CIM = 0 [adjusted OR (95% CI): 4.4 (2.1, 9.2)].

DISCUSSION

One fifth of Pitt PDs were retained by Pitt as faculty. While Pitt PDs were equally likely to get a faculty position whether they were retained at Pitt or left, those who left had greater odds of obtaining a TTFP. Future work with longer follow-up times, expanded markers of TTI, and samples from other R1 institutions is needed to better understand the reason for these results. This knowledge can lead to better support for the next generation of PDs as they successfully transition to faculty.

Rigor and reproducibility for data analysis and design in the study of eating disorders

OBJECTIVE

Incorporating open science practices has become a priority for submission criteria in the International Journal of Eating Disorders (IJED). In this systematic review, we used the rigor and reproducibility framework developed by Hildebrandt and Prenoveau (2020) to examine the implementation of statistically sound open science principles in IJED, determining whether the cost and effort of incorporating these practices ultimately make research more likely to be cited.

METHOD

For this systematic review, six trained coders examined 1145 articles published from January 2011 to May 2021, including the 5 years prior to the 2016 introduction of the Open Science Foundation article preregistration. We coded for the presence or absence of 10 specific open science elements and calculated citation metrics for each article.

RESULTS

There was evidence of a significant positive relationship between time and total rigor and reproducibility (Total RR) criteria included in IJED articles following the implementation of preregistration in 2016. For every increase in year from 2011 to 2016, there was a .14 decrease in Total RR criteria. From 2016 to 2021, there was a .42 increase per volume in Total RR criteria. There was no statistically significant relationship between Total RR criteria and citation impact.

DISCUSSION

Although findings indicate that statistical rigor and reproducibility in this field has increased, the lack of direct relationship between open science methods and article visibility for scientists suggests that there is a limited incentive for researchers to participate in reporting guidelines.

PUBLIC SIGNIFICANCE

Statistical controversies within science threaten the rigor and reproducibility of published research. Open science practices, including the preregistration of study hypotheses, links to statistical code, and explicit data-sharing arguably generate reliable and valid inferences. This review illustrates the rigor and reproducibility of articles published in IJED between 2011 and 2021 and identifies whether open sciences practices have become increasingly prevalent in eating disorder research.

The Stark realities of reproducible statistically orientated sociological research: Some newer rules of the sociological method

There is increasing concern that research is not transparent and that empirical results are often impossible to reproduce. Guidelines for undertaking reproducible research have been proposed in a number of academic areas (e.g. computational economics, psychology and medical research), however currently there are no guidelines for sociological research. This methodological paper provides guidance for undertaking reproducible statistically orientated sociological research. We provide an extended demonstration of the issues associated with reproducing results and undertaking transparent analyses. We draw on suitable concepts and techniques from open research, e-research and computing. We propose a set of Newer Rules of the Sociological Method, for undertaking transparent statistically orientated sociological research that supports reproducibility.

Predicting implementation of active learning by tenure-track teaching faculty using robust cluster analysis

BACKGROUND

The University of California system has a novel tenure-track education-focused faculty position called Lecturer with Security of Employment (working titles: Teaching Professor or Professor of Teaching). We focus on the potential difference in implementation of active-learning strategies by faculty type, including tenure-track education-focused faculty, tenure-track research-focused faculty, and non-tenure-track lecturers. In addition, we consider other instructor characteristics (faculty rank, years of teaching, and gender) and classroom characteristics (campus, discipline, and class size). We use a robust clustering algorithm to determine the number of clusters, identify instructors using active learning, and to understand the instructor and classroom characteristics in relation to the adoption of active-learning strategies.

RESULTS

We observed 125 science, technology, engineering, and mathematics (STEM) undergraduate courses at three University of California campuses using the Classroom Observation Protocol for Undergraduate STEM to examine active-learning strategies implemented in the classroom. Tenure-track education-focused faculty are more likely to teach with active-learning strategies compared to tenure-track research-focused faculty. Instructor and classroom characteristics that are also related to active learning include campus, discipline, and class size. The campus with initiatives and programs to support undergraduate STEM education is more likely to have instructors who adopt active-learning strategies. There is no difference in instructors in the Biological Sciences, Engineering, or Information and Computer Sciences disciplines who teach actively. However, instructors in the Physical Sciences are less likely to teach actively. Smaller class sizes also tend to have instructors who teach more actively.

CONCLUSIONS

The novel tenure-track education-focused faculty position within the University of California system represents a formal structure that results in higher adoption of active-learning strategies in undergraduate STEM education. Campus context and evolving expectations of the position (faculty rank) contribute to the symbols related to learning and teaching that correlate with differential implementation of active learning.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1186/s40594-022-00365-9.

The Impact of Academic Publication: Inequity for Women in Behavior Analytic Journals

The number of women in higher education has increased over the past few decades but are still not at an equal level to their male counterparts, especially at the tenured level. One area of note within the tenure process is research. This area is highly valued by certain universities and could shed light on discrepancies in the number of female faculty as the faculty position becomes more prestigious. The author downloaded 21 years of publication data for seven prestigious behavior analytic journals and used quantitative methods to determine if the rates of publication differed between a previous study and today. There were 8,778 final articles yielding 27,225 authors in total. Data showed that women are represented more frequently overall, across time and all journals, less frequently in prestigious authorship positions, and more often when the sex of the editor at the time of publication was also female. While women's participation has increased over time, and since the original study, there is still disproportionate representation compared to the entirety of the field, in the order of authorship positions, and for editor-in-chief positions.

Faculty appointment and promotion in Taiwan's medical schools, a systematic analysis

BACKGROUND

A rigorous faculty appointment and promotion (FAP) system is vital for the success of any academic institution. However, studies examining the FAP system in Asian universities are lacking. We surveyed the FAP policies of Taiwan's medical schools and identified an overreliance on the CJA score (manuscript Category, Journal quality, and Author order). The potential shortcomings of this metric and recommendations for refinement were discussed.

METHODS

We obtained the FAP documents from all 12 medical schools in Taiwan, and analyzed their use of traditional versus non-traditional criteria for FAP according to a published methodology. The influence of the journal impact factor (JIF) on the FAP process was quantified by comparing its relative weight between papers with two extreme JIFs. To better understand the research impact and international standing of each school, we utilized the public bibliographic database to rank universities by the number of papers, and the proportions of papers within the top 10% or 50% citation.

RESULTS

Compared with other countries, Taiwan's medical schools focus more on the quantifiable quality of the research, mostly using a "CJA" score that integrates the category, JIF or ranking, and authorship of a paper, with the JIF being the most influential factor. The CJA score for an article with a JIF of 20 can be up to three times the threshold for promotion to Assistant Professor. The emphasis on JIF is based on a presumed correlation between JIF and citation counts. However, our analysis shows that Taiwan's medical schools have lower-than-average citation counts despite a competitive rank in the number of publications.

CONCLUSIONS

The JIF plays an unrivaled role in determining the outcome of FAP in Taiwan's medical schools, mostly via the CJA system. The questionable effectiveness of the current system in elevating the international standing of Taiwan's higher-education institutions calls for a re-examination of the FAP system. We recommend a reduction in the relative importance of CJA score in the FAP system, adopting more rigorous metrics such as the h-index for evaluating research quality, and supporting more research aimed at improving the FAP system.

The role of collegiality in academic review, promotion, and tenure

Review, promotion, and tenure (RPT) processes at universities typically assess candidates along three dimensions: research, teaching, and service. In recent years, some have argued for the inclusion of a controversial fourth criterion: collegiality. While collegiality plays a role in the morale and effectiveness of academic departments, it is amorphic and difficult to assess, and could be misused to stifle dissent or enforce homogeneity. Despite this, some institutions have opted to include this additional element in their RPT documents and processes, but it is unknown the extent of this practice and how it varies across institution type and disciplinary units. This study is based on two sets of data: survey data collected as part of a project that explored the publishing decisions of faculty and how these related to perceived importance in RPT processes, and 864 RPT documents collected from 129 universities from the United States and Canada. We analysed these RPT documents to determine the degree to which collegiality and related terms are mentioned, if they are defined, and if and how they may be assessed during the RPT process. Results show that when collegiality and related terms appear in these documents they are most often just briefly mentioned. It is less common for collegiality and related terms to be defined or assessed in RPT documents. Although the terms are mentioned across all types of institutions, there is a statistically significant difference in how prevalent they are at each. Collegiality is more commonly mentioned in the documents of doctoral research-focused universities (60%), than of master’s universities and colleges (31%) or baccalaureate colleges (15%). Results from the accompanying survey of faculty also support this finding: individuals from R-Types were more likely to perceive collegiality to be a factor in their RPT processes. We conclude that collegiality likely plays an important role in RPT processes, whether it is explicitly acknowledged in policies and guidelines or not, and point to several strategies in how it might be best incorporated in the assessment of academic careers.

Strengthening capacity for community and public engagement (CPE): a mixed-methods evaluation of the ‘DELTAS Africa CPE seed fund’ pilot

Background: The ‘DELTAS Africa CPE seed fund’ was a pilot scheme designed to strengthen capacity in community and public engagement (CPE) via a ‘learn by doing’ approach.   The scheme supported a total of 25 early career researchers and research support staff belonging to the DELTAS Africa network to design and implement a variety of CPE projects between August 2019 and February 2021.  We examine recipient experiences of the DELTAS Africa CPE seed fund initiative, changes in their CPE attitudes, knowledge and proficiency and their CPE practice and/or practice intentions post-award.

Methods: A mixed-methods process and performance evaluation drawing on three data sources: An anonymous, online knowledge, attitude and practice survey completed by CPE seed fund awardees pre- and post-project implementation (N=23); semi-structured interviews completed with a sub-sample of awardees and programme implementors (N=9); and ‘end-of-project’ reports completed by all seed fund awardees (N=25). 

Results: All awardees described their seed fund experience in positive terms, despite invariably finding it more challenging than originally anticipated.  The combined survey, interview and end of project report data all uniformly revealed improvement in awardees’ self-reported CPE knowledge, attitudes and proficiency by completion of their respective projects.   Commitment to continued CPE activity post-award was evident in the survey data and all interviewees were adamant that they would integrate CPE within their respective research work going forward.

Conclusion: The DELTAS Africa CPE seed fund appeared to work successfully as a CPE capacity strengthening platform and as a vehicle for fostering longer-term interest in CPE activities.

Long-term Association of Altmetric Attention Scores With Citations in Selected Major Pharmacy Journals

Objective. To determine the long-term change in the Altmetric Attention Score (AAS) and its components, as well as the impact of higher AAS on citation count for articles published in major pharmacy journals.Methods. This study evaluated articles from pharmacy journals ranked in the top 10% according to their AAS in the year 2017. Correlation between the AAS and number of citations (through November 2020) was assessed using the Spearman's correlation test. A Kruskal-Wallis 1-way analysis of variance was used to compare the AAS across journals.Results. The median three-year AAS and citation count per article was 20 (25th, 75th percentile=15, 28) and 11 (6, 18), respectively. Between November 2018 and November 2020, there was no significant change in the median AAS for the 137 included articles. The only change in the AAS components was an increase in the number of Mendeley readers (22 [13, 34]). The median number of citations per article also increased (8 [4, 14]). We found a significant association between the three-year AAS and the three-year number of citations. The three-year number of Mendeley readers was associated with an increase in the 3-year number of citations. The mean three-year AAS was highest with articles published in the Journal of the American Pharmacists Association, while the mean three-year number of citations was highest for articles published in PharmacotherapyConclusion. Higher AAS scores appear to be associated with the number of citations for articles published in major pharmacy journals within three years of publication.

Prioritizing gender equity and intersectionality in Canadian global health institutions and partnerships

Despite governmental efforts to close the gender gap and global calls including Sustainable Development Goal 5 to promote gender equality, the sobering reality is that gender inequities continue to persist in Canadian global health institutions. Moreover, from health to the economy, security to social protection, COVID-19 has exposed and heightened pre-existing inequities, with women, especially marginalized women, being disproportionately impacted. Women, particularly women who face bias along multiple identity dimensions, continue to be at risk of being excluded or delegitimized as participants in the global health workforce and continue to face barriers in career advancement to leadership, management and governance positions in Canada. These inequities have downstream effects on the policies and programmes, including global health efforts intended to support equitable partnerships with colleagues in low- and middle- income countries. We review current institutional gender inequities in Canadian global health research, policy and practice and by extension, our global partnerships. Informed by this review, we offer four priority actions for institutional leaders and managers to gender-transform Canadian global health institutions to accompany both the immediate response and longer-term recovery efforts of COVID-19. In particular, we call for the need for tracking indicators of gender parity within and across our institutions and in global health research (e.g., representation and participation, pay, promotions, training opportunities, unpaid care work), accountability and progressive action.

Advancing our field by academically advancing pediatric rehabilitation medicine physicians

Academic promotion is desired by many faculty practicing at academic medical institutions, but the criteria for promotion often appear opaque to many physician faculty. In nearly all cases, evidence of scholarship is required regardless of academic track. Academic advancement can be stymied by unclear expectations, lack of protected time to engage in scholarly projects, insufficient evidence of dissemination, and limited guidance, mentorship and sponsorship. In addition to being important for promotion, scholarship is an essential aspect of academic medicine because it helps inform and advance the science. Pursuing academic excellence is an important goal for pediatric rehabilitation medicine faculty members because it helps advance the care of children with disabilities and the field itself. Pediatric rehabilitation medicine faculty in the clinician educator or clinician leader tracks are encouraged to understand the criteria for advancement, seek out mentorship, scholarize their career ikigai and identify opportunities to demonstrate academic excellence.

Dynamics of cumulative advantage and threats to equity in open science: a scoping review

Open Science holds the promise to make scientific endeavours more inclusive, participatory, understandable, accessible and re-usable for large audiences. However, making processes open will not per se drive wide reuse or participation unless also accompanied by the capacity (in terms of knowledge, skills, financial resources, technological readiness and motivation) to do so. These capacities vary considerably across regions, institutions and demographics. Those advantaged by such factors will remain potentially privileged, putting Open Science's agenda of inclusivity at risk of propagating conditions of 'cumulative advantage'. With this paper, we systematically scope existing research addressing the question: 'What evidence and discourse exists in the literature about the ways in which dynamics and structures of inequality could persist or be exacerbated in the transition to Open Science, across disciplines, regions and demographics?' Aiming to synthesize findings, identify gaps in the literature and inform future research and policy, our results identify threats to equity associated with all aspects of Open Science, including Open Access, Open and FAIR Data, Open Methods, Open Evaluation, Citizen Science, as well as its interfaces with society, industry and policy. Key threats include: stratifications of publishing due to the exclusionary nature of the author-pays model of Open Access; potential widening of the digital divide due to the infrastructure-dependent, highly situated nature of open data practices; risks of diminishing qualitative methodologies as 'reproducibility' becomes synonymous with quality; new risks of bias and exclusion in means of transparent evaluation; and crucial asymmetries in the Open Science relationships with industry and the public, which privileges the former and fails to fully include the latter.

Assessing the effect of article processing charges on the geographic diversity of authors using Elsevier’s “Mirror Journal” system

Journals publishing open access (OA) articles often require that authors pay article processing charges (APC). Researchers in the Global South often cite APCs as a major financial obstacle to OA publishing, especially in widely recognized or prestigious outlets. Consequently, it has been hypothesized that authors from the Global South will be underrepresented in journals charging APCs. We tested this hypothesis using more than 37,000 articles from Elsevier’s “Mirror journal” system, in which a hybrid “Parent” journal and its Gold OA “Mirror” share editorial boards and standards for acceptance. Most articles were non-OA; 45% of articles had lead authors based in either the United States or China. After correcting for the effect of this dominance and differences in sample size, we found that OA articles published in Parent and Mirror journals had lead authors with similar Geographic Diversity. However, Author Geographic Diversity of OA articles was significantly lower than that of non-OA articles. Most OA articles were written by authors in high-income countries, and there were no articles in Mirror journals by authors in low-income countries. Our results for Elsevier’s Mirror-Parent system are consistent with the hypothesis that APCs are a barrier to OA publication for scientists from the Global South.

Reaping the benefits of open science in scholarly communication

Regardless of multiple efforts carried out across many countries to disseminate the ideas and the practice of open science, most scholars in the early 2020s do not self-archive their research articles and do not publish research papers in preprint form. Having received no education and training on open science, researchers are often puzzled on what to do, in practice, to start reaping the benefits of open science. This study offers a succinct vademecum on how to benefit from the open science approach to scholarly communication, no matter whether in natural or in humanistic and social sciences.

Neurodegenerative Diseases and Cholesterol: Seeing the Field Through the Players

Neurodegenerative diseases, namely Alzheimer’s (AD), Parkinson’s (PD), and Huntington’s disease (HD) together with amyotrophic lateral sclerosis (ALS) and multiple sclerosis (MS), devastate millions of lives per year worldwide and impose an increasing socio-economic burden across nations. Consequently, these diseases occupy a considerable portion of biomedical research aiming to understand mechanisms of neurodegeneration and to develop efficient treatments. A potential culprit is cholesterol serving as an essential component of cellular membranes, as a cofactor of signaling pathways, and as a precursor for oxysterols and hormones. This article uncovers the workforce studying research on neurodegeneration and cholesterol using the TeamTree analysis. This new bibliometric approach reveals the history and dynamics of the teams and exposes key players based on citation-independent metrics. The team-centered view reveals the players on an important field of biomedical research.

How faculty define quality, prestige, and impact of academic journals

Despite the calls for change, there is significant consensus that when it comes to evaluating publications, review, promotion, and tenure processes should aim to reward research that is of high "quality," is published in "prestigious" journals, and has an "impact." Nevertheless, such terms are highly subjective and present challenges to ascertain precisely what such research looks like. Accordingly, this article responds to the question: how do faculty from universities in the United States and Canada define the terms quality, prestige, and impact of academic journals? We address this question by surveying 338 faculty members from 55 different institutions in the U.S. and Canada. While relying on self-reported definitions that are not linked to their behavior, this study’s findings highlight that faculty often describe these distinct terms in overlapping ways. Additionally, results show that marked variance in definitions across faculty does not correspond to demographic characteristics. This study’s results highlight the subjectivity of common research terms and the importance of implementing evaluation regimes that do not rely on ill-defined concepts and may be context specific.

The Content Quality of YouTube Videos for Professional Medical Education: A Systematic Review

PURPOSE

To evaluate the content quality of YouTube videos intended for professional medical education based on quality rating tool (QRT) scores and determine if video characteristics, engagement metrics, or author type are associated with quality.

METHOD

The authors searched 7 databases for English-language studies about the quality of YouTube videos intended for professional medical education from each database's inception through April 2019. To be included, studies had to be published in 2005 (when YouTube was created) or later. Studies were classified according to the type of QRT used: externally validated, internally validated, or limited global. Study information and video characteristics and engagement metrics were extracted. Videos were classified by video author type.

RESULTS

Thirty-one studies were included in this review. Three studies used externally validated QRTs, 20 used internally validated QRTs, and 13 used limited global QRTs. Studies using externally validated QRTs had average scores/total possible scores of 1.3/4, 26/80, and 1.7/5. Among the 18 studies using internally validated QRTs, from which an average percentage of total possible QRT score could be computed or extracted, the average score was 44% (range: 9%-71%). Videos with academic-physician authors had higher internally validated QRT mean scores (46%) than those with nonacademic-physician or other authors (26%; P < .05).

CONCLUSIONS

The authors found a wide variation in QRT scores of videos, with many low QRT scores. While videos authored by academic-physicians were of higher quality on average, their quality still varied significantly. Video characteristics and engagement metrics were found to be unreliable surrogate measures of video quality. A lack of unifying grading criteria for video content quality, poor search algorithm optimization, and insufficient peer review or controls on submitted videos likely contributed to the overall poor quality of YouTube videos that could be used for professional medical education.