Translating Scientific Discovery Into Health Policy Impact: Innovative Bibliometrics Bridge Translational Research Publications to Policy Literature

To understand how translational science efforts lead to outcomes, it is common to examine publications as a key step in the translational process. The National Institutes of Health's Clinical and Translational Science Awards (CTSA) program aims to accelerate that process by providing support to investigators. Although it is challenging to measure the impact of such support on translational outcomes, CTSA-supported research that arises in research publications can advance translation through use of these publications in public policy and guideline documents from government health agencies, intergovernmental organizations, and other outlets. Using cutting-edge bibliometric tools, the authors evaluated how CTSA-supported research has extended its impact beyond academic silos to influence public policy literature. The authors identified approximately 118,490 publications that acknowledged receiving support from a CTSA hub, from the inception of the program in 2006 through 2021. Articles were queried in the Overton policy database, which indexes references to publications in global policy literature. The search revealed 13% of CTSA-supported articles were referenced in policy documents, significantly more than the expected proportion (10%) calculated by Overton. References came from 576 policy source outlets across 87 countries, predominantly the United States and Europe. The most frequent sources included guidelines in PubMed Central, the World Health Organization, and the Centers for Disease Control and Prevention. The authors illustrate the bridge from translational research to public policy with case studies of 6 articles based on CTSA-supported research and having notable policy impact. They found articles with greater clinical relevance, altmetric attention (i.e., nonacademic community/public attention), and academic citation influence were more likely to be referenced in policy literature. Study findings help to characterize the kinds of research that have influenced and may be expected to influence health policy in the future.

Big splashes & ripple effects: a narrative review of the short- & long-term impact of publications supported by an NIH CTSA pediatrics program

BACKGROUND AND OBJECTIVE

This review examines a promising new framework for analyzing outputs of pediatric research in the context of translational advancement. We demonstrate a method for evaluating the impact of an NIH Clinical and Translational Science Award's (CTSA) Pediatrics Program through publications that have emerged from supported research. The Georgia CTSA Pediatrics Program provides training, funding, and infrastructure to ensure that researchers have the resources to advance pediatric health. Internal evaluations found that research supported by this program is exceptionally impactful within the academic community and commands high interest within the lay community. Therefore, we examined the impact of this research in both traditional academic and broader community spheres using bibliometrics-the study of supported publications. Bibliometrics describe a pivotal stage in the translational process of bringing scientific discoveries to clinical/community use and include both academic citations and 'altmetric' or non-academic attention. These complementary approaches combine to shed light on the short- and long-term impact of the research on segments of the translational pipeline, including academic literature, community discourse, technological advancement, and public health policy.

METHODS

The authors identified a portfolio of 250 articles supported by the Georgia CTSA Pediatrics Program from 2007-2020. We utilized various bibliometrics to analyze both short-term attention, or 'splash' made by articles, and long-term influence, or 'ripples' made across both academic and public spheres.

KEY CONTENT AND FINDINGS

The short-term splash of the portfolio was indicated through publication in high-impact factor journals, peer faculty recommendations, and Mendeley readership, as well as by early altmetric attention in news stories, blogs, and Twitter posts. The portfolio's long-term ripples were demonstrated by high absolute and relative rates of academic citation and by downstream altmetric influence in public-facing documents, including Wikipedia articles, patent applications, and policy documents.

CONCLUSIONS

This article reviews a useful bibliometric methodology for illustrating the waves of impact made by pediatric research. Whereas splash provides a picture of early interest in a publication, a preliminary indicator of eventual utility and impact, ripples provide a measure of the cumulative influence of an article over time. Both reflect opportunities for a line of research to advance along the translational spectrum.

Participant perspectives on a seminar-based research career development program and its role in career independence

Health science researchers need training and support to effectively pursue independence in their research careers. Little data exist regarding the specific resources that faculty researchers have found or would find useful. In this study, we aimed to better understand the needs of health science researchers to develop recommendations for effective career development programming. The authors conducted a multi-method evaluation of early-career researcher faculty needs beginning by using post-session satisfaction surveys to assess the value of a long-standing "K-Club" seminar, which educates and supports those pursuing NIH Career Development (K) awards or similar. The authors then collected in-depth views on career development needs through a series of focus groups conducted with health science researchers at three career stages: early career, award-seeking junior faculty; mid-career faculty who have obtained some extramural funding; senior faculty who serve as mentors for early/mid-career faculty. Participants who attended the existing K-Club strongly endorse the program in supporting their career goals. Focus group participants described specific areas for program expansion that would add value across career stages: more flexible training options, conducted in smaller group settings with immediate feedback provided; more formalized training and resources for senior research mentors; in-depth guidance on individualized grantsmanship. The authors propose program development guidelines for helping researchers achieve research independence and success. Findings indicate that a broad-reaching K-Club style educational seminar can serve as a valuable foundation supporting professional development. The addition of tailored programs delivered across diverse platforms are predicted to heighten career development success.