"The results are encouragements to make positive changes to be healthier:" qualitative evaluation of Marshallese participants' perceptions when receiving study results in a randomized control trial

Leveraging artificial intelligence to summarize abstracts in lay language for increasing research accessibility and transparency

OBJECTIVE

Returning aggregate study results is an important ethical responsibility to promote trust and inform decision making, but the practice of providing results to a lay audience is not widely adopted. Barriers include significant cost and time required to develop lay summaries and scarce infrastructure necessary for returning them to the public. Our study aims to generate, evaluate, and implement ChatGPT 4 lay summaries of scientific abstracts on a national clinical study recruitment platform, ResearchMatch, to facilitate timely and cost-effective return of study results at scale.

MATERIALS AND METHODS

We engineered prompts to summarize abstracts at a literacy level accessible to the public, prioritizing succinctness, clarity, and practical relevance. Researchers and volunteers assessed ChatGPT-generated lay summaries across five dimensions: accuracy, relevance, accessibility, transparency, and harmfulness. We used precision analysis and adaptive random sampling to determine the optimal number of summaries for evaluation, ensuring high statistical precision.

RESULTS

ChatGPT achieved 95.9% (95% CI, 92.1-97.9) accuracy and 96.2% (92.4-98.1) relevance across 192 summary sentences from 33 abstracts based on researcher review. 85.3% (69.9-93.6) of 34 volunteers perceived ChatGPT-generated summaries as more accessible and 73.5% (56.9-85.4) more transparent than the original abstract. None of the summaries were deemed harmful. We expanded ResearchMatch's technical infrastructure to automatically generate and display lay summaries for over 750 published studies that resulted from the platform's recruitment mechanism.

DISCUSSION AND CONCLUSION

Implementing AI-generated lay summaries on ResearchMatch demonstrates the potential of a scalable framework generalizable to broader platforms for enhancing research accessibility and transparency.

Prognostic Implications of Early Prediction in Posttraumatic Epilepsy

Posttraumatic epilepsy (PTE) is a complication of traumatic brain injury that can increase morbidity, but predicting which patients may develop PTE remains a challenge. Much work has been done to identify a variety of risk factors and biomarkers, or a combination thereof, for patients at highest risk of PTE. However, several issues have hampered progress toward fully adapted PTE models. Such issues include the need for models that are well-validated, cost-effective, and account for competing outcomes like death. Additionally, while an accurate PTE prediction model can provide quantitative prognostic information, how such information is communicated to inform shared decision-making and treatment strategies requires consideration of an individual patient's clinical trajectory and unique values, especially given the current absence of direct anti-epileptogenic treatments. Future work exploring approaches integrating individualized communication of prediction model results are needed.

Return of aggregate results to study participants: Facilitators, barriers, and recommendations

Background

Most researchers and study participants believe that the summary, or aggregate, results of health research should be returned to study participants. However, researchers often do not return aggregate results. A better understanding of the impediments to results return could support improvements in this practice.

Methods

This qualitative study convened eight virtual focus groups, four with investigators and four with patient partners from research studies funded by the Patient-Centered Outcomes Research Institute (PCORI). In total, 23 investigators and 20 partners participated. We explored perspectives, experiences, influences, and recommendations related to aggregate results return.

Results

Focus group participants described the ethical importance of returning aggregate results, as well as the benefits to study participants. They also noted important impediments to results return, emphasizing IRB and logistical challenges and describing a lack of support for the practice both on the part of institutions and the field at large. Participants highlighted the value of patients and caregivers' perspectives and contributions to results return, which focused on returning the most relevant findings through effective channels and formats. They further emphasized the importance of planning and identified resources that could support results return.

Conclusion

Researchers, funders, and the field can better facilitate results return by promoting standardized processes in research, such as the earmarking of funds for results return and inclusion of results returns milestones in research plans. More intentional policies, infrastructures, and resources that support results return may lead to more widespread return of study results to those who make these studies possible.

Rural Research Network to engage rural and minority community members in translational research

Background

To address the high prevalence of health disparities and lack of research opportunities among rural and minority communities, the University of Arkansas for Medical Sciences (UAMS) developed the Rural Research Network in January 2020.

Aim

The aim of this report is to describe our process and progress in developing a rural research network. The Rural Research Network provides a platform to expand research participation opportunities to rural Arkansans, many of whom are older adults, low-income individuals, and underrepresented minority populations.

Methods

The Rural Research Network leverages existing UAMS Regional Programs family medicine residency clinics within an academic medical center.

Results

Since the inception of the Rural Research Network, research infrastructure and processes have been built within the regional sites. Twelve diverse studies have been implemented with recruitment and data collection from 9248 participants, and 32 manuscripts have been published with residents and faculty from the regional sites. Most studies were able to recruit Black/African American participants at or above a representative sample.

Conclusions

As the Rural Research Network matures, the types of research will expand in parallel with the health priorities of Arkansas.

Relevance to Patients

The Rural Research Network demonstrates how Cancer Institutes and sites funded by a Clinical and Translational Science Award can collaborate to expand research capacity and increase opportunities for research among rural and minority communities.

Correlates of attendance at community engagement meetings held in advance of bio-behavioral research studies: A longitudinal, sociocentric social network study in rural Uganda

BACKGROUND

Community engagement is central to the conduct of health-related research studies as a way to determine priorities, inform study design and implementation, increase recruitment and retention, build relationships, and ensure that research meets the goals of the community. Community sensitization meetings, a form of community engagement, are often held prior to the initiation of research studies to provide information about upcoming study activities and resolve concerns in consultation with potential participants. This study estimated demographic, health, economic, and social network correlates of attendance at community sensitization meetings held in advance of a whole-population, combined behavioral, and biomedical research study in rural Uganda.

METHODS AND FINDINGS

Research assistants collected survey data from 1,630 adults participating in an ongoing sociocentric social network cohort study conducted in a rural region of southwestern Uganda. These community survey data, collected between 2016 and 2018, were linked to attendance logs from community sensitization meetings held in 2018 and 2019 before the subsequent community survey and community health fair. Of all participants, 264 (16%) attended a community sensitization meeting before the community survey, 464 (28%) attended a meeting before the community health fair, 558 (34%) attended a meeting before either study activity (survey or health fair), and 170 (10%) attended a meeting before both study activities (survey and health fair). Using multivariable Poisson regression models, we estimated correlates of attendance at community sensitization meetings. Attendance was more likely among study participants who were women (adjusted relative risk [ARR]health fair = 1.71, 95% confidence interval [CI], 1.32 to 2.21, p < 0.001), older age (ARRsurvey = 1.02 per year, 95% CI, 1.01 to 1.02, p < 0.001; ARRhealth fair = 1.02 per year, 95% CI, 1.01 to 1.02, p < 0.001), married (ARRsurvey = 1.74, 95% CI, 1.29 to 2.35, p < 0.001; ARRhealth fair = 1.41, 95% CI, 1.13 to 1.76, p = 0.002), and members of more community groups (ARRsurvey = 1.26 per group, 95% CI, 1.10 to 1.44, p = 0.001; ARRhealth fair = 1.26 per group, 95% CI, 1.12 to 1.43, p < 0.001). Attendance was less likely among study participants who lived farther from meeting locations (ARRsurvey = 0.54 per kilometer, 95% CI, 0.30 to 0.97, p = 0.041; ARRhealth fair = 0.57 per kilometer, 95% CI, 0.38 to 0.86, p = 0.007). Leveraging the cohort's sociocentric design, social network analyses suggested that information conveyed during community sensitization meetings could reach a broader group of potential study participants through attendees' social network and household connections. Study limitations include lack of detailed data on reasons for attendance/nonattendance at community sensitization meetings; achieving a representative sample of community members was not an explicit aim of the study; and generalizability may not extend beyond this study setting.

CONCLUSIONS

In this longitudinal, sociocentric social network study conducted in rural Uganda, we observed that older age, female sex, being married, membership in more community groups, and geographical proximity to meeting locations were correlated with attendance at community sensitization meetings held in advance of bio-behavioral research activities. Information conveyed during meetings could have reached a broader portion of the population through attendees' social network and household connections. To ensure broader input and potentially increase participation in health-related research studies, the dissemination of research-related information through community sensitization meetings may need to target members of underrepresented groups.