Patient Recruitment Into a Multicenter Clinical Cohort Linking Electronic Health Records From 5 Health Systems: Cross-sectional Analysis

A comprehensive digital mental health screening tool for people with epilepsy: A feasibility study in UK outpatients

BACKGROUND

Mental health symptoms are common in people with epilepsy, impacting medication adherence, quality of life, and mortality. Early detection and timely interventions for mental health symptoms will be crucial for improved outcomes but the absence of standardized screening procedures and time constraints hinder regular assessment and management.

PURPOSE

To evaluate feasibility, acceptability and, value of a digital tool for identifying mental health symptoms in adult and paediatric epilepsy outpatients using electronic Patient-Reported Outcome Measures (ePROMs).

METHODS AND MATERIALS

The study used an established local platform (IMPARTS - Integrating Mental and Physical Healthcare: Research Training and Services) to develop an online tool using e-PROMS for a comprehensive mental health screen (psychiatric symptoms, neurodevelopmental traits, and psychosocial/behavioural risk factors) of people with epilepsy. Prior to attending the outpatient clinical epilepsy services at King's College Hospital, participants were invited to complete the online screening tool through an SMS appointment link.

RESULTS

Out of 1081 epilepsy patients (955 adults, 126 paediatric), 38.2% of adults and 51.6% of carers of paediatric patients accessed the ePROMs, with modest completion rates of 15% and 14%, respectively. Adults reported mild to significant anxiety (37.4%), minor to major depression symptoms (29.2%), and occasionally psychotic symptoms (11.1%). Adults with self-reported psychiatric symptoms reported significantly higher number of seizures, seizure burden, insomnia, autistic and ADHD traits and lower quality of life and perceived social support. Only 21% of those reporting psychiatric symptoms were receiving any form of mental health support. A large proportion of paediatric patients presented emotional/behavioural difficulties (32%), high impulsivity (38.8%), low self-esteem (27.7%), sleep difficulties (50%), comorbid neurodevelopmental syndromes (27.7%). Both groups reported good level of perceived social support.

CONCLUSION

Our epilepsy adapted IMPARTS e-PROMS allowed remote screening for mental health symptoms, neurodevelopmental and resilience factors. Integrating these tools into electronic patient records might enhance early identification and facilitate referral to appropriate care pathways.

Using patient portals for large-scale recruitment of individuals underrepresented in biomedical research: an evaluation of engagement patterns throughout the patient portal recruitment process at a single site within the All of Us Research Program

OBJECTIVE

To evaluate the use of patient portal messaging to recruit individuals historically underrepresented in biomedical research (UBR) to the All of Us Research Program (AoURP) at a single recruitment site.

MATERIALS AND METHODS

Patient portal-based recruitment was implemented at Columbia University Irving Medical Center. Patient engagement was assessed using patient's electronic health record (EHR) at four recruitment stages: Consenting to be contacted, opening messages, responding to messages, and showing interest in participating. Demographic and socioeconomic data were also collected from patient's EHR and univariate logistic regression analyses were conducted to assess patient engagement.

RESULTS

Between October 2022 and November 2023, a total of 59 592 patients received patient portal messages inviting them to join the AoURP. Among them, 24 445 (41.0%) opened the message, 8983 (15.1%) responded, and 3765 (6.3%) showed interest in joining the program. Though we were unable to link enrollment data with EHR data, we estimate about 2% of patients contacted ultimately enrolled in the AoURP. Patients from underrepresented race and ethnicity communities had lower odds of consenting to be contacted and opening messages, but higher odds of showing interest after responding.

DISCUSSION

Patient portal messaging provided both patients and recruitment staff with a more efficient approach to outreach, but patterns of engagement varied across UBR groups.

CONCLUSION

Patient portal-based recruitment enables researchers to contact a substantial number of participants from diverse communities. However, more effort is needed to improve engagement from underrepresented racial and ethnic groups at the early stages of the recruitment process.

Monitoring Pregnancies Exposed to Galcanezumab for Migraine in a United States Administrative Claims Database

PURPOSE

Galcanezumab is a calcitonin gene-related peptide monoclonal antibody indicated for migraine prevention in adults. Due to the long half-life of galcanezumab and the prevalence of migraine in women of childbearing age, galcanezumab exposure may occur during pregnancy. However, real-world use and safety of galcanezumab during pregnancy has not been fully described. To help fill this gap, galcanezumab has two ongoing pregnancy safety studies, one of which is an insurance claims database study.

METHODS

This database study is actively identifying and following pregnancies exposed to galcanezumab using commercial claims from the Healthcare Integrated Research Database (HIRD). Patient accrual is planned from September 2018 to June 2026, with a final study report planned for December 2027. This study requires 430 galcanezumab-exposed pregnancies with linked infants to reach power for comparative analysis of major congenital malformations.

RESULTS

Recent monitoring of patient accrual, including data from 28 September 2018 to 31 January 2023, identified 207 galcanezumab-exposed pregnancies in women with migraine in the HIRD, of which 110 were live births and 73 of which were linked to an infant. This represents an annual accrual rate of approximately 17 pregnancies linked to infants, which is substantially lower than the 55 required annually to reach target size within current regulatory-committed study timelines.

CONCLUSIONS

The accrual of a sufficient number of galcanezumab-exposed pregnancies represents a substantial, but not uncommon, barrier to conducting comparative analyses in pregnancy studies. Potential solutions that would allow for timely dissemination of important safety information to patients and providers may be available.

Targeted electronic health record-based recruitment strategy to enhance COVID-19 vaccine response clinical research study enrollment

Efficient recruitment of eligible participants is a significant challenge for clinical research studies. This challenge was exacerbated during the COVID-19 pandemic when in-person recruitment was not an option. In 2020, the University of Minnesota was tasked, as part of the National Cancer Institute's Serological Sciences Network for COVID-19 (SeroNet), to recruit participants for a longitudinal serosurveillance clinical research study with a goal of characterizing the COVID-19 vaccine-elicited immune response among immunocompromised individuals, which necessitated reliance on non-traditional strategies for participant recruitment. To meet our enrollment target of 300 transplant patients, 300 cancer patients, 100 persons living with HIV, and 200 immunocompetent individuals, we utilized targeted electronic health record (EHR)-based recruitment in addition to traditional recruitment tools, which was an effective combination of recruitment strategies. A significant advantage of patient portal messaging or other digital recruitment strategies such as email communication is timing. We reached 85 % (769 out of 900) of our enrollment target within one year with a 14.3 % response rate to invitations to participate in our study. This achievement is perhaps more salient given the COVID-19 pandemic-related constraints within which we were operating. We demonstrated that the EHR can be leveraged to quickly identify potentially eligible study participants either via EHR communication or mail. We also illustrate how the online portal MyChart can be used to efficiently send targeted recruitment messages.

Zero-shot interpretable phenotyping of postpartum hemorrhage using large language models

Many areas of medicine would benefit from deeper, more accurate phenotyping, but there are limited approaches for phenotyping using clinical notes without substantial annotated data. Large language models (LLMs) have demonstrated immense potential to adapt to novel tasks with no additional training by specifying task-specific instructions. Here we report the performance of a publicly available LLM, Flan-T5, in phenotyping patients with postpartum hemorrhage (PPH) using discharge notes from electronic health records (n = 271,081). The language model achieves strong performance in extracting 24 granular concepts associated with PPH. Identifying these granular concepts accurately allows the development of interpretable, complex phenotypes and subtypes. The Flan-T5 model achieves high fidelity in phenotyping PPH (positive predictive value of 0.95), identifying 47% more patients with this complication compared to the current standard of using claims codes. This LLM pipeline can be used reliably for subtyping PPH and outperforms a claims-based approach on the three most common PPH subtypes associated with uterine atony, abnormal placentation, and obstetric trauma. The advantage of this approach to subtyping is its interpretability, as each concept contributing to the subtype determination can be evaluated. Moreover, as definitions may change over time due to new guidelines, using granular concepts to create complex phenotypes enables prompt and efficient updating of the algorithm. Using this language modelling approach enables rapid phenotyping without the need for any manually annotated training data across multiple clinical use cases.

Design, implementation, and inferential issues associated with clinical trials that rely on data in electronic medical records: a narrative review

Real world evidence is now accepted by authorities charged with assessing the benefits and harms of new therapies. Clinical trials based on real world evidence are much less expensive than randomized clinical trials that do not rely on "real world evidence" such as contained in electronic health records (EHR). Consequently, we can expect an increase in the number of reports of these types of trials, which we identify here as 'EHR-sourced trials.' 'In this selected literature review, we discuss the various designs and the ethical issues they raise. EHR-sourced trials have the potential to improve/increase common data elements and other aspects of the EHR and related systems. Caution is advised, however, in drawing causal inferences about the relationships among EHR variables. Nevertheless, we anticipate that EHR-CTs will play a central role in answering research and regulatory questions.

Rudin R, Sulca Flores J, Goolkasian G, Sousa J, Rodriguez J, Lipsitz S, Foer D, K. Dalal A. Assessing Equitable Recruitment in a Digital Health Trial for Asthma

OBJECTIVE

This study aimed to assess a multipronged strategy using primarily digital methods to equitably recruit asthma patients into a clinical trial of a digital health intervention.

METHODS

We approached eligible patients using at least one of eight recruitment strategies. We recorded approach dates and the strategy that led to completion of a web-based eligibility questionnaire that was reported during the verbal consent phone call. Study team members conducted monthly sessions using a structured guide to identify recruitment barriers and facilitators. The proportion of participants who reported being recruited by a portal or nonportal strategy was measured as our outcomes. We used Fisher's exact test to compare outcomes by equity variable, and multivariable logistic regression to control for each covariate and adjust effect size estimates. Using grounded theory, we coded and extracted themes regarding recruitment barriers and facilitators.

RESULTS

The majority (84.4%) of patients who met study inclusion criteria were patient portal enrollees. Of 6,366 eligible patients who were approached, 627 completed the eligibility questionnaire and were less frequently Hispanic, less frequently Spanish-speaking, and more frequently patient portal enrollees. Of 445 patients who consented to participate, 241 (54.2%) reported completing the eligibility questionnaire after being contacted by a patient portal message. In adjusted analysis, only race (odds ratio [OR]: 0.46, 95% confidence interval [CI]: 0.28-0.77, p = 0.003) and college education (OR: 0.60, 95% CI: 0.39-0.91, p = 0.016) remained significant. Key recruitment barriers included technology issues (e.g., lack of email access) and facilitators included bilingual study staff, Spanish-language recruitment materials, targeted phone calls, and clinician-initiated "1-click" referrals.

CONCLUSION

A primarily digital strategy to recruit patients into a digital health trial is unlikely to achieve equitable participation, even in a population overrepresented by patient portal enrollees. Nondigital recruitment methods that address racial and educational disparities and less active portal enrollees are necessary to ensure equity in clinical trial enrollment.

Zero-shot Interpretable Phenotyping of Postpartum Hemorrhage Using Large Language Models

Many areas of medicine would benefit from deeper, more accurate phenotyping, but there are limited approaches for phenotyping using clinical notes without substantial annotated data. Large language models (LLMs) have demonstrated immense potential to adapt to novel tasks with no additional training by specifying task-specific i nstructions. We investigated the per-formance of a publicly available LLM, Flan-T5, in phenotyping patients with postpartum hemorrhage (PPH) using discharge notes from electronic health records ( n =271,081). The language model achieved strong performance in extracting 24 granular concepts associated with PPH. Identifying these granular concepts accurately allowed the development of inter-pretable, complex phenotypes and subtypes. The Flan-T5 model achieved high fidelity in phenotyping PPH (positive predictive value of 0.95), identifying 47% more patients with this complication compared to the current standard of using claims codes. This LLM pipeline can be used reliably for subtyping PPH and outperformed a claims-based approach on the three most common PPH subtypes associated with uterine atony, abnormal placentation, and obstetric trauma. The advantage of this approach to subtyping is its interpretability, as each concept contributing to the subtype determination can be evaluated. Moreover, as definitions may change over time due to new guidelines, using granular concepts to create complex phenotypes enables prompt and efficient updating of the algorithm. Using this lan-guage modelling approach enables rapid phenotyping without the need for any manually annotated training data across multiple clinical use cases.

Clinical trial knowledge among U.S. adults aged 65 years and up: Findings from a 2020 national survey

BACKGROUND

Older adults are underrepresented in most clinical trials. As the United States observes growth in the number of older adults over time, it will be critical to include them in clinical trials to improve the generalizability of results across age groups. Although clinical trial participation requires clinical trial knowledge, no study has assessed clinical trial knowledge among older adults. Using a national survey, this study aims to identify the prevalence and determinants of clinical trial knowledge among older adults.

METHODS

We used the 2020 Health Information National Trends Survey for secondary data analysis. We restricted the sample to older adults (aged 65 years and up). Our outcome variable was whether respondents reported having any clinical trial knowledge. We controlled for demographics, social determinants of health, healthcare utilization, and comorbidities through multivariable logistic regression models.

RESULTS

Using a weighted sample of 27,574,958 adults, we estimated that 61.1% of older adults reported having at least some knowledge of clinical trials. After controlling for other factors, those with one to two (OR = 1.80, 95% CI:1.14-2.84) or three to five (OR = 2.93, 95% CI:1.74-4.95) portal visits compared with no portal visits, those with cancer (OR = 1.92, 95% CI:1.22-3.02), and those with depression (OR = 2.27, 95% CI:1.23-4.20) had greater odds of having clinical trial knowledge. Inversely, those with hypertension (OR = 0.62, 95% CI:0.42-0.92) had lower odds of clinical trial knowledge.

CONCLUSIONS

Patient portal recruitment may be a supplemental intervention to improve clinical trial knowledge among older adults. Further research on additional interventions for identifying eligible participants is needed to minimize the burden among clinicians amidst other competing demands during clinic visits.

Describing current use, barriers, and facilitators of patient portal messaging for research recruitment: Perspectives from study teams and patients at one institution

Introduction

The electronic health record (EHR) and patient portal are used increasingly for clinical research, including patient portal recruitment messaging (PPRM). Use of PPRM has grown rapidly; however, best practices are still developing. In this study, we examined the use of PPRM at our institution and conducted qualitative interviews among study teams and patients to understand experiences and preferences for PPRM.

Methods

We identified study teams that sent PPRMs and patients that received PPRMs in a 60-day period. We characterized these studies and patients, in addition to the patients' interactions with the PPRMs (e.g., viewed, responded). From these groups, we recruited study team members and patients for semi-structured interviews. A pragmatic qualitative inquiry framework was used by interviewers. Interviews were audio-recorded and analyzed using a rapid qualitative analysis exploratory approach.

Results

Across ten studies, 35,037 PPRMs were sent, 33% were viewed, and 17% were responded to. Interaction rates varied across demographic groups. Six study team members completed interviews and described PPRM as an efficient and helpful recruitment method. Twenty-eight patients completed interviews. They were supportive of receiving PPRMs, particularly when the PPRM was relevant to their health. Patients indicated that providing more information in the PPRM would be helpful, in addition to options to set personalized preferences.

Conclusions

PPRM is an efficient recruitment method for study teams and is acceptable to patients. Engagement with PPRMs varies across demographic groups, which should be considered during recruitment planning. Additional research is needed to evaluate and implement recommended changes by study teams and patients.

Reach in a pragmatic hypertension trial: A critical RE-AIM component

BACKGROUND

Hypertension control is falling in the US yet efficacious interventions exist. Poor patient reach has limited the ability of pragmatic trials to demonstrate effectiveness. This paper uses quantitative and qualitative data to understand factors influencing reach in Hyperlink 3, a pragmatic hypertension trial testing an efficacious pharmacist-led Telehealth Care intervention in comparison to a physician-led Clinic-based Care intervention. Referrals to both interventions were ordered by physicians.

METHODS

A sequential-explanatory mixed methods approach was used to understand barriers and facilitators to reach. Reach was assessed quantitatively using EHR data, defined as the proportion of eligible patients attending intended follow-up hypertension care and qualitatively, via semi-structured interviews with patients who were and were not reached. Quantitative data were analyzed using descriptive and inferential statistics. Qualitative data were analyzed via combined deductive and inductive content analysis.

RESULTS

Of those eligible, 27% of Clinic-based (n = 532/1945) and 21% of Telehealth patients (n = 385/1849) were reached. In both arms, the largest drop was between physician-signed orders and patients attending initial intended follow-up care. Qualitative analyses uncovered patient barriers related to motivation, capability, and opportunity to attend follow-up care.

CONCLUSIONS

Although the proportion of eligible patients with signed orders was high in both arms, the proportion ultimately reached was lower. Patients described barriers related to the influence of one's own personal beliefs or priorities, decision making processes, logistics, and patient perceptions on physician involvement on reach. Addressing these barriers in the design of pragmatic interventions is critical for future effectiveness.

TRIAL REGISTRATION

NCT02996565.

Electronic Health Record-Based Recruitment and Retention and Mobile Health App Usage: Multisite Cohort Study

BACKGROUND

To address the obesity epidemic, there is a need for novel paradigms, including those that address the timing of eating and sleep in relation to circadian rhythms. Electronic health records (EHRs) are an efficient way to identify potentially eligible participants for health research studies. Mobile health (mHealth) apps offer available and convenient data collection of health behaviors, such as timing of eating and sleep.

OBJECTIVE

The aim of this descriptive analysis was to report on recruitment, retention, and app use from a 6-month cohort study using a mobile app called Daily24.

METHODS

Using an EHR query, adult patients from three health care systems in the PaTH clinical research network were identified as potentially eligible, invited electronically to participate, and instructed to download and use the Daily24 mobile app, which focuses on eating and sleep timing. Online surveys were completed at baseline and 4 months. We described app use and identified predictors of app use, defined as 1 or more days of use, versus nonuse and usage categories (ie, immediate, consistent, and sustained) using multivariate regression analyses.

RESULTS

Of 70,661 patients who were sent research invitations, 1021 (1.44%) completed electronic consent forms and online baseline surveys; 4 withdrew, leaving a total of 1017 participants in the analytic sample. A total of 53.79% (n=547) of the participants were app users and, of those, 75.3% (n=412), 50.1% (n=274), and 25.4% (n=139) were immediate, consistent, and sustained users, respectively. Median app use was 28 (IQR 7-75) days over 6 months. Younger age, White race, higher educational level, higher income, having no children younger than 18 years, and having used 1 to 5 health apps significantly predicted app use (vs nonuse) in adjusted models. Older age and lower BMI predicted early, consistent, and sustained use. About half (532/1017, 52.31%) of the participants completed the 4-month online surveys. A total of 33.5% (183/547), 29.3% (157/536), and 27.1% (143/527) of app users were still using the app for at least 2 days per month during months 4, 5, and 6 of the study, respectively.

CONCLUSIONS

EHR recruitment offers an efficient (ie, high reach, low touch, and minimal participant burden) approach to recruiting participants from health care settings into mHealth research. Efforts to recruit and retain less engaged subgroups are needed to collect more generalizable data. Additionally, future app iterations should include more evidence-based features to increase participant use.

Using a Patient Portal to Increase Enrollment in a Newborn Screening Research Study: Observational Study

BACKGROUND

Many research studies fail to enroll enough research participants. Patient-facing electronic health record applications, known as patient portals, may be used to send research invitations to eligible patients.

OBJECTIVE

The first aim was to determine if receipt of a patient portal research recruitment invitation was associated with enrollment in a large ongoing study of newborns (Early Check). The second aim was to determine if there were differences in opening the patient portal research recruitment invitation and study enrollment by race and ethnicity, age, or rural/urban home address.

METHODS

We used a computable phenotype and queried the health care system's clinical data warehouse to identify women whose newborns would likely be eligible. Research recruitment invitations were sent through the women's patient portals. We conducted logistic regressions to test whether women enrolled their newborns after receipt of a patient portal invitation and whether there were differences by race and ethnicity, age, and rural/urban home address.

RESULTS

Research recruitment invitations were sent to 4510 women not yet enrolled through their patient portals between November 22, 2019, through March 5, 2020. Among women who received a patient portal invitation, 3.6% (161/4510) enrolled their newborns within 27 days. The odds of enrolling among women who opened the invitation was nearly 9 times the odds of enrolling among women who did not open their invitation (SE 3.24, OR 8.86, 95% CI 4.33-18.13; P<.001). On average, it took 3.92 days for women to enroll their newborn in the study, with 64% (97/161) enrolling their newborn within 1 day of opening the invitation. There were disparities by race and urbanicity in enrollment in the study after receipt of a patient portal research invitation but not by age. Black women were less likely to enroll their newborns than White women (SE 0.09, OR 0.29, 95% CI 0.16-0.55; P<.001), and women in urban zip codes were more likely to enroll their newborns than women in rural zip codes (SE 0.97, OR 3.03, 95% CI 1.62-5.67; P=.001). Black women (SE 0.05, OR 0.67, 95% CI 0.57-0.78; P<.001) and Hispanic women (SE 0.07, OR 0.73, 95% CI 0.60-0.89; P=.002) were less likely to open the research invitation compared to White women.

CONCLUSIONS

Patient portals are an effective way to recruit participants for research studies, but there are substantial racial and ethnic disparities and disparities by urban/rural status in the use of patient portals, the opening of a patient portal invitation, and enrollment in the study.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03655223; https://clinicaltrials.gov/ct2/show/NCT03655223.

Healthy for Two/Healthy for You: Design and methods for a pragmatic randomized clinical trial to limit gestational weight gain and prevent obesity in the prenatal care setting

OBJECTIVE

To compare the effect of Healthy for Two/Healthy for You (H42/H4U), a health coaching program, in prenatal care clinics that serve a racially and economically diverse population, on total gestational weight gain (GWG) (vs. usual care). We hypothesize that compared to usual prenatal care, intervention participants will have lower GWG and lower rates of gestational diabetes mellitus (GDM).

METHODS

We report the rationale and design of a pragmatic, parallel arm randomized clinical trial with 380 pregnant patients ≤15 weeks gestation with overweight or obesity from one of 6 academic and community-based obstetrics practices, randomized to either H42/H4U or usual prenatal care in a 1:1 ratio. The study duration is early pregnancy to 6 months postpartum. The primary outcome is total GWG, calculated as the difference between first clinic-assessed pregnancy weight and the weight at 37 weeks gestation. Key maternal and infant secondary outcomes include GDM incidence, weight retention at 6 months postpartum, infant weight, maternal health behaviors and wellness.

CONCLUSIONS

This pragmatic clinical trial embeds a pregnancy health coaching program into prenatal care to allow parallel testing compared to usual prenatal care on the outcome of total GWG. The real-world design provides an approach to enhance its sustainability beyond the trial to ultimately improve maternal/child health outcomes and reduce future obesity.

TRIAL REGISTRATION

The study was first registered at clinicaltrials.gov on 1/26/21 (NCT04724330).