Examining differential success in recruitment using respondent driven sampling (RDS) in a multi-site study of gay, bisexual and other men who have sex with men

BACKGROUND

The Engage Study is a longitudinal biobehavioral cohort study of gay, bisexual and other men who have sex with men (GBM) in Toronto, Montreal, and Vancouver. Baseline data (2,449 participants) were collected from February 2017 - August 2019 using respondent-driven sampling (RDS). Recruitment in Montreal required fewer seeds, had a much shorter recruitment period, and recruited the largest sample.

METHODS

To better understand why RDS recruitment was more successful in Montreal compared to other sites, we conducted an analysis to examine RDS recruitment characteristics for GBM in each of the three study sites, explore demographic characteristics and measures of homophily, that is, the tendency of individuals to recruit other study participants who are like themselves, and compared motivations for study participation.

RESULTS

Montreal had the greatest proportion of participants over the age of 45 (29.1% in Montreal, 24.6% in Vancouver, and 21.0% in Toronto) and the highest homophily for this age group, but homophily was high across the three cities. Montreal also reported the lowest percentage of participants with an annual income greater or equal to $60,000 (7.9% in Montreal, 13.1% in Vancouver and 10.6% in Toronto), but homophily was similar across all three cities. The majority of participants indicated interest in sexual health and HIV as the main reason for participating (36.1% in Montreal, 34.7% in Vancouver, and 29.8% in Toronto). Financial interest as the main reason for participation was low (12.7% in Montreal, 10.6% in Vancouver, and 5.7% in Toronto).

CONCLUSION

Taken together, although we found some differences in study demographic characteristics and homophily scores, we were unable to fully explain the different recruitment success based on the data available. Our study underlines the fact that success of RDS implementation may vary by unknown factors, and that researchers should be proactive and flexible to account for variability.

Open science in psychophysiology: An overview of challenges and emerging solutions

The present review is the result of a one-day workshop on open science, held at the Annual Meeting of the Society for Psychophysiological Research in Washington, DC, September 2019. The contributors represent psychophysiological researchers at different career stages and from a wide spectrum of institutions. The state of open science in psychophysiology is discussed from different perspectives, highlighting key challenges, potential benefits, and emerging solutions that are intended to facilitate open science practices. Three domains are emphasized: data sharing, preregistration, and multi-site studies. In the context of these broader domains, we present potential implementations of specific open science procedures such as data format harmonization, power analysis, data, presentation code and analysis pipeline sharing, suitable for psychophysiological research. Practical steps are discussed that may be taken to facilitate the adoption of open science practices in psychophysiology. These steps include (1) promoting broad and accessible training in the skills needed to implement open science practices, such as collaborative research and computational reproducibility initiatives, (2) establishing mechanisms that provide practical assistance in sharing of processing pipelines, presentation code, and data in an efficient way, and (3) improving the incentive structure for open science approaches. Throughout the manuscript, we provide references and links to available resources for those interested in adopting open science practices in their research.

Brain network dynamics fingerprints are resilient to data heterogeneity

CONTEXT

Large multi-site neuroimaging datasets have significantly advanced our quest to understand brain-behavior relationships and to develop biomarkers of psychiatric and neurodegenerative disorders. Yet, such data collections come at a cost, as the inevitable differences across samples may lead to biased or erroneous conclusions.

OBJECTIVE

We aim to validate the estimation of individual brain network dynamics fingerprints and appraise sources of variability in large resting-state functional magnetic resonance imaging (rs-fMRI) datasets by providing a novel point of view based on data-driven dynamical models.

APPROACH

Previous work has investigated this critical issue in terms of effects on static measures, such as functional connectivity and brain parcellations. Here, we utilize dynamical models (Hidden Markov models - HMM) to examine how diverse scanning factors in multi-site fMRI recordings affect our ability to infer the brain's spatiotemporal wandering between large-scale networks of activity. Specifically, we leverage a stable HMM trained on the Human Connectome Project (homogeneous) dataset, which we then apply to an heterogeneous dataset of traveling subjects scanned under a multitude of conditions.

MAIN RESULTS

Building upon this premise, we first replicate previous work on the emergence of non-random sequences of brain states. We next highlight how these time-varying brain activity patterns are robust subject-specific fingerprints. Finally, we suggest these fingerprints may be used to assess which scanning factors induce high variability in the data.

SIGNIFICANCE

These results demonstrate that we can i) use large scale dataset to train models that can be then used to interrogate subject-specific data, ii) recover the unique trajectories of brain activity changes in each individual, but also iii) urge caution as our ability to infer such patterns is affected by how, where and when we do so.

Effective Recruitment Strategies for a Sickle Cell Patient Registry Across Sites from the Sickle Cell Disease Implementation Consortium (SCDIC)

Sickle cell disease (SCD) is a genetic disorder predominantly affecting people of African descent and is associated with significant morbidity and mortality. To improve SCD outcomes, the National Heart Lung and Blood Institute funded eight centers to participate in the SCD Implementation Consortium. Sites were required to each recruit 300 individuals with SCD, over 20 months. We aim to describe recruitment strategies and challenges encountered. Participants aged 15-45 years with confirmed diagnosis of SCD were eligible. Descriptive statistics were used to analyze the effectiveness of each recruitment strategy. A total of 2432 participants were recruited. Majority (95.3%) were African American. Successful strategies were recruitment from clinics (68.1%) and affiliated sites (15.6%). Recruitment at community events, emergency departments and pain centers had the lowest yield. Challenges included saturation of strategies and time constraints. Effective recruitment of participants in multi-site studies requires multiple strategies to achieve adequate sample sizes.

Assessment of the impact of EHR heterogeneity for clinical research through a case study of silent brain infarction

Background

The rapid adoption of electronic health records (EHRs) holds great promise for advancing medicine through practice-based knowledge discovery. However, the validity of EHR-based clinical research is questionable due to poor research reproducibility caused by the heterogeneity and complexity of healthcare institutions and EHR systems, the cross-disciplinary nature of the research team, and the lack of standard processes and best practices for conducting EHR-based clinical research.

Method

We developed a data abstraction framework to standardize the process for multi-site EHR-based clinical studies aiming to enhance research reproducibility. The framework was implemented for a multi-site EHR-based research project, the ESPRESSO project, with the goal to identify individuals with silent brain infarctions (SBI) at Tufts Medical Center (TMC) and Mayo Clinic. The heterogeneity of healthcare institutions, EHR systems, documentation, and process variation in case identification was assessed quantitatively and qualitatively.

Result

We discovered a significant variation in the patient populations, neuroimaging reporting, EHR systems, and abstraction processes across the two sites. The prevalence of SBI for patients over age 50 for TMC and Mayo is 7.4 and 12.5% respectively. There is a variation regarding neuroimaging reporting where TMC are lengthy, standardized and descriptive while Mayo’s reports are short and definitive with more textual variations. Furthermore, differences in the EHR system, technology infrastructure, and data collection process were identified.

Conclusion

The implementation of the framework identified the institutional and process variations and the heterogeneity of EHRs across the sites participating in the case study. The experiment demonstrates the necessity to have a standardized process for data abstraction when conducting EHR-based clinical studies.

Use of a Single, Independent IRB: Case Study of an NIH Funded Consortium

In 2014, the Request for Applications from the National Institutes of Health (NIH) for continued funding of a multi-site clinical and mechanistic research network, Inner City Asthma Consortium (ICAC), called for "efficient IRB review and approval for multi-center studies" and "IRB approval within 30 days from submission". These requirements were precursors to the NIH policy of single IRB review for multi-site studies. Here we share our challenges, implementation processes, results, and recommendations, using a single, independent IRB.