Developing an international consensus Reporting guideline for intervention Fidelity in Non-Drug, non-surgical trials: The ReFiND protocol

BACKGROUND

Inadequate reporting of fidelity to interventions in trials limits the transparency and interpretation of trial findings. Despite this, most trials of non-drug, non-surgical interventions lack comprehensive reporting of fidelity. If fidelity is poorly reported, it is unclear which intervention components were tested or implemented within the trial, which also hinders research reproducibility. This protocol describes the development process of a reporting guideline for fidelity of non-drug, non-surgical interventions (ReFiND) in the context of trials.

METHODS

The ReFiND guideline will be developed in six stages. Stage one: a guideline development group has been formed to oversee the guideline methodology. Stage two: a scoping review will be conducted to identify and summarize existing guidance documents on the fidelity of non-drug, non-surgical interventions. Stage three: a Delphi study will be conducted to reach consensus on reporting items. Stage four: a consensus meeting will be held to consolidate the reporting items and discuss the wording and structure of the guideline. Stage five: a guidance statement, an elaboration and explanation document, and a reporting checklist will be developed. Stage six: different strategies will be used to disseminate and implement the ReFiND guideline.

DISCUSSION

The ReFiND guideline will provide a set of items developed through international consensus to improve the reporting of intervention fidelity in trials of non-drug, non-surgical interventions. This reporting guideline will enhance transparency and reproducibility in future non-drug, non-surgical intervention research.

Participant characteristics and exclusion from phase 3/4 industry funded trials of chronic medical conditions: meta-analysis of individual participant level data

Objectives

To assess whether age, sex, comorbidity count, and race and ethnic group are associated with the likelihood of trial participants not being enrolled in a trial for any reason (ie, screen failure).

Design

Bayesian meta-analysis of individual participant level data.

Setting

Industry funded phase 3/4 trials of chronic medical conditions.

Participants

Participants were identified using individual participant level data to be in either the enrolled group or screen failure group. Data were available for 52 trials involving 72 178 screened individuals of whom 24 733 (34%) were excluded from the trial at the screening stage.

Main outcome measures

For each trial, logistic regression models were constructed to assess likelihood of screen failure in people who had been invited to screening, and were regressed on age (per 10 year increment), sex (male v female), comorbidity count (per one additional comorbidity), and race or ethnic group. Trial level analyses were combined in Bayesian hierarchical models with pooling across condition.

Results

In age and sex adjusted models across all trials, neither age nor sex was associated with increased odds of screen failure, although weak associations were detected after additionally adjusting for comorbidity (odds ratio of age, per 10 year increment was 1.02 (95% credibility interval 1.01 to 1.04) and male sex (0.95 (0.91 to 1.00)). Comorbidity count was weakly associated with screen failure, but in an unexpected direction (0.97 per additional comorbidity (0.94 to 1.00), adjusted for age and sex). People who self-reported as black seemed to be slightly more likely to fail screening than people reporting as white (1.04 (0.99 to 1.09)); a weak effect that seemed to persist after adjustment for age, sex, and comorbidity count (1.05 (0.98 to 1.12)). The between-trial heterogeneity was generally low, evidence of heterogeneity by sex was noted across conditions (variation in odds ratios on log scale of 0.01-0.13).

Conclusions

Although the conclusions are limited by uncertainty about the completeness or accuracy of data collection among participants who were not randomised, we identified mostly weak associations with an increased likelihood of screen failure for age, sex, comorbidity count, and black race or ethnic group. Proportionate increases in screening these underserved populations may improve representation in trials.

Trial registration number

PROSPERO CRD42018048202.

Kids SIPsmartER reduces sugar-sweetened beverages among Appalachian middle-school students and their caregivers: a cluster randomized controlled trial

BACKGROUND

High consumption of sugar-sweetened beverages (SSB) is a global health concern. Additionally, sugar-sweetened beverage (SSB) consumption is disproportionately high among adolescents and adults in rural Appalachia. The primary study objective is to determine the intervention effects of Kids SIPsmartER on students' SSB consumption. Secondary objectives focus on caregivers' SSB consumption and secondary student and caregiver outcomes [e.g, body mass index (BMI), quality of life (QOL)].

METHODS

This Type 1 hybrid, cluster randomized controlled trial includes 12 Appalachian middle schools (6 randomized to Kids SIPsmartER and 6 to control). Kids SIPsmartER is a 6-month, 12 lesson, multi-level, school-based, behavior and health literacy program aimed at reducing SSB among 7th grade middle school students. The program also incorporates a two-way text message strategy for caregivers. In this primary prevention intervention, all 7th grade students and their caregivers from participating schools were eligible to participate, regardless of baseline SSB consumption. Validated instruments were used to assess SSB behaviors and QOL. Height and weight were objectively measured in students and self-reported by caregivers. Analyses included modified two-part models with time fixed effects that controlled for relevant demographics and included school cluster robust standard errors.

RESULTS

Of the 526 students and 220 caregivers, mean (SD) ages were 12.7 (0.5) and 40.6 (6.7) years, respectively. Students were 55% female. Caregivers were mostly female (95%) and White (93%); 25% had a high school education or less and 33% had an annual household income less than $50,000. Regardless of SSB intake at baseline and relative to control participants, SSB significantly decreased among students [-7.2 ounces/day (95% CI = -10.7, -3.7); p < 0.001, effect size (ES) = 0.35] and caregivers [-6.3 ounces/day (95% CI = -11.3, -1.3); p = 0.014, ES = 0.33]. Among students (42%) and caregivers (28%) who consumed > 24 SSB ounces/day at baseline (i.e., high consumers), the ES increased to 0.45 and 0.95, respectively. There were no significant effects for student or caregiver QOL indicators or objectively measured student BMI; however, caregiver self-reported BMI significantly decreased in the intervention versus control schools (p = 0.001).

CONCLUSIONS

Kids SIPsmartER was effective at reducing SSB consumption among students and their caregivers in the rural, medically underserved Appalachian region. Importantly, SSB effects were even stronger among students and caregivers who were high consumers at baseline.

TRIAL REGISTRATION

Clincialtrials.gov: NCT03740113. Registered 14 November 2018- Retrospectively registered, https://clinicaltrials.gov/ct2/show/NCT03740113 .

Back to the basics: Guidance for designing good literature searches

The number of scientific publications is growing at an unprecedented rate. Failure to properly evaluate existing literature at the start of a project may result in a researcher wasting time and resources. As pharmacy researchers and scholars look to conceptualize new studies, it is imperative to begin with a high-quality literature review that reveals what is known and unknown about a given topic. The purpose of this commentary is to provide useful guidance on conducting rigorous searches of the literature that inform the design and execution of research. Guidance for less formal literature reviews can be adapted from best practices utilized within the formalized field of evidence synthesis. Additionally, researchers can draw on guidance from PRESS (Peer Review of Electronic Search Strategies) to engage in self-evaluation of their search strategies. Finally, developing an awareness of common pitfalls when designing literature searches can provide researchers with confidence that their research is designed to fill clearly articulated gaps in knowledge.

The emerging adulthood gap in diabetes prevention research

Emerging adulthood, the period between ages 18 and 25, is distinct from older and younger populations in terms of both physiology and social circumstances. As a critical developmental window with long-lasting repercussions, emerging adulthood presents a key opportunity for prevention of cardiovascular disease. Despite significant advances in diabetes and cardiovascular disease prevention for other age groups, 18-25 year-olds remain underrepresented in research. Using diabetes prevention as an example, we analyzed the cited evidence behind four major guidelines that influence US clinical practice on screening and management of prediabetes in children and adults, revealing that the majority of these studies in both the pediatric and adult literature do not include emerging adults in their study populations. This gap between the pediatric and adult diabetes prevention literature creates a missing link connecting childhood risks to adult chronic disease. In this article, we draw attention to this often overlooked age group, and provide tangible recommendations as a path forward for both pediatric and adult researchers to increase the representation of emerging adults in diabetes prevention and other cardiovascular disease prevention studies.

Digital Mental Health and Its Discontents: Assumptions About Technology That Create Barriers to Equitable Access

Despite the potential of digital mental health interventions to aid recovery for people with serious mental illness, access to these digital tools remains a key barrier. In this column, the authors discuss three key assumptions that shape the integration of digital mental health tools into community health settings: clinical context, digital literacy, and financial burden. Clinical contexts have shifted with the increased use of telehealth, altering intervention environments; access to a mobile device is not the same as digital literacy; and digital mental health care is not necessarily affordable. Context-centered study design through ethnography will facilitate transfer of digital resources to real-world settings.

Methodological quality of systematic reviews on sepsis treatments: A cross-sectional study

OBJECTIVE

Systematic reviews (SRs) offer updated evidence to support decision-making on sepsis treatments. However, the rigour of SRs may vary, and methodological flaws may limit their validity in guiding clinical practice. This cross-sectional study appraised the methodological quality of SRs on sepsis treatments.

METHODS

We searched MEDLINE, EMBASE, and Cochrane Database for eligible SRs on randomised controlled trials on sepsis treatments with at least one meta-analysis published between 2018 and 2023. We extracted SRs' bibliographical characteristics with a pre-designed form and appraised their methodological quality using AMSTAR (A MeaSurement Tool to Assess systematic Reviews) 2. We applied logistic regressions to explore associations between bibliographical characteristics and methodological quality ratings.

RESULTS

Among the 102 SRs, two (2.0%) had high overall quality, while respectively four (3.9%), seven (6.9%) and 89 (87.3%) were of moderate, low, and critically low quality. Performance in several critical methodological domains was poor, with only 32 (31.4%) considering the risk of bias in primary studies in result interpretation, 22 (21.6%) explaining excluded primary studies, and 16 (15.7%) applying comprehensive searching strategies. SRs published in higher impact factor journals (adjusted odds ratio: 1.19; 95% confidence interval: 1.05 to 1.36) was associated with higher methodological quality.

CONCLUSIONS

The methodological quality of recent SRs on sepsis treatments is unsatisfactory. Future reviewers should address the above critical methodological aspects. More resources should also be allocated to support continuous training in critical appraisal among healthcare professionals and other evidence users.

"Future patient II" telerehabilitation for patients with heart failure: Protocol for a randomized controlled trial

Background

Heart failure is a global problem affecting millions of people worldwide. Current care of heart failure patients follows standard protocols and often overlooks the patients' specific needs, which leads to low compliance in the rehabilitation phase. Telerehabilitation, where the patients communicate with health care professionals about their rehabilitation program and monitor their vital signs, aims to increase the degree of compliance as well as enhancing their quality of life.

Objective

The aim of this study is to investigate whether application of the Future Patient Telerehabilitation Program II can improve the health-related quality of life for patients with heart failure.

Methods

A randomized controlled trial will be conducted. A total of 70 patients will be enrolled, 35 in the intervention group, 35 in the control group. The intervention group will follow an add-on to traditional care, while the control group will follow the conventional Danish cardiac rehabilitation program, which is based on periodic visits to the clinic. The patients will be followed for a period of six months. The intervention group will have access to an online HeartPortal and will use various home-based devices for self-monitoring. The primary outcome to be investigated is health-related quality of life as measured by the EuroQol-5 Dimension. Secondary outcomes are the number of visits to the outpatient clinic, number of readmissions and number of tele-communications contacts (phone and video) with health care professionals. The primary and secondary outcomes will be assessed using questionnaires and through the data generated by digital technologies for self-monitoring.

Results

Enrolment began in August 2020. The results will be published in peer-reviewed journals. Results from the Future Patient II Telerehabilitation program are expected to be published in 2024.

Discussion

This study is a further development of the Future Patient Telerehabilitation I study, and it is expected to explore the use of video consultation and a weight calculator in relation to telerehabilitation as well as the quality of life for heart failure patients.

Conclusion

The expected outcomes are increased quality of life, increased number of phone- and video-consultations with health-care professionals, and the enhanced ability of patients to manage their own disease with the use of a calculator for weight.

Priorities for efficacy trials of gender-affirming hormone therapy with estrogen: collaborative design and results of a community survey

PURPOSE

Treatment guidelines for gender-affirming hormone therapy with estrogen (GAHT-E) recommend specific dosing regimens based on limited data. Well-controlled efficacy trials are essential to tailoring treatment to patient goals as the guidelines recommend. The goal of this study was to take a foundational step toward designing community-centered effectiveness trials for gender-diverse individuals seeking GAHT-E.

METHODS

Our team developed a cross-sectional survey based on broad clinical experience and consultation with our community advisory board. The survey included 60 items covering demographics, transition history, goals and priorities for treatment, indicators of treatment success, sexual function goals, and future research priorities. The survey was distributed during the summer of 2021, primarily through social networks designed for gender-expansive individuals seeking treatment with estrogen.

RESULTS

A total of 1270 individuals completed the survey. Overall treatment goals most frequently rated "extremely important" or "very important" were the following: (1) improved satisfaction with life (81%), (2) appearing more feminine (80%), (3) appearing less masculine (77%), (4) improved mental health (76%), and (5) being seen as your true gender by others (75%). The three body characteristics most frequently rated "highest priority" or "high priority" among changes were the following: (1) facial hair (85%), (2) breast shape or size (84%), and (3) body shape (80%). The highest-rated research priority was comparing feminization with different routes of estrogen administration.

CONCLUSION

The goals and experiences of individuals seeking GAHT-E are diverse. Future clinical trials of GAHT-E should be grounded in the needs and priorities of community stakeholders.

Design differences and variation in results between randomised trials and non-randomised emulations: meta-analysis of RCT-DUPLICATE data

Objective

To explore how design emulation and population differences relate to variation in results between randomised controlled trials (RCT) and non-randomised real world evidence (RWE) studies, based on the RCT-DUPLICATE initiative (Randomised, Controlled Trials Duplicated Using Prospective Longitudinal Insurance Claims: Applying Techniques of Epidemiology).

Design

Meta-analysis of RCT-DUPLICATE data.

Data sources

Trials included in RCT-DUPLICATE, a demonstration project that emulated 32 randomised controlled trials using three real world data sources: Optum Clinformatics Data Mart, 2004-19; IBM MarketScan, 2003-17; and subsets of Medicare parts A, B, and D, 2009-17.

Eligibility criteria for selecting studies

Trials where the primary analysis resulted in a hazard ratio; 29 RCT-RWE study pairs from RCT-DUPLICATE.

Results

Differences and variation in effect sizes between the results from randomised controlled trials and real world evidence studies were investigated. Most of the heterogeneity in effect estimates between the RCT-RWE study pairs in this sample could be explained by three emulation differences in the meta-regression model: treatment started in hospital (which does not appear in health insurance claims data), discontinuation of some baseline treatments at randomisation (which would have been an unusual care decision in clinical practice), and delayed onset of drug effects (which would be under-reported in real world clinical practice because of the relatively short persistence of the treatment). Adding the three emulation differences to the meta-regression reduced heterogeneity from 1.9 to almost 1 (absence of heterogeneity).

Conclusions

This analysis suggests that a substantial proportion of the observed variation between results from randomised controlled trials and real world evidence studies can be attributed to differences in design emulation.

The DCM Project Portal: A direct-to-participant platform of The DCM Research Project

Study objective

To develop a digital platform to conduct family-based, dilated cardiomyopathy (DCM) genetic research.

Design

The DCM Project Portal, a direct-to-participant electronic recruitment, consent, and communication tool, was designed using prior experience with traditional enrollment methods and characteristics and feedback of current participants.

Participants

DCM patients (probands) and their family members enrolled from June 7, 2016 to March 15, 2020 at 25 US advanced heart failure programs.

Results

The portal was designed as a self-guided, three module (registration, eligibility, and consent) process with supporting informational and messaging resources integrated throughout. The experience is tailored to user type and the format adaptable with programmatic growth. Characteristics of participants of the recently completed DCM Precision Medicine Study were assessed as an exemplary user population. A majority of the diverse (34 % non-Hispanic Black (NHE-B), 9.1 % Hispanic; 53.6 % female) proband (n = 1223) and family member (n = 1781) participants aged ≥18 years reported not at all or rarely having problems learning about their health from written information (81 %) and a high confidence in completing medical forms (77.2 % very much or often confident), supporting a self-guided model. A majority of participants across age and race-ethnicity groups reported internet access, with highest rates of no reported access in those ≥77 years (31.9 %), NHE-B (25.2 %), and Hispanic (22.9 %), a similar pattern to those reported by the US Census Bureau as of 2021.

Conclusions

The portal is an example of a digital approach to family-based genetic research that offers opportunity to improve access and efficiency of research operations.

Advancing patient-centered research practices in a pragmatic patient-level randomized clinical trial: A thematic analysis of stakeholder engagement in Emergency Medicine Palliative Care Access (EMPallA)

BACKGROUND

Involving patient and community stakeholders in clinical trials adds value by ensuring research prioritizes patient goals both in conduct of the study and application of the research. The use of stakeholder committees and their impact on the conduct of a multicenter clinical trial have been underreported clinically and academically. The aim of this study is to describe how Study Advisory Committee (SAC) recommendations were implemented throughout the Emergency Medicine Palliative Care Access (EMPallA) trial. EMPallA is a multi-center, pragmatic two-arm randomized controlled trial (RCT) comparing the effectiveness of nurse-led telephonic case management and specialty, outpatient palliative care of older adults with advanced illness.

METHODS

A SAC consisting of 18 individuals, including patients with palliative care experience, members of healthcare organizations, and payers was convened for the EMPallA trial. The SAC engaged in community-based participatory research and assisted in all aspects from study design to dissemination. The SAC met with the research team quarterly and annually from project inception to dissemination. Using meeting notes and recordings we completed a qualitative thematic analysis using an iterative process to develop themes and subthemes to summarize SAC recommendations throughout the project's duration.

RESULTS

The SAC convened 16 times between 2017 and 2020. Over the course of the project, the SAC provided 41 unique recommendations. Twenty-six of the 41 (63%) recommendations were adapted into formal Institutional Review Board (IRB) study modifications. Recommendations were coded into four major themes: Scientific, Pragmatic, Resource and Dissemination. A majority of the recommendations were related to either the Scientific (46%) or Pragmatic (29%) themes. Recommendations were not mutually exclusive across three study phases: Preparatory, execution and translational. A vast majority (94%) of the recommendations made were related to the execution phase. Major IRB study modifications were made based on their recommendations including data collection of novel dependent variables and expanding recruitment to Spanish-speaking patients.

CONCLUSIONS

Our study provides an example of successful integration of a SAC in the conduct of a pragmatic, multi-center RCT. Future trials should engage with SACs in all study phases to ensure trials are relevant, inclusive, patient-focused, and attentive to gaps between health care and patient and family needs.

TRIAL REGISTRATION

Clinicaltrials.gov Identifier: NCT03325985, 10/30/2017.

Involving patients and clinicians in the development of a randomised clinical trial protocol to assess spinal manual therapy versus nerve root injection for patients with lumbar radiculopathy: a patient and public involvement project to inform the SALuBRITY trial design

BACKGROUND

Spinal manual therapy and corticosteroid nerve root injection are commonly used to treat patients with lumbar radiculopathy. The SALuBRITY trial-a two parallel group, double sham controlled, randomised clinical trial-is being developed to compare their effectiveness. By gathering patients' and clinicians' perspectives and involving them in discussions related to the trial research question and objectives, proposed trial recruitment processes, methods, and outcome measures, we aimed to improve the relevance and quality of the SALuBRITY trial.

METHODS

We involved patients with lived experience of lumbar radiculopathy (n = 5) and primary care clinicians (n = 4) with experience in the treatment of these patients. Involvement activities included an initial kick-off event to introduce the project, establishing a shared purpose statement, and empowering patient and clinician advisors for their involvement, followed by semi-structured group and individual interviews, and questionnaires to evaluate the experience throughout the project.

RESULTS

Both patient and clinician advisors endorsed the significance and relevance of the trial's objectives. Patients assessed the proposed trial methods as acceptable within the context of a trusting patient-clinician relationship. A trial recruitment and enrolment target time of up to five days was regarded as acceptable, although patients with chronic radiculopathy may need more time to consider their trial participation decision. All advisors reached consensus on the acceptability of a medication washout phase of 12- to 24-h before pain outcome measurement, with the inclusion of a rescue medication protocol. Both advisory groups preferred leg pain over back pain as the primary clinical outcome, with patient advisors advocating for personalized primary pain localization. Furthermore, patients requested expanding the pain, enjoyment, and general activity scale with peak pain intensity, rather than average pain alone. Patient and clinician advisors evaluated their engagement in clinical research as meaningful and impactful.

CONCLUSION

Patient and public involvement resulted in important and relevant considerations for the SALuBRITY trial, spanning all research phases. These findings hold promise for enhancing the trial's quality and relevance and improving its translation into clinical practice.

The middle-aged and older Chinese adults' health using actigraphy in Taiwan (MOCHA-T): protocol for a multidimensional dataset of health and lifestyle

BACKGROUND AND OBJECTIVES

Older adults keep transforming with Baby Boomers and Gen Xers being the leading older population. Their lifestyle, however, is not well understood. The middle-aged and older Chinese adults' health using actigraphy in Taiwan (MOCHA-T) collected both objective and subjective data to depict the health and lifestyle of this population. The objectives, design, and measures of the MOCHA-T study are introduced, and the caveats and future directions related to the use of the data are presented.

METHODS

People aged 50 and over were recruited from the community, with a subset of women aged 45-49 invited to supplement data on menopause and aging. Four instruments (i.e., self-reported questionnaires, diary, wrist actigraphy recorder, and GPS) were used to collect measures of sociodemographic, health, psychosocial, behavioral, temporal, and spatial data.

RESULTS

A total of 242 participants who returned the informed consent and questionnaires were recruited in the MOCHA-T study. Among them, 94.6%, 95.0%, and 25.2% also completed the diary, actigraphy, and GPS data, respectively. There was almost no difference in sociodemographic characteristics between those with and without a completed diary, actigraphy, and GPS data, except for age group and educational level for those who returned completed actigraphy data.

CONCLUSION

The MOCHA-T study is a multidimensional dataset that allows researchers to describe the health, behaviors, and lifestyle patterns, and their interactions with the environment of the newer generation of middle-aged and older adults in Taiwan. It can be compared with other countries with actigraphy and GPS-based lifestyle data of middle-aged and older adults in the future.

From complexity to clarity: how directed acyclic graphs enhance the study design of systematic reviews and meta-analyses

While frameworks to systematically assess bias in systematic reviews and meta-analyses (SRMAs) and frameworks on causal inference are well established, they are less frequently integrated beyond the data analysis stages. This paper proposes the use of Directed Acyclic Graphs (DAGs) in the design stage of SRMAs. We hypothesize that DAGs created and registered a priori can offer a useful approach to more effective and efficient evidence synthesis. DAGs provide a visual representation of the complex assumed relationships between variables within and beyond individual studies prior to data analysis, facilitating discussion among researchers, guiding data analysis, and may lead to more targeted inclusion criteria or set of data extraction items. We illustrate this argument through both experimental and observational case examples.

Use of nominal group technique methods in the virtual setting: A reflective account and recommendations for practice

Nominal group technique methods involve the use of structured activities within groups comprised of purposefully selected stakeholders (nominal groups), with the broad aim of achieving a level of consensus and prioritising information. In this paper, we will report how we facilitated nominal groups, using Microsoft Teams, to prioritise content for a theory-based behaviour change intervention to improve responses to clinically deteriorating patients. Our methods incorporated development and piloting of research materials, facilitation of online nominal groups with different stakeholders, and a structured approach to ranking behaviour change strategies. Practical suggestions are offered based on our experience of using this method in a virtual context.

Back to the basics: Guidance for formulating good research questions

Good science is driven by rigorous questions. Much like the foundation of a house, a research question must be carefully constructed to prevent downstream problems in project execution. And yet, pharmacy researchers and scholars across all career stages may find themselves struggling when developing research questions. The purpose of this commentary is to provide useful guidance on composing and evaluating rigorous research questions. A variety of frameworks, such as PICO (Patient/population; Intervention; Comparison; Outcome), are available to researchers and can assist them in ensuring that their research question has covered all relevant components. Additionally, the FINER (Feasible; Interesting; Novel; Ethical; and Relevant) criteria can help researchers with evaluating their research questions for practical considerations. Finally, building awareness of common pitfalls when composing research questions can aid researchers to avoid issues that they may not otherwise discover until their manuscript undergoes peer review.

An evaluation of untargeted metabolomics methods to characterize inborn errors of metabolism

Inborn errors of metabolism (IEMs) encompass a diverse group of disorders that can be difficult to classify due to heterogenous clinical, molecular, and biochemical manifestations. Untargeted metabolomics platforms have become a popular approach to analyze IEM patient samples because of their ability to detect many metabolites at once, accelerating discovery of novel biomarkers, and metabolic mechanisms of disease. However, there are concerns about the reproducibility of untargeted metabolomics research due to the absence of uniform reporting practices, data analyses, and experimental design guidelines. Therefore, we critically evaluated published untargeted metabolomic platforms used to characterize IEMs to summarize the strengths and areas for improvement of this technology as it progresses towards the clinical laboratory. A total of 96 distinct IEMs were collectively evaluated by the included studies. However, most of these IEMs were evaluated by a single untargeted metabolomic method, in a single study, with a limited cohort size (55/96, 57%). The goals of the included studies generally fell into two, often overlapping, categories: detecting known biomarkers from many biochemically distinct IEMs using a single platform, and detecting novel metabolites or metabolic pathways. There was notable diversity in the design of the untargeted metabolomic platforms. Importantly, the majority of studies reported adherence to quality metrics, including the use of quality control samples and internal standards in their experiments, as well as confirmation of at least some of their feature annotations with commercial reference standards. Future applications of untargeted metabolomics platforms to the study of IEMs should move beyond single-subject analyses, and evaluate reproducibility using a prospective, or validation cohort.

Synoptic review on existing and potential sources for bias in dental research methodology with methods on their prevention and remedies

The results of years of dental study serve as the foundation for the practise of medicine and, for that matter, dentistry. Doctors may have their own preferences for techniques and materials, but whether directly or indirectly, their decisions are influenced by systematic reviews and meta-analyses. However, due to poorly conducted or presented research, this very basic foundation may not be reliable. Bias in research is one of several factors that might make study results or research itself unreliable. Bias can be introduced into research at many stages, deliberately or unknowingly. Bias can appear at any point during the research process, even before the study itself begins. There are many biases in research, but some of them are more relevant to dentistry research than others. Because it is said that "eyes see what the mind knows", it is essential to have a complete understanding of the different types of bias, how and when they get entrenched, and what steps may be taken to prevent or lessen them if they do occur. This comprehensive summary of bias in dentistry research is provided by this synoptic review. The goal is to identify gaps and measures that have been taken-or that should have been taken-by providing both descriptive and evaluative summaries, as well as examples from the literature, when needed.

Time and change: a typology for presenting research findings in qualitative longitudinal research

BACKGROUND

Qualitative longitudinal research (QLR) is an emerging methodology used in health research. The method literature states that the change in a phenomenon through time should be the focus of any QLR study, but in empirical studies, the analysis of changes through time is often poorly described, and the emphasis on time/change in the findings varies greatly. This inconsistency might depend on limitations in the existing method literature in terms of describing how QLR studies can present findings. The aim of this study was to develop and describe a typology of alternative approaches for integrating time and/or change in QLR findings.

METHODS

In this method study, we used an adapted scoping review design. Articles were identified using EBSCOhost. In total, methods and results sections from 299 QLR articles in the field of health research were analyzed with inspiration from content analysis.

RESULTS

We constructed a typology of three types and seven subtypes. The types were based on the underlying structural principles of how time/change was presented: Type A) Findings have a low utilization of longitudinal data, Type B) Findings are structured according to chronological time, and Type C) Findings focus on changes through time. These types differed in 1) the way the main focus was on time, change or neither; 2) the level of interpretation in the findings; and 3) how theoretical understandings of time/change were articulated in the articles. Each type encompassed two or three subtypes that represented distinct approaches to the aim and results presentation of QLR findings.

CONCLUSIONS

This method study is the first to describe a coherent and comprehensive typology of alternative approaches for integrating time/change into QLR findings in health research. By providing examples of various subtypes that can be used for results presentations, it can help researchers make informed decisions suitable to their research intent.

Profiling the Research Activities of Canadian Occupational Therapy and Occupational Science Faculty Members

Background. There is a lack of knowledge on the scope and nature of the research by faculty members in occupational science (OS) and/or occupational therapy (OT) programs in Canada. Purpose. To describe the research activities of faculty members in these programs and directions. Method. A cross-sectional survey was distributed to 173 faculty members across all 14 Canadian OT that addressed: 1) research topics and methods, 2) populations, and 3) funding. Findings. Based on respondents (N  =  121), research is focused on a range of topics and populations with most conducting qualitative research. Many conduct research examining the effectiveness of interventions, with few respondents focused on OS research. Federal and provincial grants agencies were the largest source of funding. Implications. Research topics studied were not always proportional to practice although emerging areas were being investigated that can expand the evidence base and scope of practice. Despite limited occupation-specific funding options, respondents were accessing funding from varied sources. Collaborations among faculty members, clinicians, and individuals with lived experience can create priorities for future OS and/or OT research in Canada.

What does consumer and community involvement in health-related education look like? A mixed methods study

Consumer and community involvement (also referred to as patient and public involvement) in health-related curricula involves actively partnering with people with lived experience of health and social care systems. While health professions education has a long history of interaction with patients or consumers, a shift in the way consumer and community engage in health-related education has created novel opportunities for mutual relationships valuing lived experience expertise and shifting traditional education power relations. Drawing on a mixed methods design, we explored consumer and community involvement practices in the design and delivery of health-related education using the capability, opportunity, motivation and behaviour framework (COM-B). In our results, we describe educator capabilities, opportunities and motivations, including identifying barriers and enablers to consumer and community involvement in health-related education. Educators have varying philosophical reasons and approaches for involving consumers and community. There is a focus on augmenting student learning through inclusion of lived and living experience, and on mutual transformative learning through embedding lived experience and co-creating learning. How these philosophical positionings and motivations shape the degree by which educators involve consumers and community members in health-related curricula is important for further understanding these educational partnerships within universities.

Using the Matrixed Multiple Case Study approach to identify factors affecting the uptake of IPV screening programs following the use of implementation facilitation

BACKGROUND

Intimate partner violence (IPV) is a prevalent social determinant of health. The US Preventive Services Task Force recommends routine IPV screening of women, but uptake remains variable. The Veterans Health Administration (VHA) initiated implementation facilitation (IF) to support integration of IPV screening programs into primary care clinics. An evaluation of IF efforts showed variability in IPV screening rates across sites. The follow-up study presented here used a Matrixed Multiple Case Study (MMCS) approach to examine the multilevel factors impacting IPV screening program implementation across sites with varying levels of implementation success.

METHODS

This mixed methods study is part of a larger cluster randomized stepped wedge Hybrid-II program evaluation. In the larger trial, participating sites received 6 months of IF consisting of an external facilitator from VHA's Office of Women's Health working closely with an internal facilitator and key site personnel. Recognizing the heterogeneity in implementation outcomes across sites, the MMCS approach was used to enable interpretation of qualitative and quantitative data within and across sites to help contextualize the primary findings from the larger study. Qualitative data collection was guided by the integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) framework and included interviews with key informants involved in IPV screening implementation at eight sites. Quantitative data on IPV screening uptake was derived from medical records and surveys completed by key personnel at the same eight sites to understand implementation facilitation activities.

RESULTS

Fifteen factors influencing IPV screening implementation spanning all four i-PARIHS domains were identified and categorized into three distinct categories: (1) factors with enabling influence across all sites, (2) factors deemed important to implementation success, and (3) factors differentiating sites with high/medium versus low implementation success.

CONCLUSIONS

Understanding the influencing factors across multi-level domains contributing to variable success of IPV screening implementation can inform the tailoring of IF efforts to promote spread and quality of screening. Implementation of IPV screening programs in primary care with IF should consider consistent engagement of internal facilitators with clinic staff involved in implementation, the resourcefulness of external facilitators, and appending resources to IPV screening tools to help key personnel address positive screens.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04106193. Registered on September 26, 2019.

The effect of disease misclassification on the ability to detect a gene-environment interaction: implications of the specificity of case definitions for research on Gulf War illness

BACKGROUND

Since 1997, research on Gulf War illness (GWI) has predominantly used 3 case definitions-the original Research definition, the CDC definition, and modifications of the Kansas definition-but they have not been compared against an objective standard.

METHODS

All 3 case definitions were measured in the U.S. Military Health Survey by a computer-assisted telephone interview in a random sample (n = 6,497) of the 1991 deployed U.S. military force. The interview asked whether participants had heard nerve agent alarms during the conflict. A random subsample (n = 1,698) provided DNA for genotyping the PON1 Q192R polymorphism.

RESULTS

The CDC and the Modified Kansas definition without exclusions were satisfied by 41.7% and 39.0% of the deployed force, respectively, and were highly overlapping. The Research definition, a subset of the others, was satisfied by 13.6%. The majority of veterans meeting CDC and Modified Kansas endorsed fewer and milder symptoms; whereas, those meeting Research endorsed more symptoms of greater severity. The group meeting Research was more highly enriched with the PON1 192R risk allele than those meeting CDC and Modified Kansas, and Research had twice the power to detect the previously described gene-environment interaction between hearing alarms and RR homozygosity (adjusted relative excess risk due to interaction [aRERI] = 7.69; 95% CI 2.71-19.13) than CDC (aRERI = 2.92; 95% CI 0.96-6.38) or Modified Kansas without exclusions (aRERI = 3.84; 95% CI 1.30-8.52) or with exclusions (aRERI = 3.42; 95% CI 1.20-7.56). The lower power of CDC and Modified Kansas relative to Research was due to greater false-positive disease misclassification from lower diagnostic specificity.

CONCLUSIONS

The original Research case definition had greater statistical power to detect a genetic predisposition to GWI. Its greater specificity favors its use in hypothesis-driven research; whereas, the greater sensitivity of the others favor their use in clinical screening for application of future diagnostic biomarkers and clinical care.

Pressure Injury Data Reconciliation in a Randomized Controlled Trial

OBJECTIVE

To advance pressure injury (PrI) research in individuals with spinal cord injury (SCI) by describing lessons learned and recommendations for future research, ultimately promoting PrI prevention and more effective wound care. This paper describes the detailed procedures undertaken to collect and reconcile PrI data and summarizes the types of discrepancies identified.

DESIGN

Secondary analyses of PrI data collected between 2009 and 2014 in a randomized controlled trial (parent study).

SETTING

Participants in the parent study were recruited from a large rehabilitation center in the Los Angeles area that serves primarily individuals with limited resources.

PARTICIPANTS

232 participants with SCI and a history of 1 or more medically serious PrI (MSPrI) in the previous 5 years.

INTERVENTIONS

Participants in the parent study were randomized to a 12-month PrI prevention intervention led by an occupational therapist, or to usual care.

MAIN OUTCOME MEASURES

Relations among PrI characteristics, data sources (phone interviews, skin checks, paper and electronic medical records [MRs]), and treatment condition, and sensitivity of 6 different data sources in detecting MSPrIs.

RESULTS

The majority (62%) of MSPrIs were in the pelvic region. MRs detected 82% of the MSPrIs overall, making it the most sensitive data source, and scheduled skin checks were the second-most sensitive data source, finding 37% of the MSPrIs.

CONCLUSIONS

MR review is the preferred method for ascertaining MSPrIs in clinical trials of interventions designed to reduce the incidence of these injuries. When multiple sources of information are used, careful reconciliation of reports is necessary to ensure accuracy.

Personalized redox biology: Designs and concepts

Personalized interventions are regarded as a next-generation approach in almost all fields of biomedicine, such as clinical medicine, exercise, nutrition and pharmacology. At the same time, an increasing body of evidence indicates that redox processes regulate, at least in part, multiple aspects of human physiology and pathology. As a result, the idea of applying personalized redox treatments to improve their efficacy has gained popularity among researchers in recent years. The aim of the present primer-style review was to highlight some crucial yet underappreciated methodological, statistical, and interpretative concepts within the redox biology literature, while also providing a physiology-oriented perspective on personalized redox biology. The topics addressed are: (i) the critical issue of investigating the potential existence of inter-individual variability; (ii) the importance of distinguishing a genuine and consistent response of a subject from a chance finding; (iii) the challenge of accurately quantifying the effect of a redox treatment when dealing with 'extreme' groups due to mathematical coupling and regression to the mean; and (iv) research designs and analyses that have been implemented in other fields, and can be reframed and exploited in a redox biology context.

Lessons learnt while designing and conducting a longitudinal study from the first Italian COVID-19 pandemic wave up to 3 years

BACKGROUND

Several scientific contributions have summarized the "lessons learnt" during the coronavirus disease 2019 (COVID-19) pandemic, but only a few authors have discussed what we have learnt on how to design and conduct research during a pandemic. The main intent of this study was to summarize the lessons learnt by an Italian multidisciplinary research group that developed and conducted a longitudinal study on COVID-19 patients infected during the first wave in March 2020 and followed-up for 3 years.

METHODS

A qualitative research approach embedded into the primary CORonavirus MOnitoRing study (CORMOR) study was developed, according to the the consolidated criteria for reporting qualitative research. Multiple data collection strategies were performed: each member was invited to report the main lessons learnt according to his/her perspective and experience from the study design throughout its conduction. The narratives collected were summarized and discussed in face-to-face rounds. The narratives were then thematically analysed according to their main topic in a list that was resent to all members to check the content and their organization. The list of the final "lessons learnt" has been agreed by all members, as described in a detailed fashion.

RESULTS

Several lessons were learnt while designing and conducting a longitudinal study during the COVID-19 pandemic and summarised into ten main themes: some are methodological, while others concern how to conduct research in pandemics/epidemics/infectious disease emergencies.

CONCLUSIONS

The multidisciplinary approach, which also included patients' perspective, helped us to protect the consistency and quality of the research provided in pandemic times. The lesson learnt suggest that our research approach may benefit from changes in education, clinical practice and policies.

Drug-coated balloon for treatment of non-atherosclerotic renal artery stenosis-a multi-center study

INTRODUCTION

Renal artery stenosis (RAS) is a significant reason for secondary hypertension. Impaired renal function and subsequent cardiopulmonary dysfunction could also occur. Patients of non-atherosclerotic RAS has a relatively young age and long life expectancy. Revascularization with percutaneous transluminal angioplasty (PTA) is a viable treatment option. However, restenosis is unavoidable which limits its use. Drug-coated balloon (DCB) has been proven to be effective in restenosis prevention in femoropopliteal arterial diseases and in patients with renal artery stenosis. And PTA for Renal artery fibromuscular dysplasia is safe and clinically successful. Therefore, we could speculate that DCB might have potential efficacy in non-atherosclerotic RAS treatment.

METHODS AND ANALYSIS

This will be a randomized multi-center-controlled trial. Eighty-four eligible participants will be assigned randomly in a 1:1 ratio to the control group (plain old balloon, POB) and the experimental group (DCB). Subjects in the former group will receive balloon dilatation alone, and in the latter group will undergo the DCB angioplasty. The DCB used in this study will be a paclitaxel-coated balloon (Orchid, Acotec Scientific Holdings Limited, Beijing, China). Follow-up visits will be scheduled 1, 3, 6, 9, and 12 months after the intervention. Primary outcomes will include controlled blood pressure and primary patency in the 9-month follow-up. Secondary outcomes will include technical success rate, complication rate, and bail-out stenting rate.

TRIAL REGISTRATION

ClinicalTrials.gov (number NCT05858190). Protocol version V.4 (3 May 2023).

Asynchronous online focus groups for research with people living with amyotrophic lateral sclerosis and family caregivers: usefulness, acceptability and lessons learned

BACKGROUND

People with amyotrophic lateral sclerosis (ALS) face disability- and travel-related barriers to research participation. We investigate the usefulness and acceptability of asynchronous, online focus groups (AOFGs) for research involving people affected by ALS (patients and family caregivers) and outline lessons learned.

METHODS

The ALS Talk Project, consisting of seven AOFGs and 100 participants affected by ALS, provided context for this investigation. Hosted on the secure itracks Board™ platform, participants interacted in a threaded web forum structure. Moderators posted weekly discussion questions and facilitated discussion. Data pertaining to methodology, participant interaction and experience, and moderator technique were analyzed using itracks and NVivo 12 analytics (quantitative) and conventional content analysis and the constant-comparative approach (qualitative).

RESULTS

There was active engagement within groups, with post lengths averaging 111.48 words and a complex network of branching interactions between participants. One third of participant responses included individual reflections without further interaction. Participants affirmed their co-group members, offered practical advice, and discussed shared and differing perspectives. Moderators responded to all posts, indicating presence and probing answers. AOFGs facilitated qualitative and quantitative data-gathering and flexible response to unanticipated events. Although total participation fell below 50% after 10-12 weeks, participants valued interacting with peers in an inclusive, confidential forum. Participants used a variety of personal devices, browsers, and operating systems when interacting on the online platform.

CONCLUSIONS

This methodological examination of AOFGs for patient-centred investigations involving people affected by ALS demonstrates their usefulness and acceptability, and advances knowledge of online research methodologies. Lessons learned include: early identification of research goals and participant needs is critical to selecting an AOFG platform; although duration longer than 10-12 weeks may be burdensome in this population, participants were positive about AOFGs; AOFGs offer real world flexibility enabling response to research challenges and opportunities; and, AOGFs can effectively foster safe spaces for sharing personal perspectives and discussing sensitive topics. With moderators playing an important role in fostering engagement, AOFGs facilitated rich data gathering and promoted reciprocity by fostering the exchange of ideas and interaction between peers. Findings may have implications for research involving other neurologically impaired and/or medically vulnerable populations.

Publications poorly report the essential RadiOmics ParametERs (PROPER): A meta-research on quality of reporting

PURPOSE

To investigate the quality of reporting in radiomics research, with a focus on the most basic technical parameters.

METHODS

A PubMed literature search was conducted to identify original studies on radiomics (last search: January 2, 2023). Following a sample size calculation with an a priori power analysis, a random sample of the radiomic literature was collected. In addition to baseline characteristics, the key aspects of radiomic software, resampling, and discretization were evaluated. Agreement between raters was analyzed. Disagreements were resolved through consensus.

RESULTS

A sample of 87 publications was evaluated. Most publications (89%; 77/87) were retrospective. They were conducted predominantly with private data (87%; 76/87) at a single institution (77%; 67/87) without external validation (90%; 78/87). 69% (60/87) of the papers reported the radiomic software used (p < 0.001), with nearly half (43%; 26/60) omitting the version. 37% (32/87) reported the resampling size (p = 0.018), while 22% (7/32) did not report using iso-voxel resampling. 34% (30/87) reported the discretization parameters (p < 0.01), but more than three-quarters (77%; 23/30) did not experiment with different discretization parameters. A wide range of discretization parameter values were reported. Most papers (79%; 69/87) failed to report all three essential items simultaneously (p < 0.001).

CONCLUSION

Even the essential radiomic parameters that are usually displayed on the user interface of radiomic software tools were poorly reported in radiomics-related publications. This issue of transparency may require additional action from researchers, editors, and reviewers in the form of adopting more stringent reporting standards (e.g., checklists, guidelines).

How to update a living systematic review and keep it alive during a pandemic: a practical guide

BACKGROUND

The covid-19 pandemic has highlighted the role of living systematic reviews. The speed of evidence generated during the covid-19 pandemic accentuated the challenges of managing high volumes of research literature.

METHODS

In this article, we summarise the characteristics of ongoing living systematic reviews on covid-19, and we follow a life cycle approach to describe key steps in a living systematic review.

RESULTS

We identified 97 living systematic reviews on covid-19, published up to 7th November 2022, which focused mostly on the effects of pharmacological interventions (n = 46, 47%) or the prevalence of associated conditions or risk factors (n = 30, 31%). The scopes of several reviews overlapped considerably. Most living systematic reviews included both observational and randomised study designs (n = 45, 46%). Only one-third of the reviews has been updated at least once (n = 34, 35%). We address practical aspects of living systematic reviews including how to judge whether to start a living systematic review, methods for study identification and selection, data extraction and evaluation, and give recommendations at each step, drawing from our own experience. We also discuss when it is time to stop and how to publish updates.

CONCLUSIONS

Methods to improve the efficiency of searching, study selection, and data extraction using machine learning technologies are being developed, their performance and applicability, particularly for reviews based on observational study designs should improve, and ways of publishing living systematic reviews and their updates will continue to evolve. Finally, knowing when to end a living systematic review is as important as knowing when to start.

Optimizing data integration in trials that use EHR data: lessons learned from a multi-center randomized clinical trial

BACKGROUND

Despite great promise, trials that ascertain patient clinical data from electronic health records (EHR), referred to here as "EHR-sourced" trials, are limited by uncertainty about how existing trial sites and infrastructure can be best used to operationalize study goals. Evidence is needed to support the practical use of EHRs in contemporary clinical trial settings.

MAIN TEXT

We describe a demonstration project that used EHR data to complement data collected for a contemporary multi-center pharmaceutical industry outcomes trial, and how a central coordinating center supported participating sites through the technical, governance, and operational aspects of this type of activity. We discuss operational considerations related to site selection, data extraction, site performance, and data transfer and quality review, and we outline challenges and lessons learned. We surveyed potential sites and used their responses to assess feasibility, determine the potential capabilities of sites and choose an appropriate data extraction strategy. We designed a flexible, multimodal approach for data extraction, enabling each site to either leverage an existing data source, create a new research datamart, or send all data to the central coordinating center to produce the requisite data elements. We evaluated site performance, as reflected by the speed of contracting and IRB approval, total patients enrolled, enrollment yield, data quality, and compared performance by data collection strategy.

CONCLUSION

While broadening the type of sites able to participate in EHR-sourced trials may lead to greater generalizability and improved enrollment, sites with fewer technical resources may require additional support to participate. Central coordinating center support is essential to facilitate the execution of operational processes. Future work should focus on sharing lessons learned and creating reusable tools to facilitate participation of heterogeneous trial sites.

Cluster randomized trials in nursing homes should better be planned as open-cohort than as closed-cohort

OBJECTIVES

Two designs are frequently used in cluster randomized trials in nursing homes: closed cohort and open cohort. The former design includes residents at the beginning of the trial and then follows them. In the latter design, participants are enrolled at the beginning of the trial or although it is ongoing; at dates of assessment, all residents present in the nursing home are assessed. The open-cohort design is much less used than the closed-cohort design, but it offers several advantages such as less exposure to individual attrition. Objective was to assess whether an open-cohort design could have been feasible in trials with a closed-cohort design.

STUDY DESIGN AND SETTING

Twenty-two closed-cohort trials in nursing homes.

RESULTS

An open-cohort design was considered a relevant alternative for 20 trials. For 16 trials, a resident newly admitted could not opt out of the intervention, and for all trials, the resident could benefit from an intervention effect if it existed. For two trials, newly admitted residents could not benefit from the intervention effect, if it existed.

CONCLUSION

The open-cohort design is well-adapted for most of the interventions assessed in nursing homes by means of a cluster randomized trial and should be considered more often.

How to review and assess a systematic review and meta-analysis article: a methodological study (secondary publication)

Systematic reviews and meta-analyses have become central in many research fields, particularly medicine. They offer the highest level of evidence in evidence-based medicine and support the development and revision of clinical practice guidelines, which offer recommendations for clinicians caring for patients with specific diseases and conditions. This review summarizes the concepts of systematic reviews and meta-analyses and provides guidance on reviewing and assessing such papers. A systematic review refers to a review of a research question that uses explicit and systematic methods to identify, select, and critically appraise relevant research. In contrast, a meta-analysis is a quantitative statistical analysis that combines individual results on the same research question to estimate the common or mean effect. Conducting a meta-analysis involves defining a research topic, selecting a study design, searching literature in electronic databases, selecting relevant studies, and conducting the analysis. One can assess the findings of a meta-analysis by interpreting a forest plot and a funnel plot and by examining heterogeneity. When reviewing systematic reviews and meta-analyses, several essential points must be considered, including the originality and significance of the work, the comprehensiveness of the database search, the selection of studies based on inclusion and exclusion criteria, subgroup analyses by various factors, and the interpretation of the results based on the levels of evidence. This review will provide readers with helpful guidance to help them read, understand, and evaluate these articles.

Monitoring health and health behaviors among adolescents in Central Catalonia: DESKcohort protocol

The objective of the prospective cohort study (the DESKcohort project) is to describe and monitor health, health behaviors, and their related factors among 12 and 19-year-old adolescents schooled at centers of Compulsory Secondary Education or post-compulsory secondary education in Central Catalonia, considering social determinants of health. The DESKcohort survey is administered biannually between the months of October and June, and the project has been running for three years. We have interviewed 7319 and 9265 adolescents in the academic years 2019/20 and 2021/22, respectively. They responded a questionnaire created by a committee of experts, that included the following variables: sociodemographic factors, physical and mental health, food, physical activity, leisure and mobility, substance use, interpersonal relationships, sexuality, screen use and digital entertainment, and gambling. The results are presented to educational centers, county councils, municipalities, and health and third sector entities to plan, implement, and evaluate prevention and health promotion actions that address the identified needs.

The DCM Project Portal: A direct-to-participant platform of The DCM Research Project

Study Objective

To develop a digital platform to conduct family-based, dilated cardiomyopathy (DCM) genetic research.

Design

Innovative approaches are needed to achieve large family enrollment targets. The DCM Project Portal, a direct-to-participant electronic recruitment, consent, and communication tool, was designed using prior experience with traditional enrollment methods, characteristics and feedback of current participants, and internet access of the US population.

Participants

DCM patients (probands) and their family members.

Results

The portal was designed as a self-guided, three module (registration, eligibility, and consent) process with internally created supporting informational and messaging resources integrated throughout. The experience can be tailored to user type and the format adapted with programmatic growth. Characteristics of participants of the recently completed DCM Precision Medicine Study were assessed as an exemplary user population. A majority of the diverse (34% non-Hispanic Black (NHE-B), 9.1% Hispanic; 53.6% female) proband (n=1223) and family members (n=1781) participants aged ≥18 years reported not at all or rarely having problems learning about their health from written information (81%) and a high confidence in completing medical forms (77.2% very much or often confident). A majority of participants across age and race-ethnicity groups reported internet access, with highest rates of no reported access in those ≥77 years, NHE-B, and Hispanic, which reflects patterns similar to rates reported by the US Census Bureau as of 2021.

Conclusions

Digital enrollment tools offer opportunity to improve access and efficiency. The portal is an example of a digital approach to family-based genetic research.

Authors arbitrarily used methodological approaches to analyze the quality of reporting in research reports: a meta-research study

OBJECTIVES

Many authors used reporting checklists as an assessment tool to analyze the reporting quality of diverse types of evidence. We aimed to analyze methodological approaches used by researchers assessing reporting quality of evidence in randomized controlled trials, systematic reviews, and observational studies.

STUDY DESIGN AND SETTING

We analyzed articles reporting quality assessment of evidence with Preferred Reporting Items of Systematic Reviews and Meta-Analyses (PRISMA), CONsolidated Standards of Reporting Trials (CONSORT), or the Strengthening the Reporting of Observational studies in Epidemiology (STROBE) checklists published up to 18 July 2021. We analyzed methods used for assessing reporting quality.

RESULTS

Among 356 analyzed articles, 293 (88%) investigated a specific thematic field. The CONSORT checklist (N = 225; 67%) was most often used, in its original, modified, partial form, or its extension. Numerical scores were given for adherence to checklist items in 252 articles (75%), of which 36 articles (11%) used various reporting quality thresholds. In 158 (47%) articles, predictors of adherence to reporting checklist were analyzed. The most studied factor associated with adherence to reporting checklist was the year of article publication (N = 82; 52%).

CONCLUSION

The methodology used for assessing reporting quality of evidence varied considerably. The research community needs a consensus on a consistent methodology for assessing the quality of reporting.

Defining representativeness of study samples in medical and population health research

Medical and population health science researchers frequently make ambiguous statements about whether they believe their study sample or results are representative of some (implicit or explicit) target population. This article provides a comprehensive definition of representativeness, with the goal of capturing the different ways in which a study can be representative of a target population. It is proposed that a study is representative if the estimate obtained in the study sample is generalisable to the target population (owing to representative sampling, estimation of stratum specific effects, or quantitative methods to generalise or transport estimates) or the interpretation of the results is generalisable to the target population (based on fundamental scientific premises and substantive background knowledge). This definition is explored in the context of four covid-19 studies, ranging from laboratory science to descriptive epidemiology. All statements regarding representativeness should make clear the way in which the study results generalise, the target population the results are being generalised to, and the assumptions that must hold for that generalisation to be scientifically or statistically justifiable.

Has the quality of reporting improved since it became mandatory to use the Standards for Reporting Diagnostic Accuracy?

OBJECTIVES

To investigate whether making the Standards for Reporting Diagnostic Accuracy (STARD) mandatory by the leading journal 'Radiology' in 2016 improved the quality of reporting of diagnostic accuracy studies.

METHODS

A validated search term was used to identify diagnostic accuracy studies published in Radiology in 2015 and 2019. STARD adherence was assessed by two independent reviewers. Each item was scored as yes (1 point) if adequately reported or as no (0 points) if not. The total STARD score per article was calculated. Wilcoxon-Mann-Whitney tests were used to evaluate differences of the total STARD scores between 2015 and 2019. In addition, the total STARD score was compared between studies stratified by study design, citation rate, and data collection.

RESULTS

The median number of reported STARD items for the total of 66 diagnostic accuracy studies from 2015 to 2019 was 18.5 (interquartile range [IQR] 17.5-20.0) of 29. Adherence to the STARD checklist significantly improved the STARD score from a median of 18.0 (IQR 15.5-19.5) in 2015 to a median of 19.5 (IQR 18.5-21.5) in 2019 (p < 0.001). No significant differences were found between studies stratified by mode of data collection (prospective vs. retrospective studies, p = 0.68), study design (cohort vs. case-control studies, p = 0.81), and citation rate (two groups divided by median split [< 0.56 citations/month vs. ≥ 0.56 citations/month], p = 0.54).

CONCLUSIONS

Making use of the STARD checklist mandatory significantly increased the adherence with reporting standards for diagnostic accuracy studies and should be considered by editors and publishers for widespread implementation.

CRITICAL RELEVANCE STATEMENT

Editors may consider making reporting guidelines mandatory to improve the scientific quality.

Estimates of excess mortality during the COVID-19 pandemic strongly depend on subjective methodological choices

Excess mortality is often used to assess the health impact of the COVID-19 pandemic. It involves comparing the number of deaths observed during the pandemic with the number of deaths that would counterfactually have been expected in the absence of the pandemic. However, published data on excess mortality often vary even for the same country. The reason for these discrepancies is that the estimation of excess mortality involves a number of subjective methodological choices. The aim of this paper was to summarize these subjective choices. In several publications, excess mortality was overestimated because population aging was not adjusted for. Another important reason for different estimates of excess mortality is the choice of different pre-pandemic reference periods that are used to estimate the expected number of deaths (e.g., only 2019 or 2015-2019). Other reasons for divergent results include different choices of index periods (e.g., 2020 or 2020-2021), different modeling to determine expected mortality rates (e.g., averaging mortality rates from previous years or using linear trends), the issue of accounting for irregular risk factors such as heat waves and seasonal influenza, and differences in the quality of the data used. We suggest that future studies present the results not only for a single set of analytic choices, but also for sets with different analytic choices, so that the dependence of the results on these choices becomes explicit.

A systematic review of methodological considerations in time to diagnosis and treatment in colorectal cancer research

Research focusing on timely diagnosis and treatment of colorectal cancer is necessary to improve outcomes for people with cancer. Previous attempts to consolidate research on time to diagnosis and treatment have noted varied methodological approaches and quality, limiting the comparability of findings. This systematic review was conducted to comprehensively assess the scope of methodological issues in this field and provide recommendations for future research. Eligible articles had to assess the role of any interval up to treatment, on any outcome in colorectal cancer, in English, with no limits on publication time. Four databases were searched (Ovid Medline, EMBASE, EMCARE and PsycInfo). Papers were screened by two independent reviewers using a two-stage process of title and abstract followed by full text review. In total, 130 papers were included and had data extracted on specific methodological and statistical features. Several methodological problems were identified across the evidence base. Common issues included arbitrary categorisation of intervals (n = 107, 83%), no adjustment for potential confounders (n = 65, 50%), and lack of justification for included covariates where there was adjustment (n = 40 of 65 papers that performed an adjusted analysis, 62%). Many articles introduced epidemiological biases such as immortal time bias (n = 37 of 80 papers that used survival as an outcome, 46%) and confounding by indication (n = 73, 56%), as well as other biases arising from inclusion of factors outside of their temporal sequence. However, determination of the full extent of these problems was hampered by insufficient reporting. Recommendations include avoiding artificial categorisation of intervals, ensuring bias has not been introduced due to out-of-sequence use of key events and increased use of theoretical frameworks to detect and reduce bias. The development of reporting guidelines and domain-specific risk of bias tools may aid in ensuring future research can reliably contribute to recommendations regarding optimal timing and strengthen the evidence base.

An information-oriented paradigm in evaluating accuracy and agreement in radiology

The goal of any radiological diagnostic process is to gain information about the patient's status. However, the mathematical notion of information is usually not adopted to measure the performance of a diagnostic test or the agreement among readers in providing a certain diagnosis. Indeed, commonly used metrics for assessing diagnostic accuracy (e.g., sensitivity and specificity) or inter-reader agreement (Cohen [Formula: see text] statistics) use confusion matrices containing the number of true- and false positives/negatives results of a test, or the number of concordant/discordant categorizations, respectively, thus lacking proper information content. We present a methodological paradigm, based on Shannon's information theory, aiming to measure both accuracy and agreement in diagnostic radiology. This approach models the information flow as a "diagnostic channel" connecting the state of the patient's disease and the radiologist or, in the case of agreement analysis, as an "agreement channel" linking two or more radiologists evaluating the same set of images. For both cases, we proposed some measures, derived from Shannon's mutual information, which can represent an alternative way to express diagnostic accuracy and agreement in radiology.Key points• Diagnostic processes can be modeled with information theory (IT).• IT metrics of diagnostic accuracy are independent from disease prevalence.• IT metrics of inter-reader agreements can overcome Cohen κ pitfalls.

The quality of gender and sex integration in scientific articles resulting from health research funded by the Brazilian Ministry of Health 2004-2016

Aim

Integrating sex and gender into health research is critical to contributing to an ethical and more responsible science to address significant knowledge gaps, resulting in higher-quality evidence for all.

Subject and methods

Using the Essential Metrics for Assessing Sex and Gender Integration in Health Research Proposals Involving Human Participants, we evaluate the quality of the integration of sex and gender in the 350 scientific articles produced by 144 health studies funded by the Department of Science and Technology of the Brazilian Ministry of Health between 2004 and 2016.

Results

The results show that clinical research articles are the type of studies that most frequently report on sex differences, while population and public health research articles most frequently report on gender differences. Analysis of the quality of sex and gender integration reveals low levels of qualification in the items of the literature review and research objectives (section 1) and participant recruitment and retention (section 2). However, the data collection tools, data analysis, and knowledge translation (section 3) items were rated as excellent and good.

Conclusion

Funding agencies and public institutions should recognize the importance of the integration of sex and gender at all stages of the research process, for instance, through awareness and training for researchers and reviewers, clear requirements, and the possibility to use metrics in the evaluations process.

Proactive and Integrated Management and Empowerment in Parkinson's Disease protocol for a randomised controlled trial (PRIME-UK) to evaluate a new model of care

BACKGROUND

People living with Parkinson's disease experience progressive motor and non-motor symptoms, which negatively impact on health-related quality of life and can lead to an increased risk of hospitalisation. It is increasingly recognised that the current care models are not suitable for the needs of people with parkinsonism whose care needs evolve and change as the disease progresses. This trial aims to evaluate whether a complex and innovative model of integrated care will increase an individual's ability to achieve their personal goals, have a positive impact on health and symptom burden and be more cost-effective when compared with usual care.

METHODS

This is a single-centre, randomised controlled trial where people with parkinsonism and their informal caregivers are randomised into one of two groups: either PRIME Parkinson multi-component model of care or usual care. Adults ≥18 years with a diagnosis of parkinsonism, able to provide informed consent or the availability of a close friend or relative to act as a personal consultee if capacity to do so is absent and living in the trial geographical area are eligible. Up to three caregivers per patient can also take part, must be ≥18 years, provide informal, unpaid care and able to give informed consent. The primary outcome measure is goal attainment, as measured using the Bangor Goal Setting Interview. The duration of enrolment is 24 months. The total recruitment target is n=214, and the main analyses will be intention to treat.

DISCUSSION

This trial tests whether a novel model of care improves health and disease-related metrics including goal attainment and decreases hospitalisations whilst being more cost-effective than the current usual care. Subject to successful implementation of this intervention within one centre, the PRIME Parkinson model of care could then be evaluated within a cluster-randomised trial at multiple centres.

Has the STARD statement improved the quality of reporting of diagnostic accuracy studies published in European Radiology?

OBJECTIVES

To investigate whether encouraging authors to follow the Standards for Reporting Diagnostic Accuracy (STARD) guidelines improves the quality of reporting of diagnostic accuracy studies.

METHODS

In mid-2017, European Radiology started encouraging its authors to follow the STARD guidelines. Our MEDLINE search identified 114 diagnostic accuracy studies published in European Radiology in 2015 and 2019. The quality of reporting was evaluated by two independent reviewers using the revised STARD statement. Item 11 was excluded because a meaningful decision about adherence was not possible. Student's t test for independent samples was used to analyze differences in the mean number of reported STARD items between studies published in 2015 and in 2019. In addition, we calculated differences related to the study design, data collection, and citation rate.

RESULTS

The mean total number of reported STARD items for all 114 diagnostic accuracy studies analyzed was 15.9 ± 2.6 (54.8%) of 29 items (range 9.5-22.5). The quality of reporting of diagnostic accuracy studies was significantly better in 2019 (mean ± standard deviation (SD), 16.3 ± 2.7) than in 2015 (mean ± SD, 15.1 ± 2.3; p < 0.02). No significant differences in the reported STARD items were identified in relation to study design (p = 0.13), data collection (p = 0.87), and citation rate (p = 0.09).

CONCLUSION

The quality of reporting of diagnostic accuracy studies according to the STARD statement was moderate with a slight improvement since European Radiology started to recommend its authors to follow the STARD guidelines.

KEY POINTS

• The quality of reporting of diagnostic accuracy studies was moderate with a mean total number of reported STARD items of 15.9 ± 2.6. • The adherence to STARD was significantly better in 2019 than in 2015 (16.3 ± 2.7 vs. 15.1 ± 2.3; p = 0.016). • No significant differences in the reported STARD items were identified in relation to study design (p = 0.13), data collection (p = 0.87), and citation rate (p = 0.09).

Suggestion of more suitable study designs and the corresponding reporting guidelines in articles published in the Journal of Educational Evaluation for Health Professions from 2021 to September 2022: a descriptive study

PURPOSE

This study aimed to suggest a more suitable study design and the corresponding reporting guidelines in the papers published in the Journal of Educational Evaluation for Health Professionals from January 2021 to September 2022.

METHODS

Among 59 papers published in the Journal of Educational Evaluation for Health Professionals from January 2021 to September 2022, research articles, review articles, and brief reports were selected. The followings were analyzed: first, the percentage of articles describing the study design in the title, abstracts, or methods; second, the portion of articles describing reporting guidelines; third, the types of study design and corresponding reporting guidelines; and fourth, the suggestion of a more suitable study design based on the study design algorithm for medical literature on interventions, systematic reviews & other review types, and epidemiological studies overview.

RESULTS

Out of 45 articles, 44 described study designs (97.8%). Out of 44, 19 articles were suggested to be described with more suitable study designs, which mainly occurred in before-and-after studies, diagnostic research, and non-randomized trials. Of the 18 reporting guidelines mentioned, 8 (44.4%) were considered perfect. STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) was used for descriptive studies, before-and-after studies, and randomized controlled trials; however, its use should be reconsidered.

CONCLUSION

Some declarations of study design and reporting guidelines were suggested to be described with more suitable ones. Education and training on study design and reporting guidelines for researchers are needed, and reporting guideline policies for descriptive studies should also be implemented.

Factors to Consider During Identification and Invitation of Individuals in a Multi-stakeholder Research Partnership

BACKGROUND

Health research teams increasingly partner with stakeholders to produce research that is relevant, accessible, and widely used. Previous work has covered stakeholder group identification.

OBJECTIVE

We aimed to develop factors for health research teams to consider during identification and invitation of individual representatives in a multi-stakeholder research partnership, with the aim of forming equitable and informed teams.

DESIGN

Consensus development.

PARTICIPANTS

We involved 16 stakeholders from the international Multi-Stakeholder Engagement (MuSE) Consortium, including patients and the public, providers, payers of health services/purchasers, policy makers, programme managers, peer review editors, and principal investigators.

APPROACH

We engaged stakeholders in factor development and as co-authors of this manuscript. Using a modified Delphi approach, we gathered stakeholder views concerning a preliminary list of 18 factors. Over two feedback rounds, using qualitative and quantitative analysis, we concentrated these into ten factors.

KEY RESULTS

We present seven highly desirable factors: 'expertise or experience', 'ability and willingness to represent the stakeholder group', 'inclusivity (equity, diversity and intersectionality)', 'communication skills', 'commitment and time capacity', 'financial and non-financial relationships and activities, and conflict of interest', 'training support and funding needs'. Additionally, three factors are desirable: 'influence', 'research relevant values', 'previous stakeholder engagement'.

CONCLUSIONS

We present factors for research teams to consider during identification and invitation of individual representatives in a multi-stakeholder research partnership. Policy makers and guideline developers may benefit from considering the factors in stakeholder identification and invitation. Research funders may consider stipulating consideration of the factors in funding applications. We outline how these factors can be implemented and exemplify how their use has the potential to improve the quality and relevancy of health research.