A core outcome set development for a French national prospective study about the effect of mediolateral episiotomy on obstetric anal sphincter injury during operative vaginal delivery (INSTRUMODA)

BACKGROUND

We aimed at developing a core outcome and variables of interest set to investigate the effects of mediolateral episiotomy on Obstetric Anal Sphincter Injury (OASI) during and after operative delivery in nulliparous women in a large-scale one-year observational French study including 15,000 women (INSTRUMODA).

METHODS

A list of outcomes and variables of interest was suggested to obstetricians participating in the INSTRUMODA study using online questionnaires divided into 7 categories: the woman's history and course of pregnancy, course of labor, modalities of operative delivery, episiotomy characteristics, immediate maternal morbidity, one-year maternal morbidity, immediate neonatal morbidity. We used a three-round DELPHI method to reach a consensus. In the first round, outcomes and variables considered as essential by 70% or more of obstetricians were included in the corpus whereas they were excluded when 70% rated them as "not important". In the second round, non-consensual outcomes and variables were reassessed and excluded or definitively included if considered as "not important" or essential by 50% or more of the obstetricians. During the first round, obstetricians were invited to suggest new outcomes and/or variables that were then assessed in the second and third round. We used the same method to develop a core outcome and variables of interest set in a population of women in the community recruited via an association of patients. At the end of the procedure the core outcome and variables of interest sets were merged to provide the final core outcome set for the INSTRUMODA study.

RESULTS

Fifty-three obstetricians and 16 women filled out questionnaires. After the 3 rounds of Delphi procedure in each population, 74 outcomes and variables were consensually reported by obstetricians and 92 by women in the community. By mixing these two consensual corpora we reported a final consensual list of 114 variables of interest and outcomes for both obstetricians and women.

CONCLUSION

We established a core outcome and variables of interest set among obstetricians and women in the community to investigate the association between mediolateral episiotomy and OASI during operative delivery.

TRIAL REGISTRATION

The INSTRUMODA study was registered on https://clinicaltrials.gov on June 25, 2020 ( NCT04446780 ).

National diabetes registries: do they make a difference?

AIMS

The global epidemic of diabetes mellitus continues to expand, including its large impact on national health care. Measuring diabetes outcomes and their causes of variation highlights areas for improvement in care and efficiency gains; large registries carry this potential. By means of a systematic review, we aimed to give an overview of national registries worldwide by quantifying their data and assessing their influence on diabetes care.

METHODS

The literature on MEDLINE up to March 31, 2020, was searched, using keywords diabetes mellitus, national, registry, registration, and/or database. National disease-specific registries from corresponding articles were included. Database characteristics and clinical variables were obtained. All registries were compared to the ICHOM standard set of outcomes.

RESULTS

We identified 12 national clinical diabetes registries, comprising a total of 7,181,356 diabetic patients worldwide. Nearly all registries recorded weight, HbA1c, lipid profile, and insulin treatment; the recording of other variables varied to a great extent. Overall, registries corresponded fairly well with the ICHOM set. Most registries proved to monitor and improve the quality of diabetes care using guidelines as a benchmark. The effects on national healthcare policy were more variable and often less clear.

CONCLUSIONS

National diabetes registries confer clear insights into diagnostics, complications, and treatment. The extent to which registries influenced national healthcare policy was less clear. A globally implemented standard outcome set has the potential to improve concordance between national registries, enhance the comparison and exchange of diabetes outcomes, and allocate resources and interventions where most needed.

A Patient-Centric Tool to Facilitate Goal Attainment Scaling in Neurogenic Bladder and Bowel Dysfunction: Path to Individualization

OBJECTIVES

People with neurogenic bladder and/or bowel dysfunction experience diverse challenges that can be difficult to evaluate with standardized outcome measures. Goal attainment scaling (GAS) is an individualized, patient-centric outcome measure that enables patients/caregivers to identify and track their own treatment goals. Because creating goals de novo can be cumbersome, we aimed to develop a neurogenic bladder/bowel dysfunction goal menu to facilitate goal attainment scaling uptake and use.

METHODS

We conducted a workshop with 6 expert clinicians to develop an initial menu. Individual interviews with 12 people living with neurogenic bladder and/or bowel dysfunction and 2 clinician panels with 5 additional experts aided us in refining the menu. A thematic framework analysis identified emergent themes for analysis and reporting.

RESULTS

Interview participants were adults (median = 36 years, range 25-58), most with spinal cord injury (75%; 9/12). Of 24 goals identified initially, 2 (8%) were not endorsed and were removed, and 3 goals were added. Most participants listed "Impact on Life" goals (eg, Exercise, Emotional Well-Being) among their 5 most important goals (58%; 35/60). Three main themes emerged: challenges posed by incontinence, limitations on everyday life, and need for personalized care.

CONCLUSIONS

We developed a clinical outcome assessment tool following a multistep process of representative stakeholder engagement. This patient-centric tool consists of 25 goals specific to people living with neurogenic bladder and/or bowel dysfunction. Asking people what matters most to them can identify important constructs that clinicians might have overlooked.

Effect of Tactile Experience During Preterm Infant Feeding on Clinical Outcomes

BACKGROUND

Although the survival rate of very preterm infants has improved, rates of subsequent neurobehavioral disabilities remain high. One factor implicated in poor neurobehavioral and developmental outcomes is hospitalization and inconsistent caregiving patterns in the neonatal intensive care unit. Although much underlying brain damage occurs in utero or shortly after birth, neuroprotective strategies may stop progression of damage, particularly when these strategies are used during the most sensitive periods of neural plasticity 2-3 months before term age.

OBJECTIVE

The purpose of this analysis was to test the effect of a patterned feeding experience involving a tactile component (touch and/or holding) provided during feedings on preterm infants' clinical outcomes, measured by oral feeding progress, as an early indicator of neurodevelopment.

METHODS

We used an experimental, longitudinal, two-group random assignment design. Preterm infants (n = 120) were enrolled within the first week of life and randomized to an experimental group receiving a patterned feeding experience or to a control group receiving usual feeding care.

RESULTS

Analysis of data from 91 infants showed that infants receiving touch at more than 25% of early gavage feedings achieved full oral feeding more quickly; as touch exposure increased, time from first oral to full oral feeding decreased. There was no association between holding during early gavage feedings or touch during transition feedings and time to full oral feeding.

DISCUSSION

Neurological expectation during critical periods of development is important for infants. However, a preterm infant's environment is not predictable: Caregivers change regularly, medical procedures dictate touch and holding, and care provision based on infant cues is limited. Current knowledge supports caregiving that occurs with a naturally occurring sensation (i.e., hunger), is provided in a manner that is congruent with the expectation of the neurological system, and occurs with enough regularity to enhance neuronal and synaptic development. In this study, we modeled an experience infants would "expect" if they were not in the neonatal intensive care unit and demonstrated a shorter time from first oral feeding to full oral feeding, an important clinical outcome with neurodevelopmental implications. We recommend further research to determine the effect of patterned caregiving experiences on other areas of neurodevelopment, particularly those that may occur later in life.

Association of Mandatory Bundled Payments for Joint Replacement With Postacute Care Outcomes Among Medicare and Medicaid Dual Eligible Patients

IMPORTANCE

The Medicare comprehensive care for joint replacement (CJR) model, a mandatory bundled payment program started in April 2016 for hospitals in randomly selected metropolitan statistical areas (MSAs), may help reduce postacute care (PAC) use and episode costs, but its impact on disparities between Medicaid and non-Medicaid beneficiaries is unknown.

OBJECTIVE

To determine effects of the CJR program on differences (or disparities) in PAC use and outcomes by Medicare-Medicaid dual eligibility status.

DESIGN, SETTING, AND PARTICIPANTS

Observational cohort study of 2013-2017, based on difference-in-differences (DID) analyses on Medicare data for 1,239,452 Medicare-only patients, 57,452 dual eligibles with full Medicaid benefits, and 50,189 dual eligibles with partial Medicaid benefits who underwent hip or knee surgery in hospitals of 75 CJR MSAs and 121 control MSAs.

MAIN OUTCOME MEASURES

Risk-adjusted differences in rates of institutional PAC [skilled nursing facility (SNF), inpatient rehabilitation, or long-term hospital care] use and readmissions; and for the subgroup of patients discharged to SNF, risk-adjusted differences in SNF length of stay, payments, and quality measured by star ratings, rate of successful discharge to community, and rate of transition to long-stay nursing home resident.

RESULTS

The CJR program was associated with reduced institutional PAC use and readmissions for patients in all 3 groups. For example, it was associated with reductions in 90-day readmission rate by 1.8 percentage point [DID estimate=-1.8; 95% confidence interval (CI), -2.6 to -0.9; P<0.001] for Medicare-only patients, by 1.6 percentage points (DID estimate=-1.6; 95% CI, -3.1 to -0.1; P=0.04) for full-benefit dual eligibles, and by 2.0 percentage points (DID estimate=-2.0; 95% CI, -3.6 to -0.4; P=0.01) for partial-benefit dual eligibles. These CJR-associated effects did not differ between dual eligibles (differences in above DID estimates=0.2; 95% CI, -1.4 to 1.7; P=0.81 for full-benefit patients; and -0.3; 95% CI, -1.9 to 1.3; P=0.74 for partial-benefit patients) and Medicare-only patients. Among patients discharged to SNF, the CJR program showed no effect on successful community discharge, transition to long-term care, or their persistent disparities.

CONCLUSIONS

The CJR program did not help reduce persistent disparities in readmissions or SNF-specific outcomes related to Medicare-Medicaid dual eligibility, likely due to its lack of financial incentives for reduced disparities and improved SNF outcomes.

Systematic review of outcomes and endpoints in preventive migraine clinical trials

BACKGROUND

Over the last six decades (earliest included publication from 1959), clinical trials of migraine preventive treatments have led to the regulatory approval of many medications and devices. Despite similar clinical goals, the outcomes and endpoints used in these trials are broad and not well standardized.

OBJECTIVE

To describe results from a systematic literature review focused on outcomes and endpoints used in preventive migraine clinical trials.

METHOD

A systematic literature review, following a pre-specified (unregistered) protocol developed to adhere to recommendations of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses, was conducted to characterize the endpoints and outcomes used in preventive migraine clinical trials. Predetermined terms were searched in PubMed on October 28, 2019. Data related to trial design, subject characteristics, outcomes, and endpoints reported in each publication were extracted. Descriptive summaries of these features were tabulated for the recent subset of publications, published during or after 1988, that were randomized, blinded, and focused on pharmacological or device therapies for the preventive treatment of migraine.

RESULTS

The initial literature search identified 1506 publications, of which 757 publications were eligible for data extraction. Of specific clinical interest were the recent subset of 268 articles (268/757, 35.4%) fulfilling the targeted criteria. Results showed that the outcomes used to define endpoints varied substantially across publications. For example, in the recent subset of publications, 68.7% (184/268) of the publications examined ≥1 migraine-specific outcome, 39.6% (106/268) examined ≥1 headache-specific outcome, 50.7% (136/268) examined ≥1 acute/rescue medication use outcome, 40.3% (108/268) examined ≥1 headache-related patient-reported outcome measure (PROM), and 22.0% (59/268) examined ≥1 non-headache-specific PROM. Furthermore, the definition of the endpoints used (e.g., change from baseline, fixed timepoint comparisons, categorization of "responders" to treatment based on wide variety of "responder definitions") also differed across publications.

CONCLUSION

Publications from clinical trials of preventive migraine pharmacologic and device treatments differed in terms of study design, endpoint definitions, and how endpoints and outcomes were measured. Although there were common outcomes and endpoints used across publications, no clear "standardized" set of endpoints and outcomes emerged. The inconsistencies in endpoints and outcomes within this literature suggest that the development of a uniform set of outcomes and endpoints could improve the clinical meaningfulness of clinical trial results, facilitate cross-trial comparisons and better inform patient care. This standard set of outcomes and endpoints should be statistically robust and informed by the priorities of various stakeholders, most importantly, the needs and preferences of people living with migraine.

Systematic review of outcomes and endpoints in acute migraine clinical trials

BACKGROUND/OBJECTIVE

To review the acute migraine clinical trial literature and provide a summary of the endpoints and outcomes used in such trials.

METHOD

A systematic literature review, following a prespecified (but unregistered) protocol developed to adhere to recommendations of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses, was conducted to understand endpoints and outcomes used in acute migraine clinical trials. Predefined terms were searched in PubMed to locate clinical trials assessing acute migraine treatments. Final database search was conducted on October 28, 2019. Identified publications were reviewed against established inclusion and exclusion criteria to determine eligibility. Data related to general trial design characteristics, sample characteristics, and outcomes and endpoints reported in each publication were extracted from eligible publications. Descriptive summaries of design features, sample characteristics, and the endpoints and outcomes employed across publications were constructed. Outcomes are presented within four broad categories: (a) pain-related outcomes (pain relief, pain freedom, etc.), (b) associated symptoms (nausea, photophobia, etc.), (c) disability/impairment/impact, (d) patient-reported outcome measures (PROMs, general health and migraine/headache-specific). Endpoint types were categorized within three broad categories: (a) change from baseline, (b) fixed timepoint, and (c) responder definitions (e.g., 50% reduction). This review focuses on a subset of recent (1998 or later) randomized and blinded publications evaluating drugs or medical devices.

RESULTS

Of 1567 publications found through the initial search and reference section reviews, 705 met criteria and were included for data extraction. Inter-rater agreement kappas for the descriptive variables extracted had an average kappa estimate of 0.86. The more recent, randomized and blinded pharmaceutical and medical device article subset includes 451 publications (451/705, 63.9%). The outcomes and endpoints varied substantially across trials, ranging from pain relief or freedom, freedom from or relief of migraine-associated symptoms, use of acute or rescue medication, and various other PROMs, including measures of satisfaction and quality of life. Within the recent randomized and blinded article subset, most articles examined ≥1 pain-related outcome (430/451, 95.3%). Of the publications that examined pain, outcomes most often used were pain relief (310/430, 72.1%), pain freedom (279/430, 64.9%), and headache recurrence (202/43,051, 47.0%) or rescue medication use (278/430, 64.9%). Associated symptoms such as nausea, photophobia, and phonophobia were more frequently measured (299/451, 66.3%) compared to most bothersome associated symptom (16/451, 3.5%), as it is a new addition to regulatory guidance. Over one-third of eligible publications examined disability/impairment (186/451, 41.2%) or ≥1 PROM (159/451, 35.3%). The definition of the endpoints used (e.g., change from baseline, fixed timepoint comparisons, categorization of "responders" to treatment based on wide variety of "responder definitions") also differed substantially across publications.

CONCLUSION

Acute migraine clinical trials exhibit a large amount of variability in outcomes and endpoints used, in addition to the variability in how outcomes and endpoints were used from trial-to-trial. There were some common elements across trials that align with guidance from the International Headache Society, the Food and Drug Administration and other regulatory agencies (e.g., assessing pain and associated symptoms, 2-hour post-treatment). Other aspects of acute migraine clinical trial design did not follow guidance. For example, multi-item PROMs intended to measure constructs (e.g., scales) are rarely used, the use of pain-related outcomes is inconsistent, some associated symptom assessments are idiosyncratic, and the timing of the assessment of primary endpoints is variable. The development of a core set of outcomes and endpoints for acute migraine clinical trials that are patient-centered and statistically robust could improve the conduct of individual trials, facilitate cross-trial comparisons, and better support informed treatment decisions by healthcare professionals and patients.

The Structure of Research Questions in Randomized Controlled Trials in the Rehabilitation Field: A Methodological Study

OBJECTIVE

The aim of this study is to assess whether and how the PICO (Population, Intervention, Comparator, and Outcomes) format is described to frame research questions in randomized controlled trials looking at effectiveness of rehabilitation interventions.

DESIGN

A methodological study was conducted. Randomized controlled trials in the rehabilitation field, published between July 1, 2019, and December 31, 2019, were included. The framing of the primary research question from each trial was evaluated.

RESULTS

A total of 97 randomized controlled trials were included in the analysis. The most frequent framing of the primary research question was as an "objective" statement (55%), and in 33% of the articles, this was stated as an "objective" together with a "hypothesis" description. All PICO elements were present in 55% of research questions, but only 49% have used the statement suggested by Cochrane.

CONCLUSION

The findings of this study suggest that a specific item about the "research question" and the rationale that drove the proposed design following the form suggested by Cochrane should be included in the RCT Rehabilitation Checklist.

A systematic review finds Core Outcome Set uptake varies widely across different areas of health

OBJECTIVE

The aim of our review was to bring together studies that had assessed the uptake of core outcome sets (COS) to explore the level of uptake across different COS and areas of health.

STUDY DESIGN AND SETTING

We examined the citations of 337 COS reports to identify studies that had assessed the uptake of a particular COS in randomized controlled trials (RCTs) or systematic reviews (SRs).

RESULTS

We identified 24 studies that had assessed uptake in RCTs and two studies that had assessed uptake in SRs. The studies covered a total of 17/337 (5%) COS. Uptake rates reported for RCTs varied from 0% of RCTs (gout) to 82% RCTs (rheumatoid arthritis) measuring the full COS. Studies that assessed uptake of individual core outcomes showed a wide variation in uptake between the outcomes. Suggested barriers to uptake included lack of validated measures, lack of patient and other key stakeholder involvement in COS development, and lack of awareness of the COS.

CONCLUSIONS

Few studies have been undertaken to assess the uptake of COS in RCTs and SRs. Further studies are needed to assess whether COS have been implemented across a wider range of disease categories and to explore the barriers and facilitators to COS uptake.

Criteria to Evaluate the Quality of Outcome Reporting in Randomized Controlled Trials of Rehabilitation Interventions

ABSTRACT

No standardized guideline for the reporting of outcomes measures in randomized controlled trials of rehabilitation interventions is currently available. This study includes four phases to identify, synthesize, and make recommendations for potential attributes of reporting criteria of outcome measures in rehabilitation randomized controlled trials. First, we surveyed the author instructions for rehabilitation journals to determine how journals require authors to report outcomes. Second, we reviewed all consolidated standards of reporting trials extensions to determine how other speciality groups require reporting of outcomes in randomized controlled trials. Third, we conducted a focused scoping review to examine the nature and variations of criteria used to evaluate the quality of outcome measures in randomized controlled trials. Finally, we synthesized the information from phases 1-3 and propose four criteria specific to the reporting of outcomes in randomized controlled trials of rehabilitation interventions: (1) clearly describe the construct to be measured as outcome(s); (2) justify the selection of outcome measures by mapping to World Health Organization International Classification of Function, Disability, and Health (International Classification of Functioning) framework; justify the psychometric properties (relevance, validity, reliability) of the selected measurement tool; (3) clearly describe the timing of outcome measurement, with consideration of the health condition, the course of disease, and hypothesized effect of intervention; and (4) complete and unselective reporting of outcome data.

Precision clinical trials: a framework for getting to precision medicine for neurobehavioural disorders

The goal of precision medicine (individually tailored treatments) is not being achieved for neurobehavioural conditions such as psychiatric disorders. Traditional randomized clinical trial methods are insufficient for advancing precision medicine because of the dynamic complexity of these conditions. We present a pragmatic solution: the precision clinical trial framework, encompassing methods for individually tailored treatments. This framework includes the following: (1) treatment-targeted enrichment, which involves measuring patients' response after a brief bout of an intervention, and then randomizing patients to a full course of treatment, using the acute response to predict long-term outcomes; (2) adaptive treatments, which involve adjusting treatment parameters during the trial to individually optimize the treatment; and (3) precise measurement, which involves measuring predictor and outcome variables with high accuracy and reliability using techniques such as ecological momentary assessment. This review summarizes precision clinical trials and provides a research agenda, including new biomarkers such as precision neuroimaging, transcranial magnetic stimulation-electroencephalogram digital phenotyping and advances in statistical and machine-learning models. Validation of these approaches - and then widespread incorporation of the precision clinical trial framework - could help achieve the vision of precision medicine for neurobehavioural conditions.

International Classification of Diseases, Tenth Revision, Clinical Modification social determinants of health codes are poorly used in electronic health records

There have been increasing calls for clinicians to document social determinants of health (SDOH) in electronic health records (EHRs). One potential source of SDOH in the EHRs is in the International Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM) Z codes (Z55-Z65). In February 2018, ICD-10-CM Official Guidelines for Coding and Reporting approved that all clinicians, not just the physicians, involved in the care of a patient can document SDOH using these Z codes.To examine the utilization rate of the ICD-10-CM Z codes using data from a large network of EHRs.We conducted a retrospective analysis of EHR data between 2015 to 2018 in the OneFlorida Clinical Research Consortium, 1 of the 13 Clinical Data Research Networks funded by Patient-Centered Outcomes Research Institute. We calculated the Z code utilization rate at both the encounter and patient levels.We found a low rate of utilization for these Z codes (270.61 per 100,000 at the encounter level and 2.03% at the patient level). We also found that the rate of utilization for these Z codes increased (from 255.62 to 292.79 per 100,000) since the official approval of Z code reporting from all clinicians by the American Hospital Association Coding Clinic and ICD-10-CM Official Guidelines for Coding and Reporting became effective in February 2018.The SDOH Z codes are rarely used by clinicians. Providing clear guidelines and incentives for documenting the Z codes can promote their use in EHRs. Improvements in the EHR systems are probably needed to better document SDOH.

The Italian Version of SCORE-15: Validation and Potential Use

SCORE-15 (Systemic Clinical Outcome and Routine Evaluation) is a 15-item questionnaire for completion by family members aged 12 years and older to assess outcomes in systemic therapy. This study aimed to investigate (a) the psychometric properties and the internal consistency reliability of the Italian version of SCORE-15, (b) clinical responsiveness, and (c) normative (Italian) criteria. Furthermore, (d) the study sought to evaluate the participants' representation of both their family and their problems, analyzing open-ended questions included in the SCORE-15. Data were collected from two clinical centers for 208 families (n = 507). Results confirmed the three-factor structure (i.e., strengths, difficulties, and communication), a good internal consistency reliability, and indicated a cutoff threshold for the Italian version. Furthermore, results showed that SCORE-15 is a good instrument for clinical responsiveness and that it can be used to explore the way in which family members describe their families and problems. Overall, SCORE-15 is a brief, psychometrically robust family assessment instrument that may be used for both researchers and practitioners in several domains of clinical and social psychology.

Standardizing definitions and reporting guidelines for the infertility core outcome set: an international consensus development study

STUDY QUESTION

Can consensus definitions for the core outcome set for infertility be identified in order to recommend a standardized approach to reporting?

SUMMARY ANSWER

Consensus definitions for individual core outcomes, contextual statements, and a standardized reporting table have been developed.

WHAT IS KNOWN ALREADY

Different definitions exist for individual core outcomes for infertility. This variation increases the opportunities for researchers to engage with selective outcome reporting, which undermines secondary research and compromises clinical practice guideline development.

STUDY DESIGN, SIZE, DURATION

Potential definitions were identified by a systematic review of definition development initiatives and clinical practice guidelines and by reviewing Cochrane Gynaecology and Fertility Group guidelines. These definitions were discussed in a face-to-face consensus development meeting, which agreed consensus definitions. A standardized approach to reporting was also developed as part of the process.

PARTICIPANTS/MATERIALS, SETTING, METHODS

Healthcare professionals, researchers, and people with fertility problems were brought together in an open and transparent process using formal consensus development methods.

MAIN RESULTS AND THE ROLE OF CHANCE

Forty-four potential definitions were inventoried across four definition development initiatives, including the Harbin Consensus Conference Workshop Group and International Committee for Monitoring Assisted Reproductive Technologies, 12 clinical practice guidelines, and Cochrane Gynaecology and Fertility Group guidelines. Twenty-seven participants, from 11 countries, contributed to the consensus development meeting. Consensus definitions were successfully developed for all core outcomes. Specific recommendations were made to improve reporting.

LIMITATIONS, REASONS FOR CAUTION

We used consensus development methods, which have inherent limitations. There was limited representation from low- and middle-income countries.

WIDER IMPLICATIONS OF THE FINDINGS

A minimum data set should assist researchers in populating protocols, case report forms, and other data collection tools. The generic reporting table should provide clear guidance to researchers and improve the reporting of their results within journal publications and conference presentations. Research funding bodies, the Standard Protocol Items: Recommendations for Interventional Trials statement, and over 80 specialty journals have committed to implementing this core outcome set.

STUDY FUNDING/COMPETING INTEREST(S)

This research was funded by the Catalyst Fund, Royal Society of New Zealand, Auckland Medical Research Fund, and Maurice and Phyllis Paykel Trust. Siladitya Bhattacharya reports being the Editor-in-Chief of Human Reproduction Open and an editor of the Cochrane Gynaecology and Fertility group. Hans Evers reports being the Editor Emeritus of Human Reproduction. Richard Legro reports consultancy fees from Abbvie, Bayer, Ferring, Fractyl, Insud Pharma and Kindex and research sponsorship from Guerbet and Hass Avocado Board. Ben Mol reports consultancy fees from Guerbet, iGenomix, Merck, Merck KGaA and ObsEva. Craig Niederberger reports being the Editor-in-Chief of Fertility and Sterility and Section Editor of the Journal of Urology, research sponsorship from Ferring, and a financial interest in NexHand. Ernest Ng reports research sponsorship from Merck. Annika Strandell reports consultancy fees from Guerbet. Jack Wilkinson reports being a statistical editor for the Cochrane Gynaecology and Fertility group. Andy Vail reports that he is a Statistical Editor of the Cochrane Gynaecology & Fertility Review Group and of the journal Reproduction. His employing institution has received payment from HFEA for his advice on review of research evidence to inform their 'traffic light' system for infertility treatment 'add-ons'. Lan Vuong reports consultancy and conference fees from Ferring, Merck and Merck Sharp and Dohme. The remaining authors declare no competing interests in relation to the work presented. All authors have completed the disclosure form.

TRIAL REGISTRATION NUMBER

Core Outcome Measures in Effectiveness Trials Initiative: 1023.

Beyond abstinence and relapse: cluster analysis of drug-use patterns during treatment as an outcome measure for clinical trials

RATIONALE

Many people being treated for opioid use disorder continue to use drugs during treatment. This use occurs in patterns that rarely conform to well-defined cycles of abstinence and relapse. Systematic identification and evaluation of these patterns could enhance analysis of clinical trials and provide insight into drug use.

OBJECTIVES

To evaluate such an approach, we analyzed patterns of opioid and cocaine use from three randomized clinical trials of contingency management in methadone-treated participants.

METHODS

Sequences of drug test results were analyzed with unsupervised machine-learning techniques, including hierarchical clustering of categorical results (i.e., whether any samples were positive during each week) and K-means longitudinal clustering of quantitative results (i.e., the proportion positive each week). The sensitivity of cluster membership as an experimental outcome was assessed based on the effects of contingency management. External validation of clusters was based on drug craving and other symptoms of substance use disorder.

RESULTS

In each clinical trial, we identified four clusters of use patterns, which can be described as opioid use, cocaine use, dual use (opioid and cocaine), and partial/complete abstinence. Different clustering techniques produced substantially similar classifications of individual participants, with strong above-chance agreement. Contingency management increased membership in clusters with lower levels of drug use and fewer symptoms of substance use disorder.

CONCLUSIONS

Cluster analysis provides person-level output that is more interpretable and actionable than traditional outcome measures, providing a concrete answer to the question of what clinicians can tell patients about the success rates of new treatments.

Person Ability Scores as an Alternative to Norm-Referenced Scores as Outcome Measures in Studies of Neurodevelopmental Disorders

Although norm-referenced scores are essential to the identification of disability, they possess several features which affect their sensitivity to change. Norm-referenced scores often decrease over time among people with neurodevelopmental disorders who exhibit slower-than-average increases in ability. Further, the reliability of norm-referenced scores is lower at the tails of the distribution, resulting in floor effects and increased measurement error for people with neurodevelopmental disorders. In contrast, the person ability scores generated during the process of constructing a standardized test with item response theory are designed to assess change. We illustrate these limitations of norm-referenced scores, and relative advantages of ability scores, using data from studies of autism spectrum disorder and creatine transporter deficiency.

Outcome Measures for Core Symptoms of Intellectual Disability: State of the Field

Intellectual disability (ID) is defined by impairments in intellectual and adaptive functioning. As such, tools designed to assess these domains would theoretically be ideal outcome measures for treatment trials targeting core symptoms of ID. However, measures of intellectual and adaptive functioning have rarely been used as primary outcome measures to date and further study is needed regarding their usefulness to measure change. This area of inquiry is important because promising, mechanism-modifying treatments for conditions leading to ID are being initiated. To show efficacy, these treatments need to demonstrate an impact on core features of ID. After reviewing literature on this topic, we suggest solutions to several problems outlined, including use of out-of-age-range testing, alternative metrics, and development of new measures.

Construct Validity of Outcome Rating Scale (ORS) Scores in Clinical Samples: Extension of Harris, Murphy, and Rakes' (2019) Narrative Review

PURPOSE

A recent review of 24 studies primarily evaluated psychometric properties of the Outcome Rating Scale (ORS) related to coefficient alpha and convergent validity.

METHOD

To provide a fuller picture, this review examined effect size (ES) estimates and the full range of correlations between ORS scores and related measures.

RESULTS

Mean ORS ESs equaled 1.00 for 44 comparison periods. ORS scores correlated highest with measures of depression and evidenced larger ESs in depression treatments.

DISCUSSION

The ORS functions as a robust measure for detecting client progress in clinical samples that were primarily young, female, and Caucasian. Some results suggest ORS scores primarily reflect a rapid response to interventions.

CONCLUSION AND LIMITATIONS

Future research should assess ORS scores' psychometric properties in response to interventions with more heterogeneous client samples as well as its capacity to monitor change beyond initial sessions.

A Psychometric Evaluation of the Motor-Behavioral Assessment Scale for Use as an Outcome Measure in Rett Syndrome Clinical Trials

Rett syndrome (RTT) is a neurodevelopmental disorder that primarily affects females. Recent work indicates the potential for disease modifying therapies. However, there remains a need to develop outcome measures for use in clinical trials. Using data from a natural history study (n = 1,075), we examined the factor structure, internal consistency, and validity of the clinician-reported Motor Behavior Assessment scale (MBA). The analysis resulted in a five-factor model: (1) motor dysfunction, (2) functional skills, (3) social skills, (4) aberrant behavior, and (5) respiratory behaviors. Item Response Theory (IRT) analyses demonstrated that all items had acceptable discrimination. The revised MBA subscales showed a positive relationship with parent reported items, age, and a commonly used measure of clinical severity in RTT, and mutation type. Further work is needed to evaluate this measure longitudinally and to add items related to the RTT phenotype.

Cardiac involvement at presentation in patients hospitalized with COVID-19 and their outcome in a tertiary referral hospital in Northern Italy

The correlation between myocardial injury and clinical outcome in COVID-19 patients is gaining attention in the literature. The aim of the present study was to evaluate the role of cardiac involvement and of respiratory failure in a cohort of COVID-19 patients hospitalized in an academic hospital in Lombardy, one of the most affected Italian (and worldwide) regions by the epidemic. The study included 405 consecutive patients with confirmed COVID-19 admitted to a medical ward from February 25th to March 31st, 2020. Follow-up of surviving patients ended either at hospital discharge or by July 30th, 2020. Myocardial injury was defined on the basis of the presence of blood levels of hs-TnI above the 99th percentile upper reference limit. Respiratory function was assessed as PaO₂/FiO₂ (P/F) ratio. The primary end-point was death for any cause. During hospitalization, 124 patients died. Death rate increased from 7.9% in patients with normal hs-TnI plasma levels and no cardiac comorbidity to 61.5% in patients with elevated hs-TnI and cardiac involvement (p < 0.001). At multivariable analysis, older age, P/F ratio < 200 (both p < 0.001) and hs-TnI plasma levels were independent predictors of death. However, it must be emphasized that the median values of hs-TnI were within normal range in non-survivors. Cardiac involvement at presentation was associated with poor prognosis in COVID-19 patients, but, even in a population of COVID-19 patients who did not require invasive ventilation at hospital admission, mortality was mainly driven by older age and respiratory failure.

Measuring Change in the Communication Skills of Children With Austim Spectrum Disorder Using the Communication Complexity Scale

Changes in minimal verbal communication by children with autism spectrum disorder (ASD) were measured with the Communication Complexity Scale (CCS) and other communication assessments. The CCS measures complexity of preverbal and beginning verbal communication used to communicate behavior regulation and joint attention. The purpose was to investigate if the CCS was responsive to changes associated with a behavioral intervention aimed at improving communication skills. Changes were detected with CCS scores, rates of initiating joint attention, and the Mullen Scales of Early Learning (MSEL) Expressive Language subscale. Significant changes in CCS scores were also detected for a subgroup of participants who did not show significant changes on the MSEL Expressive Language subscale, demonstrating that CCS scores are sensitive to changes associated with a behavioral intervention.

Placebo use and outcome quality: A protocol for systematic review and meta-analysis

BACKGROUND

The Pharmaceutical industry sponsorship, research outcome and quality has been already evaluated for clinical trials in order to analyze if this kind of sponsorship affects the results of clinical trials. In this sense, this study has the aim to investigate whether placebo use allows positive outcomes regarding efficacy and safety compared to synthetic medicines.

METHODS

We designed and registered a study protocol for a systematic review for methodology data. We will only randomized clinical trials that use placebo as comparator. The main outcome will be the evaluation of placebo use regarding the tendency for positive results (efficacy and security) when comparing to synthetic medicines. PubMed, Cochrane, LILACS (BVS), Web of Science, Scopus, and Excerpta Medica dataBASE (EMBASE) databases will be searched. Gray literature will be identified through the databases Proquest (Dissertation and Theses), OpenGrey and Google Scholar. Two review authors will independently assess trial quality and will extract data in accordance with standard Cochrane methodology. If necessary, we will also contact authors for additional information. The Cochrane Collaboration's risk of bias tool will be used. If feasible, it means homogenous data, we will conduct random effects meta-analysis. Subgroup analyses will be conducted for different justifications for placebo use and for studies sponsored/not sponsored by the pharmaceutical industry.

RESULTS

Our present findings will indicate the effects of placebo use as comparator regarding efficacy and safety of the oral synthetic medicines.

DISCUSSION

This systematic review will identify, summarize, and analyze if there is a trend for positive efficacy and safety results for synthetic medicines in clinical trials when compared with placebo and if the justification for placebo use is considered ethically acceptable.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42018110829.

The initial validation of a novel outcome measure in severe burns- the Persistent Organ Dysfunction +Death: Results from a multicenter evaluation

INTRODUCTION

A need exists to improve the efficiency of clinical trials in burn care. The objective of this study was to validate "Persistent Organ Dysfunction" plus death as endpoint in burn patients and to demonstrate its statistical efficiency.

METHODS

This secondary outcome analysis of a dataset from a prospective international multicenter RCT (RE-ENERGIZE) included patients with burned total body surface area >20% and a 6-month follow-up. Persistent organ dysfunction was defined as persistence of organ dysfunction with life-supportiing technologies and ICU care.

RESULTS

In the 539 included patients, the prevalence of 0p p+ pdeath was 40% at day 14 and of 27% at day 28. At both timepoints, survivors with POD (vs. survivors without POD) had a higher mortality rate, longer ICU- and hospital-stays, and a reduced quality of life. POD + death as an endpoint could result in reduced sample size requirements for clinical trials. Detecting a 25% relative risk reduction in 28-day mortality would require a sample size of 4492 patients, whereas 1236 patients would be required were 28-day POD + death used.

CONCLUSIONS

POD + death represents a promising composite outcome measure that may reduce the sample size requirements of clinical trials in severe burns patients. Further validation in larger clinical trials is warranted.

STUDY TYPE

Prospective cohort study, level of evidence: II.

Assessment of Outcomes Among Patients With Venous Thromboembolism With and Without Chronic Kidney Disease

IMPORTANCE

Patients with venous thromboembolism (VTE) and concomitant chronic kidney disease (CKD) have been reported to have a higher risk of thrombosis and major bleeding complications compared with patients without concomitant CKD. The use of anticoagulation therapy is challenging, as many anticoagulant medications are excreted by the kidney. Large-scale data are needed to clarify the impact of CKD for anticoagulant treatment strategies and clinical outcomes of patients with VTE.

OBJECTIVE

To compare clinical characteristics, treatment patterns, and 12-month outcomes among patients with VTE and concomitant moderate to severe CKD (stages 3-5) vs patients with VTE and mild to no CKD (stages 1-2) in a contemporary international registry.

DESIGN, SETTING, AND PARTICIPANTS

The Global Anticoagulant Registry in the Field-Venous Thromboembolism (GARFIELD-VTE) study is a prospective noninterventional investigation of real-world treatment practices. A total of 10 684 patients from 415 sites in 28 countries were enrolled in the GARFIELD-VTE between May 2014 and January 2017. This cohort study included 8979 patients (6924 patients with mild to no CKD and 2055 patients with moderate to severe CKD) who had objectively confirmed VTE within 30 days before entry in the registry. Chronic kidney disease stages were defined by estimated glomerular filtration rates. Data were extracted from the study database on December 8, 2018, and analyzed between May 1, 2019, and July 30, 2020.

EXPOSURE

Moderate to severe CKD vs mild to no CKD.

MAIN OUTCOMES AND MEASURES

The primary outcomes were all-cause mortality, recurrent VTE, and major bleeding. Event rates and 95% CIs were calculated and expressed per 100 person-years. Hazard ratios (HRs) were estimated with Cox proportional hazards regression models and adjusted for relevant confounding variables. All-cause mortality was considered a competing risk for other clinical outcomes in the estimation of cumulative incidences.

RESULTS

Of the 10 684 patients with objectively confirmed VTE, serum creatinine data were available for 8979 patients (84.0%). Of those, 4432 patients (49.4%) were female and 5912 patients (65.8%) were White; 6924 patients (77.1%; median age, 57 years; interquartile range [IQR], 44-69 years) were classified as having mild to no CKD, and 2055 patients (22.9%; median age, 70 years; IQR, 59-78 years) were classified as having moderate to severe CKD. Calculations using the equation from the Modification of Diet in Renal Disease study indicated that, among the 6924 patients with mild to no CKD, 2991 patients had stage 1 CKD, and 3933 patients had stage 2 CKD; among the 2055 patients with moderate to severe CKD, 1650 patients had stage 3 CKD, 190 patients had stage 4 CKD, and 215 patients had stage 5 CKD. The distribution of VTE presentation was comparable between groups. In total, 1171 patients (57.0%) with moderate to severe CKD and 4079 patients (58.9%) with mild to no CKD presented with deep vein thrombosis alone, 547 patients (26.6%) with moderate to severe CKD and 1723 patients (24.9%) with mild to no CKD presented with pulmonary embolism alone, and 337 patients (16.4%) with moderate to severe CKD and 1122 patients (16.2%) with mild to no CKD presented with both pulmonary embolism and deep vein thrombosis. Compared with patients with mild to no CKD, patients with moderate to severe CKD were more likely to be female (3259 women [47.1%] vs 1173 women [57.1%]) and older than 65 years (2313 patients [33.4%] vs 1278 patients [62.2%]). At baseline, the receipt of parenteral therapy alone was comparable between the 2 groups (355 patients [17.3%] with moderate to severe CKD vs 1253 patients [18.1%] with mild to no CKD). Patients with moderate to severe CKD compared with those with mild to no CKD were less likely to be receiving direct oral anticoagulant therapy, either alone (557 patients [27.1%] vs 2139 patients [30.9%]) or in combination with parenteral therapy (319 patients [15.5%] vs 1239 patients [17.9%]). Patients with moderate to severe CKD had a higher risk of all-cause mortality (adjusted hazard ratio [aHR], 1.44; 95% CI, 1.21-1.73), major bleeding (aHR, 1.40; 95% CI, 1.03-1.90), and recurrent VTE (aHR, 1.40; 95% CI, 1.10-1.77) than patients with mild to no CKD.

CONCLUSIONS AND RELEVANCE

In this study of patients with VTE, the presence of moderate to severe CKD was associated with increases in the risk of death, VTE recurrence, and major bleeding compared with the presence of mild to no CKD.

Association of Hospital-Level Differences in Care With Outcomes Among Patients With Acute ST-Segment Elevation Myocardial Infarction in China

IMPORTANCE

The incidence of acute myocardial infarction has increased over the past decades in China, and management challenges include an unbalanced economy, disparate resources, and variable access to medical care across the nation.

OBJECTIVE

To examine the variations in care and outcomes of patients with ST-segment elevation myocardial infarction among 3 levels of hospitals in the typical Chinese public hospital model.

DESIGN, SETTING, AND PARTICIPANTS

This cross-sectional study used data from the China Acute Myocardial Infarction Registry to compare the differences in care and outcomes among patients at 108 hospitals from 31 provinces and municipalities throughout mainland China. Participants included patients with ST-segment elevation myocardial infarction directly admitted to hospitals between January 2013 and September 2014. Data analyses were performed from June 2015 to June 2019.

EXPOSURES

Care in province-level, prefecture-level, or county-level hospitals in China.

MAIN OUTCOMES AND MEASURES

The primary outcome was in-hospital mortality. Secondary outcomes included presentation, treatments, and major complications.

RESULTS

A total of 12 695 patients (9593 men [75.6%]; median [interquartile range] age, 63 [54-72] years) were included; 3985 were at province-level hospitals, 6731 were at prefecture-level hospitals, and 1979 were at county-level hospitals. Compared with patients admitted to province-level hospitals, those admitted to prefecture-level and county-level hospitals were older (median [interquartile range] age, 61 [52-70] years vs 63 [54-72] years and 65 [57-75] years) and more likely to be women (815 women [20.5%] vs 1620 women [24.1%] and 667 women [33.7%]). Patients in prefecture-level and county-level hospitals were less likely to use ambulances compared with patients at province-level hospitals (11.6% [95% CI, 10.8%-12.4%] and 12.0% [95% CI, 10.6%-13.5%] vs 19.4% [95% CI, 18.1%-20.7%]; P < .001) and were less likely to experience early presentation, with onset-to-arrival times less than 12 hours for 75.3% (95% CI, 73.9%-76.6%) of patients at province-level hospitals, 70.8% (95% CI, 69.7%-71.9%) of patients at prefecture-level hospitals, and 69.8% (95% CI, 67.7%-71.8%) of patients at county-level hospitals (P < .001). The rates of reperfusion therapy were significantly lower in low-level hospitals (54.3% [95% CI, 53.1%-55.5%] for prefecture-level hospitals and 45.8% [95% CI, 43.6%-48.1%] for county-level hospitals) compared with province-level hospitals (69.4% [95% CI, 67.9%-70.8%]; P < .001). There was a progressively higher rate of in-hospital mortality at the 3 levels of hospitals: 3.1% (95% CI, 2.6%-3.7%) for province-level hospitals, 5.3% (95% CI, 4.8%-5.9%) for prefecture-level hospitals, and 10.2% (95% CI, 8.9%-11.7%) for county-level hospitals (P for trend < .001). After adjustment for patient characteristics, presentation, hospital facility, and treatments, the odds of death remained higher in prefecture-level (odds ratio, 1.39 [95% CI, 1.06-1.84]) and county-level (odds ratio, 1.43 [95% CI, 0.97-2.11]) hospitals compared with province-level hospitals (P for trend = .04).

CONCLUSIONS AND RELEVANCE

These findings suggest that there are significant variations in care and outcomes of patients among the 3 levels of hospitals in China. More efforts should be made to address the identified gaps, particularly in the prefecture-level and county-level hospitals. This work can inform national quality improvements efforts in China and in other developing countries.