Reporting and Analyzing Demographics in the Journal of Arthroplasty: Are We Making Progress?

Randomized controlled trials in the shoulder arthroplasty literature rarely include key demographic and socioeconomic patient data

BACKGROUND

It is well known that socioeconomic and demographic variables can greatly affect health outcomes. Previous studies across medical and surgical subspecialties have demonstrated that these variables are frequently under-reported in randomized controlled trials (RCTs). No such study currently exists that examines rates of reporting of sociodemographic variables in shoulder arthroplasty RCTs. This study aims to present these rates and explore the impact of failing to report socioeconomic variables in shoulder arthroplasty RCTs.

METHODS

The PubMed database was queried for the term shoulder arthroplasty. Sixty-five RCTs from the past 10 years were identified for inclusion from 5 high-impact orthopedic surgery journals. Each RCT was analyzed for patient age and sex or gender as well as the following sociodemographic variables: race, ethnicity, insurance status, income, work status, and education. It was also noted whether each of the above variable was mentioned in the results section of the article. Data were presented in a descriptive fashion as well as analyzed using χ2 and Fisher exact tests where appropriate.

RESULTS

From 2014 to 2023, the 65 shoulder arthroplasty RCTs published reported age in 40 of 65 (61.5%) in their results sections and 61 of 65 (93.8%) in any section. Sex or gender was reported in 27 of 65 (41.5%) in their results sections and 61 of 65 (93.8%) in any section. No articles included any sociodemographic variables in the results section. Reporting rates for sociodemographic variables in any section were as follows: race, 6 of 65 (9.2%); ethnicity, 5 of 65 (7.7%); work status, 4 of 65 (6.2%); and insurance status, 1 of 65 (1.5%). No studies included income or education of the enrolled patients. There was no difference in reporting sociodemographic variables by journal (P = .45) or by year of publication (P = .57). However, no study prior to 2020 included any sociodemographic variable (0 of 27, 0%), whereas from 2020 onward 6 studies included at least 1 (6 of 38, 15.8%). Sociodemographic variables were reported significantly less frequently than age and sex or gender (P = .001).

DISCUSSION

Our study found sociodemographic variables are rarely reported in shoulder arthroplasty RCTs, whereas age and sex or gender are reported with great frequency. In order to understand the results of shoulder arthroplasty RCTs, apply their findings to the care of our patients, and address health disparities, we must ensure these studies include patient sociodemographic data.

Orthopaedic Sports Medicine Randomized Controlled Trials Infrequently Report on the Social Determinants of Health Factors of Their Patient Cohorts

PURPOSE

To describe the prevalence of randomized controlled trials (RCTs) in orthopaedic sports medicine-related journals reporting on the social determinants of health (SDOH) of their patient cohorts, including factors receiving less attention, such as education level, employment status, insurance status, and socioeconomic status.

METHODS

The PubMed/MEDLINE database was used to search for RCTs between 2020 and 2022 from 3 high-impact orthopaedic sports medicine-related journals: American Journal of Sports Medicine, Arthroscopy, and Journal of Shoulder and Elbow Surgery. The following information was extracted from each article: age, sex/gender, body mass index, year published, corresponding author country, and self-reported SDOH factors (race, ethnicity, education level, employment status, insurance status, and socioeconomic status).

RESULTS

A total of 189 articles were analyzed. Articles originated from 34 different countries, with the United States (n = 66) producing the greatest number of articles. Overall, age (n = 186; 98.4%) and sex/gender (n = 184; 97.4%) were the factors most commonly reported, followed by body mass index (n = 112; 59.3%), race (n = 17; 9.0%), ethnicity (n = 10; 5.3%), employment status (n = 9; 4.8%), insurance status (n = 7; 3.7%), and education level (n = 5; 2.6%). Socioeconomic status was not reported in any of the articles analyzed. Articles from the United States report on SDOH factors more frequently than international articles, most notably race (24.2% vs 0.8%, respectively) and ethnicity (15.2% and 0%, respectively).

CONCLUSIONS

RCTs from 3 high-impact orthopaedic sports medicine journals infrequently report on SDOH.

CLINICAL RELEVANCE

Better understanding patient SDOH factors in RCTs is important to help orthopaedic surgeons and other practitioners best apply study results to their patients, as well as help researchers and our field ensure that research is being done transparently with relevance to as many patients as possible.

Socioeconomic Status and Race Are Rarely Reported in Randomized Controlled Trials for Achilles Tendon Pathology in the Top 10 Orthopaedic Journals: A Systematic Review

Background

Randomized controlled trials (RCTs) are crucial in comparative research, and a careful approach to randomization methodology helps minimize bias. However, confounding variables like socioeconomic status (SES) and race are often underreported in orthopaedic RCTs, potentially affecting the generalizability of results. This study aimed to analyze the reporting trends of SES and race in RCTs pertaining to Achilles tendon pathology, considering 4 decades of data from top-tier orthopaedic journals.

Methods

This review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines and used PubMed to search 10 high-impact factor orthopaedic journals for RCTs related to the management of Achilles tendon pathology. The search encompassed all articles from the inception of each journal until July 11, 2023. Data extraction included year of publication, study type, reporting of SES and race, primary study location, and intervention details.

Results

Of the 88 RCTs identified, 68 met the inclusion criteria. Based on decade of publication, 6 articles (8.8%) reported on SES, whereas only 2 articles (2.9%) reported on race. No RCTs reported SES in the pre-1999 period, but the frequency of reporting increased in subsequent decades. Meanwhile, all RCTs reporting race were published in the current decade (2020-2030), with a frequency of 20%. When considering the study location, RCTs conducted outside the United States were more likely to report SES compared with those within the USA.

Conclusion

This review revealed a concerning underreporting of SES and race in Achilles tendon pathology RCTs. The reporting percentage remains low for both SES and race, indicating a need for comprehensive reporting practices in orthopaedic research. Understanding the impact of SES and race on treatment outcomes is critical for informed clinical decision making and ensuring equitable patient care. Future studies should prioritize the inclusion of these variables to enhance the generalizability and validity of RCT results.

Improving Randomized-Controlled Trials in Foot and Ankle Orthopaedics: The Need to Include Sociodemographic Patient Data

BACKGROUND

The representation of sociodemographic data within randomized-controlled trials (RCT) regarding foot and ankle surgery is undefined. The purpose of this study was to determine the incidence of sociodemographic data being reported in contemporary foot and ankle RCTs.

METHODS

Randomized-controlled trials within the PubMed database from 2016 to 2021 were searched and the full text of 40 articles was reviewed to identify sociodemographic variables reported in the manuscript. Data regarding race, ethnicity, insurance status, income, work status, and education were collected.

RESULTS

Race was reported in the results in 4 studies (10.0%), ethnicity in 1 (2.5%), insurance status in 0 (0%), income in 1 (2.5%), work status in 3 (7.5%) and education in 2 (5.0%). In any section other than the results, race was reported in 6 studies (15.0%), ethnicity in 1 (2.5%), insurance status in 3 (7.5%), income in 6 (15.0%), work status in 6 (15.0%), and education in 3 (7.5%). There was no difference in sociodemographic data by journal (P = .212), year of publication (P = .216), or outcome study (P = .604).

CONCLUSION

The overall rate of sociodemographic data reported in foot and ankle RCTs is low. There was no difference in the reporting of sociodemographic data between journal, year of publication, or outcome study.

LEVEL OF EVIDENCE

Level II.

Reporting demographics in randomized control trials in spine surgery - we must do better

BACKGROUND CONTEXT

Demographic factors contribute significantly to spine surgery outcomes. Although race and ethnicity are not proxies for disease states, the intersection between these patient characteristics and socioeconomic status significantly impact patient outcomes.

PURPOSE

The purpose of this study is to investigate the frequency of demographic reporting and analysis in randomized controlled clinical trials (RCTs) published in the three highest impact spine journals.

STUDY DESIGN

Systematic review.

PATIENT SAMPLE

We analyzed 278 randomized control trials published in The Spine Journal, Spine, and Journal of Neurosurgery: Spine between January 2012 - January 2022.

OUTCOME MEASURES

Extracted manuscript characteristics included the frequency of demographic reporting, sample size, and demographic composition of studies.

METHODS

We conducted a systematic review of RCTs published between January 2012 - January 2022 in the three highest impact factor spine journals in 2021: The Spine Journal, Spine, and Journal of Neurosurgery: Spine. We determined if age, gender, BMI, race, and ethnicity were reported and analyzed for each study. The overall frequency of demographic reporting was assessed, and the reporting trends were analyzed for each individual year and journal. Among studies that did report demographics, the populations were analyzed in comparison to the national population per United States (US) census reports. Studies were evaluated for bias using Cochrane risk-of-bias.

RESULTS

Our search identified 278 RCTs for inclusion. 166 were published in Spine, 65 in The Spine Journal, and 47 in Journal of Neurosurgery: Spine. Only 9.35% (N=26) and 3.9% (N=11) of studies reported race and ethnicity, respectively. Demographic reporting frequency did not vary based on the publishing journal. Reporting of age and BMI increased over time, but reporting of race and ethnicity did not. Among RCTs that reported race, 88% were conducted in the US, and 85.71% of the patients in these US studies were White. White subjects were overly represented compared to the US population (85.71% vs. 61.63%, p<.001), and non-White or Black patients were most underrepresented (2.89% vs. 25.96%, p<.001).

CONCLUSIONS

RCTs published in the three highest impact factor spine journals failed to frequently report patient race or ethnicity. Among studies published in the US, study populations are increasingly represented by non-Hispanic White patients. As we strive to care for an increasingly diverse population and reduce disparities to care, spine surgeons must do a better job reporting these variables to increase the external validity and generalizability of RCTs.

Diversity in Orthopaedic Surgery Medical Device Clinical Trials: An Analysis of the Food and Drug Administration Safety and Innovation Act

INTRODUCTION

Demographic factors contribute markedly to orthopaedic surgery outcomes. However, women and minorities have been historically excluded from clinical trials. The United States passed the Safety and Innovation Act (Food and Drug Administration Safety and Innovation Act [FDA-SIA]) in 2012 to increase study diversity and mandate reporting of certain demographics. The purpose of this study was to investigate demographic reporting and analysis among high-risk orthopaedic medical device trials and evaluate the effectiveness of the FDA-SIA in increasing diversity of study enrollment.

METHODS

The premarket approval database was queried for all original submissions approved by the Orthopedic Advisory Committee from January 1, 2003, to July 1, 2022. Study demographics were recorded. Weighted means of race, ethnicity, and sex were compared before and after FDA-SIA implementation with the US population.

RESULTS

We identified 51 orthopaedic trials with unique study data. Most Food and Drug Administration device trials reported age (98.0%) and sex (96.1%), but only 49.0% and 37.3% reported race and ethnicity, respectively. Only 23 studies analyzed sex, six analyzed race, and two analyzed ethnicity. Compared with the US population, participants were overwhelmingly White (91.36% vs. 61.63%, P < 0.001) with a significant underrepresentation of Black (3.65% vs. 12.41%, P = 0.008), Asian (0.86% vs. 4.8%, P = 0.030), and Hispanic participants (3.02% vs. 18.73%, P < 0.001) before 2013. The FDA-SIA increased female patient enrollment (58.99% vs. 47.96%, P = 0.021) but did not increase the enrollment of racial or ethnic minorities.

CONCLUSION

Despite efforts to increase the generalizability of studies within the FDA-SIA, orthopaedic medical devices still fail to enroll diverse populations and provide demographic subgroup analysis. The study populations within these trials do not represent the populations for whom these devices will be indicated in the community. The federal government must play a stronger role in mandating study diversity, enforcing appropriate statistical analysis of the demographic subgroups, and executing measures to ensure compliance.

LEVEL OF EVIDENCE

I.

Race and Ethnicity Reporting in Randomized Controlled Trials Published in Upper-Extremity Journals

PURPOSE

Hand surgery remains one of the least racially and ethnically diverse subspecialties in all of medicine, and minority patients demonstrate overall worse health care outcomes compared with White patients. Our purpose was to determine the frequency of race and ethnicity reporting in randomized controlled trials (RCTs) published in journals with an upper-extremity (UE) focus.

METHODS

A systematic review was conducted in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines by searching EMBASE and MEDLINE for RCTs contained in peer-reviewed journals with an UE focus. All articles from 2000 to 2021 were included. Information such as article sample size, center type, funding, and location was recorded. We assessed each article to determine whether demographic information, including race and ethnicity, was reported for study participants.

RESULTS

A total of 481 RCTs in 9 UE journals were included. For UE RCTs, 96% of studies reported age, 90% reported sex, and 5% reported either race or ethnicity. Demographic information about economic status, insurance status, mental health, educational level, and marital status were each reported in <10% of RCTs. Racial representation was highest for White participants (80%) and lowest among American Indian participants. Of studies conducted within the United States, all racial groups except for White patients were underrepresented compared with census data.

CONCLUSIONS

Demographic data related to race and ethnicity for patients involved in UE RCTs are infrequently reported. When reported, the racial demographics of UE RCT patients do not match the demographics of the patients in United States. Black patients remain underrepresented in RCTs.

CLINICAL RELEVANCE

Academic journals mandating the reporting of demographic data related to race may aid in improved reporting and allow for subsequent aggregation within systematic reviews to assess outcomes for racial minorities.