Medicine is plagued by untrustworthy clinical trials. How many studies are faked or flawed?

How to fight fake papers: a review on important information sources and steps towards solution of the problem

Scientific fake papers, containing manipulated or completely fabricated data, are a problem that has reached dramatic dimensions. Companies known as paper mills (or more bluntly as "criminal science publishing gangs") produce and sell such fake papers on a large scale. The main drivers of the fake paper flood are the pressure in academic systems and (monetary) incentives to publish in respected scientific journals and sometimes the personal desire for increased "prestige." Published fake papers cause substantial scientific, economic, and social damage. There are numerous information sources that deal with this topic from different points of view. This review aims to provide an overview of these information sources until June 2024. Much more original research with larger datasets is needed, for example on the extent and impact of the fake paper problem and especially on how to detect them, as many findings are based more on small datasets, anecdotal evidence, and assumptions. A long-term solution would be to overcome the mantra of publication metrics for evaluating scientists in academia.

Theranostic Innovation by Humane N-of-One Cancer Care in Real-World Patients

Patients with relapsed or refractory metastatic cancer unresponsive to standard therapies have motivated nuclear physicians to develop innovative radioligands, precisely targeted to tumor molecular receptors, for effective treatment of specific advanced malignancies. Individual practitioners in departments of nuclear medicine across the world have performed first-in-human studies on compassionate patient usage N-of-One protocols. These physician-sponsored studies then evolved into early-phase clinical trials and obtained real-world data to demonstrate real-world evidence of effectiveness in prolonging survival and enhancing quality of life of many so-called "End-Stage" cancer patients. Virtually all the therapeutic radiopharmaceuticals in current clinical oncology have been discovered and developed into effective specific treatments of targetable cancers by individual doctors in the course of their hospital practice. Pharma industry was not involved until many years later when performance of mandated Phase 3 randomized controlled trials became necessary to achieve regulatory agency approval. This article traces the history of several novel theranostic agents developed from compassionate N-of-One studies by hospital physicians over the past 36 years. It acknowledges the collegiality and collaboration of individual nuclear medicine specialists, worldwide, in pioneering effective humane therapy of particular advanced cancers unresponsive to conventional treatments.

Editorial Commentary: Published Literature on Platelet-Rich Plasma Is Extensive but Flawed in Methodology

Recent research shows that most orthopaedic published investigations on platelet-rich plasma (PRP) lack reporting of preparation methods or PRP composition. The studies are thus unreproducible and the outcomes cannot be verified. Unfortunately, this is not surprising. A PubMed search reveals more than 500 orthopaedic PRP publications from 2023 alone, almost 42 musculoskeletal PRP papers per month, and unfortunately, despite peer review, Nature reports that 44% of published research is flawed and 26% of studies cannot be trusted. PubMed citation does not ensure quality. Guidelines and checklists such as the CONSORT statement (Consolidated Standards of Reporting Trails) can result in quality.

Corticosteroid in non-COVID-19 induced community-acquired pneumonia, a meta-analysis

BACKGROUND

Corticosteroid treatment in non-COVID-19 induced Community-acquired pneumonia (CAP) remains inconclusive.

OBJECTIVES

We aimed to assess the role of corticosteroid treatment in CAP.

METHODS

We conducted a comprehensive search of online databases, including PubMed, Embase, and Cochrane, to identify articles published from January 1, 2000, to May 5, 2023. Double-blind RCTs were selected. Two authors screened studies and extracted data. The evidence was assessed using the Grading of Recommendations Assessment, Development, and Evaluation approach.

RESULTS

We analyzed data from 12 RCTs, involving 2446 patients. Corticosteroids therapy may reduce short-term mortality in patients with severe CAP (sCAP) and shorten the hospital length of stay in patients with CAP. Furthermore, corticosteroids treatment can decrease the risk of requiring mechanical ventilation, developing septic shock and multiple organ dysfunction syndrome (MODS). There were no significant differences between the corticosteroid and control groups concerning gastrointestinal bleeding and nosocomial infection. The use of corticosteroids could increase the risk of hyperglycemia.

CONCLUSION

Corticosteroid treatment for sCAP has the potential to provide benefits in reducing short-term mortality, but this conclusion necessitates more evidence. Besides, we found no evidence that strongly prevents us from using corticosteroids in patients with sCAP or those at risk of progressing to sCAP.

Drug Promotions Between Ethics, Regulations, and Financial Interests

BACKGROUND

The promotion of the latest medicines produced by the pharmaceutical industry is an important issue both from an ethical point of view (the level of accessibility, the way research is carried out) and from the point of view of marketing and especially from the lobbying issues raised.

AREAS OF UNCERTAINTY

The ethical dilemmas raised by the promotion of new drugs revolve between the need to discover new molecules important for treating a wide range of diseases and the need to establish a battery of ethical rules, absolutely necessary for regulations in the field to be compliant with all ethical principles.

DATA SOURCES

A literature search was conducted through PubMed, MEDLINE, Plus, Scopus, and Web of Science (2015-2023) using combinations of keywords, including drugs, medical publicity, and pharma marketing plus ethical dilemma.

ETHICS AND THERAPEUTIC ADVANCES

The promotion of medicines is governed by advertising laws and regulations in many countries, including at EU level, based on the need for countries to ensure that the promotion and advertising of medicines is truthful, based on information understood by consumers. The ethical analysis of the issues raised is more necessary and complex as the channels used for promotion are more accessible to the population, and the information, easier to obtain, can be the cause of increased self-medication and overeating. Large amounts of money invested in the development of new molecules, but also the risk of scientific fraud through manipulation of data during clinical trials, selective or biased publication of information can have repercussions on the health of the population.

CONCLUSIONS

The development of new pharmaceutical molecules is necessary to intervene and treat as many conditions as possible, but marketing must not neglect the observance of ethical principles. The promotion of medicines should be the attribute especially of the medical staff, which should also be a mandatory part of the mechanism for approving the marketing methods and means used by the pharmaceutical companies.

Leveraging generative AI for clinical evidence synthesis needs to ensure trustworthiness

Evidence-based medicine promises to improve the quality of healthcare by empowering medical decisions and practices with the best available evidence. The rapid growth of medical evidence, which can be obtained from various sources, poses a challenge in collecting, appraising, and synthesizing the evidential information. Recent advancements in generative AI, exemplified by large language models, hold promise in facilitating the arduous task. However, developing accountable, fair, and inclusive models remains a complicated undertaking. In this perspective, we discuss the trustworthiness of generative AI in the context of automated summarization of medical evidence.

Do medical devices contribute to sustainability? The role of innovative polymers and device design

Sustainability of a medical device has not yet become a major issue in public discussions compared to other topics with impact to material performance, clinical application, production economy and environmental pollution. Due to their unique properties, polymers (plastics) allow for multiple, flexible applications in medical device technology. Polymers are part of the majority of disposable and single use medical device and contribute with 3% to the worldwide production of plastics. The global medical polymer market size was valued 19.9 billion US-$ in 2022 and its value projection for 2023 is expected to reach 43.03 billion US-$ Here, a wider concept of related sustainability is introduced for medical devices and their polymer components. A close look on medical device specification reveals that additional properties are required to provide sustainability, such as biodegradability, quality by device design (QbD), as well as an inbuild performance service for patients, healthcare professionals and healthcare providers. The increasing global numbers for chronic and non-communicable diseases require a huge demand for single use medical devices. A careful look at polymer specification and its performance properties is needed, including possible chemical modifications and degradation processes during waste disposal. Bioengineers in charge of design and production of medical devices will only be successful when they apply a holistic and interdisciplinary approach to medical device sustainability.

Commentary: Fifty years exploring pharmacology with Sam Enna

The passing of Sam Enna in June of 2023 is major loss to the world of pharmacology. While best known for his extensive research activities in the area of γ-aminobutyric acid (GABA) pharmacology, Sam devoted much of his professional time to teaching and as an Editor in Chief for the legacy journals - the Journal of Pharmacology and Experimental Therapeutics (JPET - 1998-2003); Pharmacology & Therapeutics (P & T - 2003-2023) and Biochemical Pharmacology (BCP -2003-2023) - increasing the volume of submissions for all three journals and their Impact Factors while decreasing the time for peer review and publication. Sam was a well-respected consultant in the CNS area for the biopharmaceutical industry and served as Secretary General and President of the International Union of Basic and Clinical Pharmacology where his efforts were focused on sustaining research integrity, particularly in the areas of data reproducibility and fraud. This Commentary provides a personal overview of Sam's 50-year career in pharmacology and briefly updates topics that were of keen interest to Sam including: developments on the continuing reproducibility crisis where systematic fraud continues to proliferate now reaching industrial scale proportions, aided and abetted by paper mills, AI and the erosion of meritocratic norms; and the fall and rise of CNS drug discovery.

Calcium supplementation for the prevention of pre-eclampsia: Challenging the evidence from meta-analyses

OBJECTIVE

To investigate the validity of the conclusion from Cochrane reviews and meta-analyses that treatment with calcium supplementation during pregnancy reduces the risk for pre-eclampsia by 55%, which has been influential in international guidelines and future research.

DESIGN

Sensitivity analysis of data from Cochrane reviews of trials evaluating high-dose calcium supplementation (of at least 1 g/day) for reduction of pre-eclampsia risk.

SETTING

Systematic review and meta-analysis.

POPULATION

The Cochrane reviews and meta-analyses included 13 trials enrolling a total of 15 730 women. Random-effects meta-analysis of these studies resulted in a mean risk ratio (RR, calcium/placebo) of 0.45 (95% confidence interval [CI] 0.31-0.65; p < 0.0001).

METHODS

We carried out a sensitivity analysis of evidence from the relevant Cochrane review, to examine the impact of study size.

MAIN OUTCOME MEASURES

pre-eclampsia.

RESULTS

In the three largest studies, accounting for 13 815 (88%) of total recruitment, mean RR was 0.92 (95% CI 0.80-1.06) and there was no evidence of heterogeneity between studies (I2  = 0). With inclusion of the smaller studies, mean RR decreased to 0.45 and I2 increased to 70%.

CONCLUSIONS

In assessment of the effect of calcium supplementation on pre-eclampsia risk, the naive focus on the mean of the random-effects meta-analysis in the presence of substantial heterogeneity is highly misleading.

Is there 'trustworthy' evidence for using manual therapy to treat patients with shoulder dysfunction?: A systematic review

The primary objective of this review was to create a 'trustworthy,' living systematic review and meta-analysis for the application of manual therapy interventions in treating patients with shoulder dysfunction. Included studies were English-language randomized controlled trials published between 1/1/2010 and 8/3/2023, with searches performed in: PubMed, Cochrane Central Register of Controlled Trials (CENTRAL), CINHAL, ProQuest Nursing & Allied Health, EBSCO Medline, and PEDro. The population of focus included adults 18 years and older with musculoskeletal impairments related to shoulder dysfunction. Our primary outcomes included pain and region-specific outcome measures. We excluded trials, including participants having shoulder dysfunction resulting from surgery, radicular pain, instability/dislocation, fracture, lymphedema, and radiation. Our screening methodology was based upon a previously published 'trustworthy' systematic review protocol. This included the application of our PICOTS criteria in addition to screening for prospective clinical trial registration and following of prospective intent, as well as assessment of PEDro scores, risk-of-bias ratings, GRADE scoring, and examination of confidence in estimated effects. Twenty-six randomized controlled trials met our PICOTS criteria; however, only 15 of these were registered. Only three were registered prospectively. Two of these did not have discussions and conclusions that aligned with their primary outcome. The remaining single study was found to have a high risk-of-bias, meaning the remainder of the protocol could not be employed and that no randomized controlled trials could undergo further assessment or meta-analysis. The results of this systematic review indicate there are no 'trustworthy' randomized controlled trials examining the effectiveness of manual therapy interventions for the treatment of patients with shoulder dysfunction, as defined by the prospectively established methodology. Therefore, these findings signal that creating a 'trustworthy,' living systematic review on this clinically relevant topic is not yet possible due to a lack of 'trustworthy' randomized controlled trials.

Perioperative pain management for cleft palate surgery: a systematic review and procedure-specific postoperative pain management (PROSPECT) recommendations

BACKGROUND/IMPORTANCE

Cleft palate surgery is associated with significant postoperative pain. Effective pain control can decrease stress and agitation in children undergoing cleft palate surgery and improve surgical outcomes. However, limited evidence often results in inadequate pain control after cleft palate surgery.

OBJECTIVES

The aim of this review was to evaluate the available evidence and to develop recommendations for optimal pain management after cleft palate surgery using procedure-specific postoperative pain management (PROSPECT) methodology.

EVIDENCE REVIEW

MEDLINE, Embase, and Cochrane Databases were searched for randomized controlled trials and systematic reviews assessing pain in children undergoing cleft palate repair published in English language from July 2002, through August 2023.

FINDINGS

Of 1048 identified studies, 19 randomized controlled trials and 4 systematic reviews met the inclusion criteria. Interventions that improved postoperative pain, and are recommended, include suprazygomatic maxillary nerve block or palatal nerve block (if maxillary nerve block cannot be performed). Addition of dexmedetomidine to local anesthetic for suprazygomatic maxillary nerve block or, alternatively, as intravenous administration perioperatively is recommended. These interventions should be combined with a basic analgesic regimen including acetaminophen and nonsteroidal anti-inflammatory drugs. Of note, pre-incisional local anesthetic infiltration and dexamethasone were administered as a routine in several studies, however, because of limited procedure-specific evidence their contribution to pain relief after cleft palate surgery remains unknown.

CONCLUSION

The present review identified an evidence-based analgesic regimen for cleft palate surgery in pediatric patients.

PROSPERO REGISTRATION NUMBER

CRD42022364788.

How Can the Clinical Aptitude of AI Assistants Be Assayed?

Large language models (LLMs) are exhibiting remarkable performance in clinical contexts, with exemplar results ranging from expert-level attainment in medical examination questions to superior accuracy and relevance when responding to patient queries compared to real doctors replying to queries on social media. The deployment of LLMs in conventional health care settings is yet to be reported, and there remains an open question as to what evidence should be required before such deployment is warranted. Early validation studies use unvalidated surrogate variables to represent clinical aptitude, and it may be necessary to conduct prospective randomized controlled trials to justify the use of an LLM for clinical advice or assistance, as potential pitfalls and pain points cannot be exhaustively predicted. This viewpoint states that as LLMs continue to revolutionize the field, there is an opportunity to improve the rigor of artificial intelligence (AI) research to reward innovation, conferring real benefits to real patients.

Antiphospholipid antibodies are enriched post-acute COVID-19 but do not modulate the thrombotic risk

BACKGROUND AND OBJECTIVES

COVID-19-associated coagulopathy, shown to increase the risk for the occurrence of thromboses and microthromboses, displays phenotypic features of the antiphospholipid syndrome (APS), a prototype antibody-mediated autoimmune disease. Several groups have reported elevated levels of criteria and non-criteria antiphospholipid antibodies (aPL), assumed to cause APS, during acute or post-acute COVID-19. However, disease heterogeneity of COVID-19 is accompanied by heterogeneity in molecular signatures, including aberrant cytokine profiles and an increased occurrence of autoantibodies. Moreover, little is known about the association between autoantibodies and the clinical events. Here, we first aim to characterise the antiphospholipid antibody, anti-SARS-CoV-2 antibody, and the cytokine profiles in a diverse collective of COVID-19 patients (disease severity: asymptomatic to intensive care), using vaccinated individuals and influenza patients as comparisons. We then aim to assess whether the presence of aPL in COVID-19 is associated with an increased incidence of thrombotic events in COVID-19.

METHODS AND RESULTS

We conducted anti-SARS-CoV-2 IgG and IgA microELISA and IgG, IgA, and IgM antiphospholipid line immunoassay (LIA) against 10 criteria and non-criteria antigens in 155 plasma samples of 124 individuals, and we measured 16 cytokines and chemokines in 112 plasma samples. We additionally employed clinical and demographic parameters to conduct multivariable regression analyses within multiple paradigms. In line with recent results, we find that IgM autoantibodies against annexin V (AnV), β2-glycoprotein I (β2GPI), and prothrombin (PT) are enriched upon infection with SARS-CoV-2. There was no evidence for seroconversion from IgM to IgG or IgA. PT, β2GPI, and AnV IgM as well as cardiolipin (CL) IgG antiphospholipid levels were significantly elevated in the COVID-19 but not in the influenza or control groups. They were associated predominantly with the strength of the anti-SARS-CoV-2 antibody titres and the major correlate for thromboses was SARS-CoV-2 disease severity.

CONCLUSION

While we have recapitulated previous findings, we conclude that the presence of the aPL, most notably PT, β2GPI, AnV IgM, and CL IgG in COVID-19 are not associated with a higher incidence of thrombotic events.