1
|
Gikandi A, Hallet J, Koerkamp BG, Clark CJ, Lillemoe KD, Narayan RR, Mamon HJ, Zenati MA, Wasif N, Safran DG, Besselink MG, Chang DC, Traeger LN, Weissman JS, Fong ZV. Distinguishing Clinical From Statistical Significances in Contemporary Comparative Effectiveness Research. Ann Surg 2024; 279:907-912. [PMID: 38390761 PMCID: PMC11087199 DOI: 10.1097/sla.0000000000006250] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/24/2024]
Abstract
OBJECTIVE To determine the prevalence of clinical significance reporting in contemporary comparative effectiveness research (CER). BACKGROUND In CER, a statistically significant difference between study groups may or may not be clinically significant. Misinterpreting statistically significant results could lead to inappropriate recommendations that increase health care costs and treatment toxicity. METHODS CER studies from 2022 issues of the Annals of Surgery , Journal of the American Medical Association , Journal of Clinical Oncology , Journal of Surgical Research , and Journal of the American College of Surgeons were systematically reviewed by 2 different investigators. The primary outcome of interest was whether the authors specified what they considered to be a clinically significant difference in the "Methods." RESULTS Of 307 reviewed studies, 162 were clinical trials and 145 were observational studies. Authors specified what they considered to be a clinically significant difference in 26 studies (8.5%). Clinical significance was defined using clinically validated standards in 25 studies and subjectively in 1 study. Seven studies (2.3%) recommended a change in clinical decision-making, all with primary outcomes achieving statistical significance. Five (71.4%) of these studies did not have clinical significance defined in their methods. In randomized controlled trials with statistically significant results, sample size was inversely correlated with effect size ( r = -0.30, P = 0.038). CONCLUSIONS In contemporary CER, most authors do not specify what they consider to be a clinically significant difference in study outcome. Most studies recommending a change in clinical decision-making did so based on statistical significance alone, and clinical significance was usually defined with clinically validated standards.
Collapse
Affiliation(s)
| | - Julie Hallet
- Department of Surgery, University of Toronto, Toronto, Canada
| | - Bas Groot Koerkamp
- Department of Surgery, Erasmus MC Cancer Institute, Rotterdam, The Netherlands
| | - Clancy J Clark
- Department of Surgical Oncology, Wake Forest School of Medicine, Winston-Salem, NC
| | - Keith D Lillemoe
- Department of Surgery, Massachusetts General Hospital, Boston, MA
| | - Raja R Narayan
- Department of Surgical Oncology, Brigham and Women's Hospital/Dana-Farber Cancer Institute, Boston, MA
| | - Harvey J Mamon
- Department of Radiation Oncology, Brigham and Women's Hospital/Dana-Farber Cancer Institute, Boston, MA
| | - Marco A Zenati
- Department of Cardiac Surgery, Brigham and Women's Hospital and Harvard Medical School, Boston, MA
| | - Nabil Wasif
- Department of Surgical Oncology and Endocrine Surgery, Mayo Clinic Arizona, Phoenix, AZ
| | - Dana Gelb Safran
- Department of Medicine, National Quality Forum, Washington, DC; School of Medicine, Tufts University, Boston, MA
| | - Marc G Besselink
- Department of Surgery, Amsterdam UMC, Amsterdam, The Netherlands
| | - David C Chang
- Department of Surgery, Massachusetts General Hospital, Boston, MA
| | - Lara N Traeger
- Department of Psychology, University of Miami, Coral Gables, FL
| | - Joel S Weissman
- Department of Surgery, Center for Surgery and Public Health, Brigham and Women's Hospital, Boston, MA
| | - Zhi Ven Fong
- Department of Surgical Oncology and Endocrine Surgery, Mayo Clinic Arizona, Phoenix, AZ
| |
Collapse
|
2
|
Yan M, Lin Z, Wu Z, Zheng H, Shi M. A predictive nomogram model for low anterior resection syndrome after rectal cancer resection. ANZ J Surg 2022; 92:3224-3231. [PMID: 36527689 DOI: 10.1111/ans.17966] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2022] [Revised: 07/17/2022] [Accepted: 07/25/2022] [Indexed: 12/31/2022]
Abstract
BACKGROUND The aim of this study was to identify risk factors associated with the low anterior resection syndrome (LARS) and to construct a nomogram capable of predicting the risk of LARS in patients who undergo rectal cancer resection. METHODS About 538 patients who had undergone anterior resection were recruited as a development set. In addition, 114 patients with rectal cancer were analysed as a validation set to test the new nomogram. Patients in the development set were grouped into two separate cohorts: those with major LARS and those with minor or no LARS. Multiple logistic regression was conducted to detect risk factors for major LARS. RESULTS The prevalence of major LARS was 40.7%, of minor LARS was 28.6% and the proportion with no LARS was 30.7% in the development set. In multivariate analysis, female gender, preoperative chemoradiation, low tumour height, diverting ileostomy, postoperative anastomotic leakage were shown to be independently associated with major LARS occurring in patients after rectal cancer resection. The area under the curve (AUC) values of the nomogram were 0.726 (95% CI: 0.682-0.769) and 0.750 (95% CI: 0.655-0.845) in the development and validation sets, respectively. The calibration curves and Hosmer-Lemeshow goodness of fit tests showed that the model was acceptably accurate. CONCLUSION A nomogram model based on risk factors could be valuable as a predictor of the probability of major LARS after rectal cancer surgery, and provides a guide that clinical staff can use to take preventive measures for high-risk patients.
Collapse
Affiliation(s)
- Mingfang Yan
- Department of Gastrointestinal Surgery, Fujian Medical University Cancer Hospital & Fujian Cancer Hospital, Fuzhou, China
| | - Zhenmeng Lin
- Department of Gastrointestinal Surgery, Fujian Medical University Cancer Hospital & Fujian Cancer Hospital, Fuzhou, China
| | - Zhiying Wu
- Department of Gastrointestinal Surgery, Zhongshan Hospital Affiliated to Xiamen University, Xiamen, China
| | - Huizhe Zheng
- Department of Anesthesiology Surgery, Fujian Medical University Cancer Hospital & Fujian Cancer Hospital, Fuzhou, China
| | - Meiqin Shi
- Department of Operating Theatre, Fujian Medical University Cancer Hospital & Fujian Cancer Hospital, Fuzhou, China
| |
Collapse
|
3
|
De Simone V, Litta F, Persiani R, Rizzo G, Sofo L, Menghi R, Santullo F, Biondi A, Coco C, Sacchetti F, Longo F, Attalla El Halabieh M, Moroni R, Ratto C. Effectiveness and Validation of the Italian Translation of the Low Anterior Resection Syndrome Score in an Italian High-Volume University Hospital. Front Surg 2022; 9:917224. [PMID: 35795231 PMCID: PMC9251199 DOI: 10.3389/fsurg.2022.917224] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2022] [Accepted: 05/30/2022] [Indexed: 11/13/2022] Open
Abstract
Background The low anterior resection syndrome (LARS) score is a validated questionnaire developed in Denmark to measure the severity of bowel dysfunction after low anterior resection. This retrospective study aimed to assess the effectiveness of the LARS score in the Italian language in a population of Italian patients who underwent low anterior resection for rectal cancer. The convergent and discriminative validity and the test-retest reliability of the score were investigated. Methods A cohort of two hundred and five patients treated with low anterior resection were enrolled in an Italian high-volume university hospital between January 2000 and April 2018. The Italian version of the LARS score (tested twice), as translated from English original version, a single question on quality of life and the EORTC QLQ-C30 questionnaire were submitted to patients. Results A high proportion of patients showed a perfect or moderate fit between the LARS score and QoL categories (convergent validity, p < 0.0005). All differences regarding the items of the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire - Core 30 (EORTC QLQ-C30) functional scales were statistically significant (p < 0.0005). The LARS score was able to discriminate between groups of patients who received or did not receive preoperative chemoradiotherapy (p < 0.0005) and those who received total or partial mesorectal excision (p < 0.0005). The test-retest reliability was excellent (intraclass correlation coefficient 0.96). Conclusion The Italian translation of the LARS score is an easy and reliable tool for assessing bowel dysfunction after low anterior resection and its routine use in clinical practice should be recommended.Trial registration number at www.clinicaltrials.gov: NCT04406311.
Collapse
Affiliation(s)
- Veronica De Simone
- Proctology Unit, Fondazione Policlinico Universitario “A. Gemelli” IRCCS, Rome, Italy
| | - Francesco Litta
- Proctology Unit, Fondazione Policlinico Universitario “A. Gemelli” IRCCS, Rome, Italy
| | - Roberto Persiani
- General Surgery Unit, Fondazione Policlinico Universitario “A. Gemelli” IRCCS, Rome, Italy
| | - Gianluca Rizzo
- General Surgery II Unit, Fondazione Policlinico Universitario “A. Gemelli” IRCCS, Rome, Italy
| | - Luigi Sofo
- Abdominal Surgery Unit, Fondazione Policlinico Universitario “A. Gemelli” IRCCS, Rome, Italy
| | - Roberta Menghi
- Digestive Surgery Unit, Fondazione Policlinico Universitario “A. Gemelli” IRCCS, Rome, Italy
| | - Francesco Santullo
- Peritoneal and Retroperitoneal Surgery Unit, Fondazione Policlinico Universitario “A. Gemelli” IRCCS, Rome, Italy
| | - Alberto Biondi
- General Surgery Unit, Fondazione Policlinico Universitario “A. Gemelli” IRCCS, Rome, Italy
| | - Claudio Coco
- General Surgery II Unit, Fondazione Policlinico Universitario “A. Gemelli” IRCCS, Rome, Italy
| | - Franco Sacchetti
- Abdominal Surgery Unit, Fondazione Policlinico Universitario “A. Gemelli” IRCCS, Rome, Italy
| | - Fabio Longo
- Digestive Surgery Unit, Fondazione Policlinico Universitario “A. Gemelli” IRCCS, Rome, Italy
| | - Miriam Attalla El Halabieh
- Peritoneal and Retroperitoneal Surgery Unit, Fondazione Policlinico Universitario “A. Gemelli” IRCCS, Rome, Italy
| | - Rossana Moroni
- Scientific Direction, Fondazione Policlinico Universitario “A. Gemelli” IRCCS, Rome, Italy
| | - Carlo Ratto
- Proctology Unit, Fondazione Policlinico Universitario “A. Gemelli” IRCCS, Rome, Italy
| |
Collapse
|