1
|
Wan X, Wang R, Zhao J, Liang T, Wang B, Zhang J, Liu Y, Ma Y, Chen Y, Lv X. From Manual to Machine: Revolutionizing Day Surgery Guideline and Consensus Quality Assessment With Large Language Models. J Evid Based Med 2025; 18:e70017. [PMID: 40123109 PMCID: PMC11931197 DOI: 10.1111/jebm.70017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/23/2024] [Revised: 03/10/2025] [Accepted: 03/11/2025] [Indexed: 03/25/2025]
Abstract
OBJECTIVE To evaluate the methodological and reporting quality of clinical practice guidelines/expert consensus for ambulatory surgery centers published since 2000, combining manual assessment with large language model (LLM) analysis, while exploring LLMs' feasibility in quality evaluation. METHODS We systematically searched Chinese/English databases and guideline repositories. Two researchers independently screened literature and extracted data. Quality assessments were conducted using AGREE II and RIGHT tools through both manual evaluation and GPT-4o modeling. RESULTS 54 eligible documents were included. AGREE II domains showed mean compliance: Scope and purpose 25.00%, Stakeholder involvement 20.16%, Rigor of development 17.28%, Clarity of presentation 41.56%, Applicability 18.06%, Editorial independence 26.39%. RIGHT items averaged: Basic information 44.44%, Background 36.11%, Evidence 14.07%, Recommendations 34.66%, Review and quality assurance 3.70%, Funding and declaration and management of interests 24.54%, Other information 27.16%. LLMs'-evaluated documents demonstrated significantly higher scores than manual assessments in both tools. Subgroup analyses revealed superior quality in documents with evidence retrieval, conflict disclosure, funding support, and LLM integration (P <0.05). CONCLUSION Current guidelines and consensus related to day surgery need to improve their methodological quality and quality of reporting. The study validates LLMs' supplementary value in quality assessment while emphasizing the necessity of maintaining manual evaluation as the foundation.
Collapse
Affiliation(s)
- Xingyu Wan
- The First School of Clinical MedicineLanzhou UniversityLanzhouChina
| | - Ruiyan Wang
- The First School of Clinical MedicineLanzhou UniversityLanzhouChina
| | - Junxian Zhao
- Research Center for Clinical Medicinethe First Hospital of Lanzhou UniversityLanzhouChina
| | - Tianhu Liang
- Research Center for Clinical Medicinethe First Hospital of Lanzhou UniversityLanzhouChina
| | - Bingyi Wang
- School of Basic Medical SciencesLanzhou UniversityLanzhouChina
| | - Jie Zhang
- School of Basic Medical SciencesLanzhou UniversityLanzhouChina
| | - Yujia Liu
- The First School of Clinical MedicineLanzhou UniversityLanzhouChina
| | - Yan Ma
- The First School of Clinical MedicineLanzhou UniversityLanzhouChina
| | - Yaolong Chen
- Research Center for Clinical Medicinethe First Hospital of Lanzhou UniversityLanzhouChina
- School of Basic Medical SciencesLanzhou UniversityLanzhouChina
- Research Unit of Evidence‐Based Evaluation and Guidelines, Chinese Academy of Medical Sciences (2021RU017), School of Basic Medical Sciences, Lanzhou UniversityLanzhouChina
| | - Xinghua Lv
- The First School of Clinical MedicineLanzhou UniversityLanzhouChina
- Day Surgery Centerthe First Hospital of Lanzhou UniversityLanzhouChina
| |
Collapse
|
2
|
Luedi MM, Schober P, Hammoud B, Andereggen L, Hoenemann C, Doll D. Preoperative Pressure Pain Threshold Is Associated With Postoperative Pain in Short-Stay Anorectal Surgery: A Prospective Observational Study. Anesth Analg 2021; 132:656-662. [PMID: 32675636 PMCID: PMC7870038 DOI: 10.1213/ane.0000000000005072] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
BACKGROUND: Postoperative pain management is key for patient satisfaction. Pressure pain threshold (PPT) has been studied in some surgical cohorts but has not been studied in relationship to acute postoperative pain in short-stay patients undergoing anorectal surgery. We hypothesized that preoperative finger PPT measurements can identify respective patients with higher postoperative pain. Aiming to understand the relationship with subjective postoperative pain perception, we tested the hypotheses that preoperative PPT is associated with postoperative Visual Analog Scale (VAS) pain scores and correlates with postoperative analgesic consumption in short-stay patients undergoing anorectal surgery. METHODS: We prospectively assessed preoperative PPT in a cohort undergoing anorectal surgery, known as a moderately to severely painful procedure. Linear mixed-effects models were used to assess the relationship with postoperative VAS pain scores at 1 and 3 days as well as 4 weeks postoperatively. Logistic regression was used to study the relationship with additional postoperative analgesic consumption. RESULTS: We studied 128 patients and found that preoperative PPT is significantly associated with postoperative pain (P value for interaction = .025). Logistic regression modeling additionally revealed an association between the preoperative PPT and the need for additional postoperative analgesics, with odds of requiring additional analgesia decreasing by about 10% for each 1-point increase in PPT (odds ratio [OR] = 0.90; 95% confidence interval [CI], 00.81–0.98; P = .012). CONCLUSIONS: Preoperative finger PPT is associated with postoperative pain and might help identify patients who are at risk of developing more severe postoperative pain on anorectal surgery. Especially in ambulatory and short-stay settings, this approach can help to address patients’ high variability in pain sensitivity to facilitate appropriate postoperative analgesia, timely discharge, and prevent readmission.
Collapse
Affiliation(s)
- Markus M Luedi
- From the Department of Anaesthesiology and Pain Medicine, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Patrick Schober
- Department of Anaesthesiology, Amsterdam University Medical Centres, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
| | - Bassam Hammoud
- Department of Colorectal Surgery, St Marien-Krankenhaus, Vechta, Germany
| | - Lukas Andereggen
- Department of Neurosurgery, Kantonsspital Aarau, Aarau, Switzerland
| | | | - Dietrich Doll
- Department of Colorectal Surgery, St Marien-Krankenhaus, Vechta, Germany
| |
Collapse
|
3
|
Bourgouin S, Monchal T, Schlienger G, Franck L, Lacroix G, Balandraud P. Eligibility criteria for ambulatory colectomy. J Visc Surg 2020; 159:21-30. [PMID: 33349570 DOI: 10.1016/j.jviscsurg.2020.11.012] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
PURPOSE OF THE STUDY To determine the statistical indicators aimed at identifying patients for whom ambulatory colectomy could be proposed without additional risk. PATIENTS AND METHODS The medical charts of patients who benefited from scheduled colonic or rectal resection during conventional hospitalization stays between 2018 and 2019 were reviewed. Eligibility for ambulatory colectomy was defined by hospital stay≤4 days and absence of any postoperative complication. Patient characteristics were compared, and the results were modeled in the form of a decision-making tree. The effect of an enhanced recovery after surgery (ERAS) protocol for each sub-group was calculated. RESULTS One hundred and ten (110) patients were selected (41 "eligible" and 69 "non-eligible"). Median age was 73 years (27-95). Nearly 80% of the patients were operated for cancer. In multivariate analysis, age (≥65 years, OR=3.15, CI95%=1.22-8.12), diabetes (OR=3.91, CI95%=1.03-14.8) and indication (sigmoidectomy for diverticulosis, OR=0.21, CI=95%=0.05-0.9) were the only identified independent variables. Likelihood for ambulatory eligibility was 83.3% (<65 years, sigmoidectomy pour diverticulosis, +ERAS=92%-96.9%), 58.3% (<65 years, other indication, +ERAS=63.4%-89.9%), 35.7% (≥65 years without diabetes, +ERAS=40.0%-55.9%) and 8.3% (≥65 years with diabetes, +ERAS=10.0%-20.1%). CONCLUSION Sigmoidectomy for diverticulosis in a patient under 65 years age represents the best indication for ambulatory colectomy, a procedure that must not be proposed to diabetic patients over 65 years of age. In the other cases (<65 years operated in another indication and non-diabetic≥65 years), ambulatory surgery is possible, pending satisfactory application of the ERAS protocol.
Collapse
Affiliation(s)
- S Bourgouin
- Department of Digestive and Oncological Surgery, Sainte Anne Military Teaching Hospital, Toulon, France.
| | - T Monchal
- Department of Digestive and Oncological Surgery, Sainte Anne Military Teaching Hospital, Toulon, France
| | - G Schlienger
- Department of Digestive and Oncological Surgery, Sainte Anne Military Teaching Hospital, Toulon, France
| | - L Franck
- Department of Anesthesia and Intensive Care, Sainte Anne Military Teaching Hospital, Toulon, France
| | - G Lacroix
- Department of Anesthesia and Intensive Care, Sainte Anne Military Teaching Hospital, Toulon, France
| | - P Balandraud
- Department of Digestive and Oncological Surgery, Sainte Anne Military Teaching Hospital, Toulon, France; École du Val-de-Grâce, Paris, France
| |
Collapse
|
4
|
|
5
|
Ceulemans A, De Looze D, Van de putte D, Stiers E, Coppens M. High post-operative pain scores despite multimodal analgesia in ambulatory anorectal surgery: a prospective cohort study. Acta Chir Belg 2019; 119:224-230. [PMID: 30189793 DOI: 10.1080/00015458.2018.1500802] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Abstract
Background: Ambulatory surgery for anorectal procedures has become widely accepted. Recent reviews recommend a multimodal approach to pain management. However, these recommendations are largely based on single intervention studies. Our goal was to evaluate post-operative pain in patients receiving a multimodal analgesic regimen. Methods: All patients undergoing an ambulatory anorectal procedure between December 2015 and September 2016 received a pain diary. Mean pain throughout the day and pain during defecation where recorded on day 0-14 and day 21 postoperatively using a numeric rating scale-11. Use of oral analgesics was also recorded. Results: Forty-two patients completed the pain diary. The use of local anesthetic infiltration did not result in a significant difference in pain scores in this study. Patients who received written information on postoperative pain management and hygienic measures had higher intake of oral analgesics. Despite receiving multimodal analgesic treatment, patients undergoing surgery for hemorrhoids or anal fissures reported pain scores ≥4 and used analgesics longer. Conclusion: A multimodal analgesic approach consisting of local anesthetic infiltration, multiple oral analgesics and written information seems to be insufficient for certain patient groups after ambulatory anorectal surgery. Especially patients undergoing surgery for hemorrhoids or an anal fissure should receive adequate analgesia. Pain during defecation is problematic and finding a solution for this problem remains challenging. Further research into the combined use of different analgesic modalities is recommended.
Collapse
Affiliation(s)
- Aline Ceulemans
- Department of Ambulatory Surgery, Ghent University, Ghent, Belgium
- Faculty of Medicine and Health Sciences, Ghent University, Ghent, Belgium
| | - Danny De Looze
- Department of Ambulatory Surgery, Ghent University, Ghent, Belgium
- Department of Gastroenterology, Ghent University Hospital, Ghent, Belgium
| | - Dirk Van de putte
- Department of Ambulatory Surgery, Ghent University, Ghent, Belgium
- Department of Gastrointestinal Surgery, Ghent University Hospital, Ghent, Belgium
| | - Eline Stiers
- Department of Ambulatory Surgery, Ghent University, Ghent, Belgium
- Faculty of Medicine and Health Sciences, Ghent University, Ghent, Belgium
| | - Marc Coppens
- Department of Ambulatory Surgery, Ghent University, Ghent, Belgium
- Faculty of Medicine and Health Sciences, Anesthesiology and Perioperative Medicine, Ghent University Hospital, Ghent, Belgium
| |
Collapse
|
6
|
Faucheron JL, Trilling B, Sage PY. Ambulatory colectomy: fast-track management pushed to its limits? Tech Coloproctol 2018; 22:741-742. [PMID: 30413997 DOI: 10.1007/s10151-018-1871-5] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/05/2018] [Accepted: 10/19/2018] [Indexed: 12/01/2022]
Affiliation(s)
- J-L Faucheron
- Colorectal Unit, Department of Surgery, Michallon University Hospital, Grenoble, CS 10217, 38043, Grenoble Cedex, France.
- University Grenoble Alpes, Grenoble, France.
| | - B Trilling
- Colorectal Unit, Department of Surgery, Michallon University Hospital, Grenoble, CS 10217, 38043, Grenoble Cedex, France
- University Grenoble Alpes, Grenoble, France
| | - P-Y Sage
- Colorectal Unit, Department of Surgery, Michallon University Hospital, Grenoble, CS 10217, 38043, Grenoble Cedex, France
| |
Collapse
|
7
|
Trilling B, Sage PY, Reche F, Barbois S, Waroquet PA, Faucheron JL. Early experience with ambulatory robotic ventral rectopexy. J Visc Surg 2018; 155:5-9. [PMID: 29396113 DOI: 10.1016/j.jviscsurg.2017.05.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
OBJECTIVE OF THE STUDY Ventral rectopexy can be performed robotically with only limited trauma for the patient, making its performance in an ambulatory setting potentially interesting. The aim of this study is to report our preliminary experience with ambulatory robotic ventral rectopexy in consecutive patients. PATIENTS AND METHODS Ten consecutive patients underwent robotic ventral rectopexy for total rectal prolapse (n=8) or symptomatic enterocele (n=2) between February 2014 and April 2015. Patients were selected for outpatient treatment based on criteria of patient motivation, favorable social conditions, and satisfactory general condition. Patient characteristics, technical results and cost were reported. RESULTS The mean operating time was 94minutes (range: 78-150). The average operating room occupancy time was 254minutes (222-339). There were no operative complications, conversion to laparotomy, or postoperative complication. The average duration of hospital stay was 11 (8-32) hours. Two patients required hospitalization: one for persistent pain and the other for urinary retention. The average maximum pain score recorded on postoperative day 1 was 2/10 on a visual analog scale (range: 0-5/10). Estimated average cost (excluding amortization of the purchase of the robot) was €9088 per procedure. CONCLUSIONS Ambulatory management of robotic ventral rectopexy is feasible and safe.
Collapse
Affiliation(s)
- B Trilling
- Unité colorectale, service de chirurgie digestive et de l'urgence, CHU de Grenoble, 38000 Grenoble, France; Université de Grenoble Alpes, UMR 5525, CNRS, TIMC-IMAG, 38000 Grenoble, France.
| | - P-Y Sage
- Unité colorectale, service de chirurgie digestive et de l'urgence, CHU de Grenoble, 38000 Grenoble, France
| | - F Reche
- Unité colorectale, service de chirurgie digestive et de l'urgence, CHU de Grenoble, 38000 Grenoble, France; Université de Grenoble Alpes, UMR 5525, CNRS, TIMC-IMAG, 38000 Grenoble, France
| | - S Barbois
- Unité colorectale, service de chirurgie digestive et de l'urgence, CHU de Grenoble, 38000 Grenoble, France
| | - P-A Waroquet
- Unité colorectale, service de chirurgie digestive et de l'urgence, CHU de Grenoble, 38000 Grenoble, France
| | - J-L Faucheron
- Unité colorectale, service de chirurgie digestive et de l'urgence, CHU de Grenoble, 38000 Grenoble, France; Université de Grenoble Alpes, UMR 5525, CNRS, TIMC-IMAG, 38000 Grenoble, France; Unité de chirurgie ambulatoire, CHU de Grenoble, 38000 Grenoble, France
| |
Collapse
|
8
|
Soudan D, Fathallah N, de Parades V. [Open haemorrhoidectomy as an ambulatory procedure, is it reasonable?]. Presse Med 2017; 46:1106-1107. [PMID: 28919275 DOI: 10.1016/j.lpm.2017.08.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/28/2017] [Accepted: 08/02/2017] [Indexed: 11/18/2022] Open
Affiliation(s)
- Damien Soudan
- Groupe hospitalier Paris Saint-Joseph, institut Léopold-Bellan, proctologie médicochirurgicale, 185, rue Raymond-Losserand, 75014 Paris, France
| | - Nadia Fathallah
- Groupe hospitalier Paris Saint-Joseph, institut Léopold-Bellan, proctologie médicochirurgicale, 185, rue Raymond-Losserand, 75014 Paris, France
| | - Vincent de Parades
- Groupe hospitalier Paris Saint-Joseph, institut Léopold-Bellan, proctologie médicochirurgicale, 185, rue Raymond-Losserand, 75014 Paris, France.
| |
Collapse
|