1
|
Passman JE, Wall-Wieler E, Liu Y, Zheng F, Cohen JB. Antihypertensive Medication Use Trajectories After Bariatric Surgery: A Matched Cohort Study. Hypertension 2024; 81:1737-1746. [PMID: 38832510 PMCID: PMC11251508 DOI: 10.1161/hypertensionaha.124.23054] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2024] [Accepted: 05/14/2024] [Indexed: 06/05/2024]
Abstract
BACKGROUND Metabolic and bariatric surgery (MBS) is the most effective and durable treatment for obesity. We aimed to compare the trajectories of antihypertensive medication (AHM) use among obese individuals treated and not treated with MBS. METHODS Adults with a body mass index of ≥35 kg/m2 were identified in the Merative Database (US employer-based claims database). Individuals treated with versus without MBS were matched 1:1 using baseline demographic and clinical characteristics as well as AHM utilization. Monthly AHM use was examined in the 3 years after the index date using generalized estimating equations. Subanalyses investigated rates of AHM discontinuation, AHM initiation, and apparent treatment-resistant hypertension. RESULTS The primary cohort included 43 206 adults who underwent MBS matched with 43 206 who did not. Compared with no MBS, those treated with MBS had sustained, markedly lower rates of AHM use (31% versus 15% at 12 months; 32% versus 17% at 36 months). Among patients on AHM at baseline, 42% of patients treated with MBS versus 7% treated medically discontinued AHM use (P<0.01). The risk of apparent treatment-resistant hypertension was 3.41× higher (95% CI, 2.91-4.01; P<0.01) 2 years after the index date in patients who did not undergo MBS. Among those without hypertension treated with MBS versus no MBS, 7% versus 21% required AHM at 2 years. CONCLUSIONS MBS is associated with lower rates of AHM use, higher rates of AHM discontinuation, and lower rates of AHM initiation among patients not taking AHM. These findings suggest that MBS is both an effective treatment and a preventative measure for hypertension.
Collapse
Affiliation(s)
- Jesse E Passman
- Department of Surgery (J.E.P.), Perelman School of Medicine, University of Pennsylvania, Philadelphia
| | - Elizabeth Wall-Wieler
- Global Health Economics & Outcomes Research Division, Intuitive, Sunnyvale, CA (E.W.-W., Y.L., F.Z.)
- Department of Community Health Sciences, Max Rady College of Medicine, University of Manitoba, Winnipeg, Canada (E.W.-W.)
| | - Yuki Liu
- Global Health Economics & Outcomes Research Division, Intuitive, Sunnyvale, CA (E.W.-W., Y.L., F.Z.)
| | - Feibi Zheng
- Global Health Economics & Outcomes Research Division, Intuitive, Sunnyvale, CA (E.W.-W., Y.L., F.Z.)
- Michael E. DeBakey Department of Surgery, Baylor College of Medicine, Houston, TX (F.Z.)
| | - Jordana B Cohen
- Renal-Electrolyte and Hypertension Division, Department of Medicine (J.B.C.), Perelman School of Medicine, University of Pennsylvania, Philadelphia
- Department of Biostatistics, Epidemiology, and Informatics (J.B.C.), Perelman School of Medicine, University of Pennsylvania, Philadelphia
| |
Collapse
|
2
|
Chaivanijchaya K, Dang JT. Comment on: Bariatric surgery is as safe as other common operations: an analysis of the ACS-NSQIP. Surg Obes Relat Dis 2024; 20:525-526. [PMID: 38290868 DOI: 10.1016/j.soard.2023.12.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Accepted: 12/27/2023] [Indexed: 02/01/2024]
Affiliation(s)
| | - Jerry T Dang
- Digestive Disease Institute, Cleveland Clinic, Cleveland, Ohio
| |
Collapse
|
3
|
Srinivasan N, Samaan JS, Rajeev ND, Kanu MU, Yeo YH, Samakar K. Large language models and bariatric surgery patient education: a comparative readability analysis of GPT-3.5, GPT-4, Bard, and online institutional resources. Surg Endosc 2024; 38:2522-2532. [PMID: 38472531 PMCID: PMC11078810 DOI: 10.1007/s00464-024-10720-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Accepted: 01/28/2024] [Indexed: 03/14/2024]
Abstract
BACKGROUND The readability of online bariatric surgery patient education materials (PEMs) often surpasses the recommended 6th grade level. Large language models (LLMs), like ChatGPT and Bard, have the potential to revolutionize PEM delivery. We aimed to evaluate the readability of PEMs produced by U.S. medical institutions compared to LLMs, as well as the ability of LLMs to simplify their responses. METHODS Responses to frequently asked questions (FAQs) related to bariatric surgery were gathered from top-ranked health institutions. FAQ responses were also generated from GPT-3.5, GPT-4, and Bard. LLMs were then prompted to improve the readability of their initial responses. The readability of institutional responses, initial LLM responses, and simplified LLM responses were graded using validated readability formulas. Accuracy and comprehensiveness of initial and simplified LLM responses were also compared. RESULTS Responses to 66 FAQs were included. All institutional and initial LLM responses had poor readability, with average reading levels ranging from 9th grade to college graduate. Simplified responses from LLMs had significantly improved readability, with reading levels ranging from 6th grade to college freshman. When comparing simplified LLM responses, GPT-4 responses demonstrated the highest readability, with reading levels ranging from 6th to 9th grade. Accuracy was similar between initial and simplified responses from all LLMs. Comprehensiveness was similar between initial and simplified responses from GPT-3.5 and GPT-4. However, 34.8% of Bard's simplified responses were graded as less comprehensive compared to initial. CONCLUSION Our study highlights the efficacy of LLMs in enhancing the readability of bariatric surgery PEMs. GPT-4 outperformed other models, generating simplified PEMs from 6th to 9th grade reading levels. Unlike GPT-3.5 and GPT-4, Bard's simplified responses were graded as less comprehensive. We advocate for future studies examining the potential role of LLMs as dynamic and personalized sources of PEMs for diverse patient populations of all literacy levels.
Collapse
Affiliation(s)
- Nitin Srinivasan
- Division of Upper GI and General Surgery, Keck School of Medicine of USC, 1510 San Pablo St HCC 3, Los Angeles, CA, 90033, USA
| | - Jamil S Samaan
- Karsh Division of Gastroenterology and Hepatology, Department of Medicine, Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Nithya D Rajeev
- Division of Upper GI and General Surgery, Keck School of Medicine of USC, 1510 San Pablo St HCC 3, Los Angeles, CA, 90033, USA
| | - Mmerobasi U Kanu
- Division of Upper GI and General Surgery, Keck School of Medicine of USC, 1510 San Pablo St HCC 3, Los Angeles, CA, 90033, USA
| | - Yee Hui Yeo
- Karsh Division of Gastroenterology and Hepatology, Department of Medicine, Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Kamran Samakar
- Division of Upper GI and General Surgery, Keck School of Medicine of USC, 1510 San Pablo St HCC 3, Los Angeles, CA, 90033, USA.
| |
Collapse
|
4
|
Ahmad Zawawi M'AF, Jahit MS, Mohd Yusof BN. Bridging the gap between bariatric surgery and continuous multidisciplinary care. MALAYSIAN FAMILY PHYSICIAN : THE OFFICIAL JOURNAL OF THE ACADEMY OF FAMILY PHYSICIANS OF MALAYSIA 2024; 19:8. [PMID: 38496771 PMCID: PMC10944647 DOI: 10.51866/lte.514] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/19/2024]
Affiliation(s)
| | - Mohammad Shukri Jahit
- MD, MMed, Fellowship in Upper, Gastro-Intestinal Surgery No. 4, Jalan P7, Presint 7, W.P. Putrajaya, Malaysia
| | - Barakatun-Nisak Mohd Yusof
- BS Dietetics, PhD, Research Fellow in Diabetes Nutrition, Department of Dietetics, Faculty of Medicine and Health Sciences, Universiti Putra Malaysia, Serdang, Selangor, Malaysia
| |
Collapse
|
5
|
Jazi AHD, Mahjoubi M, Shahabi S, Alqahtani AR, Haddad A, Pazouki A, Prasad A, Safadi BY, Chiappetta S, Taskin HE, Billy HT, Kasama K, Mahawar K, Gawdat K, Rheinwalt KP, Miller KA, Kow L, Neto MG, Yang W, Palermo M, Ghanem OM, Lainas P, Peterli R, Kassir R, Puy RV, Da Silva Ribeiro RJ, Verboonen S, Pintar T, Shabbir A, Musella M, Kermansaravi M. Bariatric Evaluation Through AI: a Survey of Expert Opinions Versus ChatGPT-4 (BETA-SEOV). Obes Surg 2023; 33:3971-3980. [PMID: 37889368 DOI: 10.1007/s11695-023-06903-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2023] [Revised: 10/08/2023] [Accepted: 10/11/2023] [Indexed: 10/28/2023]
Abstract
BACKGROUND Recent advancements in artificial intelligence, such as OpenAI's ChatGPT-4, are revolutionizing various sectors, including healthcare. This study investigates the use of ChatGPT-4 in identifying suitable candidates for bariatric surgery and providing surgical recommendations to improve decision-making in obesity treatment amid the global obesity epidemic. METHODS We devised ten patient scenarios, thoughtfully encompassing a spectrum that spans from uncomplicated cases to more complex ones. Our objective was to delve into the decision-making process regarding the recommendation of bariatric surgery. From July 29th to August 10th, 2023, we conducted a voluntary online survey involving thirty prominent bariatric surgeons, ensuring that there was no predetermined bias in the selection of a specific type of bariatric surgery. This survey was designed to collect their insights on these scenarios and gain a deeper understanding of their professional experience and background in the field of bariatric surgery. Additionally, we consulted ChatGPT-4 in two separate conversations to evaluate its alignment with expert opinions on bariatric surgery options. RESULTS In 40% of the scenarios, disparities were identified between the two conversations with ChatGPT-4. It matched expert opinions in 30% of cases. Differences were noted in cases like gastrointestinal metaplasia and gastric adenocarcinoma, but there was alignment with conditions like endometriosis and GERD. CONCLUSION The evaluation of ChatGPT-4's role in determining bariatric surgery suitability uncovered both potential and shortcomings. Its alignment with experts was inconsistent, and it often overlooked key factors, emphasizing human expertise's value. Its current use requires caution, and further refinement is needed for clinical application.
Collapse
Affiliation(s)
- Amir Hossein Davarpanah Jazi
- Department of Surgery, Minimally Invasive Surgery Research Center, Division of Minimally Invasive and Bariatric Surgery, School of Medicine, Rasool-E Akram Hospital, Iran University of Medical Sciences, Niyaesh Avenue, Sattar Khan Street, Tehran, Iran
| | - Mohammad Mahjoubi
- Clinical Research Development Center, Najafabad Branch, Islamic Azad University, Najafabad, Iran
| | - Shahab Shahabi
- Department of Surgery, Minimally Invasive Surgery Research Center, Division of Minimally Invasive and Bariatric Surgery, School of Medicine, Rasool-E Akram Hospital, Iran University of Medical Sciences, Niyaesh Avenue, Sattar Khan Street, Tehran, Iran.
| | | | - Ashraf Haddad
- Gastrointestinal Metabolic and Bariatric Center, GBMC M, Jordan Hospital, Amman, Jordan
| | - Abdolreza Pazouki
- Department of Surgery, Minimally Invasive Surgery Research Center, Division of Minimally Invasive and Bariatric Surgery, School of Medicine, Rasool-E Akram Hospital, Iran University of Medical Sciences, Niyaesh Avenue, Sattar Khan Street, Tehran, Iran
| | - Arun Prasad
- GI, Bariatric and Robotic Surgery Apollo Hospital, New Delhi, India
| | | | - Sonja Chiappetta
- Bariatric and Metabolic Surgery Unit, Ospedale Evangelico Betania, Naples, Italy
| | - Halit Eren Taskin
- Department of General Surgery, Cerrahpaşa Medical Faculty, Istanbul University Cerrahpaşa, Istanbul, Turkey
| | | | - Kazunori Kasama
- Weight Loss and Metabolic Surgery Center, Yotsuya Medical Cube, Tokyo, Japan
| | | | - Khaled Gawdat
- Ain Shams University Faculty of Medicine Department of General Surgery, Cairo, Egypt
| | - Karl Peter Rheinwalt
- Department of Bariatric, Metabolic and Plastic Surgery, St. Franziskus Hospital, Cologne, Germany
| | | | - Lilian Kow
- Department GI Surgery Flinders, University South Australia, Adelaide, Australia
| | | | - Wah Yang
- The First Affiliated Hospital of Jinan University, Guangzhou, China
| | - Mariano Palermo
- Gastrointestinal and Bariatric Surgery, University of Buenos Aires, Buenos Aires, Argentina
| | | | - Panagiotis Lainas
- Department of Digestive and Bariatric Surgery, Metropolitan Hospital, HEAL Academy, Athens, Greece
| | - Ralph Peterli
- Deputy Head of Visceral Surgery and Head of Bariatric-Metabolic Surgery Clarunis, Department of Visceral Surgery, University Centre for Gastrointestinal and Liver Diseases St. Clara Hospital and University Hospital Basel, 4002, Basel, Switzerland
| | - Radwan Kassir
- Digestive Surgery Unit, University Hospital of La Réunion -Félix Guyon Hospital, Saint-Denis, La Réunion, France
| | - Ramon Vilallonga Puy
- Head Endocrine-Metabolic and Bariatric Surgery Unit, Vall Hebron Barcelona Hospital Campus, Pg. De La Vall d'hebron, 119-129, 08035, Barcelona, Spain
| | - Rui José Da Silva Ribeiro
- General Surgery Department, Multidisciplinary Center for Obesity Treatment - Hospital Lusíadas Amadora, Amadora, Portugal
| | | | - Tadeja Pintar
- UMC Ljubljana, Department of Abdominal Surgery and Medical Faculty, Ljubljana, Slovenia
| | - Asim Shabbir
- National University of Singapore, Singapore, Singapore
| | - Mario Musella
- Advanced Biomedical Sciences Department, "Federico II" University, Naples, Italy
| | - Mohammad Kermansaravi
- Department of Surgery, Minimally Invasive Surgery Research Center, Division of Minimally Invasive and Bariatric Surgery, School of Medicine, Rasool-E Akram Hospital, Iran University of Medical Sciences, Niyaesh Avenue, Sattar Khan Street, Tehran, Iran
| |
Collapse
|
6
|
Rajeev ND, Samaan JS, Premkumar A, Yu E, Srinivasan N, Samakar K. Providers' Knowledge and Perceptions of Bariatric Surgery: a Systematic Review. Obes Surg 2023; 33:3571-3601. [PMID: 37740831 PMCID: PMC10603000 DOI: 10.1007/s11695-023-06827-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 08/21/2023] [Accepted: 09/15/2023] [Indexed: 09/25/2023]
Abstract
Bariatric surgery remains underutilized despite its proven efficacy in the management of obesity. Provider perceptions of bariatric surgery are important to consider when discussing utilization rates. PubMed, SCOPUS, and OVID databases were searched in April 2023, and 40 published studies discussing providers' knowledge and perceptions of bariatric surgery were included. There were generally positive perceptions of the efficacy of bariatric surgery, although overestimations of surgical risks and postoperative complications were common. Providers' previous training was associated with knowledge and perceptions of bariatric surgery and familiarity with perioperative management across studies. These perceptions were also associated with referral rates, suggesting that inadequate provider knowledge may contribute to bariatric surgery underutilization. We advocate for increased bariatric surgery-related education throughout all stages of medical training and across specialties.
Collapse
Affiliation(s)
- Nithya D Rajeev
- Division of Upper GI and General Surgery, Department of Surgery, Keck School of Medicine, University of Southern California, 1510 San Pablo St., Suite 514, Los Angeles, CA, 90033, USA
| | - Jamil S Samaan
- Department of Medicine, Karsh Division of Gastroenterology and Hepatology, Cedars-Sinai Medical Center, 8700 Beverly Blvd, Los Angeles, CA, 90048, USA
| | - Agnes Premkumar
- Department of General Surgery, Creighton University of Phoenix, 3100 N. Central Ave, Phoenix, AZ, 85012, USA
| | - Erin Yu
- Division of Upper GI and General Surgery, Department of Surgery, Keck School of Medicine, University of Southern California, 1510 San Pablo St., Suite 514, Los Angeles, CA, 90033, USA
| | - Nitin Srinivasan
- Division of Upper GI and General Surgery, Department of Surgery, Keck School of Medicine, University of Southern California, 1510 San Pablo St., Suite 514, Los Angeles, CA, 90033, USA
| | - Kamran Samakar
- Division of Upper GI and General Surgery, Department of Surgery, Keck School of Medicine, University of Southern California, 1510 San Pablo St., Suite 514, Los Angeles, CA, 90033, USA.
| |
Collapse
|
7
|
Moazzam Z, Lima HA, Endo Y, Noria S, Needleman B, Pawlik TM. A Paradigm Shift: Online Artificial Intelligence Platforms as an Informational Resource in Bariatric Surgery. Obes Surg 2023; 33:2611-2614. [PMID: 37322244 DOI: 10.1007/s11695-023-06675-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Revised: 05/25/2023] [Accepted: 06/07/2023] [Indexed: 06/17/2023]
Affiliation(s)
- Zorays Moazzam
- Department of Surgery, The Ohio State University Wexner Medical Center, 395 W. 12th Avenue, Suite 670, OH, 43210, Columbus, USA
| | - Henrique A Lima
- Department of Surgery, The Ohio State University Wexner Medical Center, 395 W. 12th Avenue, Suite 670, OH, 43210, Columbus, USA
| | - Yutaka Endo
- Department of Surgery, The Ohio State University Wexner Medical Center, 395 W. 12th Avenue, Suite 670, OH, 43210, Columbus, USA
| | - Sabrena Noria
- Department of Surgery, The Ohio State University Wexner Medical Center, 395 W. 12th Avenue, Suite 670, OH, 43210, Columbus, USA
| | - Bradley Needleman
- Department of Surgery, The Ohio State University Wexner Medical Center, 395 W. 12th Avenue, Suite 670, OH, 43210, Columbus, USA
| | - Timothy M Pawlik
- Department of Surgery, The Ohio State University Wexner Medical Center, 395 W. 12th Avenue, Suite 670, OH, 43210, Columbus, USA.
| |
Collapse
|
8
|
Gulinac M, Miteva DG, Peshevska-Sekulovska M, Novakov IP, Antovic S, Peruhova M, Snegarova V, Kabakchieva P, Assyov Y, Vasilev G, Sekulovski M, Lazova S, Tomov L, Velikova T. Long-term effectiveness, outcomes and complications of bariatric surgery. World J Clin Cases 2023; 11:4504-4512. [PMID: 37469732 PMCID: PMC10353499 DOI: 10.12998/wjcc.v11.i19.4504] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/01/2023] [Revised: 05/17/2023] [Accepted: 06/06/2023] [Indexed: 06/30/2023] Open
Abstract
Dietary imbalance and overeating can lead to an increasingly widespread disease - obesity. Aesthetic considerations aside, obesity is defined as an excess of adipose tissue that can lead to serious health problems and can predispose to a number of pathological changes and clinical diseases, including diabetes; hypertension; atherosclerosis; coronary artery disease and stroke; obstructive sleep apnea; depression; weight-related arthropathies and endometrial and breast cancer. A body weight 20% above ideal for age, gender and height is a severe health risk. Bariatric surgery is a set of surgical methods to treat morbid obesity when other treatments such as diet, increased physical activity, behavioral changes and drugs have failed. The two most common procedures currently used are sleeve gastrectomy and gastric bypass. This procedure has gained popularity recently and is generally considered safe and effective. Although current data show that perioperative mortality is low and better control of comorbidities and short-term complications is achieved, more randomized trials are needed to evaluate the long-term outcomes of bariatric procedures. This review aims to synthesize and summarize the growing evidence on the long-term effectiveness, outcomes and complications of bariatric surgery.
Collapse
Affiliation(s)
- Milena Gulinac
- Department of General and Clinical Pathology, Medical University of Plovdiv, Plovdiv 4000, Bulgaria
| | - Dimitrina Georgieva Miteva
- Department of Genetics, Sofia University "St. Kliment Ohridski", Faculty of Biology, Sofia 1164, Bulgaria
| | | | - Ivan P Novakov
- Department of Thoraco-abdominal Surgery, Medical University Plovdiv, Plovdiv 6000, Bulgaria
| | - Svetozar Antovic
- University Clinic for Digestive Surgery, Medical Faculty, Skopje, Skopje 1000, North Macedonia
| | - Milena Peruhova
- Department of Gastroenterology, Heart and Brain Hospital, Burgas, Burgas 1000, Bulgaria
| | - Violeta Snegarova
- Clinic of Internal Diseases, Naval Hospital - Varna, Military Medical Academy, Medical Faculty, Medical University, Varna 9000, Bulgaria
| | - Plamena Kabakchieva
- Clinic of Internal Diseases, Naval Hospital - Varna, Military Medical Academy, Varna 9010, Bulgaria
| | - Yavor Assyov
- Clinic of Endocrinology, University Hospital "Alexandrovska, Sofia 1431, Bulgaria
- Department of Internal Diseases, Medical University – Sofia, Sofia 1431, Bulgaria
| | - Georgi Vasilev
- Clinic of Endocrinology and Metabolic Disorders, UMHAT "Sv. Georgi", Plovdiv 4000, Bulgaria
| | - Metodija Sekulovski
- Department of Anesthesiology and Intensive Care, University Hospital Lozenetz, Sofia 1407, Bulgaria
- Medical Faculty, Sofia University, St. Kliment Ohridski, Sofia 1407, Bulgaria
| | - Snezhina Lazova
- Department of Pediatric, University Hospital "N. I. Pirogov", Sofia 1606, Bulgaria
- Department of Healthcare, Faculty of Public Health "Prof. Tsekomir Vodenicharov, MD, DSc", Sofia 1527, Bulgaria
| | - Latchezar Tomov
- Department of Informatics, New Bulgarian University, Sofia 1618, Bulgaria
| | - Tsvetelina Velikova
- Medical Faculty, Sofia University St. Kliment Ohridski, Sofia 1407, Bulgaria
| |
Collapse
|
9
|
Samaan JS, Yeo YH, Rajeev N, Hawley L, Abel S, Ng WH, Srinivasan N, Park J, Burch M, Watson R, Liran O, Samakar K. Assessing the Accuracy of Responses by the Language Model ChatGPT to Questions Regarding Bariatric Surgery. Obes Surg 2023; 33:1790-1796. [PMID: 37106269 PMCID: PMC10234918 DOI: 10.1007/s11695-023-06603-5] [Citation(s) in RCA: 92] [Impact Index Per Article: 92.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Revised: 04/10/2023] [Accepted: 04/17/2023] [Indexed: 04/29/2023]
Abstract
PURPOSE ChatGPT is a large language model trained on a large dataset covering a broad range of topics, including the medical literature. We aim to examine its accuracy and reproducibility in answering patient questions regarding bariatric surgery. MATERIALS AND METHODS Questions were gathered from nationally regarded professional societies and health institutions as well as Facebook support groups. Board-certified bariatric surgeons graded the accuracy and reproducibility of responses. The grading scale included the following: (1) comprehensive, (2) correct but inadequate, (3) some correct and some incorrect, and (4) completely incorrect. Reproducibility was determined by asking the model each question twice and examining difference in grading category between the two responses. RESULTS In total, 151 questions related to bariatric surgery were included. The model provided "comprehensive" responses to 131/151 (86.8%) of questions. When examined by category, the model provided "comprehensive" responses to 93.8% of questions related to "efficacy, eligibility and procedure options"; 93.3% related to "preoperative preparation"; 85.3% related to "recovery, risks, and complications"; 88.2% related to "lifestyle changes"; and 66.7% related to "other". The model provided reproducible answers to 137 (90.7%) of questions. CONCLUSION The large language model ChatGPT often provided accurate and reproducible responses to common questions related to bariatric surgery. ChatGPT may serve as a helpful adjunct information resource for patients regarding bariatric surgery in addition to standard of care provided by licensed healthcare professionals. We encourage future studies to examine how to leverage this disruptive technology to improve patient outcomes and quality of life.
Collapse
Affiliation(s)
- Jamil S Samaan
- Karsh Division of Gastroenterology and Hepatology, Cedars-Sinai Medical Center, 8700 Beverly Blvd, Los Angeles, CA, 90048, USA.
| | - Yee Hui Yeo
- Karsh Division of Gastroenterology and Hepatology, Cedars-Sinai Medical Center, 8700 Beverly Blvd, Los Angeles, CA, 90048, USA
| | - Nithya Rajeev
- Division of Upper GI and General Surgery, Department of Surgery, Health Care Consultation Center, Keck School of Medicine of USC, 1510 San Pablo St. #514, Los Angeles, CA, 90033, USA
| | - Lauren Hawley
- Division of Upper GI and General Surgery, Department of Surgery, Health Care Consultation Center, Keck School of Medicine of USC, 1510 San Pablo St. #514, Los Angeles, CA, 90033, USA
| | - Stuart Abel
- Division of Upper GI and General Surgery, Department of Surgery, Health Care Consultation Center, Keck School of Medicine of USC, 1510 San Pablo St. #514, Los Angeles, CA, 90033, USA
| | - Wee Han Ng
- Bristol Medical School, University of Bristol, 5 Tyndall Ave, Bristol, BS8 1UD, UK
| | - Nitin Srinivasan
- Division of Upper GI and General Surgery, Department of Surgery, Health Care Consultation Center, Keck School of Medicine of USC, 1510 San Pablo St. #514, Los Angeles, CA, 90033, USA
| | - Justin Park
- Division of Upper GI and General Surgery, Department of Surgery, Health Care Consultation Center, Keck School of Medicine of USC, 1510 San Pablo St. #514, Los Angeles, CA, 90033, USA
| | - Miguel Burch
- Department of Surgery, Cedars-Sinai Medical Center, 8700 Beverly Blvd, Los Angeles, CA, 90048, USA
| | - Rabindra Watson
- Karsh Division of Gastroenterology and Hepatology, Cedars-Sinai Medical Center, 8700 Beverly Blvd, Los Angeles, CA, 90048, USA
| | - Omer Liran
- Department of Psychiatry and Behavioral Sciences, Cedars-Sinai Medical Center, 8700 Beverly Blvd, Los Angeles, CA, 90048, USA
- Division of Health Services Research, Department of Medicine, Cedars-Sinai Medical Center, 8700 Beverly Blvd, Los Angeles, CA, 90048, USA
| | - Kamran Samakar
- Division of Upper GI and General Surgery, Department of Surgery, Health Care Consultation Center, Keck School of Medicine of USC, 1510 San Pablo St. #514, Los Angeles, CA, 90033, USA
| |
Collapse
|