1
|
Gencer A. Readability analysis of ChatGPT's responses on lung cancer. Sci Rep 2024; 14:17234. [PMID: 39060365 PMCID: PMC11282056 DOI: 10.1038/s41598-024-67293-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2024] [Accepted: 07/09/2024] [Indexed: 07/28/2024] Open
Abstract
For common diseases such as lung cancer, patients often use the internet to obtain medical information. As a result of advances in artificial intelligence and large language models such as ChatGPT, patients and health professionals use these tools to obtain medical information. The aim of this study was to evaluate the readability of ChatGPT-generated responses with different readability scales in the context of lung cancer. The most common questions in the lung cancer section of Medscape® were reviewed, and questions on the definition, etiology, risk factors, diagnosis, treatment, and prognosis of lung cancer (both NSCLC and SCLC) were selected. A set of 80 questions were asked 10 times to ChatGPT via the OpenAI API. ChatGPT's responses were tested using various readability formulas. The mean Flesch Reading Ease, Flesch-Kincaid Grade Level, Gunning FOG Scale, SMOG Index, Automated Readability Index, Coleman-Liau Index, Linsear Write Formula, Dale-Chall Readability Score, and Spache Readability Formula scores are at a moderate level (mean and standard deviation: 40.52 ± 9.81, 12.56 ± 1.66, 13.63 ± 1.54, 14.61 ± 1.45, 15.04 ± 1.97, 14.24 ± 1.90, 11.96 ± 2.55, 10.03 ± 0.63 and 5.93 ± 0.50, respectively). The readability levels of the answers generated by ChatGPT are "collage" and above and are difficult to read. Perhaps in the near future, the ChatGPT can be programmed to produce responses that are appropriate for people of different educational and age groups.
Collapse
Affiliation(s)
- Adem Gencer
- Department of Thoracic Surgery, Faculty of Medicine, Afyonkarahisar Health Sciences University, Zafer Sağlık Külliyesi, Dörtyol Mah. 2078 Sok. No:3 A Blok Afyonkarahisar, Afyonkarahisar, Turkey.
| |
Collapse
|
2
|
Berhanu D, Leal Rato M, Canhoto AI, Vieira da Cunha J, Geraldes R. Online information search by people with Multiple Sclerosis: A systematic review. Mult Scler Relat Disord 2023; 79:105032. [PMID: 37801957 DOI: 10.1016/j.msard.2023.105032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2023] [Revised: 09/15/2023] [Accepted: 09/24/2023] [Indexed: 10/08/2023]
Abstract
BACKGROUND People with Multiple Sclerosis (pwMS) search for information online about various aspects of living with their disease, but details about patterns of searching and outcomes are unclear. This means that opportunities to leverage online resources to support pwMS, and to enhance shared decision making, may be missed. We aimed to do a systematic review of the literature on digital information searching by pwMS. METHODS We performed a systematic search for studies assessing online information seeking of pwMS in MEDLINE and JSTOR databases. Studies were screened and selected by two investigators. All study designs were included, risk of bias was assessed using the Critical Appraisal Skills Programme qualitative checklist. Reports were assessed for the proportion of patients searching information online about MS, type of information sought, online tools used by patients, perceived quality of the information acquired, and impact of online searching in pwMS. RESULTS We identified 5 studies, including 10,090 patients. Most pwMS search for information online (53.8-82 %), which they rarely discuss with physicians. The most common topics are treatment, general disease information, symptoms, lifestyle recommendations, prognosis, and coping strategies. Patients that are younger, have a shorter disease duration, primary progressive MS, and during periods of disease worsening, are more likely to use online resources. Online information is perceived as low quality by pwMS. CONCLUSIONS Online information search is prevalent among pwMS. Despite concerns with the quality of the available information, only a minority of pwMS will discuss the information found with their physician. These findings highlight the importance of developing and providing quality online information resources for pwMS.
Collapse
Affiliation(s)
- David Berhanu
- Multiple Sclerosis Clinical Trials Unit, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK; Faculdade de Medicina, Universidade de Lisboa, Lisboa, Portugal; Universidade Católica Portuguesa, Portugal; Serviço de Imagiologia Neurológica, Centro Hospitalar Universitário Lisboa Norte, Lisboa, Portugal
| | - Miguel Leal Rato
- Multiple Sclerosis Clinical Trials Unit, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK; Faculdade de Medicina, Universidade de Lisboa, Lisboa, Portugal; Serviço de Neurologia, Departamento de Neurociências e Saúde Mental, Hospital Santa Maria, Centro Hospitalar Universitário Lisboa Norte, Lisboa, Portugal
| | | | | | - Ruth Geraldes
- Multiple Sclerosis Clinical Trials Unit, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK; Department of Neurology, Frimley Health NHS Foundation Trust, Frimley, Surrey, UK; Department of Clinical Neurology, Oxford University Hospitals Trust, John Radcliffe Hospital, Oxford, Oxfordshire, UK.
| |
Collapse
|
3
|
Investigation on the Effect of Graded Emergency Nursing Group under the Assistance of Multidisciplinary First Aid Knowledge Internet-Based Approach on the First Aid of Acute Myocardial Infarction. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:8469930. [PMID: 35087651 PMCID: PMC8789469 DOI: 10.1155/2022/8469930] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/29/2021] [Revised: 12/16/2021] [Accepted: 12/27/2021] [Indexed: 02/07/2023]
Abstract
OBJECTIVE To analyze the effect of a graded emergency nursing group under the assistance of multidisciplinary first aid knowledge Internet-based approach on the first aid of acute myocardial infarction (AMI). METHODS The clinical data of 90 AMI patients treated in our hospital from March 2019 to March 2020 were selected for the retrospective analysis, and the patients were divided into the observation group and the routine group according to the first aid order, with 45 cases each. The patients in the routine group received the conventional first aid measures, and the graded emergency nursing group mode with the help of multidisciplinary first aid knowledge Internet-based approach was adopted for those in the observation group so as to compare the prognosis, nursing satisfaction scores, etc., between the two groups. RESULTS Compared with the routine group, patients in the observation group obtained significantly lower various fast reaction indicators and quality of life score (P < 0.001), higher nursing satisfaction score (P < 0.001), lower total complication rate (P < 0.05), higher successful rescue rate (P < 0.05), and lower AMI recurrence rate and PCI reuse rate (P < 0.05). CONCLUSION Rescue measures by the graded emergency nursing group with the help of multidisciplinary first aid knowledge Internet-based approach are a reliable method for improving AMI patients, and such strategy greatly promotes patients' quality of life and reduces the PCI reuse rate. Further research will be conducive to establishing a better solution for AMI patients.
Collapse
|
4
|
Van Hecke W, Costers L, Descamps A, Ribbens A, Nagels G, Smeets D, Sima DM. A Novel Digital Care Management Platform to Monitor Clinical and Subclinical Disease Activity in Multiple Sclerosis. Brain Sci 2021; 11:brainsci11091171. [PMID: 34573193 PMCID: PMC8469941 DOI: 10.3390/brainsci11091171] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2021] [Revised: 08/30/2021] [Accepted: 09/01/2021] [Indexed: 11/27/2022] Open
Abstract
In multiple sclerosis (MS), the early detection of disease activity or progression is key to inform treatment changes and could be supported by digital tools. We present a novel CE-marked and FDA-cleared digital care management platform consisting of (1) a patient phone/web application and healthcare professional portal (icompanion) including validated symptom, disability, cognition, and fatigue patient-reported outcomes; and (2) clinical brain magnetic resonance imaging (MRI) quantifications (icobrain ms). We validate both tools using their ability to detect (sub)clinical disease activity (known-groups validity) and real-world data insights. Surveys showed that 95.6% of people with MS (PwMS) were interested in using an MS app, and 98.2% were interested in knowing about MRI changes. The icompanion measures of disability (p < 0.001) and symptoms (p = 0.005) and icobrain ms MRI parameters were sensitive to (sub)clinical differences between MS subtypes. icobrain ms also decreased intra- and inter-rater lesion count variability and increased sensitivity for detecting disease activity/progression from 24% to 76% compared to standard radiological reading. This evidence shows PwMS’ interest, the digital care platform’s potential to improve the detection of (sub)clinical disease activity and care management, and the feasibility of linking different digital tools into one overarching MS care pathway.
Collapse
Affiliation(s)
- Wim Van Hecke
- icometrix, 3012 Leuven, Belgium; (L.C.); (A.D.); (A.R.); (G.N.); (D.S.); (D.M.S.)
- AI Supported Modelling in Clinical Sciences (AIMS), Vrije Universiteit Brussel, 1050 Brussels, Belgium
- Correspondence:
| | - Lars Costers
- icometrix, 3012 Leuven, Belgium; (L.C.); (A.D.); (A.R.); (G.N.); (D.S.); (D.M.S.)
- AI Supported Modelling in Clinical Sciences (AIMS), Vrije Universiteit Brussel, 1050 Brussels, Belgium
| | - Annabel Descamps
- icometrix, 3012 Leuven, Belgium; (L.C.); (A.D.); (A.R.); (G.N.); (D.S.); (D.M.S.)
| | - Annemie Ribbens
- icometrix, 3012 Leuven, Belgium; (L.C.); (A.D.); (A.R.); (G.N.); (D.S.); (D.M.S.)
| | - Guy Nagels
- icometrix, 3012 Leuven, Belgium; (L.C.); (A.D.); (A.R.); (G.N.); (D.S.); (D.M.S.)
- AI Supported Modelling in Clinical Sciences (AIMS), Vrije Universiteit Brussel, 1050 Brussels, Belgium
- Department of Engineering, University of Oxford, Oxford OX1 3PJ, UK
| | - Dirk Smeets
- icometrix, 3012 Leuven, Belgium; (L.C.); (A.D.); (A.R.); (G.N.); (D.S.); (D.M.S.)
- AI Supported Modelling in Clinical Sciences (AIMS), Vrije Universiteit Brussel, 1050 Brussels, Belgium
| | - Diana M. Sima
- icometrix, 3012 Leuven, Belgium; (L.C.); (A.D.); (A.R.); (G.N.); (D.S.); (D.M.S.)
- AI Supported Modelling in Clinical Sciences (AIMS), Vrije Universiteit Brussel, 1050 Brussels, Belgium
| |
Collapse
|
5
|
Haase R, Voigt I, Scholz M, Schlieter H, Benedict M, Susky M, Dillenseger A, Ziemssen T. Profiles of eHealth Adoption in Persons with Multiple Sclerosis and Their Caregivers. Brain Sci 2021; 11:brainsci11081087. [PMID: 34439706 PMCID: PMC8392753 DOI: 10.3390/brainsci11081087] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2021] [Revised: 08/07/2021] [Accepted: 08/16/2021] [Indexed: 01/03/2023] Open
Abstract
(1) Background: Persons with multiple sclerosis (pwMS) are often characterized as ideal adopters of new digital healthcare trends, but it is worth thinking about whether and which pwMS will be targeted and served by a particular eHealth service like a patient portal. With our study, we wanted to explore needs and barriers for subgroups of pwMS and their caregivers when interacting with eHealth services in care and daily living. (2) Methods: This study comprises results from two surveys: one collecting data from pwMS and their relatives (as informal caregivers) and another one providing information on the opinions and attitudes of healthcare professionals (HCPs). Data were analyzed descriptively and via generalized linear models. (3) Results: 185 pwMS, 25 informal caregivers, and 24 HCPs in the field of MS participated. Nine out of ten pwMS used information technology on a daily base. Individual impairments like in vision and cognition resulted in individual needs like the desire to actively monitor their disease course or communicate with their physician in person. HCPs reported that a complete medication overview, additional medication information, overview of future visits and a reminder of medication intake would be very helpful eHealth features for pwMS, while they themselves preferred features organizing and enriching future visits. (4) Conclusions: A closer look at the various profiles of eHealth adoption in pwMS and their caregivers indicated that there is a broad and robust enthusiasm across several subgroups that does not exclude anyone in general, but constitutes specific areas of interest. For pwMS, the focus was on eHealth services that connect previously collected information and make them easily accessible and understandable.
Collapse
Affiliation(s)
- Rocco Haase
- Center of Clinical Neuroscience, Department of Neurology, University Hospital Carl Gustav Carus, Technical University of Dresden, 01307 Dresden, Germany; (I.V.); (M.S.); (A.D.); (T.Z.)
- Correspondence:
| | - Isabel Voigt
- Center of Clinical Neuroscience, Department of Neurology, University Hospital Carl Gustav Carus, Technical University of Dresden, 01307 Dresden, Germany; (I.V.); (M.S.); (A.D.); (T.Z.)
| | - Maria Scholz
- Center of Clinical Neuroscience, Department of Neurology, University Hospital Carl Gustav Carus, Technical University of Dresden, 01307 Dresden, Germany; (I.V.); (M.S.); (A.D.); (T.Z.)
| | - Hannes Schlieter
- Faculty of Business and Economics, Technical University of Dresden, 01062 Dresden, Germany; (H.S.); (M.B.); (M.S.)
| | - Martin Benedict
- Faculty of Business and Economics, Technical University of Dresden, 01062 Dresden, Germany; (H.S.); (M.B.); (M.S.)
| | - Marcel Susky
- Faculty of Business and Economics, Technical University of Dresden, 01062 Dresden, Germany; (H.S.); (M.B.); (M.S.)
| | - Anja Dillenseger
- Center of Clinical Neuroscience, Department of Neurology, University Hospital Carl Gustav Carus, Technical University of Dresden, 01307 Dresden, Germany; (I.V.); (M.S.); (A.D.); (T.Z.)
| | - Tjalf Ziemssen
- Center of Clinical Neuroscience, Department of Neurology, University Hospital Carl Gustav Carus, Technical University of Dresden, 01307 Dresden, Germany; (I.V.); (M.S.); (A.D.); (T.Z.)
| |
Collapse
|