1
|
Rodler S, Maruccia S, Abreu A, Murphy D, Canes D, Loeb S, Malik RD, Bagrodia A, Cacciamani GE. Readability Assessment of Patient Education Materials on Uro-oncological Diseases Using Automated Measures. Eur Urol Focus 2024:S2405-4569(24)00117-2. [PMID: 39048402 DOI: 10.1016/j.euf.2024.06.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2024] [Revised: 05/28/2024] [Accepted: 06/27/2024] [Indexed: 07/27/2024]
Abstract
BACKGROUND AND OBJECTIVE Readability of patient education materials is of utmost importance to ensure understandability and dissemination of health care information in uro-oncology. We aimed to investigate the readability of the official patient education materials of the European Association of Urology (EAU) and American Urology Association (AUA). METHODS Patient education materials for prostate, bladder, kidney, testicular, penile, and urethral cancers were retrieved from the respective organizations. Readability was assessed via the WebFX online tool for Flesch Kincaid Reading Ease Score (FRES) and for reading grade levels by Flesch Kincaid Grade Level (FKGL), Gunning Fog Score (GFS), Smog Index (SI), Coleman Liau Index (CLI), and Automated Readability Index (ARI). Layperson readability was defined as a FRES of ≥70 and with the other readability indexes <7 according to European Union recommendations. This study assessed only objective readability and no other metrics such as understandability. KEY FINDINGS AND LIMITATIONS Most patient education materials failed to meet the recommended threshold for laypersons. The mean readability for EAU patient education material was as follows: FRES 50.9 (standard error [SE]: 3.0), and FKGL, GFS, SI, CLI, and ARI all with scores ≥7. The mean readability for AUA patient material was as follows: FRES 64.0 (SE: 1.4), with all of FKGL, GFS, SI, and ARI scoring ≥7 readability. Only 13 out of 70 (18.6%) patient education materials' paragraphs met the readability requirements. The mean readability for bladder cancer patient education materials was the lowest, with a FRES of 36.7 (SE: 4.1). CONCLUSIONS AND CLINICAL IMPLICATIONS Patient education materials from leading urological associations reveal readability levels beyond the recommended thresholds for laypersons and may not be understood easily by patients. There is a future need for more patient-friendly reading materials. PATIENT SUMMARY This study checked whether health information about different cancers was easy to read. Most of it was too hard for patients to understand.
Collapse
Affiliation(s)
- Severin Rodler
- USC Institute of Urology and Catherine and Joseph Aresty Department of Urology, Keck School of Medicine, University of Southern California, Los Angeles, CA, USA; Artificial Intelligence Center at USC Urology, USC Institute of Urology, University of Southern California, Los Angeles, CA, USA; Department of Urology, University Hospital of LMU Munich, Munich, Germany
| | - Serena Maruccia
- Department of Urology, ASST Santi Paolo e Carlo, San Paolo Hospital, Milano, Italy
| | - Andre Abreu
- USC Institute of Urology and Catherine and Joseph Aresty Department of Urology, Keck School of Medicine, University of Southern California, Los Angeles, CA, USA; Artificial Intelligence Center at USC Urology, USC Institute of Urology, University of Southern California, Los Angeles, CA, USA
| | - Declan Murphy
- Sir Peter MacCallum Department of Oncology, Peter MacCallum Cancer Centre, Melbourne, Victoria, Australia
| | - David Canes
- Division of Urology, Lahey Hospital & Medical Center, Burlington, MA, USA
| | - Stacy Loeb
- Department of Urology and Population Health, New York University and Manhattan Veterans Affairs, New York, NY, USA
| | - Rena D Malik
- Division of Urology, Long Beach VA Hospital in Long Beach, CA, USA
| | - Aditya Bagrodia
- Department of Urology, University of California-San Diego School of Medicine, La Jolla, CA, USA; Department of Urology, University of Texas Southwestern Medical Center, Dallas, TX, USA
| | - Giovanni E Cacciamani
- USC Institute of Urology and Catherine and Joseph Aresty Department of Urology, Keck School of Medicine, University of Southern California, Los Angeles, CA, USA; Artificial Intelligence Center at USC Urology, USC Institute of Urology, University of Southern California, Los Angeles, CA, USA.
| |
Collapse
|
2
|
Ocmen E, Erdemir I, Aksu Erdost H, Hanci V. Assessing parental comprehension of online resources on childhood pain. Medicine (Baltimore) 2024; 103:e38569. [PMID: 38905405 PMCID: PMC11191864 DOI: 10.1097/md.0000000000038569] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/04/2024] [Accepted: 05/23/2024] [Indexed: 06/23/2024] Open
Abstract
We aimed to examine the patient education materials (PEMs) on the internet about "Child Pain" in terms of readability, reliability, quality and content. For our observational study, a search was made on February 28, 2024, using the keywords "Child Pain," "Pediatric Pain," and "Children Pain" in the Google search engine. The readability of PEMs was assessed using computer-based readability formulas (Flesch Reading Ease Score [FRES], Flesch-Kincaid Grade Level [FKGL], Automated readability index (ARI), Gunning Fog [GFOG], Coleman-Liau score [CL], Linsear Write [LW], Simple Measure of Gobbledygook [SMOG]). The reliability and quality of websites were determined using the Journal of American Medical Association (JAMA) score, Global Quality Score (GQS), and DISCERN score. 96 PEM websites included in our study. We determined that the FRES was 64 (32-84), the FKGL was 8.24 (4.01-15.19), ARI was 8.95 (4.67-17.38), GFOG was 11 (7.1-19.2), CL was 10.1 (6.95-15.64), LW was 8.08 (3.94-19.0) and SMOG was 8.1 (4.98-13.93). The scores of readability formulas showed that, the readability level of PEMs was statistically higher than sixth-grade level with all formulas (P = .011 for FRES, P < .001 for GFOG, P < .001 for ARI, P < .001 for FKGL, P < .001 for CL and P < .001 for SMOG), except LW formula (P = .112). The websites had moderate-to-low reliability and quality. Health-related websites had the highest quality with JAMA score. We found a weak negative correlation between Blexb score and JAMA score (P = .013). Compared to the sixth-grade level recommended by the American Medical Association and the National Institutes of Health, the readability grade level of child pain-related internet-based PEMs is quite high. On the other hand, the reliability and quality of PEMs were determined as moderate-to-low. The low readability and quality of PEMs could cause an anxious parent and unnecessary hospital admissions. PEMs on issues threatening public health should be prepared with attention to the recommendations on readability.
Collapse
Affiliation(s)
- Elvan Ocmen
- Dokuz Eylul University Medical Faculty, Department of Anesthesiology and Reanimation, Balcova, Izmir, Turkey
| | - Ismail Erdemir
- Dokuz Eylul University Medical Faculty, Department of Anesthesiology and Reanimation, Balcova, Izmir, Turkey
| | - Hale Aksu Erdost
- Dokuz Eylul University Medical Faculty, Department of Anesthesiology and Reanimation, Balcova, Izmir, Turkey
| | - Volkan Hanci
- Sincan Training Hospital Department of Anesthesiology and Reanimation, Balcova, Izmir, Turkey
| |
Collapse
|
3
|
van Leeuwen GL, Kooijman MA, Schuurmann RCL, van Leeuwen BL, van Munster BC, van der Wal-Huisman H, de Vries JPPM. Health Literacy and Disease Knowledge of Patients With Peripheral Arterial Disease or Abdominal Aortic Aneurysm: A Scoping Review. Eur J Vasc Endovasc Surg 2024; 67:935-947. [PMID: 38552837 DOI: 10.1016/j.ejvs.2024.03.040] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Revised: 03/01/2024] [Accepted: 03/25/2024] [Indexed: 04/29/2024]
Abstract
OBJECTIVE This scoping review summarises health literacy and disease knowledge in patients with abdominal aortic aneurysm (AAA) or peripheral arterial disease (PAD) and the influencing factors. DATA SOURCES A systematic search was conducted in PubMed, Embase, PsychINFO, and CINAHL covering the period January 2012 to October 2022. REVIEW METHODS This scoping review was undertaken in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR). Inclusion criteria encompassed studies addressing health literacy, knowledge, perception, or awareness in patients with AAA or PAD. Two authors independently reviewed abstracts and full texts, resolving any discrepancies through discussion or by consulting a third author for consensus. All article types were included except letters, editorials, study protocols, reviews, and guidelines. No language restrictions were applied. Primary outcomes were health literacy and disease knowledge. Secondary outcomes were factors that could influence this. Quality assessment was done using the Mixed Methods Appraisal Tool (MMAT). RESULTS The review included 32 articles involving a total of 5 268 patients. Four articles reported health literacy and the rest disease knowledge. Ten studies (31%) met all quality criteria. Twenty studies were quantitative, eight were qualitative, and four were mixed methods studies. The review revealed inadequate health literacy in the majority of patients, and disease knowledge was relatively low among patients with AAA and PAD, with disparities in measures and assessment tools across studies. Factors influencing health literacy and disease knowledge included socioeconomic status, education, income, and employment. CONCLUSION This scoping review revealed low health literacy and low disease knowledge in patients with AAA and PAD. Standardised health literacy assessment may contribute to improve communication strategies and decision aids to enhance patients' understanding and engagement in healthcare decisions, however further research is needed to prove its merits.
Collapse
Affiliation(s)
- Goudje L van Leeuwen
- Department of Surgery, Division of Vascular Surgery, University Medical Centre Groningen, Groningen, the Netherlands.
| | - Maria-Annette Kooijman
- Department of Surgery, Division of Vascular Surgery, University Medical Centre Groningen, Groningen, the Netherlands
| | - Richte C L Schuurmann
- Department of Surgery, Division of Vascular Surgery, University Medical Centre Groningen, Groningen, the Netherlands
| | - Barbara L van Leeuwen
- Department of Surgery, Division of Vascular Surgery, University Medical Centre Groningen, Groningen, the Netherlands
| | - Barbara C van Munster
- Department of Geriatric Medicine, University Medical Centre Groningen, Groningen, the Netherlands
| | - Hanneke van der Wal-Huisman
- Department of Surgery, Division of Vascular Surgery, University Medical Centre Groningen, Groningen, the Netherlands
| | - Jean-Paul P M de Vries
- Department of Surgery, Division of Vascular Surgery, University Medical Centre Groningen, Groningen, the Netherlands
| |
Collapse
|
4
|
Budge J, Lenti L, Azhar B, Roy I, Loftus I, Holt P. Quality Assessment of Elective Abdominal Aortic Aneurysm Repair Patient Information on the Internet Using the Modified Ensuring Quality Information for Patients Tool. Eur J Vasc Endovasc Surg 2024; 67:738-745. [PMID: 38185375 DOI: 10.1016/j.ejvs.2024.01.013] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Revised: 12/07/2023] [Accepted: 01/04/2024] [Indexed: 01/09/2024]
Abstract
OBJECTIVE This study aimed to assess the quality of patient information material regarding elective abdominal aortic aneurysm (AAA) repair on the internet using the Modified Ensuring Quality Information for Patients (MEQIP) tool. METHODS A qualitative assessment of internet based patient information was performed. The 12 most used search terms relating to AAA repair were identified using Google Trends, with the first 10 pages of websites retrieved for each term searched. Duplicates were removed, and information for patients undergoing elective AAA were selected. Further exclusion criteria were marketing material, academic journals, videos, and non-English language sites. The remaining websites were then MEQIP scored independently by two reviewers, producing a final score by consensus. RESULTS A total of 1 297 websites were identified, with 235 (18.1%) eligible for analysis. The median MEQIP score was 18 (interquartile range [IQR] 14, 21) out of a possible 36. The highest score was 33. The 99th percentile MEQIP scoring websites scored > 27, with four of these six sites representing online copies of hospital patient information leaflets, however hospital sites overall had lower median MEQIP scores than most other institution types. MEQIP subdomain median scores were: content, 8 (IQR 6, 11); identification, 3 (IQR 1, 3); and structure, 7 (IQR 6, 9). Of the analysed websites, 77.9% originated from the USA (median score 17) and 12.8% originated in the UK (median score 22). Search engine ranking was related to website institution type but had no correlation with MEQIP. CONCLUSION When assessed by the MEQIP tool, most websites regarding elective AAA repair are of questionable quality. This is in keeping with studies in other surgical and medical fields. Search engine ranking is not a reliable measure of quality of patient information material regarding elective AAA repair. Health practitioners should be aware of this issue as well as the whereabouts of high quality material to which patients can be directed.
Collapse
Affiliation(s)
- James Budge
- St George's Vascular Institute, St George's University Hospitals NHS Foundation Trust, London, UK; and St George's University of London, London, UK.
| | - Lorenzo Lenti
- St George's Vascular Institute, St George's University Hospitals NHS Foundation Trust, London, UK; and St George's University of London, London, UK
| | - Bilal Azhar
- St George's Vascular Institute, St George's University Hospitals NHS Foundation Trust, London, UK; and St George's University of London, London, UK
| | - Iain Roy
- St George's Vascular Institute, St George's University Hospitals NHS Foundation Trust, London, UK; and St George's University of London, London, UK
| | - Ian Loftus
- St George's Vascular Institute, St George's University Hospitals NHS Foundation Trust, London, UK; and St George's University of London, London, UK
| | - Peter Holt
- St George's Vascular Institute, St George's University Hospitals NHS Foundation Trust, London, UK; and St George's University of London, London, UK
| |
Collapse
|
5
|
Wanhainen A, Van Herzeele I, Bastos Goncalves F, Bellmunt Montoya S, Berard X, Boyle JR, D'Oria M, Prendes CF, Karkos CD, Kazimierczak A, Koelemay MJW, Kölbel T, Mani K, Melissano G, Powell JT, Trimarchi S, Tsilimparis N, Antoniou GA, Björck M, Coscas R, Dias NV, Kolh P, Lepidi S, Mees BME, Resch TA, Ricco JB, Tulamo R, Twine CP, Branzan D, Cheng SWK, Dalman RL, Dick F, Golledge J, Haulon S, van Herwaarden JA, Ilic NS, Jawien A, Mastracci TM, Oderich GS, Verzini F, Yeung KK. Editor's Choice -- European Society for Vascular Surgery (ESVS) 2024 Clinical Practice Guidelines on the Management of Abdominal Aorto-Iliac Artery Aneurysms. Eur J Vasc Endovasc Surg 2024; 67:192-331. [PMID: 38307694 DOI: 10.1016/j.ejvs.2023.11.002] [Citation(s) in RCA: 49] [Impact Index Per Article: 49.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Accepted: 09/20/2023] [Indexed: 02/04/2024]
Abstract
OBJECTIVE The European Society for Vascular Surgery (ESVS) has developed clinical practice guidelines for the care of patients with aneurysms of the abdominal aorta and iliac arteries in succession to the 2011 and 2019 versions, with the aim of assisting physicians and patients in selecting the best management strategy. METHODS The guideline is based on scientific evidence completed with expert opinion on the matter. By summarising and evaluating the best available evidence, recommendations for the evaluation and treatment of patients have been formulated. The recommendations are graded according to a modified European Society of Cardiology grading system, where the strength (class) of each recommendation is graded from I to III and the letters A to C mark the level of evidence. RESULTS A total of 160 recommendations have been issued on the following topics: Service standards, including surgical volume and training; Epidemiology, diagnosis, and screening; Management of patients with small abdominal aortic aneurysm (AAA), including surveillance, cardiovascular risk reduction, and indication for repair; Elective AAA repair, including operative risk assessment, open and endovascular repair, and early complications; Ruptured and symptomatic AAA, including peri-operative management, such as permissive hypotension and use of aortic occlusion balloon, open and endovascular repair, and early complications, such as abdominal compartment syndrome and colonic ischaemia; Long term outcome and follow up after AAA repair, including graft infection, endoleaks and follow up routines; Management of complex AAA, including open and endovascular repair; Management of iliac artery aneurysm, including indication for repair and open and endovascular repair; and Miscellaneous aortic problems, including mycotic, inflammatory, and saccular aortic aneurysm. In addition, Shared decision making is being addressed, with supporting information for patients, and Unresolved issues are discussed. CONCLUSION The ESVS Clinical Practice Guidelines provide the most comprehensive, up to date, and unbiased advice to clinicians and patients on the management of abdominal aorto-iliac artery aneurysms.
Collapse
|
6
|
Lecouturier J, Stansby G, Thomson RG. Information provision and decision-making in the treatment of abdominal aortic aneurysm: A qualitative study of patient experience. PLoS One 2023; 18:e0293354. [PMID: 37871042 PMCID: PMC10593210 DOI: 10.1371/journal.pone.0293354] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2023] [Accepted: 10/11/2023] [Indexed: 10/25/2023] Open
Abstract
INTRODUCTION Shared decision making (SDM) refers to patients and health care professionals working together to reach a decision about treatment/care. In abdominal aortic aneurysm (AAA) treatment options are influenced by patients' clinical characteristics, their preferences, and potential trade-offs between alternative interventions. This is a prime example of where SDM is essential to ensure the right decision is made for the right patient, yet we have little understanding of what happens in practice. This study explored patient experiences to understand SDM practice in AAA surgery. METHODS We used a qualitative approach to describe, and identify improvements to, current treatment decision making in abdominal aortic aneurysm (AAA) surgery. Two groups of patients were interviewed: those at the point of discussing treatment options (with corresponding digitally recorded consultation data) and following surgical intervention from one hospital. Framework analysis was used. RESULTS Fifteen patients were interviewed, seven at the point of discussing treatment options and eight following surgical intervention. Timing, format and sources of information, verbal framing of interventions and level of patient engagement were key themes. Four areas for improvement were identified: earlier provision and more detailed written information along with signposting to quality on-line information; both intervention options, risks, benefits, and consequences, were not always discussed; some clinicians were somewhat directive in the decision-making process; and patients' treatment values/preferences were not explored-the only example was in one of the eight recorded consultations. Patients could feel overwhelmed by the information and decision and fearful of the impending surgery. CONCLUSIONS More emphasis should be placed on the provision of full information and the exploration of patient values and preferences for treatment. Clinician training and support for patients, including decision aids, could facilitate the decision-making process. Providing written information earlier and guidance on reliable on-line resources would benefits patients and their families.
Collapse
Affiliation(s)
- Jan Lecouturier
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Gerry Stansby
- Northern Vascular Centre, Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, United Kingdom
- School of Surgical and Reproductive Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Richard G. Thomson
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, United Kingdom
| |
Collapse
|
7
|
Machin M, Van Herzeele I, Ubbink D, Powell JT. Shared Decision Making and the Management of Intact Abdominal Aortic Aneurysm: A Scoping Review of the Literature. Eur J Vasc Endovasc Surg 2023; 65:839-849. [PMID: 36720426 DOI: 10.1016/j.ejvs.2023.01.036] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Revised: 10/19/2022] [Accepted: 01/23/2023] [Indexed: 01/30/2023]
Abstract
OBJECTIVE The aim of this study was to summarise the current knowledge of shared decision making (SDM) in patients facing a treatment decision about an intact abdominal aortic aneurysm (AAA), and to identify where further evidence is needed. DATA SOURCES MEDLINE, Embase, and the Cochrane Library were searched on 18 July 2021. An updated search was run on 31 May 2022 for relevant studies published from 1 January 2000 to 31 May 2022. REVIEW METHODS This scoping review was undertaken in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines following a pre-defined protocol, retrieving studies reporting on aspects of SDM in those with intact AAAs. Qualitative synthesis of the articles was performed, and the results grouped according to theme. RESULTS Fifteen articles reporting on a total of 1 344 participants (age range 62-74 years) from hospital vascular surgery clinics with intact AAAs were included. Studies were observational (n = 9), non-randomised studies of an intervention (n = 3), and randomised clinical trials (n = 3). The first theme was the preferences and practice of SDM. The proportion of patients preferring SDM ranged from 58% to 95% (three studies), although objective rating of SDM practice was consistently < 50% (three studies). Clinician training improved SDM practice. The second theme was poor provision of information. Fewer than half of patients (0 - 46%) surveyed were informed about all available treatment options (three studies). Publicly available information sources were rated as poor. The third theme concerned the utility of decision making support tools (DSTs). Two randomised trials demonstrated that the provision of DSTs improves patient knowledge and agreement between patient preference and repair type received but not objective measures of SDM for patients with AAAs. CONCLUSION SDM for patients with an intact AAA appears to be in its infancy. Most patients with an AAA want SDM, but this is not commonly applied. Most patients with an AAA do not receive adequate information for SDM, although the use of bespoke DSTs leaves patients better informed to facilitate SDM.
Collapse
Affiliation(s)
- Matthew Machin
- Department of Surgery and Cancer, Imperial College London, London, UK.
| | - Isabelle Van Herzeele
- Department of Thoracic and Vascular Surgery, Ghent University Hospital, Ghent, Belgium
| | - Dirk Ubbink
- Amsterdam University Medical Centres, location University of Amsterdam, Department of Surgery, Amsterdam, the Netherlands
| | - Janet T Powell
- Department of Surgery and Cancer, Imperial College London, London, UK
| |
Collapse
|
8
|
Çiftci S, Şahin E, Aktaş SA, Safali S, Durgut F, Aydin BK. How understandable are the patient education materials about flat foot on the Internet for parents? Medicine (Baltimore) 2023; 102:e32791. [PMID: 36820566 PMCID: PMC9907911 DOI: 10.1097/md.0000000000032791] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/12/2023] Open
Abstract
Flat foot is a common reason for parents to visit orthopedic clinics. As the Internet has become an easy-search platform, parents often seek online educational materials before seeking out a professional. The aim of this study was to investigate the quality, readability, and understandability of such online materials for parents. An Internet search was performed for "flat foot" and "pes planus" using the Google search engine. The readability was evaluated using 6 different grading systems: Flesch Reading Ease Score, Flesch-Kincaid Grade Level, Simple Measure of Gobbledygook, Fry Readability score, Gunning Fog Index tests, and Automated Readability Index. The Patient Education Materials Assessment Tool test was used to assess the understandability. For quality assessment, the Journal of American Medical Association benchmark criteria and Health on the Net code were applied. One hundred nine websites were included and evaluated for readability, understandability, and quality. The mean readability grade for all websites was 10.5 ± 2.0. The mean Gunning Fog Index tests and Flesch-Kincaid Grade Level scores for all websites were 12.4 ± 2.2 and 9.7 ± 2.1 sequentially. The mean Coleman-Liau index score was 10.0 ± 1.5, and the average Fry Readability score was 9.9 ± 2.0. The automated readability index for all websites was 10.3 ± 2.5. The average Flesch Reading Ease score for all educational materials was 59.3 ± 10.1. The average Patient Education Materials Assessment Tool score for all educational materials was 81% (range, 70-87%). The mean Journal of American Medical Association benchmark criterion for all websites was 1.0, with a range from 1.0 and 2.0. Eighteen (16.5%) websites had Health on the Net certificates. Readability, understandability, and quality of patient education materials about flat feet on the Internet vary and are often worse than professional recommendations.
Collapse
Affiliation(s)
- Sadettin Çiftci
- Selcuk University Faculty of Medicine, Department of Orthopaedics and Traumatology, Konya, Turkey
- * Correspondence: Sadettin Çiftci, Orthopaedic Surgeon, Selcuk University Faculty of Medicine, Department of Orthopaedics and Traumatology, Konya, Turkey (e-mail: )
| | - Erdem Şahin
- Erzurum Regional Training and Research Hospital, Erzurum, Turkey
| | - Süha Ahmet Aktaş
- Selcuk University Faculty of Medicine, Department of Orthopaedics and Traumatology, Konya, Turkey
| | - Selim Safali
- Selcuk University Faculty of Medicine, Department of Orthopaedics and Traumatology, Konya, Turkey
| | - Fatih Durgut
- Dicle University School of Medicine, Department of Orthopedics and Traumatology, Diyarbakir, Turkey
| | - Bahattin Kerem Aydin
- Selcuk University Faculty of Medicine, Department of Orthopaedics and Traumatology, Konya, Turkey
| |
Collapse
|
9
|
Özduran E, Hanci V. Evaluating the readability, quality and reliability of online information on Behçet’s disease. Reumatismo 2022; 74. [DOI: 10.4081/reumatismo.2022.1495] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Accepted: 07/07/2022] [Indexed: 11/23/2022] Open
Abstract
There are concerns over the reliability and comprehensibility of health-related information on the internet. The goal of our research was to analyze the readability, reliability, and quality of information obtained from websites associated with Behçet’s disease (BD). On September 20, 2021, the term BD was used to perform a search on Google, and 100 eligible websites were identified. The Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), and Gunning Fog (GFOG) were used to evaluate the readability of the website. The JAMA score was used to assess the websites’ reliability, the DISCERN score and the Health on the Net Foundation code of conduct (HONcode) were used to assess quality, and Alexa was used to analyze their popularity. Sections of the text were evaluated, and the results revealed that the mean FRES was 35.49±14.42 (difficult) and the mean GFOG was 14.93±3.13 years (very difficult). According to the JAMA scores, 36% of the websites had a high reliability rating and 20% adhered to the HONcode. The readability was found to significantly differ from the reliability of the websites (p<0.05). Moreover, websites with scientific content were found to have higher readability and reliability (p<0.05). The readability of BD-related information on the Internet was found to be considerably higher than that recommended by the National Health Institute’s Grade 6, with moderate reliability and good quality. We believe that online information should have some level of readability and must have reliable content that is appropriate to educate the public, particularly for websites that provide with patient education material.
Collapse
|
10
|
Zhang D, Earp BE, Kilgallen EE, Blazar P. Readability of Online Hand Surgery Patient Educational Materials: Evaluating the Trend Since 2008. J Hand Surg Am 2022; 47:186.e1-186.e8. [PMID: 34023192 DOI: 10.1016/j.jhsa.2021.03.025] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/28/2020] [Revised: 01/27/2021] [Accepted: 03/26/2021] [Indexed: 02/02/2023]
Abstract
PURPOSE Online patient educational materials have historically been written at a higher-than-recommended sixth grade reading level. The objectives of this study were to assess the readability of online hand surgery patient educational materials from the official online patient resource website of the American Society for Surgery of the Hand (ASSH) and to compare changes in the readability of the current ASSH online patient educational materials with those in 2008 and 2015. METHODS An internet-based study of all 88 English language patient educational materials on HandCare.org, the official online patient resource website of the ASSH, was performed. The readability of each article was assessed using the Flesch reading ease formula, Flesch-Kincaid grade level, Coleman-Liau index, Gunning-Fog index, and Simple Measure of Gobbledygook grade level. To evaluate the trend in the readability of ASSH online hand surgery patient educational materials, the Flesch-Kincaid grade levels of articles published in 2020 were compared with those of data published in 2008 and 2015. RESULTS The average Flesch reading ease score of the patient educational materials was 57.6, which is at the high-school reading level. The average reading grade level of patient educational materials ranged from 9.0 to 12.3 depending on the readability metric used. The average Flesch-Kincaid grade level of all the ASSH patient educational materials was 9.8 in 2020, which is significantly better than 10.4 in 2008 but significantly worse than 8.5 in 2015. CONCLUSIONS Online hand surgery patient educational materials continue to be written for the general public at a higher-than-recommended reading grade level. There has been no substantial improvement in the readability of online hand surgery patient educational materials since 2008. CLINICAL RELEVANCE Improvements are needed in the readability of online patient educational materials to ensure that patients with all health literacy levels are able to comprehend and benefit from health information.
Collapse
Affiliation(s)
- Dafang Zhang
- Department of Orthopaedic Surgery, Brigham and Women's Hospital; Harvard Medical School, Boston, MA.
| | - Brandon E Earp
- Department of Orthopaedic Surgery, Brigham and Women's Hospital; Harvard Medical School, Boston, MA
| | | | - Philip Blazar
- Department of Orthopaedic Surgery, Brigham and Women's Hospital; Harvard Medical School, Boston, MA
| |
Collapse
|
11
|
Ozduran E, Hanci V. Evaluating the readability, quality, and reliability of online information on sjogren's syndrome. INDIAN JOURNAL OF RHEUMATOLOGY 2022. [DOI: 10.4103/injr.injr_56_22] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
|
12
|
Ji M, Bodomo A, Xie W, Huang R. Assessing Communicative Effectiveness of Public Health Information in Chinese: Developing Automatic Decision Aids for International Health Professionals. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:10329. [PMID: 34639643 PMCID: PMC8508186 DOI: 10.3390/ijerph181910329] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/25/2021] [Revised: 09/22/2021] [Accepted: 09/28/2021] [Indexed: 12/03/2022]
Abstract
Effective multilingual communication of authoritative health information plays an important role in helping to reduce health disparities and inequalities in developed and developing countries. Health information communication from the World Health Organization is governed by key principles including health information relevance, credibility, understandability, actionability, accessibility. Multilingual health information developed under these principles provide valuable benchmarks to assess the quality of health resources developed by local health authorities. In this paper, we developed machine learning classifiers for health professionals with or without Chinese proficiency to assess public-oriented health information in Chinese based on the definition of effective health communication by the WHO. We compared our optimized classifier (SVM_F5) with the state-of-art Chinese readability classifier (Chinese Readability Index Explorer CRIE 3.0), and classifiers adapted from established English readability formula, Gunning Fog Index, Automated Readability Index. Our optimized classifier achieved statistically significant higher area under the receiver operator curve (AUC of ROC), accuracy, sensitivity, and specificity than those of SVM using CRIE 3.0 features and SVM using linguistic features of Gunning Fog Index and Automated Readability Index (ARI). The statistically improved performance of our optimized classifier compared to that of SVM classifiers adapted from popular readability formula suggests that evaluation of health communication effectiveness as defined by the principles of the WHO is more complex than information readability assessment. Our SVM classifier validated on health information covering diverse topics (environmental health, infectious diseases, pregnancy, maternity care, non-communicable diseases, tobacco control) can aid effectively in the automatic assessment of original, translated Chinese public health information of whether they satisfy or not the current international standard of effective health communication as set by the WHO.
Collapse
Affiliation(s)
- Meng Ji
- School of Languages and Cultures, The University of Sydney, Sydney 2006, Australia;
| | - Adams Bodomo
- Department of African Studies, The University of Vienna, A-1090 Vienna, Austria;
| | - Wenxiu Xie
- Department of Computer Science, City University of Hong Kong, Hong Kong 518057, China;
| | - Riliu Huang
- School of Languages and Cultures, The University of Sydney, Sydney 2006, Australia;
| |
Collapse
|
13
|
Xie W, Ji M, Liu Y, Hao T, Chow CY. Predicting Writing Styles of Web-Based Materials for Children's Health Education Using the Selection of Semantic Features: Machine Learning Approach. JMIR Med Inform 2021; 9:e30115. [PMID: 34292167 PMCID: PMC8367110 DOI: 10.2196/30115] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2021] [Revised: 05/22/2021] [Accepted: 06/15/2021] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND Medical writing styles can have an impact on the understandability of health educational resources. Amid current web-based health information research, there is a dearth of research-based evidence that demonstrates what constitutes the best practice of the development of web-based health resources on children's health promotion and education. OBJECTIVE Using authoritative and highly influential web-based children's health educational resources from the Nemours Foundation, the largest not-for-profit organization promoting children's health and well-being, we aimed to develop machine learning algorithms to discriminate and predict the writing styles of health educational resources on children versus adult health promotion using a variety of health educational resources aimed at the general public. METHODS The selection of natural language features as predicator variables of algorithms went through initial automatic feature selection using ridge classifier, support vector machine, extreme gradient boost tree, and recursive feature elimination followed by revision by education experts. We compared algorithms using the automatically selected (n=19) and linguistically enhanced (n=20) feature sets, using the initial feature set (n=115) as the baseline. RESULTS Using five-fold cross-validation, compared with the baseline (115 features), the Gaussian Naive Bayes model (20 features) achieved statistically higher mean sensitivity (P=.02; 95% CI -0.016 to 0.1929), mean specificity (P=.02; 95% CI -0.016 to 0.199), mean area under the receiver operating characteristic curve (P=.02; 95% CI -0.007 to 0.140), and mean macro F1 (P=.006; 95% CI 0.016-0.167). The statistically improved performance of the final model (20 features) is in contrast to the statistically insignificant changes between the original feature set (n=115) and the automatically selected features (n=19): mean sensitivity (P=.13; 95% CI -0.1699 to 0.0681), mean specificity (P=.10; 95% CI -0.1389 to 0.4017), mean area under the receiver operating characteristic curve (P=.008; 95% CI 0.0059-0.1126), and mean macro F1 (P=.98; 95% CI -0.0555 to 0.0548). This demonstrates the importance and effectiveness of combining automatic feature selection and expert-based linguistic revision to develop the most effective machine learning algorithms from high-dimensional data sets. CONCLUSIONS We developed new evaluation tools for the discrimination and prediction of writing styles of web-based health resources for children's health education and promotion among parents and caregivers of children. User-adaptive automatic assessment of web-based health content holds great promise for distant and remote health education among young readers. Our study leveraged the precision and adaptability of machine learning algorithms and insights from health linguistics to help advance this significant yet understudied area of research.
Collapse
Affiliation(s)
- Wenxiu Xie
- Department of Computer Science, City University of Hong Kong, Hong Kong, China (Hong Kong)
| | - Meng Ji
- School of Languages and Cultures, The University of Sydney, Sydney, Australia
| | - Yanmeng Liu
- School of Languages and Cultures, The University of Sydney, Sydney, Australia
| | - Tianyong Hao
- School of Computer Science, South China Normal University, Guangzhou, China
| | - Chi-Yin Chow
- Department of Computer Science, City University of Hong Kong, Hong Kong, China (Hong Kong)
| |
Collapse
|
14
|
Nilsson O, Stenman M, Letterstål A, Hultgren R. A randomized clinical trial of an eHealth intervention on anxiety in patients undergoing abdominal aortic aneurysm surgery. Br J Surg 2021; 108:917-924. [PMID: 34021309 PMCID: PMC10364917 DOI: 10.1093/bjs/znab151] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2021] [Accepted: 04/10/2021] [Indexed: 11/12/2022]
Abstract
BACKGROUND The potential benefit of eHealth interventions in patients with abdominal aortic aneurysm (AAA) is uncertain. The primary aim of this study was to investigate the effect of an eHealth intervention on anxiety in patients with AAA undergoing surgery. METHODS A single-centre randomized clinical trial of patients with AAA scheduled for surgical repair was undertaken. The intervention group received an eHealth tool and psychosocial support besides standard care. The control group received standard care. The analysis of treatment effects was performed as intention-to-treat and per protocol analysis. The primary outcome measure was anxiety mean score (Hospital Anxiety and Depression Scale Anxiety (HADS)-A). Secondary outcomes measures were HADS Depression and short-form 12-item health survey mean scores. RESULTS Some 120 participants were randomized. No effect on anxiety mean scores was found in the intention-to-treat analysis (-1.21 versus -0.54, P = 0.330). Among those randomized to the intervention, only 30 of 60 participants used the eHealth tool (application (app) users). The app users were younger and had a higher educational level. A decrease in anxiety mean scores was noted in those who used the app in the per protocol analysis (-2.00 versus -0.54, P = 0.028). The intervention group stated a lower physical-component health-related quality of life (HRQoL) (-4.32 versus -1.16, P = 0.042) but mental-component HRQoL and depressive symptoms were unchanged. CONCLUSIONS Delivery of an eHealth intervention in this RCT did not result in an improvement in anxiety scores in patients awaiting AAA surgery. Uptake of the eHealth tool was low, although it resulted in lower anxiety scores in those participants who actually used it. CLINICAL TRIAL REGISTRATION NUMBER NCT03157973 (http://www.clinicaltrials.gov).
Collapse
Affiliation(s)
- O Nilsson
- Department of Molecular Medicine and Surgery, Karolinska Institutet, Stockholm, Sweden.,Department of Vascular Surgery, Karolinska University Hospital, Stockholm, Sweden
| | - M Stenman
- Department of Molecular Medicine and Surgery, Karolinska Institutet, Stockholm, Sweden.,Perioperative Medicine and Intensive Care Function, Karolinska University Hospital, Stockholm, Sweden
| | - A Letterstål
- Department of Medicine, Karolinska Institutet, Stockholm, Sweden.,School of Health, Care and Social Welfare, Mälardalen University, Västerås, Sweden
| | - R Hultgren
- Department of Molecular Medicine and Surgery, Karolinska Institutet, Stockholm, Sweden.,Department of Vascular Surgery, Karolinska University Hospital, Stockholm, Sweden
| |
Collapse
|
15
|
Arslan D, Tutar MS, Kozanhan B. Evaluating the readability, understandability, and quality of online materials about chest pain in children. Eur J Pediatr 2020; 179:1881-1891. [PMID: 32894353 DOI: 10.1007/s00431-020-03772-8] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/15/2020] [Revised: 08/01/2020] [Accepted: 08/04/2020] [Indexed: 10/23/2022]
Abstract
An increasing number of individuals use the Internet to obtain health information. However, online health information is unregulated and highly variable. We aimed to assess the readability, understandability, and quality of online information available for "chest pain in children." This analysis was performed in January 2020, by inputting the search term "chest pain in children" into Google. The 180 search results were evaluated/categorized. The readability was assessed using the Flesch reading ease score, the Gunning FOG readability score, the Flesch-Kincaid grade level, the Coleman-Liau score, the Simple Measure of Gobbledygook readability score, the Fry readability score, and the automated readability index (ARI). The quality was assessed through the Journal of the American Medical Association (JAMA) benchmark criteria. The understandability was evaluated by the Patient Education Materials Assessment Tool (PEMAT) for this study. Sixty-five websites were analyzed (academic and hospital websites (n = 30), physicians and health information websites (n = 35)). Among all websites, the average reading grade level was 9.99. There was no statistical difference between the two groups for the average readability level (p: 0.645). The mean PEMAT score for all websites was 65.09%. There was no statistical difference between the two groups for the average PEMAT score (p: 0.945). For both groups, the understandability score was below 70%. The average JAMA benchmark score was 2.43 ± 1.06, with a statistically significant difference between the academic and hospital websites (2.07 ± 0.91) and physician and health information websites (2.74 ± 1.09, p: 0.009).Conclusion: The readability of online materials available for patients regarding "chest pain in children" was significantly higher than the grade 6 recommended by the National Institutes of Health. The current online health information related to pediatric chest pain may be too difficult for the average reader to read. The quality and understandability were not good for both groups. Improving the readability, understandability, and quality of pediatric health-related online materials has the potential to reduce parental anxiety, improve baseline medical knowledge, and even enhance the physician-parent alliance.
Collapse
Affiliation(s)
- Derya Arslan
- Department of Pediatric Cardiology, University of Health Sciences Turkey, Konya Education and Research Hospital, 42075, Konya, Turkey.
| | - Mahmut Sami Tutar
- Department of Anesthesiology and Reanimation Clinic, Konya Numune Hospital, Konya, Turkey
| | - Betul Kozanhan
- Department of Anesthesiology and Reanimation Clinic, University of Health Science Turkey, Konya Education and Research Hospital, Konya, Turkey
| |
Collapse
|
16
|
García Rivera E, San Norberto EM, Fidalgo Domingos L, Cenizo Revuelta N, Estévez Fernández I, Vaquero Puerta C. [Informed consents readability in vascular surgery and its progress over time]. J Healthc Qual Res 2020; 35:355-363. [PMID: 33121917 DOI: 10.1016/j.jhqr.2020.07.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2020] [Revised: 06/07/2020] [Accepted: 07/12/2020] [Indexed: 10/23/2022]
Abstract
BACKGROUND AND OBJECTIVE Doctors provide patients the information in written form by informed consents (IC), being the readability essential in the quality of care. The primary endpoint was to analyze the readability of IC published by the Chapter of Endovascular Surgery (CCEV) of the Spanish Society of Angiology and Vascular Surgery (SEACV) in 2019, and its evolution to those published by the SEACV in 2007. MATERIALS AND METHODS The ICs were organized by sectors and we obtained the following parameters: syllables, words, phrases, average words/phrases and syllables/words, Flesch, Flesch-Szigriszt, Fernández-Huerta and Gunning-Fog indexes, as well as the grade on the Inflesz scale. RESULTS The Flesch index classified the CCEV consents as very difficult, and the Gunning-Fog index reflected a readability equivalent to university texts. The Flesch-Szigriszt, Fernández-Huerta indexes and Inflesz scale classified them as normal. The ICs with less readability were those referring to supra-aortic trunks (SAT) and miscellaneous in the Fernández-Huerta (P<.020 and P<.05, respectively) and Flesch-Szigriszt (P<.05) indexes. However, ICs regarding venous pathology showed a better readability in this indexes (P<.006). CCEV consents were significantly longer than SEACV consents (P=.021). In addition, there was a decrease over time in the mean value of the Fernandez-Huerta and Flesch-Szigriszt indexes (P=.002). CONCLUSIONS Although CCEV consents had a normal readability, it has been observed a decrease in the readability indexes compared to those published in 2007 by the SEACV. In addition the length and content of the ICs should be reviewed, especially those relating to SAT and miscellaneous.
Collapse
Affiliation(s)
- E García Rivera
- Hospital Clínico Universitario de Valladolid, Valladolid, España.
| | - E M San Norberto
- Hospital Clínico Universitario de Valladolid, Valladolid, España
| | | | | | | | - C Vaquero Puerta
- Hospital Clínico Universitario de Valladolid, Valladolid, España
| |
Collapse
|
17
|
Georgsson S, Carlsson T. Readability of web-based sources about induced abortion: a cross-sectional study. BMC Med Inform Decis Mak 2020; 20:102. [PMID: 32503524 PMCID: PMC7275615 DOI: 10.1186/s12911-020-01132-y] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2019] [Accepted: 05/14/2020] [Indexed: 12/18/2022] Open
Abstract
Background High-quality information is essential if clients who request an abortion are to reach informed decisions and feel prepared for the procedure, but little is known concerning the readability of web-based sources containing such material. The aim was to investigate the readability of web-based information about induced abortion. Methods The search engine Google was used to identify web pages about induced abortion, written in the English language. A total of 240 hits were screened and 236 web pages fulfilled the inclusion criteria. After correcting for duplicate hits, 185 web pages were included. The readability of the text-based content of each web page was determined with Flesch Kincaid Grade Level, Gunning Fog Index, Coleman-Liau Index, Simple Measure of Gobbledygook, and Flesch Reading Ease. Data were analyzed with descriptive statistics, Pearson’s correlation coefficient and Kruskal-Wallis with Dunn’s test as post hoc analysis. Results Across all grade level measures, a small minority of the web pages had a readability corresponding to elementary school (n < 3, 1%), while the majority had readability corresponding to senior high school or above (n > 153, 65%). The means of the grade level measures ranged between 10.5 and 13.1, and the mean Flesch Reading Ease score was 45.3 (SD 13.6). Only weak correlations (rho < 0.2) were found between the readability measures and search rank in the hit lists. Consistently, web pages affiliated with health care had the least difficult readability and those affiliated with scientific sources had the most difficult readability. Conclusions Overall, web-based information about induced abortions has difficult readability. Incentives are needed to improve the readability of these texts and ensure that clients encounter understandable information so that they may reach informed decisions and feel adequately prepared when requesting an abortion.
Collapse
Affiliation(s)
- Susanne Georgsson
- The Swedish Red Cross University College, Huddinge, Sweden.,Department of Clinical science, Intervention and technology, Karolinska Institutet, Stockholm, Sweden
| | - Tommy Carlsson
- The Swedish Red Cross University College, Huddinge, Sweden. .,Department of Women's and Children's Health, Uppsala university, MTC-huset, Dag Hammarskjölds väg 14B, 1 tr, SE-75237, Uppsala, Sweden.
| |
Collapse
|