1
|
Khan S, Walters RK, Walker AM, Nguyen SA, Liu SY, Tremont TJ, Abdelwahab MA. The readability of online patient education materials on maxillomandibular advancement surgery. Sleep Breath 2024; 28:745-751. [PMID: 38062224 DOI: 10.1007/s11325-023-02952-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2023] [Revised: 10/05/2023] [Accepted: 11/20/2023] [Indexed: 05/31/2024]
Abstract
STUDY OBJECTIVES Maxillomandibular advancement (MMA) is an effective surgical option for patients suffering from obstructive sleep apnea (OSA). As a relatively new treatment option, patients may turn to the Internet to learn more. However, online patient education materials (OPEMs) on MMA may be written at a higher literacy level than recommended for patients. The aim of this study was to analyze the readability of OPEMs on MMA. METHODS A Google search of "maxillomandibular advancement" was performed, and the first 100 results were screened. Websites that met eligibility criteria were analyzed for their readability using the Automated Readability Index (ARI), Coleman-Liau Index (CLI), Flesch-Kincaid Grade Level (FKGL), Gunning Fog (GF), and Simple Measure of Gobbledygook (SMOG) and compared to the recommended sixth-grade reading level using one-tailed t tests. Readability scores were compared based on the type of website, including hospitals/universities or physician clinics, using ANOVA tests. RESULTS The mean (SD) for ARI, CLI, FKGL, GF, and SMOG was 11.91 (2.43), 13.42 (1.81), 11.91 (2.06), 14.32 (2.34), and 13.99 (1.56), respectively. All readability scores were significantly higher than a sixth-grade reading level (p < 0.001). After comparing readability scores between different website types (university/hospital, clinic, and other), there was no statistical difference found. CONCLUSIONS The available OPEMs on MMA surgery for OSA are above the recommended sixth-grade reading level. Identifying and reducing the gap between the reading levels of OPEMs and the reading level of the patient are needed to encourage a more active role, informed decisions, and better patient satisfaction.
Collapse
Affiliation(s)
- Sofia Khan
- Department of Otolaryngology-Head and Neck Surgery, Medical University of South Carolina, 135 Rutledge Avenue, MSC 500, Charleston, SC, 29425, USA.
| | - Rameen K Walters
- Department of Otolaryngology-Head and Neck Surgery, Medical University of South Carolina, 135 Rutledge Avenue, MSC 500, Charleston, SC, 29425, USA
| | - Angelica M Walker
- Department of Otolaryngology-Head and Neck Surgery, Medical University of South Carolina, 135 Rutledge Avenue, MSC 500, Charleston, SC, 29425, USA
| | - Shaun A Nguyen
- Department of Otolaryngology-Head and Neck Surgery, Medical University of South Carolina, 135 Rutledge Avenue, MSC 500, Charleston, SC, 29425, USA
| | - Stanley Y Liu
- Department of Otolaryngology-Head and Neck Surgery, Stanford University, Stanford, CA, 94305, USA
| | - Timothy J Tremont
- Department of Orthodontics, Medical University of South Carolina, Charleston, SC, 29425, USA
| | - Mohamed A Abdelwahab
- Department of Otolaryngology-Head and Neck Surgery, Medical University of South Carolina, 135 Rutledge Avenue, MSC 500, Charleston, SC, 29425, USA
| |
Collapse
|
2
|
Morse E, Odigie E, Gillespie H, Rameau A. The Readability of Patient-Facing Social Media Posts on Common Otolaryngologic Diagnoses. Otolaryngol Head Neck Surg 2024; 170:1051-1058. [PMID: 38018504 DOI: 10.1002/ohn.584] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Revised: 10/09/2023] [Accepted: 10/28/2023] [Indexed: 11/30/2023]
Abstract
OBJECTIVE To assess the readability of patient-facing educational information about the most common otolaryngology diagnoses on popular social media platforms. STUDY DESIGN Cross-sectional study. SETTING Social media platforms. METHODS The top 5 otolaryngologic diagnoses were identified from the National Ambulatory Medical Care Survey Database. Facebook, Twitter, TikTok, and Instagram were searched using these terms, and the top 25 patient-facing posts from unique accounts for each search term and poster type (otolaryngologist, other medical professional, layperson) were identified. Captions, text, and audio from images and video, and linked articles were extracted. The readability of each post element was calculated with multiple readability formulae. Readability was summarized and was compared between poster types, platforms, and search terms via Kruskal-Wallis testing. RESULTS Median readability, by grade level, by grade level, was greater than 10 for captions, 5 for image-associated text, and 9 for linked articles. Captions and images in posts by laypeople were significantly more readable than captions by otolaryngologists or other medical professionals, but there was no difference for linked articles. All post components were more readable in posts about cerumen than those about other search terms. CONCLUSIONS When examining the readability of posts on social media regarding the most common otolaryngology diagnoses, we found that many posts are less readable than recommended for patients, and found that posts by laypeople were significantly more readable than those by medical professionals. Medical professionals should work to make educational social media posts more readable to facilitate patient comprehension.
Collapse
Affiliation(s)
- Elliot Morse
- Department of Otolaryngology-Head and Neck Surgery, Weill Cornell Medicine, New York, New York, USA
| | - Eseosa Odigie
- Department of Otolaryngology-Head and Neck Surgery, Weill Cornell Medicine, New York, New York, USA
- Sean Parker Institute for the Voice, Weill Cornell Medicine, New York, New York, USA
| | - Helen Gillespie
- Department of Otolaryngology-Head and Neck Surgery, Weill Cornell Medicine, New York, New York, USA
- Sean Parker Institute for the Voice, Weill Cornell Medicine, New York, New York, USA
| | - Anaïs Rameau
- Department of Otolaryngology-Head and Neck Surgery, Weill Cornell Medicine, New York, New York, USA
- Sean Parker Institute for the Voice, Weill Cornell Medicine, New York, New York, USA
| |
Collapse
|
3
|
Mastrokostas PG, Mastrokostas LE, Emara AK, Wellington IJ, Ginalis E, Houten JK, Khalsa AS, Saleh A, Razi AE, Ng MK. GPT-4 as a Source of Patient Information for Anterior Cervical Discectomy and Fusion: A Comparative Analysis Against Google Web Search. Global Spine J 2024:21925682241241241. [PMID: 38513636 DOI: 10.1177/21925682241241241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/23/2024] Open
Abstract
STUDY DESIGN Comparative study. OBJECTIVES This study aims to compare Google and GPT-4 in terms of (1) question types, (2) response readability, (3) source quality, and (4) numerical response accuracy for the top 10 most frequently asked questions (FAQs) about anterior cervical discectomy and fusion (ACDF). METHODS "Anterior cervical discectomy and fusion" was searched on Google and GPT-4 on December 18, 2023. Top 10 FAQs were classified according to the Rothwell system. Source quality was evaluated using JAMA benchmark criteria and readability was assessed using Flesch Reading Ease and Flesch-Kincaid grade level. Differences in JAMA scores, Flesch-Kincaid grade level, Flesch Reading Ease, and word count between platforms were analyzed using Student's t-tests. Statistical significance was set at the .05 level. RESULTS Frequently asked questions from Google were varied, while GPT-4 focused on technical details and indications/management. GPT-4 showed a higher Flesch-Kincaid grade level (12.96 vs 9.28, P = .003), lower Flesch Reading Ease score (37.07 vs 54.85, P = .005), and higher JAMA scores for source quality (3.333 vs 1.800, P = .016). Numerically, 6 out of 10 responses varied between platforms, with GPT-4 providing broader recovery timelines for ACDF. CONCLUSIONS This study demonstrates GPT-4's ability to elevate patient education by providing high-quality, diverse information tailored to those with advanced literacy levels. As AI technology evolves, refining these tools for accuracy and user-friendliness remains crucial, catering to patients' varying literacy levels and information needs in spine surgery.
Collapse
Affiliation(s)
- Paul G Mastrokostas
- College of Medicine, State University of New York (SUNY) Downstate, Brooklyn, NY, USA
| | | | - Ahmed K Emara
- Department of Orthopaedic Surgery, Cleveland Clinic, Cleveland, OH, USA
| | - Ian J Wellington
- Department of Orthopaedic Surgery, University of Connecticut, Hartford, CT, USA
| | | | - John K Houten
- Department of Neurosurgery, Mount Sinai School of Medicine, New York, NY, USA
| | - Amrit S Khalsa
- Department of Orthopaedic Surgery, University of Pennsylvania, Philadelphia, PA, USA
| | - Ahmed Saleh
- Department of Orthopaedic Surgery, Maimonides Medical Center, Brooklyn, NY, USA
| | - Afshin E Razi
- Department of Orthopaedic Surgery, Maimonides Medical Center, Brooklyn, NY, USA
| | - Mitchell K Ng
- Department of Orthopaedic Surgery, Maimonides Medical Center, Brooklyn, NY, USA
| |
Collapse
|
4
|
Ahmed A, Jassim S, Karkuri A. Readability of Online Information on the Latarjet Procedure. Cureus 2023; 15:e49184. [PMID: 38024088 PMCID: PMC10662536 DOI: 10.7759/cureus.49184] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/21/2023] [Indexed: 12/01/2023] Open
Abstract
Introduction A common complication of first-time or recurrent shoulder dislocations is bone loss at the humeral head and glenoid. Recurrent shoulder instability is often a result of bony defects in the glenoid following shoulder dislocations. In the setting of glenoid bone loss, surgical interventions are generally required to restore stability. The Latarjet procedure is a challenging operation and, due to its complexity, may be associated with operative complications. It can be difficult to explain the procedure to patients in a manner that is easily comprehensible, which may lead to confusion or being overwhelmed with information. Hence, it is important that the information available to patients is easily accessible and perceivable to allow for adequate health literacy. Health literacy is defined as the ability to make health decisions in the context of everyday life. Methods The search engines Google and Bing were accessed on a single day in the month of July 2023, searching the terms "Latarjet surgery" and "Latarjet procedure." For each term on both search engines, the first three pages were evaluated, resulting in a total of 114 websites for review. Out of these, 25 websites met the inclusion criteria and underwent further in-depth analysis through the online readability software, WEB FX. This software generated a Flesch Reading Ease Score (FRES) and a Reading Grade Level (RGL) for each website. Results In our study, the mean FRES was 50.3 (SD ±12.5), categorizing the data as 'fairly difficult to read.' The mean RGL score was 8.12 (SD ±2.35), which exceeds the recommended target. Conclusion In conclusion, the results of this study have demonstrated that the material available on the Internet about the Latarjet procedure is above the recommended readability levels for the majority of the population. Our findings align with similar studies assessing the readability of online patient information. Based on these findings, physicians should provide patients with vetted information to facilitate a better understanding of the procedure, thereby enabling patients to make more informed decisions regarding their health.
Collapse
Affiliation(s)
- Aathir Ahmed
- Orthopaedics, Royal College of Surgeons in Ireland, Dublin, IRL
| | - Sarmed Jassim
- Surgery, Royal College of Surgeons in Ireland, Dublin, IRL
| | - Ahmed Karkuri
- Orthopaedic Surgery, Sligo University Hospital, Sligo, IRL
| |
Collapse
|
5
|
Baumann J, Marshall S, Groneck A, Hanish SJ, Choma T, DeFroda S. Readability of spine-related patient education materials: a standard method for improvement. EUROPEAN SPINE JOURNAL : OFFICIAL PUBLICATION OF THE EUROPEAN SPINE SOCIETY, THE EUROPEAN SPINAL DEFORMITY SOCIETY, AND THE EUROPEAN SECTION OF THE CERVICAL SPINE RESEARCH SOCIETY 2023; 32:3039-3046. [PMID: 37466719 DOI: 10.1007/s00586-023-07856-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/05/2023] [Revised: 03/08/2023] [Accepted: 03/19/2023] [Indexed: 07/20/2023]
Abstract
PURPOSE Orthopaedic patient education materials (PEMs) have repeatedly been shown to be well above the recommended reading level by the National Institute of Health and American Medical Association. The purpose of this study is to create a standardized method to improve the readability of PEMs describing spine-related conditions and injuries. It is hypothesized that reducing the usage of complex words (≥ 3 syllables) and reducing sentence length to < 15 words per sentence improves readability of PEMs as measured by all seven readability formulas used. METHODS OrthoInfo.org was queried for spine-related PEMs. The objective readability of PEMs was evaluated using seven unique readability formulas before and after applying a standardized method to improve readability while preserving critical content. This method involved reducing the use of > 3 syllable words and ensuring sentence length is < 15 words. Paired samples t-tests were conducted to assess relationships with the cut-off for statistical significance set at p < 0.05. RESULTS A total of 20 spine-related PEM articles were used in this study. When comparing original PEMs to edited PEMs, significant differences were seen among all seven readability scores and all six numerical descriptive statistics used. Per the Flesch Kincaid Grade level readability formula, one original PEM (5%) versus 15 edited PEMs (75%) met recommendations of a sixth-grade reading level. CONCLUSION The current study shows that using this standardized method significantly improves the readability of spine-related PEMs and significantly increased the likelihood that PEMs will meet recommendations for being at or below the sixth-grade reading level.
Collapse
Affiliation(s)
- John Baumann
- Department of Orthopaedic Surgery, University of Missouri Health Care, Columbia, MO, USA.
- University of Missouri School of Medicine, Columbia, MO, USA.
| | - Samuel Marshall
- Department of Orthopaedic Surgery, University of Missouri Health Care, Columbia, MO, USA
- University of Missouri School of Medicine, Columbia, MO, USA
| | - Andrew Groneck
- Department of Orthopaedic Surgery, University of Missouri Health Care, Columbia, MO, USA
- University of Missouri School of Medicine, Columbia, MO, USA
| | - Stefan J Hanish
- Department of Orthopaedic Surgery, University of Missouri Health Care, Columbia, MO, USA
- University of Missouri School of Medicine, Columbia, MO, USA
| | - Theodore Choma
- Department of Orthopaedic Surgery, University of Missouri Health Care, Columbia, MO, USA
| | - Steven DeFroda
- Department of Orthopaedic Surgery, University of Missouri Health Care, Columbia, MO, USA.
| |
Collapse
|
6
|
Guo F, Zhou A, Chang W, Sun X, Zou B. Is physician online information sharing always beneficial to patient education? An attention perspective. Front Public Health 2022; 10:987766. [PMID: 36111196 PMCID: PMC9468256 DOI: 10.3389/fpubh.2022.987766] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2022] [Accepted: 08/08/2022] [Indexed: 01/26/2023] Open
Abstract
Aims With the development of information technology, online health platforms and physician online information sharing play an important role in public health management and patient education. Is physician online information sharing always beneficial to patient education? From the attention perspective, this study aims to explore how physician online information sharing influences patient education, considering the contingent roles of physician online reputation and offline expertise. Methods A 6-month panel data of 61,566 physician-month observations from an online health platform in China was used to tested the proposed hypotheses. Considering the inefficiency and estimated bias of the ordinary least squares regression model, this study conducted the fixed models to test the direct and moderating effects. Results The results indicate that physician online information sharing is positively related to potential patient education, while the relationship between physician online information sharing and realized patient education is an inverted U-shape. Physician online reputation enhances the positive relationship between physician online information sharing and potential patient education, but physician offline expertise weakens the abovementioned relationship. In addition, physician offline expertise flattens the curvilinear effect of physician online information sharing on realized patient education. Conclusion This study contributes to the literature about attention theory and information sharing for patient education, and provides implications for practice.
Collapse
Affiliation(s)
- Feng Guo
- College of Management and Economics, Tianjin University, Tianjin, China
| | - Apan Zhou
- College of Management and Economics, Tianjin University, Tianjin, China
| | - Wenhao Chang
- School of Business, Sun Yat-sen University, Guangzhou, China
| | - Xinru Sun
- College of Management and Economics, Tianjin University, Tianjin, China
| | - Bo Zou
- School of Business, Sun Yat-sen University, Guangzhou, China
| |
Collapse
|