1
|
Abdullah Y, Alokozai A, Mathew AJ, Stamm MA, Mulcahey MK. Patient Education Materials Found via Google Search for Shoulder Arthroscopy Are Written at Too-High of a Reading Level. Arthrosc Sports Med Rehabil 2022; 4:e1575-e1579. [PMID: 36033169 PMCID: PMC9402457 DOI: 10.1016/j.asmr.2022.04.034] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2022] [Accepted: 04/27/2022] [Indexed: 12/02/2022] Open
Abstract
Purpose To evaluate the quality and correlation of readability on actionability and understandability of shoulder arthroscopy-related patient education materials (PEMs) found via a routine Google search. Methods Two independent authors performed an online Google search with the term “shoulder arthroscopy.” The first 5 pages of search results were then screened for PEMs. Journal articles, news articles, nontext materials, and unrelated websites were excluded. The readability of included resources was calculated using objective metrics: Flesch–Kincaid Grade Score, Simple Measure of Gobbledygook index, Coleman–Liau Index, and the Gunning Fog Index. Patient Education Material Assessment Tool for Printed Materials assessed for understandability and actionability. Associations between readability and actionability and understandability were determined using Spearman correlation and linear regression. Results The searches returned 53 websites related to shoulder arthroscopy. A total of 34 (64%) met inclusion criteria. A high school reading level or greater was required to read the average PEM according to all scales used. The average PEM received a Patient Education Material Assessment Tool for Printed Materials score of 61.33 in understandability (range 18.75-89.47) and 55.59 points in actionability (range 16.67-83.33). An easily understood or actionable article would score at least 70 points. A moderate correlation was observed between readability and actionability on three of the scales used (r = 0.5, r = 0.59, r = 0.61). Conclusions Most shoulder arthroscopy PEMs identified on Google are not written at a level that the average patient can read, understand, or act on (actionability). Clinical Relevance Orthopaedic surgeons should be aware of the resources that patients use to obtain medical information. More accessible PEMs should be developed for patients undergoing shoulder arthroscopy to enhance comprehension of their condition and improve shared decision-making.
Collapse
Affiliation(s)
| | | | | | | | - Mary K. Mulcahey
- Address correspondence to Mary K. Mulcahey, M.D., F.A.A.O.S., F.A.O.A., Department of Orthopaedic Surgery, Tulane University School of Medicine, 1430 Tulane Ave., New Orleans, LA, 70112.
| |
Collapse
|
2
|
Noback PC, Trupia EP, Dziesinski LK, Sarpong NO, Trofa DP, Vosseller JT. Ankle Fractures: The Current State of Online Patient Information. Foot Ankle Spec 2021; 14:324-333. [PMID: 32674596 DOI: 10.1177/1938640020916286] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Background. We assessed the quality, accuracy, and readability of websites for ankle fractures. Methods. Ankle Fracture, Broken Ankle, and Fibular Fracture were entered into 3 search engines. The first 25 results from each search were collected. Quality, accuracy, and readability were assessed by a custom rubric, 3 surgeons, and Fleisch-Kincaid grade level (FKGL), respectively. Results. A total of 57 websites were included: 24 were assigned to Ankle Fracture, 26 to Broken Ankle, and 7 to Fibular Fracture. The average quality score out of 36, accuracy score out of 12, and FKGL for all websites were 13.1 ± 6.8, 10.8 ± 1.2, and 9.6 ± 1.7, respectively. Websites assigned to the term Broken Ankle had a significantly lower New Dale-Chall score. Websites of lower FKGL and appearing earlier in results had significantly higher quality scores. Physician specialty societies (PSSs) had a significantly lower FKGL than websites of other types. Conclusion. The readability of patient materials is above the recommended level for ankle fractures. Encouragingly, a trade-off between readability and quality was not found. Patients should use search terms they are familiar with and prioritize websites that appear earlier in search results, are easier to read, and produced by PSSs.Level of Evidence: Level 3.
Collapse
Affiliation(s)
- Peter C Noback
- Department of Orthopaedic Surgery, Trauma Training Center, Columbia University Medical Center, New York
| | - Evan P Trupia
- Department of Orthopaedic Surgery, Trauma Training Center, Columbia University Medical Center, New York
| | - Lucas K Dziesinski
- Department of Orthopaedic Surgery, Trauma Training Center, Columbia University Medical Center, New York
| | - Nana O Sarpong
- Department of Orthopaedic Surgery, Trauma Training Center, Columbia University Medical Center, New York
| | - David P Trofa
- Department of Orthopaedic Surgery, Trauma Training Center, Columbia University Medical Center, New York
| | - J Turner Vosseller
- Department of Orthopaedic Surgery, Trauma Training Center, Columbia University Medical Center, New York
| |
Collapse
|
3
|
Phan A, Jubril A, Menga E, Mesfin A. Readability of the Most Commonly Accessed Online Patient Education Materials Pertaining to Surgical Treatments of the Spine. World Neurosurg 2021; 152:e583-e588. [PMID: 34139351 DOI: 10.1016/j.wneu.2021.06.010] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2021] [Revised: 05/31/2021] [Accepted: 06/02/2021] [Indexed: 10/21/2022]
Abstract
OBJECTIVE The American Medical Association and National Institutes of Health have recommended that patient education materials should be written at the sixth-grade reading level to maximize patient comprehension. The objective of the present study was to evaluate the readability of Internet information for the 9 most common spinal surgeries. METHODS We reviewed 90 online patient educational materials regarding the 9 most common spinal surgeries as reported by the North American Spine Society. A Google search was performed on March 23, 2019 for each surgery, and the top 10 most visited websites for each surgery were assessed for reading level using the Flesch-Kincaid formula. RESULTS Using the Flesch-Kincaid formula, the average grade reading level of the 90 websites included was 12.82, with a reading ease of 37.04 ("difficult college"). Only 6 websites relayed information to patients at or below the national average of an eighth-grade reading level. The websites for bone morphogenic protein had the highest average grade reading level at 15.88 ± 2.6. Lumbar microscopic discectomy had the lowest average grade reading level at 10.37 ± 2.89. All surgical options discussed had an average readability above the recommended sixth-grade reading level. CONCLUSIONS The most accessed online materials for common spinal surgeries, not only exceeded the readability limits recommended by both the American Medical Association and the National Institutes of Health, but they also exceeded the average reading ability of most adults in the United States. Patients, therefore, might not fully comprehend the information from commonly accessed websites regarding surgical spine treatment options.
Collapse
Affiliation(s)
- Amy Phan
- Department of Orthopaedic Surgery, University of Rochester School of Medicine and Dentistry, Rochester, New York, USA
| | - Ayodeji Jubril
- Department of Orthopaedic Surgery, University of Rochester School of Medicine and Dentistry, Rochester, New York, USA
| | - Emmanuel Menga
- Department of Orthopaedic Surgery, University of Rochester School of Medicine and Dentistry, Rochester, New York, USA
| | - Addisu Mesfin
- Department of Orthopaedic Surgery, University of Rochester School of Medicine and Dentistry, Rochester, New York, USA.
| |
Collapse
|
4
|
Noback PC, Trofa DP, Dziesinski LK, Trupia EP, Galle S, Rosenwasser MP. Kienböck Disease: Quality, Accuracy, and Readability of Online Information. Hand (N Y) 2020; 15:563-572. [PMID: 30556422 PMCID: PMC7370388 DOI: 10.1177/1558944718813631] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
Abstract
Background: Patients with limited health literacy require online educational materials to be written below a sixth grade level for optimal understanding. We assessed the quality, accuracy, and readability of online materials for Kienböck disease (KD). Methods: "Kienbock's Disease" and "Lunate Avacular Necrosis" were entered into 3 search engines. The first 25 Web sites from each search were collected. Quality was assessed via a custom grading rubric, accuracy by 2 residents and a fellow, and readability by Flesch-Kincaid grade level (FKGL) and New Dale-Chall test. Web sites were stratified according to the search term, FKGL, order of appearance, and authorship type. Results: A total of 38 unique Web sites were included, of which 22 were assigned to "KD" and 16 to "Lunate Avascular Necrosis." The average quality score out of 30, accuracy score out of 12, and FKGL for all Web sites were 13.3 ± 7.3, 10.4 ± 1.9, and 10.5 ± 1.4, respectively. Web sites assigned to the term "Kienbock's Disease" had a significantly higher FKGL. Web sites of higher FKGL had significantly worse accuracy scores. Order of appearance had no influence. Physician specialty societies (PSS) had a significantly lower FKGL than Web sites of other authorship types. Conclusions: Despite concerted efforts by national organizations, the readability of online patient materials is above the recommended level for KD. Patients with limited health literacy will be most affected by this reality. Until readability improves, patients should continue to consult their physicians when uncertain and prioritize Web sites that are easier to read and produced by PSS.
Collapse
Affiliation(s)
| | | | | | | | - Samuel Galle
- Columbia University Medical Center, New York, NY, USA
| | - Melvin P. Rosenwasser
- Columbia University Medical Center, New York, NY, USA,Melvin P. Rosenwasser, Department of Orthopedic Surgery, Trauma Training Center, Columbia University Medical Center, PH-1164, 622 West 168th Street, New York, NY 10032, USA.
| |
Collapse
|
5
|
Akinleye SD, Garofolo-Gonzalez G, Montuori M, Culbertson MD, Hashem J, Edelstein DM. Readability of the Most Commonly Accessed Online Patient Education Materials Pertaining to Pathology of the Hand. Hand (N Y) 2018; 13:705-714. [PMID: 28836453 PMCID: PMC6300184 DOI: 10.1177/1558944717726138] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND The American Medical Association (AMA) and National Institutes of Health (NIH) recommend that patient education materials be written at no higher than a sixth-grade reading level. METHODS We examined 100 online educational materials for the 10 hand conditions most commonly treated by hand surgeons, as reported by the American Society for Surgery of the Hand. The listed conditions were carpal tunnel syndrome, basal joint arthritis of the thumb, de Quervain syndrome, Dupuytren's contracture, ganglion cysts, hand fractures, trigger finger, extensor tendon injuries, flexor tendon injuries, and mallet finger. Following a Google search for each condition, we analyzed the 10 most visited websites for each disorder utilizing the Flesch-Kincaid formula. RESULTS The average grade reading level of the 100 websites studied was 9.49 with a reading ease of 53.03 ("fairly difficult high school"). Only 29% of the websites were at or below the national average of an eighth-grade reading level. Carpal tunnel syndrome had the highest average grade reading level at 10.32 (standard deviation: 1.52), whereas hand fractures had the lowest at 8.14 (2.03). Every hand condition in this study had an average readability at or above the ninth-grade reading level. CONCLUSIONS The most frequently accessed materials for common maladies of the hand exceed both the readability limits recommended by the AMA and NIH, and the average reading ability of most US adults. Therefore, the most commonly accessed websites pertaining to hand pathology may not be comprehended by the audience for which it is intended.
Collapse
Affiliation(s)
- Sheriff D. Akinleye
- Maimonides Medical Center, Brooklyn, NY, USA,Sheriff D. Akinleye, Orthopaedic Surgery, Maimonides Medical Center, 927 49th Street, Brooklyn, NY 11219, USA.
| | | | | | | | | | | |
Collapse
|
6
|
Akinleye SD, Krochak R, Richardson N, Garofolo G, Culbertson MD, Erez O. Readability of the Most Commonly Accessed Arthroscopy-Related Online Patient Education Materials. Arthroscopy 2018; 34:1272-1279. [PMID: 29287948 DOI: 10.1016/j.arthro.2017.09.043] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/25/2017] [Revised: 09/16/2017] [Accepted: 09/19/2017] [Indexed: 02/02/2023]
Abstract
PURPOSE To assess the readability and comprehension of written text by the most commonly visited websites containing patient education materials on common conditions that can be treated arthroscopically. METHODS We examined 50 websites, assessed independently by 2 orthopaedic surgery residents (S.A. and G.G.), with educational materials on 5 common conditions treated by arthroscopic surgeons: anterior cruciate ligament (ACL) tear, meniscus tear, hip labral tear, shoulder labral tear, and rotator cuff tear. Following a Google search for each condition, we analyzed the 10 most visited websites for each disorder using a widely used and validated tool for assessing the reading levels of written materials (Flesch-Kincaid formula). RESULTS The average grade reading level of the 50 websites studied was 9.90 with a reading ease of 52.14 ("fairly difficult, high school"). Only 26% of the websites were at or below the national average of an eighth-grade reading level. Of the 5 conditions treated by arthroscopic surgery, ACL tear had the highest average grade reading level at 10.73 ± 1.54, whereas meniscus tear had the lowest at 9.31 ± 1.81. Every condition in this study had an average readability at or above the ninth-grade reading level. CONCLUSIONS The most frequently accessed materials for patients with injuries requiring arthroscopic surgery exceeds the readability recommendations of the American Medical Association and National Institutes of Health, as well as the average reading ability of US adults. Given the fact that these are the most commonly visited websites by the lay public, there needs to be a greater emphasis on tailoring written information to the literacy levels of the patient population. CLINICAL RELEVANCE This study emphasizes the discrepancy between the recommended versus the measured reading levels of online patient education materials related to conditions treated by arthroscopic surgeons. The subject matter of these conditions is inherently complex; thus, relying solely on text to inform patients increases the likelihood that the reading level of the material exceeds that of the majority of the lay public.
Collapse
Affiliation(s)
- Sheriff D Akinleye
- Maimonides Medical Center, Orthopaedic Surgery, Brooklyn, New York, U.S.A..
| | - Ryan Krochak
- Maimonides Medical Center, Orthopaedic Surgery, Brooklyn, New York, U.S.A
| | | | - Garret Garofolo
- Maimonides Medical Center, Orthopaedic Surgery, Brooklyn, New York, U.S.A
| | | | - Orry Erez
- Maimonides Medical Center, Orthopaedic Surgery, Brooklyn, New York, U.S.A
| |
Collapse
|
7
|
Hadden K, Prince LY, Schnaekel A, Couch CG, Stephenson JM, Wyrick TO. Readability of Patient Education Materials in Hand Surgery and Health Literacy Best Practices for Improvement. J Hand Surg Am 2016; 41:825-32. [PMID: 27291416 DOI: 10.1016/j.jhsa.2016.05.006] [Citation(s) in RCA: 37] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/28/2016] [Revised: 05/03/2016] [Accepted: 05/16/2016] [Indexed: 02/02/2023]
Abstract
PURPOSE This study aimed to update a portion of a 2008 study of patient education materials from the American Society for Surgery of the Hand Web site with new readability results, to compare the results to health literacy best practices, and to make recommendations to the field for improvement. METHODS A sample of 77 patient education documents were downloaded from the American Society for Surgery of the Hand Web site, handcare.org, and assessed for readability using 4 readability tools. Mean readability grade-level scores were derived. Best practices for plain language for written health materials were compiled from 3 government agency sources. RESULTS The mean readability of the 77 patient education documents in the study was 9.3 grade level. This reading level is reduced from the previous study in 2008 in which the overall mean was 10.6; however, the current sample grade level still exceeds recommended readability according to best practices. CONCLUSIONS Despite a small body of literature on the readability of patient education materials related to hand surgery and other orthopedic issues over the last 7 years, readability was not dramatically improved in our current sample. Using health literacy as a framework, improvements in hand surgery patient education may result in better understanding and better outcomes for patients seeing hand surgeons. CLINICAL RELEVANCE Improved understanding of patient education materials related to hand surgery may improve preventable negative outcomes that are clinically significant as well as contribute to improved quality of life for patients.
Collapse
Affiliation(s)
- Kristie Hadden
- University of Arkansas for Medical Sciences, Little Rock, AR.
| | | | - Asa Schnaekel
- University of Arkansas for Medical Sciences, Little Rock, AR
| | - Cory G Couch
- University of Arkansas for Medical Sciences, Little Rock, AR
| | | | | |
Collapse
|
8
|
Cassidy JT, Baker JF. Orthopaedic Patient Information on the World Wide Web: An Essential Review. J Bone Joint Surg Am 2016; 98:325-38. [PMID: 26888683 DOI: 10.2106/jbjs.n.01189] [Citation(s) in RCA: 116] [Impact Index Per Article: 14.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
BACKGROUND Patients increasingly use the Internet to research health-related issues. Internet content, unlike other forms of media, is not regulated. Although information accessed online can impact patients' opinions and expectations, there is limited information about the quality or readability of online orthopaedic information. METHODS PubMed, MEDLINE, and Google Scholar were searched using anatomic descriptors and three title keywords ("Internet," "web," and "online"). Articles examining online orthopaedic information from January 1, 2000, until April 1, 2015, were recorded. Articles were assessed for the number of reviewers evaluating the online material, whether the article examined for a link between authorship and quality, and the use of recognized quality and readability assessment tools. To facilitate a contemporary discussion, only publications since January 1, 2010, were considered for analysis. RESULTS A total of thirty-eight peer-reviewed articles published since 2010 examining the quality and/or readability of online orthopaedic information were reviewed. For information quality, there was marked variation in the quality assessment methods utilized, the number of reviewers, and the manner of reporting. To date, the majority of examined information is of poor quality. Studies examining readability have focused on pages produced by professional orthopaedic societies. CONCLUSIONS The quality and readability of online orthopaedic information are generally poor. CLINICAL RELEVANCE For modern practices to adapt to the Internet and to prevent misinformation, the orthopaedic community should develop high-quality, readable online patient information.
Collapse
Affiliation(s)
- John Tristan Cassidy
- Department of Orthopaedic Surgery, The Adelaide and Meath incorporating the National Children's Hospital, Dublin, Ireland
| | - Joseph F Baker
- Department of Orthopaedic Surgery, Galway University Hospital, Galway City, Ireland
| |
Collapse
|