Readability Assessment of Patient Information about Lymphedema and Its Treatment

Optimizing Readability of Patient-Facing Hand Surgery Education Materials Using Chat Generative Pretrained Transformer (ChatGPT) 3.5

PURPOSE

To address patient health literacy, the American Medical Association and the National Institutes of Health recommend that readability of patient education materials should not exceed an eighth grade reading level. However, patient-facing materials often remain above the recommended average reading level. Current online calculators provide readability scores; however, they lack the ability to provide text-specific feedback, which may streamline the process of simplifying patient materials. The purpose of this study was to evaluate Chat Generative Pretrained Transformer (ChatGPT) 3.5 as a tool for optimizing patient-facing hand surgery education materials through reading level analysis and simplification.

METHODS

The readability of 18 patient-facing hand surgery education materials was compared by a traditional online calculator for reading level and ChatGPT 3.5. The original excerpts were then entered into ChatGPT 3.5 and simplified by the artificial intelligence tool. The simplified excerpts were scored by the same calculators.

RESULTS

The readability scores for the original excerpts from the online calculator and ChatGPT 3.5 were similar. The simplified excerpts' scores were lower than the originals, with a mean of 7.28, less than the maximum recommended 8.

CONCLUSIONS

The use of ChatGPT 3.5 for the purpose of simplification and readability analysis of patient-facing hand surgery materials is efficient and may help facilitate the conveyance of important health information. ChatGPT 3.5 rendered readability scores comparable with traditional readability calculators, in addition to excerpt-specific feedback. It was also able to simplify materials to the recommended grade levels.

CLINICAL RELEVANCE

By confirming ChatGPT3.5's ability to assess and simplify patient education materials, this study offers a practical solution for potentially improving patient comprehension, engagement, and health outcomes in clinical settings.

Class in Session: Analysis of GPT-4-created Plastic Surgery In-service Examination Questions

Background

The Plastic Surgery In-Service Training Examination (PSITE) remains a critical milestone in residency training. Successful preparation requires extensive studying during an individual's residency. This study focuses on the capacity of Generative Pre-trained Transformer 4 (GPT-4) to generate PSITE practice questions.

Methods

GPT-4 was prompted to generate multiple choice questions for each PSITE section and provide answer choices with detailed rationale. Question composition via readability metrics were analyzed, along with quality. Descriptive statistics compared GPT-4 and the 2022 PSITE.

Results

The overall median Flesch-Kincaid reading ease for GPT-4-generated questions was 43.90 (versus 50.35 PSITE, P = 0.036). GPT-4 provided questions that contained significantly fewer mean sentences (1 versus 4), words (16 versus 56), and percentage of complex words (3 versus 13) than 2022 PSITE questions (P < 0.001). When evaluating GPT-4 generated questions for each examination section, the highest median Flesch-Kincaid reading ease was on the core surgical principles section (median: 63.30, interquartile range [54.45-68.28]) and the lowest was on the craniomaxillofacial section (median: 36.25, interquartile range [12.57-58.40]). Most readability metrics were higher for the 2022 PSITE compared with GPT-4 generated questions. Overall question quality was poor for the chatbot.

Conclusions

Our study found that GPT-4 can be adapted to generate practice questions for the 2022 PSITE, but its questions are of poor quality. The program can offer general explanations for both the correct and incorrect answer options but was observed to generate false information and poor-quality explanations. Although trainees should navigate with caution as the technology develops, GPT-4 has the potential to serve as an effective educational adjunct under the supervision of trained plastic surgeons.

A systematic review and meta-analysis of English language online patient education materials in breast cancer: Is readability the only story?

BACKGROUND

Online patient education materials (OPEMs) are an increasingly popular resource for women seeking information about breast cancer. The AMA recommends written patient material to be at or below a 6th grade level to meet the general public's health literacy. Metrics such as quality, understandability, and actionability also heavily influence the usability of health information, and thus should be evaluated alongside readability.

PURPOSE

A systematic review and meta-analysis was conducted to determine: 1) Average readability scores and reporting methodologies of breast cancer readability studies; and 2) Inclusion frequency of additional health literacy-associated metrics.

MATERIALS AND METHODS

A registered systematic review and meta-analysis was conducted in Ovid MEDLINE, Web of Science, Embase.com, CENTRAL via Ovid, and ClinicalTrials.gov in June 2022 in adherence with the PRISMA 2020 statement. Eligible studies performed readability analyses on English-language breast cancer-related OPEMs. Study characteristics, readability data, and reporting of non-readability health literacy metrics were extracted. Meta-analysis estimates were derived from generalized linear mixed modeling.

RESULTS

The meta-analysis included 30 studies yielding 4462 OPEMs. Overall, average readability was 11.81 (95% CI [11.14, 12.49]), with a significant difference (p < 0.001) when grouped by OPEM categories. Commercial organizations had the highest average readability at 12.2 [11.3,13.0]; non-profit organizations had one of the lowest at 11.3 [10.6,12.0]. Readability also varied by index, with New Fog, Lexile, and FORCAST having the lowest average scores (9.4 [8.6, 10.3], 10.4 [10.0, 10.8], and 10.7 [10.2, 11.1], respectively). Only 57% of studies calculated average readability with more than two indices. Only 60% of studies assessed other OPEM metrics associated with health literacy.

CONCLUSION

Average readability of breast cancer OPEMs is nearly double the AMA's recommended 6th grade level. Readability and other health literacy-associated metrics are inconsistently reported in the current literature. Standardization of future readability studies, with a focus on holistic evaluation of patient materials, may aid shared decision-making and be critical to increased screening rates and breast cancer awareness.

Readability of Spanish-Language Online Patient Educational Materials for Peripheral Artery Disease Do Not Meet Recommended Standards and Represent a Literacy Barrier to Care

BACKGROUND

Online resources are a valuable source of information for patients and have been reported to improve engagement and adherence to medical care. However, readability of online patient educational materials (OPEMs) is crucial for them to serve their intended purpose. The American Medical Association (AMA) recommends that OPEM be written at or below the sixth grade reading level. To avoid disparities in access to comprehensible health information on peripheral artery disease (PAD), it is imperative that the readability of PAD OPEM is appropriate for both English-speaking and Spanish-speaking patients. The aim of this study is to evaluate the readability of PAD OPEM in Spanish and compare to English-language OPEM.

METHODS

We conducted a Google search in English and Spanish using "peripheral arterial disease" and "enfermedad arterial periferica", respectively, and the top 25 patient-accessible articles were collected for each. Articles were categorized by source type: hospital, professional society, or other. Readability of English-language OPEM was measured using the Flesch Reading Ease Readability Formula, Automated Readability Index, Coleman-Liau Index, Flesch-Kincaid Grade Level, Gunning Fog, Linsear Write Formula, and the Simple Measure of Gobbledygook Index. Readability of Spanish OPEM was measured using the Fernández-Huerta Index and Índice Flesch-Szigriszt Scale. Readability of the articles was compared to the AMA recommendation, between English- and Spanish-language, and across sources using statistical tests appropriate to the data.

RESULTS

OPEM from professional societies represented the fewest number of English- (n = 7, 28%) and Spanish-language (n = 6, 24%) articles. Most English-speaking (n = 18, 72%) and Spanish-language (n = 20, 80%) OPEM were considered difficult as measured by the Flesch Reading Ease Readability Formula and Fernández-Huerta Index, respectively, but did not significantly differ between languages (P = 0.59). There were no significant differences in the average readability of all readability measurements across sources (hospital, professional society, or other). All the average readability grade levels for English-speaking and Spanish-language OPEM was significantly higher than the sixth grade reading level (P < 0.01). Only 3 (6%) OPEM met the AMA recommended reading level and there was no significant difference between English-language and Spanish-language OPEM (P = 1.0).

CONCLUSIONS

Nearly all Spanish-language and English-language PAD OPEM assessed were written at a reading grade level higher than recommended by the AMA. There was no significant difference in the readability of materials from hospitals or professional societies. To prevent further widening of health disparities related to literacy, health content creators, particularly hospitals and professional societies, should prioritize, develop, and ensure that English-language and Spanish-language patient education materials are written at a level appropriate for the public.

The Readability of Patient-Facing Social Media Posts on Common Otolaryngologic Diagnoses

OBJECTIVE

To assess the readability of patient-facing educational information about the most common otolaryngology diagnoses on popular social media platforms.

STUDY DESIGN

Cross-sectional study.

SETTING

Social media platforms.

METHODS

The top 5 otolaryngologic diagnoses were identified from the National Ambulatory Medical Care Survey Database. Facebook, Twitter, TikTok, and Instagram were searched using these terms, and the top 25 patient-facing posts from unique accounts for each search term and poster type (otolaryngologist, other medical professional, layperson) were identified. Captions, text, and audio from images and video, and linked articles were extracted. The readability of each post element was calculated with multiple readability formulae. Readability was summarized and was compared between poster types, platforms, and search terms via Kruskal-Wallis testing.

RESULTS

Median readability, by grade level, by grade level, was greater than 10 for captions, 5 for image-associated text, and 9 for linked articles. Captions and images in posts by laypeople were significantly more readable than captions by otolaryngologists or other medical professionals, but there was no difference for linked articles. All post components were more readable in posts about cerumen than those about other search terms.

CONCLUSIONS

When examining the readability of posts on social media regarding the most common otolaryngology diagnoses, we found that many posts are less readable than recommended for patients, and found that posts by laypeople were significantly more readable than those by medical professionals. Medical professionals should work to make educational social media posts more readable to facilitate patient comprehension.

Validation of ChatGPT 3.5 as a Tool to Optimize Readability of Patient-facing Craniofacial Education Materials

Background

To address patient health literacy, the American Medical Association recommends that readability of patient education materials should not exceed a sixth grade reading level; the National Institutes of Health recommend no greater than an eigth-grade reading level. However, patient-facing materials in plastic surgery often remain at an above-recommended average reading level. The purpose of this study was to evaluate ChatGPT 3.5 as a tool for optimizing patient-facing craniofacial education materials.

Methods

Eighteen patient-facing craniofacial education materials were evaluated for readability by a traditional calculator and ChatGPT 3.5. The resulting scores were compared. The original excerpts were then inputted to ChatGPT 3.5 and simplified by the artificial intelligence tool. The simplified excerpts were scored by the calculators.

Results

The difference in scores for the original excerpts between the online calculator and ChatGPT 3.5 were not significant (P = 0.441). Additionally, the simplified excerpts' scores were significantly lower than the originals (P < 0.001), and the mean of the simplified excerpts was 7.78, less than the maximum recommended 8.

Conclusions

The use of ChatGPT 3.5 for simplification and readability analysis of patient-facing craniofacial materials is efficient and may help facilitate the conveyance of important health information. ChatGPT 3.5 rendered readability scores comparable to traditional readability calculators, in addition to excerpt-specific feedback. It was also able to simplify materials to the recommended grade levels. With human oversight, we validate this tool for readability analysis and simplification.

Readability Assessment of Online Peripheral Artery Disease Education Materials

OBJECTIVE

Online resources can be a valuable source of information for patients and have been shown to result in more inquiry during medical office visits, following physician medical recommendation more closely, and making self-directed lifestyle changes. The accessibility to these resources is limited by the readability level of the article and the literacy level of the population. Peripheral artery disease (PAD) is estimated to affect between 8 and 12 million people in the United States with greater disease severity among under insured or un-insured populations. As PAD continues to increase in prevalence, it is imperative that patients have access to comprehensible patient-centered health information. This study aims to evaluate the readability of online PAD patient education materials.

METHODS

The search engine Google was utilized to collect the first 25 patient-accessible online articles pertaining to the search term "peripheral artery disease." Articles were then categorized by source type: hospital, professional society, or other. Readability was measured using the following tests: Automated Readability Index (ARI), Coleman-Liau Index, (CLI) Flesch-Kincaid Grade Level (FKGL), Gunning Fog, Linsear Write Formula, and the SMOG Index. Statistical analyses were performed using Statistical Analysis Software (SAS), with p-values <0.05 being statistically significant.

RESULTS

Twenty-five articles were categorized by source and statistically analyzed. The average readability of PAD patient education materials was 10.8 and significantly above the AMA, NIH, and USDHHS recommended reading level of 6th grade. Readability scores among source categories were not significantly different.

CONCLUSIONS

Commonly available online PAD resources are written at a grade level above that currently recommended by medical societies. Hospitals, professional societies, and other stakeholders in PAD patient education should take into consideration the readability of their materials to make medicine more accessible. Readable articles may combat historic, and structural racism often found in our health care system that marginalizes those with lower health literacy. It is imperative to develop patient education at an appropriate level to enrich patient autonomy.

Health Literacy in Plastic Surgery: A Scoping Review

Health literacy of plastic surgery patients may affect surgical decision-making and perioperative outcomes. In addition to consulting a plastic surgeon, patients often refer to online-based resources to learn about surgical options. The aim of this scoping review was to identify evidence detailing the state of health literacy of plastic surgery patients and available resources to highlight areas of improvement for clinical practice and future research.

Assessing the Accuracy, Quality, and Readability of Information Related to the Surgical Management of Benign Prostatic Hyperplasia

Objectives: To assess the accuracy, quality, and readability of online educational health information in English related to the most common benign prostatic hyperplasia (BPH) guideline-approved surgical treatments. Methods: The terms "benign prostatic hyperplasia," "BPH," and all eight guideline-approved treatment modalities studied, were searched to retrieve the first five relevant websites and first two paid advertised websites related to the surgical treatment options for BPH. These modalities included transurethral resection of the prostate (TURP), GreenLight photovaporization, endoscopic enucleation of the prostate, Rezum, Urolift, Aquablation, open simple prostatectomy, and robotic simple prostatectomy (RSP). All relevant websites were assessed for their accuracy, quality, and readability using standardized scoring systems. Results: The mean accuracy score for each of the treatment modalities were all indicative of good accuracy, with 76%-99% of the information presented as being accurate. The median quality score was statistically different across the eight treatment modalities (p = 0.015). The median readability grade level was statistically different across the eight treatment modalities (p = 0.009). Websites that described TURP (median readability grade level, 9.00 [interquartile range (IQR) 8.00-10.80]) were significantly easier to read than those related to RSP (median readability grade level, 14.35 [IQR, 11.08-16.50]) (p = 0.011). No other statistically significant differences were found within the other treatment modality websites. Conclusions: The majority of websites retrieved were found to be of high accuracy, good quality, and poor readability. Additionally, it was found that none of the retrieved websites included descriptions for all the other included treatment modalities. Given these findings, the authors recommend the development of centralized resources with all guideline-approved treatment modalities and accurate, readable, and high-quality information related to the surgical treatment of BPH.

The relationship between lymphedema severity and awareness of lymphedema surgery

BACKGROUND

During the early stages of lymphedema, active physiologic surgical treatment can be applied. However, lymphedema patients often have limited knowledge and misconceptions regarding lymphedema and surgical treatment. We analyzed the correlations between lymphedema severity and surgical technique according to patients' awareness of surgical treatment for secondary upper extremity lymphedema (UEL).

METHODS

Patients with UEL diagnosed between December 2017 and December 2019 were retrospectively evaluated. At the time of their presentation to our hospital for the treatment of lymphedema, they were administered a questionnaire about lymphedema and lymphedema surgery. Based on the results, patients were classified as being aware or unaware of surgical treatment. Lymphedema severity was classified according to the arm dermal backflow (ADB) stage and the MD Anderson Cancer Center (MDACC) stage based on indocyanine green lymphography conducted at presentation. Surgical techniques were compared between the two groups.

RESULTS

Patients who were aware of surgical treatment had significantly lower initial ADB and MDACC stages (P<0.05) and more frequently underwent physiologic procedures than excisional procedures (P=0.003).

CONCLUSIONS

If patients are actively educated regarding surgical treatment of lymphedema, physiologic procedures may be performed during the early stages of UEL.

Readability of Online Patient Information Relating to Cleft Palate Surgery

OBJECTIVE

It is important for health care education materials to be easily understood by caretakers of children requiring craniofacial surgery. This study aimed to analyze the readability of Google search results as they pertain to "Cleft Palate Surgery" and "Palatoplasty." Additionally, the study included a search from several locations globally to identify possible geographic differences.

DESIGN

Google searches of the terms "Cleft Palate Surgery" and "Palatoplasty" were performed. Additionally, searches of only "Cleft Palate Surgery" were run from several internet protocol addresses globally.

MAIN OUTCOME MEASURES

Flesch-Kincaid Grade Level and Readability Ease, Gunning Fog Index, Simple Measure of Gobbledygook (SMOG) index, and Coleman-Liau Index.

RESULTS

Search results for "Cleft Palate Surgery" were easier to read and comprehend compared to search results for "Palatoplasty." Mean Flesch-Kincaid Grade Level scores were 7.0 and 10.11, respectively (P = .0018). Mean Flesch-Kincaid Reading Ease scores were 61.29 and 40.71, respectively (P = .0003). Mean Gunning Fog Index scores were 8.370 and 10.34, respectively (P = .0458). Mean SMOG Index scores were 6.84 and 8.47, respectively (P = .0260). Mean Coleman-Liau Index scores were 12.95 and 15.33, respectively (P = .0281). No significant differences were found in any of the readability measures based on global location.

CONCLUSIONS

Although some improvement can be made, craniofacial surgeons can be confident in the online information pertaining to cleft palate repair, regardless of where the search is performed from. The average readability of the top search results for "Cleft Palate Surgery" is around the seventh-grade reading level (US educational system) and compares favorably to other health care readability analyses.

Comprehensive Assessment of Vascularized Composite Allotransplantation Patient-Oriented Online Resources

INTRODUCTION

Online resources have become a major source of medical information for the general public. To date, there has not been an assessment of patient-oriented online resources for face and upper extremity transplantation candidates and patients. The goal of this study is to perform a comprehensive assessment of these resources.

METHODS

Our analysis relied on 2 dimensions: comprehensiveness and readability. Comprehensiveness was evaluated using 14 predetermined variables. Readability was evaluated using 8 different readability scales through the Readability Studio Professional Edition Software (Oleander Software, Ltd, Vandalia, Ohio). Data were also collected from solid organ transplantation (SOT), specifically kidney and liver, programs for comparison.

RESULTS

Face and upper extremity transplantation programs were significantly more likely to list exclusion criteria (73.9% vs 41.2%; P = 0.02), the need for life-long immunosuppression (87.0% vs 58.8%; P = 0.02), and benefits of transplantation (91.3% vs 61.8%; P = 0.01) compared with SOT programs. The average readability level of online resources by all face and upper extremity transplantation programs exceeded the sixth grade reading level recommended by the National Institutes of Health and the American Medical Association. The average reading grade level of online resources by these programs was also significantly higher than those of SOT with both exceeding the recommended reading level (13.95 ± 1.55 vs 12.60 ± 1.65; P = 0.003).

CONCLUSIONS

Future efforts in face and upper extremity transplantation should be directed toward developing standardized, comprehensive, and intelligible resources with high-quality content and simple language.

Evaluation of the Informational Content and Readability of US Lung Cancer Screening Program Websites

IMPORTANCE

The internet is an important source of medical information for many patients and may have a key role in the education of patients about lung cancer screening (LCS). Although most LCS programs in the United States have informational websites, the accuracy, completeness, and readability of these websites have not previously been studied.

OBJECTIVE

To evaluate the informational content and readability of US LCS program websites.

DESIGN, SETTING, AND PARTICIPANTS

This cross-sectional study assessed US LCS program websites identified on September 15, 2018. A standardized checklist was used to assess key informational content of each website, and text was analyzed for reading level, word count, and reading time. Links to US websites of national advocacy organizations with LCS program content were tabulated. All functional LCS program websites in Google internet search engine results using the search terms lung cancer screening, low-dose CT screening, and lung screening were included in the analysis.

MAIN OUTCOMES AND MEASURES

Radiologists used a standardized checklist to evaluate content, and readability was assessed with validated scales. Website word count, reading time, and number of links to outside LCS informational websites were assessed.

RESULTS

A total of 257 LCS websites were included in the analysis. The word count ranged from 73 to 4410 (median, 571; interquartile range, 328-909). The reading time ranged from 0.3 to 19.6 minutes (median, 2.5; interquartile range, 1.5-4.0). The median reading level of all websites was grade 10 (interquartile range, 9-11). Only 26% (n = 66) of websites had at least 1 web link to a national website with additional information on LCS. There was wide variability regarding reported eligibility age criteria, with ages 55 to 77 years most frequently cited (42% [n = 108]). Only 56% (n = 143) of websites mentioned smoking cessation. The subject of patient cost was mentioned on 75% (n = 192) of websites. Although major LCS benefits, such as detection of lung cancer, were discussed by most (93% [n = 239]) websites, less than half of the websites (45% [n = 115]) made any mention of possible risks associated with screening.

CONCLUSIONS AND RELEVANCE

There appears to be marked variability in the informational content of US LCS program websites, and the reading level of most websites is above that recommended by the American Medical Association and the National Institutes of Health. Efforts to improve website content and readability may be warranted.

Universal Measures of Support Are Needed: A Cross-Sectional Study of Health Literacy in Patients with Dupuytren's Disease

BACKGROUND

Health literacy represents the degree to which patients can understand and act on health information. The relevance of health literacy to health care delivery, outcomes, and overall surgical care is unambiguous. This study aimed (1) to determine the prevalence of limited health literacy in patients diagnosed with Dupuytren's contracture and (2) to identify independent predictors of limited health literacy.

METHODS

This cross-sectional study included patients with Dupuytren's disease and with self-reported English fluency. The Newest Vital Sign, a rapid, validated, and reliable screening tool, was selected to measure health literacy. An exploratory multivariable logistic regression model was used to identify possible predictors of limited health literacy.

RESULTS

A total of 185 patients met eligibility criteria and were included. From those, 82 (44 percent) were found to have limited health literacy, defined as a score of 3 or less on the Newest Vital Sign. The domain of prose literacy was most highly scored compared to numeracy and document literacy. Lower household income was associated with a 4.7-fold increase in the odds of having limited health literacy. Being an immigrant also increased the odds of having limited health literacy by a factor of 3.6. Sensitivity analyses and subgroup analyses (based on education, maternal language, and immigration status) corroborated these independent predictor findings.

CONCLUSIONS

Limited health literacy is common among patients with Dupuytren's contracture. System level changes are necessary such as the access and integration to clinical care of universal measures of support to promote productive patient-surgeon interactions.

Innovative Online Educational Portal Improves Disease-Specific Reproductive Knowledge Among Patients With Inflammatory Bowel Disease

BACKGROUND

Inflammatory bowel disease (IBD) is often diagnosed in early adulthood, affecting patients through their reproductive years. Many patients, lacking knowledge about IBD and reproduction, make uninformed decisions. Although patients have turned to the Internet for information, it remains unclear if online resources are effective for improving and retaining IBD-specific reproductive knowledge. We aimed to elucidate if a multimedia vs text-only online educational intervention could improve IBD-specific reproductive knowledge for more than 6 months.

METHODS

We developed a website covering genetics, fertility, surgery, pregnancy, medications, delivery, and postpartum in the context of IBD. Adult IBD patients were randomized into study groups (multimedia or text-only) and provided 60-day access. Participants completed pre-, post-, and 6+ month-postintervention pregnancy knowledge (CCPKnow) questionnaires. Results were compared using nonparametric tests.

RESULTS

Of 111 registered participants, 78 (70.3%) completed pre- and postintervention questionnaires, and 37 (47.4%) subsequently completed the 6+ month questionnaire. Demographics were as follows: median age (interquartile range [IQR]) 29.3 (25.6-32.9) years, Crohn's disease n = 54 (69.2%), females n = 63 (80.3%), of which n = 5 (7.9%) were pregnant and n = 19 (30.2%) had previously been pregnant. The median CCPKnow scores (/17) (IQR) were 8.0 (3.0-10.0) pre-intervention, 16.0 (13.00-17.00) postintervention, and 14.0 (12.0-15.0) 6+ months postintervention. The median within-subject increase in score was 6.5 pre- to postintervention, and 4.0 pre- to 6+ months postintervention (both P < 0.001). The median increase in score (pre- to post-) was 8.0 for the multimedia group and 6.0 for the text-only group (P = 0.216).

CONCLUSIONS

An evidence-based, online educational portal can significantly improve and maintain IBD-specific reproductive patient knowledge for more than 6 months.

Hand Surgery Resources Exceed American Health Literacy

BACKGROUND

The National Institutes of Health, American Medical Association, and US National Library of Medicine recommend that educational material for patients be written at a sixth-grade reading level. The purpose of this study is to assess the complexity of hand surgery information on academic plastic and orthopedic surgery websites.

METHODS

An online search was performed for all hand surgery patient education materials provided by institutions with plastic and orthopedic surgery training programs. Readability analyses were conducted using the Flesch-Kincaid Reading Ease, Flesch-Kincaid Grade Level, Simple Measure of Gobbledygook Index, Gunning Fog Score, Automated Readability Index, and Coleman-Liau Index. A 2-tailed z test was used to compare means.

RESULTS

Seventy-six institutions with both plastic and orthopedic surgery training programs were identified; 42 had educational material available online. The average readability for all hand-related information was at the 11.92 grade reading level. Information regarding de Quervain tenosynovitis had the highest grade level for all plastic surgery procedures (13.45). Hand arthritis had the highest grade level for all orthopedic surgery procedures (12.82). Ganglion cysts had the lowest grade level for both plastic and orthopedic surgery (10.15 and 11.01, respectively; P = .12). Carpal tunnel release was the most commonly described procedure overall. There were no differences in text complexity among geographic regions.

CONCLUSIONS

Online patient resources for common hand ailments are too complex for the average patient to understand. Efforts should be made to provide materials at the recommended sixth-grade reading level to improve patient education and improve the physician-patient relationship.

Facial Plastic Surgery Patient Resources Exceed National Institute Recommendations

Patient education is essential in enhancing the physician-patient therapeutic alliance, patient satisfaction, and clinical outcomes. The American Medical Association and National Institute of Health recommend that information be written at a 6th-grade reading level, but online resources often exceed patient literacy. The purpose of this study is to assess readability of online material for facial plastics procedures presented on academic plastic surgery and otolaryngology websites.An Internet search was performed of all academic institutions that had both plastic surgery and otolaryngology training programs who offered patient information on facial plastic surgery procedures. National society websites for both plastic surgery and otolaryngology were also analyzed. All procedural information was compiled and readability analyses were performed. A 2-tailed Z-test was used to compare scores, and statistical significance was set at P < 0.05.Sixty-three programs were identified; 42 had educational material. The overall average readability for all information was at a 10th-grade reading level. The national plastic surgery website had a significantly higher word count and number of syllables per word compared to the national otolaryngology website (P < 0.001, P = 0.04).The complexity of written resources represents an obstacle to online patient education and efforts to improve readability could benefit patients seeking medical information online. Current online education materials are a potential hindrance to patient education, satisfaction, and decision making. Healthcare institutions should consider writing new materials with simpler language that would be accessible to patients.

Readability of Wikipedia Pages on Autoimmune Disorders: Systematic Quantitative Assessment

Background

In the era of new information and communication technologies, the Internet is being increasingly accessed for health-related information. Indeed, recently published patient surveys of people with autoimmune disorders confirmed that the Internet was reported as one of the most important health information sources. Wikipedia, a free online encyclopedia launched in 2001, is generally one of the most visited websites worldwide and is often consulted for health-related information.

Objective

The main objective of this investigation was to quantitatively assess whether the Wikipedia pages related to autoimmune disorders can be easily accessed by patients and their families, in terms of readability.

Methods

We obtained and downloaded a list of autoimmune disorders from the American Autoimmune Related Diseases Association (AARDA) website. We analyzed Wikipedia articles for their overall level of readability with 6 different quantitative readability scales: (1) the Flesch Reading Ease, (2) the Gunning Fog Index, (3) the Coleman-Liau Index, (4) the Flesch-Kincaid Grade Level, (5) the Automated Readability Index (ARI), and (6) the Simple Measure of Gobbledygook (SMOG). Further, we investigated the correlation between readability and clinical, pathological, and epidemiological parameters. Moreover, each Wikipedia analysis was assessed according to its content, breaking down the readability indices by main topic of each part (namely, pathogenesis, treatment, diagnosis, and prognosis plus a section containing paragraphs not falling into any of the previous categories).

Results

We retrieved 134 diseases from the AARDA website. The Flesch Reading Ease yielded a mean score of 24.34 (SD 10.73), indicating that the sites were very difficult to read and best understood by university graduates, while mean Gunning Fog Index and ARI scores were 16.87 (SD 2.03) and 14.06 (SD 2.12), respectively. The Coleman-Liau Index and the Flesch-Kincaid Grade Level yielded mean scores of 14.48 (SD 1.57) and 14.86 (1.95), respectively, while the mean SMOG score was 15.38 (SD 1.37). All the readability indices confirmed that the sites were suitable for a university graduate reading level. We found no correlation between readability and clinical, pathological, and epidemiological parameters. Differences among the different sections of the Wikipedia pages were statistically significant.

Conclusions

Wikipedia pages related to autoimmune disorders are characterized by a low level of readability. The onus is, therefore, on physicians and health authorities to improve the health literacy skills of patients and their families and to create, together with patients themselves, disease-specific readable sites, disseminating highly accessible health-related online information, in terms of both clarity and conciseness.

Recent trends in oropharyngeal cancer funding and public interest

OBJECTIVES/HYPOTHESIS

The incidence of oropharyngeal cancer (OPC) has increased in the United States. This has been driven by an increase in human papillomavirus (HPV)-positive OPC. Our objective is to determine trends in National Institutes (NIH)-supported research funding and public interest in OPC.

METHODS

The NIH Research Portfolio Online Reporting Tools database was evaluated for projects related to OPC between 2004 and 2015. Projects were evaluated for total funding, relation to HPV, principal investigator departmental affiliation and degree, and NIH agency or center responsible for grant. The Google Trends database was evaluated for relative Internet search popularity of oropharyngeal cancer and related search terms between 2004 and 2015.

RESULTS

In terms of NIH funding, 100 OPC-related projects representing 242 grant years and $108.5 million were funded between 2004 and 2015. Total NIH funding for OPC projects increased from $167,406 in 2004 to $16.2 million in 2015. Funding for HPV-related OPC increased from less than $2 million yearly between 2004 and 2010 up to $12.7 million in 2015. Principal investigators related to radiation oncology ($41.8 million) and with doctor of medicine degrees ($52.8 million) received the largest share of total funding. Relative Internet search popularity for oropharyngeal cancer has increased from 2004 to 2015 compared to control cancer search terms.

CONCLUSION

Increased public interest and NIH funding has paralleled the rising incidence of OPC. NIH funding has been driven by projects related to the role of HPV in OPC.

LEVEL OF EVIDENCE

2c. Laryngoscope, 127:1345-1350, 2017.

Readability, complexity, and suitability analysis of online lymphedema resources

BACKGROUND

Over 72% of Americans use online health information to assist in health care decision-making. Previous studies of lymphedema literature have focused only on reading level of patient-oriented materials online. Findings indicate they are too advanced for most patients to comprehend. This, more comprehensive study, expands the previous analysis to include critical elements of health materials beyond readability using assessment tools to report on the complexity and density of data as well as text design, vocabulary, and organization.

METHODS

The top 10 highest ranked websites on lymphedema were identified using the most popular search engine (Google). Website content was analyzed for readability, complexity, and suitability using Simple Measure of Gobbledygook, PMOSE/iKIRSCH, and Suitability Assessment of Materials (SAM), respectively. PMOSE/iKIRSCH and SAM were performed by two independent raters. Fleiss' kappa score was calculated to ensure inter-rater reliability.

RESULTS

Online lymphedema literature had a reading grade level of 14.0 (SMOG). Overall complexity score was 6.7 (PMOSE/iKIRSCH) corresponding to "low" complexity and requiring a 8th-12th grade education. Fleiss' kappa score was 80% (P = 0.04, "substantial" agreement). Overall suitability score was 45% (SAM) correlating to the lowest level of "adequate" suitability. Fleiss' kappa score was 76% (P = 0.06, "substantial" agreement).

CONCLUSIONS

Online resources for lymphedema are above the recommended levels for readability and complexity. The suitability level is barely adequate for the intended audience. Overall, these materials are too sophisticated for the average American adult, whose literacy skills are well documented. Further efforts to revise these materials are needed to improve patient comprehension and understanding.

Readability analysis of online resources related to lung cancer

BACKGROUND

Patients seeking health information commonly use the Internet as the first source for material. Studies show that well-informed patients have increased involvement, satisfaction, and healthcare outcomes. As one-third of Americans have only basic or below basic health literacy, the National Institutes of Health and American Medical Association recommend patient-directed health resources be written at a sixth-grade reading level. This study evaluates the readability of commonly accessed online resources on lung cancer.

METHODS

A search for "lung cancer" was performed using Google and Bing, and the top 10 websites were identified. Location services were disabled, and sponsored sites were excluded. Relevant articles (n = 109) with patient-directed content available directly from the main sites were downloaded. Readability was assessed using 10 established methods and analyzed with articles grouped by parent website.

RESULTS

The average reading grade level across all sites was 11.2, with a range from 8.8 (New Fog Count) to 12.2 (Simple Measure of Gobbledygook). The average Flesch Reading Ease score was 52, corresponding with fairly difficult to read text. The readability varied when compared by individual website, ranging in grade level from 9.2 to 15.2. Only 10 articles (9%) were written below a sixth-grade level and these tended to discuss simpler topics.

CONCLUSIONS

Patient-directed online information about lung cancer exceeds the recommended sixth-grade reading level. Readability varies between individual websites, allowing physicians to direct patients according to level of health literacy. Modifications to existing materials can significantly improve readability while maintaining content for patients with low health literacy.