Online educational materials for appendectomy patients have good quality but poor readability

Down the Rabbit Hole: Evaluation of Internet Information Quality in Parathyroid and Thyroid Surgery

INTRODUCTION

Patients often discuss information obtained from Internet sources during clinic visits, which can be of variable quality and depth. We sought to review and assess information on the Internet regarding common operations within endocrine surgery.

METHODS

Using Google's search engine, the top 100 websites from the search phrase "parathyroid surgery," and the top 100 websites from the phrase "thyroid surgery" were identified. Each website was evaluated for accessibility, accuracy, and completeness of information about gland hormone function, associated disease processes, and surgery itself. Results were stratified based on the website type, and bivariate analysis was performed to determine accuracy by category. Presence of author credentials, last webpage update, and presence of advertisements were also assessed. Inter-rater reliability was calculated for each variable.

RESULTS

For parathyroid surgery, at least two-thirds of all websites included information about surgery, hormone function, and disease processes. For thyroid surgery, 71% of websites included procedure information, but only 52% included information about hormone function and 56% about disease processes. Less than 30% of all websites included advertisements and less than 25% listed author credentials or provided references. Academic or research-affiliated sources were most likely to have zero inaccuracies, but 44% of all websites had at least one potential inaccuracy. Inter-rater reliability achieved at least moderate agreement (>0.41) for 56% of variables.

CONCLUSIONS

There is a wide array of information available to patients online, and accuracy varies based on multiple factors including the type of website. Endocrine surgeons and related practitioners must be cognizant of this fact when discussing treatment plans with patients.

Patient education information material assessment criteria: A scoping review

BACKGROUND

Patient education information material (PEIM) is an essential component of patient education programs in increasing patients' ability to cope with their diseases. Therefore, it is essential to consider the criteria that will be used to prepare and evaluate these resources.

OBJECTIVE

This paper aims to identify these criteria and recognize the tools or methods used to evaluate them.

METHODS

National and international databases and indexing banks, including PubMed, Scopus, Web of Science, ProQuest, the Cochrane Library, Magiran, SID and ISC, were searched for this review. Original or review articles, theses, short surveys, and conference papers published between January 1990 and June 2022 were included.

RESULTS

Overall, 4688 documents were retrieved, of which 298 documents met the inclusion criteria. The criteria were grouped into 24 overarching criteria. The most frequently used criteria were readability, quality, suitability, comprehensibility and understandability.

CONCLUSION

This review has provided empirical evidence to identify criteria, tools, techniques or methods for developing or evaluating a PEIM. The authors suggest that developing a comprehensive tool based on these findings is critical for evaluating the overall efficiency of PEIM using effective criteria.

Readability and Quality of Online Health Information Regarding Parathyroidectomy

Objective

Assessment of the readability and quality of online health information regarding parathyroidectomy.

Study Design

Cross-sectional analysis.

Setting

Websites providing patient-oriented health information regarding parathyroidectomy obtained via the Google search engine.

Methods

The top 75 Google search results for “parathyroidectomy,”“parathyroid surgery,” and “parathyroid gland removal” were reviewed. Websites were categorized by website type and country of origin. Readability was assessed by Flesch-Kincaid Grade Level and Simple Measure of Gobbledygook. Website quality was assessed per JAMA benchmark criteria and the DISCERN instrument.

Results

A total of 74 unique websites were evaluated. The mean readability of the assessed websites exceeded the recommended sixth-grade reading level on the Flesch-Kincaid Grade Level and Simple Measure of Gobbledygook (P < .001). Readability did not vary significantly by website type. Websites originating from the United Kingdom were significantly more readable than those from the United States. The majority of assessed websites were of poor quality (n = 42, 56.8%) on assessment based on the DISCERN instrument. Quality varied significantly by website category on the JAMA benchmark criteria (P < .001) and DISCERN score (P = .049) with commercial websites receiving the highest scores. DISCERN score also varied significantly by country of origin (P = .036) with UK sites receiving highest mean DISCERN scores.

Conclusion

Online health information regarding parathyroidectomy is largely of poor quality and is poorly readable for many patients. Institutions utilizing well-defined guidelines for development of patient educational resources may provide online health information of greater quality and readability.