Varicocele Embolization: An Assessment of the Quality and Readability of Online Patient Information

Patient education information material assessment criteria: A scoping review

BACKGROUND

Patient education information material (PEIM) is an essential component of patient education programs in increasing patients' ability to cope with their diseases. Therefore, it is essential to consider the criteria that will be used to prepare and evaluate these resources.

OBJECTIVE

This paper aims to identify these criteria and recognize the tools or methods used to evaluate them.

METHODS

National and international databases and indexing banks, including PubMed, Scopus, Web of Science, ProQuest, the Cochrane Library, Magiran, SID and ISC, were searched for this review. Original or review articles, theses, short surveys, and conference papers published between January 1990 and June 2022 were included.

RESULTS

Overall, 4688 documents were retrieved, of which 298 documents met the inclusion criteria. The criteria were grouped into 24 overarching criteria. The most frequently used criteria were readability, quality, suitability, comprehensibility and understandability.

CONCLUSION

This review has provided empirical evidence to identify criteria, tools, techniques or methods for developing or evaluating a PEIM. The authors suggest that developing a comprehensive tool based on these findings is critical for evaluating the overall efficiency of PEIM using effective criteria.

The Value of Web-Based Patient Education Materials on Transarterial Chemoembolization: Systematic Review

Background

Thousands of web searches are performed related to transarterial chemoembolization (TACE), given its palliative role in the treatment of liver cancer.

Objective

This study aims to assess the reliability, quality, completeness, readability, understandability, and actionability of websites that provide information on TACE for patients.

Methods

The five most popular keywords pertaining to TACE were searched on Google, Yahoo, and Bing. General website characteristics and the presence of Health On the Net Foundation code certification were documented. Website assessment was performed using the following scores: DISCERN, Journal of the American Medical Association, Flesch-Kincaid Grade Level, Flesch Reading Ease Score, and the Patient Education Materials Assessment Tool. A novel TACE content score was generated to evaluate website completeness.

Results

The search yielded 3750 websites. In total, 81 website entities belonging to 78 website domains met the inclusion criteria. A medical disclaimer was not provided on 28% (22/78) of website domains. Health On the Net code certification was present on 12% (9/78) of website domains. Authorship was absent on 88% (71/81) of websites, and sources were absent on 83% (67/81) of websites. The date of publication or of the last update was not listed on 58% (47/81) of websites. The median DISCERN score was 47.0 (IQR 40.5-54.0). The median TACE content score was 35 (IQR 27-43). The median readability grade level was in the 11th grade. Overall, 61% (49/81) and 16% (13/81) of websites were deemed understandable and actionable, respectively. Not-for-profit websites fared significantly better on the Journal of the American Medical Association, DISCERN, and TACE content scores.

Conclusions

The content referring to TACE that is currently available on the web is unreliable, incomplete, difficult to read, understandable but not actionable, and characterized by low overall quality. Websites need to revise their content to optimally educate consumers and support shared decision-making.

Trial Registration

PROSPERO International Prospective Register of Systematic Reviews CRD42020202747; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42020202747

Transjugular intrahepatic portosystemic shunt (TIPS) procedure: an assessment of the quality and readability of online information

Purpose

Transjugular intrahepatic portosystemic shunt (TIPS) procedure is an established procedure carried out by interventional radiologists to achieve portal decompression and to manage the complications of portal hypertension. The aim of this study was to evaluate the quality and readability of information available online for TIPS procedure.

Methods

Websites were identified using the search terms “TIPS procedure”, “TIPSS procedure”, “transjugular intrahepatic portosystemic shunt procedure”, with the first 25 pages from the three most popular search engines (Google, Bing and Yahoo) being selected for evaluation with a total of 225. Each Website was grouped by authorship into one of five categories: (1) Physician, (2) Academic, (3) For-profit, (4) Non-profit (including government and public health), or (5) Other (discussion/social media). Readability of each Website was assessed using the Flesch-Reading Ease score, Flesch–Kincaid grade level, Gunning-Fog Index, Coleman–Liau and SMOG index. Quality was calculated using the DISCERN instrument, the Journal of the American Medical Association (JAMA) benchmark criteria and the presence of Health on the Net (HON) code certification.

Results

After disregarding duplicate and non-accessible Websites a total of 81 were included. The mean DISCERN score assessing the quality of information provided by Websites was “good” (59.3 ± 10.2) with adherence to the JAMA Benchmark being 54.3%. Websites with HON-code certification were statistically significantly higher in terms of DISCERN (p = 0.034) and JAMA scores (p = 0.003) compared to HON-code negative sites. The readability scores of Websites ranged from 10 to 12th grade across calculators. Thirty-two out of the 81 Websites were targeted towards patients (39.5%), 46 towards medical professionals (56.8%) and 3 were aimed at neither (3.7%). The medical professional aimed Websites were statistically significantly more difficulty to read across all readability formulas (all p < 0.001).

Conclusion

While quality of online information available to patients is “good”, the average readability for information on the internet for TIPS is set far above the recommended 7th-grade level. Academic Websites were of the highest quality, yet most challenging for the general public to read. These findings call for the production of high-quality and comprehensible content around TIPS procedure, where physicians can reliably direct their patients for information.

Pelvic vein embolization: an assessment of the readability and quality of online information for patients

Introduction

Pelvic congestion syndrome is a controversial topic. Pelvic vein embolization is a minimally invasive treatment for pelvic congestion syndrome. We aimed to assess the quality of information available on the Internet and determine how accessible information provided by the main IR societies was to patients.

Materials and methods

The most commonly used term relating to pelvic vein embolization was searched across the five most-used English language search engines, with the first 25 web pages returned by each engine included for analysis. Duplicate web pages, nontext content and web pages behind paywalls were excluded. Web pages were analyzed for quality and readability using validated tools: DISCERN score, JAMA Benchmark Criteria, HONcode Certification, Flesch Reading Ease Score, Flesch–Kincaid Grade Level, and Gunning–Fog Index.

Results

The most common applicable term was “Pelvic Vein Embolization”. Mean DISCERN quality of information provided by websites is “fair”. Flesh–Kincaid readability tests and Gunning–Fog Index demonstrated an average “college level” of reading ease. HON code certification was demonstrated in less than one third of web pages. Professional societies and scientific journals demonstrated the highest average JAMA and DISCERN scores, while for-profit organizations and healthcare providers demonstrated the lowest. Only information from 1 of 3 interventional societies was included in the first 25 search engine pages.

Conclusion

The quality of information available online to patients is “fair” and outside of scientific journals the majority of web pages do not meet the JAMA benchmark criteria. These findings call for the production of high-quality and comprehensible content regarding interventional radiology, where physicians can reliably direct their patients for information.