The quality of internet sites providing information relating to oral cancer

A cross-sectional quantitative analysis of the readability and quality of online resources regarding thumb carpometacarpal joint replacement surgery

Background

Thumb carpometacarpal (CMC) joint osteoarthritis is a common degenerative condition that affects up to 15 ​% of the population older than 30 years. Poor readability of online health resources has been associated with misinformation, inappropriate care, incorrect self-treatment, worse health outcomes, and increased healthcare resource waste. This study aims to assess the readability and quality of online information regarding thumb carpometacarpal (CMC) joint replacement surgery.

Methods

The terms "thumb joint replacement surgery", "thumb carpometacarpal joint replacement surgery", "thumb cmc joint replacement surgery", "thumb arthroplasty", "thumb carpometacarpal arthroplasty", and "thumb cmc arthroplasty" were searched in Google and Bing. Readability was determined using the Flesch Reading Ease Score (FRES) and the Flesch-Kincaid Reading Grade Level (FKGL). FRES >65 or a grade level score of sixth grade and under was considered acceptable. Quality was assessed using the Patient Education Materials Assessment Tool (PEMAT) and a modified DISCERN tool. PEMAT scores below 70 were considered poorly understandable and poorly actionable.

Results

A total of 34 websites underwent qualitative analysis. The average FRES was 54.60 ​± ​7.91 (range 30.30-67.80). Only 3 (8.82 ​%) websites had a FRES score >65. The average FKGL score was 8.19 ​± ​1.80 (range 5.60-12.90). Only 3 (8.82 ​%) websites were written at or below a sixth-grade level. The average PEMAT percentage score for understandability and actionability was 76.82 ​± ​9.43 (range 61.54-93.75) and 36.18 ​± ​24.12 (range 0.00-60.00) respectively. Although 22 (64.71 ​%) of websites met the acceptable standard of 70 ​% for understandability, none of the websites met the acceptable standard of 70 ​% for actionability. The average total DISCERN score was 32.00 ​± ​4.29 (range 24.00-42.00).

Conclusions

Most websites reviewed were written above recommended reading levels. Most showed acceptable understandability but none showed acceptable actionability. To avoid the negative outcomes of poor patient understanding of online resources, providers of these resources should optimise accessibility to the average reader by using simple words, avoiding jargon, and analysing texts with readability software before publishing the materials online. Websites should also utilise visual aids and provide clearer pre-operative and post-operative instructions.

Patient education resources for oral mucositis: a google search and ChatGPT analysis

PURPOSE

Oral mucositis affects 90% of patients receiving chemotherapy or radiation for head and neck malignancies. Many patients use the internet to learn about their condition and treatments; however, the quality of online resources is not guaranteed. Our objective was to determine the most common Google searches related to "oral mucositis" and assess the quality and readability of available resources compared to ChatGPT-generated responses.

METHODS

Data related to Google searches for "oral mucositis" were analyzed. People Also Ask (PAA) questions (generated by Google) related to searches for "oral mucositis" were documented. Google resources were rated on quality, understandability, ease of reading, and reading grade level using the Journal of the American Medical Association benchmark criteria, Patient Education Materials Assessment Tool, Flesch Reading Ease Score, and Flesh-Kincaid Grade Level, respectively. ChatGPT-generated responses to the most popular PAA questions were rated using identical metrics.

RESULTS

Google search popularity for "oral mucositis" has significantly increased since 2004. 78% of the Google resources answered the associated PAA question, and 6% met the criteria for universal readability. 100% of the ChatGPT-generated responses answered the prompt, and 20% met the criteria for universal readability when asked to write for the appropriate audience.

CONCLUSION

Most resources provided by Google do not meet the criteria for universal readability. When prompted specifically, ChatGPT-generated responses were consistently more readable than Google resources. After verification of accuracy by healthcare professionals, ChatGPT could be a reasonable alternative to generate universally readable patient education resources.

Are large language models a useful resource to address common patient concerns on hallux valgus? A readability analysis

BACKGROUND

This study evaluates the accuracy and readability of Google, ChatGPT-3.5, and 4.0 (two versions of an artificial intelligence model) responses to common questions regarding bunion surgery.

METHODS

A Google search of "bunionectomy" was performed, and the first ten questions under "People Also Ask" were recorded. ChatGPT-3.5 and 4.0 were asked these ten questions individually, and their answers were analyzed using the Flesch-Kincaid Reading Ease and Gunning-Fog Level algorithms.

RESULTS

When compared to Google, ChatGPT-3.5 and 4.0 had a larger word count with 315 ± 39 words (p < .0001) and 294 ± 39 words (p < .0001), respectively. A significant difference was found between ChatGPT-3.5 and 4.0 compared to Google using Flesch-Kincaid Reading Ease (p < .0001).

CONCLUSIONS

Our findings demonstrate that ChatGPT provided significantly lengthier responses than Google and there was a significant difference in reading ease. Both platforms exceeded the seventh to eighth-grade reading level of the U.S.

POPULATION

LEVEL OF EVIDENCE

N/A.

Using Google web search to analyze and evaluate the application of ChatGPT in femoroacetabular impingement syndrome

Background

Chat Generative Pre-trained Transformer (ChatGPT) is a new machine learning tool that allows patients to access health information online, specifically compared to Google, the most commonly used search engine in the United States. Patients can use ChatGPT to better understand medical issues. This study compared the two search engines based on: (i) frequently asked questions (FAQs) about Femoroacetabular Impingement Syndrome (FAI), (ii) the corresponding answers to these FAQs, and (iii) the most FAQs yielding a numerical response.

Purpose

To assess the suitability of ChatGPT as an online health information resource for patients by replicating their internet searches.

Study design

Cross-sectional study.

Methods

The same keywords were used to search the 10 most common questions about FAI on both Google and ChatGPT. The responses from both search engines were recorded and analyzed.

Results

Of the 20 questions, 8 (40%) were similar. Among the 10 questions searched on Google, 7 were provided by a medical practice. For numerical questions, there was a notable difference in answers between Google and ChatGPT for 3 out of the top 5 most common questions (60%). Expert evaluation indicated that 67.5% of experts were satisfied or highly satisfied with the accuracy of ChatGPT's descriptions of both conservative and surgical treatment options for FAI. Additionally, 62.5% of experts were satisfied or highly satisfied with the safety of the information provided. Regarding the etiology of FAI, including cam and pincer impingements, 52.5% of experts expressed satisfaction or high satisfaction with ChatGPT's explanations. Overall, 62.5% of experts affirmed that ChatGPT could serve effectively as a reliable medical resource for initial information retrieval.

Conclusion

This study confirms that ChatGPT, despite being a new tool, shows significant potential as a supplementary resource for health information on FAI. Expert evaluations commend its capacity to provide accurate and comprehensive responses, valued by medical professionals for relevance and safety. Nonetheless, continuous improvements in its medical content's depth and precision are recommended for ongoing reliability. While ChatGPT offers a promising alternative to traditional search engines, meticulous validation is imperative before it can be fully embraced as a trusted medical resource.

A Cross-Sectional Analysis of the Readability of Online Information Regarding Hip Osteoarthritis

Introduction Osteoarthritis (OA) is an age-related degenerative joint disease. There is a 25% risk of symptomatic hip OA in patients who live up to 85 years of age. It can impair a person's daily activities and increase their reliance on healthcare services. It is primarily managed with education, weight loss and exercise, supplemented with pharmacological interventions. Poor health literacy is associated with negative treatment outcomes and patient dissatisfaction. A literature search found there are no previously published studies examining the readability of online information about hip OA. Objectives To assess the readability of healthcare websites regarding hip OA. Methods The terms "hip pain", "hip osteoarthritis", "hip arthritis", and "hip OA" were searched on Google and Bing. Of 240 websites initially considered, 74 unique websites underwent evaluation using the WebFX online readability software (WebFX®, Harrisburg, USA). Readability was determined using the Flesch Reading Ease Score (FRES), Flesch-Kincaid Reading Grade Level (FKGL), Gunning Fog Index (GFI), Simple Measure of Gobbledygook (SMOG), Coleman-Liau Index (CLI), and Automated Readability Index (ARI). In line with recommended guidelines and previous studies, FRES >65 or a grade level score of sixth grade and under was considered acceptable. Results The average FRES was 56.74±8.18 (range 29.5-79.4). Only nine (12.16%) websites had a FRES score >65. The average FKGL score was 7.62±1.69 (range 4.2-12.9). Only seven (9.46%) websites were written at or below a sixth-grade level according to the FKGL score. The average GFI score was 9.20±2.09 (range 5.6-16.5). Only one (1.35%) website was written at or below a sixth-grade level according to the GFI score. The average SMOG score was 7.29±1.41 (range 5.4-12.0). Only eight (10.81%) websites were written at or below a sixth-grade level according to the SMOG score. The average CLI score was 13.86±1.75 (range 9.6-19.7). All 36 websites were written above a sixth-grade level according to the CLI score. The average ARI score was 6.91±2.06 (range 3.1-14.0). Twenty-eight (37.84%) websites were written at or below a sixth-grade level according to the ARI score. One-sample t-tests showed that FRES (p<0.001, CI -10.2 to -6.37), FKGL (p<0.001, CI 1.23 to 2.01), GFI (p<0.001, CI 2.72 to 3.69), SMOG (p<0.001, CI 0.97 to 1.62), CLI (p<0.001, CI 7.46 to 8.27), and ARI (p<0.001, CI 0.43 to 1.39) scores were significantly different from the accepted standard. One-way analysis of variance (ANOVA) testing of FRES scores (p=0.009) and CLI scores (p=0.009) showed a significant difference between categories. Post hoc testing showed a significant difference between academic and non-profit categories for FRES scores (p=0.010, CI -15.17 to -1.47) and CLI scores (p=0.008, CI 0.35 to 3.29). Conclusions Most websites regarding hip OA are written above recommended reading levels, hence exceeding the comprehension levels of the average patient. Readability of these resources must be improved to improve patient access to online healthcare information which can lead to improved patient understanding of their own condition and treatment outcomes.

Evaluation of Patient Education Materials From Large-Language Artificial Intelligence Models on Carpal Tunnel Release

BACKGROUND

ChatGPT, an artificial intelligence technology, has the potential to be a useful patient aid, though the accuracy and appropriateness of its responses and recommendations on common hand surgical pathologies and procedures must be understood. Comparing the sources referenced and characteristics of responses from ChatGPT and an established search engine (Google) on carpal tunnel surgery will allow for an understanding of the utility of ChatGPT for patient education.

METHODS

A Google search of "carpal tunnel release surgery" was performed and "frequently asked questions (FAQs)" were recorded with their answer and source. ChatGPT was then asked to provide answers to the Google FAQs. The FAQs were compared, and answer content was compared using word count, readability analyses, and content source.

RESULTS

There was 40% concordance among questions asked by the programs. Google answered each question with one source per answer, whereas ChatGPT's answers were created from two sources per answer. ChatGPT's answers were significantly longer than Google's and multiple readability analysis algorithms found ChatGPT responses to be statistically significantly more difficult to read and at a higher grade level than Google's. ChatGPT always recommended "contacting your surgeon."

CONCLUSION

A comparison of ChatGPT's responses to Google's FAQ responses revealed that ChatGPT's answers were more in-depth, from multiple sources, and from a higher proportion of academic Web sites. However, ChatGPT answers were found to be more difficult to understand. Further study is needed to understand if the differences in the responses between programs correlate to a difference in patient comprehension.

Content analysis of oral (mouth) cancer-related posts on Instagram

OBJECTIVE

To examine the content of Instagram posts about oral cancer and assess its usefulness in promoting oral cancer awareness and early detection practices.

METHODS

A systematic search of Instagram for posts about oral (mouth) cancer was conducted using the hashtags #oral cancer and #mouth cancer. Posts usefulness in promoting awareness and early detection was assessed using the early detection usefulness score, and caption readability was assessed using the Flesch Kincaid readability score.

RESULTS

A total of 81,000 posts were identified, and 200 posts were thoroughly evaluated. Included posts gathered a total of 48,118 (mean = 420.59 likes) and 27,898 views. Most posts (81.5%) were educational to the lay person, and India and the UK were the major contributors. The most discussed topics were prevention and early detection (55%). Representative clinical images were present in 35.5% of posts. Only 9.5% of posts mentioned the source of information, and the mean usefulness score was only 2.1 out of 10. The mean reading ease score was 56.7 ± 43.8 (range from 1 to 98 out of 100).

CONCLUSION

Instagram shows potential for promoting oral cancer awareness, particularly in prevention and early detection. However, concerns regarding content quality, scientific validity, and clarity persist.

Readability and reliability of online patient education materials about statins

Objective

Statins are the cornerstone for the prevention and treatment of cardiovascular disease. Patients often consult online patient education materials (OPEMs) to inform medical decision-making. We therefore aimed to assess the readability and reliability of OPEMs related to statins.

Methods

A total of 17 statin-related terms were queried using an online search engine to identify the top 20 search results for each statin-related term. Each OPEM was then grouped into the following categories based on 2 independent reviewers: government OPEMs (national, state, or local government agencies); healthcare/nonprofit OPEMs (major health systems and nonprofit organizations with a specific cardiovascular health focus); industry/commercial OPEMs (pharmaceutical manufacturers and online pharmacies); lay press OPEMs (healthcare-oriented news organizations); and dictionary/encyclopedia OPEMs. Grade-level readability for each OPEM was calculated using 5 standard readability metrics and compared with AMA-recommended readability recommendations. Reliability of each OPEM was evaluated using the JAMA benchmark criteria for online health information and certification from Health on the Net (HONCode).

Results

A total of 340 websites were identified across the 17 statin search terms. There were 211 statin OPEMs after excluding non-OPEM results; 172 OPEMs had unique content. Statin OPEM readability exceeded the recommended 6th grade AMA reading level (average reading grade level of 10.9). The average JAMA benchmark criteria score was 2.13 (on a scale of 0-4, with higher scores indicating higher reliability), and only 60% of statin OPEMs were HONCode-certified. There was an inverse association between readability and reliability. The most readable results were from industry and commercial sources, while the most reliable sites were from lay press sources.

Conclusions

Statin OPEMs are written at an overall averaging reading grade level of 10.9. There was an inverse association between readability and reliability. Lack of accessible, high-quality online health information may contribute to statin nonadherence.

Indications for Surgery, Activities After Surgery, and Pain Are the Most Commonly Asked Questions in Anterior Cruciate Ligament Injury and Reconstruction

Purpose

To leverage Google's search algorithms to summarize the most commonly asked questions regarding anterior cruciate ligament (ACL) injuries and surgery.

Methods

Six terms related to ACL tear and/or surgery were searched on a clean-installed Google Chrome browser. The list of questions and their associated websites on the Google search page were extracted after multiple search iterations performed in January of 2022. Questions and websites were categorized according to Rothwell's criteria. The Journal of the American Medical Association (JAMA) Benchmark criteria were used to grade website quality and transparency. Descriptive statistics were provided. χ2 and Student t-tests identified for categorical differences and differences in JAMA score, respectively (significance set at P < .05).

Results

A total of 273 unique questions associated with 204 websites were identified. The most frequently asked questions involved Indications/Management (20.2%), Specific Activities (15.8%), and Pain (10.3%). The most common websites were Medical Practice (27.9%), Academic (23.5%), and Commercial (19.5%). In Academic websites, questions regarding Specific Activities were seldom included (4.7%) whereas questions regarding Pain were frequently addressed (39.3%, P = .027). Although average JAMA score was relatively high for Academic websites, the average combined score for medical and governmental websites was lower (P < .001) than nonmedical websites.

Conclusions

The most searched questions on Google regarding ACL tears or surgery related to indications for surgery, pain, and activities postoperatively. Health information resources stemmed from Medical Practice (27.9%) followed by Academic (23.5%) and Commercial (19.5%) websites. Medical websites had lower JAMA quality scores compared with nonmedical websites.

Clinical Relevance

These findings presented may assist physicians in addressing the most frequently searched questions while also guiding their patients to greater-quality resources regarding ACL injuries and surgery.

Using a Google Web Search Analysis to Assess the Utility of ChatGPT in Total Joint Arthroplasty

BACKGROUND

Rapid technological advancements have laid the foundations for the use of artificial intelligence in medicine. The promise of machine learning (ML) lies in its potential ability to improve treatment decision making, predict adverse outcomes, and streamline the management of perioperative healthcare. In an increasing consumer-focused health care model, unprecedented access to information may extend to patients using ChatGPT to gain insight into medical questions. The main objective of our study was to replicate a patient's internet search in order to assess the appropriateness of ChatGPT, a novel machine learning tool released in 2022 that provides dialogue responses to queries, in comparison to Google Web Search, the most widely used search engine in the United States today, as a resource for patients for online health information. For the 2 different search engines, we compared i) the most frequently asked questions (FAQs) associated with total knee arthroplasty (TKA) and total hip arthroplasty (THA) by question type and topic; ii) the answers to the most frequently asked questions; as well as iii) the FAQs yielding a numerical response.

METHODS

A Google web search was performed with the following search terms: "total knee replacement" and "total hip replacement." These terms were individually entered and the first 10 FAQs were extracted along with the source of the associated website for each question. The following statements were inputted into ChatGPT: 1) "Perform a google search with the search term 'total knee replacement' and record the 10 most FAQs related to the search term" as well as 2) "Perform a google search with the search term 'total hip replacement' and record the 10 most FAQs related to the search term." A Google web search was repeated with the same search terms to identify the first 10 FAQs that included a numerical response for both "total knee replacement" and "total hip replacement." These questions were then inputted into ChatGPT and the questions and answers were recorded.

RESULTS

There were 5 of 20 (25%) questions that were similar when performing a Google web search and a search of ChatGPT for all search terms. Of the 20 questions asked for the Google Web Search, 13 of 20 were provided by commercial websites. For ChatGPT, 15 of 20 (75%) questions were answered by government websites, with the most frequent one being PubMed. In terms of numerical questions, 11 of 20 (55%) of the most FAQs provided different responses between a Google web search and ChatGPT.

CONCLUSION

A comparison of the FAQs by a Google web search with attempted replication by ChatGPT revealed heterogenous questions and responses for open and discrete questions. ChatGPT should remain a trending use as a potential resource to patients that needs further corroboration until its ability to provide credible information is verified and concordant with the goals of the physician and the patient alike.

Rhytidectomy-Information Patients Seek and Where They Find Answers

Patients considering rhytidectomy often search for information online prior to in-office consultation. This study identifies the most searched queries regarding rhytidectomy and evaluates sources to which patients are directed. The search engine optimization tool Ahrefs was utilized to extract Google metadata on searches performed in the United States. Frequently asked questions were categorized by topic; websites were categorized by type. Journal of the American Medical Association (JAMA) benchmark criteria enabled information quality assessment. A total of 565 questions for three search phrases were extracted (265 "facelift," 265 "face lift," and 35 "rhytidectomy"). The majority of monthly searches in the facelift and face lift groups pertained to procedural cost, which was significantly higher than in the rhytidectomy group (52.9% and 50.7 vs. 0.0%, ANOVA p <0.001). The mean JAMA score for private practice sources (1.2 ± 0.42) was significantly lower than that of academic pages of (2.3 ± 1.9, p = 0.026) and commercial sources (3.0 ± 0.82, p = 0.008). The most popular destinations for rhytidectomy were California and Mexico (630 and 440 searches/month). Online searches for facelifts often revolve around the topic of cost and frequently direct patients to websites that provide inadequate information on authorship, attribution, disclosure, and currency.

Assessing the Functional Accessibility, Actionability, and Quality of Patient Education Materials from Canadian Cancer Agencies

Patient education materials (PEM)s were extracted from provincial cancer agencies to determine their organizational health literacy by evaluating the quality, actionability, and functional accessibility (e.g., readability and understandability) of their PEMs. PEMs from 10 provincial agencies were assessed for their grade reading level (GRL), using eight numerical and two graphical readability scales, and underwent a difficult word analysis. The agencies were assessed for PEM quality using two methods (JAMA benchmarks and DISCERN), while actionability and understandability were assessed using the Patient Education Materials Assessment Tool (PEMAT). Seven hundred and eighty-six PEMs were analyzed. The overall average GRL was 9.3 ± 2.1, which is above the recommended 7th GRL for health information. The difficult word analysis showed that 15.4% ± 5.1% of texts contained complex words, 35.8% ± 6.8% of texts contained long words, and 24.2% ± 6.6% of texts contained unfamiliar words. Additionally, there was high overlap between the most frequently identified difficult words in the PEMs and the most frequently misunderstood words by cancer patients identified in the literature. Regarding quality indicators, no agency displayed all four indicators according to the JAMA benchmarks and DISCERN scores ranged between 38 (poor) to 66 (excellent). PEMAT scores ranged between 68% to 88% for understandability and 57% to 88% for actionability. PEMs continue to be written at a level above the recommended GRL across all provinces, and there was overall high variability in the quality, understandability, and actionability of PEMs among provincial agencies. This represents an opportunity to optimize materials, thus ensuring understanding by a wider audience and improving health literacy among Canadian cancer patients.

An Investigation of Google Searches for Knee Osteoarthritis and Stem Cell Therapy: What are Patients Searching Online?

Background

Stem cell therapies have emerged as a potential treatment for osteoarthritis (OA), but their role remains controversial. Their growing popularity may lead patients to search for information online, but search queries and sources are unknown.

Purpose

We sought to (1) identify the most frequently asked questions on Google related to knee OA and stem cell therapy, (2) assess the types of websites accessed through these searches, and (3) evaluate the transparency of these websites.

Methods

The search terms "knee," "osteoarthritis," and "stem cell" were entered into Google. Frequently asked questions suggested by Google, and their corresponding websites were extracted. Questions and websites were classified by type. Journal of the American Medical Association (JAMA) benchmark criteria were used as a measure of website transparency (range: 0-4). Analysis of variance tests were performed to compare JAMA benchmark criteria between website types.

Results

Of the 145 questions and website extracted, the most common question subtype pertained to non-stem cell treatments (41.4%) for knee OA; the most common website types were medical publishers (24.8%) and nonacademic medical practices (22.8%). JAMA scores were highest for medical publishers (mean: 3.81) and lowest for nonacademic medical practices (mean: 1.55). Nonacademic medical practices had significantly worse JAMA scores compared with commercial, academic, and medical publishers.

Conclusion

The most frequent questions pertained to non-stem cell treatments, although questions related to stem cell efficacy were most common among the 10 most frequent questions. Google searches on knee OA and stem cell therapies often directed the user to websites lacking transparency and verifiable information. Further research is warranted.

Trend Analysis of Global Web Searches (2004–2022) on Oral Cancer and Its Major Risk Factors

Background Oral cancer is the 15th leading cause of mortality globally. The Internet is an online source of information pertaining to oral cancer and its major risk factors. This study aims to analyze the trend of global online interest on oral cancer and its major risk factors through an analysis of web searches of oral cancer.

Materials and Methods This study analyzed the web searches conducted, from 2004 to January 2022, on oral cancer and its major risk factors (tobacco use, harmful alcohol use, and human papillomavirus [HPV] infection) using data obtained from Google Trends.

Results Within the time frame under study, oral cancer had multiple peak search periods, with the highest relative search volume index (SVI) for a period being 1; the peak search period for alcohol was March 2020 (SVI = 100); the peak search periods for tobacco were March to April 2004 (SVI = 17); and the peak search period of HPV was April 2004 (SVI = 1). Globally, alcohol was the most common searched term among these four terms (oral cancer, alcohol, tobacco, and HPV) except in Turkey where tobacco was the most common (55%) searched term. The top 25 search queries for oral cancer, HPV, tobacco, and alcohol had SVI ranges of 22 to 100, 12 to 100, 28 to 100, and 18 to 100, respectively. From these search queries, it was observed that people have interest in oral cancer symptomatology, and the adverse effects of tobacco, alcohol, and HPV.

Conclusion This study revealed an overall decline in the online interest on oral cancer and its major risk factors on a global scale.

The Quality of Online Information for the Treatment of Knee Osteoarthritis: A Google Study

Introduction

Affecting more than 30 million adults annually, osteoarthritis (OA) is the most common joint disorder in the United States. A variety of management options for knee OA exists, including physical therapy, weight loss, intra-articular corticosteroid injections, and total joint arthroplasty. With many treatments available, patients often utilize the internet to educate themselves about their condition and management options. The purpose of this study was to evaluate the quality, transparency, and readability of online information for the treatment of knee OA.

Methods

The search terms “knee,” “arthritis,” and “treatment” were entered into an incognito mode Google browser. Websites were classified by type (commercial, academic, nonacademic medical practice, government/patient advocacy, and other) and graded on content quality, transparency, and readability using the following scores, respectively: modified DISCERN, Journal of American Medical Association (JAMA) Benchmark, and Flesch-Kincaid (FK) grade level.

Results

Of the 95 websites evaluated, commercial (mean, 38.2) and academic (37.3) sites had the highest total DISCERN scores, which were significantly greater than nonacademic medical practice (31.8) and government/patient advocacy sites (33.4) (p≤0.035). Nonacademic medical practice sites had the lowest mean total DISCERN (31.8) and JAMA (1.47) scores and the highest FK grade level readability (9.5). There was a significant positive correlation between mean total DISCERN and JAMA scores (r=0.46, p<0.001).

Conclusion

The mean overall quality of websites regarding the treatment of OA was good as evidenced by greater modified DISCERN scores. However, website quality ranged from poor to excellent, indicating that some websites are still missing key information patients may find useful when assessing treatment options online.

Infodemiology for oral health and disease: A scoping review

INTRODUCTION

Increasing affordability, accessibility and penetration of internet services worldwide, have substantially changed the ways of gathering health-related information. This has led to the origin of concept infodemiology that allows the information to be collected and analysed in near real time. Globally, oral diseases affect nearly 3.5 billion people; thus, volume and profile of oral health searches would help in understanding specific community dental needs and formulation of pertinent oral health strategies.

AIM

To review the published literature on infodemiological aspects of oral health and disease.

METHODOLOGY

This scoping review was conducted in accordance with PRISMA-ScR guidelines. Electronic search engines (Google Scholar) and databases (PubMed, Web of science, Scopus) were searched from 2002 onwards.

RESULTS

Thirty-eight articles were included in this review. The infodemiological studies for oral health and disease were mainly used in two domains. Out of 38 articles, 24 accessed the quality of available online information and 15 studied online oral health-related information seeking behaviour.

CONCLUSION

The most commonly searched oral diseases were toothache, oral cancer, dental caries, periodontal disease, oral maxillofacial surgical procedures and paediatric oral diseases. Most of the studies belonged to developed countries and Google was the most researched search engine.

Sinus Surgery and Balloon Sinuplasty: What Do Patients Want to Know?

OBJECTIVE

Limited knowledge exists regarding the information patients seek online about sinus procedures. The goals of our study were to identify the most searched online queries regarding functional endoscopic sinus surgery (FESS) and balloon sinuplasty and evaluate the sources to which patients are directed.

STUDY DESIGN

Observational.

SETTING

Online Google Database.

METHODS

Google data were analyzed using the search engine optimization tool Ahrefs. People Also Ask (PAA) questions (extracted from Google searches) helped identify questions for analysis of search query volume. Search results were categorized into specific topics, and the source (eg, academic vs medical practice) of the information was identified. The JAMA benchmark criteria were used to determine the quality of the online resource.

RESULTS

The most searched term (average monthly queries) on Google was "sinus surgery" (13,190), followed by "balloon sinuplasty" (9212). For FESS and balloon sinuplasty, most questions focused on treatment of sinusitis (71.64% vs 79.19%) and preoperative inquiries about sinus issues (11.50% vs 11.35%). Answers to PAA questions for FESS were obtained from academic sources at a higher frequency compared to balloon sinuplasty (26.7% vs 10.3%, P = .016) but a lower frequency from medical practice websites (15.2% vs 29.3%, P = .042). The mean (SD) JAMA scores for FESS and balloon sinuplasty sources were 1.59 (1.46) and 1.40 (1.46), respectively.

CONCLUSION

There is a high volume of online search queries regarding FESS and balloon sinuplasty. The quality of the sources could be improved by addressing authorship, attribution, disclosure, and currency. This information may help otolaryngologists better address patient queries.

Google Search Analysis: What Do People Want to Know About Rhinoplasty and Where Do They Find the Answers?

Background: During online search queries, Google uses machine learning algorithms to provide frequently associated ("People Also Ask" [PAA]) questions with corresponding websites answering the question. We aimed to identify the most frequent questions about rhinoplasty asked online and the sources used to answer them. Materials and Methods: PAA questions were extracted for the terms "rhinoplasty," "nose surgery," and "nose job." Questions were categorized into specific topics. Websites were categorized by type and assessed for quality using Journal of the American Medical Association (JAMA) benchmark criteria. A search engine optimization tool determined search volume for individual questions and specific topics. Results: Internet searches for the PAA questions (n = 102) and associated websites were related to preoperative factors (46%), cost (35.7%), and recovery timeline (7.3%). Sources for the answers to PAA questions were single surgeon personal (39.3%) and medical practice (20.6%) websites. Conclusions: Surgeons may wish to emphasize specific patient education topics, including preoperative factors, cost, and recovery timeline, on their websites to address the most frequently sought-after information regarding rhinoplasty online.

The quality of Internet information relating to 2019-nCov transmission control in dental practice

Background

To date, the quality of the Internet information regarding the control and management of 2019-nCov virus transmission in dental clinics has not been evaluated. The aim of this study was to evaluate the quality of Internet information about the control of 2019-nCov transmission in dental practice.

Material and Methods

Internet websites were identified daily using two search engines: Google and Yahoo! during the week from 20-06-2020 to 26-06-2020, applying the search term "2019-nCov transmission control in dental practice." The first 100 consecutive sites identified in each search were visited and classified. The quality of information contained in each website was analyzed using the Journal of the American Medical Association (JAMA) benchmarks, whether the website had been granted the Health on the Net Foundation Code of Conduct (HONcode), and a new tool for evaluating the quality of Internet websites providing information relating to 2019-nCov transmission control in dental practice, which awards a score of 0-40 points (8-13: poor; 14-26: medium; and 27-40 high).

Results

After the exclusion of duplicates, non-functioning websites, books/journals, irrelevant websites, or websites not in English, a total of 30 websites were evaluated. Only 6.66% fulfilled all four JAMA benchmarks, none had been granted the HONcode, and only 10% presented high quality information.

Conclusions

The quality of Internet information about 2019-nCov transmission control in dental practice is poor. This study points to the need to improve the quality of information available on the Internet relating to 2019-nCov transmission control in dental practice. Key words:2019-nCov, COVID-19, transmission control in dental practice, Internet, quality of information.

Knowledge and Practice Regarding Oral Cancer: A Study Among Dentists in Jakarta, Indonesia

Objective

To assess Indonesian dentists' knowledge of risk factors and diagnostic procedures related to oral cancer (OC) and to determine the factors that influenced their level of knowledge.

Methods

A modified version of a questionnaire that had been used to assess dentists’ knowledge regarding OC in Canada was used. A total of 816 dentists were invited to participate in the study.

Results

The total response rate was 49.2%; however, the number of dentists from 5 regions in Jakarta were equally represented. Use of tobacco or alcohol and history of previous OC were the top 3 risk factors that were answered correctly by dentists, but there was a high proportion of dentists who considered some without any evidence as risk factors. Almost half of the dentists did not know the early signs of OC and that erythroplakia and leukoplakia were associated with increased risks of developing OC. Only about 27% of dentists had a high level of knowledge of risk factors and fewer dentists demonstrated a good knowledge of diagnostic procedures. Dentists’ age group, year of graduation, and experience of continuing education significantly influenced the level of knowledge of diagnostic procedures (P < .05).

Conclusion

Dentists in Jakarta had a considerable level of knowledge of major risk factors of OC, although some gaps in their knowledge, especially in diagnostic procedures, were present. Increasing these competencies may aid in the prevention and early detection of OC.

Content and Quality Analysis of Websites as a Patient Resource for Temporomandibular Disorders

Objective

The purpose of this study was to evaluate the content and quality of internet information resources in Turkey about temporomandibular disorders (TMDs).

Methods

In July 2020, the keywords "jaw joint disease" (çene eklemi rahatsızlığı) and "jaw joint pain" (çene eklemi ağrısı) were searched on Google, Bing, YAHOO!, and Yandex. The first 20 websites were listed for 2 keywords on the 4 search engines. Scientific articles, product websites, repetitive sites, advertisements, and irrelevant websites were excluded from the list. The remaining 77 websites were assessed using the Quality Criteria for Consumer Health Information (DISCERN), Global Quality Score (GQS) and Journal of American Medical Association (JAMA) benchmarks. The topics related to TMDs that were thought to be important in informing the patient were determined and the Temporomandibular Disorder Content Score (TMDCS) was calculated to evaluate whether these contents were available on the website.

Results

The sources of the 77 websites included dentists in private practice (6.5%, n=5), hospitals/polyclinics (32.5%, n=25), universities (6.5%, n=5), and others (54.5%, n=42). The total DISCERN scores of all websites included were poor (average score 26.96). Mean scores of JAMA, GQS, and TMDCS were 1.75, 2.31, and 8.4, respectively.

Conclusion

The quality and reliability of the information on the websites related to TMDs are poor. Clinicians should be aware that patients may have access to unreliable or incomplete information. There is a need for improvement on websites about TMDs, especially by professionals through imparting more comprehensive and reliable information.

COVID-19-Related Internet Search Patterns Among People in the United States: Exploratory Analysis

Background

The internet is a well-known source of information that patients use to better inform their opinions and to guide their conversations with physicians during clinic visits. The novelty of the recent COVID-19 outbreak has led patients to turn more frequently to the internet to gather more information and to alleviate their concerns about the virus.

Objective

The aims of the study were to (1) determine the most commonly searched phrases related to COVID-19 in the United States and (2) identify the sources of information for these web searches.

Methods

Search terms related to COVID-19 were entered into Google. Questions and websites from Google web search were extracted to a database using customized software. Each question was categorized into one of 6 topics: clinical signs and symptoms, treatment, transmission, cleaning methods, activity modification, and policy. Additionally, the websites were categorized according to source: World Health Organization (WHO), Centers for Disease Control and Prevention (CDC), non-CDC government, academic, news, and other media.

Results

In total, 200 questions and websites were extracted. The most common question topic was transmission (n=63, 31.5%), followed by clinical signs and symptoms (n=54, 27.0%) and activity modification (n=31, 15.5%). Notably, the clinical signs and symptoms category captured questions about myths associated with the disease, such as whether consuming alcohol stops the coronavirus. The most common websites provided were maintained by the CDC, the WHO, and academic medical organizations. Collectively, these three sources accounted for 84.0% (n=168) of the websites in our sample.

Conclusions

In the United States, the most commonly searched topics related to COVID-19 were transmission, clinical signs and symptoms, and activity modification. Reassuringly, a sizable majority of internet sources provided were from major health organizations or from academic medical institutions.

Modern Internet Search Analytics and Total Joint Arthroplasty: What Are Patients Asking and Reading Online?

BACKGROUND

Patients considering total joint arthroplasty often search for information online regarding surgery; however, little is known about the specific topics that patients search for and the nature of the information provided. Google compiles frequently asked questions associated with a search term using machine learning and natural language processing. Links to individual websites are provided to answer each question. Analysis of this data may help improve understanding of patient concerns and inform more effective counseling.

METHODS

Search terms were entered into Google for total hip and total knee arthroplasty. Frequently asked questions and associated websites were extracted to a database using customized software. Questions were categorized by topic; websites were categorized by type. JAMA Benchmark Criteria were used to assess website quality. Pearson's chi-squared and Student's t-tests were performed as appropriate.

RESULTS

A total of 620 questions (305 total knee arthroplasties, 315 total hip arthroplasties) were extracted with 602 associated websites. The most popular question topics were Specific Activities (23.5%), Indications/Management (15.6%), and Restrictions (13.4%). Questions related to Pain were more common in the TKA group (23.0% vs 2.5%, P < .001) compared to THA. The most common website types were Academic (31.1%), Commercial (29.2%), and Social Media (17.1%). JAMA scores (0-4) were highest for Government websites (mean 3.92, P = .005).

CONCLUSION

The most frequently asked questions on Google related to total joint arthroplasty are related to arthritis management, rehabilitation, and ability to perform specific tasks. A sizable proportion of health information provided originate from non-academic, non-government sources (64.4%), with 17.1% from social media websites.

Quality and readability of the dental information obtained by patients on Internet: criteria for selecting medical consultation websites

Background

The main objective of this study is to examine the quality of the information available for patients online with regards to the apicoectomy surgical procedure, both on general and critically selected websites. The hypothesis is that general websites has less quality than other that have been pre-selected.

Material and Methods

A search for the English term "apicoectomy” was performed online. The first 100 websites that appeared in both Google and Yahoo were analysed. Seven validated instruments were used for these two dimensions: quality (DISCERN, JAMA and EQIP), and readability (FRES, Fog Scale, FKRGL and SMOG).

Results

A total of 21 websites (10.5%) were selected. The readability of the websites in both groups was difficult or very difficult. With regards to the quality of the websites, the DISCERN instrument indicated an average value of 2.28 [2.14-2.39] for all of the websites, therefore indicating very low quality with serious defects; however, in the selected websites, the average quality was 3.16 [2.84-3.48], indicating potential, but not serious defects (p<0.001). There were statistically significant differences for the FRES values (p = 0.030), with a greater readability in the selected group of websites.

Conclusions

We believe that it is very important for the population to become aware of and learn how to use certain exclusion criteria when selecting medical consultation websites, as in doing so, they will be able to obtain a higher quality of information from these websites.

Key words:Apicoectomy, readability, DISCERN.

Quality of information about oral cancer in Brazilian Portuguese available on Google, Youtube, and Instagram

Background

To evaluate the quality of oral cancer information in Brazilian Portuguese on Google, YouTube, and Instagram.

Material and Methods

The first 100 links of each platform characterized the initial sample. The websites and Instagram were evaluated using the JAMA benchmarks, the Discern instrument, and the Flesch readability index (Flesch Reading Ease). The existence of Health on the Net (HON) code was also registered on websites. The usefulness of each video on YouTube was classified as not useful, slightly useful, moderately useful, or very useful.

Results

Thirty-four websites, 39 Instagram posts, and 57 videos were evaluated, of which 18 (33.3%) websites and 19 (48.7%) Instagram posts covered only 2 of the 4 JAMA benchmarks. For the Discern instrument, 20 (37%) and 18 (33.3%) websites exhibited low and moderate reliability, respectively, while 26 (66.7%) Instagram posts were of low confidence. The level of intelligibility of both websites and Instagram was difficult. Only three websites exhibited the HONcode. Forty-one (71.9%) videos on YouTube were moderately useful.

Conclusions

Information on oral cancer on the Internet in Brazilian Portuguese is of low quality. Thus, educational and governmental institutions have a responsibility to produce and indicate reliable sources of information for the population.

Key words:Access to information, internet, oral cancer.

Quality Assessment of Information on Oral Cancer Provided at Arabic Speaking Websites

BACKGROUND

Patients often use Inernet to explore information about their health and disease. This study aimed to evaluate the quality of information on oral cancer provided at Arabic websites.

MATERIAL AND METHOD

The translated Arabic keywords of "oral cancer" and treatment of oral cancer" and 6 search engines were used. The top 100 websites were selected. Irrelevant and duplicates websites were excluded. To evaluate the quality of websites and their information, DISCERN, HON, and JAMA benchmarks were used.

RESULTS

The majority (n = 64, 74.4%) of websites were founded by profit organizations. The mean overall rating was 2.23 (1.6) out of 5 and the median overall rating was 1 (1-3) based on DISCERN. According to HON, only 4.7% of the websites achieved a high score (≥75) and 37.2% of the websites gained a low score (<50). Based on JAMA benchmarks, 15% of the websites did not fulfill any criteria and only 2% of them fulfilled the four criteria proposed by the JAMA benchmarks.

CONCLUSION

This study suggested the poor quality of web-based Arabic information on oral cancer. It is recommended to develop a websites based system by which enable to the Arabic websites related to oral cancer know their shortfalls, therefore, improve their quality according to evaluation tools which will ensure finding reliable data from the websites.<br />.

Online health information and public knowledge, attitudes, and behaviours regarding antibiotics in the UK: Multiple regression analysis of Wellcome Monitor and Eurobarometer Data

Background

Antimicrobial resistance is a global public health problem with some socially patterned drivers. The objective of the study was to investigate associations between use of and trust in the Internet as a source of health-related information and the public’s knowledge, attitudes, and behaviours regarding antibiotics.

Methods

Two representative cross-sectional surveys (the 2015 Wellcome Monitor (n = 1524) and UK segment (n = 1330) of the 2016 Eurobarometer 85.1) covering knowledge about antibiotics and antibiotic consumption were analysed. Knowledge, attitude, and behaviour variables were analysed using regression in relation to demographic characteristics and use and trust in the Internet as a source of information.

Results

The key findings of the analysis are that both use of the Internet as a source of medical research information (variable from the Wellcome Monitor) and trust in the Internet as a source of information about antibiotics (variable from the Eurobarometer) were independently and positively associated with knowledge, attitude, and behaviour regarding antibiotics. Additionally, knowledge about antibiotics was positively associated with behaviour with antibiotics (Wellcome Monitor) and attitude towards finishing antibiotic prescriptions (Eurobarometer). Higher levels of education were associated with better knowledge about antibiotics in both datasets. Older age was positively associated with behaviour and attitude regarding antibiotic consumption.

Conclusions

The Internet is a resource for disseminating quality health information that has the potential to improve stewardship of antibiotics in the community. This study suggests that members of the UK public that use the Internet as a source of health-related information are more likely to be better informed about, and be more responsible with, antibiotics. This mode of information dissemination should be capitalised on to improve antimicrobial stewardship, and further research should examine what the most effective online information sources are in the UK and to what extent their association with behaviour is causal.

General Characteristics and Quality of Stroke-Related Online Information – A Cross-Sectional Assessment of the Romanian and Hungarian Websites

Background: The quality of online health-related information may affect users’ understanding and medical decision-making with dramatic impact, particularly in case of stroke. Objective: The objective of this study was to assess the quality of information about stroke on the Romanian and Hungarian websites in terms of completeness and accuracy. Methods: The research was designed as an observational cross-sectional study. The sample included 25 Romanian and 25 Hungarian websites presenting information about stroke for the general public. General characteristics such as website ownership, main goal, website genre and medical approach were identified by the evaluators using a predetermined set of common instructions. The completeness and accuracy of the information were assessed by two independent assessors against a quality benchmark. Results: Overall, most of the websites were owned by private commercial companies (42%), had educational goal (66%), were designed as medical web-portals (46%) and had a conventional medicine approach (72%). Mean completeness score was 5.6 points (SD± 1.9) for Romanian sites and 4.1 points (SD ± 2.4) for Hungarian sites (p = 0.017). Mean accuracy score was 6.2 points (SD ± 1.1) for Romanian sites and 7.0 points (SD ± 0.7) for Hungarian sites (p = 0.02). Conclusions: The information about stroke on the Romanian and Hungarian websites had poor quality. Although we found statistically significant differences between the quality scores of the two language sub-samples and two site characteristics associated with significantly higher quality, the practical relevance of these findings for online health information seekers should be interpreted with caution.

The Content and Quality of Health Information on the Internet for Patients and Families on Adult Kidney Cancer

The Internet is one of the major sources for health information for patients and their families, particularly when patients face serious life-threatening conditions such as kidney cancer in adults. In this study, we evaluate the content and quality of health information on adult kidney cancer using several validated instruments. We accessed the three most popular search engines (Google, Yahoo, Bing), using two terms: "kidney cancer" and "renal cell carcinoma," and reviewed the top 30 hits. After exclusion of duplicated websites, websites targeting health care professionals, and unrelated websites, 35 websites were included. Content was assessed using a 22-item checklist adapted from the American Cancer Society. We assessed website quality using the DISCERN questionnaire, HONcode and JAMA benchmark criteria, readability using three readability scores, and ALEXA for global traffic ranking systems. The average website had 16 of 22 content items while 6 websites fulfilled all 22 items. Among all websites, the average DISCERN quality score was 42 out of 80, 15 (42.8 %) of websites had HONcode certification, and only 3 (8.5 %) fulfilled all JAMA benchmark criteria. The average website readability was at the ninth grade reading level. The content and quality of health-related information on the Internet for adult kidney cancer are variable in comprehensiveness and quality. Many websites are difficult to read without a high school education. A standardized approach to presenting cancer information on the Internet for patients and families may be warranted.

Web-Based Information on the Treatment of Tobacco Dependence for Oral Health Professionals: Analysis of English-Written Websites

BACKGROUND

Studies have been conducted on the content and quality of Web-based information for patients who are interested in smoking cessation advice and for health care practitioners regarding the content of e-learning programs about tobacco cessation. However, to the best of our knowledge, there is no such information about the quality of Web-based learning resources regarding smoking cessation dedicated to oral health professionals.

OBJECTIVE

The aim of this study was to identify and evaluate the quality of the content of webpages providing information about smoking cessation for oral health care professionals.

METHODS

Websites were identified using Google and Health on Net (HON) search engines using the terms: smoking cessation OR quit smoking OR stop smoking OR 3As OR 5As OR tobacco counselling AND dentistry OR dental clinic OR dentist OR dental hygienist OR oral health professionals. The first 100 consecutive results of the 2 search engines were considered for the study. Quality assessment was rated using the DISCERN questionnaire, the Journal of the American Medical Association (JAMA) benchmarks, and the HON seal. In addition, smoking cessation content on each site was assessed using an abbreviated version of the Smoke Treatment Scale (STS-C) and the Smoking Treatment Scale-Rating (STS-R). To assess legibility of the selected websites, the Flesch Reading Ease (FRES) and the Flesch-Kinkaid Reading Grade Level (FKRGL) were used. Websites were also classified into multimedia and nonmultimedia and friendly and nonfriendly usability.

RESULTS

Of the first 200 sites selected (100 of Google and 100 of HON), only 11 met the inclusion criteria and mainly belonged to governmental institutions (n=8), with the others being prepared by Professional Associations (n=2) and nonprofit organizations (n=1). Only 3 were exclusively dedicated to smoking cessation. The average score obtained with the DISCERN was 3.0, and the average score in the FKRGL and FRES was 13.31 (standard deviation, SD 3.34) and 40.73 (SD 15.46), respectively. Of the 11 websites evaluated, none achieved all the four JAMA benchmarks. The mean score of STS-R among all the websites was 2.81 (SD 0.95) out of 5. A significant strong positive correlation was obtained between the DISCERN mean values and the STS-R (R=.89, P=.01).

CONCLUSIONS

The mean quality of webpages with information for oral health care professionals about smoking cessation is low and displayed a high heterogeneity. These webpages are also difficult to read and often lack multimedia resources, which further limits their usefulness.

[Information quality in general public French-speaking websites dedicated to oral cancer detection]

INTRODUCTION

The goal set by the French highest national authorities in the 2014-2019 Cancer Plan is to "heal more sick persons by promoting early diagnosis through screening". Screening requires information. Nowadays, Internet allows for access to information "in one click". The aim of our study was to evaluate the quality of information found on the Internet.

MATERIALS AND METHODS

Several sites dedicated to oral cavity cancer screening were selected on Google. The quality of health information found in these sites was evaluated by the DISCERN questionnaire. The quality of decision support provided by the sites was evaluated by the IPDAS checklist.

RESULTS

Twenty-seven sites were selected. The average DISCERN score was 25.1/75 (15/75 to 40/75). Eighteen sites (66.6%) had very poor, 8 sites (29.6%) had poor and 1 site had average information quality. IPDAS scores ranged from 11.1 to 38.1. Eight sites (29.6%) had less than 20%, 14 sites (51.9%) had between 20 and 30% and 5 sites (18.5%) had 30% or more validated criteria. No site achieved the pass mark.

DISCUSSION

The quality of general public French-speaking website dedicated to oral cancer detection is very bad. The role of health professionals such as general practitioners and head and neck surgeons, remains essential.

The Quality of Online Health-Related Information – an Emergent Consumer Health Issue

The Internet has become one of the main means of communication used by people who search for health-related information. The quality of online health-related information affects the users’ knowledge, their attitude, and their risk or health behaviour in complex ways and influences a substantial number of users in their decisions regarding diagnostic and treatment procedures.

The aim of this review is to explore the benefits and risks associated with using the Internet as a source of health-related information; the relationship between the quality of the health-related information available on the Internet and the potential risks; the multiple conceptual components of the quality of health-related information; the evaluation criteria for quality health-related information; and the main approaches and initiatives that have been implemented worldwide to help improve users’ access to high-quality health-related information.

Internet Websites for Chest Pain Symptoms Demonstrate Highly Variable Content and Quality

OBJECTIVE

Chest pain is a common symptom with causes that range from benign to serious. We assess the content and quality of websites about chest pain symptoms that describe its causes and when to seek care.

METHODS

We used five search engines (Google, Bing, Yahoo, Ask, AOL) using the term "chest pain" and assessed the first 30 websites that resulted from each search. We excluded websites that were diagnosis-driven, intended for physicians, patient blogs, advertisements, news, or videos. For included websites, we assessed for the presence of content potentially useful to patients with chest pain symptoms; website quality with three instruments (DISCERN, HONcode, and JAMA benchmark criteria); readability using four validated scores, accessibility, usability, and reliability using the LIDA instrument; and popularity using the Alexa tool.

RESULTS

In 27 included websites, 96 and 81% mentioned cardiac and noncardiac causes of chest pain, respectively, while 85% described when to seek emergency care. Only 51% of websites mentioned potential tests that might be used to diagnose symptoms, 22% described potential treatments, and 11% mentioned consequences if treatment is delayed or avoided. The median website DISCERN score was 23 (interquartile range [IQR] = 18-32) out of a possible 45 points, which can be interpreted as low to medium quality. A total of 44% of websites had HONcode certification, and only 11% fulfilled all four JAMA benchmark criteria. Average reading scores demonstrated that half of websites were above the eighth to ninth grade reading level. With LIDA, the average scores were "medium" for accessibility at 83% and usability at 59% and "low" for reliability at 43%.

CONCLUSIONS

Many websites that provide health information for patients about chest pain symptoms are not reliable. There is highly variable content and quality, and the average website is difficult to read for patients with low health literacy.

Trends in internet search activity, media coverage, and patient-centered health information after the FDA safety communications on surgical mesh for pelvic organ prolapse

INTRODUCTION

In July 2011, the US Food and Drug Administration (FDA) issued a safety communication regarding serious complications associated with surgical mesh for pelvic organ prolapse, prompting increased media and public attention. This study sought to analyze internet search activity and news article volume after this FDA warning and to evaluate the quality of websites providing patient-centered information.

METHODS

Google Trends™ was utilized to evaluate search engine trends for the term "pelvic organ prolapse" and associated terms between 1 January 2004 and 31 December 2014. Google News™ was utilized to quantify the number of news articles annually under the term "pelvic organ prolapse." The search results for the term "pelvic organ prolapse" were assessed for quality using the Health On the Net Foundation (HON) certification.

RESULTS

There was a significant increase in search activity from 37.42 in 2010 to 57.75 in 2011, at the time of the FDA communication (p = 0.021). No other annual interval had a statistically significant increase in search activity. The single highest monthly search activity, given the value of 100, was August 2011, immediately following the July 2011 notification, with the next highest value being 98 in July 2011. Linear regression analysis of news articles per year since the FDA communication revealed r² = 0.88, with a coefficient of 186. Quality assessment demonstrated that 42 % of websites were HON-certified, with .gov sites providing the highest quality information.

CONCLUSIONS

Although the 2011 FDA safety communication on surgical mesh was associated with increased public and media attention, the quality of relevant health information on the internet remains of poor quality. Future quality assurance measures may be critical in enabling patients to play active roles in their own healthcare.

The quality and readability of online consumer information about gynecologic cancer

OBJECTIVE

The Internet has become an important source of health-related information for consumers, among whom younger women constitute a notable group. The aims of this study were (1) to evaluate the quality and readability of online information about gynecologic cancer using validated instruments and (2) to relate the quality of information to its readability.

METHODS

Using the Alexa Rank, we obtained a list of 35 Web pages providing information about 7 gynecologic malignancies. These were assessed using the Health on the Net (HON) seal of approval, the Journal of the American Medical Association (JAMA) benchmarks, and the DISCERN instrument. Flesch readability score was calculated for sections related to symptoms and signs and treatment.

RESULTS

Less than 30% of the Web pages displayed the HON seal or achieved all JAMA benchmarks. The majority of the treatment sections were of moderate to high quality according to the DISCERN. There was no significant relationship between the presence of the HON seal and readability. Web pages achieving all JAMA benchmarks were significantly more difficult to read and understand than Web pages that missed any of the JAMA benchmarks. Treatment-related content of moderate to high quality as assessed by the DISCERN had a significantly better readability score than the low-quality content.

CONCLUSIONS

The online information about gynecologic cancer provided by the most frequently visited Web pages is of variable quality and in general difficult to read and understand. The relationship between the quality and readability remains unclear. Health care providers should direct their patients to reliable material online because patients consider the Internet as an important source of information.

Evaluation of Health on the Net seal label and DISCERN as content quality indicators for patients seeking information about thumb sucking habit

Aims:

The aim of this study was to evaluate the reliability of websites on the thumb sucking habit using DISCERN instrument and Health on the Net (HON) seal code at a single moment in time.

Subjects and Methods:

An Internet search engine (www.google.com) was used to identify websites comprising information on “thumb sucking habit.” Of over 204,000 links for thumb sucking habit, the first 100 were analyzed in detail. After excluding discussion groups, news and video feeds, and removing carbon copy sites, only 36 relevant websites remained, which were then assessed using the DISCERN instrument and HON seal code. Using the 16 questions of DISCERN for assessing the reliability and quality of the consumer information which were scored from 1 to 5, an appropriate index of the quality of the information was generated. All the assessed websites were also checked for presence or absence of HON seal code.

Results:

The maximum score attainable for an outstanding website is 80. Of the 36 websites that were scored the highest score obtained by one of the websites according to the DISCERN tool was 55 of 80, and the lowest score achieved was 16 of 80. The websites achieving the maximum and minimum score were children.webmd.com and thebehaviorsolution.com, respectively. The HON seal was displayed only in three websites, which were medicinenet.com, righthealth.com, and children.webmd.com.

Conclusions:

By directing patients to validated websites on the thumb sucking habit, clinicians can ensure patients find appropriate information.

How will I be after my operation for oral cancer?

Validated health-related quality of life measures for patients with oral cancer have been available for over a decade. We used the Liverpool head and neck cancer database to identify 1060 patients who had curative operations for primary squamous cell carcinoma of the head and neck at the regional maxillofacial unit between 1995 and 2010. We then produced one-page summary tables for subsites of oral cancer by stage and common treatments based on patient-reported outcomes from the University of Washington quality of life (UWQoL) head and neck cancer questionnaire. Data had been collected in a series of annual surveys. Sites included were buccal and retromolar (n=189), oral tongue (n=358), floor of the mouth (n=321), and other oral sites (n=192). A total of 633 patients completed at least one questionnaire (total 1931) between 9 and 60 months after treatment (71% of those alive at 9 months). Only questionnaires completed around 2 years from diagnosis or operation were analysed. Data include crude survival at 1, 2, and 5 years, the 12 UWQoL domains, which comprise the number of patients who chose the best 2 responses for each, overall health-related QoL, and the number who chose the worst responses (based on an algorithm). The data are sufficiently detailed to be used in discussions with patients about likely outcomes. They can help patients to make decisions about the type of treatment, provide a reference for realistic expectations, and enable them to be better informed when they give their consent.

Available web-based teaching resources for health care professionals on screening for oral cancer

Objectives: To identify websites with adequate information on oral cancer screening for healthcare professionals (HCPs) and to assess both their quality and contents. Study Design: Websites were identified using Google and HON medical professional search engines using the terms “screening for oral cancer”. The first 100 sites retrieved by each engine were analysed using the DISCERN questionnaire (reliability), the V instrument (contents on oral cancer) and further by the Flesch-Kinkaid Reading Grade Level and the Flesch Reading Ease (readability). Results: The overall rating showed minimal shortcomings in the quality of the information in the websites. The coverage and correctness of information on “visual examination” was rated as fair/good, whereas updating of contents resulted very variable (eg: 81% for visual examination and 18.2% for molecular biomarkers). These results permitted to rank the websites housing relevant information for oral cancer. Top ranking websites were affiliated to the Oral Cancer Foundation (USA), WHO Collaborating Centre for oral cancer (UK) whose webpage is entitled “Oral Cancer Education and Research”, and the Clinical Guidelines maintained by the British Columbia Cancer Agency (Canada) and the British Dental Association (UK) respectively. Conclusions: There are web-based, HCP-addressed, resources on screening for oral cancer housing heterogeneous information both in quality and contents. The use of specific evaluation tools permits the selection of reliable websites on this topic with a potential to improve the existing educational gaps among HCPs.

Key words:Oral cancer, early diagnosis, screening, secondary prevention, internet, teaching resources, continuous education.

Is Wikipedia a reliable learning resource for medical students? Evaluating respiratory topics

The aim of the present study was to critically evaluate the accuracy and readability of English Wikipedia articles on the respiratory system and its disorders and whether they can be a suitable resource for medical students. On April 27, 2014, English Wikipedia was searched for articles on respiratory topics. Using a modified DISCERN instrument, articles were independently scored by three assessors. The scoring targeted content accuracy, frequency of updating, and quality of references. The readability of articles was measured using two other instruments. The mean DISCERN score for the 40 articles identified was 26.4±6.3. Most articles covered causes, signs and symptoms, prevention, and treatment. However, several knowledge deficiencies in the pathogenesis of diseases, investigations needed, and treatment were observed. The total number of references for the 40 articles was 1,654, and the references varied from 0 to 168 references, but several problems were identified in the list of references and citations made. The readability of articles was in the range of 9.4±1.8 to 22.6±10.7 using the Flesch-Kincaid Grade Level instrument and 10.0±2.6 to 19.6±8.3 using the Readability Coleman-Liau index. A strong correlation was found between the two instruments (r2=0.744, P<0.001). The agreement between the assessors had mean κ scores in the range of 0.712-0.857. In conclusion, despite the effort placed in creating Wikipedia respiratory articles by anonymous volunteers (wikipedians), most articles had knowledge deficiencies, were not accurate, and were not suitable for medical students as learning resources.

A Methodology to Analyze the Quality of Health Information on the Internet

Purpose

The purpose of this work was to evaluate the criteria used to assess the quality of information on diabetic neuropathy on the Internet.

Methods

Different search engines (Google, Yahoo, Bing, and Ask) and 1 governmental health website (MedlinePlus) were studied. The websites returned (200 for each search engine) were then classified according to their affiliation (eg, commercial, professional, patient groups). A scoring system was devised from the literature to assess quality of information. Websites were also analyzed using the 2 most widely used instruments for assessing the quality of health information, the Journal of the American Medical Association (JAMA) scoring system and the Health On the Net Foundation (HON) certification.

Results

Professional websites or health portals scored better according to most criteria. Google and MedlinePlus returned results scoring significantly higher than other engines in some of the criteria. The use of different instruments gave different results and indicates that the JAMA score and the HON certification may not be sufficient ones.

Conclusions

This methodology could be used to evaluate the reliability and trustworthiness of information on the Internet on different topics to identify topic areas or websites where the available information is not appropriate.

The quality of health information on allergic rhinitis, rhinitis, and sinusitis available on the internet

Purpose

The internet has become one of the most important media outlets used to obtain health information. Therefore, the quality of health information available on the internet is very important. We evaluated the quality of internet-derived health information on allergic rhinitis, rhinitis and sinusitis and compared these results to those of previous studies performed five years ago.

Methods

The terms "allergic rhinitis (AR)", "rhinitis" and "sinusitis" were searched among the four most commonly used search engines in South Korea. These websites were evaluated according to the author, the Journal of the American Medical Association (JAMA) benchmarks, the DISCERN questionnaire and the Allergic rhinitis and its Impact on Asthma (ARIA) 2008 Update.

Results

A total of 120 websites were obtained and analyzed. For all diseases, "Oriental physician" had the largest portion (almost half of all websites), followed by "Western physician". Based on analyses using the JAMA benchmark, "Attribution" and "Disclosure" were ignored in almost all surveyed websites. According to the scores of the DISCERN question, the majority of websites did not supply appropriate references for their health information, and information on the negative aspects of treatment such as risks and uncertainty was not provided in several websites. In an analysis based on the ARIA 2008 Update concepts, 65% of websites pertaining to health information on AR contained unreliable information.

Conclusions

The quality of health information on the internet was not acceptable. Thus, governmental regulation or control to improve the quality of health information is required.

Tongue lesions

BACKGROUND

Some authors have shown that tongue lesions represent an important segment of oral mucosal lesions group, with prevalence varying among epidemiologic studies from different countries.

OBJECTIVES

The aim of this study was to describe the prevalence of tongue lesions in a Brazilian population.

METHODS

A collaborative study was conducted using data from 5 anatomic pathology services in Brazil. After data collection, these tongue lesions were separated in 4 groups: G1/malignant tumors, G2/benign tumors, G3/reactive lesions, and G4/other lesions.

RESULTS

Analysis of 6231 specimens for which oral biopsy was performed showed 760 cases (12.2%) diagnosed in the tongue. From this total, 306 cases (40.3%) occurred in females, and 454 (59.7%) occurred in males. Ages ranged from 3 to 93 years, with a global average of 45.3 years. The largest numbers of cases were represented by reactive lesions (44.6%), followed by benign tumors (27.9%), malignant tumors (18.6%), and other lesions (8.9%).

CONCLUSIONS

Tongue diseases were more common in male patients, and most of them were reactive lesions or benign neoplasms, but 18.6% were malignant neoplasms. The occurrence of malignant neoplasm increased notably with age.