Evaluating the quality of Internet information for femoroacetabular impingement

Evaluating the Quality of Cancer-Related WeChat Public Accounts: Cross-Sectional Study

BACKGROUND

WeChat (Tencent) is one of the most important information sources for Chinese people. Relevantly, various health-related data are constantly transmitted among WeChat users. WeChat public accounts (WPAs) for health are rapidly emerging. Health-related WeChat public accounts have a significant impact on public health. Because of the rise in web-based health-seeking behavior, the general public has grown accustomed to obtaining cancer information from WPAs. Although WPAs make it easy for people to obtain health information, the quality of the information is questionable.

OBJECTIVE

This study aims to assess the quality and suitability of cancer-related WeChat public accounts (CWPAs).

METHODS

The survey was conducted from February 1 to 28, 2023. Based on the WPA monthly list provided by Qingbo Big Data, 28 CWPAs in the WeChat communication index were selected as the survey sample. Quality assessment of the included CWPAs was performed using the HONcode instrument. Furthermore, suitability was measured by using the Suitability Assessment of Materials. A total of 2 researchers conducted the evaluations independently.

RESULTS

Of the 28 CWPAs, 12 (43%) were academic and 16 (57%) were commercial. No statistical difference was found regarding the HONcode scores between the 2 groups (P=.96). The quality of the academic and commercial CWPAs evaluated using the HONcode instrument demonstrated mean scores of 5.58 (SD 2.02) and 5.63 (SD 2.16), respectively, corresponding to a moderate class. All CWPAs' compliance with the HONcode principles was unsatisfactory. A statistically significant difference between the 2 groups was observed in the Suitability Assessment of Materials scores (P=.04). The commercial WPAs reached an overall 55.1% (SD 5.5%) score versus the 50.2% (SD 6.4%) score reached by academic WPAs. The suitability of academic and commercial CWPAs was considered adequate.

CONCLUSIONS

This study revealed that CWPAs are not sufficiently credible. WPA owners must endeavor to create reliable health websites using approved tools such as the HONcode criteria. However, it is necessary to educate the public about the evaluation tools of health websites to assess their credibility before using the provided content. In addition, improving readability will allow the public to read and understand the content.

The quality of online information on Legg-Calvé-Perthes disease: can we do better?

INTRODUCTION

As patients increasingly utilize the Internet to obtain health-related information, the accuracy and usability of information prove critical, especially for patients and parents seeking care for relatively common orthopedic childhood disorders such as Legg-Calvé-Perthes (LCP) disease. Therefore, the purpose of this study is to evaluate available online health information regarding LCP disease. The study specifically seeks to (1) examine the accessibility, usability, reliability, and readability of online information, (2) compare the quality of sites from different sources, and (3) determine whether Health on the Net Foundation Code (HON-code) certification guarantees higher quality of information.

MATERIALS AND METHODS

Websites from a query of both Google and Bing were compiled and scored using the Minervalidation tool (LIDA), an appraisal tool quantifying website quality, along with the Flesch-Kinkaid (FK) analysis, a metric assessing readability of content. All sites were organized based on source category [academic, private physician/physician group, governmental/non-profit organization (NPO), commercial, and unspecified] and HON-code certification.

RESULTS

Physician-based and governmental/NPO sites had the highest accessibility, the unspecified site group were the most reliable and usable, and the physician-based group was found to require the least education to comprehend. Unspecified sites had a significantly higher rating of reliability than physician sites (p = 0.0164) and academic sites (p < 0.0001). HON-code-certified sites were found to have greater scores across quality domains along with being easier to read compared to sites without certification, with significantly higher reliability scoring (p < 0.0001).

CONCLUSIONS

As a whole, information on the Internet regarding LCP disease is of poor quality. However, our findings also encourage patients to utilize HON-code-certified websites due to their significantly higher reliability. Future studies should analyze methods of improving this publicly available information. Additionally, future analyses should examine methods for patients to better identify reliable websites, as well as the best mediums for optimized patient access and comprehension.

Patient education information material assessment criteria: A scoping review

BACKGROUND

Patient education information material (PEIM) is an essential component of patient education programs in increasing patients' ability to cope with their diseases. Therefore, it is essential to consider the criteria that will be used to prepare and evaluate these resources.

OBJECTIVE

This paper aims to identify these criteria and recognize the tools or methods used to evaluate them.

METHODS

National and international databases and indexing banks, including PubMed, Scopus, Web of Science, ProQuest, the Cochrane Library, Magiran, SID and ISC, were searched for this review. Original or review articles, theses, short surveys, and conference papers published between January 1990 and June 2022 were included.

RESULTS

Overall, 4688 documents were retrieved, of which 298 documents met the inclusion criteria. The criteria were grouped into 24 overarching criteria. The most frequently used criteria were readability, quality, suitability, comprehensibility and understandability.

CONCLUSION

This review has provided empirical evidence to identify criteria, tools, techniques or methods for developing or evaluating a PEIM. The authors suggest that developing a comprehensive tool based on these findings is critical for evaluating the overall efficiency of PEIM using effective criteria.

Growing Taller without Hormones? Dr. Consult Google-An Evaluation of Online Information Related to Limb Lengthening

PURPOSE

The aim of this study was to investigate the reliability, content and readability of the information available on the Internet related to limb lengthening surgeries, which have recently been progressively in fashion.

METHODS

The three most commonly used browsers on the Internet were determined and a search term for "Limb Lengthening Surgery" was typed for each browser. The websites were categorized by their type, and the content and the quality of them was evaluated using the DISCERN score, the Journal of American Medical Association (JAMA) benchmark and the Global Quality Score (GQS). The Flesch Kincaid Grade Level (FKGL) and the Flesch Reading Ease Score (FKRS) were used to evaluate the readability. Each website also assessed the presence (or absence) of the Health on Net (HON) code.

RESULTS

The academic category was found to be significantly higher than the medical and commercial categories. Mean FKGL and FCRS scores, DISCERN score values, JAMA, GQS and LLCS score values of Websites with HON code were significantly higher than those without.

CONCLUSIONS

The quality of online information related to limb lengthening was of low quality. Although some websites, especially academic resources, were of higher quality, the readability of their content is just about 2.5 degrees higher than the sixth-grade reading level.

Internet and Social Media Contribute to Medical Research Journal Growth

In 2010, our editorial team wrote about the Internet's inarguable role in overloading information on our readers. In this editorial, we reflect on insights gained, mostly in the past decade, regarding the Internet and social media. Medical and surgical information online is easy to obtain, but it varies from platform to platform, is low in quality and reliability, and overestimates the public's ability to decipher the information. Physicians do not use social media enough, or well. Social media can engage patients and can inform patients about the quality of medical and surgical information online. Physicians, themselves, can provide reliable information that informs patients and eases their minds. Physician-authors can use social media to develop communities with shared interests in research; members of these communities can post research findings and highlight the publications in which they find them. Discussion of research online increases the likelihood that it will be cited. It is no surprise that the Internet and social media have contributed to the growth of Arthroscopy; Arthroscopy Techniques; and Arthroscopy, Sports Medicine, and Rehabilitation.

Can Patients Read, Understand, and Act on Online Resources for Anterior Cruciate Ligament Surgery?

Background:

Patients undergoing elective procedures often utilize online educational materials to familiarize themselves with the surgical procedure and expected postoperative recovery. While the Internet is easily accessible and ubiquitous today, the ability of patients to read, understand, and act on these materials is unknown.

Purpose:

To evaluate online resources about anterior cruciate ligament (ACL) surgery utilizing measures of readability, understandability, and actionability.

Study Design:

Cross-sectional study; Level of evidence, 4.

Methods:

Using the term “ACL surgery,” 2 independent searches were performed utilizing a public search engine (Google.com). Patient education materials were identified from the top 50 results. Audiovisual materials, news articles, materials intended for advertising or medical professionals, and materials unrelated to ACL surgery were excluded. Readability was quantified using the Flesch Reading Ease, Flesch-Kincaid Grade Level, Simple Measure of Gobbledygook, Coleman-Liau Index, Automated Readability Index, and Gunning Fog Index. The Patient Education Materials Assessment Tool for Printable Materials (PEMAT-P) was utilized to assess the actionability and understandability of materials. For each online source, the relationship between its Google search rank (from first to last) and its readability, understandability, and actionability was calculated utilizing the Spearman rank correlation coefficient (ρ_S).

Results:

Overall, we identified 68 unique websites, of which 39 met inclusion criteria. The mean Flesch-Kincaid Grade Level was 10.08 ± 2.34, with no website scoring at or below the 6th-grade level. Mean understandability and actionability scores were 59.18 ± 10.86 (range, 33.64-79.17) and 34.41 ± 22.31 (range, 0.00-81.67), respectively. Only 5 (12.82%) and 1 (2.56%) resource scored above the 70% adequate PEMAT-P threshold mark for understandability and actionability, respectively. Readability (lowest P value = .103), understandability (ρ_S = –0.13; P = .441), and actionability (ρ_S = 0.28; P = .096) scores were not associated with Google rank.

Conclusion:

Patient education materials on ACL surgery scored poorly with respect to readability, understandability, and actionability. No online resource scored at the recommended reading level of the American Medical Association or National Institutes of Health. Only 5 resources scored above the proven threshold for understandability, and only 1 resource scored above it for actionability.

Stem Cells in Orthopedic Web Information: An Assessment with the DISCERN Tool

OBJECTIVE

Regenerative medicine is experiencing a strong expansion worldwide, including the treatment of some common orthopedic pathologies, with an increase in physicians adopting these technologies. This growing interest has been associated with an equally significant spread of websites dedicated to public information on this topic, often lacking scientific bases. This study aims to evaluate the quality of information on the World Wide Web about stem cells for cartilage disorders in orthopedic practice.

DESIGN

On February 19, 2021 we performed a search on Google using as keywords "cartilage stem cells," considering only the freely accessible sites in Italian, English, French, and Spanish. We selected the first 50 valid results for each language and evaluated them using the DISCERN scale.

RESULTS

A total of 249 sites were observed, of which 49 were discarded as duplicates (8) or not relevant to the topic (41). Of the 200 sites surveyed, 47 were affiliated to a singular surgeon (23.5%), 31 to private stakeholders (15.5%), 73 to information sites (36.5%), 8 to public hospitals (4%), 13 to universities (6.5%), and 28 referred to international scientific journals (14%). Only 76 sites (38%) were rated as fair or better, while the remaining 124 (62%) were classified as poor or very poor.

CONCLUSIONS

The quality of the information promoted for stem cells in orthopedics is generally low, although a significant minority of the sites offers good quality information. A greater commitment on the part of surgeons and other stakeholders is desirable to promote information on regenerative medicine through scientific criteria supported by adequate literature.

Robotic-Assisted Total Knee Arthroplasty: An Assessment of Content, Quality, and Readability of Available Internet Resources

BACKGROUND

The use of robotic-assisted total knee arthroplasty (TKA) has significantly increased over the past decade. Internet content is largely unregulated and may contain inaccurate and/or misleading information about robotic TKA. Our goal was to assess the content, quality, and readability of online material regarding robotic-assisted TKA.

METHODS

We conducted an internet search for the top 50 web sites from each of the 3 most popular search engines (Google, Yahoo, and Bing) using the search term robotic total knee replacement. Each web site was assessed for content, quality, and readability. Web site quality was assessed utilizing the QUality Evaluation Scoring Tool (QUEST). Readability was assessed utilizing the Simple Measure of Gobbledygook, Flesch-Kincaid Grade Level, and Flesch Reading Ease Formula scores.

RESULTS

General risks of TKA were discussed in 47.2%, while benefits were discussed in 98.6% of all web sites. Inaccurate claims occurred at a significantly higher rate in physician/community hospital sources compared to university/academic web sites (59% vs 28%, P = .045). Web sites from university/academic web sites had the highest QUEST scores, while physician/community hospital sources scored the lowest (16.1 vs 10.6, P = .01). Most web sites were written at a college reading level or higher.

CONCLUSION

Patients should be counseled on the largely unregulated nature of online information regarding robotic-assisted TKA. Physicians and hospitals should consider revising the readability of their online information to a more appropriate level in order to provide accurate, evidence-based information to allow the patient to make an informed consent decision.

Are health websites credible enough for elderly self-education in the most prevalent elderly diseases?

BACKGROUND

The Elderly and their caregivers need credible health information to manage elderly chronic diseases and help them to be involved in health decision making. In this regard, health websites are considered as a potential source of information for elderlies as well as their caregivers. Nevertheless, the credibility of these websites has not been identified yet. Thus, this study aimed to evaluate the credibility of the health websites on the most prevalent chronic diseases of the elderly.

METHODS

The terms "Chronic obstructive pulmonary disease", "Alzheimer's", "Ischemic heart disease", and "Stroke" were searched using the three popular search engines. A total of 216 unique websites were eligible for evaluation. The study was carried out using the HONcode of conduct. The chi-square test was carried out to determine the difference between conforming and nonconforming websites with HONcode principles and website categories.

RESULTS

The findings showed that half of the evaluated websites had fully considered the HONcode principles. Furthermore, there was a significant difference between websites category and compliance with HONcode principles (p value < .05).

CONCLUSION

Regarding the poor credibility of most prevalent elderly diseases' websites, the potential online health information users should be aware of the low credibility of such websites, which may seriously threaten their health. Furthermore, educating the elderly and their caregivers to evaluate the credibility of websites by the use of popular tools such as HONcode of conducts before utilizing their information seems to be necessary.

The quality of non-alcoholic fatty liver disease information resources for patients on the internet in Korea

BACKGROUND/AIMS

Many patients uses the internet to obtain information about their diseases. However, there is increasing concern regarding the quality of internet information. Thus, we aimed to systematically evaluate the quality of websites containing educational information about non-alcoholic fatty liver disease (NAFLD) in Korea.

METHODS

Naver, Daum, and Google search engines were searched using the term "non-alcoholic fatty liver disease" in Korean. Two reviewers independently evaluated website quality using the quality evaluation instrument (QEI), which awarded websites scores for specific information on various aspects of NAFLD, as well as a five-point Likert scale (1-5), the DISCERN instrument, and a global quality scale (GQS).

RESULTS

Forty-seven websites met the inclusion criteria. We found that the quality of the internet information about NAFLD is generally poor. The mean QEI score with standard deviation was 10.31 ± 5.09 (range, 4 to 22), with only 17% of websites scoring higher than 10 points. The median GQS of the websites was 2.0, with no website achieving a score of 4 or 5. The QEI score was highly associated with the GQS score (r = 0.74, p < 0.01). For each DISCERN question from question 1 to question 15, the mean score was less than 3.

CONCLUSION

Overall, the internet health information for patients regarding NAFLD is poor and in need of much improvement. There is a need for institutional support, qualitative regulation of internet information, and development of an accreditation system to provide patients with internet health information of appropriate quality.

Evaluating the Quality and Readability of Online Resources for Labiaplasty

OBJECTIVES

The aim of this study was to evaluate the quality, readability, and accuracy of Web-based information regarding labiaplasty and to characterize the types of Web sites providing this information.

METHODS

Investigators used 3 major search engines to query the internet using the search terms labiaplasty, labia reduction, and vaginal rejuvenation. Two validated tools were used to evaluate Web sites: the JAMA benchmark tool and the DISCERN instrument. Three physicians independently reviewed each Web site. Interrater agreement was assessed, and reviewer scores were averaged. Flesch-Kincaid reading ease and Flesch-Kincaid grade level of each site were assessed. Data were analyzed using Stata 14.0 (College Station, TX).

RESULTS

Of the 112 Web sites reviewed, 100 Web sites were from North America, 9 from Europe, 2 from Australia, and 1 from Asia. The median score using the JAMA tool was 1.0 (0.33-4.0), indicating low accountability, whereas the median score using the DISCERN tool was 28 (18.7-77) of 80 with higher scores indicating higher quality. Cohen's weighted κ statistic (0.81) demonstrated near perfect agreement among reviewers for DISCERN scores. The median reading level was 11.9 (6.4-19.5). A majority of the Web sites (92) were for-profit businesses or blogs.

CONCLUSIONS

The internet enables patients to research sensitive topics and seek answers without worry of social stigma. Online health-related information is a widely used yet poorly studied source of medical information. The majority of Web sites reviewed lack balanced, evidence-based information. Given the wide variation in the quality of information, physicians should guide patients to reputable online resources.

Online Resources for Rotator Cuff Repair: What are Patients Reading?

Purpose

The purpose of this study was to use a novel scoring system to evaluate the content and grade the quality of websites that patients may use to learn about rotator cuff repair.

Methods

Two search terms (“rotator cuff repair” and “rotator cuff surgery”) were entered into 3 Internet search engines (Google, Yahoo, and Bing). We scored the quality of information using a novel scoring system. Website quality was further assessed by the Journal of the American Medical Association (JAMA) benchmark criteria and Health on the Net Foundation (HON) code certification. The readability of the websites was evaluated with the Flesch-Kincaid score.

Results

We evaluated 47 websites. The average quality for all websites was 6.47 ± 5.21 (maximum 20 points). There was a large difference in scores between the top 5 websites and the remaining websites (16.30 vs 5.51, P < .001). There was no difference in scores when comparing the 3 different search engines (P = .85). The mean reading level was 10.17 ± 2.24. Reading level was not significantly correlated with quality (r_s = 0.14, P = .36). The average JAMA benchmark criteria score for all websites was 2.34 ± 1.11 (maximum 4 points). JAMA criteria score was not significantly correlated with quality (r_s = 0.02, P = .91). Sites without HONcode certification had higher quality scores (8.33 ± 4.80) than sites with HONcode certification (6.18 ± 4.66), but this difference was not statistically significant (P = .15).

Conclusion

The quality of patient-level information on rotator cuff repair on the Internet is both incomplete and written at a reading level higher than current recommendations. Information quality is not significantly correlated with reading level or JAMA criteria, and does not depend on the search term used or HONcode certification.

Clinical Relevance

Patients having rotator cuff repair may seek information on the Internet; the information may require surgeon clarification.

Evaluation of the accuracy and availability of cancer-related physical activity and sedentary behaviour information on English-language websites

PURPOSE

To assess the quality and accuracy of cancer-related physical activity (PA) and sedentary behaviour (SB) information provided on major cancer websites from English-speaking countries.

DESIGN

The study used a cross-sectional design.

SAMPLE

A list of major cancer websites (N = 11) was generated from countries that speak English primarily (e.g., Canada, Australia).

METHODS

These websites were assessed for quality and accuracy based on a detailed coding framework (e.g., PA guidelines, PA and cancer prevention). Frequencies and descriptive statistics were derived for website characteristics of interest.

FINDINGS

All sites reviewed within this study offered PA information for cancer prevention and cancer survivorship. However, while 81% of the sites presented information for SB and cancer prevention, very little information was presented for SB and cancer survivorship, with only 18.2% of the information being offered.

CONCLUSIONS

The quality and accuracy of cancer-related PA and SB information presented on leading cancer websites is variable. Further information is warranted in the areas of SB, resistance training, and behaviour change strategies.

IMPLICATIONS

Websites have considerable value as knowledge translation tools and, therefore, presenting evidence-based information that is easy to understand may positively impact the health and behaviours of cancer populations, as well as the general population.

Websites as a tool for public health education: determining the trustworthiness of health websites on Ebola disease

OBJECTIVES

Health service providers use internet as a tool for the spreading of health information and people often go on the web to acquire information about a disease. A wide range of information with varying qualities and by authors with varying degrees of credibility has thus become accessible by the public. Most people believe that the health information available on the internet is reliable. This issue reveals the need for having a critical view of the health information available online that is directly related to people's life. The Ebola epidemic is an emergency situation in the international public health domain and the internet is regarded as an important source for obtaining information on this disease. Given the absence of studies on the trustworthiness of health websites on Ebola, the present study was conducted to assess the trustworthiness of websites which are focused on this disease.

METHODS

The term "Ebola" was searched in Google, Yahoo and Bing search engines. Google Chrome browser was used for this purpose with the settings fixed on yielding 10 results per page. The first 30 English language websites in each of the three search engines were evaluated manually by using the HONcode of conduct tool. Moreover, the official HONcode toolbar was used to identify websites that had been officially certified by HON foundation. Results: Almost the half of the retrieved websites were commercial (49%). Complementarity was the least-observed criterion (37%) in all the websites retrieved from all three-search engines. Justifiability, Transparency and Financial Disclosure had been completely observed (100%).

DISCUSSION

The present study showed that only three criteria (Justifiability, Transparency and Financial Disclosure) out of the eight HON criteria were observed in the examined websites. Like other health websites, the websites concerned with Ebola are not reliable and should be used with caution.

CONCLUSION

Considering the lack of a specific policy about the publication of health information on the web, it is necessary for healthcare providers to advise their patients to use only credible websites. Furthermore, teaching them the criteria for assessing the trustworthiness of health websites would be helpful.

Editorial Commentary: Smarter Than a Sixth Grader? Hip Arthroscopists, Check Your Training at the Door

Literacy is one of the best predictors of an individual's health, and providing effective, patient-centered communication to our less literate patients has become a challenge for the entire medical community. The internet has become patients' first-line source of medical information, and as caretakers of musculoskeletal medicine, it is orthopaedists' responsibility to provide high-quality, patient-centric resources that are simple and clear. When creating our own practice or institution's websites, we must check our training and technicality at the door to create resources that are easily readable and digestible.

Minimally Invasive Spine Surgery: Analyzing Internet-based Education Material

STUDY DESIGN

This is a cross-sectional study.

OBJECTIVE

The purpose of this study is to evaluate the content of information available on the Internet regarding minimally invasive spine surgery (MISS).

SUMMARY OF BACKGROUND DATA

Patients look to the Internet for quick and accessible information on orthopedic procedures to help guide their personal decision making process regarding the care they receive. However, the quality of internet-based orthopedic education material varies significantly with respect to accuracy and readability.

MATERIALS AND METHODS

The top 50 results were generated from each of 3 search engines (Google, Yahoo!, and Bing) using the search term "minimally invasive spine surgery." Results were categorized by authorship type and evaluated for their description of key factors such as procedural benefits, risks, and techniques. Comparisons between search engines and between authorship types were done using the Freeman-Halton extension for the Fisher exact test. The content of websites certified by Health on the Net Foundation (HONcode) was compared with those not HONcode certified.

RESULTS

Of the 150 websites and videos, only 26% were authored by a hospital or university, whereas 50% were by a private physician or clinic. Most resources presented some benefits of MISS (84%, 126/150), but only 17% presented risks of the procedure (26/150). Almost half of all resources described the technique of MISS, but only 27% had thorough descriptions that included visual representations while 26% failed to describe the procedure. Only 12 results were HONcode certified, and 10 (83%) of these were authored by a medical industry company.

CONCLUSIONS

Internet-based resources on MISS provide inconsistent content and tend to emphasize benefits of MISS over risks.

The Assessment of Quality, Accuracy, and Readability of Online Educational Resources for Platelet-Rich Plasma

PURPOSE

To critically evaluate the quality, accuracy, and readability of readily available Internet patient resources for platelet-rich plasma (PRP) as a treatment modality for musculoskeletal injuries.

METHODS

Using the 3 most commonly used Internet search engines (Google, Bing, Yahoo), the search term "platelet rich plasma" was entered, and the first 50 websites from each search were reviewed. The website's affiliation was identified. Quality was evaluated using 25-point criteria based on guidelines published by the American Academy of Orthopaedic Surgeons, and accuracy was assessed with a previously described 12-point grading system by 3 reviewers independently. Readability was evaluated using the Flesch-Kincaid (FK) grade score.

RESULTS

A total of 46 unique websites were identified and evaluated. The average quality and accuracy was 9.4 ± 3.4 (maximum 25) and 7.9 ± 2.3 (maximum 12), respectively. The average FK grade level was 12.6 ± 2.4, which is several grades higher than the recommended eighth-grade level for patient education material. Ninety-one percent (42/46) of websites were authored by physicians, and 9% (4/46) contained commercial bias. Mean quality was significantly greater in websites authored by health care providers (9.8 ± 3.1 vs 5.9 ± 4.7, P = .029) and in websites without commercial bias (9.9 ± 3.1 vs 4.5 ± 3.2, P = .002). Mean accuracy was significantly lower in websites authored by health care providers (7.6 ± 2.2 vs 11.0 ± 1.2, P = .004). Only 24% (11/46) reported that PRP remains an investigational treatment.

CONCLUSIONS

The accuracy and quality of online patient resources for PRP are poor, and the information overestimates the reading ability of the general population. Websites authored by health care providers had higher quality but lower accuracy. Additionally, the majority of websites do not identify PRP as an experimental treatment, which may fail to provide appropriate patient understanding and expectations.

CLINICAL RELEVANCE

Physicians should educate patients that many online patient resources have poor quality and accuracy and can be difficult to read.

The poor quality and reliability of information on periacetabular osteotomy on the internet in Japan

Although many patients use the internet to access health-related information, the quality and the reliability of the information is highly inconsistent. Periacetabular osteotomy (PAO) is one of the surgical procedures for hip dysplasia. However, medical information on PAO is limited on the internet. This study aims to evaluate the quality and reliability of information available on PAO on the internet in Japan. A web search was conducted on two search engines for the following terms: “hip osteotomy,” “pelvic osteotomy,” and “osteotomy for hip preservation” in Japanese. In total, we found 120 websites. To determine the quality and reliability of information on each website, we used the Health on the Net Foundation (HON) score, the Brief DISCERN score, and an osteotomy-specific content (OSC) score. After eliminating duplicate websites, we reviewed 49 unique websites. Only three websites (6.1%) had good reliability, as indicated by their HON scores. Twelve websites (24.4%) had good-quality information, as measured by their Brief DISCERN scores. As evaluated by their OSC scores, physician websites were found to be biased toward etiology and surgical indication and did not provide information on the complications of procedures. Non-physician websites were generally insufficient. The information about PAO on the internet is, therefore, unreliable and of poor-quality for Japanese patients.

"Is There An App For That?" Orthopaedic Patient Preferences For A Smartphone Application

BACKGROUND

Patients are seeking out medical information on the Internet and utilizing smartphone health applications ("apps"). Smartphone use has exponentially increased among orthopaedic surgeons and patients. Despite this increase, patients are rarely directed to specific apps by physicians. No study exists querying patient preferences for a patient-centered, orthopaedic smartphone application.

OBJECTIVES

The purpose of this study is to 1) determine Internet use patterns amongst orthopaedic patients; 2) ascertain access to and use of smartphones; and 3) elucidate what features orthopaedic patients find most important in a smartphone application.

METHODS

We surveyed patients in an orthopaedic practice in an urban academic center to assess demographics, access to and patterns of Internet and Smartphone use, and preferences for features in a smartphone app.

RESULTS

A total of 310 surveys were completed. Eighty percent of patients reported Internet access, and 62% used the Internet for health information. Seventy-seven percent owned smartphones, 45% used them for health information, and 28% owned health apps. Only 11% were referred to an app by a physician. The highest ranked features were appointment reminders, ability to view test results, communication with physicians, and discharge instructions. General orthopaedic information and pictures or videos explaining surgery were the 2 lowest ranked features. Seventy-one percent of patients felt an app with some of the described features would improve their healthcare experiences, and 40% would pay for the app.

CONCLUSIONS

The smartphone is an under-utilized tool to enhance patient-physician communication, increase satisfaction, and improve quality of care. Patients were enthusiastic about app features that are often included in patient health portals, but ranked orthopaedic educational features lowest. Further study is required to elucidate how best to use orthopaedic apps as physician-directed educational opportunities to promote patient satisfaction and quality of care.

Internet resources for Tommy John injuries: what are patients reading?

BACKGROUND

The quality of medical information on the Internet has come under scrutiny. This study investigates the quality, accuracy, and readability of online information regarding ulnar collateral ligament (UCL) injuries.

METHODS

Three search terms ("elbow ulnar collateral ligament injury," "tommy john injury," and "pitcher's elbow") were entered into 3 Internet search engines. Three independent reviewers evaluated the content and accuracy of the information with a set of predetermined scoring criteria. Website quality was further assessed by the Journal of the American Medical Association benchmark criteria and Health on the Net Foundation certification. Website readability was ascertained with the Flesch-Kincaid score.

RESULTS

We evaluated 113 unique websites. The average quality for all websites was 8.88 ± 6.8 (maximum, 32 points). Website quality and accuracy were lower with use of the search term "pitcher's elbow" as compared with "elbow ulnar collateral ligament injury" or "tommy john injury" (P ≤ .001). Sites certified by the Health on the Net Foundation had higher quality scores than non-certified sites (P = .034). The mean reading grade level was 10.7. Reading level was significantly correlated with website accuracy and quality (P ≤ .001) and physician authorship (P = .012). Forty-three websites (38.1%) described surgical reconstruction; of these, 16 (37.2%) mentioned improved pitching performance postoperatively.

CONCLUSIONS

Online information on UCL injuries is often inaccurate and written at an inappropriate reading level. Information quality depends on the search term used, website authorship, and commercial bias. Clinicians must be aware of factors influencing website quality in order to direct patients to appropriate resources.

Editorial Commentary: Google It!-Reliability of Medical Information Found on the Internet

Patients use Google or other search engines to obtain information on various medical problems. This information is not always reliable, and physicians should direct patients to Web sites that are validated and reliable.

Assessment of Quality and Content of Online Information About Hip Arthroscopy

PURPOSE

The purpose of this study was to assess the quality of information available to patients on the Internet when using popular search engines to search the term "hip arthroscopy."

METHODS

We analyzed the quality and content of information about hip arthroscopy (HA) on the first 50 websites returned by the search engines Google and Bing for the search term "hip arthroscopy." The sites were categorized by type, and quality and content were measured using the DISCERN score, along with an HA-specific content score. The HA-specific content score was used to assess each website for the presence or absence of 19 topics about HA determined to be important for a patient seeking information about the procedure. The Health on the Net Code (HONcode) status of each website was also noted.

RESULTS

The mean DISCERN score for all websites analyzed was 39.5, considered "poor," while only 44.6% of sites were considered "fair" or "good." Governmental and nonprofit organization (NPO) websites had the highest average DISCERN score. The mean HA-specific content score was 8.6 (range, 2 to 16). The commercial website category had the highest average HA-specific content score, followed by the governmental and NPO category. Sites that bore the HONcode certification obtained significantly higher DISCERN scores than those without the certification (P = .0032) but did not obtain significantly higher HA-specific content scores.

CONCLUSIONS

"Hip arthroscopy" is a fairly general term, and there is significant variability in the quality of HA information available online. The HONcode is useful to identify quality patient information websites; however, it is not commonly used in HA-specific websites and does not encompass all quality websites about HA.

CLINICAL RELEVANCE

This study increases awareness of the quality of information on HA available online.

Quality of Web-based Information for the 10 Most Common Fractures

Background

In today's technologically advanced world, 75% of patients have used Google to search for health information. As a result, health care professionals fear that patients may be misinformed. Currently, there is a paucity of data on the quality and readability of Web-based health information on fractures.

Objectives

In this study, we assessed the quality and readability of Web-based health information related to the 10 most common fractures.

Methods

Using the Google search engine, we assessed websites from the first results page for the 10 most common fractures using lay search terms. Website quality was measured using the DISCERN instrument, which scores websites as very poor (15-22.5), poor (22.5-37.5), fair (37.5-52.5), good (52.5-67.5), or excellent (67.5-75). The presence of Health on the Net code (HONcode) certification was assessed for all websites. Website readability was measured using the Flesch Reading Ease Score (0-100), where 60-69 is ideal for the general public, and the Flesch-Kincaid Grade Level (FKGL; −3.4 to ∞), where the mean FKGL of the US adult population is 8.

Results

Overall, website quality was “fair” for all fractures, with a mean (standard deviation) DISCERN score of 50.3 (5.8). The DISCERN score correlated positively with a higher website position on the search results page (r²=0.1, P=.002) and with HONcode certification (P=.007). The mean (standard deviation) Flesch Reading Ease Score and FKGL for all fractures were 62.2 (9.1) and 6.7 (1.6), respectively.

Conclusion

The quality of Web-based health information on fracture care is fair, and its readability is appropriate for the general public. To obtain higher quality information, patients should select HONcode-certified websites. Furthermore, patients should select websites that are positioned higher on the results page because the Google ranking algorithms appear to rank the websites by quality.

Assessment of the Accuracy of Online Information Regarding Trigger Finger

Background: Review of the recent literature suggests substantial use of the Internet by patients seeking health care information despite questionable accuracy and readability of information presented on some websites. The purpose of our study was to assess the accuracy, quality, and readability of online information regarding trigger finger.

Methods: Three terms (“trigger finger”, “stenosing tenosynovitis”, and “finger locking”) were used to query three Internet search engines to evaluate websites regarding information about trigger finger. Three hand surgery fellows independently assessed website accuracy and quality using standardized scoring criteria. The Fleisch-Kincaid reading grade level score was used to assess website readability. Website authorship and commercial association were also noted.

Results: Sixty-nine unique websites were assessed. Internet information obtained using the search term “stenosing tenosynovitis” was written at a significantly higher reading level than information found using “finger locking” or “trigger finger”. Website quality and accuracy were both significantly better in websites authored by physicians compared to websites authored by non-physicians. However, website accuracy was significantly poorer in websites featuring commercial association. Additionally, websites presenting information written below the 8th grade reading level demonstrated poorer accuracy.

Conclusions: Search term has a significant effect on the readability of online information regarding trigger finger. Despite the terminology used in searches, most websites are largely inaccurate and may not be easily understandable by the general population. This demonstrates a substantial barrier to accessing accurate health care information and may impact patient outcomes. Hand surgeons should direct patients towards websites presenting accurate information with easily readable content.

Orthopaedic Patient Information on the World Wide Web: An Essential Review

BACKGROUND

Patients increasingly use the Internet to research health-related issues. Internet content, unlike other forms of media, is not regulated. Although information accessed online can impact patients' opinions and expectations, there is limited information about the quality or readability of online orthopaedic information.

METHODS

PubMed, MEDLINE, and Google Scholar were searched using anatomic descriptors and three title keywords ("Internet," "web," and "online"). Articles examining online orthopaedic information from January 1, 2000, until April 1, 2015, were recorded. Articles were assessed for the number of reviewers evaluating the online material, whether the article examined for a link between authorship and quality, and the use of recognized quality and readability assessment tools. To facilitate a contemporary discussion, only publications since January 1, 2010, were considered for analysis.

RESULTS

A total of thirty-eight peer-reviewed articles published since 2010 examining the quality and/or readability of online orthopaedic information were reviewed. For information quality, there was marked variation in the quality assessment methods utilized, the number of reviewers, and the manner of reporting. To date, the majority of examined information is of poor quality. Studies examining readability have focused on pages produced by professional orthopaedic societies.

CONCLUSIONS

The quality and readability of online orthopaedic information are generally poor.

CLINICAL RELEVANCE

For modern practices to adapt to the Internet and to prevent misinformation, the orthopaedic community should develop high-quality, readable online patient information.

Evaluating patient education material regarding unicompartmental knee arthroplasty

BACKGROUND

Variability in quality and accuracy of information has been well documented in other orthopedic procedures. Given the growing role of the Internet in patient education, it is important to assess the quality of material provided. The purpose of this study was to evaluate online patient education materials regarding unicompartmental knee arthroplasty (UKA).

METHOD

The first 50 websites generated from a search of the term, partial knee replacement, using three search engines, Google, Yahoo!, and Bing, were analyzed for quality, content, and authorship. Categorical data between the three search engines were compared using the Freeman-Halton extension for the Fisher's exact test. Fisher's exact test was used to compare categorical data between the search terms partial knee replacement and unicompartmental knee arthroplasty.

RESULTS

Most websites mentioned benefits of UKA (69%) but only a minority (39%) mentioned risks. A more technical search term, unicompartmental knee arthroplasty, yielded fewer websites authored by manufacturers/industry and miscellaneous sources (p=0.018 and p=0.039, respectively), more mentions of risks (p=0.0014), and more references to peer-reviewed literature (p=0.0026).

CONCLUSIONS

Overall, online information related to UKA is of questionable quality and may be geared more towards attracting patients than providing high-quality information.

Arthroscopy Up to Date: Hip Femoroacetabular Impingement

PURPOSE

To provide a comprehensive review and summary of the research published in Arthroscopy: The Journal of Arthroscopic and Related Surgery and The American Journal of Sports Medicine (AJSM) related to hip arthroscopy for femoroacetabular impingement (FAI).

METHODS

A comprehensive review was conducted in duplicate of Arthroscopy and AJSM from February 2012 to February 2015 for all articles related to FAI, and a quality assessment was completed for all included studies. Clinical outcomes were dichotomized into short-term (<6 months) and midterm (<24 months) outcomes, and values were pooled when possible.

RESULTS

We identified 60 studies in Arthroscopy and 44 studies in AJSM, primarily from North America (78.8%), that predominantly assessed clinical outcomes after arthroscopic hip surgery (46.1%). Seventy-one percent of Arthroscopy studies and 20.5% of AJSM studies were Level IV evidence. The modified Harris Hip Score (mHHS) was used by 81.5% of included studies. Pooled weighted mean mHHS values after arthroscopic surgery for FAI showed improvements at the midterm from 60.5 points (range, 56.6 to 83.6 points) to 80.5 points (range, 72.1 to 98.0 points) out of a possible 100 points. Pooled weighted outcomes for labral repair showed mean mHHS improvements from 63.8 points (range, 62.5 to 69.0 points) preoperatively to 86.9 points (range, 85.5 to 89.9 points) up to 24 months postoperatively.

CONCLUSIONS

This comprehensive review of research published in Arthroscopy and AJSM over the past 3 years identified a number of key findings. Arthroscopic intervention results in improvements in functional outcomes at both the short-term and midterm for patients with symptomatic FAI in the absence of significant existing degenerative changes. Labral repair may result in improvements over labral debridement. The most commonly used outcome score was the mHHS for objective assessment of surgical success. There is a need for continued focus on improvement of methodologic quality and reporting of research pertaining to FAI.

LEVEL OF EVIDENCE

Level IV, systematic review of Level IV studies.

Evaluating online information regarding the direct anterior approach for total hip arthroplasty

We evaluated the quality of information available on the Internet regarding the direct anterior approach (DAA). The top 50 Web sites from three major search engines (Google, Yahoo!, and Bing) were tabulated utilizing the search term direct anterior hip replacement. Of these, only 22% were authored by a hospital/university, while 60% were by a private physician/clinic. Most Web sites presented the DAA as "better" than other surgical approaches describing benefits, such as accelerated recovery though only 35% described risks of the approach. While only 39% of sites presented patient eligibility criteria, greater than 75% had the ability to make an appointment. Web sites regarding the DAA provide patients with a limited perspective and may be focused on attracting new patients, as opposed to accurately educating them.