Health literacy and the Internet: a study on the readability of Australian online health information

Reaching out to stakeholders: The use of knowledge terminology on the websites of Australian public hospitals

Background

The objective of the study described in this article was to examine whether, and to what extent, Australian public hospitals use knowledge terminology, i.e. a body of knowledge-related terms, on their websites. The paper also discusses the difference in the level of such communication between large and small hospitals, the factors affecting the use of the knowledge-related terms in the communication and the similarities/differences between the use of knowledge terms in Australian public hospitals and large/small companies in Australia.

Methods

151 Australian public hospitals were included in the research sample: 51 large and 100 small hospitals. Using the method of content analysis, websites mentioning knowledge creation, knowledge sharing, knowledge implementation, and knowledge retention were identified, along with the number of these mentions. Descriptive statistics and chi square test of independence were used to provide answers to four research questions.

Results

Of the 151 hospitals included in the sample, 30 had no website and 62 (50 small and 12 large) had a single page website. The study found that there are differences between Australian public hospitals regarding the level of their knowledge communication on their websites, both between small and large hospitals and between the individual hospitals within the large and small hospital groups.

Conclusions

A well-known saying goes “For the mouth speaks what the heart is full of”. Effective communication of knowledge-related terminologies to both internal and external stakeholders, i.e. the parties who access the websites, is therefore an indication of a knowledge focus in the public hospitals. Large hospitals are generally more active in communicating knowledge terms, although there are some exceptions. Some of the small hospitals can lead by example, but most of them do not include knowledge terminology in their communication on websites.

Web-based information on orthodontic clear aligners: a qualitative and readability assessment

BACKGROUND

Data regarding the quality of information (QOI) related to orthodontic clear aligners (OCAs) on the internet are lacking. The aim of the present investigation was to assess the quality and readability of websites providing information regarding OCAs to prospective patients.

METHODS

Three search terms were entered separately into three search engines. Four validated QOI instruments were used to determine the QOI and readability of the content contained within the websites that satisfied predetermined criteria. Descriptive statistical analyses and intrarater testing for DISCERN scores were calculated.

RESULTS

Forty-nine websites satisfied inclusion/exclusion criteria. General dentists (44.9%) and specialist orthodontists (26.5%) authored the majority of websites. One website contained the Health on the Net (HON) code seal. Cohen's kappa for DISCERN scores was good (0.87). The overall mean (SD) DISCERN score was 38.55 (8.00)/80, range 26-60. The websites authored by 'Direct-to-consumer' OCA providers recorded the lowest DISCERN mean score (33/80). One website contained all four Journal of the American Medical Association (JAMA) benchmarks. The mean (SD) Flesch Reading Ease score was 53.92 (9.08), range 36-82.5.

CONCLUSIONS

The QOI of the website content related to OCAs is poor and is 'fairly difficult' to read. Website authors should consider using QOI instruments and readability tools to enable the delivery of evidence-based and easily readable information regarding OCAs to prospective patients.

Web-Based Health Information Following the Renewal of the Cervical Screening Program in Australia: Evaluation of Readability, Understandability, and Credibility

BACKGROUND

Three main changes were implemented in the Australian National Cervical Screening Program (NCSP) in December 2017: an increase in the recommended age to start screening, extended screening intervals, and change from the Papanicolaou (Pap) test to primary human papillomavirus screening (cervical screening test). The internet is a readily accessible source of information to explain the reasons for these changes to the public. It is important that web-based health information about changes to national screening programs is accessible and understandable for the general population.

OBJECTIVE

This study aimed to evaluate Australian web-based resources that provide information about the changes to the cervical screening program.

METHODS

The term cervical screening was searched in 3 search engines. The first 10 relevant results across the first 3 pages of each search engine were selected. Overall, 2 authors independently evaluated each website for readability (Flesch Reading Ease [FRE], Flesch-Kincaid Grade Level, and Simple Measure of Gobbledygook [SMOG] index), quality of information (Patient Education Materials Assessment Tool [PEMAT] for printable materials), credibility (Journal of the American Medical Association [JAMA] benchmark criteria and presence of Health on the Net Foundation code of conduct [HONcode] certification), website design, and usability with 5 simulation questions to assess the relevance of information. A descriptive analysis was conducted for the readability measures, PEMAT, and the JAMA benchmark criteria.

RESULTS

Of the 49 websites identified in the search, 15 were eligible for inclusion. The consumer-focused websites were classed as fairly difficult to read (mean FRE score 51.8, SD 13.3). The highest FRE score (easiest to read) was 70.4 (Cancer Council Australia Cervical Screening Consumer Site), and the lowest FRE score (most difficult to read) was 33.0 (NCSP Clinical Guidelines). A total of 9 consumer-focused websites and 4 health care provider-focused websites met the recommended threshold (sixth to eighth grade; SMOG index) for readability. The mean PEMAT understandability scores were 87.7% (SD 6.0%) for consumer-focused websites and 64.9% (SD 13.8%) for health care provider-focused websites. The mean actionability scores were 58.1% (SD 19.1%) for consumer-focused websites and 36.7% (SD 11.0%) for health care provider-focused websites. Moreover, 9 consumer-focused and 3 health care provider-focused websites scored above 70% for understandability, and 2 consumer-focused websites had an actionability score above 70%. A total of 3 websites met all 4 of the JAMA benchmark criteria, and 2 websites displayed the HONcode.

CONCLUSIONS

It is important for women to have access to information that is at an appropriate reading level to better understand the implications of the changes to the cervical screening program. These findings can help health care providers direct their patients toward websites that provide information on cervical screening that is written at accessible reading levels and has high understandability.

The quality of diagnosis and triage advice provided by free online symptom checkers and apps in Australia

OBJECTIVES

To investigate the quality of diagnostic and triage advice provided by free website and mobile application symptom checkers (SCs) accessible in Australia.

DESIGN

36 SCs providing medical diagnosis or triage advice were tested with 48 medical condition vignettes (1170 diagnosis vignette tests, 688 triage vignette tests).

MAIN OUTCOME MEASURES

Correct diagnosis advice (provided in first, the top three or top ten diagnosis results); correct triage advice (appropriate triage category recommended).

RESULTS

The 27 diagnostic SCs listed the correct diagnosis first in 421 of 1170 SC vignette tests (36%; 95% CI, 31-42%), among the top three results in 606 tests (52%; 95% CI, 47-59%), and among the top ten results in 681 tests (58%; 95% CI, 53-65%). SCs using artificial intelligence algorithms listed the correct diagnosis first in 46% of tests (95% CI, 40-57%), compared with 32% (95% CI, 26-38%) for other SCs. The mean rate of first correct results for individual SCs ranged between 12% and 61%. The 19 triage SCs provided correct advice for 338 of 688 vignette tests (49%; 95% CI, 44-54%). Appropriate triage advice was more frequent for emergency care (63%; 95% CI, 52-71%) and urgent care vignette tests (56%; 95% CI, 52-75%) than for non-urgent care (30%; 95% CI, 11-39%) and self-care tests (40%; 95% CI, 26-49%).

CONCLUSION

The quality of diagnostic advice varied between SCs, and triage advice was generally risk-averse, often recommending more urgent care than appropriate.

Online resources for family caregivers of cognitively competent patients: A review of user-driven reputable health website content on caregiver communication with health professionals

OBJECTIVE

Most patients want their family involved in consultations and decisions, however some family caregivers report feeling overwhelmed and unsure of their role. As caregivers are increasingly looking to medical websites for guidance, this study aimed to review reputable web-resources available to inform family caregivers on how to be involved in medical consultations and decisions.

METHODS

Google searches were performed using lay search strings, to imitate how a cancer caregiver may locate information. Relevant webpages were included if they were directed at caregivers and from a reputable health organisation. Qualitative content analyses were performed on the included webpages.

RESULTS

22 webpages were included and 8 were directed at caregivers of cancer patients. Six key categories of information were identified: preparing for consultations, helping during consultations, advocating for the patient, decision-making, communicating in hospital settings, and communicating with family and friends.

CONCLUSION

A range of online resources were found to guide family caregivers, particularly cancer caregivers, on involvement in consultations. However, few provided information to caregivers on complex situations such as treatment decision-making, advocating for patient's needs, and communicating in a hospital setting.

PRACTICE IMPLICATIONS

Clinicians can actively refer family caregivers to online resources that support caregiver communication in medical settings.

Quality of life and its association with comorbidities and adverse events from antiepileptic medications: Online survey of patients with epilepsy in Australia

OBJECTIVE

This study aimed to explore the quality of life (QoL) of adult patients with epilepsy (PwE) in Australia and its relationship with comorbidities and adverse events (AEs) from antiepileptic drugs (AEDs).

METHODS

Cross-sectional surveys were completed by PwE, or carer proxies, recruited via the online pharmacy application MedAdvisor and Australian PwE Facebook groups from May to August 2018. Data were collected on demographics, epilepsy severity and management, AEs, comorbidities, and QoL (using the Patient-Weighted Quality of Life in Epilepsy Inventory [QOLIE-10-P] total score). Two linear regression models were constructed to explore associations between AEs or comorbidities and QOLIE-10-P score, with possible confounders determined using stepwise selection.

RESULTS

Nine hundred and seventy-eight of 1267 responses were eligible (mean age of respondents: 44.5 years, 64% female, 52% employed). Recent AED use was reported by 97%; 47% were on AED monotherapy, 35% had ≤2 lifetime AEDs, and 55% were seizure-free for >1 year. After stepwise selection, control variables included in both models were time since diagnosis, employment status, seizure frequency, number of currently prescribed AEDs, and number of general practitioner (GP) visits per year. In the model for comorbidities, "psychiatric disorders" was associated with the largest QOLIE-10-P score decrease (-23.14, p < 0.001). In the model for AEs, which additionally controlled for depression and anxiety disorder, self-reported "memory problems" was associated with the largest decrease in QOLIE-10-P score (-14.27, p < 0.001).

CONCLUSIONS

In this survey of Australian PwE, many of whom had relatively well-controlled epilepsy, psychiatric and self-reported memory problems were common and associated with the greatest detrimental impact on QoL. Further research is needed to better understand the underlying causes of impaired QoL and thereby improve its management.

'Not everybody is an internet person': Barriers for menopause-related health literacy among immigrant women from the Horn of Africa nations

ISSUE ADDRESSED

Changes in health require new learning. There are increased risks of chronic noncommunicable diseases after menopause and positive health behaviour during the peri-menopausal years and beyond are crucial for a healthy postmenopausal life. In order to implement health promotion messages, women require adequate health literacy skills in order to achieve better health and access to appropriate health care.

METHODS

This qualitative study explored menopause-related health literacy and experiences of menopause-related health care using semi-structured interviews with women from the Horn of Africa nations who had migrated to Melbourne, Australia.

RESULTS

Participants viewed menopause as a normal life phase and did not see the need for accessing menopause-related information and care. Limited education, low literacy and being unfamiliar with the internet were barriers to health literacy. Participants' preferred health care providers who could converse in their first language, but regretted their lack of proactive engagement in providing menopause-related information.

CONCLUSION

Primary health care providers need to be aware that immigrant women from the Horn of Africa nations have poor health literacy and may be unaware of the benefits of positive health behaviours during and after menopause. Offering menopause-related health promotion opportunistically may lead to better postmenopausal health for this group of women. SO WHAT?: Health promotion and education programs codesigned with community stakeholders may be effective in engaging immigrant communities to improve menopause-related health literacy.

Readability and quality of online eating disorder information-Are they sufficient? A systematic review evaluating websites on anorexia nervosa using DISCERN and Flesch Readability

OBJECTIVE

Evaluate the quality and readability of United Kingdom-based websites on anorexia nervosa.

METHOD

First-page search results of three search engines (with search term "anorexia nervosa") were consulted. Websites were excluded if they were pro-ana, duplications, advertisements, Wikipedia, nonwritten/video, invalid addresses, non-English, book links, articles/news pages, and discussion forums. Fifteen websites were evaluated on information quality using DISCERN, and on readability using the Flesch Reading Ease (FRE) Scale. Spearman's correlations between quality and readability were calculated.

RESULTS

DISCERN-scores ranged from 34 to 71 (M = 49.27, SD = 9.16), representing "fair" information quality. FRE-scores ranged from 28 to 64 (M = 42.7, SD = 13.43), representing "difficult" readability. The Royal College of Psychiatrists website (https://www.rcpsych.ac.uk/) received the only "excellent" quality rating and was the only website that met the recommended reading level. The other websites' quality varied, and their reading levels ranged from fairly to very difficult.

CONCLUSION

Website quality scores varied. Oftentimes, information about treatment risks and benefits was lacking, and texts were too complex. Website quality seals could prove beneficial, and web developers should use quality and readability measures to ensure information accessibility. Future research should utilize DISCERN and FRE to evaluate quality and readability of websites pertaining to other eating disorders too. Video abstract: https://www.youtube.com/watch?v=a9DKS7qISSA&feature=youtu.be.

Reframing healthy food choices: a content analysis of Australian healthy eating blogs

BACKGROUND

Blogs are widely being used by health professionals and consumers to communicate and access nutrition information. There are numerous benefits for dietitians to establish and contribute to healthy eating blogs. In particular, to disseminate evidence-based nutrition information to promote healthier dietary practices. The aim of this study was to explore characteristics of popular healthy eating blogs and inform the provision of healthy eating information in the Australian context.

METHODS

A content analysis approach was used to identify characteristics of popular Australian healthy eating blogs. A purposive and snowball sampling approach was used to identify healthy eating blogs from search engines including Google, Bing and Yahoo. Blogs were deemed eligible if: (1) the author self-identified as a health professional; (2) the blog was written by a single author; (3) the blog was written by an Australian author; (4) the blog had a minimum of one post per month, and (5) the blog focused on communicating healthy eating information to the general adult population.

RESULTS

Five popular blogs were followed over a three-month period (December 2017-March 2018), with 76 blog posts included for analysis. Characteristics of these popular blogs were examined and four main features were identified: (i) clearly conveying the purpose of each post; (ii) developing a strong understanding of the reader base and their preferences; (iii) employing a consistent writing style; use of vocabulary and layout; and (iv) communicating healthy eating information in a practical manner. These findings reveal important insight into the features that promote effective nutrition communication within this context.

CONCLUSION

Findings from this study highlight common characteristics of popular healthy eating blogs. Future research into the development of blog guidelines which incorporate the characteristics identified in this study can support dietitians in establishing or contributing to the successful provision of evidence-based nutritional information through blogs.

Implications for GP endorsement of a diabetes app with patients from culturally diverse backgrounds: a qualitative study

Although many diabetes self-management apps exist, these are not tailored for people from culturally and linguistically diverse (CALD) backgrounds. This study aimed to explore GP perceptions of how diabetes app features could help GPs better support their patients from CALD backgrounds. Twenty-five semi-structured interviews with GPs in Western Sydney explored attitudes towards a proposed app's suitability for CALD patients. Interviews were audio-recorded, transcribed and coded using Framework Analysis. Theme 1 explored the implications of perceptions that patients' health literacy is dependent on the language used. Theme 2 explored the influence of messaging from sources that share the patient's language and culture (including misinformation from community sources). Theme 3 described the suitability of the app platform for CALD patients, and its potential challenges in this group. GPs perceived that a diabetes app could be useful for providing support to patients from CALD backgrounds. Findings suggest app features should be optimised to address existing challenges that GPs face and carefully consider strategies for recruiting CALD patients. It is important that GPs feel comfortable promoting an app to their CALD patients to help increase participation rates by people in the CALD community.

A pilot study of Australian pet owners who engage in social media and their use, experience and views of online pet health information

OBJECTIVE

The aim of this study was to gain a better understanding of Australian pet owners' use of the internet for pet health; how trustworthy they rate various pet health information sources and the use of online information in subsequent veterinary consultations.

METHOD

An anonymous questionnaire was developed, consisting of 30 questions, and distributed between March 2018 and May 2018 using convenience sampling through social media venues including Facebook and Twitter. All respondents were over the age of 18, lived in Australia and owned a pet animal.

RESULTS

A total of 228 responses were received. The most common sources of pet health information were veterinarians (88.2%) and internet websites (81.1%). Most respondents reported using the internet 'many times per day' at either home or work. The majority of respondents used the internet to seek pet health information either 'not weekly but at least once a month' or 'less than once a month'. Nearly half of the respondents stated that they only 'sometimes' discuss their online findings with their veterinarian. Approximately one half of respondents agreed with the statement that online pet health information had affected their decision about whether to take their pet to the veterinarian.

CONCLUSION

This study assesses how pet owners use the internet for pet health information and the role veterinarians can play in helping to facilitate these searches with tools such as information prescriptions. Further large-scale research is needed to help further understand this increasingly important aspect of pet health.

Effectiveness of internet-delivered education and home exercise supported by behaviour change SMS on pain and function for people with knee osteoarthritis: a randomised controlled trial protocol

BACKGROUND

Knee osteoarthritis (OA) is a prevalent and chronic condition with no known cure. Exercise is advocated in all clinical guidelines due to its positive effects on symptoms. Despite this, exercise participation is often poor in people with knee OA with access to exercise treatments a known barrier. Internet-delivered exercise interventions have the potential to improve access to evidence-based exercise treatments and can benefit OA outcomes, although non-usage and low adherence potentially limit their effectiveness. Short message services (SMS) show promise in facilitating exercise adherence and may be one solution to improve adherence to internet-delivered exercise interventions. The combination of internet-delivered exercise and SMS adherence support has not been specifically evaluated in people with knee OA.

METHODS

This protocol reports a two-arm parallel-design, assessor- and participant-blinded randomised controlled trial. This trial is recruiting 206 people aged 45 years and older, with a clinical diagnosis of knee OA from the Australian-wide community. Eligible and consenting participants are enrolled and randomised to receive access to either i) 'My Knee Education', an education control website containing OA and exercise information only or ii) a combined intervention that includes a website, 'My Knee Exercise', containing the same educational information as the control, guidance to increase general physical activity, and the prescription of a 24-week self-directed home-based lower-limb strengthening program in addition to a 24-week behaviour change SMS exercise adherence program. Outcome measures are being collected at baseline and 24-weeks. Primary outcomes are self-reported knee pain and physical function. Secondary outcomes include another self-reported measure of knee pain, function in sport and recreation, quality-of-life, physical activity, self-efficacy, participant satisfaction and perceived global change.

DISCUSSION

This randomised controlled trial will provide evidence about the effectiveness of a combined intervention of internet-delivered OA and exercise education, physical activity guidance and prescription of a 24-week lower-limb strengthening exercise program supported by a behaviour change SMS program compared to internet delivered OA and exercise education alone.

TRIAL REGISTRATION

ACTRN12618001167257/13th July 2018.

Low Health Literacy Is Associated With Risk of Developing Type 2 Diabetes in a Nonclinical Population

PURPOSE

The purpose of this study was to examine associations among risk of type 2 diabetes (T2D), health literacy levels, and sociodemographic characteristics in a nonclinical adult population to assist in the development of effective T2D prevention programs.

METHODS

The Health Literacy Questionnaire and Australian Type 2 Diabetes Risk Assessment Tool were included in an online survey. Participants were a random sample of adults residing in each Australian state and territory. Data were analyzed with descriptive statistics and multinomial logistic regression.

RESULTS

A total of 1279 Australian adults participated (52% female; mean ± SD age, 61 ± 12 years). Most were at medium (42.4%) or high (46.9%) risk of developing T2D. The lowest health literacy scores were found for the domains "critical appraisal of health information" and "navigating the health care system." After controlling for covariates, participants at the highest risk of developing T2D were significantly more likely to be unemployed, have ≥1 chronic conditions, or have a mental health condition. Furthermore, they were significantly more likely to develop T2D if they scored low in 1 of the following health literacy domains: critical appraisal of health information, navigating the health care system, actively managing health, social support, and health care provider support.

CONCLUSIONS

Health literacy was associated with increased risk for developing T2D and should therefore be part of diabetes prevention initiatives. Specifically, new health promotion initiatives need to help people develop skills required to critically appraise health information and navigate the health care system. Health practitioners and educators should ensure that health information developed for consumers is uncomplicated and easily understood.

Creating Consumer-Generated Health Data: Interviews and a Pilot Trial Exploring How and Why Patients Engage

Background

Consumer-generated health data (CGHD) are any clinically relevant data collected by patients or their carers (consumers) that may improve health care outcomes. Like patient experience measures, these data reflect the consumer perspective and is part of a patient-centric agenda. The use of CGHD is believed to enhance diagnosis, patient engagement, and thus foster an improved therapeutic partnership with health care providers.

Objective

The aim of this study was to further identify how these data were used by consumers and how it influences engagement via a validated framework. In addition, carer data has not been explored for the purpose of engagement.

Methods

Study 1 used interviews with CGHD-experienced patients, carers, and doctors to understand attitudes about data collection and use, developing an ontological framework. Study 2 was a pilot trial with carers (parents) of children undergoing laparoscopic appendectomy. For 10 days carers generated and emailed surgical site photographs to a tertiary children’s hospital. Subsequently, carers were interviewed about the engagement framework. In total, 60 interviews were analyzed using theme and content analysis.

Results

This study validates a framework anchored in engagement literature, which categorizes CGHD engagement outcomes into 4 domains: physiological, cognitive, emotional, and behavioral. CGHD use is complex, interconnected, and can be organized into 10 themes within these 4 domains.

Conclusions

CGHD can instigate an ecosystem of engagement and provide clinicians with an enhanced therapeutic relationship through an extended view into the patient’s world. In addition to clinical diagnosis and efficient use of health care resources, data offer another tool to manage consumers service experience, especially the emotions associated with the health care journey. Collection and use of data increases consumers sense of reassurance, improves communication with providers, and promotes greater personal responsibility, indicating an empowering consumer process. Finally, it can also improve confidence and satisfaction in the service.

Assessing the readability and patient comprehension of rheumatology medicine information sheets: a cross-sectional Health Literacy Study

OBJECTIVES

Patients are often provided with medicine information sheets (MIS). However, up to 60% of patients have low health literacy. The recommended readability level for health-related information is ≤grade 8. We sought to assess the readability of MIS given to patients by rheumatologists in Australia, the UK and Canada and to examine Australian patient comprehension of these documents.

DESIGN

Cross-sectional study.

SETTING

Community-based regional rheumatology practice.

PARTICIPANTS

Random sample of patients attending the rheumatology practice.

OUTCOME MEASURES

Readability of MIS was assessed using readability formulae (Flesch Reading Ease formula, Simple Measure of Gobbledygook scale, FORCAST (named after the authors FORd, CAylor, STicht) and the Gunning Fog scale). Literal comprehension was assessed by asking patients to read various Australian MIS and immediately answer five simple multiple choice questions about the MIS.

RESULTS

The mean (±SD) grade level for the MIS from Australia, the UK and Canada was 11.6±0.1, 11.8±0.1 and 9.7±0.1 respectively. The Flesch Reading Ease score for the Australian (50.8±0.6) and UK (48.5±1.5) MIS classified the documents as 'fairly difficult' to 'difficult'. The Canadian MIS (66.1±1.0) were classified as 'standard'. The five questions assessing comprehension were correctly answered by 9/21 patients for the adalimumab MIS, 7/11 for the methotrexate MIS, 6/28 for the non-steroidal anti-inflammatory MIS, 10/11 for the prednisone MIS and 13/24 for the abatacept MIS.

CONCLUSIONS

The readability of MIS used by rheumatologists in Australia, the UK and Canada exceeds grade 8 level. This may explain why patient literal comprehension of these documents may be poor. Simpler, shorter MIS with pictures and infographics may improve patient comprehension. This may lead to improved medication adherence and better health outcomes.

Reducing infectious disease inequities among migrants

BACKGROUND

migration has reached unprecedented levels, with 3.6% of the world's population living outside their country of birth. Migrants comprise a substantial proportion of high-income country populations, are at increased risk of a range of infectious diseases, compared to native-born populations and may experience worse health outcomes due to barriers accessing timely diagnoses and treatment. Poor access to essential healthcare services can be attributed to several factors, including language and cultural barriers and lack of specific inclusive health policies.

METHODS

This review draws on evidence from the immigrant health and travel medicine literature, with a focus on infectious disease risks. It presents strategies to reduce barriers to healthcare access through health promotion and screening programs both at the community and clinic level and the delivery of linguistically and culturally competent care. The Methods: Salud Entre Culturas (SEC) 'Health Between Cultures' project from the Tropical Medicine Unit at the Hospital Ramon y Cajal in Madrid is described as an effective model of care.

RESULTS

For those providing healthcare to migrant populations, the use of community-consulted approaches are considered best practice in the development of health education, health promotion and the delivery of targeted health services. At the clinic-level, strategies optimizing care for migrants include the use of bilingual healthcare professionals or community-based healthcare workers, cultural competence training of all clinic staff, the appropriate use of trained interpreters and the use of culturally appropriate health promotion materials.

CONCLUSIONS

Multifaceted strategies are needed to improve access, community knowledge, community engagement and healthcare provider training to provide appropriate care to migrant populations to reduce infectious disease disparities.

Consumer evaluation of 'Veggycation®', a website promoting the health benefits of vegetables

Issue addressed Whether the website Veggycation^® appeals to particular groups of consumers significantly more than other groups. Methods Australian adults aged ≥18 years (n = 1000) completed an online survey. The website evaluation instrument used was tested for validity and reliability. Associations between demographic variables and website evaluation dimensions of attractiveness, content, user-friendliness and loyalty intentions were examined using a general linear model (GLM). The appraisal of the website was further investigated based on the respondents' daily consumption level of vegetables and the importance they attach to vegetable consumption in their diet, using GLM and a Tukey's all-pair comparison. Results Veggycation^® has a high level of acceptance among the Australian community with certain groups evaluating the website more favourably. These include women, people aged≤29 years, higher income respondents, non-metro respondents and those who viewed vegetables as extremely important in their daily diet. Conclusions Customisation of the website for consumer groups with low vegetable consumption is recommended. Designing tailored communication tools will assist in enhancing the knowledge base of vegetable-related health benefits and may promote vegetable consumption among the Australian population. So what? The promotion of higher vegetable consumption is aided by tailored, well-designed web communication. This study adds to the existing body of knowledge for the education of organisations developing e-tools for promoting health education and literacy.

Evaluation of treatment risks and the quality of information contained within the websites of specialist orthodontists

Objective

To evaluate the treatment risks and the quality of information contained within the websites of specialist orthodontists in Australia.

Methods

The term ‘specialist orthodontic practice’ was entered into three internet search engines. Websites satisfying inclusion and exclusion criteria were evaluated for orthodontic treatment risk information against nine common treatment risks. For website reliability and quality, the DISCERN instrument was used along with the HON (health on the net) seal certification; and for readability, the Flesch Reading Ease (FRE) Test was applied.

Results

Of the 105 websites that met the inclusion and exclusion criteria, 4.8% reported all nine risks. No risks were reported by 17.1%. Relapse (64.8%) was the most common risk recorded on websites, followed by ‘pain/discomfort’ (63.8%). Root resorption was reported by 5.7%. The requirement for life-long retention was indicated by 22.9% of the websites and 57.1% gave advice on sports mouthguard wear. The proposed benefits of orthodontic treatment were outlined by 85.7%. The mean (standard deviation [SD]) overall DISCERN score was 43.78 (SD 6.49; range 17–59). No website displayed the HON Seal certification. The mean FRE Score was 51.71 (SD 10.19; range 30.1–74.7).

Conclusions

Information regarding orthodontic treatment risks contained within specialist orthodontic practice websites appears deficient. Websites were of variable reliability, quality and readability. Further development of specialist orthodontists’ websites is required to ensure the delivery of accessible, reliable and understandable evidence-based information to patients.

Tinnitus information online – does it ring true?

Objective

To assess, using standardised tools, the quality and readability of online tinnitus information that patients are likely to access.

Methods

A standardised review was conducted of websites relating to tinnitus and its management. Each website was scored using the DISCERN instrument and the Flesch Reading Ease scale.

Results

Twenty-seven unique websites were evaluated. The mean DISCERN score of the websites was 34.5 out of 80 (standard deviation = 11.2). This would be considered ‘fair’ in quality. Variability in DISCERN score between websites was high (range, 15–57: ‘poor’ to ‘very good’). Website readability was poor, with a mean Flesch Reading Ease score of 52.6 (standard deviation = 7.7); this would be considered ‘difficult’ to read.

Conclusion

In general, the quality of tinnitus websites is fair and the readability is poor, with substantial variability in quality between websites. The Action on Hearing Loss and the British Tinnitus Association websites were identified as providing the highest quality information.

Health Information Discrepancies Between Internet Media and Scientific Papers Reporting on Omega-3 Supplement Research: Comparative Analysis

Background

Dietary supplements are the most used complementary and alternative health modality in the United States, and omega-3 supplements continue to be the most popularly used nonvitamin or nonmineral supplements by adults. Users of dietary supplements report that they obtain health guidance from internet media resources, but there is question as to whether or not these resources provide the necessary evidence to guide health decisions. Current evidence suggests that there is a mistranslation occurring somewhere between researchers and the media.

Objective

The aim of this study was to conduct a comparative cross-sectional analysis to identify areas of discordance created when science is translated from the laboratory to Web-based news media.

Methods

A Google news search provided our convenience sample of 40 omega-3 supplement–based media reports stratified by the years 2009 to 2012. Media reports (n=17) were compared with the corresponding scientific papers for content. Report and scientific paper content were extracted using commonly accepted reporting guideline domains, and domains were then compared for detecting underlying omissions or mistranslations in reporting. Mean scores for all of the scientific papers and media reports were assessed for each domain.

Results

Scientific papers (n=14) generally maintained a mean close to complete for each reporting domain. The only domain where there was not a significant difference between media and scientific reporting match was within the objectives domain (χ²₁= 0.8, P=.36). Media reports (n=17) more frequently reported potential caveats and warnings for consumers with a mean domain for caveat reporting of 0.88, with possible scores falling between 0 and 1.

Conclusions

There are inherent differences in the intended audience, structure, and goals in scientific and media communications. These differences should be explored further, and consumers should be made aware of them. Additional considerations for balanced reporting and reader accessibility are also necessary to take into account and are explored further in this analysis.

'Your DNA, Your Say': global survey gathering attitudes toward genomics: design, delivery and methods

Our international study, 'Your DNA, Your Say', uses film and an online cross-sectional survey to gather public attitudes toward the donation, access and sharing of DNA information. We describe the methodological approach used to create an engaging and bespoke survey, suitable for translation into many different languages. We address some of the particular challenges in designing a survey on the subject of genomics. In order to understand the significance of a genomic result, researchers and clinicians alike use external databases containing DNA and medical information from thousands of people. We ask how publics would like their 'anonymous' data to be used (or not to be used) and whether they are concerned by the potential risks of reidentification; the results will be used to inform policy.

The Development of Delta: Using Agile to Develop a Decision Aid for Pediatric Oncology Clinical Trial Enrollment

BACKGROUND

The internet is increasingly being used to disseminate health information. Given the complexity of pediatric oncology clinical trials, we developed Delta, a Web-based decision aid to support families deciding whether or not to enroll their child with cancer in a clinical trial.

OBJECTIVE

This paper details the Agile development process of Delta and user testing results of Delta.

METHODS

Development was iterative and involved 5 main stages: a requirements analysis, planning, design, development, and user testing. For user testing, we conducted 13 eye-tracking analyses and think-aloud interviews with health care professionals (n=6) and parents (n=7).

RESULTS

Results suggested that there was minimal rereading of content and a high level of engagement in content. However, there were some navigational problems. Participants reported high acceptability (12/13) and high usability of the website (8/13).

CONCLUSIONS

Delta demonstrates the utility for the use of Agile in the development of a Web-based decision aid for health purposes. Our study provides a clear step-by-step guide to develop a Web-based psychosocial tool within the health setting.

Assessment of readability, quality and popularity of online information on ureteral stents

OBJECTIVE

To evaluate the quality and readability of online information on ureteral stents.

METHODS

Google.com was queried using the search terms "ureteric stent", "ureteral stent", "double J stent" and, "Kidney stent" derived from Google AdWords. Website popularity was determined using Google Rank and the Alexa tool. Website quality assessment was performed using the following criteria: Journal of the American Medical Association (JAMA) benchmarks, Health on the Net (HON) criteria, and a customized DISCERN questionnaire. The customized DISCERN questionnaire was developed by combining the short validated DISCERN questionnaire with additional stent-specific items including definition, placement, complications, limitations, removal and "when to seek help". Scores related to stent items were considered as the "stent score" (SS). Readability was evaluated using five readability tests.

RESULTS

Thirty-two websites were included. The mean customized DISCERN score and "stent score" were 27.1 ± 7.1 (maximum possible score = 59) and 14.6 ± 3.8 (maximum possible score = 24), respectively. A minority of websites adequately addressed "stent removal" and "when to seek medical attention". Only two websites (6.3%) had HON certification (drugs.com, radiologyinfo.org) and only one website (3.3%) met all JAMA criteria (bradyurology.blogspot.com). Readability level was higher than the American Medical Association recommendation of sixth-grade level for more than 75% of the websites. There was no correlation between Google rank, Alexa rank, and the quality scores (P > 0.05).

DISCUSSION

Among the 32 most popular websites on the topic of ureteral stents, online information was highly variable. The readability of many of the websites was far higher than standard recommendations and the online information was questionable in many cases. These findings suggest a need for improved online resources in order to better educate patients about ureteral stents and also should inform physicians that popular websites may have incomplete information.

How well are health information websites displayed on mobile phones? Implications for the readability of health information

Issue addressed More than 87% of Australians own a mobile phone with Internet access and 82% of phone owners use their smartphones to search for health information, indicating that mobile phones may be a powerful tool for building health literacy. Yet, online health information has been found to be above the reading ability of the general population. As reading on a smaller screen may further complicate the readability of information, this study aimed to examine how health information is displayed on mobile phones and its implications for readability. Methods Using a cross-sectional design with convenience sampling, a sample of 270 mobile webpages with information on 12 common health conditions was generated for analysis, they were categorised based on design and position of information display. Results The results showed that 71.48% of webpages were mobile-friendly but only 15.93% were mobile-friendly webpages designed in a way to optimise readability, with a paging format and queried information displayed for immediate viewing. Conclusion With inadequate evidence and lack of consensus on how webpage design can best promote reading and comprehension, it is difficult to draw a conclusion on the effect of current mobile health information presentation on readability. So what? Building mobile-responsive websites should be a priority for health information providers and policy-makers. Research efforts are urgently required to identify how best to enhance readability of mobile health information and fully capture the capabilities of mobile phones as a useful device to increase health literacy.

Information sought, information shared: exploring performance and image enhancing drug user-facilitated harm reduction information in online forums

BACKGROUND

There is good evidence to suggest that performance and image enhancing drug (PIED) use is increasing in Australia and that there is an increase in those using PIEDs who have never used another illicit substance. Peers have always been an important source of information in this group, though the rise of the Internet, and the increased use of Internet forums amongst substance consumers to share harm reduction information, means that PIED users may have access to a large array of views and opinions. The aim of this study was to explore the type of information that PIED users seek and share on these forums.

METHODS

An online search was conducted to identify online forums that discussed PIED use. Three discussion forums were included in this study: aussiegymjunkies.com, bodybuildingforums.com.au, and brotherhoodofpain.com. The primary source of data for this study was the 'threads' from the online forums. Threads were thematically analysed for overall content, leading to the identification of themes.

RESULTS

One hundred thirty-four threads and 1716 individual posts from 450 unique avatars were included in this analysis. Two themes were identified: (1) personal experiences and advice and (2) referral to services and referral to the scientific literature.

CONCLUSIONS

Internet forums are an accessible way for members of the PIED community to seek and share information to reduce the harms associated with PIED use. Forum members show concern for both their own and others' use and, where they lack information, will recommend seeking information from medical professionals. Anecdotal evidence is given high credence though the findings from the scientific literature are used to support opinions. The engagement of health professionals within forums could prove a useful strategy for engaging with this population to provide harm reduction interventions, particularly as forum members are clearly seeking further reliable information, and peers may act as a conduit between users and the health and medical profession.

A content analysis of the consumer-facing online information about My Health Record: Implications for increasing knowledge and awareness to facilitate uptake and use

BACKGROUND

Low health literacy, low levels of positive belief and privacy and security concerns have been identified as a significant barrier to personal electronic health record uptake and use. An important tool for overcoming these barriers is the consumer-facing information which accompanies the system. My Health Record (MyHR) is the Australian national e-health record system, for which a large suite of online resources exists to facilitate consumer registration and use. This study uses a number of different measures of health resource quality to assess the MyHR online consumer-facing information and identify any gaps or areas for improvement.

OBJECTIVE

To analyse the quality and content of the online consumer-facing resources which support the uptake and use of MyHR.

METHOD

Australian information resources aimed at healthcare consumers about the MyHR were included in this study. A comprehensive search using Internet search engines was conducted to locate all online consumer-facing resources about MyHR from both government and non-government sources. Readability (measured by Flesch-Kincaid grade level), year of publication/review, publishing organisation type, presentation style, linked websites, target audience, and themes were identified as important measures of health information quality, and these were recorded and reported on for each resource.

RESULTS

Eighty resources met the inclusion criteria. The mean Flesch-Kincaid grade level was 11.8. Most resources were created by Australian government sources ( n = 55), and the most common target audience was the general public ( n = 65). Registration ( n = 51), privacy/security ( n = 49), and benefits of use ( n = 46) were the most common resource themes.

CONCLUSION

The authors identified a number of gaps and areas for improvement in the provision of consumer-facing information about MyHR. Readability is too high for the general Australian population, and there are few translated resources, which means that the information provided does not cater to people with low literacy levels, communication disability, and/or difficulties in understanding written English. The target audiences for resources do not reflect priority groups that were identified during the MyHR development processes. There are also gaps in information provision about how consumers can use MyHR as a tool to meaningfully engage with health professionals and services to support their own person-centred care.

Online nutrition information for pregnant women: a content analysis

Pregnant women actively seek health information online, including nutrition and food-related topics. However, the accuracy and readability of this information have not been evaluated. The aim of this study was to describe and evaluate pregnancy-related food and nutrition information available online. Four search engines were used to search for pregnancy-related nutrition web pages. Content analysis of web pages was performed. Web pages were assessed against the 2013 Australian Dietary Guidelines to assess accuracy. Flesch-Kincaid (F-K), Simple Measure of Gobbledygook (SMOG), Gunning Fog Index (FOG) and Flesch reading ease (FRE) formulas were used to assess readability. Data was analysed descriptively. Spearman's correlation was used to assess the relationship between web page characteristics. Kruskal-Wallis test was used to check for differences among readability and other web page characteristics. A total of 693 web pages were included. Web page types included commercial (n = 340), not-for-profit (n = 113), blogs (n = 112), government (n = 89), personal (n = 36) and educational (n = 3). The accuracy of online nutrition information varied with 39.7% of web pages containing accurate information, 22.8% containing mixed information and 37.5% containing inaccurate information. The average reading grade of all pages analysed measured by F-K, SMOG and FOG was 11.8. The mean FRE was 51.6, a 'fairly difficult to read' score. Only 0.5% of web pages were written at or below grade 6 according to F-K, SMOG and FOG. The findings suggest that accuracy of pregnancy-related nutrition information is a problem on the internet. Web page readability is generally difficult and means that the information may not be accessible to those who cannot read at a sophisticated level. © 2016 John Wiley & Sons Ltd.

Readability Formulas and User Perceptions of Electronic Health Records Difficulty: A Corpus Study

Background

Electronic health records (EHRs) are a rich resource for developing applications to engage patients and foster patient activation, thus holding a strong potential to enhance patient-centered care. Studies have shown that providing patients with access to their own EHR notes may improve the understanding of their own clinical conditions and treatments, leading to improved health care outcomes. However, the highly technical language in EHR notes impedes patients’ comprehension. Numerous studies have evaluated the difficulty of health-related text using readability formulas such as Flesch-Kincaid Grade Level (FKGL), Simple Measure of Gobbledygook (SMOG), and Gunning-Fog Index (GFI). They conclude that the materials are often written at a grade level higher than common recommendations.

Objective

The objective of our study was to explore the relationship between the aforementioned readability formulas and the laypeople’s perceived difficulty on 2 genres of text: general health information and EHR notes. We also validated the formulas’ appropriateness and generalizability on predicting difficulty levels of highly complex technical documents.

Methods

We collected 140 Wikipedia articles on diabetes and 242 EHR notes with diabetes International Classification of Diseases, Ninth Revision code. We recruited 15 Amazon Mechanical Turk (AMT) users to rate difficulty levels of the documents. Correlations between laypeople’s perceived difficulty levels and readability formula scores were measured, and their difference was tested. We also compared word usage and the impact of medical concepts of the 2 genres of text.

Results

The distributions of both readability formulas’ scores (P<.001) and laypeople’s perceptions (P=.002) on the 2 genres were different. Correlations of readability predictions and laypeople’s perceptions were weak. Furthermore, despite being graded at similar levels, documents of different genres were still perceived with different difficulty (P<.001). Word usage in the 2 related genres still differed significantly (P<.001).

Conclusions

Our findings suggested that the readability formulas’ predictions did not align with perceived difficulty in either text genre. The widely used readability formulas were highly correlated with each other but did not show adequate correlation with readers’ perceived difficulty. Therefore, they were not appropriate to assess the readability of EHR notes.

Evaluating mobile phone applications for health behaviour change: A systematic review

Introduction Increasing smartphones access has allowed for increasing development and use of smart phone applications (apps). Mobile health interventions have previously relied on voice or text-based short message services (SMS), however, the increasing availability and ease of use of apps has allowed for significant growth of smartphone apps that can be used for health behaviour change. This review considers the current body of knowledge relating to the evaluation of apps for health behaviour change. The aim of this review is to investigate approaches to the evaluation of health apps to identify any current best practice approaches. Method A systematic review was conducted. Data were collected and analysed in September 2016. Thirty-eight articles were identified and have been included in this review. Results Articles were published between 2011- 2016, and 36 were reviews or evaluations of apps related to one or more health conditions, the remaining two reported on an investigation of the usability of health apps. Studies investigated apps relating to the following areas: alcohol, asthma, breastfeeding, cancer, depression, diabetes, general health and fitness, headaches, heart disease, HIV, hypertension, iron deficiency/anaemia, low vision, mindfulness, obesity, pain, physical activity, smoking, weight management and women's health. Conclusion In order to harness the potential of mobile health apps for behaviour change and health, we need better ways to assess the quality and effectiveness of apps. This review is unable to suggest a single best practice approach to evaluate mobile health apps. Few measures identified in this review included sufficient information or evaluation, leading to potentially incomplete and inaccurate information for consumers seeking the best app for their situation. This is further complicated by a lack of regulation in health promotion generally.

Evaluation of Web-Based Consumer Medication Information: Content and Usability of 4 Australian Websites

Background

Medication is the most common intervention in health care, and written medication information can affect consumers’ medication-related behavior. Research has shown that a large proportion of Australians search for medication information on the Internet.

Objective

To evaluate the medication information content, based on consumer medication information needs, and usability of 4 Australian health websites: Better Health Channel, myDr, healthdirect, and NPS MedicineWise .

Methods

To assess website content, the most common consumer medication information needs were identified using (1) medication queries to the healthdirect helpline (a telephone helpline available across most of Australia) and (2) the most frequently used medications in Australia. The most frequently used medications were extracted from Australian government statistics on use of subsidized medicines in the community and the National Census of Medicines Use. Each website was assessed to determine whether it covered or partially covered information and advice about these medications. To assess website usability, 16 consumers participated in user testing wherein they were required to locate 2 pieces of medication information on each website. Brief semistructured interviews were also conducted with participants to gauge their opinions of the websites.

Results

Information on prescription medication was more comprehensively covered on all websites (3 of 4 websites covered 100% of information) than nonprescription medication (websites covered 0%-67% of information). Most websites relied on consumer medicines information leaflets to convey prescription medication information to consumers. Information about prescription medication classes was less comprehensive, with no website providing all information examined about antibiotics and antidepressants. Participants (n=16) were able to locate medication information on websites in most cases (accuracy ranged from 84% to 91%). However, a number of usability issues relating to website navigation and information display were identified. For example, websites not allowing combinations of search terms to be entered in search boxes and continuous blocks of text without subheadings.

Conclusions

Of the 4 Australian health information websites tested, none provided consumers with comprehensive medication information on both prescription and nonprescription medications in a user-friendly way. Using data on consumer information needs and user testing to guide medication information content and website design is a useful approach to inform consumer website development.