Tools used to evaluate written medicine and health information: document and user perspectives

Patient education information material assessment criteria: A scoping review

BACKGROUND

Patient education information material (PEIM) is an essential component of patient education programs in increasing patients' ability to cope with their diseases. Therefore, it is essential to consider the criteria that will be used to prepare and evaluate these resources.

OBJECTIVE

This paper aims to identify these criteria and recognize the tools or methods used to evaluate them.

METHODS

National and international databases and indexing banks, including PubMed, Scopus, Web of Science, ProQuest, the Cochrane Library, Magiran, SID and ISC, were searched for this review. Original or review articles, theses, short surveys, and conference papers published between January 1990 and June 2022 were included.

RESULTS

Overall, 4688 documents were retrieved, of which 298 documents met the inclusion criteria. The criteria were grouped into 24 overarching criteria. The most frequently used criteria were readability, quality, suitability, comprehensibility and understandability.

CONCLUSION

This review has provided empirical evidence to identify criteria, tools, techniques or methods for developing or evaluating a PEIM. The authors suggest that developing a comprehensive tool based on these findings is critical for evaluating the overall efficiency of PEIM using effective criteria.

Evaluation of Medicine Information Leaflets for Omeprazole, Safety Knowledge, and Perceptions of Taking the Medication in Thailand

PURPOSE

This study aimed to compare package inserts and patient information leaflets for omeprazole in terms of the quality of and satisfaction with the written medicine information, medication safety knowledge, and perceived benefits and risks.

PATIENTS AND METHODS

A cross-sectional, comparative study was conducted at a university hospital in Thailand. Outpatients visiting the pharmacy departments prescribed omeprazole were randomly selected to receive either a package insert or a patient information leaflet. Medication safety knowledge was measured using a set of eight questions. The quality of the written medicine information was measured by the Consumer Information Rating Form. Perceived benefits and risks of the medication were rated using a visual analog scale. Linear regression was used to determine factors associated with perceived benefits and risks.

RESULTS

Of the 645 patients, 293 agreed to answer the questionnaire. 157 and 136 patients were given patient information leaflets and package inserts, respectively. Most respondents were female (65.6%), over half had a degree (56.2%). Patients reading the patient information leaflets had slightly higher overall safety knowledge scores than those reading the package inserts (5.88 ± 2.25 vs 5.25 ± 1.84, p=0.01). Using the Consumer Information Rating Form, the patient information leaflets were given significantly higher scores compared to the package inserts for comprehensibility (19.34±3.92 vs 17.32±3.52, p<0.001) and design quality (29.25 ± 5.00 vs 23.81 ± 5.16, p<0.001). After reading the leaflets, patients receiving the patient information leaflets had significantly higher satisfaction with the information provided (p=0.003). In contrast, those receiving the package inserts rated the risks of omeprazole higher (p=0.007).

CONCLUSION

Demonstrable differences were found from the patient perspective between a package insert and a patient information leaflet for the same medicine, mostly in favour of patient information leaflets. Medicine safety knowledge after reading PI and PIL was similar. However, receiving package inserts provided higher perceived risks from taking the medicine.

Electronic Package Leaflets for Vaccines: What Are People’s Perceptions in Italy?

In Italy, the paper package leaflet (PPL) is the official document that is approved by the Italian Medicines Agency (AIFA) for each medicine. PPLs of all medicines, including vaccines, are freely available online by accessing the AIFA website. To investigate people’s attitudes toward possible access to the PPLs of vaccines and the acceptability of switching to an electronic package leaflet (e-leaflet) in the future, we surveyed three target groups (pregnant women, young parents, and older people) in Italy, via an online survey. We collected 321 questionnaires from the cohorts, which comprised 104 pregnant women, 105 young parents, and 112 older people. The results indicate in all target groups that health care professionals (HCPs) do not usually offer the vaccine PPL during the vaccination session: only about 10.7% of respondents receive the PPL without asking for it, with pregnant women receiving it the most frequently. The acceptance rate for switching from a PPL to an e-leaflet is fairly high in all target groups (76.9% in pregnant women, 81.9% in young parents, and 66.1% in the elderly), especially if the option exists to request a paper print, to make sure that people with a low level of digital skills can access the PPL information as well. HCPs have an important role in ensuring access to the PPLs of vaccines. HCPs should be trained to inform their patients about the different options for accessing the PPLs (as well as online access) to increase their patients’ knowledge and satisfaction.

Worth the paper they're printed on? Findings from an independent evaluation of how understandable patient information leaflets for antiseizure medications are

OBJECTIVE

The Patient Information Leaflet (PIL) is an authoritative document that all people with epilepsy (PWE) in the European Union receive when prescribed anti-seizure medication (ASM). We undertook the first independent, comprehensive assessment to determine how understandable they are. Regulators state that when patients are asked comprehension questions about them, ≥80% should answer correctly. Also recommended PILs have a maximum reading requirement of US Grade 8.

METHODS

Study 1: Obtained 140 current ASM PILs written in English. 'Readability' assessed using 4 tests, with and without adjustment for influence of familiar, polysyllabic words. 179 online materials on epilepsy also assessed. Study 2: Two PILs from Study 1 randomly selected (Pregabalin Focus; Inovelon) and shown to 35 people from UK epilepsy population. Their comprehension was assessed. Study 3: To understand whether student population provides accessible alternative population for future examination of ASM PILs, Study 3 was completed. Used same methods as Study 2 but participants were 262 UK university students.

RESULTS

Study 1: No PIL had a reading level of Grade 8. Median was 11. Adjusting for context, the PILs were still at Grade 10.5. PILs for branded ASMs were most readable. PILs were no more readable than (unregulated) online materials. Study 2: Users struggled to comprehend the PILs key messages. The 8 questions asked about pregabalin were typically answered correctly by 54%. For Inovelon it was 62%. Study 3: Most student participants comprehend the PILs key messages. The questions about Inovelon were answered correctly by 90%; for pregabalin it was 86%.

SIGNIFICANCE

This is the first independent and comprehensive examination of ASM PILs. Found PILs being used fail to meet recommendations and regulatory requirements and risk not being understandable to substantial proportion of users. In finding that people from epilepsy population differ markedly in comprehension of PILs compared to students, study highlights importance of completing user testing with the target population.

Development and psychometric validation for evaluating written medicine information in Thailand: The Consumer Information Rating Form

OBJECTIVE

To translate and validate the consumer information rating form (CIRF) for use in Thai populations.

DESIGN

The development of the CIRF was carried out in two phases: translation process and cognitive interview, and psychometric testing.

SETTING

A university hospital and a tertiary hospital in northeast Thailand.

PARTICIPANTS

150 outpatients from medicine department: 30 for phase 1 and 120 patients for phase 2 study.

METHODS

The CIRF was translated with cultural adaptation into Thai using cognitive interview technique in a sample of outpatients. A larger sample of outpatients then completed the CIRF in relation to either a package insert (PI) or a patient information leaflet (PIL) for one of three medicines: atorvastatin, celecoxib and metformin. Construct validity was assessed using principal component analysis (PCA) and internal consistency using Cronbach's α coefficient. Known group validity was assessed by comparing mean consumers' ratings for PIs and PILs.

RESULTS

Thirty participants engaged in the cognitive interview and 120 participants completed the CIRF. The PCA found the 17 items of the CIRF were extracted into three factors: comprehensibility, utility and design quality scales, mirroring the original. Cronbach's α for the overall scale (0.904) indicated good internal consistency. Known-group validity demonstrated significant differences in consumers' rating between PIs and PILs for almost all items (p<0.001).

CONCLUSION

Thai version of CIRF had acceptable validity and reliability for Thai consumers' ratings of written medicine information. The CIRF could be of practical use in the process of developing medicine information to ensure consumers' comprehension and their usefulness.

Sexual health communication in COPD: The role, contents and design of patient information leaflets

Understanding need for support and information among people with COPD is important for the delivery of patient-centred care. Especially regarding intimacy matters, many people wish to remain sexually active but may be struggling to find out how, as information and communication regarding sexual health is scarce. This is especially true when it comes to people with chronic obstructive pulmonary disease (COPD). The present review seeks to provide an overview of the role, contents and design of patient information leaflets (PILs) and discuss their application in sexual health communication for COPD. Based on the literature, a number of key points in the design of high-quality PILs are suggested, and important areas for the improvement of patients-clinician communication are highlighted. While PILs is a commonly used format to provide information in healthcare, other formats, e.g. video and podcasts, could be explored. Prioritizing the development of material to support communication in the future is necessary to address the needs of both patients and caregivers and to support clinicians in initiating conversations about sexual health and intimacy matters.

Evaluating the Quality of Health-Related WeChat Public Accounts: Cross-Sectional Study

Background

As representatives of health information communication platforms accessed through mobile phones and mobile terminals, health-related WeChat public accounts (HWPAs) have a large consumer base in the Chinese-speaking world. However, there is still a lack of general understanding of the status quo of HWPAs and the quality of the articles they release.

Objective

The aims of this study were to assess the conformity of HWPAs to the Health on the Net Foundation Code of Conduct (HONcode) and to evaluate the suitability of articles disseminated by HWPAs.

Methods

The survey was conducted from April 23 to May 5, 2019. Based on the monthly (March 1-31, 2019) WeChat Index provided by Qingbo Big Data, the top 100 HWPAs were examined to evaluate their HONcode compliance. The first four articles published by each HWPA on the survey dates were selected as samples to evaluate their suitability. All materials were assessed by three raters. The materials were assessed using the HONcode checklist and the Suitability Assessment of Materials (SAM) score sheet. Data analysis was performed with SPSS version 17.0 (SPSS Inc, Chicago, IL, USA) and Excel version 2013 (Microsoft Inc, Washington DC, USA).

Results

A total of 93 HWPAs and 210 of their released articles were included in this study. For six of the eight principles, the 93 HWPAs nearly consistently did not meet the requirements of the HONcode. The HWPAs certified by Tencent Corporation (66/93, 71%) were generally slightly superior to those without such certification (27/93, 29%) in terms of compliance with HONcode principles. The mean SAM score for the 210 articles was 67.72 (SD 10.930), which indicated “adequate” suitability. There was no significant difference between the SAM scores of the articles published by certified and uncertified HWPAs (P=.07), except in the literacy requirements dimension (t_df=97=–2.418, P=.02).

Conclusions

The HWPAs had low HONcode conformity. Although the suitability of health information released by HWPAs was at a moderate level, there were still problems identified, such as difficulty in tracing information sources, excessive implicit advertisements, and irregular usage of charts. In addition, the low approval requirements of HWPAs were not conducive to improvement of their service quality.

Analysis of written resources for parents of children discharged from a paediatric emergency department

The aim of this study was to profile the information and readability of parent-focused resources to support care at home following a child's discharge from a paediatric emergency department (ED). Analysis included recording the scope, source, readability scores and benchmarking the contents against previous recommendations for discharge information. Information from 46 resources (on 41 conditions) from three separate sources was analysed. Overall, a wide range of resources was available. Inconsistency was evident in the framework and design of resources available. Approximately two-thirds of resources provided information about referral to community resources, and most had links to community health providers. Assessment of readability levels showed a predominant pitch towards a relatively high level of schooling. Existing written resources available for parents to use in caring for their child following discharge from an ED could improve with more streamlined designs as well as consistent references to community resources and additional health providers. Parents with low reading capacity may not be able to make the most of existing resources to care for their child at home following ED discharge. This framework was developed for reviewing the resources that could be useful for quality assessment of other parent-focused discharge information.

‘To be understood as to understand’: A readability analysis of public library acceptable use policies

Acceptable Use Policies (AUPs) are documents stating the limitations users must agree to when first accessing information and communications technologies (ICTs) in organisations, such as employers, educational institutions and public libraries. AUPs lay out the parameters of acceptable use expected of someone accessing the ICT services provided, and should state in clear and understandable terms what behaviours will attract sanctions, both legal and in terms of restricting future access. Utilising a range of standard readability tests used to measure how understandable documents are, the paper investigates how readable the AUPs presented to public library patrons in the UK are in practice. Of the 206 AUPs in use across the local government departments who manage public library services 200 were obtained and subjected to a range of readability testing procedures. Four readability tests were used for analysis: the Flesch Reading Ease, the Coleman-Liau Index, the Gunning Fog Index and the SMOG Grade. Results for all four readability tests administered on all AUPs raise significant questions. For the Flesch Reading Ease score only 5.5% of AUPs scored at the standard readability level or higher (60+), and 8% scored at a very high level of difficulty akin to a piece of scientific writing. Similarly, for SMOG, only 7.5% of the 200 AUPs scored at the recommended level of 10. Likewise, very few AUPs scored at levels recommended for a general audience with either the Gunning Fog Index (11.5%) or the Coleman-Liau Index (2%). With such variability in readability, the fitness for purpose of the average AUP as a contract patrons must agree to can be called into question. This paper presents the first ever analysis of the readability of library AUPs in the literature. Recommendations are made as to how public library services may improve this aspect of practice.

A comparison of genomic laboratory reports and observations that may enhance their clinical utility for providers and patients

Purpose

To assess clinical chromosomal microarray (CMA) genomic testing reports for the following: (a) usage of reporting elements consistent with 2011 ACMG guidelines and other elements identified in the primary literature, (b) information quality, and (c) readability.

Methods

We retrospectively analyzed genomic testing reports from 2011 to 2016 provided to, or by our laboratory to aid in clinical detection and interpretation of copy number variants. Analysis was restricted to the following sections: interpretation, recommendations, limitations, and citations. Analysis included descriptive characteristics, reporting elements, reading difficulty using the Simple Measure of Gobbledygook (SMOG), and quality ratings using a subset of questions adapted from the DISCERN‐Genetics questionnaire.

Results

The analysis included 44 unique reports from 26 laboratories comprising four groups: specialty laboratories (SL; N = 9), reference laboratories (RL; N = 12), hospital laboratories (HL; N = 10), and university‐based laboratories (UL; N = 13). There were 23 abnormal/pathogenic reports and 21 of uncertain/unknown significance. Nine laboratories did not include one or more pieces of information based on ACMG guidelines; only one of ten laboratories reported condition‐specific management/treatment information when available and relevant. Average quality ratings and readability scores were not significantly different between laboratory types or result classification.

Conclusions

Reporting practices for most report elements varied widely; however, readability and quality did not differ significantly between laboratory types. Management and treatment information, even for well‐known conditions, are rarely included. Effectively communicating test results may be improved if certain reporting elements are incorporated. Recommendations to improve laboratory reports are provided.

Languages for different health information readers: multitrait-multimethod content analysis of Cochrane systematic reviews textual summary formats

Background

Although subjective expressions and linguistic fluency have been shown as important factors in processing and interpreting textual facts, analyses of these traits in textual health information for different audiences are lacking. We analyzed the readability and linguistic psychological and emotional characteristics of different textual summary formats of Cochrane systematic reviews.

Methods

We performed a multitrait-multimethod cross-sectional study of Press releases available at Cochrane web site (n = 162) and corresponding Scientific abstracts (n = 158), Cochrane Clinical Answers (n = 35) and Plain language summaries in English (n = 156), French (n = 101), German (n = 41) and Croatian (n = 156). We used SMOG index to assess text readability of all text formats, and natural language processing tools (IBM Watson Tone Analyzer, Stanford NLP Sentiment Analysis and Linguistic Inquiry and Word Count) to examine the affective states and subjective information in texts of Scientific abstracts, Plain language summaries and Press releases.

Results

All text formats had low readability, with SMOG index ranging from a median of 15.6 (95% confidence interval (CI) 15.3–15.9) for Scientific abstracts to 14.7 (95% CI 14.4–15.0) for Plain language summaries. In all text formats, “Sadness” was the most dominantly perceived emotional tone and the style of writing was perceived as “Analytical” and “Tentative”. At the psychological level, all text formats exhibited the predominant “Openness” tone, and Press releases scored higher on the scales of “Conscientiousness”, “Agreeableness” and “Emotional range”. Press releases had significantly higher scores than Scientific abstracts and Plain language summaries on the dimensions of “Clout”, and “Emotional tone”.

Conclusions

Although the readability of Plain language summaries was higher than that of text formats targeting more expert audiences, the required literacy was much higher than the recommended US 6th grade level. The language of Press releases was generally more engaging than that of Scientific abstracts and Plain language summaries, which are written by the authors of systematic reviews. Preparation of textual summaries about health evidence for different audiences should take into account readers’ subjective experiences to encourage cognitive processing and reaction to the provided information.

Electronic supplementary material

The online version of this article (10.1186/s12874-019-0716-x) contains supplementary material, which is available to authorized users.

Medicine package inserts from the users' perspective: are they read and understood?

INTRODUCTION

The written information on medicines has been acknowledged as an important tool for health education.

OBJECTIVE

To analyze the use and understanding of medicine package inserts by users and assess sociodemographic and medical factors associated with their comprehension.

METHOD

Data in this analysis are part of the PNAUM National Survey - a cross-sectional population-based study conducted in Brazil. Descriptive statistics and the Pearson χ2 tests were performed to compare proportions between sociodemographic and medical characteristics, as well as use and understanding of medicine package inserts.

RESULTS

A total of 28.427 individuals responded to questions related to medicine package inserts. From these, 59.6% (95%CI 57.7 - 61.5) said they usually read the inserts, and 98.4% (95%CI 98.0 - 98.8) considered them necessary. Among people who read the medicine package inserts, more than half indicated difficulties with legibility (57.4%; 95%CI 55,2 - 59,6) and readability (54.1%; 95%CI 52.1 - 56.1). People from a lower education level reported greater difficulty in understanding them.

CONCLUSION

The larger portion of the population usually read medicine package inserts. Nevertheless, people have difficulty in reading and understanding them.

Educator and Student Hand Hygiene Adherence in Dental Schools: A Systematic Review and Meta-Analysis

Health professionals and their patients are subject to cross-contamination and potential exposure to harmful infectious diseases. A common form of cross-contamination is through dental procedures without proper instrument care and lack of hand hygiene. The aim of this systematic review was to evaluate the published research on the adherence of educators and students in academic dental institutions to hand hygiene procedures. This systematic review was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and included articles collected in the Cochrane, LILACS, PubMed, Science Direct, Scopus, and Web of Science databases. The initial search identified 1,196 articles. Ultimately, three studies were included for qualitative synthesis and two for the meta-analysis. The three articles had similar characteristics of observational hand hygiene research involving educators and dental students. In all three, hand hygiene among dental students did not reach 50% of the total number of opportunities, which is a troubling result. Although the hand hygiene rate of educators was higher than that of dental students, these findings point to a need to further promote hand hygiene to future professionals to avoid cross-contamination between health professionals and patients.

Consumer satisfaction with National Alliance on Mental Illness written medicine information

Introduction

Written medicine information (WMI) is a collection of facts for a specific medication, and it helps facilitate patient understanding of medication therapy. The primary objective of this study was to assess consumer satisfaction with National Alliance on Mental Illness (NAMI) WMI. A secondary objective was to assess health care professional satisfaction.

Methods

National Alliance on Mental Illness WMI and surveys were offered to consumers, health care professionals, and trainees at 3 treatment centers with psychiatric services. All adults who received medication counseling were eligible for inclusion. Survey responses were evaluated using descriptive statistics.

Results

Most consumers (82.4%) and providers (74.5%) reported overall satisfaction with NAMI WMI. Consumers were least satisfied with information on how to manage unwanted effects, drug-drug interactions, and readability (9.5%, 14.9%, 41.9% dissatisfaction).

Discussion

Evaluation and feedback from consumers and health care professionals may influence decisions to refine NAMI WMI to meet consumer needs.

Readability of written medicine information materials in Arabic language: expert and consumer evaluation

BACKGROUND

Written Medicine Information (WMI) is one of the sources that patients use to obtain information concerning medicine. This paper aims to assess the readability of two types of WMIs in Arabic language based on vocabulary use and sentence structure using a panel of experts and consumers.

METHODS

This is a descriptive study. Two different types of materials, including the online text from King Abdullah Bin Abdulaziz Arabic Health Encyclopaedia (KAAHE) and medication leaflets submitted by the manufacturers to the Saudi Food and Drug Authority (SFDA) were evaluated. We selected a group of sentences from each WMI. The readability was assessed by experts (n = 5) and consumers (n = 5). The sentence readability of each measured using a specific criteria and rated as 1 = easy, 2 = intermediate, or 3 = difficult.

RESULTS

A total of 4476 sentences (SFDA 2231; KAHEE 2245) extracted from websites or patient information leaflets on 50 medications and evaluated. The majority of the vocabulary and sentence structure was considered easy by both expert (SFDA: 68%; KAAHE: 76%) and consumer (SFDA: 76%; KAAHE: 84%) groups. The sentences with difficult or intermediate vocabulary and sentence structure are derived primarily from the precautions and side effects sections.

CONCLUSIONS

The SFDA and KAAHE WMIs are easy to read and understand as judged by our study sample. However; there is room for improvement, especially in sections related to the side effects and precautions.

Does cohort matter in the association between education, health literacy and health in the USA?

Summary

Growing empirical evidence supports the generally positive relationship between education, health literacy and health outcomes. However, little is known about cohort in this relationship. This study examined the role of cohort defined by 10-year age period in the association between educational attainment, health literacy and self-rated health. The data were obtained from the 2003 National Assessment of Adult Literacy survey restricted file. Focusing on nationally representative community-dwelling adults age 25 years and older, self-rated health was modeled as a function of health literacy, educational attainment, cohorts (defined by 10-year age periods), other demographic characteristics and socio-economic status. While the youngest cohort was positively associated with self-rated health, middle-age cohorts were more likely to have lower self-rated health (compared with the age 65 years and older cohort). Interestingly, age was no longer statistically significant after adjusting for cohort and other covariates. Recognition of possible cohort effects in education, health literacy and health should be reflected in future health literacy research and intervention programs for addressing health disparities in the USA.

Patient Evaluation of Medication Package Leaflets in Al Kharj City, Saudi Arabia

OBJECTIVE

The purpose of this study was to determine how well patients could correctly recognize and comprehend the various information items in over-the-counter (OTC) medications package leaflets in Saudi Arabia.

METHODS

Leaflets from 20 most commonly sold OTC medications were examined by experts to evaluate the leaflet layout, language, and content. The same leaflets were also evaluated by patients who had their medicines dispensed at 2 hospitals and 8 community pharmacies in Al Kharj, Saudi Arabia. A questionnaire was used for the patients' examination.

RESULTS

A total of 479 questionnaires were included in the study. Each package leaflet was examined by at least 20 participants. The results indicate poor comprehensibility, for many items, particularly items regarding "drug interactions" and "contraindications."

CONCLUSION

The participants had some difficulty recognizing and comprehending certain information items in the package leaflets that are supplied with OTC medications in Saudi Arabia.

Readability of patient information and consent documents in rheumatological studies

BACKGROUND

Before participation in medical research an informed consent must be obtained. This study investigates whether the readability of patient information and consent documents (PICDs) corresponds to the average educational level of participants in rheumatological studies in the Netherlands, Denmark, and Norway.

METHODS

24 PICDs from studies were collected and readability was assessed independently using the Gunning's Fog Index (FOG) and Simple Measure of Gobbledygook (SMOG) grading.

RESULTS

The mean score for the FOG and SMOG grades were 14.2 (9.0-19.0) and 14.2 (12-17) respectively. The mean FOG and SMOG grades were 12.7 and 13.3 in the Dutch studies, 15.0 and 14.9 in the Danish studies, and 14.6 and 14.3 in the Norwegian studies, respectively. Out of the 2865 participants, more than 57 % had a lower educational level than the highest readability score calculated in the individual study.

CONCLUSIONS

As the readability level of the PICDs did not match the participants' educational level, consent may not have been valid, as the participants may have had a limited understanding of what they agreed to participate in. There should be more focus on the readability of PICDs. National guidelines for how to write clear and unambiguous PICDs in simple and easily understandable language could increase the focus on the readability of PICD.

State of the science of health literacy measures: Validity implications for minority populations

OBJECTIVES

To review the evidence supporting the validity of health literacy (HL) measures for ethnic minority populations.

METHODS

PubMed, CINAHL, and PsycINFO databases were searched for HL measures between 1965 and 2013.

RESULTS

A total of 109HL measures were identified; 37 were non-English HL measures and 72 were English language measures. Of the 72 English language measures, 17 did not specify the racial/ethnic characteristic of their sample. Of the remaining 55 measures, 10 (18%) did not include blacks, 30 (55%) did not include Hispanics, and 35 (64%) did not include Asians in their validation sample. When Hispanic and Asian Americans were included, they accounted for small percentages in the overall sample. Between 2005-2013, a growing number of REALM and TOFHLA translations were identified, and new HL measures for specific cultural/linguistic groups within and outside the United States were developed.

CONCLUSIONS

While there are a growing number of new and translated HL measures for minority populations, many existing HL measures have not been properly validated for minority groups.

PRACTICE IMPLICATIONS

HL measures that have not been properly validated for a given population should be piloted before wider use. In addition, improving HL instrument development/validation methods are imperative to increase the validity of these measures for minority populations.

Essential Medication Information for Patients: Ensuring Access

The US Food and Drug Administration (FDA) is developing a new framework to provide patients with quality, up-to-date prescription product information that will promote the safe use of prescribed medication. The goal of this new Patient Medication Information is to provide patient-oriented information for each prescription product. Described in this article are the efforts of the FDA to help ensure that patients receive essential prescription medication information.

Is the cloze procedure appropriate to evaluate health literacy in older individuals? Age effects in the test of functional health literacy in adults

Health literacy has received increasing attention because of its importance for older individuals' health, as studies have shown a close relation between older individuals' health literacy and their health. Research also suggests that older individuals have low levels of health literacy, but this finding is variable and may depend on which health literacy test is used. Older individuals assessed with the Test of Functional Health Literacy (TOFHLA) score lower than younger individuals, but a previous study suggested that this may result from age-related differential item functioning (DIF) on the TOFHLA. The study reported here assessed age-related DIF in a sample of community-dwelling volunteers. Twenty-two percent of items were differentially more difficult for older individuals independent of their overall ability, and when these items were eliminated from the total score, age differences were no longer found. Performance on a working memory task predicted older but not younger individuals' performance on the age-related items. At least part of older individuals' apparent deficits in health literacy when assessed by the TOFHLA may be related to DIF on its items. The TOFHLA, and any measure that employs the cloze procedure to evaluate reading comprehension, should be used cautiously in older individuals.

A content analysis of visual cancer information: prevalence and use of photographs and illustrations in printed health materials

Researchers and practitioners have an increasing interest in visual components of health information and health communication messages. This study contributes to this evolving body of research by providing an account of the visual images and information featured in printed cancer communication materials. Using content analysis, 147 pamphlets and 858 images were examined to determine how frequently images are used in printed materials, what types of images are used, what information is conveyed visually, and whether or not current recommendations for the inclusion of visual content were being followed. Although visual messages were found to be common in printed health materials, existing recommendations about the inclusion of visual content were only partially followed. Results are discussed in terms of how relevant theoretical frameworks in the areas of behavior change and visual persuasion seem to be used in these materials, as well as how more theory-oriented research is necessary in visual messaging efforts.

Readability assessment of package inserts of biological medicinal products from the European medicines agency website

BACKGROUND

Package inserts that accompany medicines are a common source of information aimed at patients and should match patient abilities in terms of readability.

OBJECTIVE

Our objective was to determine the degree of readability of the package inserts for biological medicinal products commercially available in 2007 and compare them with the readability of the same package inserts in 2010.

METHODS

A total of 33 package inserts were selected and classified into five groups according to the type of medicine: monoclonal antibody-based products, cytokines, therapeutic enzymes, recombinant blood factors and other blood-related products, and recombinant hormones. The package inserts were downloaded from the European Medicines Agency website in 2007 and 2010. Readability was evaluated for the entire text of five of the six sections of the package inserts and for the 'Annex' when there was one. Three readability formulas were used: SMOG (Simple Measure of Gobbledygook) grade, Flesh-Kincaid grade level, and Szigriszt's perspicuity index.

RESULTS

No significant differences were found between the readability results for the 2007 package inserts and those from 2010 according to any of the three readability indices studied (p>0.05). However, there were significant differences (p<0.05) between the readability scores of the sections of the package inserts in both 2007 and 2010. The readability of the package inserts was above the recommended sixth grade reading level (ages 11-12) and may lead to difficulties of understanding for people with limited literacy.

CONCLUSIONS

All the sections should be easy to read and, therefore, the readability of the medicine package inserts studied should be improved.

Reading comprehension of health checkup reports and health literacy in Japanese people

OBJECTIVES

To determine the reading comprehension of health checkup reports in the context of health literacy (HL) in Japanese people.

METHODS

A web-based survey was conducted among 424 Japanese adults aged 35-59 years. Participants were asked to read specifically designed health checkup reports and then answer a series of questions to examine whether they accomplished the fundamental purposes of health checkup reports (recognition of the problems, recognition of the risk of illness, recognition of the need for preventive action, and motivation for preventive action). HL was simultaneously measured using the 14-item health literacy scale (HLS-14), the 11-item Lipkus scale (Lipkus-J), and the Newest Vital Sign (NVS-J).

RESULTS

About 70 % of the study subjects misread the normal/abnormal classification for at least one items. Those with lower HLS-14 scores were significantly less likely to recognize the problems, the risk of illness, and the need for preventive action for the examinee, and also less likely to express their willingness to take preventive action in compliance with the doctor's advice after having received the health checkup report. Compared with the HLS-14 scores, the Lipkus-J and NVS-J scores showed hardly any association with the reading comprehension of health checkup reports.

CONCLUSION

All examinees do not always have an adequate level of HL. HL may be the major determinant of reading comprehension of health checkup reports. For more effective health checkups, health promotion service providers should become aware of the existence of examinees with inadequate HL and address the problem of misreading health checkup results.

Health education literacy in patients with chronic musculoskeletal diseases: development of a new questionnaire and sociodemographic predictors

It was our aim to develop a questionnaire for patients with chronic musculoskeletal diseases to self-report their health education literacy, to analyse the psychometric properties of the instrument and to test hypotheses concerning sociodemographic predictors of health education literacy. A total of 577 patients with chronic back pain or osteoarthritis who underwent inpatient rehabilitation were surveyed. The resulting 'HELP questionnaire' (health education literacy of patients with chronic musculoskeletal diseases) consists of 18 items and three scales (comprehension of medical information, applying medical information, communicative competence in provider interactions). The instrument's psychometric properties are good (Cronbach's alpha between 0.88 and 0.95, unidimensionality and Rasch model fit established). Our sample's average level of self-reported health education literacy is quite high. However, 20-30% of the patients admitted to having difficulty understanding important aspects of health education programmes (i.e. comprehending what medical information means in relation to their disease). The variance explained by sociodemographic and basic medical variables is small (4-8%). Greater effort is required to make health education programmes easier to understand. There is a need for more research on interindividual variability of complex aspects of health literacy.

Health knowledge among the millennial generation

The Millennial Generation, also known as Generation Y, is the demographic cohort following Generation X, and is generally regarded to be composed of those individuals born between 1980 and 2000. They are the first to grow up in an environment where health-related information is widely available by internet, TV and other electronic media, yet we know very little about the scope of their health knowledge. This study was undertaken to quantify two domains of clinically relevant health knowledge: factual content and ability to solve health related questions (application) in nine clinically related medical areas. Study subjects correctly answered, on average, 75% of health application questions but only 54% of health content questions. Since students were better able to correctly answer questions dealing with applications compared to those on factual content contemporary US high school students may not use traditional hierarchical learning models in acquisition of their health knowledge.

Health Literacy Assessment of the STOFHLA: Paper versus electronic administration continuation study

Low health literacy is associated with poor health outcomes. Research is needed to understand the mechanisms and pathways of its effects. Computer-based assessment tools may improve efficiency and cost-effectiveness of health literacy research. The objective of this preliminary study was to assess if administration of the Short Test of Functional Health Literacy in Adults (STOFHLA) through a computer-based medium was comparable to the paper-based test in terms of accuracy and time to completion. A randomized, crossover design was used to compare computer versus paper format of the STOFHLA at a Midwestern family medicine residency program. Eighty participants were initially randomized to either computer (n = 42) or paper (n = 38) format of the STOFHLA. After a 30-day washout period, participants returned to complete the other version of the STOFHLA. Data analysis revealed no significant difference between paper- and computer-based surveys (p = .9401; N = 57). The majority of participants showed "adequate" health literacy via paper- and computer-based surveys (100% and 97% of participants, respectively). Electronic administration of STOFHLA results were equivalent to the paper administration results for evaluation of adult health literacy. Future investigations should focus on expanded populations in multiple health care settings and validation of other health literacy screening tools in a clinical setting.

The comprehensibility of health education programs: questionnaire development and results in patients with chronic musculoskeletal diseases

OBJECTIVE

The objective was to develop a comprehensive questionnaire for measuring the patient-perceived comprehensibility of health education programs (COHEP questionnaire). According to a conceptual model outlined in the article, comprehensibility is considered a context factor of patient health literacy.

METHODS

A questionnaire study was carried out on N=577 patients with chronic musculoskeletal diseases. During inpatient rehabilitation, patients participated in standardized, interactive group education programs conducted by clinic personnel. Factorial structure, unidimensionality, reliability, fit to the Rasch model, and construct validity were tested.

RESULTS

The COHEP consists of 30 items and 4 scales (comprehension-fostering behavior of program trainers, transferability to everyday life, comprehensibility of medical information, amount of information). All scales are reliable, unidimensional, and meet the requirements of the Rasch model. In addition, there are initial indications of validity. The descriptive results show that the overall rating of the comprehensibility of patient education programs in the German rehabilitation system is good, but that there are clear differences between centers.

CONCLUSION

The COHEP can be used to evaluate health education programs, since it measures an important proximal outcome.

PRACTICE IMPLICATIONS

An analysis of patient-perceived comprehensibility can help providers adapt education sessions better to the health literacy of patients.

Quality and readability of information materials for people with brain tumours and their families

Written information is commonly used to inform patients about their disease and treatment but must be evidence-based and understandable to be useful. This study assessed the quality of the content and the readability of information brochures for people affected by brain tumours. We randomly selected 18 publicly available brochures. Brochures were assessed by criteria to assess the quality of content using the DISCERN instrument. Readability was tested using three commonly used formulas, which yield the reading grade level required to comprehend the brochure (sixth grade level recommended). The mean overall DISCERN score was 3.17 out of a maximum of 5 (moderate quality); only one achieved a rating greater than 4 (high quality). Only one brochure met the sixth grade readability criteria. Although brochures may have accurate content, few satisfied all of the recommended criteria to evaluate their content. Existing brochures need to be critically reviewed and simplified and consumer-focused brochures, produced.

Evaluation of medication package inserts in Saudi Arabia

Purpose

The aim of this study was to examine if package inserts (PIs) supplied with prescribed and over-the-counter medications in Saudi Arabia contain information relevant for the safe and appropriate use of these medications.

Methods

Sixty PIs for prescription-only medications (n = 37) and over-the-counter medications (n = 23) were evaluated against a set of safety criteria compiled from the literature.

Results

Analyzed PIs were defective in many aspects. Particularly of concern were unclear dosage instructions, lack of measures to be taken when an administrative error was made, inappropriate presentation of side effects, and lack of measures to be taken if serious side effects occurred.

Conclusion

This study indicated that information relevant to the safe and appropriate use of medications was not uniformly mentioned in the PIs analyzed. To avoid medication errors due to deficits in the current PIs, we recommend improvement in the existing PIs based on best practice for information content and design.