The Information Assessment Method: Over 15 years of research evaluating the value of health information

Fathers and Mothers with Low Socioeconomic Status Anticipate More Benefits from Trustworthy Easy-to- Read Online Child-Related Information Compared to Other Parents: The 4-Year IAM Prospective Time Series

INTRODUCTION

Almost all parents seek online child-related information. This study focuses on parents' experience of using information from an easy-to-read parenting website, Naître et Grandir (N&G), specifically parents with low socioeconomic status (SES). SES is correlated with health literacy, a major determinant of child education and health. In January 2019, the Information Assessment Method (IAM) questionnaire was improved and implemented in a smartphone application (IAM + N&Gsmart) to reach more low SES parents.

OBJECTIVES

We measured the influence of IAM + N&Gsmart on the frequency with which low SES parents responded to the IAM survey of N&G webpages and the relative proportions of anticipated benefits of the N&G content. We also compared these benefits among fathers and mothers.

METHODS

This was a 4-year prospective time series. For each N&G webpage, parents were invited to complete an IAM questionnaire and report anticipated outcomes. IAM data were collected before (2017-2018) and after (2019-2020) the intervention (IAM + N&Gsmart launch) from Quebec parents of 0-8-year-old children who completed at least one IAM questionnaire. Descriptive and inferential statistical analyses were applied.

RESULTS

Participants completed 10,362 IAM questionnaires. Low SES participants anticipated more benefits than other participants, and particularly low SES fathers more than low SES mothers. The proportion of responses and reported benefits from low SES participants increased post-intervention.

CONCLUSIONS FOR PRACTICE

Results suggest that increasing literacy-oriented web content can lead to greater benefits among low SES parents, and that increasing father awareness and father-inclusive content can lead to even greater benefits among low SES fathers.

Expected Health Benefits as the Ultimate Outcome of Information Available on Stroke Engine, a Knowledge Translation Stroke Rehabilitation Website: Web-Based Survey

BACKGROUND

Electronic knowledge resources are readily available and typically target different audiences, including health professionals and the public, that is, those with lived experience and their relatives. The knowledge-to-action framework, in combination with the information assessment method (IAM), considering both the value-of-information construct and the conceptual model of acquisition-cognition-application, can be used to support the evaluation process of such resources. As an example, Stroke Engine is an evidence-based knowledge translation resource in stroke rehabilitation (assessments and interventions) for health professionals and students as well as individuals who have sustained a stroke and their relatives. According to Google Analytics, the website is perused >10,000 times per week.

OBJECTIVE

With the overall aim to improve the content available on Stroke Engine, we documented Stroke Engine users' perceptions of situational relevance, cognitive impact, intention to use, and expected patient and health benefits regarding the information consulted.

METHODS

A web-based survey anchored in the IAM was made available via an invitation tab. The IAM is a validated questionnaire that is designed to assess the value of information. Sociodemographic characteristics were also collected, and a space for free-text comments was provided. Descriptive statistics were used, and thematic analysis was used for the free-text comments.

RESULTS

The sample consisted of 6634 respondents. Health professionals (3663/6634, 55.22%) and students (2784/6634, 41.97%) represented 97.18% (6447/6634) of the total responses. The remaining 2.82% (187/6634) of the responses were from individuals who had sustained a stroke (87/6634, 1.31%) and their relatives (100/6634, 1.51%). Regarding situational relevance, assessments (including selecting, obtaining, and interpreting results from a test) was the main topic searched by health professionals (1838/3364, 54.64%) and students (1228/2437, 50.39%), whereas general information on stroke rehabilitation was the top-ranked topic for nearly two-thirds of the individuals with stroke (45/76, 59%) and their relatives (57/91, 63%). Cognitive impact was characterized by learning something new. Intention to use was high (4572/6379, 71.67%) among the respondents and varied in context (eg, refine a topic, research, class assignments, teaching, and education). Respondents commented on ways to improve content. Expected patient and health benefits such as improvement in health and well-being was the top-ranked category for all 4 subgroups, followed by the avoidance of unnecessary or inappropriate treatment for health professionals (183/623, 29.4%) and a feeling of being reassured for individuals with stroke (26/75, 35%) and their relatives (28/97, 29%).

CONCLUSIONS

Valuable feedback on Stroke Engine was obtained in terms of its accessibility, relevance for informational needs and retrieval, accuracy, and applicability; however, of utmost importance is the potential implementation of its evidence-based content in clinical practice and the perceived expected impact on patients, their relatives, and their health professionals. The feedback received allowed for corrections and the identification of key topics for further development.

Validation of a generic impact survey for use by health library services indicates the reliability of the questionnaire

BACKGROUND

A validated generic impact questionnaire can demonstrate how individual and groups of health libraries contribute to continuing education and patient care outcomes.

OBJECTIVES

To validate an existing generic questionnaire for Knowledge for Healthcare, England by examining: (1) internal reliability; (2) content validity; and (3) suggest revisions.

METHODS

Methods used included Cronbach's alpha test, simple data mining of patterns among a data set of 187 questionnaire responses and checking respondents' interpretation of questions.

RESULTS

Cronbach's alpha was 0.776 (acceptable internal reliability). The patterns of responses indicated that respondents' interpretations of the questions were highly plausible, and consistent. The meaning of 'research' varied among different occupational groups, but overall, respondents could identify relevant personal and service impacts. However, users were confused about the terms that libraries use to describe some services.

DISCUSSION

The analysis indicated that the questionnaire worked well for the two types of personal services (literature/evidence searches and training/e-learning) frequently cited on the responses. Further research may be required for library assessment of the impact of other services such as digital resource services.

CONCLUSIONS

The generic questionnaire is a reliable way of assessing the impact of health library and knowledge services, both individually and collectively.

Proxy Information Seeking by Users of a Parenting Information Website: Quantitative Observational Study

BACKGROUND

One of the largest groups of consumers who seek health information on the internet are parents of young children, as well as people in their social circle. The concept of proxy seeking (on behalf of others) has been explored in the literature, yet little is known about the outcomes.

OBJECTIVE

The main aim of this study was to describe consumer health information outcomes reported by proxy seekers using a parenting website.

METHODS

We conducted a 2-year quantitative observational study. Participants were parents of 0- to 8-year-old children and members of their entourage in Canada who had accessed Naître et Grandir through the website or through a weekly newsletter. For each Naître et Grandir webpage, participants' perceptions regarding the outcomes of seeking and using specific webpages were gathered using a content-validated Information Assessment Method questionnaire. We compared the outcomes reported by parents with those reported by members of their entourage after consulting a parenting information website and explored if the method of accessing the information by the proxy seekers (website or weekly newsletter) changed the outcomes reported. For key primary survey items, the chi-square test was conducted, and differences in relative frequencies of responses were computed along with confidence intervals.

RESULTS

A total of 51,325 completed questionnaires were included in the analysis, pertaining to 1079 Naître et Grandir webpages (mean 48; range 1-637). Compared to parents, individuals in the entourage are more likely to report using the information in discussion with others (mean difference 0.166, 95% CI 0.155-0.176). Parents, on the other hand, were more likely than the entourage to report using the information to better understand (mean difference 0.084, 95% CI 0.073-0.094), to decide to do something (mean difference 0.156, 95% CI 0.146-0.166), or to do something in a different manner (mean difference 0.052, 95% CI 0.042-0.061). In addition, results suggest that the differences in perceived benefits of parenting information by the entourage depend on how they access the information. Respondents who were actively seeking the information (through the website) were more likely to report that the information would help them be less worried (mean difference 0.047; 95% CI 0.024-0.069), handle a problem (mean difference 0.083; 95% CI 0.062-0.104), and decide what to do with someone else (mean difference 0.040, 95% CI 0.020-0.058). Respondents who passively acquired the information (through the newsletter) were more likely to report that the information would help improve the health or well-being of a child (mean difference 0.090; 95% CI 0.067-0.112).

CONCLUSIONS

By better understanding how consumers and their entourages use information, information providers can adapt information to meet both individual and group needs, and health care practitioners can target patients' entourages with web-based health information resources for dissemination and use.

Outcomes of Equity-Oriented, Web-Based Parenting Information in Mothers of Low Socioeconomic Status Compared to Other Mothers: Participatory Mixed Methods Study

BACKGROUND

Typically, web-based consumer health information is considered more beneficial for people with high levels of education and income. No evidence shows that equity-oriented information offers equal benefits to all. This is important for parents of low socioeconomic status (SES; low levels of education and income and usually a low level of literacy).

OBJECTIVE

This study is based on a conceptual framework of information outcomes. In light of this, it aims to compare the perception of the outcomes of web-based parenting information in low-SES mothers with that of other mothers and explore the perspective of low-SES mothers on contextual factors and information needs and behavior associated with these outcomes.

METHODS

A participatory mixed methods research was conducted in partnership with academic researchers and Naître et grandir (N&G) editors. N&G is a magazine, website, and newsletter that offers trustworthy parenting information on child development, education, health, and well-being in a format that is easy to read, listen, or watch. Quantitative component (QUAN) included a 3-year longitudinal observational web survey; participants were mothers of 0- to 8-year-old children. For each N&G newsletter, the participants' perception regarding the outcomes of specific N&G webpages was gathered using a content-validated Information Assessment Method (IAM) questionnaire. Differences between participants of low SES versus others were estimated. Qualitative component (QUAL) was interpretive; participants were low-SES mothers. The thematic analysis of interview transcripts identified participants' characteristics and different sources of information depending on information needs. Findings from the two components were integrated (QUAN+QUAL integration) through the conceptual framework and assimilated into the description of an ideal-typical mother of low SES (Kate). A narrative describes Kate's perception of the outcomes of web-based parenting information and her perspective on contextual factors, information needs, and behavior associated with these outcomes.

RESULTS

QUAN-a total of 1889 participants completed 2447 IAM responses (50 from mothers of low SES and 2397 from other mothers). N&G information was more likely to help low-SES participants to better understand something, decrease worries, and increase self-confidence in decision making. QUAL-the 40 participants (21 N&G users and 19 nonusers) used 4 information sources in an iterative manner: websites, forums, relatives, and professionals. The integration of QUAN and QUAL findings provides a short narrative, Kate, which summarizes the main findings.

CONCLUSIONS

This is the first study comparing perceptions of information outcomes in low-SES mothers with those of other mothers. Findings suggest that equity-oriented, web-based parenting information can offer equal benefits to all, including low-SES mothers. The short narrative, Kate, can be quickly read by decision policy makers, for example, web editors, and might encourage them to reach the underserved and provide and assess trustworthy web-based consumer health information in a format that is easy to read, listen, or watch.