Lessons learned from using whiteboard videos and YouTube for deprescribing guidelines knowledge mobilization

OBJECTIVES

Deprescribing is the planned and supervised process of dose reduction or stopping medication. Few clinical guidelines exist to help health care professionals in making decisions about deprescribing. The Bruyère Deprescribing Guidelines Team developed a series of evidence-based medication-class specific deprescribing guidelines and, to extend reach and uptake, disseminated them as whiteboard videos published on YouTube. This paper reports on the creation, sharing and evaluation of videos on proton pump inhibitor (PPI), antihyperglycemic (AHG), antipsychotic (AP) and benzodiazepine receptor agonist (BZRA) deprescribing guidelines.

METHODS

Whiteboard videos depict an animator drawing on a whiteboard, while the narrator reads the script. In each video, the deprescribing algorithm is applied to mock patient cases. The videos were shared on YouTube and promoted via Twitter and other web-based tools. Evaluation methods included YouTube analytics and the validated Information Assessment Method (IAM) questionnaire.

KEY FINDINGS

The four videos have a combined total of 26 387 views over the approximately 50 months since publishing, with viewers watching 34-40% of the videos' runtimes on average. The PPI and AHG deprescribing videos were viewed 4318 times in 97 countries during the first year. IAM respondents perceived the PPI, AHG and AP video content to be relevant, useful to learning and applicable to patient care.

CONCLUSIONS

Using whiteboard videos on YouTube to explain deprescribing guidelines was a successful approach to knowledge mobilization. The evaluation approach is innovative as it combines typical success factors for online learning videos (e.g. views, estimated minutes watched) with responses to a validated information assessment tool.

Factors associated with parents' experiences using a knowledge translation tool for vaccination pain management: a qualitative study

Background

Vaccination is a common painful procedure for children. Parents’ concern regarding vaccination pain is a significant driver of vaccine hesitancy. Despite the wealth of evidence-based practices available for managing vaccination pain, parents lack knowledge of, and access to, these strategies. Knowledge translation (KT) tools can communicate evidence-based information to parents, however little is known about what factors influence parents’ use of these tools. A two-page, electronic KT tool on psychological, physical, and pharmacological vaccination pain management strategies for children, was shared with parents as part of a larger mixed methods study, using explanatory sequential design, exploring factors related to uptake of this KT tool. The aim of this qualitative study was to understand what influenced parents’ perceptions of the relevance of the KT tool, as well as their decision as to whether to use the tool.

Methods

A qualitative descriptive design was used. A total of 20 parents of children aged 0–17 years (n = 19 mothers) reviewed the KT tool ahead of their child’s upcoming vaccination and participated in a semi-structured interview at follow-up. Interviews were recorded, transcribed verbatim, and analyzed with reflexive thematic analysis using an inductive approach.

Results

The analysis generated three interrelated themes which described factors related to parents’ use of the KT tool: (1) Relevance to parents’ needs and circumstances surrounding their child’s vaccination; (2) Alignment with parents’ personal values around, and experiences with, vaccination pain management (e.g., the importance of managing pain); and (3) Support from the clinical environment for implementing evidence-based strategies (e.g., physical clinical environment and quality of interactions with the health care provider).

Conclusions

Several factors were identified as central to parents’ use of the KT tool, including the information itself and the clinical environment. When the tool was perceived as relevant, aligned with parents’ values, and was supported by health care providers, parents were more inclined to use the KT tool to manage their children’s vaccination pain. Future research could explore other factors related to promoting engagement and uptake when creating parent-directed KT tools for a range of health-related contexts.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06326-2.

Understanding parents' use of a knowledge translation tool to manage children's vaccination pain

Supplemental Digital Content is Available in the Text.

The relevance of KT tools, and parents' confidence in using them, was related to uptake of vaccination pain management strategies for children.

Introduction:

Although several evidence-based strategies for managing children's vaccination pain exist, many parents report being unaware of them. Knowledge translation (KT) tools present evidence-based information in plain language.

Objectives:

This two-phase study assessed parents/caregivers' uptake of evidence-based pain management strategies via a KT tool and considered factors related to parents' planned, actual, and future use of these strategies.

Methods:

In phase 1, parents were exposed to an online KT tool on physical, psychological, and pharmacological vaccination pain management strategies, and their impressions were assessed by questionnaires including the Information Assessment Method for Parents. In phase 2, after vaccination, parents completed a follow-up survey on their uptake and experiences using the information.

Results:

A total of 312 participants reported their plans for KT tool use. Parents who found the KT tool relevant were more likely to plan to use it at their child's upcoming vaccination. A total of 128 parents (93% mothers) completed both surveys. Nearly all parents who planned to use the information did so during their child's subsequent vaccination (90%). When the KT tool was relevant to their needs, parents were more likely to use the information during their child's vaccination. Parents who felt confident using the tool were significantly more likely to report plans for future tool use.

Discussion:

This study demonstrates the effectiveness of a KT tool that was relevant to parents' needs and built confidence to increase parent-reported uptake of evidence-based strategies. Proper pain management could positively impact parents' uptake of vaccinations for children.

Outcomes of Equity-Oriented, Web-Based Parenting Information in Mothers of Low Socioeconomic Status Compared to Other Mothers: Participatory Mixed Methods Study

BACKGROUND

Typically, web-based consumer health information is considered more beneficial for people with high levels of education and income. No evidence shows that equity-oriented information offers equal benefits to all. This is important for parents of low socioeconomic status (SES; low levels of education and income and usually a low level of literacy).

OBJECTIVE

This study is based on a conceptual framework of information outcomes. In light of this, it aims to compare the perception of the outcomes of web-based parenting information in low-SES mothers with that of other mothers and explore the perspective of low-SES mothers on contextual factors and information needs and behavior associated with these outcomes.

METHODS

A participatory mixed methods research was conducted in partnership with academic researchers and Naître et grandir (N&G) editors. N&G is a magazine, website, and newsletter that offers trustworthy parenting information on child development, education, health, and well-being in a format that is easy to read, listen, or watch. Quantitative component (QUAN) included a 3-year longitudinal observational web survey; participants were mothers of 0- to 8-year-old children. For each N&G newsletter, the participants' perception regarding the outcomes of specific N&G webpages was gathered using a content-validated Information Assessment Method (IAM) questionnaire. Differences between participants of low SES versus others were estimated. Qualitative component (QUAL) was interpretive; participants were low-SES mothers. The thematic analysis of interview transcripts identified participants' characteristics and different sources of information depending on information needs. Findings from the two components were integrated (QUAN+QUAL integration) through the conceptual framework and assimilated into the description of an ideal-typical mother of low SES (Kate). A narrative describes Kate's perception of the outcomes of web-based parenting information and her perspective on contextual factors, information needs, and behavior associated with these outcomes.

RESULTS

QUAN-a total of 1889 participants completed 2447 IAM responses (50 from mothers of low SES and 2397 from other mothers). N&G information was more likely to help low-SES participants to better understand something, decrease worries, and increase self-confidence in decision making. QUAL-the 40 participants (21 N&G users and 19 nonusers) used 4 information sources in an iterative manner: websites, forums, relatives, and professionals. The integration of QUAN and QUAL findings provides a short narrative, Kate, which summarizes the main findings.

CONCLUSIONS

This is the first study comparing perceptions of information outcomes in low-SES mothers with those of other mothers. Findings suggest that equity-oriented, web-based parenting information can offer equal benefits to all, including low-SES mothers. The short narrative, Kate, can be quickly read by decision policy makers, for example, web editors, and might encourage them to reach the underserved and provide and assess trustworthy web-based consumer health information in a format that is easy to read, listen, or watch.

Health outcomes of online consumer health information: A systematic mixed studies review with framework synthesis

The Internet has become the first source of consumer health information. Most theoretical and empirical studies are centered on information needs and seeking, rather than on information outcomes. This review's purpose is to explore and explain health outcomes of Online Consumer Health Information (OCHI) in primary care. A participatory systematic mixed studies review with a framework synthesis was undertaken. Starting from an initial conceptual framework, our specific objectives were to (a) identify types of OCHI outcomes in primary care, (b) identify factors associated with these outcomes, and (c) integrate these factors and outcomes into a comprehensive revised framework combining an information theory and a psychosocial theory of behavior. The results of 65 included studies were synthesized using a qualitative thematic data analysis. The themes derived from the literature underwent a harmonization process that produced a comprehensive typology of OCHI outcomes. The revised conceptual framework specifies four individual and one organizational level of OCHI outcomes, while including factors such as consumers' information needs and four interdependent contextual factors. It contributes to theoretical knowledge about OCHI health outcomes, and informs future research, information assessment methods, and tools to help consumers find and use health information.

A systematic mixed studies review on Organizational Participatory Research: towards operational guidance

BACKGROUND

Organizational Participatory Research (OPR) seeks organizational learning and/or practice improvement. Previous systematic literature reviews described some OPR processes and outcomes, but the link between these processes and outcomes is unknown. We sought to identify and sequence the key processes of OPR taking place with and within healthcare organizations and the main outcomes to which they contribute, and to define ideal-types of OPR.

METHODS

This article reports a participatory systematic mixed studies review with qualitative synthesis A specialized health librarian searched MEDLINE, CINAHL, Embase Classic + Embase, PsycINFO, the Cochrane Library, Social Work Abstracts and Business Source Complete, together with grey literature data bases were searched from inception to November 29, 2012. This search was updated using forward citation tracking up to June 2014. Reporting quality was appraised and unclear articles were excluded. Included studies clearly reported OPR where the main research related decisions were co-constructed among the academic and healthcare organization partners. Included studies were distilled into summaries of their OPR processes and outcomes, which were subsequently analysed using deductive and inductive thematic analysis. All summaries were analysed; that is, data analysis continued beyond saturation.

RESULTS

Eighty-three studies were included from the 8873 records retrieved. Eight key OPR processes were identified. Four follow the phases of research: 1) form a work group and hold meetings, 2) collectively determine research objectives, 3) collectively analyse data, and 4) collectively interpret results and decide how to use them. Four are present throughout OPR: 1) communication, 2) relationships; 3) commitment; 4) collective reflection. These processes contribute to extra benefits at the individual and organizational levels. Four ideal-types of OPR were defined. Basic OPR consists of OPR processes leading to achieving the study objectives. This ideal-type and may be combined with any of the following three ideal-types: OPR resulting in random additional benefits for the individuals or organization involved, OPR spreading to other sectors of the organization and beyond, or OPR leading to subsequent initiatives. These results are illustrated with a novel conceptual model.

CONCLUSION

The model provides operational guidance to help OPR stakeholders collaboratively address organizational issues and achieve desired outcomes and more.

REVIEW REGISTRATION

As per PROSPERO inclusion criteria, this review is not registered.

Assessing and Improving the Use of Online Information About Child Development, Education, Health, and Well-Being in Low-Education, Low-Income Parents: Protocol for a Mixed-Methods Multiphase Study

Background

This study is born from a partnership between Web editors of Naître et grandir (N&G) and AboutKidsHealth (AKH) and researchers who developed and validated the Information Assessment Method (IAM). N&G and AKH are popular Canadian websites with high-quality comprehensive information about child development, education, health, and well-being. IAM allows parents to assess online information and provide feedback to Web editors. High-quality online consumer health information improves knowledge, self-efficacy, and health. However, low-socioeconomic status (SES) parents underuse N&G and IAM, despite these parents being more likely to report decreased worries and increased confidence as outcomes from N&G information.

Objective

The study is aimed to improve low-SES parents’ use of online child information and interaction with Web editors and explore subsequent health outcomes for parents and children.

Methods

Multiphase mixed-methods design. Our general approach is centered on organizational participatory research. In phase 1, we will conduct a qualitative interpretive study to identify barriers and facilitators to using N&G information and to interacting with N&G editors via IAM; interview more than 10 low-SES parents about their experience with N&G and IAM and more than 10 nonusers of N&G and IAM; and use thematic analysis to identify main barriers and facilitators. In phase 2, we will integrate parents’ views (phase 1 findings) in N&G and IAM and implement a new version: IAM+N&G+. In phase 3, we will conduct a quantitative prospective longitudinal study (pre-/postimplementation monitoring of knowledge use and outcomes). We will compare the use of original (IAM and N&G) and new (IAM+ and N&G+) versions using Google Analytics variables, IAM variables, a material and social deprivation index, and demographics. We anticipate increased use post implementation (linear mixed modeling). In phase 4, we will conduct a qualitative descriptive study on outcomes of information use. We will interview more than 30 low-SES parents who receive and rate the N&G+ newsletter using IAM+ and analyze data in the form of life histories to describe how parents and children experience perceived outcomes.

Results

The project was funded in 2017 by the Canadian Institutes of Health Research and received an ethics approval by the McGill University’s institutional review board. Data collection for phase 1 was completed in 2018. Phases 2 to 4 will be conducted until 2020. Findings from this study will also be used to develop a free toolkit, useful to all Web editors, with recommendations for improving health information for low-SES persons and interactions with them using IAM.

Conclusions

The results of this study will provide a deep understanding of how low-SES parents use online child information and interact with Web editors. Following the implementation of IAM+N&G+, results will also elucidate subsequent health outcomes for low-SES parents and children after interaction with Web editors has been optimized.

International Registered Report Identifier (IRRID)

PRR1-10.2196/9996

Decisional needs assessment of patients with complex care needs in primary care: a participatory systematic mixed studies review protocol

INTRODUCTION

Patients with complex care needs (PCCNs) often suffer from combinations of multiple chronic conditions, mental health problems, drug interactions and social vulnerability, which can lead to healthcare services overuse, underuse or misuse. Typically, PCCNs face interactional issues and unmet decisional needs regarding possible options in a cascade of interrelated decisions involving different stakeholders (themselves, their families, their caregivers, their healthcare practitioners). Gaps in knowledge, values clarification and social support in situations where options need to be deliberated hamper effective decision support interventions. This review aims to (1) assess decisional needs of PCCNs from the perspective of stakeholders, (2) build a taxonomy of these decisional needs and (3) prioritise decisional needs with knowledge users (clinicians, patients and managers).

METHODS AND ANALYSIS

This review will be based on the interprofessional shared decision making (IP-SDM) model and the Ottawa Decision Support Framework. Applying a participatory research approach, we will identify potentially relevant studies through a comprehensive literature search; select relevant ones using eligibility criteria inspired from our previous scoping review on PCCNs; appraise quality using the Mixed Methods Appraisal Tool; conduct a three-step synthesis (sequential exploratory mixed methods design) to build taxonomy of key decisional needs; and integrate these results with those of a parallel PCCNs' qualitative decisional need assessment (semistructured interviews and focus group with stakeholders).

ETHICS AND DISSEMINATION

This systematic review, together with the qualitative study (approved by the Centre Intégré Universitaire de Santé et Service Sociaux du Saguenay-Lac-Saint-Jean ethical committee), will produce a working taxonomy of key decisional needs (ontological contribution), to inform the subsequent user-centred design of a support tool for addressing PCCNs' decisional needs (practical contribution). We will adapt the IP-SDM model, normally dealing with a single decision, for PCCNs who experience cascade of decisions involving different stakeholders (theoretical contribution). Knowledge users will facilitate dissemination of the results in the Canadian primary care network.

PROSPERO REGISTRATION NUMBER

CRD42015020558.

Organizational participatory research: a systematic mixed studies review exposing its extra benefits and the key factors associated with them

BACKGROUND

In health, organizational participatory research (OPR) refers to health organization members participating in research decisions, with university researchers, throughout a study. This non-academic partner contribution to the research may take the form of consultation or co-construction. A drawback of OPR is that it requires more time from all those involved, compared to non-participatory research approaches; thus, understanding the added value of OPR, if any, is important. Thus, we sought to assess whether the OPR approach leads to benefits beyond what could be achieved through traditional research.

METHODS

We identified, selected, and appraised OPR health literature, and at each stage, two team members independently reviewed and coded the literature. We used quantitative content analysis to transform textual data into reliable numerical codes and conducted a logistic regression to test the hypothesis that a co-construction type OPR study yields extra benefits with a greater likelihood than consultation-type OPR studies.

RESULTS

From 8873 abstracts and 992 full text papers, we distilled a sample of 107 OPR studies. We found no difference between the type of organization members' participation and the likelihood of exhibiting an extra benefit. However, the likelihood of an OPR study exhibiting at least one extra benefit is quadrupled when the impetus for the study comes from the organization, rather than the university researcher(s), or the organization and the university researcher(s) together (OR = 4.11, CI = 1.12-14.01). We also defined five types of extra benefits.

CONCLUSIONS

This review describes the types of extra benefits OPR can yield and suggests these benefits may occur if the organization initiates the OPR. Further, this review exposes a need for OPR authors to more clearly describe the type of non-academic partner participation in key research decisions throughout the study. Detailed descriptions will benefit others conducting OPR and allow for a re-examination of the relationship between participation and extra benefits in future reviews.

Assessing and Improving Processes and Outcomes of the McGill Primary Health Care Research Network (summer bursary)

Background: The McGill Primary Health Care Research Network (the Network) is a Practice-Based Research Network (PBRN) that promotes the collaboration between researchers and clinicians in research. The Network follows an approach called Organizational Participatory Research (OPR).Purpose: To discover the processes and outcomes associated with the Network, to learn about researcher and clinician collaboration within the Network and to propose recommendations and a revised questionnaire.Methods: A thematic qualitative data analysis was conducted. The data that was analyzed consisted of the diaries of two diaries of two Network coordinators, email correspondence between the core group members and the coordinators, and the minutes of 12 core group meetings. The data were interpreted according to the Capacity Building Framework. Then, codes were organized according to 10 framework-based meta-themes (5 domain-related processes, and 5 domain-related outcomes) and grouped in 24 key-themes (key processes and outcomes).Results: A leadership process was researchers promoting communication within the Network which resulted in clinicians becoming project leaders. An organizational development outcome was members' research projects being completed. Partnership processes involved researchers and clinicians identifying their respective challenges to partnerships. The main outcome was collaboration. Resource allocation processes included time and funding management, with accommodation to time constraints as an outcome. Workforce development processes included researchers educating clinicians, which resulted in networking core group members and positive learning experiences.  Conclusions: The results suggested practice and policy recommendations. Based on the results, an improved mailing policy, a wiki/blog, a more humble approach for researchers and a questionnaire were proposed.

Performance of a mixed filter to identify relevant studies for mixed studies reviews

OBJECTIVE

Mixed studies reviews include empirical studies with diverse designs. Given that identifying relevant studies for such reviews is time consuming, a mixed filter was developed.

METHODS

The filter was used for six journals from three disciplines. For each journal, database records were coded "empirical" (relevant) when they mentioned a research question or objective, data collection, analysis, and results. We measured precision (proportion of retrieved documents being relevant), sensitivity (proportion of relevant documents retrieved), and specificity (proportion of nonrelevant documents not retrieved).

RESULTS

Records were coded with and without the filter, and descriptive statistics were performed, suggesting the mixed filter has high sensitivity.

Regulation profiles of e-cigarettes in the United States: a critical review with qualitative synthesis

BACKGROUND

Electronic cigarettes (e-cigarettes) have been steadily increasing in popularity since their introduction to US markets in 2007. Debates surrounding the proper regulatory mechanisms needed to mitigate potential harms associated with their use have focused on youth access, their potential for nicotine addiction, and the renormalization of a smoking culture. The objective of this study was to describe the enacted and planned regulations addressing this novel public health concern in the US.

METHODS

We searched LexisNexis Academic under Federal Regulations and Registers, as well as State Administrative Codes and Registers. This same database was also used to find information about planned regulations in secondary sources. The search was restricted to US documents produced between January 1(st), 2004, and July 14(th), 2014.

RESULTS

We found two planned regulations at the federal level, and 74 enacted and planned regulations in 44 states. We identified six state-based regulation types, including i) access, ii) usage, iii) marketing and advertisement, iv) packaging, v) taxation, and vi) licensure. These were further classified into 10 restriction subtypes: sales, sale to minors, use in indoor public places, use in limited venues, use by minors, licensure, marketing and advertising, packaging, and taxation. Most enacted restrictions aimed primarily to limit youth access, while few regulations enforced comprehensive restrictions on product use and availability.

CONCLUSIONS

Current regulations targeting e-cigarettes in the US are varied in nature and scope. There is greater consensus surrounding youth protection (access by minors and/or use by minors, and/or use in limited venues), with little consensus on multi-level regulations, including comprehensive use bans in public spaces.

Development and content validation of the information assessment method for patients and consumers

BACKGROUND

Online consumer health information addresses health problems, self-care, disease prevention, and health care services and is intended for the general public. Using this information, people can improve their knowledge, participation in health decision-making, and health. However, there are no comprehensive instruments to evaluate the value of health information from a consumer perspective.

OBJECTIVE

We collaborated with information providers to develop and validate the Information Assessment Method for all (IAM4all) that can be used to collect feedback from information consumers (including patients), and to enable a two-way knowledge translation between information providers and consumers.

METHODS

Content validation steps were followed to develop the IAM4all questionnaire. The first version was based on a theoretical framework from information science, a critical literature review and prior work. Then, 16 laypersons were interviewed on their experience with online health information and specifically their impression of the IAM4all questionnaire. Based on the summaries and interpretations of interviews, questionnaire items were revised, added, and excluded, thus creating the second version of the questionnaire. Subsequently, a panel of 12 information specialists and 8 health researchers participated in an online survey to rate each questionnaire item for relevance, clarity, representativeness, and specificity. The result of this expert panel contributed to the third, current, version of the questionnaire.

RESULTS

The current version of the IAM4all questionnaire is structured by four levels of outcomes of information seeking/receiving: situational relevance, cognitive impact, information use, and health benefits. Following the interviews and the expert panel survey, 9 questionnaire items were confirmed as relevant, clear, representative, and specific. To improve readability and accessibility for users with a lower level of literacy, 19 items were reworded and all inconsistencies in using a passive or active voice have been solved. One item was removed due to redundancy. The current version of the IAM4all questionnaire contains 28 items.

CONCLUSIONS

We developed and content validated the IAM4all in partnership with information providers, information specialists, researchers and representatives of information consumers. This questionnaire can be integrated within electronic knowledge resources to stimulate users' reflection (eg, their intention to use information). We claim that any organization (eg, publishers, community organizations, or patient associations), can evaluate and improve their online consumer health information from a consumers' perspective using this method.

Number needed to benefit from information (NNBI): proposal from a mixed methods research study with practicing family physicians

PURPOSE

We wanted to describe family physicians' use of information from an electronic knowledge resource for answering clinical questions, and their perception of subsequent patient health outcomes; and to estimate the number needed to benefit from information (NNBI), defined as the number of patients for whom clinical information was retrieved for 1 to benefit.

METHODS

We undertook a mixed methods research study, combining quantitative longitudinal and qualitative research studies. Participants were 41 family physicians from primary care clinics across Canada. Physicians were given access to 1 electronic knowledge resource on handheld computer in 2008-2009. For the outcome assessment, participants rated their searches using a validated method. Rated searches were examined during interviews guided by log reports that included ratings. Cases were defined as clearly described searches where clinical information was used for a specific patient. For each case, interviewees described information-related patient health outcomes. For the mixed methods data analysis, quantitative and qualitative data were merged into clinical vignettes (each vignette describing a case). We then estimated the NNBI.

RESULTS

In 715 of 1,193 searches for information conducted during an average of 86 days, the search objective was directly linked to a patient. Of those searches, 188 were considered to be cases. In 53 cases, participants associated the use of information with at least 1 patient health benefit. This finding suggested an NNBI of 14 (715/53).

CONCLUSION

The NNBI may be used in further experimental research to compare electronic knowledge resources. A low NNBI can encourage clinicians to search for information more frequently. If all searches had benefits, the NNBI would be 1. In addition to patient benefits, learning and knowledge reinforcement outcomes are frequently reported.

Feasibility of a knowledge translation CME program: Courriels Cochrane

INTRODUCTION

Systematic literature reviews provide best evidence, but are underused by clinicians. Thus, integrating Cochrane reviews into continuing medical education (CME) is challenging. We designed a pilot CME program where summaries of Cochrane reviews (Courriels Cochrane) were disseminated by e-mail. Program participants automatically received CME credit for each Courriel Cochrane they rated. The feasibility of this program is reported (delivery, participation, and participant evaluation).

METHOD

We recruited French-speaking physicians through the Canadian Medical Association. Program delivery and participation were documented. Participants rated the informational value of Courriels Cochrane using the Information Assessment Method (IAM), which documented their reflective learning (relevance, cognitive impact, use for a patient, expected health benefits). IAM responses were aggregated and analyzed.

RESULTS

The program was delivered as planned. Thirty Courriels Cochrane were delivered to 985 physicians, and 127 (12.9%) completed at least one IAM questionnaire. Out of 1109 Courriels Cochrane ratings, 973 (87.7%) conta-ined 1 or more types of positive cognitive impact, while 835 (75.3%) were clinically relevant. Participants reported the use of information for a patient and expected health benefits in 595 (53.7%) and 569 (51.3%) ratings, respectively.

DISCUSSION

Program delivery required partnering with 5 organizations. Participants valued Courriels Cochrane. IAM ratings documented their reflective learning. The aggregation of IAM ratings documented 3 levels of CME outcomes: participation, learning, and performance. This evaluation study demonstrates the feasibility of the Courriels Cochrane as an approach to further disseminate Cochrane systematic literature reviews to clinicians and document self-reported knowledge translation associated with Cochrane reviews.

Do family physicians retrieve synopses of clinical research previously read as email alerts?

Background

A synopsis of new clinical research highlights important aspects of one study in a brief structured format. When delivered as email alerts, synopses enable clinicians to become aware of new developments relevant for practice. Once read, a synopsis can become a known item of clinical information. In time-pressured situations, remembering a known item may facilitate information retrieval by the clinician. However, exactly how synopses first delivered as email alerts influence retrieval at some later time is not known.

Objectives

We examined searches for clinical information in which a synopsis previously read as an email alert was retrieved (defined as a dyad). Our study objectives were to (1) examine whether family physicians retrieved synopses they previously read as email alerts and then to (2) explore whether family physicians purposefully retrieved these synopses.

Methods

We conducted a mixed-methods study in which a qualitative multiple case study explored the retrieval of email alerts within a prospective longitudinal cohort of practicing family physicians. Reading of research-based synopses was tracked in two contexts: (1) push, meaning to read on email and (2) pull, meaning to read after retrieval from one electronic knowledge resource. Dyads, defined as synopses first read as email alerts and subsequently retrieved in a search of a knowledge resource, were prospectively identified. Participants were interviewed about all of their dyads. Outcomes were the total number of dyads and their type.

Results

Over a period of 341 days, 194 unique synopses delivered to 41 participants resulted in 4937 synopsis readings. In all, 1205 synopses were retrieved over an average of 320 days. Of the 1205 retrieved synopses, 21 (1.7%) were dyads made by 17 family physicians. Of the 1205 retrieved synopses, 6 (0.5%) were known item type dyads. However, dyads also occurred serendipitously.

Conclusion

In the single knowledge resource we studied, email alerts containing research-based synopses were rarely retrieved. Our findings help us to better understand the effect of push on pull and to improve the integration of research-based information within electronic resources for clinicians.

A participatory approach to understanding and measuring patient satisfaction in a primary care teaching setting

BACKGROUND

Patient satisfaction is a complex, multidimensional concept that is difficult to measure. However, there is agreement that understanding the expectations of a patient community or "what is important to them" is an essential consideration. We chose a participatory approach to address patient satisfaction in the context of a primary care teaching clinic.

OBJECTIVES

The objectives of this project were to use a participatory research team of patients staff and researchers to (1) adapt an existing patient satisfaction questionnaire (PSQ) to the specific cultural and organizational elements ofa primary care teaching clinic, (2) administer the revised questionnaire and use the findings as a tool for organizational improvement, with the ultimate goal of increasing patient satisfaction, and (3) ensure that all decision making involved patients and staff to empower them in the process of organizational change.

METHODS

We used an iterative, mixed methods approach to conduct this project. An interdisciplinary committee composed of members of the patient community, clinical and administrative staff, and researchers worked together as the primary decision making body.

RESULTS

We modified a preexisting questionnaire to address the unique care delivery model of the clinic, issues of cultural sensitivity, and the need for simplified language and response format. Patient dissatisfaction was found to center on continuity and access to care.

CONCLUSIONS

The participatory approach was critical to our success in understanding and measuring patient satisfaction from the patients' perspective. The involvement of the interdisciplinary committee and the high level of joint decision making in this project represents a unique contribution to assessing primary care patient satisfaction.

Evaluation of email alerts in practice: Part 1. Review of the literature on clinical emailing channels

RATIONALE

Methods to systematically assess electronic knowledge resources by health professionals may enhance evaluation of these resources, knowledge exchange between information users and providers, and continuing professional development. We developed the Information Assessment Method (IAM) to document health professional perspectives on the relevance, cognitive impact, potential use and expected health outcomes of information delivered by (push) or retrieved from (pull) electronic knowledge resources. However, little is known about push communication in health sciences, and what we propose to call clinical emailing channels (CECs). CECs can be understood as a communication infrastructure that channels clinically relevant research knowledge, email alerts, from information providers to the inboxes of individual practitioners.

AIMS

In two companion papers, our objectives are to (part 1) explore CEC evaluation in routine practice, and (part 2) examine the content validity of the cognitive component of IAM.

METHODS

The present paper (part 1) critically reviews the literature in health sciences and four disciplines: communication, information studies, education and knowledge translation. Our review addresses the following questions. What are CECs? How are they assessed?

RESULTS

The review contributes to better define CECs, and proposes a 'push-pull-acquisition-cognition-application' evaluation framework, which is operationalized by IAM.

CONCLUSION

Compared with existing evaluation tools, our review suggests IAM is comprehensive, generic and systematic.

Many family physicians will not manually update PDA software: an observational study

BACKGROUND

In a prospective study to explore connections between clinical information delivery and information retrieval, 41 Canadian family physicians searched an electronic knowledge resource (EKR) as needed for practice. Research software, called the Information Assessment Method (IAM), prompted family physicians to report on the situational relevance, perceived cognitive impact and application of their retrieved information hits. Both the IAM and the EKR needed periodic updating to properly address our research questions.

OBJECTIVE

To determine the frequency of software updating when manual or semi-automatic approaches are used by family physicians.

METHODS

Each family physician received a handheld computer (PDA) that ran the Windows Mobile 6 operating system. For technical reasons, both the IAM and the EKR were accessed offline on PDA. To update the EKR and the IAM, family physicians were asked to synchronize their PDA to their PC. Updating the IAM was a manual process, whereas updating the EKR was semi-automatic.

RESULTS

We found: (1) about 25% of family physicians never or rarely updated PDA software on their own, (2) a large number of software updates were never installed and (3) the semi-automatic method was associated with a small increase in the proportion of installed software updates (58.9% versus 48.6% for the manual method).

CONCLUSIONS

When a wireless internet connection is not used to update PDA software, sociotechnical issues complicate mobile data collection and data transfer.