1
|
Sykes M, Rosenberg-Yunger ZRS, Quigley M, Gupta L, Thomas O, Robinson L, Caulfield K, Ivers N, Alderson S. Exploring the content and delivery of feedback facilitation co-interventions: a systematic review. Implement Sci 2024; 19:37. [PMID: 38807219 PMCID: PMC11134935 DOI: 10.1186/s13012-024-01365-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Accepted: 05/13/2024] [Indexed: 05/30/2024] Open
Abstract
BACKGROUND Policymakers and researchers recommend supporting the capabilities of feedback recipients to increase the quality of care. There are different ways to support capabilities. We aimed to describe the content and delivery of feedback facilitation interventions delivered alongside audit and feedback within randomised controlled trials. METHODS We included papers describing feedback facilitation identified by the latest Cochrane review of audit and feedback. The piloted extraction proforma was based upon a framework to describe intervention content, with additional prompts relating to the identification of influences, selection of improvement actions and consideration of priorities and implications. We describe the content and delivery graphically, statistically and narratively. RESULTS We reviewed 146 papers describing 104 feedback facilitation interventions. Across included studies, feedback facilitation contained 26 different implementation strategies. There was a median of three implementation strategies per intervention and evidence that the number of strategies per intervention is increasing. Theory was used in 35 trials, although the precise role of theory was poorly described. Ten studies provided a logic model and six of these described their mechanisms of action. Both the exploration of influences and the selection of improvement actions were described in 46 of the feedback facilitation interventions; we describe who undertook this tailoring work. Exploring dose, there was large variation in duration (15-1800 min), frequency (1 to 42 times) and number of recipients per site (1 to 135). There were important gaps in reporting, but some evidence that reporting is improving over time. CONCLUSIONS Heterogeneity in the design of feedback facilitation needs to be considered when assessing the intervention's effectiveness. We describe explicit feedback facilitation choices for future intervention developers based upon choices made to date. We found the Expert Recommendations for Implementing Change to be valuable when describing intervention components, with the potential for some minor clarifications in terms and for greater specificity by intervention providers. Reporting demonstrated extensive gaps which hinder both replication and learning. Feedback facilitation providers are recommended to close reporting gaps that hinder replication. Future work should seek to address the 'opportunity' for improvement activity, defined as factors that lie outside the individual that make care or improvement behaviour possible. REVIEW REGISTRATION The study protocol was published at: https://www.protocols.io/private/4DA5DE33B68E11ED9EF70A58A9FEAC02 .
Collapse
Affiliation(s)
| | | | | | | | | | - Lisa Robinson
- Newcastle Upon Tyne NHS Foundation Trust, Newcastle Upon Tyne, UK
| | - Karen Caulfield
- Newcastle Upon Tyne NHS Foundation Trust, Newcastle Upon Tyne, UK
| | | | | |
Collapse
|
2
|
Laird C, Benson H, Williams KA. Pharmacist interventions in osteoporosis management: a systematic review. Osteoporos Int 2023; 34:239-254. [PMID: 36239755 PMCID: PMC9852145 DOI: 10.1007/s00198-022-06561-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Accepted: 09/23/2022] [Indexed: 01/24/2023]
Abstract
UNLABELLED Internationally, there is an osteoporosis treatment gap, which pharmacists may assist in closing. This review identifies pharmacist interventions for improving osteoporosis management and evaluates their effectiveness. Pharmacist interventions are shown to improve osteoporosis management in terms of increasing investigation and treatment commencement and osteoporosis therapy adherence. INTRODUCTION This review identifies pharmacist interventions for improving osteoporosis management and evaluates their effectiveness. METHODS A literature search using PubMed, Embase, International Pharmaceutical Abstracts, and Cumulative Index to Nursing and Allied Health Literature was undertaken from database inception to June 2022. Randomised controlled trials were eligible, if they included adults diagnosed with or at risk of osteoporosis and assessed pharmacist interventions to improve osteoporosis management. Outcomes regarding investigation, treatment, adherence and patient knowledge were evaluated using qualitative analysis. The quality of included studies was assessed using the Critical Appraisal Skills Programme checklists and the Cochrane Collaboration tool to assess the risk of bias (Rob 2.0). RESULTS Sixteen articles (12 different studies) with a total of 16,307 participants, published between 2005 and 2018 were included. Pharmacist interventions were classified into two categories, those targeting investigation and treatment (n = 10) and those targeting adherence (n = 2). The impact of the intervention on patient knowledge was considered by studies targeting both investigation and treatment (n = 2) and adherence (n = 1). Pharmacist interventions demonstrated benefit for all outcomes; however, the extent to which conclusions can be drawn on their effectiveness is limited by the heterogeneity of interventions employed and methodological issues identified. Patient education and counselling were identified as a cornerstone of pharmacist interventions targeting both investigation and treatment and adherence, along with the importance of pharmacist and physician collaboration. CONCLUSION Pharmacist interventions show promise for improving osteoporosis management. The potential for pharmacists to contribute to closing the osteoporosis treatment gap through undertaking population screening has been identified.
Collapse
Affiliation(s)
- Catherine Laird
- Graduate School of Health, University of Technology Sydney, PO Box 123, Sydney, NSW, 2007, Australia.
| | - Helen Benson
- Graduate School of Health, University of Technology Sydney, PO Box 123, Sydney, NSW, 2007, Australia
| | - Kylie A Williams
- Graduate School of Health, University of Technology Sydney, PO Box 123, Sydney, NSW, 2007, Australia
| |
Collapse
|
3
|
Iwelunmor J, Tucker JD, Obiezu-Umeh C, Gbaja-Biamila T, Oladele D, Nwaozuru U, Musa AZ, Airhihenbuwa CO, Muessig K, Rosenberg N, BeLue R, Xian H, Conserve DF, Ong JJ, Zhang L, Curley J, Nkengasong S, Mason S, Tang W, Bayus B, Ogedegbe G, Ezechi O. The 4 Youth by Youth (4YBY) pragmatic trial to enhance HIV self-testing uptake and sustainability: Study protocol in Nigeria. Contemp Clin Trials 2022; 114:106628. [PMID: 34800699 PMCID: PMC9358609 DOI: 10.1016/j.cct.2021.106628] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Revised: 11/11/2021] [Accepted: 11/14/2021] [Indexed: 11/29/2022]
Abstract
BACKGROUND The World Health Organization recommends HIV self-testing (HIVST) as an additional approach to HIV testing and the Nigerian government is supportive of this policy recommendation. However, effectively increasing uptake and sustainability among Nigerian youth is unknown. The goal of this study is to conduct a full-powered type I hybrid effectiveness-implementation trial to test the effectiveness of youth-friendly implementation science strategies in increasing uptake and sustainability of HIVST led by and for Nigerian youth. METHODS Our 4 Youth by Youth (4YBY) strategy combines four core elements: 1) HIVST bundle consisting of HIVST kits and photo verification system; 2) a participatory learning community; 3) peer to peer support and technical assistance; and 4) on-site supervision and performance feedback to improve uptake and sustainability of HIVST and enhance linkage to youth-friendly health clinics for confirmatory HIV testing where needed, sexually transmitted infection (STI) testing (i.e. syphilis, gonorrhea, chlamydia, and hepatitis, STI treatment, and PrEP referral. Utilizing a stepped-wedge, cluster-randomized controlled trial, a national cohort of youth aged 14-24 recruited from 32 local government areas across 14 states and four geo-political zones in Nigeria will receive the 4YBY implementation strategy. In addition, an economic evaluation will explore the incremental cost per quality adjusted life year gained. DISCUSSION This study will add to the limited "how-to-do it literature" on implementation science strategies in a resource-limited setting targeting youth population traditionally underrepresented in implementation science literature. Study findings will also optimize uptake and sustainability of HIVST led by and for young people themselves. TRIAL REGISTRATION This study is registered in ClinicalTrials.govNCT04710784 (on January 15, 2021).
Collapse
Affiliation(s)
- Juliet Iwelunmor
- College for Public Health & Social Justice, Saint Louis University, Saint Louis, MO, USA.
| | - Joseph D Tucker
- Department of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA; Faculty of Infectious and Tropical Diseases, London School of Hygiene and Tropical Medicine, London, UK
| | - Chisom Obiezu-Umeh
- College for Public Health & Social Justice, Saint Louis University, Saint Louis, MO, USA
| | - Titilola Gbaja-Biamila
- College for Public Health & Social Justice, Saint Louis University, Saint Louis, MO, USA; Clinical Sciences Department, Nigerian Institute of Medical Research, Lagos, Nigeria
| | - David Oladele
- College for Public Health & Social Justice, Saint Louis University, Saint Louis, MO, USA; Clinical Sciences Department, Nigerian Institute of Medical Research, Lagos, Nigeria
| | - Ucheoma Nwaozuru
- Department of Implementation Science, Division of Public Health Sciences, Wake Forest School of Medicine, Winston-Salem, NC, USA
| | - Adesola Z Musa
- Clinical Sciences Department, Nigerian Institute of Medical Research, Lagos, Nigeria
| | - Collins O Airhihenbuwa
- Heath Policy and Behavioral Sciences, School of Public Health, Georgia State University, Atlanta, GA, USA
| | - Kathryn Muessig
- Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Nora Rosenberg
- Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Rhonda BeLue
- College for Public Health & Social Justice, Saint Louis University, Saint Louis, MO, USA
| | - Hong Xian
- College for Public Health & Social Justice, Saint Louis University, Saint Louis, MO, USA
| | - Donaldson F Conserve
- Department of Prevention and Community Health, Milken Institute School of Public Health, The George Washington University, Washington, DC, USA
| | - Jason J Ong
- Faculty of Infectious and Tropical Diseases, London School of Hygiene and Tropical Medicine, London, UK; Central Clinical School, Monash University, Melbourne, Australia; Melbourne Sexual Health Centre, Alfred Health, Melbourne, Australia
| | - Lei Zhang
- Melbourne Sexual Health Centre, Alfred Health, Melbourne, Australia
| | - Jamie Curley
- College for Public Health & Social Justice, Saint Louis University, Saint Louis, MO, USA
| | - Susan Nkengasong
- Clinical Research Department, London School of Hygiene and Tropical Medicine, London, UK
| | - Stacey Mason
- College for Public Health & Social Justice, Saint Louis University, Saint Louis, MO, USA
| | - Weiming Tang
- Department of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Barry Bayus
- Kenan-Flagler Business School, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Gbenga Ogedegbe
- Center for Healthful Behavior Change, Division of Health and Behavior, Department of Population Health, New York University School of Medicine, NY, New York, USA
| | - Oliver Ezechi
- College for Public Health & Social Justice, Saint Louis University, Saint Louis, MO, USA; Clinical Sciences Department, Nigerian Institute of Medical Research, Lagos, Nigeria
| |
Collapse
|
4
|
Walker P, Kifley A, Kurrle S, Cameron ID. Increasing the uptake of vitamin D supplement use in Australian residential aged care facilities: results from the vitamin D implementation (ViDAus) study. BMC Geriatr 2020; 20:383. [PMID: 33023492 PMCID: PMC7542101 DOI: 10.1186/s12877-020-01784-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2020] [Accepted: 09/21/2020] [Indexed: 01/18/2023] Open
Abstract
BACKGROUND Adequate (≥800 IU/day) vitamin D supplement use in Australian residential aged care facilities (RACFs) is variable and non-optimal. The vitamin D implementation (ViDAus) study aimed to employ a range of strategies to support the uptake of this best practice in participating facilities. The aim of this paper is to report on facility level prevalence outcomes and factors associated with vitamin D supplement use. METHODS This trial followed a stepped wedge cluster, non-randomised design with 41 individual facilities serving as clusters pragmatically allocated into two wedges that commenced the intervention six months apart. This multifaceted, interdisciplinary knowledge translation intervention was led by a project officer, who worked with nominated champions at participating facilities to provide education and undertake quality improvement (QI) planning. Local barriers and responsive strategies were identified to engage stakeholders and promote widespread uptake of vitamin D supplement use. RESULTS This study found no significant difference in the change of vitamin D supplement use between the intervention (17 facilities with approx. 1500 residents) and control group (24 facilities with approx. 1900 residents) at six months (difference in prevalence change between groups was 1.10, 95% CI - 3.8 to 6.0, p = 0.6). The average overall facility change in adequate (≥800 IU/day) vitamin D supplement use over 12 months was 3.86% (95% CI 0.6 to 7.2, p = 0.02), which achieved a facility level average prevalence of 59.6%. The variation in uptake at 12 months ranged from 25 to 88% of residents at each facility. In terms of the types of strategies employed for implementation, there were no statistical differences between facilities that achieved a clinically meaningful improvement (≥10%) or a desired prevalence of vitamin D supplement use (80% of residents) compared to those that did not. CONCLUSIONS This work confirms the complex nature of implementation of best practice in the RACF setting and indicates that more needs to be done to ensure best practice is translated into action. Whilst some strategies appeared to be associated with better outcomes, the statistical insignificance of these findings and the overall limited impact of the intervention suggests that the role of broader organisational and governmental support for implementation should be investigated further. TRIAL REGISTRATION Retrospectively registered (ANZCTR ID: ACTRN12616000782437 ).
Collapse
Affiliation(s)
- Pippy Walker
- Menzies Centre for Health Policy, University of Sydney, Charles Perkins Centre D17, Camperdown, NSW, 2006, Australia. .,John Walsh Centre for Rehabilitation Research, University of Sydney, Kolling Institute of Medical Research, Royal North Shore Hospital, St Leonards, NSW, 2065, Australia.
| | - Annette Kifley
- John Walsh Centre for Rehabilitation Research, University of Sydney, Kolling Institute of Medical Research, Royal North Shore Hospital, St Leonards, NSW, 2065, Australia
| | - Susan Kurrle
- NHMRC Cognitive Decline Partnership Centre, Hornsby Ku-ring-gai Health Service, Hornsby, NSW, 2077, Australia
| | - Ian D Cameron
- John Walsh Centre for Rehabilitation Research, University of Sydney, Kolling Institute of Medical Research, Royal North Shore Hospital, St Leonards, NSW, 2065, Australia
| |
Collapse
|
5
|
Papaioannou A, Ioannidis G, McArthur C, Hillier LM, Feldman S, Giangregorio L, Jaglal S, Jain R, Van der Horst ML, Adachi J. Preventing Fractures in Long-Term Care: Translating Recommendations to Clinical Practice. J Am Med Dir Assoc 2020; 22:36-42. [PMID: 32800745 DOI: 10.1016/j.jamda.2020.07.003] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2020] [Revised: 06/30/2020] [Accepted: 07/01/2020] [Indexed: 10/23/2022]
Abstract
The Ontario Osteoporosis Strategy for long-term care (LTC) aims to support fracture risk-reduction. LTC specific recommendations for fracture prevention were developed in 2015. This article describes the use of the Knowledge-to Action framework to guide the development and application of research evidence on fracture prevention in older adults. Knowledge translation activities highlighted fractures as a significant source of morbidity in LTC, significant gaps in fracture risk assessment and treatment, and barriers and facilitators to guideline implementation. Multifaceted knowledge translation strategies, targeting staff in LTC homes in Ontario, Canada to support fracture guideline implementation have included education, audit and feedback, team-based action planning, and engagement of LTC residents, their families, and health professionals. Provincial administrative databases were accessed to monitor fracture rates between 2005 and 2015. Our research has identified enablers and barriers to knowledge use such as limited knowledge of osteoporosis, fracture risk, and prevention. Province-wide over a 10-year period, hip fracture rates in LTC decreased from 2.3% to 1.9%, and any fracture rates decreased from 4% to 3.6%. This body of work suggests that multifaceted knowledge translation initiatives are feasible to implement in LTC and can improve the uptake of clinical recommendations for fracture prevention. A key aspect of our fracture prevention knowledge translation activities has been the full engagement of key stakeholders to assist in the co-development and design of knowledge translation products.
Collapse
Affiliation(s)
- Alexandra Papaioannou
- McMaster University, Hamilton, Ontario, Canada; GERAS Center for Aging Research, Hamilton, Ontario, Canada.
| | - George Ioannidis
- McMaster University, Hamilton, Ontario, Canada; GERAS Center for Aging Research, Hamilton, Ontario, Canada
| | - Caitlin McArthur
- McMaster University, Hamilton, Ontario, Canada; GERAS Center for Aging Research, Hamilton, Ontario, Canada
| | | | - Sid Feldman
- GERAS Center for Aging Research, Hamilton, Ontario, Canada; Baycrest Health Sciences, Toronto, Ontario, Canada; University of Toronto, Toronto, Ontario, Canada
| | - Lora Giangregorio
- GERAS Center for Aging Research, Hamilton, Ontario, Canada; University of Waterloo, Waterloo, Ontario, Canada; Schlegel-UW Research Institute for Aging, Waterloo, Ontario, Canada
| | - Susan Jaglal
- GERAS Center for Aging Research, Hamilton, Ontario, Canada; University of Toronto, Toronto, Ontario, Canada
| | - Ravi Jain
- Osteoporosis Canada, Toronto, Ontario, Canada
| | | | | |
Collapse
|
6
|
Fernandes LMM, Lansky S, Oliveira BJ, Friche AAL, Bozlak CT, Shaw BA. Changes in perceived knowledge about childbirth among pregnant women participating in the Senses of Birth intervention in Brazil: a cross-sectional study. BMC Pregnancy Childbirth 2020; 20:265. [PMID: 32370737 PMCID: PMC7201865 DOI: 10.1186/s12884-020-02874-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2019] [Accepted: 03/12/2020] [Indexed: 01/19/2023] Open
Abstract
BACKGROUND Senses of Birth (SoB) is a health education intervention in Brazil that aims to reduce unnecessary cesareans in the country by providing information on reproductive rights, benefits and risks of childbirth, and use of intrapartum evidence-based practices (EBP) which are recommended by the World Health Organization (WHO) to improve childbirth outcomes and satisfaction. This study evaluates the impact of the SoB on pregnant women's perceived knowledge about normal birth (NB), cesarean, and use of EBP. METHODS 1287 pregnant women answered a structured survey immediately after their visit to the intervention, between March 2015 and March 2016. To estimate the potential impact of the intervention on women's perceived knowledge, and possible associations between sociodemographic characteristics and perceived knowledge, statistical analyses were performed, including paired T-tests, ANOVA, and logistic and linear regressions. RESULTS The mean score (MS) of perceived knowledge after the intervention was higher than the MS before experiencing the intervention for all three knowledge domains: Normal Birth (MS Before = 3.71 x MS After = 4.49), Cesarean (MS Before = 3.54 x MS After = 4.26) and EBPs (MS Before = 3.14 x MS After = 4.14). The results suggest that perceived knowledge increased more for low-income women (B = 0.206; p < 0.001 for EBP), women without private health insurance (OR 2.47, 95% CI: 1.49-4.09 for NB), with private prenatal care (OR 2.42, 95% CI: 1.59-3.66 for NB), experiencing their first pregnancy (OR 1.92, 95% CI: 1.31-2.82 for EBP; OR 1.37, 95% CI: 1.03-1.84 for NB; OR 1.37, 95% CI: 1.03-1.84 for cesarean), and in their first or second trimester (OR 1.64, 95% CI: 1.13-2.39 for EBP; OR 1.48, 95% CI: 1.11-1.97 for NB; OR 1.85, 95% CI: 1.40-2.41 for cesarean). CONCLUSION The study showed that participation in the SoB was associated with an increase in perceived knowledge among Brazilian pregnant women. The intervention gains relevance considering the lack of evidence of the impact of non-clinical interventions to reduce unnecessary cesareans in middle and low-income countries.
Collapse
Affiliation(s)
- Luísa M M Fernandes
- Department of Health Policy, Management, and Behavior, School of Public Health, University at Albany, State University of New York, One University Place, Rensselaer, NY, 12144, USA.
| | - Sônia Lansky
- Department of Health, City Hall, Belo Horizonte, Minas Gerais, Brazil
| | - Bernardo J Oliveira
- School of Education, Universidade Federal de Minas Gerais, Belo Horizonte, Brazil
| | - Amélia A L Friche
- School of Medicine, Universidade Federal de Minas Gerais, Belo Horizonte, Brazil
| | - Christine T Bozlak
- Department of Health Policy, Management, and Behavior, School of Public Health, University at Albany, State University of New York, One University Place, Rensselaer, NY, 12144, USA
| | - Benjamin A Shaw
- Department of Health Policy, Management, and Behavior, School of Public Health, University at Albany, State University of New York, One University Place, Rensselaer, NY, 12144, USA
| |
Collapse
|
7
|
Borhan S, Kennedy C, Ioannidis G, Papaioannou A, Adachi J, Thabane L. An empirical comparison of methods for analyzing over-dispersed zero-inflated count data from stratified cluster randomized trials. Contemp Clin Trials Commun 2020; 17:100539. [PMID: 32072073 PMCID: PMC7015989 DOI: 10.1016/j.conctc.2020.100539] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2019] [Revised: 01/11/2020] [Accepted: 01/26/2020] [Indexed: 11/30/2022] Open
Abstract
Background The assessment of methods for analyzing over-dispersed zero inflated count outcome has received very little or no attention in stratified cluster randomized trials. In this study, we performed sensitivity analyses to empirically compare eight methods for analyzing zero inflated over-dispersed count outcome from the Vitamin D and Osteoporosis Study (ViDOS) – originally designed to assess the feasibility of a knowledge translation intervention in long-term care home setting. Method Forty long-term care (LTC) homes were stratified and then randomized into knowledge translation (KT) intervention (19 homes) and control (21 homes) groups. The homes/clusters were stratified by home size (<250/> = 250) and profit status (profit/non-profit). The outcome of this study was number of falls measured at 6-month post-intervention. The following methods were used to assess the effect of KT intervention on number of falls: i) standard Poisson and negative binomial regression; ii) mixed-effects method with Poisson and negative binomial distribution; iii) generalized estimating equation (GEE) with Poisson and negative binomial; iv) zero inflated Poisson and negative binomial — with the latter used as a primary approach. All these methods were compared with or without adjusting for stratification. Results A total of 5,478 older people from 40 LTC homes were included in this study. The mean (=1) of the number of falls was smaller than the variance (=6). Also 72% and 46% of the number of falls were zero in the control and intervention groups, respectively. The direction of the estimated incidence rate ratios (IRRs) was similar for all methods. The zero inflated negative binomial yielded the lowest IRRs and narrowest 95% confidence intervals when adjusted for stratification compared to GEE and mixed-effect methods. Further, the widths of the 95% confidence intervals were narrower when the methods adjusted for stratification compared to the same method not adjusted for stratification. Conclusion The overall conclusion from the GEE, mixed-effect and zero inflated methods were similar. However, these methods differ in terms of effect estimate and widths of the confidence interval. Trial registration ClinicalTrials.gov: NCT01398527. Registered: 19 July 2011.
Collapse
Affiliation(s)
- Sayem Borhan
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON, Canada.,Biostatistics Unit, Research Institute of St Joseph's Healthcare, Hamilton, ON, Canada.,Department of Family Medicine, McMaster University, Hamilton, ON, Canada.,GERAS Centre, Hamilton Health Sciences, Hamilton, ON, Canada
| | | | | | - Alexandra Papaioannou
- GERAS Centre, Hamilton Health Sciences, Hamilton, ON, Canada.,Department of Medicine, McMaster University, Hamilton, ON, Canada
| | - Jonathan Adachi
- Department of Medicine, McMaster University, Hamilton, ON, Canada
| | - Lehana Thabane
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON, Canada.,Biostatistics Unit, Research Institute of St Joseph's Healthcare, Hamilton, ON, Canada.,Departments of Pediatrics and Anesthesia, McMaster University, Hamilton, ON, Canada
| |
Collapse
|
8
|
Francis-Coad J, Etherton-Beer C, Burton E, Naseri C, Hill AM. Effectiveness of complex falls prevention interventions in residential aged care settings: a systematic review. ACTA ACUST UNITED AC 2019; 16:973-1002. [PMID: 29634516 DOI: 10.11124/jbisrir-2017-003485] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2022]
Abstract
OBJECTIVE The objective of this review was to synthesize the best available evidence for the effectiveness of complex falls prevention interventions delivered at two or more of the following levels: resident, facility or organization, on fall rates in the residential aged care (RAC) population. INTRODUCTION Preventing falls in the high risk RAC population is a common global goal with acknowledged complexity. Previous meta-analyses have not specifically addressed complexity, described as falls prevention intervention delivery at multiple levels of a RAC organization, to determine its effect on fall outcomes. INCLUSION CRITERIA The current review considered studies that included participants who were aged 65 years and over residing in long-term care settings providing 24-hour supervision and/or care assistance.Studies that evaluated complex falls prevention interventions delivered by single discipline or multidisciplinary teams across at least two or all of the following levels: residents, RAC facility and RAC organization were eligible. Experimental study designs including randomized controlled trials, controlled clinical trials and quasi-experimental trials that reported on measures related to fall incidence were considered, namely, rate of falls (expressed as the number of falls per 1000 occupied bed days), the number of participants who became fallers (expressed as the number of participants who fell once or more) and the rate of injurious falls (expressed as the number of falls with injury per 1000 occupied bed days). METHODS A three-step search strategy was undertaken, commencing with an initial scoping search of MEDLINE and CINAHL databases prior to an extensive search of all relevant published literature, clinical trial registries and gray literature. Two independent reviewers assessed selected studies for methodological validity using the standardized critical appraisal instrument from the Joanna Briggs Institute System for the Unified Management, Assessment and Review of Information (JBI SUMARI). Data were extracted from the selected studies using the standardized data extraction tool from JBI SUMARI. Quantitative data were pooled in statistical meta-analysis for rate of falls, the number of participants who became fallers and the rate of injurious falls. Meta-analysis was conducted using a random-effect model with heterogeneity assessed using the standard Chi-squared and I index. Where statistical pooling was not possible, study findings were presented in narrative form. RESULTS Twelve studies were included in this review with seven being eligible for meta-analysis. Complex falls prevention interventions delivered at multiple levels in RAC populations did not show a significant effect in reducing fall rates (MD = -1.29; 95% CI [-3.01, 0.43]), or the proportion of residents who fell (OR = 0.76; 95% CI [0.42, 1.38]). However, a sensitivity analysis suggested complex falls prevention interventions delivered with additional resources at multiple levels had a significant positive effect in reducing fall rates (MD = -2.26; 95% CI [-3.72, -0.80]). CONCLUSIONS Complex falls prevention interventions delivered at multiple levels in the RAC population may reduce fall rates when additional staffing, expertise or resources are provided. Organizations may need to determine how resources can be allocated to best address falls prevention management. Future research should continue to investigate which combinations of multifactorial interventions are effective.
Collapse
Affiliation(s)
| | | | - Elissa Burton
- School of Physiotherapy and Exercise Science, Curtin University, Bentley, Australia
| | - Chiara Naseri
- School of Physiotherapy and Exercise Science, Curtin University, Bentley, Australia.,The Western Australian Group for Evidence Informed Healthcare Practice: a Joanna Briggs Institute Centre of Excellence
| | - Anne-Marie Hill
- School of Physiotherapy and Exercise Science, Curtin University, Bentley, Australia.,The Western Australian Group for Evidence Informed Healthcare Practice: a Joanna Briggs Institute Centre of Excellence
| |
Collapse
|
9
|
Walker P, Kifley A, Kurrle S, Cameron ID. Process outcomes of a multifaceted, interdisciplinary knowledge translation intervention in aged care: results from the vitamin D implementation (ViDAus) study. BMC Geriatr 2019; 19:177. [PMID: 31238882 PMCID: PMC6593532 DOI: 10.1186/s12877-019-1187-y] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2018] [Accepted: 06/11/2019] [Indexed: 01/01/2023] Open
Abstract
BACKGROUND Vitamin D supplement use is recommended best practice in residential aged care facilities (RACFs) for the prevention of falls, however has experienced delays in uptake. Following successful international efforts at implementing this evidence into practice, the ViDAus study sought to replicate this success for the Australian context. The aim of this paper is to report on the process outcomes of implementing this intervention. METHODS Forty-one RACFs were engaged in a multifaceted, interdisciplinary knowledge translation intervention. This focused on raising awareness to improve knowledge on vitamin D, and supporting facilities to identify barriers and implement locally devised strategies to improve the uptake of evidence based practice (EBP). RESULTS Staff members of participating facilities (n = 509 including nursing, care and allied health staff) were well engaged and accepting of the intervention, though engagement of servicing general practitioners (GPs) (n = 497) and pharmacists (n = 9) was poor. Facilities each identified between three and eight strategies focused on raising awareness, identifying residents to target for vitamin D and creating referral pathways depending upon their own locally identified barriers and capacity. There was variable success at implementing these over the 12-month intervention period. Whilst this study successfully raised awareness among staff, residents and their family members, barriers were identified that hindered engagement of GPs. CONCLUSIONS The intervention was overall feasible to implement and perceived as appropriate by GPs, pharmacists, facility staff, residents and family members. More facilitation, higher-level organisational support and strategies to improve RACF access to GPs however were identified as important improvements for the implementation of vitamin D supplement use. TRIAL REGISTRATION Retrospectively registered (ANZCTR ID: ACTRN12616000782437 ) on 15 June 2016.
Collapse
Affiliation(s)
- Pippy Walker
- Menzies Centre for Health Policy, University of Sydney, Charles Perkins Centre D17, Camperdown, NSW, 2006, Australia.,John Walsh Centre for Rehabilitation Research, University of Sydney, Kolling Institute of Medical Research, Royal North Shore Hospital, St Leonards, NSW, 2065, Australia
| | - Annette Kifley
- John Walsh Centre for Rehabilitation Research, University of Sydney, Kolling Institute of Medical Research, Royal North Shore Hospital, St Leonards, NSW, 2065, Australia
| | - Susan Kurrle
- NHMRC Cognitive Decline Partnership Centre, Hornsby Ku-ring-gai Health Service, Hornsby, NSW, 2077, Australia
| | - Ian D Cameron
- John Walsh Centre for Rehabilitation Research, University of Sydney, Kolling Institute of Medical Research, Royal North Shore Hospital, St Leonards, NSW, 2065, Australia.
| |
Collapse
|
10
|
Flodgren G, O'Brien MA, Parmelli E, Grimshaw JM. Local opinion leaders: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev 2019; 6:CD000125. [PMID: 31232458 PMCID: PMC6589938 DOI: 10.1002/14651858.cd000125.pub5] [Citation(s) in RCA: 88] [Impact Index Per Article: 17.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
BACKGROUND Clinical practice is not always evidence-based and, therefore, may not optimise patient outcomes. Local opinion leaders (OLs) are individuals perceived as credible and trustworthy, who disseminate and implement best evidence, for instance through informal one-to-one teaching or community outreach education visits. The use of OLs is a promising strategy to bridge evidence-practice gaps. This is an update of a Cochrane review published in 2011. OBJECTIVES To assess the effectiveness of local opinion leaders to improve healthcare professionals' compliance with evidence-based practice and patient outcomes. SEARCH METHODS We searched CENTRAL, MEDLINE, Embase, three other databases and two trials registers on 3 July 2018, together with searching reference lists of included studies and contacting experts in the field. SELECTION CRITERIA We considered randomised studies comparing the effects of local opinion leaders, either alone or with a single or more intervention(s) to disseminate evidence-based practice, with no intervention, a single intervention, or the same single or more intervention(s). Eligible studies were those reporting objective measures of professional performance, for example, the percentage of patients being prescribed a specific drug or health outcomes, or both. We included all studies independently of the method used to identify OLs. DATA COLLECTION AND ANALYSIS We used standard Cochrane procedures in this review. The main comparison was (i) between any intervention involving OLs (OLs alone, OLs with a single or more intervention(s)) versus any comparison intervention (no intervention, a single intervention, or the same single or more intervention(s)). We also made four secondary comparisons: ii) OLs alone versus no intervention, iii) OLs alone versus a single intervention, iv) OLs, with a single or more intervention(s) versus the same single or more intervention(s), and v) OLs with a single or more intervention(s) versus no intervention. MAIN RESULTS We included 24 studies, involving more than 337 hospitals, 350 primary care practices, 3005 healthcare professionals, and 29,167 patients (not all studies reported this information). A majority of studies were from North America, and all were conducted in high-income countries. Eighteen of these studies (21 comparisons, 71 compliance outcomes) contributed to the median adjusted risk difference (RD) for the main comparison. The median duration of follow-up was 12 months (range 2 to 30 months). The results suggested that the OL interventions probably improve healthcare professionals' compliance with evidence-based practice (10.8% absolute improvement in compliance, interquartile range (IQR): 3.5% to 14.6%; moderate-certainty evidence).Results for the secondary comparisons also suggested that OLs probably improve compliance with evidence-based practice (moderate-certainty evidence): i) OLs alone versus no intervention: RD (IQR): 9.15% (-0.3% to 15%); ii) OLs alone versus a single intervention: RD (range): 13.8% (12% to 15.5%); iii) OLs, with a single or more intervention(s) versus the same single or more intervention(s): RD (IQR): 7.1% (-1.4% to 19%); iv) OLs with a single or more intervention(s) versus no intervention: RD (IQR):10.25% (0.6% to 15.75%).It is uncertain if OLs alone, or in combination with other intervention(s), may lead to improved patient outcomes (3 studies; 5 dichotomous outcomes) since the certainty of evidence was very low. For two of the secondary comparisons, the IQR included the possibility of a small negative effect of the OL intervention. Possible explanations for the occasional negative effects are, for example, the possibility that the OLs may have prioritised some outcomes, at the expense of others, or that an unaccounted outcome difference at baseline, may have given a faulty impression of a negative effect of the intervention at follow-up. No study reported on costs or cost-effectiveness.We were unable to determine the comparative effectiveness of different approaches to identifying OLs, as most studies used the sociometric method. Nor could we determine which methods used by OLs to educate their peers were most effective, as the methods were poorly described in most studies. In addition, we could not determine whether OL teams were more effective than single OLs. AUTHORS' CONCLUSIONS Local opinion leaders alone, or in combination with other interventions, can be effective in promoting evidence-based practice, but the effectiveness varies both within and between studies.The effect on patient outcomes is uncertain. The costs and the cost-effectiveness of the intervention(s) is unknown. These results are based on heterogeneous studies differing in types of intervention, setting, and outcomes. In most studies, the role and actions of the OL were not clearly described, and we cannot, therefore, comment on strategies to enhance their effectiveness. It is also not clear whether the methods used to identify OLs are important for their effectiveness, or whether the effect differs if education is delivered by single OLs or by multidisciplinary OL teams. Further research may help us to understand how these factors affect the effectiveness of OLs.
Collapse
Affiliation(s)
- Gerd Flodgren
- Norwegian Institute of Public HealthDivision of Health ServicesMarcus Thranes gate 6OsloNorway0403
| | - Mary Ann O'Brien
- University of TorontoDepartment of Family and Community Medicine500 University AvenueFifth FloorTorontoONCanadaM5G 1V7
| | - Elena Parmelli
- Lazio Regional Health Service ‐ ASL Roma1Department of EpidemiologyRomeItaly
| | - Jeremy M Grimshaw
- Ottawa Hospital Research InstituteClinical Epidemiology ProgramThe Ottawa Hospital ‐ General Campus501 Smyth Road, Box 711OttawaONCanadaK1H 8L6
| | | |
Collapse
|
11
|
Cameron ID, Dyer SM, Panagoda CE, Murray GR, Hill KD, Cumming RG, Kerse N. Interventions for preventing falls in older people in care facilities and hospitals. Cochrane Database Syst Rev 2018; 9:CD005465. [PMID: 30191554 PMCID: PMC6148705 DOI: 10.1002/14651858.cd005465.pub4] [Citation(s) in RCA: 169] [Impact Index Per Article: 28.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/19/2023]
Abstract
BACKGROUND Falls in care facilities and hospitals are common events that cause considerable morbidity and mortality for older people. This is an update of a review first published in 2010 and updated in 2012. OBJECTIVES To assess the effects of interventions designed to reduce the incidence of falls in older people in care facilities and hospitals. SEARCH METHODS We searched the Cochrane Bone, Joint and Muscle Trauma Group Specialised Register (August 2017); Cochrane Central Register of Controlled Trials (2017, Issue 8); and MEDLINE, Embase, CINAHL and trial registers to August 2017. SELECTION CRITERIA Randomised controlled trials of interventions for preventing falls in older people in residential or nursing care facilities, or hospitals. DATA COLLECTION AND ANALYSIS One review author screened abstracts; two review authors screened full-text articles for inclusion. Two review authors independently performed study selection, 'Risk of bias' assessment and data extraction. We calculated rate ratios (RaR) with 95% confidence intervals (CIs) for rate of falls and risk ratios (RRs) and 95% CIs for outcomes such as risk of falling (number of people falling). We pooled results where appropriate. We used GRADE to assess the quality of evidence. MAIN RESULTS Thirty-five new trials (77,869 participants) were included in this update. Overall, we included 95 trials (138,164 participants), 71 (40,374 participants; mean age 84 years; 75% women) in care facilities and 24 (97,790 participants; mean age 78 years; 52% women) in hospitals. The majority of trials were at high risk of bias in one or more domains, mostly relating to lack of blinding. With few exceptions, the quality of evidence for individual interventions in either setting was generally rated as low or very low. Risk of fracture and adverse events were generally poorly reported and, where reported, the evidence was very low-quality, which means that we are uncertain of the estimates. Only the falls outcomes for the main comparisons are reported here.Care facilitiesSeventeen trials compared exercise with control (typically usual care alone). We are uncertain of the effect of exercise on rate of falls (RaR 0.93, 95% CI 0.72 to 1.20; 2002 participants, 10 studies; I² = 76%; very low-quality evidence). Exercise may make little or no difference to the risk of falling (RR 1.02, 95% CI 0.88 to 1.18; 2090 participants, 10 studies; I² = 23%; low-quality evidence).There is low-quality evidence that general medication review (tested in 12 trials) may make little or no difference to the rate of falls (RaR 0.93, 95% CI 0.64 to 1.35; 2409 participants, 6 studies; I² = 93%) or the risk of falling (RR 0.93, 95% CI 0.80 to 1.09; 5139 participants, 6 studies; I² = 48%).There is moderate-quality evidence that vitamin D supplementation (4512 participants, 4 studies) probably reduces the rate of falls (RaR 0.72, 95% CI 0.55 to 0.95; I² = 62%), but probably makes little or no difference to the risk of falling (RR 0.92, 95% CI 0.76 to 1.12; I² = 42%). The population included in these studies had low vitamin D levels.Multifactorial interventions were tested in 13 trials. We are uncertain of the effect of multifactorial interventions on the rate of falls (RaR 0.88, 95% CI 0.66 to 1.18; 3439 participants, 10 studies; I² = 84%; very low-quality evidence). They may make little or no difference to the risk of falling (RR 0.92, 95% CI 0.81 to 1.05; 3153 participants, 9 studies; I² = 42%; low-quality evidence).HospitalsThree trials tested the effect of additional physiotherapy (supervised exercises) in rehabilitation wards (subacute setting). The very low-quality evidence means we are uncertain of the effect of additional physiotherapy on the rate of falls (RaR 0.59, 95% CI 0.26 to 1.34; 215 participants, 2 studies; I² = 0%), or whether it reduces the risk of falling (RR 0.36, 95% CI 0.14 to 0.93; 83 participants, 2 studies; I² = 0%).We are uncertain of the effects of bed and chair sensor alarms in hospitals, tested in two trials (28,649 participants) on rate of falls (RaR 0.60, 95% CI 0.27 to 1.34; I² = 0%; very low-quality evidence) or risk of falling (RR 0.93, 95% CI 0.38 to 2.24; I² = 0%; very low-quality evidence).Multifactorial interventions in hospitals may reduce rate of falls in hospitals (RaR 0.80, 95% CI 0.64 to 1.01; 44,664 participants, 5 studies; I² = 52%). A subgroup analysis by setting suggests the reduction may be more likely in a subacute setting (RaR 0.67, 95% CI 0.54 to 0.83; 3747 participants, 2 studies; I² = 0%; low-quality evidence). We are uncertain of the effect of multifactorial interventions on the risk of falling (RR 0.82, 95% CI 0.62 to 1.09; 39,889 participants; 3 studies; I² = 0%; very low-quality evidence). AUTHORS' CONCLUSIONS In care facilities: we are uncertain of the effect of exercise on rate of falls and it may make little or no difference to the risk of falling. General medication review may make little or no difference to the rate of falls or risk of falling. Vitamin D supplementation probably reduces the rate of falls but not risk of falling. We are uncertain of the effect of multifactorial interventions on the rate of falls; they may make little or no difference to the risk of falling.In hospitals: we are uncertain of the effect of additional physiotherapy on the rate of falls or whether it reduces the risk of falling. We are uncertain of the effect of providing bed sensor alarms on the rate of falls or risk of falling. Multifactorial interventions may reduce rate of falls, although subgroup analysis suggests this may apply mostly to a subacute setting; we are uncertain of the effect of these interventions on risk of falling.
Collapse
Affiliation(s)
- Ian D Cameron
- The University of SydneyJohn Walsh Centre for Rehabilitation Research, Sydney Medical School, Northern Clinical SchoolReserve RoadSt LeonardsNSWAustralia2065
| | - Suzanne M Dyer
- DHATR Consulting120 Robsart StreetParksideSouth AustraliaAustralia5063
| | - Claire E Panagoda
- John Walsh Centre for Rehabilitation Research, Kolling Institute, Northern Sydney Local Health DistrictSt LeonardsNSWAustralia2065
| | - Geoffrey R Murray
- Illawarra Shoalhaven Local Health DistrictAged Care, Rehabilitation and Palliative CareWarrawongAustralia
| | - Keith D Hill
- Curtin UniversitySchool of Physiotherapy and Exercise Science, Faculty of Health SciencesGPO Box U1987PerthWestern AustraliaAustralia6845
| | - Robert G Cumming
- Sydney Medical School, University of SydneySchool of Public HealthRoom 306, Edward Ford Building (A27)Fisher RoadSydneyNSWAustralia2006
| | - Ngaire Kerse
- University of AucklandDepartment of General Practice and Primary Health CarePrivate Bag 92019AucklandNew Zealand
| | | |
Collapse
|
12
|
Arditi C, Rège‐Walther M, Durieux P, Burnand B. Computer-generated reminders delivered on paper to healthcare professionals: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev 2017; 7:CD001175. [PMID: 28681432 PMCID: PMC6483307 DOI: 10.1002/14651858.cd001175.pub4] [Citation(s) in RCA: 38] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
BACKGROUND Clinical practice does not always reflect best practice and evidence, partly because of unconscious acts of omission, information overload, or inaccessible information. Reminders may help clinicians overcome these problems by prompting them to recall information that they already know or would be expected to know and by providing information or guidance in a more accessible and relevant format, at a particularly appropriate time. This is an update of a previously published review. OBJECTIVES To evaluate the effects of reminders automatically generated through a computerized system (computer-generated) and delivered on paper to healthcare professionals on quality of care (outcomes related to healthcare professionals' practice) and patient outcomes (outcomes related to patients' health condition). SEARCH METHODS We searched CENTRAL, MEDLINE, Embase, six other databases and two trials registers up to 21 September 2016 together with reference checking, citation searching and contact with study authors to identify additional studies. SELECTION CRITERIA We included individual- or cluster-randomized and non-randomized trials that evaluated the impact of computer-generated reminders delivered on paper to healthcare professionals, alone (single-component intervention) or in addition to one or more co-interventions (multi-component intervention), compared with usual care or the co-intervention(s) without the reminder component. DATA COLLECTION AND ANALYSIS Review authors working in pairs independently screened studies for eligibility and abstracted data. For each study, we extracted the primary outcome when it was defined or calculated the median effect size across all reported outcomes. We then calculated the median improvement and interquartile range (IQR) across included studies using the primary outcome or median outcome as representative outcome. We assessed the certainty of the evidence according to the GRADE approach. MAIN RESULTS We identified 35 studies (30 randomized trials and five non-randomized trials) and analyzed 34 studies (40 comparisons). Twenty-nine studies took place in the USA and six studies took place in Canada, France, Israel, and Kenya. All studies except two took place in outpatient care. Reminders were aimed at enhancing compliance with preventive guidelines (e.g. cancer screening tests, vaccination) in half the studies and at enhancing compliance with disease management guidelines for acute or chronic conditions (e.g. annual follow-ups, laboratory tests, medication adjustment, counseling) in the other half.Computer-generated reminders delivered on paper to healthcare professionals, alone or in addition to co-intervention(s), probably improves quality of care slightly compared with usual care or the co-intervention(s) without the reminder component (median improvement 6.8% (IQR: 3.8% to 17.5%); 34 studies (40 comparisons); moderate-certainty evidence).Computer-generated reminders delivered on paper to healthcare professionals alone (single-component intervention) probably improves quality of care compared with usual care (median improvement 11.0% (IQR 5.4% to 20.0%); 27 studies (27 comparisons); moderate-certainty evidence). Adding computer-generated reminders delivered on paper to healthcare professionals to one or more co-interventions (multi-component intervention) probably improves quality of care slightly compared with the co-intervention(s) without the reminder component (median improvement 4.0% (IQR 3.0% to 6.0%); 11 studies (13 comparisons); moderate-certainty evidence).We are uncertain whether reminders, alone or in addition to co-intervention(s), improve patient outcomes as the certainty of the evidence is very low (n = 6 studies (seven comparisons)). None of the included studies reported outcomes related to harms or adverse effects of the intervention. AUTHORS' CONCLUSIONS There is moderate-certainty evidence that computer-generated reminders delivered on paper to healthcare professionals probably slightly improves quality of care, in terms of compliance with preventive guidelines and compliance with disease management guidelines. It is uncertain whether reminders improve patient outcomes because the certainty of the evidence is very low. The heterogeneity of the reminder interventions included in this review also suggests that reminders can probably improve quality of care in various settings under various conditions.
Collapse
Affiliation(s)
- Chantal Arditi
- Lausanne University HospitalCochrane Switzerland, Institute of Social and Preventive MedicineLausanneSwitzerlandCH‐1005
| | - Myriam Rège‐Walther
- Lausanne University HospitalInstitute of Social and Preventive MedicineBiopôle 2Route de la Corniche 10LausanneSwitzerland1010
| | - Pierre Durieux
- Georges Pompidou European HospitalDepartment of Public Health and Medical Informatics20 rue LeblancParisFrance75015
| | - Bernard Burnand
- Lausanne University HospitalCochrane Switzerland, Institute of Social and Preventive MedicineLausanneSwitzerlandCH‐1005
| | | |
Collapse
|
13
|
Alamri SH, Kennedy CC, Marr S, Lohfeld L, Skidmore CJ, Papaioannou A. Strategies to overcome barriers to implementing osteoporosis and fracture prevention guidelines in long-term care: a qualitative analysis of action plans suggested by front line staff in Ontario, Canada. BMC Geriatr 2015; 15:94. [PMID: 26231516 PMCID: PMC4522131 DOI: 10.1186/s12877-015-0099-8] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2015] [Accepted: 07/28/2015] [Indexed: 11/12/2022] Open
Abstract
Background Osteoporosis is a major global health problem, especially among long-term care (LTC) facilities. Despite the availability of effective clinical guidelines to prevent osteoporosis and bone fractures, few LTC homes actually adhere to these practical recommendations. The purpose of this study was to identify barriers to the implementation of evidence-based practices for osteoporosis and fracture prevention in LTC facilities and elicit practical strategies to address these barriers. Methods We performed a qualitative analysis of action plans formulated by Professional Advisory Committee (PAC) teams at 12 LTC homes in the intervention arm of the Vitamin D and Osteoporosis Study (ViDOS) in Ontario, Canada. PAC teams were comprised of medical directors, administrators, directors of care, pharmacists, dietitians, and other staff. Thematic content analysis was performed to identify the key themes emerging from the action plans. Results LTC teams identified several barriers, including lack of educational information and resources prior to the ViDOS intervention, difficulty obtaining required patient information for fracture risk assessment, and inconsistent prescribing of vitamin D and calcium at the time of admission. The most frequently suggested recommendations was to establish and adhere to standard admission orders regarding vitamin D, calcium, and osteoporosis therapies, improve the use of electronic medical records for osteoporosis and fracture risk assessment, and require bone health as a topic at quarterly reviews and multidisciplinary conferences. Conclusions This qualitative study identified several important barriers and practical recommendations for improving the implementation of osteoporosis and fracture prevention guidelines in LTC settings.
Collapse
Affiliation(s)
- Sultan H Alamri
- Department of Medicine, Division of Geriatrics, McMaster University, 88 Maplewood Ave, Hamilton, ON, L8M 1 W9, Canada. .,Faculty of Medicine, King Abdulaziz University, Jeddah, Kingdom of Saudi Arabia. .,Geriatrics Residency Program, St. Joseph's Hospital, McMaster University, 50 Charlton Ave. E., Hamilton, ON, L8N 4A6, Canada.
| | - Courtney C Kennedy
- Department of Medicine, Division of Geriatrics, McMaster University, 88 Maplewood Ave, Hamilton, ON, L8M 1 W9, Canada. .,Juravinski Research Centre, Hamilton Health Sciences - St. Peter's Hospital, 88 Maplewood Avenue, Hamilton, ON, L8M 1 W9, Canada. .,Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main St. West, Hamilton, ON, L8S4K1, Canada.
| | - Sharon Marr
- Department of Medicine, Division of Geriatrics, McMaster University, 88 Maplewood Ave, Hamilton, ON, L8M 1 W9, Canada. .,Juravinski Research Centre, Hamilton Health Sciences - St. Peter's Hospital, 88 Maplewood Avenue, Hamilton, ON, L8M 1 W9, Canada.
| | - Lynne Lohfeld
- Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main St. West, Hamilton, ON, L8S4K1, Canada.
| | - Carly J Skidmore
- Juravinski Research Centre, Hamilton Health Sciences - St. Peter's Hospital, 88 Maplewood Avenue, Hamilton, ON, L8M 1 W9, Canada.
| | - Alexandra Papaioannou
- Department of Medicine, Division of Geriatrics, McMaster University, 88 Maplewood Ave, Hamilton, ON, L8M 1 W9, Canada. .,Juravinski Research Centre, Hamilton Health Sciences - St. Peter's Hospital, 88 Maplewood Avenue, Hamilton, ON, L8M 1 W9, Canada. .,Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main St. West, Hamilton, ON, L8S4K1, Canada.
| |
Collapse
|
14
|
Kennedy CC, Ioannidis G, Thabane L, Adachi JD, O’Donnell D, Giangregorio LM, Pickard LE, Papaioannou A. Osteoporosis prescribing in long-term care: impact of a provincial knowledge translation strategy. Can J Aging 2015; 34:137-48. [PMID: 25850439 PMCID: PMC5104546 DOI: 10.1017/s0714980815000057] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022] Open
Abstract
This study described prescribing trends before and after implementing a provincial strategy aimed at improving osteoporosis and fracture prevention in Ontario long-term care (LTC) homes. Data were obtained from a pharmacy provider for 10 LTC homes in 2007 and 166 homes in 2012. We used weighted, multiple linear regression analyses to examine facility-level changes in vitamin D, calcium, and osteoporosis medication prescribing rates between 2007 and 2012. After five years, the estimated increase in vitamin D, calcium, and osteoporosis medication prescribing rates, respectively, was 38.2 per cent (95% confidence interval [CI]: 29.0, 47.3; p < .001), 4.0 per cent (95% CI: -3.9, 12.0; p = .318), and 0.2 per cent (95% CI: -3.3, 3.7; p = .91). Although the study could not assess causality, findings suggest that wide-scale knowledge translation activities successfully improved vitamin D prescribing rates, although ongoing efforts are needed to target homes with low uptake.
Collapse
Affiliation(s)
- Courtney C. Kennedy
- Department of Medicine, McMaster University
- St. Peter’s Hospital, GERAS Centre
| | - George Ioannidis
- Department of Medicine, McMaster University
- St. Peter’s Hospital, GERAS Centre
| | - Lehana Thabane
- Clinical Epidemiology and Biostatistics, McMaster University
- St Joseph’s Healthcare – Hamilton
| | - Jonathan D. Adachi
- Department of Medicine, McMaster University
- St Joseph’s Healthcare – Hamilton
- Alliance for Better Bone Health Chair in Rheumatology
| | | | | | - Laura E. Pickard
- Department of Medicine, McMaster University
- St. Peter’s Hospital, GERAS Centre
| | - Alexandra Papaioannou
- Department of Medicine, McMaster University
- St. Peter’s Hospital, GERAS Centre
- Eli Lilly Canada Chair in Osteoporosis
| |
Collapse
|
15
|
Kennedy CC, Ioannidis G, Thabane L, Adachi JD, Marr S, Giangregorio LM, Morin SN, Crilly RG, Josse RG, Lohfeld L, Pickard LE, van der Horst ML, Campbell G, Stroud J, Dolovich L, Sawka AM, Jain R, Nash L, Papaioannou A. Successful knowledge translation intervention in long-term care: final results from the vitamin D and osteoporosis study (ViDOS) pilot cluster randomized controlled trial. Trials 2015; 16:214. [PMID: 25962885 PMCID: PMC4431601 DOI: 10.1186/s13063-015-0720-3] [Citation(s) in RCA: 35] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2014] [Accepted: 04/13/2015] [Indexed: 01/02/2023] Open
Abstract
Background Few studies have systematically examined whether knowledge translation (KT) strategies can be successfully implemented within the long-term care (LTC) setting. In this study, we examined the effectiveness of a multifaceted, interdisciplinary KT intervention for improving the prescribing of vitamin D, calcium and osteoporosis medications over 12-months. Methods We conducted a pilot, cluster randomized controlled trial in 40 LTC homes (21 control; 19 intervention) in Ontario, Canada. LTC homes were eligible if they had more than one prescribing physician and received services from a large pharmacy provider. Participants were interdisciplinary care teams (physicians, nurses, consultant pharmacists, and other staff) who met quarterly. Intervention homes participated in three educational meetings over 12 months, including a standardized presentation led by expert opinion leaders, action planning for quality improvement, and audit and feedback review. Control homes did not receive any additional intervention. Resident-level prescribing and clinical outcomes were collected from the pharmacy database; data collectors and analysts were blinded. In addition to feasibility measures, study outcomes were the proportion of residents taking vitamin D (≥800 IU/daily; primary), calcium ≥500 mg/day and osteoporosis medications (high-risk residents) over 12 months. Data were analyzed using the generalized estimating equations technique accounting for clustering within the LTC homes. Results At baseline, 5,478 residents, mean age 84.4 (standard deviation (SD) 10.9), 71% female, resided in 40 LTC homes, mean size = 137 beds (SD 76.7). In the intention-to-treat analysis (21 control; 19 intervention clusters), the intervention resulted in a significantly greater increase in prescribing from baseline to 12 months between intervention versus control arms for vitamin D (odds ratio (OR) 1.82, 95% confidence interval (CI): 1.12, 2.96) and calcium (OR 1.33, 95% CI: 1.01, 1.74), but not for osteoporosis medications (OR 1.17, 95% CI: 0.91, 1.51). In secondary analyses, excluding seven nonparticipating intervention homes, ORs were 3.06 (95% CI: 2.18, 4.29), 1.57 (95% CI: 1.12, 2.21), 1.20 (95% CI: 0.90, 1.60) for vitamin D, calcium and osteoporosis medications, respectively. Conclusions Our KT intervention significantly improved the prescribing of vitamin D and calcium and is a model that could potentially be applied to other areas requiring quality improvement. Trial Registration ClinicalTrials.gov: NCT01398527. Registered: 19 July 2011.
Collapse
Affiliation(s)
- Courtney C Kennedy
- McMaster University, 1280 Main Street West, Hamilton, ON, L8S 4K1, Canada.
| | - George Ioannidis
- McMaster University, 1280 Main Street West, Hamilton, ON, L8S 4K1, Canada.
| | - Lehana Thabane
- McMaster University, 1280 Main Street West, Hamilton, ON, L8S 4K1, Canada.
| | - Jonathan D Adachi
- McMaster University, 1280 Main Street West, Hamilton, ON, L8S 4K1, Canada.
| | - Sharon Marr
- McMaster University, 1280 Main Street West, Hamilton, ON, L8S 4K1, Canada.
| | - Lora M Giangregorio
- University of Waterloo, 200 University Avenue West, Waterloo, ON, N2L 3G1, Canada.
| | - Suzanne N Morin
- McGill University, 845Sherbrooke Street West, Montreal, QC, H3A 0G4, Canada.
| | - Richard G Crilly
- Western University, Parkwood Hospital, 801 Commissioners Road East, London, ON, N6C 5 J1, Canada.
| | - Robert G Josse
- University of Toronto, St. Michael's Hospital, 30 Bond Street, Toronto, ON, M5B 1 W8, Canada.
| | - Lynne Lohfeld
- McMaster University, 1280 Main Street West, Hamilton, ON, L8S 4K1, Canada.
| | - Laura E Pickard
- McMaster University, 1280 Main Street West, Hamilton, ON, L8S 4K1, Canada.
| | | | - Glenda Campbell
- McMaster University, 1280 Main Street West, Hamilton, ON, L8S 4K1, Canada.
| | - Jackie Stroud
- Medical Pharmacies Group Limited, 590 Granite Crt, Pickering, ON, L1W 3X6, Canada.
| | - Lisa Dolovich
- McMaster University, 1280 Main Street West, Hamilton, ON, L8S 4K1, Canada.
| | - Anna M Sawka
- University of Toronto, St. Michael's Hospital, 30 Bond Street, Toronto, ON, M5B 1 W8, Canada.
| | - Ravi Jain
- Osteoporosis Canada, Suite 301, 1090 Don Mills Road, Toronto, ON, M3C 3R6, Canada.
| | - Lynn Nash
- McMaster University, 1280 Main Street West, Hamilton, ON, L8S 4K1, Canada.
| | - Alexandra Papaioannou
- McMaster University, 1280 Main Street West, Hamilton, ON, L8S 4K1, Canada. .,Division of Geriatrics, Department of Medicine, McMaster University, Geriatric Education and Research in Aging Sciences (GERAS) Centre, St. Peter's Hospital, Room 151, 88 Maplewood Avenue, Hamilton, ON, L8M 1 W9, Canada.
| |
Collapse
|
16
|
Kaasalainen S, Papaioannou A, Burgess J, Van der Horst ML. Exploring the nurse practitioner role in managing fractures in long-term care. Clin Nurs Res 2015; 24:567-88. [PMID: 25825270 DOI: 10.1177/1054773815577577] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
The purpose of this study was to assess the current level of involvement of nurse practitioners (NPs) in activities related to preventing and managing fractures in long-term care (LTC). This study used a sequential explanatory mixed methods design that included two phases-a cross-sectional survey followed by qualitative interviews. A final sample of 12 NPs completed the online survey for a response rate of 67%. Eleven of the 12 NPs who completed the survey agreed to participate in a follow-up interview. NPs reported that they were quite engaged in managing fractures in LTC; specifically, they were most active in caring for residents post-fracture. NPs described their role as being holistic in nature in their assessment and treatments related to managing fractures. The findings from this mixed method study add to the growing body of knowledge related to how NPs manage fractures in LTC.
Collapse
Affiliation(s)
| | | | - Jennifer Burgess
- Nurse-Led Outreach Team, Shalom Village, Hamilton, Ontario, Canada
| | | |
Collapse
|
17
|
Field B, Booth A, Ilott I, Gerrish K. Using the Knowledge to Action Framework in practice: a citation analysis and systematic review. Implement Sci 2014; 9:172. [PMID: 25417046 PMCID: PMC4258036 DOI: 10.1186/s13012-014-0172-2] [Citation(s) in RCA: 198] [Impact Index Per Article: 19.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2014] [Accepted: 11/06/2014] [Indexed: 11/23/2022] Open
Abstract
Background Conceptual frameworks are recommended as a way of applying theory to enhance implementation efforts. The Knowledge to Action (KTA) Framework was developed in Canada by Graham and colleagues in the 2000s, following a review of 31 planned action theories. The framework has two components: Knowledge Creation and an Action Cycle, each of which comprises multiple phases. This review sought to answer two questions: ‘Is the KTA Framework used in practice? And if so, how?’ Methods This study is a citation analysis and systematic review. The index citation for the original paper was identified on three databases—Web of Science, Scopus and Google Scholar—with the facility for citation searching. Limitations of English language and year of publication 2006-June 2013 were set. A taxonomy categorising the continuum of usage was developed. Only studies applying the framework to implementation projects were included. Data were extracted and mapped against each phase of the framework for studies where it was integral to the implementation project. Results The citation search yielded 1,787 records. A total of 1,057 titles and abstracts were screened. One hundred and forty-six studies described usage to varying degrees, ranging from referenced to integrated. In ten studies, the KTA Framework was integral to the design, delivery and evaluation of the implementation activities. All ten described using the Action Cycle and seven referred to Knowledge Creation. The KTA Framework was enacted in different health care and academic settings with projects targeted at patients, the public, and nursing and allied health professionals. Conclusions The KTA Framework is being used in practice with varying degrees of completeness. It is frequently cited, with usage ranging from simple attribution via a reference, through informing planning, to making an intellectual contribution. When the framework was integral to knowledge translation, it guided action in idiosyncratic ways and there was theory fidelity. Prevailing wisdom encourages the use of theories, models and conceptual frameworks, yet their application is less evident in practice. This may be an artefact of reporting, indicating that prospective, primary research is needed to explore the real value of the KTA Framework and similar tools. Electronic supplementary material The online version of this article (doi:10.1186/s13012-014-0172-2) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- Becky Field
- School of Health and Related Research (ScHARR), University of Sheffield, Sheffield, UK.
| | - Andrew Booth
- School of Health and Related Research (ScHARR), University of Sheffield, Sheffield, UK.
| | | | - Kate Gerrish
- School of Nursing and Midwifery, University of Sheffield, Sheffield, UK. .,Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, UK. .,NIHR CLAHRC YH, Sheffield, UK.
| |
Collapse
|
18
|
Implementing a knowledge translation intervention in long-term care: feasibility results from the Vitamin D and Osteoporosis Study (ViDOS). J Am Med Dir Assoc 2014; 15:943-5. [PMID: 24953541 DOI: 10.1016/j.jamda.2014.05.007] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2014] [Revised: 05/04/2014] [Accepted: 05/08/2014] [Indexed: 11/22/2022]
Abstract
OBJECTIVES To evaluate the feasibility of implementing an interdisciplinary, multifaceted knowledge translation intervention within long-term care (LTC) and to identify any challenges that should be considered in designing future studies. DESIGN Cluster randomized controlled trial. SETTING Forty LTC homes across the province of Ontario, Canada. PARTICIPANTS LTC teams composed of physicians, nurses, pharmacists, and other staff. MEASUREMENTS Cluster-level feasibility measures, including recruitment, retention, data completion, and participation in the intervention. A process evaluation was completed by directors of care indicating which process/policy changes had been implemented. RESULTS Recruitment and retention rates were 22% and 63%, respectively. Good fidelity with the intervention was achieved, including attendance at educational meetings. After ViDOS, 7 process indicators were being newly implemented by more than 50% of active intervention homes. CONCLUSION Despite recruitment and retention challenges, the multifaceted intervention produced a number of policy/process changes and had good intervention fidelity. This study is registered at ClinicalTrials.gov NCT01398527.
Collapse
|
19
|
Slaughter SE, Estabrooks CA, Jones CA, Wagg AS, Eliasziw M. Sustaining Transfers through Affordable Research Translation (START): study protocol to assess knowledge translation interventions in continuing care settings. Trials 2013; 14:355. [PMID: 24160483 PMCID: PMC4231466 DOI: 10.1186/1745-6215-14-355] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2013] [Accepted: 10/17/2013] [Indexed: 11/16/2022] Open
Abstract
Background Bridging the research-practice gap is an important research focus in continuing care facilities, because the population of older adults (aged 65 years and over) requiring continuing care services is the fastest growing demographic among countries in the Organisation for Economic Co-operation and Development (OECD). Unlicensed practitioners, known as health care aides, provide the majority of care for residents living in continuing care facilities. However, little research examines how to sustain health care aide behavior change following initial adoption of current research evidence. Methods/Design We will conduct a phase III, multicentre, cluster randomized controlled trial (RCT) using a stratified 2 × 2 additive factorial design, including an embedded process evaluation, in 24 supportive living facilities within the health zone of Edmonton, AB, Canada. We will determine which combination of frequency and intensity of reminders most effectively sustains the completion of the sit-to-stand activity by health care aides with residents. Frequency refers to how often a reminder is implemented; intensity refers to whether a reminder is social or paper-based. We will compare monthly reminders with reminders implemented every 3 months, and we will compare low intensity, paper-based reminders and high intensity reminders provided by a health care aide peer. Using interviews, questionnaires, and observations, Sustaining Transfers through Affordable Research Translation (START) will evaluate the processes that inhibit or promote the mobility innovation’s sustainability among health care aides in daily practice. We will examine how the reminders are implemented and perceived by health care aides and licensed practical nurses, as well as how health care aides providing peer reminders are identified, received by their peers, and supported by their supervisors. Discussion START will connect up-to-date innovation research with the practice of health care aides providing direct care to a growing population of older Albertans. The project’s reach extends to both supportive living and long-term care settings. Furthermore, START has the potential to introduce and sustain a broad range of innovations in various care areas, such as dementia care, wound care, and pain management – domains where the uptake and sustainability of innovations also encounter significant challenges. By identifying the optimal frequency and intensity of knowledge translation interventions, we hope to enable continuing care organizations to efficiently integrate care innovations into the day-to-day care of residents. Trial registration ClinicalTrials.gov, NCT01746459
Collapse
Affiliation(s)
- Susan E Slaughter
- Faculty of Nursing, Edmonton Clinic Health Academy, University of Alberta, Edmonton, AB T6G 1C9, Canada.
| | | | | | | | | |
Collapse
|
20
|
Wall M, Lohfeld L, Giangregorio L, Ioannidis G, Kennedy CC, Moser A, Papaioannou A, Morin SN. Fracture risk assessment in long-term care: a survey of long-term care physicians. BMC Geriatr 2013; 13:109. [PMID: 24138565 PMCID: PMC3853074 DOI: 10.1186/1471-2318-13-109] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2013] [Accepted: 09/19/2013] [Indexed: 11/21/2022] Open
Abstract
Background The majority of frail elderly who live in long-term care (LTC) are not treated for osteoporosis despite their high risk for fragility fractures. Clinical Practice Guidelines for the diagnosis and management of osteoporosis provide guidance for the management of individuals 50 years and older at risk for fractures, however, they cannot benefit LTC residents if physicians perceive barriers to their application. Our objectives are to explore current practices to fracture risk assessment by LTC physicians and describe barriers to applying the recently published Osteoporosis Canada practice guidelines for fracture assessment and prevention in LTC. Methods A cross-sectional survey was conducted with the Ontario Long-Term Care Physicians Association using an online questionnaire. The survey included questions that addressed members’ attitudes, knowledge, and behaviour with respect to fracture risk assessment in LTC. Closed-ended responses were analyzed using descriptive statistics and thematic framework analysis for open-ended responses. Results We contacted 347 LTC physicians; 25% submitted completed surveys (81% men, mean age 60 (Standard Deviation [SD] 11) years, average 32 [SD 11] years in practice). Of the surveyed physicians, 87% considered prevention of fragility fractures to be important, but a minority (34%) reported using validated fracture risk assessment tools, while 33% did not use any. Clinical risk factors recommended by the OC guidelines for assessing fracture risk considered applicable included; glucocorticoid use (99%), fall history (93%), age (92%), and fracture history (91%). Recommended clinical measurements considered applicable included: weight (84%), thyroid-stimulating hormone (78%) and creatinine (73%) measurements, height (61%), and Get-Up-and-Go test (60%). Perceived barriers to assessing fracture risk included difficulty acquiring necessary information, lack of access to tests (bone mineral density, x-rays) or obtaining medical history; resource constraints, and a sentiment that assessing fracture risk is futile in this population because of short life expectancy and polypharmacy. Conclusion Perceived barriers to fracture risk assessment and osteoporosis management in LTC have not changed recently, contributing in part to the ongoing care gap in osteoporosis management. Our findings highlight the importance to adapt guidelines to be applicable to the LTC environment, and to develop partnerships with stakeholders to facilitate their use in clinical practice.
Collapse
Affiliation(s)
- Michelle Wall
- McGill University Health Center Research Institute, Montreal, Canada.
| | | | | | | | | | | | | | | |
Collapse
|