1
|
Ben-Porat T, Yousefi R, Stojanovic J, Boucher VG, Fortin A, Lavoie K, Bacon SL. Completeness of intervention reporting of nutrition-focused weight management interventions adjunct to metabolic and bariatric surgery: effect of the TIDieR checklist. Int J Obes (Lond) 2024; 48:901-912. [PMID: 38459257 DOI: 10.1038/s41366-024-01506-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/07/2023] [Revised: 02/20/2024] [Accepted: 02/26/2024] [Indexed: 03/10/2024]
Abstract
Nutrition-focused interventions are essential to optimize the bariatric care process and improve health and weight outcomes over time. Clear and detailed reporting of these interventions in research reports is crucial for understanding and applying the findings effectively in clinical practice and research replication. Given the importance of reporting transparency in research, this study aimed to use the Template for Intervention Description and Replication (TIDieR) checklist to evaluate the completeness of intervention reporting in nutritional weight management interventions adjunct to metabolic and bariatric surgery (MBS). The secondary aim was to examine the factors associated with better reporting. A literature search in PubMed, PsychINFO, EMBASE, Scopus, and the Cochrane Controlled Register of Trials was conducted to include randomized controlled trials (RCT), quasi-RCTs and parallel group trials. A total of 22 trials were included in the final analysis. Among the TIDieR 12 items, 6.6 ± 1.9 items were fully reported by all studies. None of the studies completely reported all intervention descriptors. The main areas where reporting required improvement were providing adequate details of the materials and procedures of the interventions, intervention personalization, and intervention modifications during the study. The quality of intervention reporting remained the same after vs. before the release of the TIDieR guidelines. Receiving funds from industrial organizations (p = 0.02) and having the study recorded within a registry platform (p = 0.08) were associated with better intervention reporting. Nutritional weight management interventions in MBS care are still below the desirable standards for reporting. The present study highlights the need to improve adequate reporting of such interventions, which would allow for greater replicability, evaluation through evidence synthesis studies, and transferability into clinical practice.
Collapse
Affiliation(s)
- Tair Ben-Porat
- Montreal Behavioural Medicine Centre (MBMC), Centre intégré universitaire de santé et de services sociaux du Nord-de-l'Île-de-Montréal (CIUSSS-NIM), Montreal, Canada
- Department of Health, Kinesiology and Applied Physiology, Concordia University, Montreal, Canada
| | - Reyhaneh Yousefi
- Montreal Behavioural Medicine Centre (MBMC), Centre intégré universitaire de santé et de services sociaux du Nord-de-l'Île-de-Montréal (CIUSSS-NIM), Montreal, Canada
- Department of Health, Kinesiology and Applied Physiology, Concordia University, Montreal, Canada
| | - Jovana Stojanovic
- Canadian Agency for Drugs and Health Technologies in Health (CADTH), Ottawa, Canada
| | - Vincent Gosselin Boucher
- School of Kinesiology, Faculty of Education, The University of British Columbia, Vancouver, Canada
| | - Annabelle Fortin
- Montreal Behavioural Medicine Centre (MBMC), Centre intégré universitaire de santé et de services sociaux du Nord-de-l'Île-de-Montréal (CIUSSS-NIM), Montreal, Canada
- Department of Psychology, Université du Québec à Montréal, Montreal, Canada
| | - Kim Lavoie
- Montreal Behavioural Medicine Centre (MBMC), Centre intégré universitaire de santé et de services sociaux du Nord-de-l'Île-de-Montréal (CIUSSS-NIM), Montreal, Canada
- Department of Psychology, Université du Québec à Montréal, Montreal, Canada
| | - Simon L Bacon
- Montreal Behavioural Medicine Centre (MBMC), Centre intégré universitaire de santé et de services sociaux du Nord-de-l'Île-de-Montréal (CIUSSS-NIM), Montreal, Canada.
- Department of Health, Kinesiology and Applied Physiology, Concordia University, Montreal, Canada.
| |
Collapse
|
2
|
Thomas A, Roberge-Dao J, Iqbal MZ, Salbach NM, Letts LJ, Polatajko HJ, Rappolt S, Debigaré R, Ahmed S, Bussières A, Paterson M, Rochette A. Developing multisectoral strategies to promote evidence-based practice in rehabilitation: findings from an end-of-grant knowledge translation symposium. Disabil Rehabil 2024; 46:2449-2463. [PMID: 37399539 DOI: 10.1080/09638288.2023.2227565] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2023] [Revised: 05/14/2023] [Accepted: 06/15/2023] [Indexed: 07/05/2023]
Abstract
PURPOSE Following a longitudinal study to understand how evidence-based practice evolves during the initial years of occupational therapy (OT) and physiotherapy (PT) practice, we held an end-of-grant symposium with representatives from education, practice, research, and policy. The objectives were to: (1) elicit feedback on the implications of the study results; and (2) co-develop a list of actionable recommendations for each sector. METHODS Qualitative participatory approach. The symposium was held over two half days and consisted of a presentation of study findings, a discussion on the implications of the research for each sector and future recommendations. Discussions were audio recorded, transcribed verbatim and analyzed using qualitative thematic analysis. RESULTS The themes related to implications of the longitudinal study included: (1) A need to rethink what evidence-based practice (EBP) really is; (2) How to practice EBP; and (3) The continuing challenge of measuring EBP. The co-development of actionable recommendations resulted in nine strategies. CONCLUSIONS This study highlighted how we may collectively promote EBP competencies in future OTs and PTs. We generated sector-specific avenues that may be pursued to promote EBP and argued for the importance of pooling efforts from the four sectors so that we may achieve the intended ethos of EBP.IMPLICATIONS FOR REHABILITATIONThere is a need to revisit the definition of evidence-based practice (EBP) and the traditional 3-circle model in rehabilitation to include a broader conceptualization of what constitutes evidence.We recommend using EBP measures as tools for self-reflection and professional development that can support practitioners to be reflective and accountable evidence-based practitioners.Optimal promotion of EBP competencies in occupational therapists and physiotherapists should rest upon collaborative efforts from the education, practice, research, and policy sectors.
Collapse
Affiliation(s)
- Aliki Thomas
- School of Physical and Occupational Therapy and Institute of Health Sciences Education, Faculty of Medicine and Health Sciences, McGill University, Montreal, Canada
- Centre for Interdisciplinary Research in Rehabilitation of Greater Montreal (CRIR), Montreal, Canada
| | - Jacqueline Roberge-Dao
- Centre for Interdisciplinary Research in Rehabilitation of Greater Montreal (CRIR), Montreal, Canada
- School of Physical and Occupational Therapy, McGill University, Montreal, Canada
| | - Muhammad Zafar Iqbal
- Centre for Interdisciplinary Research in Rehabilitation of Greater Montreal (CRIR), Montreal, Canada
- School of Physical and Occupational Therapy, McGill University, Montreal, Canada
- Research Department, Acuity Insights, Toronto, Canada
| | - Nancy M Salbach
- Department of Physical Therapy, Rehabilitation Sciences Institute, University of Toronto, Toronto, Canada
| | - Lori Jean Letts
- School of Rehabilitation Sciences, McMaster University, Hamilton, Canada
| | - Helene J Polatajko
- Department of Occupational Science and Occupational Therapy, Rehabilitation Sciences Institute, University of Toronto, Toronto, Canada
| | - Susan Rappolt
- Department of Occupational Science and Occupational Therapy, Rehabilitation Sciences Institute, University of Toronto, Toronto, Canada
| | - Richard Debigaré
- Centre de recherche de l'Institut universitaire de cardiologie et de pneumologie de Québec, Université Laval, Quebec, Canada
| | - Sara Ahmed
- Centre for Interdisciplinary Research in Rehabilitation of Greater Montreal (CRIR), Montreal, Canada
- School of Physical and Occupational Therapy, McGill University, Montreal, Canada
- Center for Outcomes Research and Evaluation (CORE), Research Institute of McGill University, Montreal, Canada
| | - André Bussières
- Centre for Interdisciplinary Research in Rehabilitation of Greater Montreal (CRIR), Montreal, Canada
- School of Physical and Occupational Therapy, McGill University, Montreal, Canada
- Département Chiropratique, Université du Québec à Trois-Rivières, Trois-Rivières, Canada
| | - Margo Paterson
- School of rehabilitation Therapy, Queen's University, Kingston, Canada
| | - Annie Rochette
- Centre for Interdisciplinary Research in Rehabilitation of Greater Montreal (CRIR), Montreal, Canada
- School of Rehabilitation, Université de Montréal, Montreal, Canada
| |
Collapse
|
3
|
Spinnewijn L, Scheele F, Braat D, Aarts J. Assessing the educational quality of shared decision-making interventions for residents: A systematic review. PATIENT EDUCATION AND COUNSELING 2024; 123:108187. [PMID: 38355382 DOI: 10.1016/j.pec.2024.108187] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/20/2023] [Revised: 11/18/2023] [Accepted: 01/29/2024] [Indexed: 02/16/2024]
Abstract
OBJECTIVES Many studies on educational interventions to enhance residents' shared decision-making (SDM) skills show limited improvement in SDM skills and clinical outcomes. One plausible explanation for these suboptimal results is the insufficient emphasis on the educational quality of training interventions. METHODS This review evaluates interventions' educational quality using an evaluation framework based on a previous study on effective skills transfer and a well-known SDM model. A systematic review was conducted, searching three databases until December 13, 2022. We assessed study quality by calculating MERSQI scores, examined the levels of study effects based on Kirkpatrick's model, and applied our evaluation framework to assess the interventions' educational quality. Given the heterogeneity among the studies, a meta-analysis was not feasible. RESULTS Twenty-six studies were included. Role-play and feedback were common training characteristics (65% and 54% of interventions). Only four studies (15%) met our framework's high educational quality threshold. No correlation was found between MERSQI scores and educational quality. CONCLUSIONS This review is a valuable attempt to assess the educational quality of SDM interventions beyond measuring study outcomes. PRACTICE IMPLICATIONS Future evaluation frameworks should consider study results, training characteristics, and training content. Our framework offers a sound basis for such an evaluation framework.
Collapse
Affiliation(s)
- Laura Spinnewijn
- Radboud University Medical Center, Department of Obstetrics and Gynaecology, Nijmegen, the Netherlands; VU University, Athena Institute for Trans-Disciplinary Research, Amsterdam, the Netherlands.
| | - Fedde Scheele
- VU University, Athena Institute for Trans-Disciplinary Research, Amsterdam, the Netherlands; OLVG hospital, Department of Healthcare Education, Amsterdam, the Netherlands
| | - Didi Braat
- Radboud University Medical Center, Department of Obstetrics and Gynaecology, Nijmegen, the Netherlands
| | - Johanna Aarts
- Amsterdam University Medical Centers, Department of Obstetrics and Gynaecology, Amsterdam, the Netherlands
| |
Collapse
|
4
|
Vinette B, Lapierre A, Lavoie A, Leclerc-Loiselle J, Charette M, Deschênes MF. Educational strategies used in master's and doctoral nursing education: A scoping review. J Prof Nurs 2023; 48:84-92. [PMID: 37775246 DOI: 10.1016/j.profnurs.2023.06.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2022] [Revised: 06/19/2023] [Accepted: 06/20/2023] [Indexed: 10/01/2023]
Abstract
BACKGROUND Advanced practice nurses and future nursing researchers must be adequately educated with the best available evidence. However, we know little about educational strategies and their characteristics used explicitly to educate advanced practice nurses and future researchers. METHOD A scoping review was used to map the latest educational strategies used in master's and doctoral nursing education between 2011 and 2021. Components of educational strategies were extracted based on the Guideline for Reporting Evidence-Based Practice Educational Interventions and Teaching and the Saskatchewan Education Department Framework of Professional Practice. The New World Kirkpatrick Model was used to categorize the associated learning outcomes. A narrative description approach was used to synthesize the findings. RESULTS A total of 56 studies were included. Several information was missing regarding the theoretical foundations of the educational strategies. A total of 158 educational strategies were identified. Individual work (e.g., homework) was the most popular educational strategy. Most studies assessed learning outcomes related to reactions (e.g., satisfaction) or learning (e.g., knowledge). CONCLUSION More studies should be done using interactive instruction or multimodal approaches, while the authors should better describe intervention components. A systematic review of effectiveness needs to be conducted to evaluate the best educational strategies in the master's and doctoral nursing education.
Collapse
Affiliation(s)
- Billy Vinette
- Faculty of Nursing, University of Montreal, QC, Canada; Center for Innovation in Nursing Education and Professional Learning, QC, Canada.
| | - Alexandra Lapierre
- Faculty of Nursing, University of Montreal, QC, Canada; Center for Innovation in Nursing Education and Professional Learning, QC, Canada
| | - Audrey Lavoie
- Faculty of Nursing, University of Montreal, QC, Canada
| | | | - Martin Charette
- Center for Innovation in Nursing Education and Professional Learning, QC, Canada; School of Nursing, University of Sherbrooke, QC, Canada; Sherbrooke University Hospital Research Center, QC, Canada; School of Nursing and Midwifery, La Trobe University, VIC, Australia
| | - Marie-France Deschênes
- Faculty of Nursing, University of Montreal, QC, Canada; Center for Innovation in Nursing Education and Professional Learning, QC, Canada
| |
Collapse
|
5
|
Leite MN, Hoffmann TC, Helal L, Umpierre D, Yamato TP. Helping to know about the intervention: The Template for Intervention Description and Replication (TIDieR) checklist is now available in Brazilian Portuguese. Braz J Phys Ther 2023; 27:100483. [PMID: 36791584 PMCID: PMC9957771 DOI: 10.1016/j.bjpt.2023.100483] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/09/2023] [Accepted: 01/18/2023] [Indexed: 02/01/2023] Open
Affiliation(s)
- Mariana N Leite
- Masters and Doctoral Programs in Physical Therapy, Universidade Cidade de São Paulo, Sao Paulo, Brazil; Centre for Pain, Health and Lifestyle, Australia
| | - Tammy C Hoffmann
- Faculty of Health Sciences and Medicine, Institute for Evidence-Based Healthcare, Bond University, Robina, QLD, Australia
| | - Lucas Helal
- Graduate Program in Cardiology, School of Medicine, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
| | - Daniel Umpierre
- Exercise Pathophysiology Laboratory, Graduate Program in Cardiology and Cardiovascular Sciences, Universidade Federal do Rio Grande do Sul, Porto Alegre, Brazil; Department of Public Health, Universidade Federal do Rio Grande do Sul, Porto Alegre, Brazil
| | - Tiê P Yamato
- Masters and Doctoral Programs in Physical Therapy, Universidade Cidade de São Paulo, Sao Paulo, Brazil; Centre for Pain, Health and Lifestyle, Australia; School of Public Health, Faculty of Medicine and Health, Institute for Musculoskeletal Health, The University of Sydney, Sydney, Australia.
| |
Collapse
|
6
|
Zacher S, Berger-Höger B, Lühnen J, Steckelberg A. Development and Piloting of a Web-Based Tool to Teach Relative and Absolute Risk Reductions. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph192316086. [PMID: 36498161 PMCID: PMC9739880 DOI: 10.3390/ijerph192316086] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 11/23/2022] [Accepted: 11/29/2022] [Indexed: 05/10/2023]
Abstract
Interpreting study results is an essential component of decision-making. Both laypeople and healthcare professionals often misinterpret treatment effects that are presented as relative risk reduction. Therefore, we developed and piloted a web-based tool to teach the difference between relative and absolute risk reductions. This project follows the UKMRC-guidance for complex interventions. The tool was developed based on adult learning and design theories. This was followed by a qualitative feasibility study focusing on acceptance, applicability, and comprehensibility with healthcare professionals and laypersons. We conducted think-aloud and semi-structured interviews and analysed them using qualitative content analysis. In addition, we explored calculation skills. Between January 2020 and April 2021, we conducted 22 interviews with 8 laypeople and 14 healthcare professionals from different settings. Overall, the tool proved to be feasible and relevant. With regard to comprehension, we observed an awareness of the interpretation of risk reduction, presented therapy effects were questioned more critically, and the influence of relative effects was recognized. Nevertheless, there were comprehension problems in some of the participants, especially with calculations in connection with low mathematical skills. The tool can be used to improve the interpretation of risk reductions in various target groups and to supplement existing educational programs.
Collapse
Affiliation(s)
- Sandro Zacher
- Institute of Health and Nursing Science, Martin Luther University Halle-Wittenberg, 06112 Halle (Saale), Germany
- Correspondence:
| | - Birte Berger-Höger
- Institute of Health and Nursing Science, Martin Luther University Halle-Wittenberg, 06112 Halle (Saale), Germany
- Institute for Public Health and Nursing Research, University of Bremen, 28359 Bremen, Germany
| | - Julia Lühnen
- Institute of Health and Nursing Science, Martin Luther University Halle-Wittenberg, 06112 Halle (Saale), Germany
| | - Anke Steckelberg
- Institute of Health and Nursing Science, Martin Luther University Halle-Wittenberg, 06112 Halle (Saale), Germany
| |
Collapse
|
7
|
Jylänki P, Mbay T, Byman A, Hakkarainen A, Sääkslahti A, Aunio P. Cognitive and Academic Outcomes of Fundamental Motor Skill and Physical Activity Interventions Designed for Children with Special Educational Needs: A Systematic Review. Brain Sci 2022; 12:brainsci12081001. [PMID: 36009064 PMCID: PMC9406044 DOI: 10.3390/brainsci12081001] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2022] [Revised: 07/25/2022] [Accepted: 07/26/2022] [Indexed: 02/05/2023] Open
Abstract
This systematic review aimed to investigate the methodological quality and the effects of fundamental motor skills and physical activity interventions on cognitive and academic skills in 3- to 7-year-old children with special educational needs. The review was reported in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA 2020) statement. A literature search was carried out in April 2020 (updated in January 2022) using seven electronic databases, including ERIC, Scopus, Web of Science, PsycINFO, CINAHL, PubMed, and SPORTDiscus. The methodological quality of the studies was assessed with Effective Public Health Practice Project (EPHPP) Quality Assessment Tool. Cohen’s d effect sizes and post-hoc power analyses were conducted for the included studies. Altogether 22 studies (1883 children) met the inclusion criteria, representing children at-risk for learning difficulties, due to family background (nstudies = 8), children with learning difficulties (nstudies = 7), learning disabilities (nstudies = 5), and physical disabilities (nstudies = 2). Two of the included 22 studies displayed strong, one moderate, and 19 studies weak methodological quality. The intervention effects appeared to be somewhat dependent on the severity of the learning difficulty; in cognitive and language skills, the effects were largest in children at-risk due to family background, whereas in executive functions the effects were largest in children with learning disabilities. However, due to the vast heterogeneity of the included studies, and a rather low methodological quality, it is challenging to summarize the findings in a generalizable manner. Thus, additional high-quality research is required to determine the effectiveness of the interventions.
Collapse
Affiliation(s)
- Pinja Jylänki
- Faculty of Educational Sciences, University of Helsinki, 00170 Helsinki, Finland; (T.M.); (A.B.); (A.H.); (P.A.)
- Correspondence:
| | - Theo Mbay
- Faculty of Educational Sciences, University of Helsinki, 00170 Helsinki, Finland; (T.M.); (A.B.); (A.H.); (P.A.)
| | - Anni Byman
- Faculty of Educational Sciences, University of Helsinki, 00170 Helsinki, Finland; (T.M.); (A.B.); (A.H.); (P.A.)
| | - Airi Hakkarainen
- Faculty of Educational Sciences, University of Helsinki, 00170 Helsinki, Finland; (T.M.); (A.B.); (A.H.); (P.A.)
| | - Arja Sääkslahti
- Faculty of Sport and Health Sciences, University of Jyväskylä, 40600 Jyväskylä, Finland;
| | - Pirjo Aunio
- Faculty of Educational Sciences, University of Helsinki, 00170 Helsinki, Finland; (T.M.); (A.B.); (A.H.); (P.A.)
| |
Collapse
|
8
|
Javornik N, Powell DJH, Eisma MC, Johnston M, Campbell MK, Hartmann-Boyce J, Michie S, West R, Black N, de Bruin M. Pragmatic evaluation of methods for retrieving unpublished information on comparator interventions in a systematic review of smoking cessation trials. Psychol Health 2022; 39:1-17. [PMID: 35876093 PMCID: PMC10911680 DOI: 10.1080/08870446.2022.2081688] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2021] [Revised: 03/23/2022] [Accepted: 04/06/2022] [Indexed: 10/16/2022]
Abstract
OBJECTIVE Reporting of the content and delivery characteristics of comparator interventions in published articles is often incomplete. This study examines the feasibility and validity of two methods for collecting additional information on comparator interventions from trial authors. METHODS & MEASURES In a systematic review of smoking cessation trials (IC-Smoke), all trial authors were asked to send unpublished comparator intervention materials and complete a specially-developed comparator intervention checklist. All published and additionally obtained information from authors were coded for behaviour change techniques (BCTs) and other characteristics (type of comparator, provider, provider training, delivery mode and treatment duration). To assess representativeness, we assessed the amount of additional information obtained from trial authors compared with the amount that was published. We examined known-group and convergent validity of comparator intervention data when using only published or also unpublished information. RESULTS Additional information were obtained from 91/136 (67%) of trial authors. Representativeness, known-group and convergent validity improved substantially based on the data collected by means of the comparator intervention checklist, but not by requesting authors to send any existing comparator materials. CONCLUSIONS Requesting authors for unpublished comparator intervention data, using specially-developed checklists and unpublished materials, substantially improves the quality of data available for systematic reviews.
Collapse
Affiliation(s)
- Neža Javornik
- Health Psychology Group, Institute of Applied Health Sciences, University of Aberdeen, Aberdeen, United Kingdom
| | - Daniel J. H. Powell
- Health Psychology Group, Institute of Applied Health Sciences, University of Aberdeen, Aberdeen, United Kingdom
- Rowett Institute, University of Aberdeen, Aberdeen, United Kingdom
| | - Maarten C. Eisma
- Department of Clinical Psychology and Experimental Psychopathology, University of Groningen, Groningen, the Netherlands
| | - Marie Johnston
- Health Psychology Group, Institute of Applied Health Sciences, University of Aberdeen, Aberdeen, United Kingdom
| | - Marion K. Campbell
- Health Services Research Unit, Institute of Applied Health Sciences, University of Aberdeen, Aberdeen, United Kingdom
| | - Jamie Hartmann-Boyce
- Nuffield Department of Primary Care Health Sciences and National Institute of Health Research Oxford Biomedical Research Centre, University of Oxford, Oxford, United Kingdom
| | - Susan Michie
- Centre for Behaviour Change, University College London, London, United Kingdom
| | - Robert West
- Department of Behavioural Science and Health, University College London, London, United Kingdom
| | - Nicola Black
- Health Psychology Group, Institute of Applied Health Sciences, University of Aberdeen, Aberdeen, United Kingdom
- Technology Addiction Team, Brain and Mind Centre, University of Sydney, Australia
| | - Marijn de Bruin
- Health Psychology Group, Institute of Applied Health Sciences, University of Aberdeen, Aberdeen, United Kingdom
- Radboud University Medical Center, Radboud Institute for Health Sciences, IQ Healthcare, Nijmegen, the Netherlands
| |
Collapse
|
9
|
Hersche R, Roser K, Weise A, Michel G, Barbero M. Fatigue self-management education in persons with disease-related fatigue: A comprehensive review of the effectiveness on fatigue and quality of life. PATIENT EDUCATION AND COUNSELING 2022; 105:1362-1378. [PMID: 34561143 DOI: 10.1016/j.pec.2021.09.016] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/28/2021] [Revised: 08/09/2021] [Accepted: 09/09/2021] [Indexed: 06/13/2023]
Abstract
OBJECTIVES To systematically synthesize the effectiveness of fatigue self-management education (SME) on fatigue and quality of life (QoL) in persons with disease-related fatigue, and to describe the intervention characteristics. METHODS We systematically reviewed the literature on SMEs in people with disease-related fatigue. We included randomized controlled trials (RCT), which aimed to improve self-management skills for fatigue in daily life. We synthesized the effectiveness and mapped the intervention characteristics. RESULTS We included 26 RCTs studying samples from eight disease groups. At follow-up, 46% studies reported statistically significant improvements on fatigue and 46% on QoL. For persons with cancer 6/8 and multiple sclerosis 8/10 RCTs showed positive evidence in favor of SME. The range of effect sizes was wide (d: 0.0 ->0.8). Delivery modalities (inpatient, outpatient, home), interactions (individual, group, remote), and duration [range (h): 1-17.5] varied. CONCLUSIONS The overall evidence on the effectiveness of SMEs on fatigue and QoL is limited and inconsistent. For persons with cancer and multiple sclerosis, the evidence provides a positive effect. The RCTs with medium to large effect on QoL indicate the potential benefit of SMEs. PRACTICAL IMPLICATION Duration and peer interaction should be considered when tailoring SMEs to populations and contexts.
Collapse
Affiliation(s)
- Ruth Hersche
- Department of Business Economics, Health and Social Care, University of Applied Sciences and Arts of Southern Switzerland, Manno, Landquart, Switzerland.
| | - Katharina Roser
- Department of Health Sciences and Medicine, University of Lucerne, Luzern, Switzerland
| | - Andrea Weise
- Department of Business Economics, Health and Social Care, University of Applied Sciences and Arts of Southern Switzerland, Manno, Landquart, Switzerland
| | - Gisela Michel
- Department of Health Sciences and Medicine, University of Lucerne, Luzern, Switzerland
| | - Marco Barbero
- Department of Business Economics, Health and Social Care, University of Applied Sciences and Arts of Southern Switzerland, Manno, Landquart, Switzerland
| |
Collapse
|
10
|
Baixinho CL, Ferreira Ó, Medeiros M, de Oliveira ESF. From Evidence Synthesis to Transfer: Results from a Qualitative Case Study with the Perspectives of Participants. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19095650. [PMID: 35565044 PMCID: PMC9105498 DOI: 10.3390/ijerph19095650] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 04/12/2022] [Revised: 05/03/2022] [Accepted: 05/05/2022] [Indexed: 12/04/2022]
Abstract
The increase in health research brings challenges to the production, synthesis, and use of research findings in clinical practice. In the case of undergraduate training in nursing, it is necessary to think about the curricular contents and create opportunities to develop skills for learning evidence-based practice. The objective of this study was to analyze nurses’ perspectives regarding the effects of their participation in a project of translation of knowledge into clinical practice during undergraduate nursing education, specifically involving knowledge, attitudes, and competencies related to the use of evidence. This is a qualitative case study grounded in the knowledge-to-action theoretical framework. The participants were 13 nurses who were involved in a project about the translation of knowledge into clinical practice during the last term of their undergraduate course. The data were collected by applying interviews between December 2020 and April 2021. Content analysis was carried out by using the qualitative data analysis software tool webQDA®. The following categories emerged from the content analysis carried out on the material gathered during the interviews: understanding evidence; learning how to use evidence; transferring evidence; adjusting to the context; and observing the advantages of evidence-based practice. Extracurricular activities were perceived as an opportunity to understand what evidence is and observe in loco the advantages of health care for clients, teams, and services. During the project, the participants developed cross-sectional competencies and envisaged changes to their professional activity as a result of changes in their attitude regarding evidence and its use. We concluded that the opportunity to develop evidence-related activities allows for the development of skills and influences the attitude towards evidence-based practice and knowledge use.
Collapse
Affiliation(s)
- Cristina Lavareda Baixinho
- Nursing Research, Innovation and Development Centre of Lisbon (CIDNUR), Nursing School of Lisbon, 1900-160 Lisbon, Portugal;
- Center for Innovative Care and Health Technology (ciTechCare), Polytechnic of Leiria, 2410-541 Leiria, Portugal
- Correspondence: ; Tel.: +351-933254269
| | - Óscar Ferreira
- Nursing Research, Innovation and Development Centre of Lisbon (CIDNUR), Nursing School of Lisbon, 1900-160 Lisbon, Portugal;
| | - Marcelo Medeiros
- Nursing School, Federal University of Goiás, Goiânia 74690-900, Brazil;
| | | |
Collapse
|
11
|
Onyura B, Lass E, Lazor J, Zuccaro L, Hamza DM. Vitalizing the evaluation of curricular implementation: a framework for attending to the "how and whys" of curriculum evolution. ADVANCES IN HEALTH SCIENCES EDUCATION : THEORY AND PRACTICE 2022; 27:553-572. [PMID: 34779952 DOI: 10.1007/s10459-021-10083-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/19/2020] [Accepted: 10/31/2021] [Indexed: 06/13/2023]
Abstract
As curricular reforms are implemented, there is often urgency among scholars to swiftly evaluate curricular outcomes and establish whether desired impacts have been realized. Consequently, many evaluative studies focus on summative program outcomes without accompanying evaluations of implementation. This runs the risk of Type III errors, whereby outcome evaluations rest on unverified assumptions about the appropriate implementation of prescribed curricular activities. Such errors challenge the usefulness of the evaluative studies, casting doubt on accumulated knowledge about curricular innovations, and posing problems for educational systems working to mobilize scarce resources. Unfortunately, however, there is long-standing inattention to the evaluation of implementation in health professions education (HPE). To address this, we propose an accessible framework that provides substantive guidance for evaluative research on implementation of curricular innovations. The Prescribed-Intended-Enacted-Sustainable (PIES) framework that is articulated in this paper, introduces new concepts to HPE-with a view to facilitating more nuanced examination of the evolution of curricula as they are implemented. Critically, the framework is theoretically grounded, integrating evaluation and implementation science as well as education theory. It outlines when, how, and why evaluators need to direct attention to curricular implementation, providing guidance on how programs can map out meaningful evaluative research agendas. Ultimately, this work is intended to support evaluators and educators, seeking to design evaluation studies that provide more faithful, useful representations of the intricacies of curricular change implementation.
Collapse
Affiliation(s)
- Betty Onyura
- Centre for Faculty Development, Faculty of Medicine, University of Toronto at Unity Health Toronto, Toronto, Canada.
- Department of Family and Community Medicine, University of Toronto, Toronto, Canada.
- Institute for Health Policy, Management and Evaluation, University of Toronto, Toronto, Canada.
| | - Elliot Lass
- Department of Family and Community Medicine, University of Toronto, Toronto, Canada
- Institute for Health Policy, Management and Evaluation, University of Toronto, Toronto, Canada
| | - Jana Lazor
- Department of Family and Community Medicine, University of Toronto, Toronto, Canada
- MD Program, Temerty Faculty of Medicine, University of Toronto, Toronto, Canada
| | - Laura Zuccaro
- Department of Family and Community Medicine, University of Toronto, Toronto, Canada
| | - Deena M Hamza
- Postgraduate Medical Education, Faculty of Medicine & Dentistry, University of Alberta, Edmonton, Canada
| |
Collapse
|
12
|
The Development of Research Skills in Nursing Postgraduate Training. EDUCATION SCIENCES 2022. [DOI: 10.3390/educsci12020078] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The objective of this study was to understand the contribution of postgraduate training to the development of research skills, aiming at their application in clinical practice. Method: This was a qualitative, exploratory, and descriptive study conducted with eight nurses in the Local Health Unit of Baixo Alentejo, in Portugal, who had postgraduate training. The researchers conducted a group interview, or discussion group, using a semi-structured interview, which was assessed by two reviewers. The data were submitted to content analysis, and the results underwent a validation process with the participants and two reviewers. This study was approved by the institution’s ethics committee. Result: In terms of the research skills developed in nursing postgraduate education, the following indicators emerged from the participants’ discourse: understanding the research process, searching databases, developing literature reviews, assessing the quality of articles, developing research projects, communicating about science, and translating knowledge into clinical practice. Conclusion: The participants developed research skills in their nursing postgraduate training and reported developing these skills in their clinical practice.
Collapse
|
13
|
Hudson E, Clavel N, Kilpatrick K, Lavoie-Tremblay M. Effective online learning strategies for leadership and policy undergraduate courses for nursing students: a rapid review. J Prof Nurs 2021; 37:1079-1085. [PMID: 34887026 DOI: 10.1016/j.profnurs.2021.08.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Indexed: 10/20/2022]
Abstract
OBJECTIVES Due to the importance of developing leadership competencies during nursing education, it is critical to make evidence-based decisions regarding the transformation from face-to-face to online delivery of leadership and policy courses for nursing students in the wake of the COVID-19 pandemic. This rapid review aims to identify effective learning strategies for creating online leadership and policy courses for undergraduate nursing students. DATA SOURCES AND REVIEW METHODS A rapid review methodology was used. Searches in CINAHL and ERIC yielded 4112 records. After screening, seven articles were included. The Criteria for Describing and Evaluating Training Interventions in Healthcare Professions (CRe-DEPTH) tool was used for quality appraisal and data extraction. A narrative synthesis approach was used to summarize the data. RESULTS The learning activities were heterogeneous in terms of content and format. Articles described the use of discussion forums, case studies, virtual clinical learning experiences, microblogging, and video clips. The methods of evaluation for these learning activities also varied greatly. CONCLUSION The findings will act as a steppingstone to help develop an online undergraduate leadership and policy nursing course. This review also demonstrated the need for rigorous evaluation of learning activities. The use of a tool such as the CRe-DEPTH can help instructors plan and report on their learning interventions or courses.
Collapse
Affiliation(s)
- Emilie Hudson
- Ingram School of Nursing, McGill University, Ingram School of Nursing, 680 Sherbrooke St. West, Montreal, QC H3A 2M7, Canada.
| | - Nathalie Clavel
- Ingram School of Nursing, McGill University, Ingram School of Nursing, 680 Sherbrooke St. West, Montreal, QC H3A 2M7, Canada.
| | - Kelley Kilpatrick
- Ingram School of Nursing, McGill University, Ingram School of Nursing, 680 Sherbrooke St. West, Montreal, QC H3A 2M7, Canada.
| | - Mélanie Lavoie-Tremblay
- Ingram School of Nursing, McGill University, Ingram School of Nursing, 680 Sherbrooke St. West, Montreal, QC H3A 2M7, Canada.
| |
Collapse
|
14
|
Hirt J, Nordhausen T, Meichlinger J, Braun V, Zeller A, Meyer G. Educational interventions to improve literature searching skills in the health sciences: a scoping review. J Med Libr Assoc 2021; 108:534-546. [PMID: 33013210 PMCID: PMC7524628 DOI: 10.5195/jmla.2020.954] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
Abstract
Objective: The authors reviewed educational interventions for improving literature searching skills in the health sciences. Methods: We performed a scoping review of experimental and quasi-experimental studies published in English and German, irrespective of publication year. Targeted outcomes were objectively measurable literature searching skills (e.g., quality of search strategy, study retrieval, precision). The search methods consisted of searching databases (CINAHL, Embase, MEDLINE, PsycINFO, Web of Science), tracking citations, free web searching, and contacting experts. Two reviewers performed screening and data extraction. To evaluate the completeness of reporting, the Template for Intervention Description and Replication (TIDieR) was applied. Results: We included 6 controlled trials and 8 pre-post trials from the 8,484 references that we screened. Study participants were students in various health professions and physicians. The educational formats of the interventions varied. Outcomes clustered into 2 categories: (1) developing search strategies (e.g., identifying search concepts, selecting databases, applying Boolean operators) and (2) database searching skills (e.g., searching PubMed, MEDLINE, or CINAHL). In addition to baseline and post-intervention measurement, 5 studies reported follow-up. Almost all studies adequately described their intervention procedures and delivery but did not provide access to the educational material. The expertise of the intervention facilitators was described in only 3 studies. Conclusions: The results showed a wide range of study populations, interventions, and outcomes. Studies often lacked information about educational material and facilitators' expertise. Further research should focus on intervention effectiveness using controlled study designs and long-term follow-up. To ensure transparency, replication, and comparability, studies should rigorously describe their intervention.
Collapse
Affiliation(s)
- Julian Hirt
- , Institute of Applied Nursing Science, Department of Health, FHS St. Gallen, University of Applied Sciences, St. Gallen, Switzerland, and Medical Faculty, International Graduate Academy, Institute for Health and Nursing Science, Martin Luther University Halle-Wittenberg, Halle (Saale), Germany
| | - Thomas Nordhausen
- , Medical Faculty, International Graduate Academy, Institute for Health and Nursing Science, Martin Luther University Halle-Wittenberg, Halle (Saale), Germany
| | - Jasmin Meichlinger
- , Institute of Applied Nursing Science, Department of Health, FHS St. Gallen, University of Applied Sciences, St. Gallen, Switzerland
| | - Volker Braun
- , Medical Faculty, Library of the University Hospital Mannheim, University of Heidelberg, Mannheim, Germany
| | - Adelheid Zeller
- , Institute of Applied Nursing Science, Department of Health, FHS St. Gallen, University of Applied Sciences, St. Gallen, Switzerland
| | - Gabriele Meyer
- , Medical Faculty, International Graduate Academy, Institute for Health and Nursing Science, Martin Luther University Halle-Wittenberg, Halle (Saale), Germany
| |
Collapse
|
15
|
Lauseng DL, Alpi KM, Linares BM, Sullo E, von Isenburg M. Library involvement in health informatics education for health professions students and practitioners: a scoping review. J Med Libr Assoc 2021; 109:365-375. [PMID: 34629964 PMCID: PMC8485947 DOI: 10.5195/jmla.2021.1081] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
OBJECTIVE The purpose of this scoping review is to evaluate the extent of library or librarian involvement in informatics education in the health domain. METHODS We searched eight databases from their inception to 2019 for reports of informatics educational activities for health professionals or health professions students that involved library staff or resources. Two reviewers independently screened all titles/abstracts (n=2,196) and resolved inclusion decisions by consensus. From the full text of the 36 papers that met the inclusion criteria, we extracted data on 41 educational activities. RESULTS The most frequent coded purposes of activities were "teaching clinical tools" (n=19, 46.3%) and "technology" (n=17; 41.5%). Medical students were the most frequent primary audience (34.1%), though 41.5% of activities had multiple audiences. Evaluation was reported for 24 activities (58.5%), only a few of which assessed short or post-activity impact on attitudes, knowledge, or skills. The most common long-term outcome was applying skills in other courses or clinical experiences. Thematic analysis yielded three areas of outcomes and issues for the library and organizational partners: expanded opportunities, technology and resource issues, and value demonstration. CONCLUSIONS Limited published examples of health informatics educational activities provide models for library roles in informatics education. More librarians should report on their informatics educational activities and provide sufficient details on the interventions and their evaluation. This would strengthen the evidence base about the potential impact of libraries within informatics education.
Collapse
Affiliation(s)
- Deborah L Lauseng
- , Regional Head Librarian & Assistant Professor, Library of the Health Sciences-Peoria, University of Illinois Chicago, Peoria, IL
| | - Kristine M Alpi
- , University Librarian, OHSU Library, Oregon Health & Science University, Portland, OR
| | - Brenda M Linares
- , School of Nursing Librarian, A. R. Dykes Library, University of Kansas Medical Center, Kansas City, KS
| | - Elaine Sullo
- , Associate Director, Reference and Instruction, Himmelfarb Health Sciences Library, George Washington University, Washington, DC
| | - Megan von Isenburg
- , Associate Dean, Library Services & Archives, Medical Center Library & Archives, Duke University Medical Center, Durham, NC
| |
Collapse
|
16
|
de Bruin M, Black N, Javornik N, Viechtbauer W, Eisma MC, Hartman-Boyce J, Williams AJ, West R, Michie S, Johnston M. Underreporting of the active content of behavioural interventions: a systematic review and meta-analysis of randomised trials of smoking cessation interventions. Health Psychol Rev 2021; 15:195-213. [PMID: 31906781 DOI: 10.1080/17437199.2019.1709098] [Citation(s) in RCA: 32] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/06/2019] [Accepted: 12/20/2019] [Indexed: 10/25/2022]
Abstract
Despite its importance, underreporting of the active content of experimental and comparator interventions in published literature has not been previously examined for behavioural trials. We assessed completeness and variability in reporting in 142 randomised controlled trials of behavioural interventions for smoking cessation published between 1/1996 and 11/2015. Two coders reliably identified the potential active components of experimental and comparator interventions (activities targeting behaviours key to smoking cessation and qualifying as behaviour change techniques, BCTs) in published, and in unpublished materials obtained from study authors directly. Unpublished materials were obtained for 129/204 (63%) experimental and 93/142 (65%) comparator groups. For those, only 35% (1200/3403) of experimental and 26% (491/1891) of comparator BCTs could be identified in published materials. Reporting quality (#published BCTs/#total BCTs) varied considerably between trials and between groups within trials. Experimental (vs. comparator) interventions were better reported (B(SE) = 0.34 (0.11), p < .001). Unpublished materials were more often obtained for recent studies (B(SE) = 0.093 (0.03), p = .003) published in behavioural (vs. medical) journals (B(SE) = 1.03 (0.41), p = .012). This high variability in underreporting of active content compromises reader's ability to interpret the effects of individual trials, compare and explain intervention effects in evidence syntheses, and estimate the additional benefit of an experimental intervention in other settings.
Collapse
Affiliation(s)
- Marijn de Bruin
- Health Psychology Group, Institute of Applied Health SciencesUniversity of Aberdeen, Aberdeen, UK
- Radboud University Medical Center, Radboud Institute for Health Sciences, IQ Healthcare, Nijmegen, the Netherlands
| | - Nicola Black
- Health Psychology Group, Institute of Applied Health SciencesUniversity of Aberdeen, Aberdeen, UK
- National Drug and Alcohol Research Centre, University of New South Wales, Sydney, Australia
| | - Neza Javornik
- Health Psychology Group, Institute of Applied Health SciencesUniversity of Aberdeen, Aberdeen, UK
| | - Wolfgang Viechtbauer
- Department of Psychiatry and NeuropsychologySchool for Mental Health and Neuroscience, Maastricht University, Maastricht, the Netherlands
| | - Maarten C Eisma
- Department of Clinical Psychology and Experimental Psychopathology, University of Groningen, Groningen, the Netherlands
| | - Jamie Hartman-Boyce
- Nuffield Department of Primary Care Health Sciences and National Institute of Health Research Oxford Biomedical Research Centre, University of Oxford, Oxford, UK
| | - A Jess Williams
- Institute of Mental HealthSchool of Psychology, University of Birmingham, Birmingham, UK
| | - Robert West
- Department of Behavioural Science and Health, University College London, London, UK
| | - Susan Michie
- Centre for Behaviour Change, University College London, London, UK
| | - Marie Johnston
- Health Psychology Group, Institute of Applied Health SciencesUniversity of Aberdeen, Aberdeen, UK
| |
Collapse
|
17
|
Chicoine G, Côté J, Pepin J, Pluye P, Boyer L, Fontaine G, Rouleau G, Dubreucq S, Jutras-Aswad D. Impact of a videoconferencing educational programme for the management of concurrent disorders on nurses' competency development and clinical practice: protocol for a convergent mixed methods study. BMJ Open 2021; 11:e042875. [PMID: 33727265 PMCID: PMC7970219 DOI: 10.1136/bmjopen-2020-042875] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/02/2022] Open
Abstract
INTRODUCTION Extension for Community Healthcare Outcomes (Project ECHO©) is an innovative model for continuing professional development that uses videoconferencing technology to support and train general practitioners remotely. The model has been replicated to a variety of settings and locations for capacity building in healthcare professionals caring for patients with chronic and complex health conditions. Limited research has been conducted so far on the impact of ECHO in the field of concurrent mental health and substance use disorders (ie, concurrent disorders (CDs)). Therefore, this mixed methods study aims to develop a comprehensive understanding of an ECHO programme impact for CD management on nurses' competency development and clinical practice. METHODS AND ANALYSIS The proposed mixed methods study, based on a convergent parallel design, will be conducted in the province of Quebec, Canada, to collect, analyse and interpret quantitative (QUAN) and qualitative (QUAL) data from a specific ECHO Program on CDs. In the QUAN component, an observational prospective cohort study will be conducted over a 12-month period. All nurses who participated in the programme between 2018 and 2020 and who consent to research will be recruited to collect data on the extent of their learning and practice outcomes at three time points. Alongside the surveys, nurses will be invited to participate in individual semistructured interviews. In-depth QUAL data will be subjected to a thematic analysis and will assist in exploring how and in which conditions nurses developed and mobilised their competencies in clinical practice. A comparison-of-results strategy will be used in the final integration component of the study. ETHICS AND DISSEMINATION This study protocol was approved by the Ethics Committee of the Université de Montréal Hospital Center (#19.295) and the Université de Montréal Ethics Committee (CERSES-20-017 R). We aim to disseminate the findings through international academic conferences, international peer-reviewed journals and professional media.
Collapse
Affiliation(s)
- Gabrielle Chicoine
- Faculty of Nursing, Université de Montréal, Montreal, Quebec, Canada
- Research Center, Université de Montréal Hospital Center, Montreal, Quebec, Canada
- Research Chair in Innovative Nursing Practices, Faculty of Nursing, Université de Montréal, Montreal, Quebec, Canada
| | - José Côté
- Faculty of Nursing, Université de Montréal, Montreal, Quebec, Canada
- Research Center, Université de Montréal Hospital Center, Montreal, Quebec, Canada
- Research Chair in Innovative Nursing Practices, Faculty of Nursing, Université de Montréal, Montreal, Quebec, Canada
| | - Jacinthe Pepin
- Faculty of Nursing, Université de Montréal, Montreal, Quebec, Canada
| | - Pierre Pluye
- Department of Family Medicine, Faculty of Medicine, McGill University, Montreal, Quebec, Canada
| | - Louise Boyer
- Faculty of Nursing, Université de Montréal, Montreal, Quebec, Canada
| | - Guillaume Fontaine
- Faculty of Nursing, Université de Montréal, Montreal, Quebec, Canada
- Research Center, Institut de Cardiologie de Montréal, Montreal, Quebec, Canada
| | - Geneviève Rouleau
- Research Chair in Innovative Nursing Practices, Faculty of Nursing, Université de Montréal, Montreal, Quebec, Canada
- Institute for Health System Solutions and Virtual Care, Women's College Hospital Institute for Health System Solutions and Virtual Care, Women's College Hospital, Toronto, Ontario, Canada
| | - Simon Dubreucq
- Research Center, Université de Montréal Hospital Center, Montreal, Quebec, Canada
- Psychiatry Department, Faculty of Medicine, Université de Montréal, Montreal, Quebec, Canada
| | - Didier Jutras-Aswad
- Research Center, Université de Montréal Hospital Center, Montreal, Quebec, Canada
- Psychiatry Department, Faculty of Medicine, Université de Montréal, Montreal, Quebec, Canada
| |
Collapse
|
18
|
Havinga PJ, Maciejewski DF, Hartman CA, Hillegers MHJ, Schoevers RA, Penninx BWJH. Prevention programmes for children of parents with a mood/anxiety disorder: Systematic review of existing programmes and meta-analysis of their efficacy. BRITISH JOURNAL OF CLINICAL PSYCHOLOGY 2021; 60:212-251. [PMID: 33410149 PMCID: PMC8248072 DOI: 10.1111/bjc.12277] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2020] [Revised: 06/03/2020] [Indexed: 12/12/2022]
Abstract
Objectives To systematically describe the characteristics and techniques of prevention programmes for children of parents with mood/anxiety disorders. In addition, recruitment approaches and difficulties were identified and a meta‐analysis was conducted to examine the efficacy of these prevention programmes. Methods Randomized controlled trials assessing the efficacy of a prevention programme for children (6–25 years) of parents with mood and/or anxiety disorders were included. A systematic literature search was conducted in PubMed, PsychINFO, and CENTRAL from the earliest record to March 2019. In addition, programme manuals of identified prevention programmes were requested for a content analysis. Results Twenty‐two articles containing eight unique prevention programmes involving 1,325 subjects were identified. Programmes varied in the number and types of techniques, but all provided psychoeducation. Results suggested that recruitment via clinicians was more successful than recruitment via health maintenance organization databases. In a meta‐analysis, a significant risk difference was found in favour of prevention programmes on the risk of developing a depressive/anxiety disorder in offspring at short‐term (9–18 months follow‐up; RR = 0.37, 95% CI [0.21; 0.66]) and long‐term follow‐up (24 months or longer follow‐up; RR = 0.71, 95% CI [0.57; 0.87] and on symptom levels in offspring at post‐intervention (SMD = −0.19, 95% CI [−0.36; −0.02]) and at 12‐months follow‐up (SMD = −0.31, 95% CI [−0.57; −0.06]). Conclusions The prevention programmes combined psychoeducational elements with skills training and/or cognitive‐behavioural therapy elements. The recruitment process and the content of these programmes are sometimes insufficiently described. Nevertheless, they appear to be effective, indicating a need to further examine how these programmes exactly work and for whom. Practitioner points Preventive interventions for children of parents with mood/anxiety disorders appear to be effective in preventing these disorders in offspring. Available preventive intervention programmes focus mostly on psychoeducation, cognitive‐behavioural therapy, and family processes. More effort should be made into describing preventive interventions so that they can be easily implemented by practitioners. Studies should further examine why and for whom preventive interventions for children of parents with mood/anxiety disorders are effective.
Collapse
Affiliation(s)
- Petra J Havinga
- Department of Psychiatry, Interdisciplinary Center Psychopathology and Emotion regulation (ICPE), University Medical Center Groningen, University of Groningen, The Netherlands
| | - Dominique F Maciejewski
- Department of Developmental Psychopathology, Behavioural Science Institute, Nijmegen, The Netherlands
| | - Catharina A Hartman
- Department of Psychiatry, Interdisciplinary Center Psychopathology and Emotion regulation (ICPE), University Medical Center Groningen, University of Groningen, The Netherlands
| | - Manon H J Hillegers
- Department of Child and Adolescent Psychology and Psychiatry, Erasmus Medical Center, Rotterdam, The Netherlands
| | - Robert A Schoevers
- Department of Psychiatry, Interdisciplinary Center Psychopathology and Emotion regulation (ICPE), University Medical Center Groningen, University of Groningen, The Netherlands
| | - Brenda W J H Penninx
- Department of Psychiatry and Amsterdam Public Health Research Institute, Amsterdam UMC, Vrije Universiteit, Amsterdam, The Netherlands
| |
Collapse
|
19
|
Janke KK, Hager KD, Sharma A. Unpacking student learning from an early experience with the Pharmacists' Patient Care Process. CURRENTS IN PHARMACY TEACHING & LEARNING 2020; 12:1447-1460. [PMID: 33092775 DOI: 10.1016/j.cptl.2020.07.003] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/09/2019] [Revised: 07/08/2020] [Accepted: 07/14/2020] [Indexed: 06/11/2023]
Abstract
BACKGROUND To illuminate learning, a case study approach was used to examine early, authentic experiences within Pharmacists' Patient Care Process (PPCP)-focused practices. EDUCATIONAL ACTIVITY Six students were matched with five practitioners and spent five half-days in a primary care clinic in a PPCP-committed health system. Students practiced interviewing, determining the patient's medication experience, and formulating the beginnings of the assessment, as well as observing and debriefing on the completion of the process by a practitioner mentor. The Five R Model was used to prompt student learning reflection. In addition, instructors examined students' work for evidence of transformative learning and observations were captured using forms of reflective practice and collaborative debriefing. CRITICAL ANALYSIS OF THE EDUCATIONAL ACTIVITY Reflection performance ratings varied; however, there was strong evidence of transformative learning for all students. Specifically, most student reflections demonstrated a focus on elaborating on existing frames of reference. The most prevalent indicator of transformative learning was exploration of options for new roles, relationships, and actions. The codes from instructors' observations revealed five categories of learning evidence, with the strongest in the patient centeredness category. The process of reviewing student work products, documenting instructor observations, and collaborative debriefing resulted in insights for curricular improvement and explanations for learning difficulties. Further work is needed in understanding student experiential learning intentions and their influence on learning and reflection. Additionally, further research should explore the value of longitudinal assessment of reflection and the value of assessing student work products using criteria beyond traditional reflection criteria.
Collapse
Affiliation(s)
- Kristin K Janke
- University of Minnesota College of Pharmacy-Twin Cities, 7-159 Weaver Densford Hall, 308 Harvard St SE, Minneapolis, MN 55455, United States.
| | - Keri D Hager
- University of Minnesota College of Pharmacy, Duluth, 211 Life Science, 1110 Kirby Dr Duluth, MN 55812, United States.
| | - Anita Sharma
- Blue Cross Blue Shield, 3535 Blue Cross Road, Eagan, MN 55122, United States.
| |
Collapse
|
20
|
Dijkers MP. Overview of Reviews Using the Template for Intervention Description and Replication (TIDieR) as a Measure of Trial Intervention Reporting Quality. Arch Phys Med Rehabil 2020; 102:1623-1632. [PMID: 33245937 DOI: 10.1016/j.apmr.2020.09.397] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2020] [Revised: 08/03/2020] [Accepted: 09/17/2020] [Indexed: 11/27/2022]
Abstract
OBJECTIVE To evaluate the quality of descriptions of interventions in health care research reports, based on a synthesis of reviews that used the Template for Intervention Description and Replication (TIDieR) to rate the completeness and quality of intervention reporting. DESIGN Overview of published reviews. In a systematic search of the literature, 56 review articles were retrieved that had evaluated 3454 primary studies (index articles) using all or most of the 12 TIDieR items, applied to experimental treatment only or treatment and comparator both, separately. If available, percentages "reported completely" were extracted based on the index article, the index article supplemented by related information, and these 2 supplemented by e-mailing the author. Information on the review's methodology was also extracted. SETTING Not applicable. PARTICIPANTS Not applicable. INTERVENTIONS Not applicable. MAIN OUTCOME MEASURES Percentage of primary studies receiving "adequately reported" ratings on each of the 12 TIDieR items. RESULTS While for treatment arms TIDieR items 1 (name of treatment) and 2 (why of treatment) are generally judged to be reported adequately, the percentage is between 25% and 75% for most other items and is as low as 10% for item 10 (modifications). Comparators are reported even more poorly. Use of additional publications on a trial increased percentages "reported adequately" marginally; e-mailing resulted in significant increases in completeness of reporting. Rehabilitation trials were reported better than nonrehabilitation trials for some TIDieR items and worse for others. CONCLUSIONS Reporting on the interventions and comparators of trials is substandard. More extensive use of supplemental digital content and of versions of TIDieR customized for specific domains of research may improve the situation.
Collapse
Affiliation(s)
- Marcel P Dijkers
- Department of Physical Medicine and Rehabilitation, Wayne State University, Detroit, Michigan.
| |
Collapse
|
21
|
Oxman AD, García LM. Comparison of the Informed Health Choices Key Concepts Framework to other frameworks relevant to teaching and learning how to think critically about health claims and choices: a systematic review. F1000Res 2020; 9:164. [PMID: 33224475 PMCID: PMC7670481 DOI: 10.12688/f1000research.21858.1] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 02/24/2020] [Indexed: 12/15/2022] Open
Abstract
Background: The Informed Health Choices (IHC) Key Concepts are principles for evaluating the trustworthiness of claims about treatment effects. The Key Concepts provide a framework for developing learning-resources to help people use the concepts when treatment claims are made, and when they make health choices. Objective: To compare the framework provided by the IHC Key Concepts to other frameworks intended to promote critical thinking about treatment (intervention) claims and choices. Methods: We identified relevant frameworks from reviews of frameworks, searching Google Scholar, citation searches, and contact with key informants. We included frameworks intended to provide a structure for teaching or learning to think critically about the basis for claims, evidence used to support claims, or informed choices. For a framework to be included, there had to be a description of its purpose; a list of concepts, competences, or dispositions; and definitions of key terms. We made independent assessments of framework eligibility and extracted data for each included framework using standardised forms. Results: Twenty-two frameworks met our inclusion criteria. The purpose of the IHC Framework is similar to that of two frameworks for critical thinking and somewhat similar to that of a framework for evidence-based practice. Those frameworks have broader scopes than the IHC Framework. An important limitation of broad frameworks is that they do not provide an adequate basis (concepts) for deciding which claims to believe and what to do. There was at most some overlap between the concepts, competences, and dispositions in each of the 22 included frameworks and those in the IHC Framework. Conclusions: The IHC Key Concepts Framework appears to be unique. Our review has shown how it and other frameworks can be improved by taking account of the ways in which other related frameworks have been developed, evaluated, and made useful.
Collapse
Affiliation(s)
- Andrew D Oxman
- Centre for Informed Health Choices, Norwegian Institute of Public Health, Oslo, Norway.,University of Oslo, Oslo, Norway
| | - Laura Martínez García
- Iberoamerican Cochrane Centre, Sant Pau Biomedical Research Institute, Barcelona, Spain.,CIBER of Epidemiology and Public Health, Barcelona, Spain
| |
Collapse
|
22
|
Kattackal TR, Cavallo S, Brosseau L, Sivakumar A, Del Bel MJ, Dorion M, Ueffing E, Toupin-April K. Assessing the reporting quality of physical activity programs in randomized controlled trials for the management of juvenile idiopathic arthritis using three standardized assessment tools. Pediatr Rheumatol Online J 2020; 18:41. [PMID: 32448277 PMCID: PMC7245815 DOI: 10.1186/s12969-020-00434-9] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/28/2019] [Accepted: 05/06/2020] [Indexed: 12/21/2022] Open
Abstract
BACKGROUND The reporting quality of physical activity (PA) programs in randomized controlled trials (RCTs) for the management of juvenile idiopathic arthritis (JIA) remains unknown. This study aimed to assess and compare the reporting quality of PA programs in RCTs for the management of JIA using three difference standardized assessment tools, and to describe the elements that were similar and different between these tools. METHODS A systematic search was conducted for moderate-to high-quality RCTs of PA programs in JIA, published up until January 2019. Two reviewers independently included 10 RCTs and scored the reporting quality of PA programs using the following tools: Consensus on Exercise Reporting Template (CERT) checklist, Consensus on Therapeutic Exercise Training (CONTENT) scale, and Template for Intervention Description and Replication (TIDieR) checklist. RESULTS Results showed that reporting of PA programs in 10 moderate- to high-quality RCTs for JIA management remains incomplete. The average reporting quality (± standard deviation) for all RCTs combined was moderate for the three standardized assessment tools with 70.8 (±14.3)% for the TIDieR checklist, 53.2 (±20.2)% for the CERT checklist, and 70.0 (±18.9)% for the CONTENT scale. Despite some overlap, the three standardized assessment tools (TIDieR, CERT, CONTENT) included different elements resulting in different scores. All tools assess elements linked to PA programs (provider, location, timing, personalization and adherence), but the CERT checklist includes other essential elements (e.g., additional resources, motivational strategies, adverse events). CONCLUSIONS The lack of complete reporting of PA programs in RCTs for the management of JIA and the variation in scores and assessed elements among standardized assessment tools show the need to improve reporting. Using the most comprehensive standardized tool (i.e., the CERT) and providing accessible supplemental information on PA programs may improve the reporting quality of PA programs in RCTs and help reproduce PA programs in research and clinical practice.
Collapse
Affiliation(s)
| | - Sabrina Cavallo
- School of Rehabilitation, Université de Montréal, Montréal, Québec, Canada
| | - Lucie Brosseau
- School of Rehabilitation Sciences, Faculty of Health Sciences, University of Ottawa, Ottawa, Ontario, Canada
| | - Aditi Sivakumar
- Children's Hospital of Eastern Ontario Research Institute, room L1147, 401 Smyth Road, Ottawa, ON, K1H 8L1, Canada
| | - Michael J Del Bel
- School of Rehabilitation Sciences, Faculty of Health Sciences, University of Ottawa, Ottawa, Ontario, Canada
| | - Michelle Dorion
- School of Rehabilitation Sciences, Faculty of Health Sciences, University of Ottawa, Ottawa, Ontario, Canada
| | - Erin Ueffing
- Children's Hospital of Eastern Ontario Research Institute, room L1147, 401 Smyth Road, Ottawa, ON, K1H 8L1, Canada
| | - Karine Toupin-April
- School of Rehabilitation Sciences, Faculty of Health Sciences, University of Ottawa, Ottawa, Ontario, Canada.
- Children's Hospital of Eastern Ontario Research Institute, room L1147, 401 Smyth Road, Ottawa, ON, K1H 8L1, Canada.
- Department of Pediatrics, Faculty of Medicine, University of Ottawa, Ottawa, Ontario, Canada.
| |
Collapse
|
23
|
Simons M, Rapport F, Zurynski Y, Cullis J, Davidson A. What are the links between evidence-based medicine and shared decision-making in training programs for junior doctors? A scoping review protocol. BMJ Open 2020; 10:e037225. [PMID: 32404397 PMCID: PMC7228528 DOI: 10.1136/bmjopen-2020-037225] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
Abstract
INTRODUCTION Patient-centred care is pivotal to clinical practice and medical education. The practice of evidence-based medicine (EBM) and shared decision-making (SDM) are complementary aspects of patient-centred care, but they are frequently taught and reported as independent entities. To effectively perform all steps of EBM, clinicians need to include patients in SDM conversations, however, the uptake of this has been slow and inconsistent. A solution may be the incorporation of SDM into EBM training programmes, but such programmes do not routinely include SDM skills development. This scoping review will survey the literature on the kinds of EBM and SDM educational programmes that exist for recently qualified doctors, programmes that incorporate the teaching of both EBM and SDM skills, as well as identifying research gaps in the literature. METHODS AND ANALYSIS Literature searches will be conducted in the databases Medline, Embase, Scopus and Cochrane Library. Bibliographies of key articles and their citing references will also be hand-searched and assessed for inclusion. Selected grey literature will be included. Papers must be written in English, or provide English abstracts, and date from 1996 to the present day.Two independent reviewers will screen titles and abstracts, check full texts of selected papers for eligibility and extract the data. Any disagreement will be resolved, and consensus reached, if necessary, with the assistance of a third reviewer. Qualitative and quantitative studies that address educational interventions for either EBM, SDM or both will be included. Data extraction tables will present bibliographic information, populations, interventions, context and outcomes. Data will be summarised using tables and figures and a description of findings. ETHICS AND DISSEMINATION This review will synthesise information from publicly available publications and does not require ethics approval. The results will be disseminated via conference presentations and publications in medical journals.
Collapse
Affiliation(s)
- Mary Simons
- Library, Macquarie University, North Ryde, New South Wales, Australia
| | - Frances Rapport
- Australian Institute of Health Innovation, Macquarie University, Sydney, New South Wales, Australia
| | - Yvonne Zurynski
- Australian Institute of Health Innovation, Macquarie University, Sydney, New South Wales, Australia
| | - Jeremy Cullis
- Library, Macquarie University, North Ryde, New South Wales, Australia
| | - Andrew Davidson
- Library, Macquarie University, North Ryde, New South Wales, Australia
| |
Collapse
|
24
|
Assessment of the completeness of intervention reporting of randomized clinical trials for alcohol use disorders: Effect of the TIDieR checklist and guide. Drug Alcohol Depend 2020; 208:107824. [PMID: 32014645 DOI: 10.1016/j.drugalcdep.2019.107824] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/23/2019] [Revised: 12/07/2019] [Accepted: 12/11/2019] [Indexed: 12/20/2022]
Abstract
BACKGROUND/PURPOSE Properly designed randomized controlled trials (RCTs) are the gold standard in patient-centered clinical research. Incomplete intervention reporting affects the readers' ability to evaluate treatment efficacy. Previous studies show that detailed descriptions of trial interventions remains insufficient for reliable replication. Understanding reporting areas in need of improvement can improve the quality of intervention reporting. METHODS This cross-sectional review uses the Template for Intervention Description and Replication (TIDieR) checklist to evaluate the quality of intervention reporting in RCTs. The primary outcome was to investigate the completeness of intervention reporting of RCTs reporting outcomes for patients with alcohol use disorder (AUD) published in highly ranked addiction journals. The secondary outcomes were to: 1) evaluate whether publication of the TIDieR checklist resulted in better intervention reporting practices and 2) determine whether particular trial characteristics were associated with the completeness of intervention reporting. RESULTS The final analysis included 56 records. The mean number of reported TIDieR items was 5.1 (SD = 1.47) of a possible 12. TIDieR checklist publication did not increase the average completion of the TIDieR checklist items (p = 0.76). Improved TIDieR adherence was associated with trials with double blinding, non-drug interventions, and CONSORT endorsement. DISCUSSION/CONCLUSIONS We found the reporting of interventions to be inadequate in our sample of AUD-related RCTs. Fundamental details were often not reported, hampering both clinical and research reproducibility. Moving forward, it may be necessary to consider additional mechanisms to either improve TIDieR uptake or to find other solutions to improve intervention reporting.
Collapse
|
25
|
Albarqouni L, Hoffmann T, Glasziou P. Evidence-based practice educational intervention studies: a systematic review of what is taught and how it is measured. BMC MEDICAL EDUCATION 2018; 18:177. [PMID: 30068343 PMCID: PMC6090869 DOI: 10.1186/s12909-018-1284-1] [Citation(s) in RCA: 65] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/20/2017] [Accepted: 07/19/2018] [Indexed: 05/21/2023]
Abstract
BACKGROUND Despite the established interest in evidence-based practice (EBP) as a core competence for clinicians, evidence for how best to teach and evaluate EBP remains weak. We sought to systematically assess coverage of the five EBP steps, review the outcome domains measured, and assess the properties of the instruments used in studies evaluating EBP educational interventions. METHODS We conducted a systematic review of controlled studies (i.e. studies with a separate control group) which had investigated the effect of EBP educational interventions. We used citation analysis technique and tracked the forward and backward citations of the index articles (i.e. the systematic reviews and primary studies included in an overview of the effect of EBP teaching) using Web of Science until May 2017. We extracted information on intervention content (grouped into the five EBP steps), and the outcome domains assessed. We also searched the literature for published reliability and validity data of the EBP instruments used. RESULTS Of 1831 records identified, 302 full-text articles were screened, and 85 included. Of these, 46 (54%) studies were randomised trials, 51 (60%) included postgraduate level participants, and 63 (75%) taught medical professionals. EBP Step 3 (critical appraisal) was the most frequently taught step (63 studies; 74%). Only 10 (12%) of the studies taught content which addressed all five EBP steps. Of the 85 studies, 52 (61%) evaluated EBP skills, 39 (46%) knowledge, 35 (41%) attitudes, 19 (22%) behaviours, 15 (18%) self-efficacy, and 7 (8%) measured reactions to EBP teaching delivery. Of the 24 instruments used in the included studies, 6 were high-quality (achieved ≥3 types of established validity evidence) and these were used in 14 (29%) of the 52 studies that measured EBP skills; 14 (41%) of the 39 studies that measured EBP knowledge; and 8 (26%) of the 35 studies that measured EBP attitude. CONCLUSIONS Most EBP educational interventions which have been evaluated in controlled studies focus on teaching only some of the EBP steps (predominantly critically appraisal of evidence) and did not use high-quality instruments to measure outcomes. Educational packages and instruments which address all EBP steps are needed to improve EBP teaching.
Collapse
Affiliation(s)
- Loai Albarqouni
- Centre for Research in Evidence Based Practice (CREBP), Faculty of Health Science and Medicine, Bond University, Gold Coast, Australia
| | - Tammy Hoffmann
- Centre for Research in Evidence Based Practice (CREBP), Faculty of Health Science and Medicine, Bond University, Gold Coast, Australia
| | - Paul Glasziou
- Centre for Research in Evidence Based Practice (CREBP), Faculty of Health Science and Medicine, Bond University, Gold Coast, Australia
| |
Collapse
|
26
|
Horsley T, Regehr G. When are two interventions the same? Implications for reporting guidelines in education. MEDICAL EDUCATION 2018; 52:141-143. [PMID: 29356081 DOI: 10.1111/medu.13496] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
|