Quality and Reporting of Cluster Randomized Controlled Trials Evaluating Occupational Therapy Interventions: A Systematic Review

Clinical effectiveness and cost-effectiveness of a multicomponent frailty management program "Say No To Frailty" in Singapore: A cluster-randomized controlled trial protocol

BACKGROUND

A 12-week multicomponent frailty management program - Say No To Frailty (SNTF) consisting of interactive talks and fitness exercises led by a trained program leader has shown feasibility and positive health outcomes in community-living older adults with frailty and pre-frailty in Singapore. This study aims to evaluate the clinical- and cost-effectiveness of SNTF on physical functions, self-confidence, community participation, quality of life and fall reduction in the local community setting.

METHODS

This study will use the cluster-randomization method to randomly allocate 12 participating centres into three arms. Centres under two intervention arms will conduct the same SNTF program but led by a program leader with different training backgrounds (an Allied Health Professional (AHP) v.s. a non-AHP), whereas centres under the control arm will continue their usual care without an additional intervention. Eligible participants at each participating centre will be recruited via the convenience sampling method in the community setting. Primary outcome measure (frailty level) and secondary outcome measures (e.g., physical functions, self-confidence, community participation, quality of life) will be conducted by the blinded assessors at baseline, immediate, 3 months and 9 months post-intervention. Fall data will be collected during the one-year study period. Outcomes between and within groups will be compared and analysed using STATA to evaluate the clinical effectiveness. Program costs and relevant healthcare costs during the follow-up phase will be recorded for cost-effectiveness analysis.

CONCLUSION

This study will provide significant insights into conducting SNTF for Singapore community-living older adults with frailty and pre-frailty on clinical- and cost-effectiveness. Australia New Zealand Clinical Trials Registry: ACTRN12621001673831.

Occupational Therapy Interventions to Improve the Quality of Life of Older Adults with Dementia Living in Nursing Homes: A Systematic Review

The increase in older adults with dementia presents challenges in promoting research to improve the quality of life of this population. The objective of this study was to assess the scientific evidence on the effectiveness of occupational therapy interventions in improving the quality of life of older adults over 65 years old with dementia living in nursing homes. The databases used were PubMed, Web of Science, OTSeeker, clinicaltrials.gov, Dialnet, Scopus, Cochrane, and SciELO between 2013 and 2023. The studies were selected and evaluated according to the Cochrane guidelines. The review was carried out following the PRISMA 2020 Statement. Sixteen articles met the inclusion criteria and were categorized into four groups according to the focus of the intervention: "meaningful activities/occupations", "physical, cognitive and sensory functioning", "performance areas", and "physical and social environment and staff training". The strength of evidence was moderate, and the risk of bias was low. The findings revealed that occupational therapy interventions based on participation in recreational activities, reminiscence, performance-based activities and the physical and social environment, and specialized staff training, could improve the perceived quality of life of older adults with dementia living in nursing homes.

BC Clinical impact of medication reviews with follow-up in cardiovascular older patients in primary care: A cluster-randomized controlled trial

AIMS

Cardiovascular diseases (CVD) are the primary cause of death in Chile. Pharmacist-led medication review with follow-up (MRF) has improved CVD risk factors control in Europe and North America. However, their healthcare systems differ from Chile's, precluding generalizability. This trial aimed to determine the effect of MRF on CVD risk factor control among older patients with polypharmacy attending public primary care centres in Chile.

METHODS

A cluster-randomized controlled trial was conducted in 24 centres. Patients older than 65 years with moderate-to-high CVD risk, five or more medications, hypertension, type 2 diabetes or dyslipidaemia, received MRF in addition to usual care or usual care alone for 12 months. Primary outcome measures were clinical goal achievement for hypertension, type 2 diabetes and dyslipidaemia, as well as medication adherence, medication number and CVD risk score. Adjusted generalized estimating equations were used, with odds ratios (ORs) for binary measures and mean differences for continuous measures.

RESULTS

In total, 324 patients from 12 centres (174 MRF group, 150 usual care group, six centres each) received four pharmacist visits. Significant improvements were found for goal achievement in hypertension (OR 4.37, 95% confidence interval [CI] 2.54 to 7.51, P = .001), LDL cholesterol (OR 3.67, 95% CI 2.13 to 6.33, P = .001), type 2 diabetes (OR 6.97, 95% CI 3.69 to 13.2, P = .001), medication adherence (OR 6.60, 95% CI 1.36 to 31.9, P = .022), medications number (-0.86, 95% CI -1.14 to -0.58, P < .001) and CVD risk score (-2.27, 95% CI -2.84 to -1.69, P < .001).

CONCLUSION

Pharmacist-led medication review with follow-up improved cardiovascular disease risk factor control and medication adherence. This study supports pharmacists' inclusion in primary care teams.

Randomised controlled trials of occupational therapy interventions for adults with a mental health condition or dementia: A systematic review of study methods and outcome measurement

Introduction

High-quality randomised controlled trials (RCTs) of interventions are essential for determining whether an intervention is effective. However, many RCTs that examine the effectiveness of occupational therapy interventions for adults with mental health conditions or dementia have methodological limitations that reduce confidence in their results. We aimed to systematically review the quality of methods and outcome measures used in RCTs of occupational therapy interventions for adults with a mental health condition or dementia. This will inform future research in this area and enable practitioners to appraise the evidence when selecting interventions.

Method

We searched peer-reviewed English language publications from 2000 to 2021 in MEDLINE, PsycINFO, ASSIA, CINAHL and e-thos, and hand-searched 12 journals. We included papers that met pre-specified inclusion criteria, appraised quality using a validated tool and extracted data. We conducted a narrative synthesis.

Results

Of thirty-three included papers, 26 reported full or pilot RCTs, two reported secondary analysis or secondary outcomes of included RCTs, three reported process evaluations and two reported economic evaluations. Methodological limitations were found in many studies and outcome measures varied in their psychometric quality.

Conclusion

High-quality RCTs of occupational therapy interventions are needed for adults with mental health conditions and dementia. Researchers should follow international guidelines for rigorously developing and evaluating interventions and reporting studies. Practitioners should critically apply RCT evidence when selecting occupational therapy interventions.

Practice educators' emphasis on research in supervision of occupational therapy students

BACKGROUND

One approach to promote students' use of research in future practice involves integrating students' research use in supervision during practice placements. Studies examining this aspect of supervision in practice placements are lacking.

AIM

To explore how practice educators perceive and emphasise research in their supervision of occupational therapy students during practice placements.

MATERIALS AND METHODS

A qualitative study was conducted. A purposive sample was recruited, consisting of participants from community-based health services and hospitals in Norway. We conducted three focus groups and one individual interview with occupational therapists (n = 9). The qualitative data analysis was based on interpretive description.

RESULTS

We identified four themes: 'emphasis on research in supervision of students'; 'practice educators' research competence and awareness of research'; 'institutionalisation of research use in everyday practice'; and 'communication and cooperation between education and practice regarding research'. Despite highlighting several benefits of research use, the practice educators focused rarely on students' research use in practice placements. Conclusions and significance: Cooperation between practice educators and faculty members regarding students' training in research use seems essential. Practice educators may need additional training in how research should be emphasised in supervision.

Bayesian statistics in the design and analysis of cluster randomised controlled trials and their reporting quality: a methodological systematic review

BACKGROUND

In a cluster randomised controlled trial (CRCT), randomisation units are "clusters" such as schools or GP practices. This has methodological implications for study design and statistical analysis, since clustering often leads to correlation between observations which, if not accounted for, can lead to spurious conclusions of efficacy/effectiveness. Bayesian methodology offers a flexible, intuitive framework to deal with such issues, but its use within CRCT design and analysis appears limited. This review aims to explore and quantify the use of Bayesian methodology in the design and analysis of CRCTs, and appraise the quality of reporting against CONSORT guidelines.

METHODS

We sought to identify all reported/published CRCTs that incorporated Bayesian methodology and papers reporting development of new Bayesian methodology in this context, without restriction on publication date or location. We searched Medline and Embase and the Cochrane Central Register of Controlled Trials (CENTRAL). Reporting quality metrics according to the CONSORT extension for CRCTs were collected, as well as demographic data, type and nature of Bayesian methodology used, journal endorsement of CONSORT guidelines, and statistician involvement.

RESULTS

Twenty-seven publications were included, six from an additional hand search. Eleven (40.7%) were reports of CRCT results: seven (25.9%) were primary results papers and four (14.8%) reported secondary results. Thirteen papers (48.1%) reported Bayesian methodological developments, the remaining three (11.1%) compared different methods. Four (57.1%) of the primary results papers described the method of sample size calculation; none clearly accounted for clustering. Six (85.7%) clearly accounted for clustering in the analysis. All results papers reported use of Bayesian methods in the analysis but none in the design or sample size calculation.

CONCLUSIONS

The popularity of the CRCT design has increased rapidly in the last twenty years but this has not been mirrored by an uptake of Bayesian methodology in this context. Of studies using Bayesian methodology, there were some differences in reporting quality compared to CRCTs in general, but this study provided insufficient data to draw firm conclusions. There is an opportunity to further develop Bayesian methodology for the design and analysis of CRCTs in order to expand the accessibility, availability, and, ultimately, use of this approach.

Analysis and reporting of stratified cluster randomized trials-a systematic survey

Background

In order to correctly assess the effect of intervention from stratified cluster randomized trials (CRTs), it is necessary to adjust for both clustering and stratification, as failure to do so leads to misleading conclusions about the intervention effect. We have conducted a systematic survey to examine the current practices about analysis and reporting of stratified CRTs.

Method

We used the search terms to identify the stratified CRTs from MEDLINE since the inception to July 2019. In phase 1, we screened the title and abstract for English-only studies and selected, including the main results paper of the identified protocols, for the next phase. In phase 2, we screened the full text and selected studies for data abstraction. The data abstraction form was piloted and developed using the REDCap. We abstracted data on multiple design and methodological aspects of the study including whether the primary method adjusted for both clustering and stratification, reporting of sample size, randomization, and results.

Results

We screened 2686 studies in the phase 1 and selected 286 studies for phase 2—among them 185 studies were selected for data abstraction. Most of the selected studies were two-arm 140/185 (76%) and parallel-group 165/185 (89%) trials. Among these 185 studies, 27 (15%) of them did not provide any sample size or power calculation, while 105 (57%) studies did not mention any method used for randomization within each stratum. Further, 43 (23%) and 150 (81%) of 185 studies did not provide the definition of all the strata, while more than 60% of the studies did not include all the stratification variable(s) in the flow chart or baseline characteristics table. More than half 114/185 (62%) of the studies did not adjust the primary method for both clustering and stratification.

Conclusion

Stratification helps to achieve the balance among intervention groups. However, to correctly assess the intervention effect from stratified CRTs, it is important to adjust the primary analysis for both stratification and clustering. There are significant deficiencies in the reporting of methodological aspects of stratified CRTs, which require substantial improvements in several areas including definition of strata, inclusion of stratification variable(s) in the flow chart or baseline characteristics table, and reporting the stratum-specific number of clusters and individuals in the intervention groups.

Supplementary information

Supplementary information accompanies this paper at 10.1186/s13063-020-04850-w.

Frailty Intervention through Nutrition Education and Exercise (FINE). A Health Promotion Intervention to Prevent Frailty and Improve Frailty Status among Pre-Frail Elderly-A Study Protocol of a Cluster Randomized Controlled Trial

The ageing process has been associated with various geriatric issues including frailty. Without early prevention, frailty may cause multiple adverse outcomes. However, it potentially may be reversed with appropriate interventions. The aim of the study is to assess the effectiveness of nutritional education and exercise intervention to prevent frailty among the elderly. A 3-month, single-blind, two-armed, cluster randomized controlled trial of the frailty intervention program among Malaysian pre-frail elderly will be conducted. A minimum of total 60 eligible respondents from 8 clusters (flats) of Program Perumahan Rakyat (PPR) flats will be recruited and randomized to the intervention and control arm. The intervention group will receive a nutritional education and a low to moderate multi-component exercise program. To date, this is the first intervention study that specifically targets both the degree of frailty and an improvement in the outcomes of frailty using both nutritional education and exercise interventions among Malaysian pre-frail elderly. If the study is shown to be effective, there are major potential benefits to older population in terms of preventing transition to frailty. The findings from this trial will potentially provide valuable evidence and serve as a model for similar future interventions designed for elderly Malaysians in the community.

Methodological approaches to the design and analysis of nonrandomized intervention studies for the prevention of child and adolescent obesity

OBJECTIVES

Interventions for child obesity prevention are needed and it is unclear whether evidence from nonrandomized intervention studies is adequate. The objective of this research was to review the methods for the design, analysis and reporting of nonrandomized intervention studies for child obesity prevention and to assess potential for bias.

METHODS

We conducted a review of nonrandomized intervention studies, including population health interventions, quasi-experimental studies and natural experiments, published from 2013 to 2017 that were identified in a recent systematic review. Data on study design, intervention and control groups, outcome measures, and statistical analyses, were extracted. Risk of bias was evaluated using the Risk of Bias in Non-Randomized Studies of Interventions (ROBINS-I) tool.

RESULTS

All identified studies (n = 23) included a school or community-based intervention and had a concurrent control group. Participants were 3-18 years and sample sizes were 100 to > 1 million. Study designs were described inconsistently, and interventions ranged from 14 weeks to 5 years. Obesity was compared between control and intervention groups using logistic or linear regression, analysis of variance and mixed effects regression. Only 48% of studies accounted for clustering, and methods to control for confounding and repeated measures varied substantially. Overall risk of bias was moderate to serious for all studies.

CONCLUSION

There are substantial opportunities to improve the methods for nonrandomized intervention studies and reduce bias. Future studies should use advanced statistical and causal epidemiology methods, including better control for confounding and clustering, to generate higher quality evidence and certainty regarding which obesity prevention interventions are effective.

Issues with data and analyses: Errors, underlying themes, and potential solutions

Some aspects of science, taken at the broadest level, are universal in empirical research. These include collecting, analyzing, and reporting data. In each of these aspects, errors can and do occur. In this work, we first discuss the importance of focusing on statistical and data errors to continually improve the practice of science. We then describe underlying themes of the types of errors and postulate contributing factors. To do so, we describe a case series of relatively severe data and statistical errors coupled with surveys of some types of errors to better characterize the magnitude, frequency, and trends. Having examined these errors, we then discuss the consequences of specific errors or classes of errors. Finally, given the extracted themes, we discuss methodological, cultural, and system-level approaches to reducing the frequency of commonly observed errors. These approaches will plausibly contribute to the self-critical, self-correcting, ever-evolving practice of science, and ultimately to furthering knowledge.

An imbalance in cluster sizes does not lead to notable loss of power in cross-sectional, stepped-wedge cluster randomised trials with a continuous outcome

BACKGROUND

The current methodology for sample size calculations for stepped-wedge cluster randomised trials (SW-CRTs) is based on the assumption of equal cluster sizes. However, as is often the case in cluster randomised trials (CRTs), the clusters in SW-CRTs are likely to vary in size, which in other designs of CRT leads to a reduction in power. The effect of an imbalance in cluster size on the power of SW-CRTs has not previously been reported, nor what an appropriate adjustment to the sample size calculation should be to allow for any imbalance. We aimed to assess the impact of an imbalance in cluster size on the power of a cross-sectional SW-CRT and recommend a method for calculating the sample size of a SW-CRT when there is an imbalance in cluster size.

METHODS

The effect of varying degrees of imbalance in cluster size on the power of SW-CRTs was investigated using simulations. The sample size was calculated using both the standard method and two proposed adjusted design effects (DEs), based on those suggested for CRTs with unequal cluster sizes. The data were analysed using generalised estimating equations with an exchangeable correlation matrix and robust standard errors.

RESULTS

An imbalance in cluster size was not found to have a notable effect on the power of SW-CRTs. The two proposed adjusted DEs resulted in trials that were generally considerably over-powered.

CONCLUSIONS

We recommend that the standard method of sample size calculation for SW-CRTs be used, provided that the assumptions of the method hold. However, it would be beneficial to investigate, through simulation, what effect the maximum likely amount of inequality in cluster sizes would be on the power of the trial and whether any inflation of the sample size would be required.