1
|
Thibaut A, Beaudart C, Martens G, Bornheim S, Kaux JF. Common Bias and Challenges in Physical and Rehabilitation Medicine Research: How to Tackle Them. FRONTIERS IN REHABILITATION SCIENCES 2022; 3:873241. [PMID: 36189055 PMCID: PMC9397780 DOI: 10.3389/fresc.2022.873241] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 02/10/2022] [Accepted: 05/19/2022] [Indexed: 11/13/2022]
Abstract
The importance of evidence-based medicine is crucial, especially in physical and rehabilitation medicine (PRM), where there is a need to conduct rigorous experimental protocols, as in any medical field. Currently, in clinical practice, therapeutic approaches are often based on empirical data rather than evidence-based medicine. However, the field of PRM faces several challenges that may complicate scientific research. In addition, there is often a lack of appropriate research training in educational programs. In this context, we aim to review the methodological challenges in PRM and provide clear examples for each of them as well as potential solutions when possible. This article will cover the following themes: (1) Choosing the right study design and conducting randomized and benchmarking controlled trials; (2). Selecting the appropriate controlled, placebo or sham condition and the issue of blinding in non-pharmacological trials; (3) The impact of populations' heterogeneity and multi-comorbidities; (4). The challenge of recruitment and adherence; (5). The importance of homogeneity and proper quantification of rehabilitative strategies; and (6). Ethical issues. We are convinced that teaching the basics of scientific research in PRM could help physicians and therapists to choose a treatment based on (novel) scientific evidence. It may also promote scientific research in PRM to develop novel and personalized rehabilitation strategies using rigorous methodologies and randomized or benchmarking controlled trials in order to improve patients' management.
Collapse
Affiliation(s)
- Aurore Thibaut
- Coma Science Group, GIGA Consciousness, University of Liège, Liège, Belgium
- Center du Cerveau 2, University Hospital of Liège, Liège, Belgium
| | - Charlotte Beaudart
- Department of Rehabilitation and Sports Sciences, University of Liège, Liège, Belgium
- World Health Organization Collaborating Center for Public Health Aspects of Musculoskeletal Health and Aging, Department of Public Health, Epidemiology and Health Economics, University of Liège, Liège, Belgium
| | - Géraldine Martens
- Department of Rehabilitation and Sports Sciences, University of Liège, Liège, Belgium
- Réseau Francophone Olympique de la Recherche en Médecine du Sport (ReFORM) International Olympic Committee (IOC) Research Center for Prevention of Injury and Protection of Athlete Health, Liège, Belgium
| | - Stephen Bornheim
- Department of Rehabilitation and Sports Sciences, University of Liège, Liège, Belgium
- Department of Physical Medicine and Sports Traumatology, Sports, FIFA Medical Center of Excellence, FIMS Collaborative Center of Sports Medicine, University and University Hospital of Liège, Liège, Belgium
| | - Jean-François Kaux
- Department of Rehabilitation and Sports Sciences, University of Liège, Liège, Belgium
- Réseau Francophone Olympique de la Recherche en Médecine du Sport (ReFORM) International Olympic Committee (IOC) Research Center for Prevention of Injury and Protection of Athlete Health, Liège, Belgium
- Department of Physical Medicine and Sports Traumatology, Sports, FIFA Medical Center of Excellence, FIMS Collaborative Center of Sports Medicine, University and University Hospital of Liège, Liège, Belgium
| |
Collapse
|
2
|
Treatment Trials in Disorders of Consciousness: Challenges and Future Directions. Brain Sci 2022; 12:brainsci12050569. [PMID: 35624956 PMCID: PMC9139017 DOI: 10.3390/brainsci12050569] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Revised: 04/23/2022] [Accepted: 04/25/2022] [Indexed: 11/29/2022] Open
Abstract
The evidence base supporting treatment interventions for patients with disorders of consciousness is limited, and rigorous treatment trials are needed to guide future management of this complex patient population. There are many potential study designs that can be employed to develop this evidence, but the process of selecting the optimal study design is challenging. This article reviews common obstacles that impede research progress in this population and a range of study designs that may be employed. In addition, we consider how the particular practical and scientific obstacles may drive selection of the optimal design and, in particular, how the optimal design changes as treatment research proceeds along the translational continuum from mechanistic discovery to real-world clinical impact.
Collapse
|
3
|
Arienti C, Armijo-Olivo S, Minozzi S, Tjosvold L, Lazzarini SG, Patrini M, Negrini S. Methodological Issues in Rehabilitation Research: A Scoping Review. Arch Phys Med Rehabil 2021; 102:1614-1622.e14. [PMID: 33989598 DOI: 10.1016/j.apmr.2021.04.006] [Citation(s) in RCA: 26] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2020] [Revised: 03/22/2021] [Accepted: 04/22/2021] [Indexed: 01/11/2023]
Abstract
OBJECTIVE To identify, synthesize, and categorize the methodological issues faced by the rehabilitation field. DATA SOURCES A scoping review was conducted using studies identified in MEDLINE, the Cochrane Library, EMBASE, Web of Science, Scopus, Physiotherapy Evidence Database, and Google Scholar up to August 2018. STUDY SELECTION We included all type of publications describing methodological issues in rehabilitation research where rehabilitation is described as a multimodal process. The methodological issues have been categorized and classified. DATA EXTRACTION The synthesis included qualitative and quantitative analysis. To focus the attention on rehabilitation, we post hoc divided in "specific issues" (highly related to, even if not exclusive of, rehabilitation research) and "generic issues" (common in biomedical research). DATA SYNTHESIS Seventy-one publications were included: 68% were narrative reviews, 15% systematic reviews, 7% editorials, 4% meta-epidemiologic studies, and 5% others. Specific methodological issues include the following: problematic application of randomized controlled trials (32%), absent definition of core outcome sets (28%), poor interventions description (22%), weak methodological (conducting) and reporting quality (21%), scarce clinical practice applicability (14%), lack of blinding assessor (10%), inadequate randomization methods or inadequate allocation concealment (8%), and inadequate participants description and recruitment (8%). "Generic" issues included the following: data and statistical description (31%), authors' methodological training (7%), peer review process (6%, n=4), funding declaration (6%), ethical statement (3%), protocol registration (3%), and conflict of interest declaration (1%). CONCLUSIONS Methodological and reporting issues might influence the quality of the evidence produced in rehabilitation research. The next steps to move forward in the field of rehabilitation could be to evaluate the influence of all these issues on the validity of trial results through meta-epidemiologic studies and to develop specific checklists to provide guidance to authors to improve the reporting and conduct of trials in this field.
Collapse
Affiliation(s)
| | - Susan Armijo-Olivo
- University of Applied Sciences, Faculty of Business and Social Sciences, Osnabrück, Germany; Faculties of Rehabilitation Medicine and Medicine and Dentistry, University of Alberta, Edmonton, Alberta, Canada
| | - Silvia Minozzi
- Department of Epidemiology, Lazio Regional Health Service, Rome, Italy
| | - Lisa Tjosvold
- Institute of Health Economics, Edmonton, Alberta, Canada
| | | | | | - Stefano Negrini
- Department of Biomedical, Surgical, and Dental Sciences, University of Milan "La Statale", Milan, Italy; IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| |
Collapse
|
4
|
Training persons with early-stage Alzheimer’s disease how to use an electronic medication management device: development of an intervention protocol. BRAIN IMPAIR 2021. [DOI: 10.1017/brimp.2020.25] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
AbstractBackground/Objectives:Medication management is challenging for persons with Alzheimer’s disease (AD) and their caregivers. Electronic medication management devices (eMMDs) are specifically designed to support this task. However, theory-driven interventions for eMMD training with this population are rarely described. This study aimed to develop and assess the appropriateness of an intervention protocol to train persons with early-stage AD how to use an eMMD.Methods:Interviews with three categories of participants [persons with early-stage AD (n = 3), caregivers (n = 3), and clinicians (n = 3)] were conducted to understand medication management needs, perceived usefulness of an eMMD, and to explore training strategies. Subsequently, this knowledge was integrated in an intervention protocol which was validated with the three clinicians. A content analysis led to iterative modifications to maximize the acceptability and coherence of the intervention protocol in a homecare context.Results:The final intervention protocol specifies the expertise required to provide the training intervention and the target population, followed by an extensive presentation of eMMD features. Specific learning strategies tailored to the cognitive profile of persons with AD with step-by-step instructions for clinicians are included. Finally, it presents theoretical information on cognitive impairment in AD and how eMMDs can support them.Conclusions:This intervention protocol with its theoretical and pragmatic foundation is an important starting point to enable persons with early-stage AD to become active users of eMMDs. Next steps should evaluate the immediate and long-term impacts of its implementation on medication management in the daily lives of persons with AD and their caregivers.
Collapse
|
5
|
Protocol for a Randomized Controlled Trial of CI Therapy for Rehabilitation of Upper Extremity Motor Deficit: The Bringing Rehabilitation to American Veterans Everywhere Project. J Head Trauma Rehabil 2020; 34:268-279. [PMID: 30608308 DOI: 10.1097/htr.0000000000000460] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
Constraint-induced movement therapy (CI therapy) has been shown to reduce disability for individuals with upper extremity (UE) hemiparesis following different neurologic injuries. This article describes the study design and methodological considerations of the Bringing Rehabilitation to American Veterans Everywhere (BRAVE) Project, a randomized controlled trial of CI therapy to improve the motor deficit of participants with chronic and subacute traumatic brain injury. Our CI therapy protocol comprises 4 major components: (1) intensive training of the more-affected UE for target of 3 hour/day for 10 consecutive weekdays, (2) a behavioral technique termed shaping during training, (3) a "transfer package," 0.5 hour/day, of behavioral techniques to transfer therapeutic gains from the treatment setting to the life situation, and (4) prolonged restraint of use of the UE not being trained. The primary endpoint is posttreatment change on the Motor Activity Log, which assesses the use of the more-affected arm outside the laboratory in everyday life situations. Data from a number of secondary outcome measures are also being collected and can be categorized as physical, genomic, biologic, fitness, cognitive/behavioral, quality of life, and neuroimaging measures.
Collapse
|
6
|
Wendebourg MJ, Heesen C, Finlayson M, Meyer B, Pöttgen J, Köpke S. Patient education for people with multiple sclerosis-associated fatigue: A systematic review. PLoS One 2017; 12:e0173025. [PMID: 28267811 PMCID: PMC5340368 DOI: 10.1371/journal.pone.0173025] [Citation(s) in RCA: 36] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2016] [Accepted: 02/14/2017] [Indexed: 12/31/2022] Open
Abstract
Background Multiple Sclerosis (MS) is an inflammatory and neurodegenerative disease often causing decreased quality of life, social withdrawal and unemployment. Studies examining the effect of pharmacological interventions demonstrated only minor effects, whereas non-pharmacological interventions as e.g. patient education programs have shown promising results. Objective We aim to systematically review the literature to determine the effect of patient education programs on fatigue in MS. Methods We conducted a comprehensive search in PubMed for randomized controlled trials (RCTs) that evaluated patient education programs for MS-related fatigue. Interventions evaluating physical exercise and/or pharmacological treatments were not included. Meta-analyses were performed using the generic inverse variance method. Results The search identified 856 citations. After full-text screening we identified ten trials that met the inclusion criteria. Data of 1021 participants were analyzed. Meta-analyses showed significant positive effects on fatigue severity (weighted mean difference -0.43; 95% CI -0.74 to -0.11) and fatigue impact (-0.48; -0.82 to -0.15), but not for depression (-0.35 (95% CI -0.75 to 0.05; p = 0.08). Essentially, we categorized patient education programs into two types: firstly, interventions with a focus on cognitive-behavioral therapy (CBT) and secondly, interventions that teach patients ways of managing daily fatigue. CBT-based approaches seem to generate better results in reducing patient-reported fatigue severity. Analysing CBT studies only, the pooled weighted mean difference for fatigue severity was -0.60 (95% CI; -1.08 to -0.11) compared to non-CBT approaches (-0.20; 95% CI; -0.60 to -0.19). Furthermore, interventions employing an individual approach seem to reduce fatigue more effectively than group-based approaches (pooled weighted mean difference for fatigue severity in face-to-face studies was -0.80 (95% CI; -1.13 to -0.47) compared to group-based studies with -0,17 (95% CI; -0,39 to 0,05). Longest follow-up data were available for 12 months post-intervention. Conclusion Overall, included studies demonstrated that educational programs and especially CBT-based approaches have a positive effect on reducing fatigue. Since fatigue is thought to be a multidimensional symptom, it should be treated with a multidimensional approach targeting patients’ behavior as well as their emotional and mental attitude towards fatigue. However, the clinical relevance of the treatment effects i.e. the relevance for patients’ daily functioning remains unclear and long-term effects, i.e. sustainability of effects beyond 6 months, warrants further work. This review has been registered in the PROSPERO international prospective register of systematic reviews data base (Registration number: CRD42014014224).
Collapse
Affiliation(s)
- Maria Janina Wendebourg
- Institute of Neuroimmunology and Department of Neurology, University Medical Center, Hamburg-Eppendorf, Hamburg, Germany
- * E-mail:
| | - Christoph Heesen
- Institute of Neuroimmunology and Department of Neurology, University Medical Center, Hamburg-Eppendorf, Hamburg, Germany
| | - Marcia Finlayson
- School of Rehabilitation Therapy, Queen’s University, Kingston, Ontario, Canada
| | | | - Jana Pöttgen
- Institute of Neuroimmunology and Department of Neurology, University Medical Center, Hamburg-Eppendorf, Hamburg, Germany
| | - Sascha Köpke
- Nursing Research Unit, Institute of Social Medicine and Epidemiology, University of Lübeck, Lübeck, Germany
| |
Collapse
|
7
|
Evidence for Occupational Therapy Interventions: Effectiveness Research Indexed in the OTseeker Database. Br J Occup Ther 2016. [DOI: 10.1177/030802260707001003] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Abstract
The aim of this study was to determine the overall quantity and quality of randomised controlled trials and the quantity of systematic reviews relevant to occupational therapy practice. The content of OTseeker ( www.otseeker.com ) was surveyed in June 2006. There were 3401 randomised controlled trials and 939 systematic reviews in OTseeker (total = 4340), published mostly in non-occupational therapy journals. The diagnostic areas of stroke (n = 458) and back or neck conditions/injuries (n = 391), and the intervention categories of exercise (n = 1262) and consumer education (n = 1098), were the most frequently listed. Although the quantity of evidence available about the effectiveness of occupational therapy interventions is rapidly increasing, some areas require greater research effort. Occupational therapists also need to search more broadly than occupational therapy journals for research to support clinical decision making.
Collapse
|
8
|
Lettinga AT, van Twillert S, Poels BJJ, Postema K. Distinguishing theories of dysfunction, treatment and care. Reflections on ‘Describing rehabilitation interventions’. Clin Rehabil 2016; 20:369-74. [PMID: 16774087 DOI: 10.1191/0269215506cr963xx] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Background: An editorial by Wade (Clinical Rehabilitation 2005; 19: 811-18. suggested a method for describing rehabilitation interventions. Objective: To review the editorial critically, and to suggest a more complete theory. Editorial: The editorial develops a model identifying factors that should be considered when analysing a complex rehabilitation problem, and provides a high-level description of the rehabilitation process. It explicitly does not address theories of behaviour change. New ideas: Three additional theoretical models are needed. The first considers the mechanisms that link the factors identified in Wade's model. For example how does self-esteem (in personal context) actually influence activity performance? This is a theory of dysfunction. The second needs to discuss how treatments alter their target. For example how does cognitive behavioural therapy alter pain perception and/or alter activity performance? This is a theory of treatment. It may be related to the theory of dysfunction. The third, which is less certain, needs to consider the process of giving support (maintaining the status quo). For example, how should one offer continuing opportunities for meaningful social role performance to someone with major cognitive losses? This is a theory of care. Conclusion: The two models that Wade integrated in his conceptual framework (the World Health Organization's International Classification of Functioning (WHO ICF) and the rehabilitation process) should primarily be considered as descriptive in character. Theories are still needed to understand how activity limitation arises and how treatments alter activity limitation, and possibly how a patient is supported to maintain a certain level of activity.
Collapse
Affiliation(s)
- Ant T Lettinga
- Center for Rehabilitation, University Medical Center, Groningen, University of Groningen, P.O. Box 30 002, 9750 RA Haren, The Netherlands.
| | | | | | | |
Collapse
|
9
|
Daniel L, Howard W, Braun D, Page SJ. Opinions of Constraint-Induced Movement Therapy Among Therapists in Southwestern Ohio. Top Stroke Rehabil 2015; 19:268-75. [DOI: 10.1310/tsr1903-268] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
10
|
Meta-analysis of three different types of fatigue management interventions for people with multiple sclerosis: exercise, education, and medication. Mult Scler Int 2014; 2014:798285. [PMID: 24963407 PMCID: PMC4052049 DOI: 10.1155/2014/798285] [Citation(s) in RCA: 93] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2014] [Revised: 03/28/2014] [Accepted: 03/31/2014] [Indexed: 01/17/2023] Open
Abstract
Fatigue is a common symptom of multiple sclerosis (MS) with negative impacts extending from general functioning to quality of life. Both the cause and consequences of MS fatigue are considered multidimensional and necessitate multidisciplinary treatment for successful symptom management. Clinical practice guidelines suggest medication and rehabilitation for managing fatigue. This review summarized available research literature about three types of fatigue management interventions (exercise, education, and medication) to provide comprehensive perspective on treatment options and facilitate a comparison of their effectiveness. We researched PubMed, Embase, and CINAHL (August 2013). Search terms included multiple sclerosis, fatigue, energy conservation, Amantadine, Modafinil, and randomized controlled trial. The search identified 230 citations. After the full-text review, 18 rehabilitation and 7 pharmacological trials targeting fatigue were selected. Rehabilitation interventions appeared to have stronger and more significant effects on reducing the impact or severity of patient-reported fatigue compared to medication. Pharmacological agents, including fatigue medication, are important but often do not enable people with MS to cope with their existing disabilities. MS fatigue affects various components of one's health and wellbeing. People with MS experiencing fatigue and their healthcare providers should consider a full spectrum of effective fatigue management interventions, from exercise to educational strategies in conjunction with medication.
Collapse
|
11
|
Abstract
Attaining and demonstrating treatment fidelity is critical in the development and testing of evidence-based interventions. Treatment fidelity refers to the extent to which an intervention was implemented in clinical testing as it was conceptualized and is clearly differentiable from control or standard-of-care interventions. In clinical research, treatment fidelity is typically attained through intensive training and supervision techniques and demonstrated by measuring therapist adherence and competence to the protocol using external raters. However, in occupational and physical therapy outcomes research, treatment fidelity methods have not been used, which, in our view, is a serious gap that impedes novel treatment development and testing in these rehabilitation fields. In this article, we describe the development of methods to train and supervise therapists to attain adequate treatment fidelity in a treatment development project involving a novel occupational and physical therapy-based intervention. We also present a data-driven model for demonstrating therapist adherence and competence in the new treatment and its differentiation from standard of care. In doing so, we provide an approach that rehabilitation researchers can use to address treatment fidelity in occupational and physical therapy-based interventions. We recommend that all treatment researchers in rehabilitation disciplines use these or similar methods as a vital step in the development and testing of evidence-based rehabilitation interventions.
Collapse
|
12
|
Lenker JA, Fuhrer MJ, Jutai JW, Demers L, Scherer MJ, DeRuyter F. Treatment theory, intervention specification, and treatment fidelity in assistive technology outcomes research. Assist Technol 2010; 22:129-38; quiz 139-40. [PMID: 20939422 DOI: 10.1080/10400430903519910] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022] Open
Abstract
Recent reports in the rehabilitation literature have suggested that treatment theory, intervention specification, and treatment fidelity have important implications for the design, results, and interpretation of outcomes research. At the same time, there has been relatively little discussion of how these concepts bear on the quality of assistive technology (AT) outcomes research. This article describes treatment theory, intervention specification, and treatment fidelity as interconnected facets of AT outcome studies that fundamentally affect the interpretation of their findings. The discussion of each is elucidated using case examples drawn from the AT outcomes research literature. Recommendations are offered for strengthening these components of AT outcomes research.
Collapse
Affiliation(s)
- James A Lenker
- Department of Rehabilitation Science, School of Public Health and Health Professions, University at Buffalo, Buffalo, New York 14214-3079, USA.
| | | | | | | | | | | |
Collapse
|
13
|
Abstract
This perspective article provides an example of a study planned using guidelines for comprehensive rehabilitation outcomes research, an approach that is believed to give service providers meaningful evidence to support practice. This line of investigation has been guided by the World Health Organization's International Classification of Functioning, Disability and Health. The short title of a study under way is Move & PLAY (Movement and Participation in Life Activities of Young Children). The article briefly describes the conceptual model, provides guidelines on how indicators and measures are selected, alludes to the details of selected measures, and describes processes of preparing for data collection, including obtaining ethics approval, preparing data collection booklets, training assessors and interviewers, and sampling. The aim of this investigation is to gain a better understanding of the multiple child, family, and service factors associated with changes in mobility, self-care, and play of preschool children with cerebral palsy as a result of using this research method. Comprehensive rehabilitation outcomes research holds promise in providing evidence that supports the complexities of planning rehabilitation services with clients with chronic conditions, such as children with cerebral palsy.
Collapse
|
14
|
Research in rehabilitation medicine: Methodological challenges. J Clin Epidemiol 2010; 63:699-704. [DOI: 10.1016/j.jclinepi.2009.07.010] [Citation(s) in RCA: 55] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2008] [Revised: 06/03/2009] [Accepted: 07/15/2009] [Indexed: 01/08/2023]
|
15
|
Sandborgh M, Lindberg P, Åsenlöf P, Denison E. Implementing behavioural medicine in physiotherapy treatment. Part I: Clinical trial. ACTA ACUST UNITED AC 2010. [DOI: 10.3109/14038190903480664] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
|
16
|
Sandborgh M, Åsenlöf P, Lindberg P, Denison E. Implementing behavioural medicine in physiotherapy treatment. Part II: Adherence to treatment protocol. ACTA ACUST UNITED AC 2010. [DOI: 10.3109/14038190903480672] [Citation(s) in RCA: 13] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
|
17
|
|
18
|
Zettler LL, Speechley MR, Foley NC, Salter KL, Teasell RW. A scale for distinguishing efficacy from effectiveness was adapted and applied to stroke rehabilitation studies. J Clin Epidemiol 2009; 63:11-8. [PMID: 19740623 DOI: 10.1016/j.jclinepi.2009.06.007] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2009] [Revised: 06/18/2009] [Accepted: 06/27/2009] [Indexed: 01/21/2023]
Abstract
OBJECTIVES To apply a tool that purports to differentiate between efficacy and effectiveness studies to stroke rehabilitation trials and to evaluate its applicability and reliability. STUDY DESIGN AND SETTING Three raters developed item operational definitions before independently applying the seven-item scale to 151 randomized controlled trials (RCT), published during or after 1997, that evaluated either a pharmacologic (P, n=78) or a nonpharmacologic (NP, n=73) intervention. Inter-rater reliability was assessed for both individual items and total scores, separately for P and NP trials. RESULTS Item inter-rater reliability (multiple-rater kappa) ranged from 0.00 (95% CI [confidence interval]: -0.13, 0.13) to 0.85 (95% CI: 0.73, 0.98) and from 0.21 (95% CI: 0.08, 0.34) to 0.79 (95% CI: 0.66, 0.92) for P and NP RCTs, respectively. For the total score (dichotomized), kappa values were 0.43 (95% CI: 0.31, 0.56) and 0.51 (95% CI: 0.37, 0.64) for P and NP trials, respectively. CONCLUSIONS The tool provides a solid foundation on which to base further discussion of the differential criteria of efficacy-effectiveness trial design. Scale items should be properly operationalized depending on the research question of interest and evaluated for reliability before the scale is used for definitively judging a given study's design or the external validity of its results.
Collapse
Affiliation(s)
- Laura L Zettler
- Department of Epidemiology and Biostatistics, Schulich School of Medicine and Dentistry, The University of Western Ontario, London, Ontario, Canada.
| | | | | | | | | |
Collapse
|
19
|
Siemonsma PC, Schröder CD, Dekker JHM, Lettinga AT. The benefits of theory for clinical practice: Cognitive treatment for chronic low back pain patients as an illustrative example. Disabil Rehabil 2009; 30:1309-17. [DOI: 10.1080/09638280701610254] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
20
|
Bartlett DJ, Macnab J, Macarthur C, Mandich A, Magill-Evans J, Young NL, Beal D, Conti-Becker A, Polatajko HJ. Advancing rehabilitation research: An interactionist perspective to guide question and design. Disabil Rehabil 2009; 28:1169-76. [PMID: 17005478 DOI: 10.1080/09638280600551567] [Citation(s) in RCA: 31] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
The purpose of this position statement is to propose an interactionist framework to bring together the existing literature and provide a unifying direction for rehabilitation research. The framework comprises three components: the conceptual model, the research question, and the research design. The interactionist conceptual model has been adapted from the World Health Organization International Classification of Functioning, Disability, and Health. The model forms the starting point that guides the specification of the research question, which, in turn, guides the selection of research design. This approach demands that the question takes precedence and that there be an extensive repertoire of research designs, each of which is valued for its 'goodness-of-fit' with the question, rather than an a priori, single hierarchical ordering of designs. Research designs must be appropriate for questions that examine the disability experience, development over the lifespan, multifaceted interventions, low incidence conditions, and development of new interventions. Analytical challenges include dealing with confounding, mediating, and moderating variables. Rehabilitation researchers--and those who fund their work--should consider and value the use of diverse research methods to best answer the questions posed from the interactionist perspective.
Collapse
Affiliation(s)
- Doreen J Bartlett
- School of Physical Therapy, Faculty of Health Sciences, The University of Western Ontario, London, Ontario, Canada.
| | | | | | | | | | | | | | | | | |
Collapse
|
21
|
Morris DM, Taub E, Macrina DM, Cook EW, Geiger BF. A Method for Standardizing Procedures in Rehabilitation: Use in the Extremity Constraint Induced Therapy Evaluation Multisite Randomized Controlled Trial. Arch Phys Med Rehabil 2009; 90:663-8. [DOI: 10.1016/j.apmr.2008.09.576] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2008] [Accepted: 09/04/2008] [Indexed: 10/20/2022]
|
22
|
Fuhrer MJ. Assessing the efficacy, effectiveness, and cost-effectiveness of assistive technology interventions for enhancing mobility. Disabil Rehabil Assist Technol 2009; 2:149-58. [PMID: 19266634 DOI: 10.1080/17483100701374355] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Abstract
PURPOSE The aim of this paper is to highlight the contributions that complementary efficacy, effectiveness, and cost-effectiveness studies can make to assessing the outcomes of assistive technology interventions for enhancing mobility. METHOD The terms, 'assistive technology outcomes research' and 'assistive technology interventions', are defined. Several bases are examined for the shortage of outcomes research pertaining to mobility-related assistive technology interventions. Three presuppositions are described for the research strategy of interlocking studies being recommended. They are assigning priority to evaluating both recently developed assistive technologies and ones that have long been available, acknowledging the complexity of assistive technology as an intervention, and appreciating the trade-offs necessary for strengthening studies' internal and external validity. Some key study preparations are considered, including treatment theory, treatment specification, and the selection of outcome domains and measures. The essential features of efficacy, effectiveness, and cost-effectiveness studies are outlined, and their interdependence is stressed. RESULTS AND CONCLUSIONS To assess the outcomes of assistive technology interventions for mobility in ways that are both methodologically sound and relevant to stakeholder needs, a research strategy is required involving mutually reinforcing efficacy, effectiveness, and cost-effectiveness studies. Collaborative arrangements and funding methods are discussed for fostering the needed research.
Collapse
Affiliation(s)
- Marcus J Fuhrer
- National Center for Medical Rehabilitation Research, National Institute of Child Health and Human Development, National Institutes of Health, Bethesda, MD, USA.
| |
Collapse
|
23
|
Multisite Trial on Efficacy of Constraint-Induced Movement Therapy in Children with Hemiplegia. Am J Phys Med Rehabil 2009; 88:216-30. [DOI: 10.1097/phm.0b013e3181951382] [Citation(s) in RCA: 14] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
24
|
Tucker JA, Reed GM. Evidentiary Pluralism as a Strategy for Research and Evidence-Based Practice in Rehabilitation Psychology. Rehabil Psychol 2008; 53:279-293. [PMID: 19649150 PMCID: PMC2610668 DOI: 10.1037/a0012963] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
This paper examines the utility of evidentiary pluralism, a research strategy that selects methods in service of content questions, in the context of rehabilitation psychology. Hierarchical views that favor randomized controlled clinical trials (RCTs) over other evidence are discussed, and RCTs are considered as they intersect with issues in the field. RCTs are vital for establishing treatment efficacy, but whether they are uniformly the best evidence to inform practice is critically evaluated. We argue that because treatment is only one of several variables that influence functioning, disability, and participation over time, an expanded set of conceptual and data analytic approaches should be selected in an informed way to support an expanded research agenda that investigates therapeutic and extra-therapeutic influences on rehabilitation processes and outcomes. The benefits of evidentiary pluralism are considered, including helping close the gap between the narrower clinical rehabilitation model and a public health disability model. KEY WORDS: evidence-based practice, evidentiary pluralism, rehabilitation psychology, randomized controlled trials.
Collapse
Affiliation(s)
- Jalie A Tucker
- University of Alabama at Birmingham, School of Public Health Birmingham, Alabama, U.S.A
| | | |
Collapse
|
25
|
Dunn DS, Elliott TR. The Place and Promise of Theory in Rehabilitation Psychology. Rehabil Psychol 2008; 53:254-267. [PMID: 19649146 PMCID: PMC2600846 DOI: 10.1037/a0012962] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
OBJECTIVE: Although rehabilitation psychology is more focused on empirical evidence and clinical application than theory development, we argue for the primacy of theory, and explain why theories are needed in and useful for rehabilitation psychology. Impediments to theory development are discussed, including the difficulties of applying psychological theories in multidisciplinary enterprises, and the difficulties in developing a theory-driven research program. We offer suggestions by reviewing research settings, knowledge gained through controlled studies, grantsmanship, and then identify topical areas where new theories are needed. We remind researcher-practitioners that rehabilitation psychology benefits from a judicious mix of scientific rigor and real-world vigor. CONCLUSIONS: We close by advocating for theory-driven research programs that embrace a methodological pluralism, which will in turn advance new theory, produce meaningful research programs that inform practice, and realize the goals of this special issue of Rehabilitation Psychology-advances in research and methodology.
Collapse
|
26
|
Dyson-Hudson TA, Kadar P, LaFountaine M, Emmons R, Kirshblum SC, Tulsky D, Komaroff E. Acupuncture for Chronic Shoulder Pain in Persons With Spinal Cord Injury: A Small-Scale Clinical Trial. Arch Phys Med Rehabil 2007; 88:1276-83. [PMID: 17908569 DOI: 10.1016/j.apmr.2007.06.014] [Citation(s) in RCA: 50] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2007] [Indexed: 11/21/2022]
Abstract
OBJECTIVE To determine the efficacy of acupuncture in the treatment of chronic musculoskeletal shoulder pain in subjects with spinal cord injury (SCI). DESIGN Randomized, double blind (participants, evaluator), placebo (invasive sham) controlled trial. SETTING Clinical research center. PARTICIPANTS Seventeen manual wheelchair-using subjects with chronic SCI and chronic musculoskeletal shoulder pain. INTERVENTIONS Participants were randomly assigned to receive 10 treatments of either acupuncture or invasive sham acupuncture (light needling of nonacupuncture points). MAIN OUTCOME MEASURE Changes in shoulder pain intensity were measured using the Wheelchair User's Shoulder Pain Index. RESULTS Shoulder pain decreased significantly over time in both the acupuncture and the sham acupuncture groups (P=.005), with decreases of 66% and 43%, respectively. There was no significant difference between the 2 groups (P=.364). There was, however, a medium effect size associated with the acupuncture treatment. CONCLUSIONS There appears to be an analgesic effect or a powerful placebo effect associated with both acupuncture and sham acupuncture. There was a medium treatment effect associated with the acupuncture, which suggests that it may be superior to sham acupuncture. This observation, along with the limited power, indicates that a larger, more definitive randomized controlled trial using a similar design is warranted.
Collapse
Affiliation(s)
- Trevor A Dyson-Hudson
- Kessler Medical Rehabilitation Research and Education Center, West Orange, NJ 07052, USA.
| | | | | | | | | | | | | |
Collapse
|
27
|
Wolf SL, Winstein CJ, Miller JP, Blanton S, Clark PC, Nichols-Larsen D. Looking in the Rear View Mirror When Conversing With Back Seat Drivers: The EXCITE Trial Revisited. Neurorehabil Neural Repair 2007; 21:379-87. [PMID: 17644651 DOI: 10.1177/1545968307306238] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
The initial Point of View: Directions for Research ( Neurorehabilitation and Neural Repair, 2007;21:3-13) identified confounders that might limit the impact that rehabilitation multicenter clinical trials may have upon altering practice patterns. Part of that viewpoint addressed the Extremity Constraint Induced Therapy Evaluation (EXCITE) Trial and highlighted some of its perceived strengths and limitations. The present Point of View expands upon factors worthy of consideration in planning and executing clinical trials in neurorehabilitation based upon experiences encountered by the EXCITE team. Cost factors and patient attributes, both of which profoundly influence the ability of clinical researchers to execute the ideal study, are among these factors. In particular, the costs associated with large trials necessitate compromise in study design or implementation, resulting in a dichotomy between what should be undertaken and what can be accomplished.
Collapse
Affiliation(s)
- Steven L Wolf
- Emory Center for Rehabilitation Medicine, Department of Rehabilitation and Medicine, Emory University School of Medicine, Nell Hodgson Woodruff School of Nursing at Emory University, Atlanta, GA 30322, USA.
| | | | | | | | | | | |
Collapse
|
28
|
Abstract
Most patients who survive a stroke experience some degree of physical recovery. Selecting the appropriate outcome measure to assess physical recovery is a difficult task, given the heterogeneity of stroke etiology, symptoms, severity, and even recovery itself. Despite these complexities, a number of strategies can facilitate the selection of functional outcome measures in stroke clinical trial research and practice. Clinical relevance in stroke outcome measures can be optimized by incorporating a framework of health and disability, such as the International Classification of Functioning, Disability, and Health (ICF). The ICF provides the conceptual basis for measurement and policy formulations for disability and health assessment. All outcome measures selected should also have sound psychometric properties. The essential psychometric properties are reliability, validity, responsiveness, sensibility, and established minimal clinically important difference. It is also important to establish the purpose of the measurement (discriminative, predictive, or evaluative) and to determine whether the purpose of the study is to evaluate the efficacy or effectiveness of an intervention. In addition, when selecting outcome measures and time of assessment, the natural history of stroke and stroke severity must be regarded. Finally, methods for acquiring data must also be considered. We present a comprehensive overview of the issues in selecting stroke outcome measures and characterize existing measures relative to these issues.
Collapse
Affiliation(s)
- Sharon Barak
- Department of Physical Therapy, College of Public Health and Health Professions, University of Florida, Gainesville, FL, USA.
| | | |
Collapse
|
29
|
Smeets RJEM, Vlaeyen JWS, Hidding A, Kester ADM, van der Heijden GJMG, van Geel ACM, Knottnerus JA. Active rehabilitation for chronic low back pain: cognitive-behavioral, physical, or both? First direct post-treatment results from a randomized controlled trial [ISRCTN22714229]. BMC Musculoskelet Disord 2006; 7:5. [PMID: 16426449 PMCID: PMC1382224 DOI: 10.1186/1471-2474-7-5] [Citation(s) in RCA: 145] [Impact Index Per Article: 8.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/08/2005] [Accepted: 01/20/2006] [Indexed: 11/26/2022] Open
Abstract
BACKGROUND The treatment of non-specific chronic low back pain is often based on three different models regarding the development and maintenance of pain and especially functional limitations: the deconditioning model, the cognitive behavioral model and the biopsychosocial model. There is evidence that rehabilitation of patients with chronic low back pain is more effective than no treatment, but information is lacking about the differential effectiveness of different kinds of rehabilitation. A direct comparison of a physical, a cognitive-behavioral treatment and a combination of both has never been carried out so far. METHODS The effectiveness of active physical, cognitive-behavioral and combined treatment for chronic non-specific low back pain compared with a waiting list control group was determined by performing a randomized controlled trial in three rehabilitation centers. Two hundred and twenty three patients were randomized, using concealed block randomization to one of the following treatments, which they attended three times a week for 10 weeks: Active Physical Treatment (APT), Cognitive-Behavioral Treatment (CBT), Combined Treatment of APT and CBT (CT), or Waiting List (WL). The outcome variables were self-reported functional limitations, patient's main complaints, pain, mood, self-rated treatment effectiveness, treatment satisfaction and physical performance including walking, standing up, reaching forward, stair climbing and lifting. Assessments were carried out by blinded research assistants at baseline and immediately post-treatment. The data were analyzed using the intention-to-treat principle. RESULTS For 212 patients, data were available for analysis. After treatment, significant reductions were observed in functional limitations, patient's main complaints and pain intensity for all three active treatments compared to the WL. Also, the self-rated treatment effectiveness and satisfaction appeared to be higher in the three active treatments. Several physical performance tasks improved in APT and CT but not in CBT. No clinically relevant differences were found between the CT and APT, or between CT and CBT. CONCLUSION All three active treatments were effective in comparison to no treatment, but no clinically relevant differences between the combined and the single component treatments were found.
Collapse
Affiliation(s)
- Rob JEM Smeets
- Rehabilitation Centre Blixembosch, Eindhoven, and Netherlands School of Primary Care Research, University of Maastricht, The Netherlands
| | - Johan WS Vlaeyen
- Department of Medical, Clinical and Experimental Psychology, University of Maastricht, The Netherlands
| | - Alita Hidding
- Department of Education & Research, Atrium Medical Centre, Heerlen, The Netherlands
| | - Arnold DM Kester
- Department of Methodology and Statistics, University of Maastricht, The Netherlands
| | - Geert JMG van der Heijden
- Julius Centre for Health Sciences and Primary Care, University Medical Centre Utrecht, The Netherlands
| | - Antonia CM van Geel
- Rehabilitation Centre Blixembosch, Eindhoven, and Netherlands School of Primary Care Research, University of Maastricht, The Netherlands
| | - J André Knottnerus
- Netherlands School of Primary Care Research, University of Maastricht, The Netherlands
| |
Collapse
|
30
|
Li LC, Davis AM, Lineker SC, Coyte PC, Bombardier C. Effectiveness of the primary therapist model for rheumatoid arthritis rehabilitation: A randomized controlled trial. ACTA ACUST UNITED AC 2006; 55:42-52. [PMID: 16463410 DOI: 10.1002/art.21692] [Citation(s) in RCA: 24] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
OBJECTIVE To compare the primary therapist model (PTM), provided by a single rheumatology-trained primary therapist, with the traditional treatment model (TTM), provided by a physical therapy (PT) and/or occupational therapy (OT) generalist, for treating patients with rheumatoid arthritis (RA). METHODS Eligible patients were adults requiring rehabilitation treatment who had not received PT/OT in the past 2 years. Participants were randomized to the PTM or TTM group. The primary outcome was defined as the proportion of clinical responders who experienced a > or =20% improvement in 2 of the following measures from baseline to 6 months: Health Assessment Questionnaire, pain visual analog scale, and Arthritis Community Research and Evaluation Unit RA Knowledge Questionnaire. RESULTS Of 144 consenting patients, 33 (10 PTM participants, 23 TTM participants) dropped out without completing any followup assessment, leaving 111 for analysis (63 PTM participants, 48 TTM participants). The majority were women (PTM 87.3%, TTM 79.2%), with a mean age of 54.2 years and 56.8 years for the PTM and TTM groups, respectively. Average disease duration was 10.6 years and 13.2 years for each group, respectively. At 6 months, 44.4% of patients in the PTM group were clinical responders versus 18.8% in the TTM group (chi(2) = 8.09, P = 0.004). CONCLUSION Compared with the TTM, the PTM was associated with better outcomes in patients with RA. The results, however, should be interpreted with caution due to the high dropout rate in the TTM group.
Collapse
Affiliation(s)
- Linda C Li
- Ottawa Health Research Institute, Clinical Epidemiology Program, 1053 Carling Avenue, Administration Building Rm. #2-014, Ottawa, Ontario K1Y 4E9, Canada.
| | | | | | | | | |
Collapse
|
31
|
Abstract
This article examines the distinctive opportunities and challenges of multiple-site clinical trials, as distinguished from trials conducted by a single program. Among the topics discussed are: the role of clinical trials generally in medical rehabilitation research; definitions of "clinical trials" and "multiple site"; the distinction between exploratory and capstone trials; the potential advantages and disadvantages of multiple-site trials; planning issues in terms of sampling designs, the choice of outcome measures, approaches to dealing with intervention fidelity, organizational structures, authorship, and the conduct of collateral studies; and implementation issues in terms of pilot-testing procedures, handling emerging issues, and optimizing communication.
Collapse
Affiliation(s)
- Marcus J Fuhrer
- National Institute of Child Health and Human Development, National Institutes of Health, Bethesda, MD 21046, USA
| |
Collapse
|
32
|
Ragnarsson KT, Wuermser LA, Cardenas DD, Marino RJ. Spinal Cord Injury Clinical Trials for Neurologic Restoration: Improving Care Through Clinical Research. Am J Phys Med Rehabil 2005; 84:S77-97; quiz S98-100. [PMID: 16251838 DOI: 10.1097/01.phm.0000179522.82483.f0] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
33
|
Hursey KG, Rains JC, Penzien DB, Nash JM, Nicholson RA. Behavioral headache research: methodologic considerations and research design alternatives. Headache 2005; 45:466-78. [PMID: 15953263 DOI: 10.1111/j.1526-4610.2005.05098.x] [Citation(s) in RCA: 14] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
Behavioral headache treatments have garnered solid empirical support in recent years, but there is substantial opportunity to strengthen the next generation of studies with improved methods and consistency across studies. Recently, Guidelines for Trials of Behavioral Treatments for Recurrent Headache were published to facilitate the production of high-quality research. The present article compliments the guidelines with a discussion of methodologic and research design considerations. Since there is no research design that is applicable in every situation, selecting an appropriate research design is fundamental to producing meaningful results. Investigators in behavioral headache and other areas of research consider the developmental phase of the research, the principle objectives of the project, and the sources of error or alternative interpretations in selecting a design. Phases of clinical trials typically include pilot studies, efficacy studies, and effectiveness studies. These trials may be categorized as primarily pragmatic or explanatory. The most appropriate research designs for these different phases and different objectives vary on such characteristics as sample size and assignment to condition, types of control conditions, periods or frequency of measurement, and the dimensions along which comparisons are made. A research design also must fit within constraints on available resources. There are a large number of potential research designs that can be used and considering these characteristics allows selection of appropriate research designs.
Collapse
Affiliation(s)
- Karl G Hursey
- Department of Psychology, HealthSouth MountainView Regional Rehabilitation Hospital, and Aachenor Psychology Consulting, PLLC, Morgantown, WV 26505, USA
| | | | | | | | | |
Collapse
|
34
|
Warren RML, Pointon L, Thompson D, Hoff R, Gilbert FJ, Padhani A, Easton D, Lakhani SR, Leach MO. Reading Protocol for Dynamic Contrast-enhanced MR Images of the Breast: Sensitivity and Specificity Analysis. Radiology 2005; 236:779-88. [PMID: 16118160 DOI: 10.1148/radiol.2363040735] [Citation(s) in RCA: 90] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
PURPOSE To prospectively determine sensitivity and specificity of breast magnetic resonance (MR) imaging in a screening and symptomatic population by using independent double reading, with histologic or cytologic results or a minimum 18-month follow-up as the standard. MATERIALS AND METHODS Informed consent and ethical approval were obtained. Reader performance was analyzed in 44 radiologists at 18 centers from 1541 examinations, including 1441 screening examinations in 638 high-risk women aged 24-51 years (mean, 40.5 years) and 100 examinations in symptomatic women aged 23-81 years (mean, 49.2 years). A screening protocol of dynamic T1-weighted three-dimensional imaging and 0.2 mmol/kg gadolinium-based intravenous contrast agent was used. Logistic and Poisson regressions were used to analyze reader performance in relation to experience. Correlation between readers was determined with kappa statistics. Sensitivity and specificity were analyzed according to reader, field strength, machine type, and histologic results. RESULTS The proportion of studies with lesions analyzed reduced significantly with reader experience (odds ratio, 0.84 per 6 months; P < .001), and number of regions per lesion analyzed also diminished (incidence rate ratio, 0.98 per 6 months; P = .047). The two readers for each study agreed 87% of the time, with a moderately good kappa statistic of 0.52 (95% confidence interval [CI]: 0.45, 0.58). By taking the reading with the highest score (most likely to be malignant) from each double-read study, sensitivity was 91% (95% CI: 83%, 96%) and specificity was 81% (95% CI: 79%, 83%). Single readings had 7% lower sensitivity (95% CI: 4%, 11%) and 7% higher specificity (95% CI: 6%, 7%). Sensitivity did not differ between MR imager manufacturers or between 1.0- and 1.5-T field strength, but there were significant differences in specificity for machine type (P = .001) and for field strength adjusted for manufacturer (P = .001). Specificity, but not sensitivity, was higher in women younger than 50 years (P = .02). CONCLUSION Independent double reading by 44 radiologists blinded to mammography results showed sensitivity and specificity acceptable for screening; sensitivity was higher when two readings were used, at the cost of specificity. Interreader correlation was moderately good, and evidence of learning was seen. Equipment manufacturer, field strength, and age affected specificity but not sensitivity.
Collapse
Affiliation(s)
- Ruth M L Warren
- Department of Radiology, Addenbrooke's Hospital, Cambridge, England
| | | | | | | | | | | | | | | | | |
Collapse
|
35
|
Li LC, Backman C, Bombardier C, Hammond A, Hill J, Iversen M, Petersson IF, Stenström C, Vlieland TV. Focusing on care research: A challenge and an opportunity. Arthritis Care Res (Hoboken) 2004; 51:874-6. [PMID: 15593108 DOI: 10.1002/art.20826] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
36
|
Bode RK, Heinemann AW, Semik P, Mallinson T. Relative Importance of Rehabilitation Therapy Characteristics on Functional Outcomes for Persons With Stroke. Stroke 2004; 35:2537-42. [PMID: 15472085 DOI: 10.1161/01.str.0000145200.02380.a3] [Citation(s) in RCA: 67] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Background and Purpose—
The purpose of this study was to evaluate the relative importance of therapy focus, intensity, and length of stay on greater than expected functional gain, controlling for stroke severity.
Methods—
This observational study included 198 first-stroke patients who were recruited from 8 in-patient rehabilitation facilities and 5 subacute programs. Stroke severity (motor, sensory and cognitive impairment) at admission was measured using an instrument combining all 3 aspects; self-care, mobility, and cognitive status at admission and discharge were measured with the Functional Independence Measure. Time spent by physical, occupational, and speech-language therapists on function- and impairment-focused activities were used to compute therapy intensity by discipline and type of activity. Residual change scores, estimated by regressing discharge on admission functional status, were modeled using patient and therapy characteristics.
Results—
Controlling for the stroke severity, greater than expected gains in self-care were predicted by longer lengths of stay and more intensive function-focused occupational therapy, and greater than expected cognitive gains were predicted by longer stays alone. Predictors of residual change in mobility, however, differed by gender: greater than expected gains in mobility for men were predicted by longer lengths of stay and more intense function-focused physical therapy whereas, for women, they were predicted by stroke severity alone.
Conclusions—
Unlike previous studies using raw functional gains, therapies accounted for a significant proportion of the variance in residual functional change. The results support studies suggesting that both content and amount of therapy are important aspects.
Collapse
Affiliation(s)
- Rita K Bode
- Center for Rehabilitation Outcomes Research, Rehabilitation Institute of Chicago, 345 E Superior St, Room O-950, Chicago, IL 60611, USA.
| | | | | | | |
Collapse
|
37
|
|