|
2
|
Krosschell KJ, Bosch M, Nelson L, Duong T, Lowes LP, Alfano LN, Benjamin D, Carry TB, Devine G, Kelley C, Gadekan R, Malkus EC, Pasternak A, Provance-Orr S, Roemeiser-Logan L, Nicorici A, Trussell D, Young SD, Fetterman JR, Montes J, Powers PJ, Quinones R, Quigley J, Coffey CS, Yankey JW, Bartlett A, Kissel JT, Kolb SJ. Motor Function Test Reliability During the NeuroNEXT Spinal Muscular Atrophy Infant Biomarker Study. J Neuromuscul Dis 2018; 5:509-521. [PMID: 30223401 PMCID: PMC8112280 DOI: 10.3233/jnd-180327] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
Abstract
BACKGROUND The NeuroNEXT SMA Infant Biomarker Study, a two year, longitudinal, multi-center study of infants with SMA type 1 and healthy infants, presented a unique opportunity to assess multi-site rater reliability on three infant motor function tests (MFTs) commonly used to assess infants with SMA type 1. OBJECTIVE To determine the effect of prospective MFT rater training and the effect of rater experience on inter-rater and intra-rater reliability for the Test of Infant Motor Performance Screening Items (TIMPSI), the Children's Hospital of Philadelphia Infant Test of Neuromuscular Disorders (CHOP-INTEND) and the Alberta Infant Motor Scale (AIMS). METHODS Training was conducted utilizing a novel set of motor function test (MFT) videos to optimize accurate MFT administration and reliability for the study duration. Inter- and intra-rater reliability of scoring for the TIMPSI and inter-rater reliability of scoring for the CHOP INTEND and the AIMS was assessed using intraclass correlation coefficients (ICC). Effect of rater experience on reliability was examined using ICC. Agreement with 'expert' consensus scores was examined using Pearson's correlation coefficients. RESULTS Inter-rater reliability on all MFTs was good to excellent. Intra-rater reliability for the primary MFT, the TIMPSI, was excellent for the study duration. Agreement with 'expert' consensus was within predetermined limits (≥85%) after training. Evaluator experience with SMA and MFTs did not affect reliability. CONCLUSIONS Reliability of scores across evaluators was demonstrated for all three study MFTs and scores were reproducible on repeated administration. Evaluator experience had no effect on reliability.
Collapse
Affiliation(s)
- Kristin J. Krosschell
- Department of Physical Therapy and Human Movement Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
- Department of Pediatrics, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Michael Bosch
- Department of Biostatistics, NeuroNEXT Data Coordinating Center, University of Iowa, Iowa City, IA, USA
| | - Leslie Nelson
- Physical Therapy, UT Southwestern Medical Center, Dallas, TX, USA
| | - Tina Duong
- Department of Neurology, Stanford University, Palo Alto, CA, USA
| | - Linda P. Lowes
- Neurology, Nationwide Children’s Hospital, Columbus, OH, USA
| | | | - Danielle Benjamin
- Physical Therapy, Oregon Health and Science University, Portland, OR, USA
| | - Terri B. Carry
- Physical Therapy, Children’s Hospital Colorado, Aurora, CO, USA
| | - Ginger Devine
- Pi Beta Phi Rehabilitation Institute, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Carolyn Kelley
- Physical Therapy, Children’s Hospital Colorado, Aurora, CO, USA
| | - Rebecca Gadekan
- Neuromuscular Division, Washington University School of Medicine, St. Louis, MO, USA
| | | | - Amy Pasternak
- The Department of Physical Therapy and Occupational Therapy Services, Boston Children’s Hospital, Boston, MA, USA
- The Department of Neurology, Boston Children’s Hospital, Boston, MA, USA
| | | | | | - Alina Nicorici
- Physical Medicine and Rehabilitation, University of California – Davis, Davis, CA, USA
| | | | - Sally Dunaway Young
- Departments of Neurology and Rehabilitation and Regenerative Medicine, Columbia University Medical Center, New York, NY, USA
| | | | - Jacqueline Montes
- Departments of Neurology and Rehabilitation and Regenerative Medicine, Columbia University Medical Center, New York, NY, USA
| | - Penny J. Powers
- Pi Beta Phi Rehabilitation Institute, Vanderbilt University Medical Center, Nashville, TN, USA
| | | | - Janet Quigley
- The Department of Physical Therapy and Occupational Therapy Services, Boston Children’s Hospital, Boston, MA, USA
- The Department of Neurology, Boston Children’s Hospital, Boston, MA, USA
| | - Christopher S. Coffey
- Department of Biostatistics, NeuroNEXT Data Coordinating Center, University of Iowa, Iowa City, IA, USA
| | - Jon W. Yankey
- Department of Biostatistics, NeuroNEXT Data Coordinating Center, University of Iowa, Iowa City, IA, USA
| | - Amy Bartlett
- Department of Neurology, The Ohio State University Wexner Medical Center, Columbus, OH, USA
| | - John T. Kissel
- Department of Neurology, The Ohio State University Wexner Medical Center, Columbus, OH, USA
| | - Stephen J. Kolb
- Department of Neurology, The Ohio State University Wexner Medical Center, Columbus, OH, USA
- Department of Biological Chemistry and Pharmacology, The Ohio State University Wexner Medical Center, Columbus, OH, USA
| |
Collapse
|