1
|
Stier J, Cameron J, Nowrouzi-Kia B, Brammer C, Asher S, Lipszyc D. The development and psychometric properties of a measure to assess the written submission of an admissions application. Br J Occup Ther 2022. [DOI: 10.1177/03080226221080871] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Introduction Health care programs evaluate prospective applicants using cognitive and non-cognitive criteria. The aim of this research was to develop and evaluate the psychometric properties of a measure to evaluate the non-cognitive criteria of admissions applications. Method A Masters of Occupational Therapy Written Submission Measure (MOTWSM) was developed and evaluated over 3 phases, using applicants’ written statements, resumes, and reference letters. Participants included 50 students who completed an occupational therapy program for determination of internal consistency and test-retest reliability. Additionally, 195 written submissions selected from the applicants who were admitted, waitlisted, and not admitted to the program were evaluated to determine inter-rater reliability using a two-way ANOVA. Analysis of 195 submissions using a one-way ANOVA determined the measure’s discriminative validity. Findings Results indicated test-retest reliability of 0.95 and internal consistency reliability of 0.76. Inter-rater reliability reported a Cronbach’s alpha coefficient of 0.86 using a horizontal scoring method. Good discriminative validity was established. Conclusion The MOTWSM is a reliable and valid measure that can be used to evaluate the non-cognitive criteria of admissions applications in health profession programs. Use of this measure can facilitate selection of the highest caliber of students.
Collapse
Affiliation(s)
- Jill Stier
- Department of Occupational Science and Occupational Therapy, University of Toronto, Toronto, ON, Canada
| | - Jill Cameron
- Department of Occupational Science and Occupational Therapy, University of Toronto, Toronto, ON, Canada
| | - Behdin Nowrouzi-Kia
- Department of Occupational Science and Occupational Therapy, University of Toronto, Toronto, ON, Canada
| | - Chantel Brammer
- Department of Occupational Science and Occupational Therapy, University of Toronto, Toronto. Canada North York General Hospital, Toronto, Canada
| | - Sara Asher
- St. Joseph’s Health Centre, Unity Health Toronto, Toronto, Canada
| | - Deborah Lipszyc
- Department of Family and Community Medicine, University of Toronto, Toronto, Canada
| |
Collapse
|