1
|
Kulgemeyer C, Riese J, Vogelsang C, Buschhüter D, Borowski A, Weißbach A, Jordans M, Reinhold P, Schecker H. How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods. ZEITSCHRIFT FUR ERZIEHUNGSWISSENSCHAFT : ZFE 2023; 26:1-25. [PMID: 37359180 PMCID: PMC10244832 DOI: 10.1007/s11618-023-01154-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/24/2022] [Revised: 11/25/2022] [Accepted: 01/06/2023] [Indexed: 06/28/2023]
Abstract
Based on a literature review of studies on teachers' professional competence and related assessment tools, this paper introduces a model of teacher education assessment. It is influenced by Miller's (1990) framework of assessment in medical education and includes, among other aspects, performance assessments. This model is used to understand the potential effects of transferring assessment tools into a digital format with assessment feedback. Five examples for such a transfer will be discussed: three methods for various aspects of communication, a test for pedagogical content knowledge, and a test for content knowledge. All five are established instruments well-described in terms of validity. All five have recently been transferred into a digital format. The analysis of this transfer also reveals a potentially harmful effect of digital assessment. The closer an assessment instrument is to assessing action-related parts of professional competence, the more authenticity is required; however, digitisation tends to decrease this authenticity. This suggests that an increasing number of digital assessment tools in teacher education might result in an even more dominant focus on knowledge tests, ignoring other parts of professional competence. This article highlights the role of authenticity in validity and discusses the most suitable assessment format to address various parts of professional competence. It ends by highlighting the lessons learned from the transfer of assessment instruments into a digital format that other academic disciplines might find interesting.
Collapse
Affiliation(s)
- Christoph Kulgemeyer
- Institut für Didaktik der Naturwissenschaften, Abt. Physikdidaktik, Universität Bremen, Otto-Hahn-Allee 1, 28334 Bremen, Germany
| | - Josef Riese
- Fakultät für Naturwissenschaften, Department Physik, Universität Paderborn, Warburger Str. 100, 33098 Paderborn, Germany
| | - Christoph Vogelsang
- Fakultät für Naturwissenschaften, Department Physik, Universität Paderborn, Warburger Str. 100, 33098 Paderborn, Germany
| | - David Buschhüter
- Institut für Physik und Astronomie, Lehrstuhl Didaktik der Physik, Universität Potsdam, Karl-Liebknecht-Str. 24/25, 14476 Potsdam-Golm, Germany
| | - Andreas Borowski
- Institut für Physik und Astronomie, Lehrstuhl Didaktik der Physik, Universität Potsdam, Karl-Liebknecht-Str. 24/25, 14476 Potsdam-Golm, Germany
| | - Anna Weißbach
- Institut für Didaktik der Naturwissenschaften, Abt. Physikdidaktik, Universität Bremen, Otto-Hahn-Allee 1, 28334 Bremen, Germany
| | - Melanie Jordans
- I. Phys. Institut IA, RWTH Aachen University, Sommerfeldstr. 14, 52074 Aachen, Germany
| | - Peter Reinhold
- Fakultät für Naturwissenschaften, Department Physik, Universität Paderborn, Warburger Str. 100, 33098 Paderborn, Germany
| | - Horst Schecker
- Institut für Didaktik der Naturwissenschaften, Abt. Physikdidaktik, Universität Bremen, Otto-Hahn-Allee 1, 28334 Bremen, Germany
| |
Collapse
|