1
|
Holvoet N, Casten W, Demissie EW, Dewachter S, Gamboa MKC, Adhanom TG, Ibrahim AH, Makundi H, Manguni G, Manyuru GA, Mugabi N, Nawanda YE, Nguyen CH, Pallangyo WA, Pascual-Villar R, Saavedra LP, Salgado MT, Tysmans N, Vu AN, Wuyts E, Weldegebriel ZB. Theory-based evaluation of the impact of Master's programmes in development studies: Insights from a mixed-methods and multicultural alumni action research project. Eval Program Plann 2023; 97:102228. [PMID: 36708698 DOI: 10.1016/j.evalprogplan.2023.102228] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/18/2020] [Revised: 08/25/2022] [Accepted: 01/05/2023] [Indexed: 06/18/2023]
Abstract
To understand the impact of the international Master's programmes offered at the Institute of Development Policy (University of Antwerp), a theory-based evaluation was undertaken. In the first phase, a Theory of Change (ToC) was elaborated, distinguishing between three levels of impact (individual, organisational and societal), four learning dimensions (knowledge, skills, attitudes and networks) and five implicit pathways (change agent, social network, widening access, academic diversity, international understanding). Given the multifaceted and vague nature of the 'impact' concept under study, we selected an international, gender-balanced, multi-sectoral team of alumni researchers who fostered inclusiveness of different perspectives, at the same time capitalising on their depth of understanding, having gone through the study experience themselves. A mixed-methods approach was adopted to validate the ToC, combining a Most Significant Change approach, categorisation and text analysis of 101 alumni impact stories. Our findings demonstrate the importance of the three levels of impact and four learning dimensions in capturing graduate impact. While the impact stories confirmed the dominant 'change agent' pathway, they also hinted at the importance of hybrid complementary configurations of pathways to fully grasp how impact materialises.
Collapse
Affiliation(s)
- Nathalie Holvoet
- Institute of Development Policy, University of Antwerp, Lange St. Annastraat 7, 2000 Antwerpen, Belgium.
| | - Wanda Casten
- Pilipinas Monitoring & Evaluation Society, 2-P Lee Gardens Commercial Center, Shaw Blvd., Mandaluyong City 1552, Philippines.
| | | | - Sara Dewachter
- Institute of Development Policy, University of Antwerp, Lange St. Annastraat 7, 2000 Antwerpen, Belgium.
| | - Marian Kaye C Gamboa
- National Economic and Development Authority, 12 Josemaria Escriva Drive, Ortigas Center, Pasig City, Philippines; Independent MEL consultant.
| | - Tewelde Gebremariam Adhanom
- Department of Gender and Development Studies, College of Social Science and Humanities, University of Gondar, P.O. Box 196, Gondar, Ethiopia.
| | - Abdurahman Hamza Ibrahim
- School of Governance and Development Studies, Hawassa University, P.O. Box 05, Hawassa, Ethiopia.
| | - Hezron Makundi
- IDS University of Dar es Salaam, Room 229, IDS-Kiswahili Building, UDSM Main Campus, P.O. Box 35169, Dar es Salaam, Tanzania.
| | - Grachel Manguni
- Institute of Development Policy, University of Antwerp, Lange St. Annastraat 7, 2000 Antwerpen, Belgium.
| | - Georgina Angela Manyuru
- World Bank Group, Uganda Country Office, Rwenzori House, Plot 1, Lumumba Avenue, P.O. Box 4463, Kampala, Uganda.
| | - Nicholas Mugabi
- School of Social Sciences, Makerere University, P.O. Box 7062, Kampala, Uganda.
| | - Yahya E Nawanda
- Department of Development Studies (DDS), College of Social Sciences and Humanities, Sokoine University of Agriculture, P.O. Box 3024, Morogoro, Tanzania.
| | - Chau Hoai Nguyen
- Canadian Development Program in Vietnam, 31 Hung Vuong str., Hanoi, Viet Nam.
| | | | - Rose Pascual-Villar
- National Economic and Development Authority (NEDA), Region 3, Philippines; Bulacan State University, City of Malolos, Bulacan, Philippines.
| | | | - Mariluz Torres Salgado
- Universidad Centroamericana (UCA) and Fundación Zamora Terán (FZT), Sierritas de Santo Domingo, de la radio estrella del Mar 1 KM al sur. Managua, Nicaragua.
| | - Nash Tysmans
- Independent consultant/researcher, Brussels, Belgium.
| | - Anh Ngoc Vu
- Department of Politics and International Relations, University of Sheffield, Elmfield Building, Northumberland Road, Sheffield S10 2TU, United Kingdom.
| | - Eva Wuyts
- Independent Consultant/Researcher, Lier, Belgium.
| | | |
Collapse
|