Panel Paper: Scaling Up What Works: Experimental Evidence On External Validity in Kenyan Education

Saturday, November 9, 2013 : 10:05 AM
3017 Monroe (Washington Marriott)

*Names in bold indicate Presenter

Tessa Bold, Goethe University Frankfurt; Stockholm University, Mwangi Kimenyi, Brookings Institute, Germano Mwabu, University of Nairobi, Alice Ng'ang'a, Strathmore University and Justin Sandefur, Center for Global Development
The recent wave of randomized trials in development economics has provoked criticisms regarding external validity. We investigate two concerns—heterogeneity across beneficiaries and implementers—in a randomized trial of contract teachers in Kenyan schools. The intervention, previously shown to raise test scores in NGO-led trials in Western Kenya and parts of India, was replicated across all Kenyan provinces by an NGO and the government. Strong effects of short-term contracts produced in controlled experimental settings are lost in weak public institutions: NGO implementation produces a positive effect on test scores across diverse contexts, while government implementation yields zero effect. The data suggests that the stark contrast in success between the government and NGO arm can be traced back to implementation constraints and political economy forces put in motion as the program went to scale.