Using Administrative Data for Impact Evaluations
*Names in bold indicate Presenter
Despite these benefits, administrative data – especially linked administrative data – are underutilized in research and impact evaluation. Finkelstein and Taubman (2015) find that, among randomized controlled trials in the field of healthcare delivery, most involved primary data collection, only half used administrative data, and only fifteen percent relied exclusively on them.
This under-utilization may be due in part to the complex web of statutes, laws, and policies that govern the release of identified data. Even when the regulations allow for the release of data for research purposes, researchers and/or policymakers are often unclear about the process and strategies for sharing data, and policy-relevant research often fails to launch. Access to de-identified data is often much simpler, but complex and policy-relevant research often requires the linkage of multiple sources of administrative data, or linkage with survey data, which requires linking the data at the individual level.
This report provides practical guidance about obtaining and using nonpublic administrative data for randomized impact evaluations. We illustrate a set of strategies for accessing data while complying with relevant regulations, describe the ethical and legal landscape, and review common challenges and potential for bias in using administrative data for impact evaluation.
The President’s budget for FY 2017 notes the underutilization of administrative data for evaluation of government programs, and proposes several strategies to increase the availability of administrative data to researchers. In March 2016, President Obama signed a bill creating an Evidence-Based Policymaking Commission, which will identify optimal strategies for linking and releasing administrative data for research and evaluation purposes. While these efforts may prove to be transformative, understanding the current possibilities for acquiring, accessing, and analyzing administrative data could facilitate more research leading to better policies today.