Randomised trials for policy: a review of the external validity of treatment effects

Simple item page
dc.creatorMuller, Sean
dc.date2014-04-03T10:08:56Z
dc.date2014-04-03T10:08:56Z
dc.date2014-04
dc.date.accessioned2015-05-28T10:06:35Z
dc.date.available2015-05-28T10:06:35Z
dc.date.issued2015-05-28
dc.descriptionThe paper provides a first survey of the literature on external validity. The starting point for this are debates regarding the use of randomised evaluations to inform policy. Besides synthesising contributions to the programme evaluation literature we consider definitions of external validity from other subdisciplines within economics, such as experimental economics and the time-series forecasting literature, as well as the disciplines of philosophy and medicine. We suggest - following Cook and Campbell (1979) - that the fundamental challenge arises from interactive functional forms. This somewhat neglected point provides a framework in which to understand how and why extrapolation may fail. In particular it suggests that replication cannot resolve the external validity problem unless informed by some prior theoretical understanding of the causal relationship of interest. Finally, we argue that the assumptions required for simple external validity are conceptually equivalent to those required for obtaining unbiased estimates of treatment effects using non-experimental methods, undermining the idea that internal validity needs be rigorously assessed whereas external validity can be ascertained subjectively. Theory may play a role in aiding extrapolation, but the extent to which this will be possible in practice remains an open question.
dc.identifier978-1-920517-68-7
dc.identifierhttp://hdl.handle.net/11090/691
dc.identifier.ris TY - Working Paper DA - 2015-05-28 DB - OpenUCT DP - University of Cape Town KW - randomised trials KW - external validity KW - treatment effects LK - https://open.uct.ac.za PB - University of Cape Town PY - 2015 T1 - Randomised trials for policy: a review of the external validity of treatment effects TI - Randomised trials for policy: a review of the external validity of treatment effects UR - http://hdl.handle.net/11090/691 ER - en_ZA
dc.identifier.urihttp://hdl.handle.net/11090/691
dc.languageen
dc.publisher.departmentSALDRUen_ZA
dc.publisher.facultyFaculty of Commerceen_ZA
dc.publisher.institutionUniversity of Cape Town
dc.relationSaldru Working Paper;127
dc.subjectrandomised trials
dc.subjectexternal validity
dc.subjecttreatment effects
dc.titleRandomised trials for policy: a review of the external validity of treatment effects
dc.typeWorking Paper
uct.type.publicationResearchen_ZA
uct.type.resourceWorking Paperen_ZA
Files
Collections
Reports