2004
Volume 109, Issue 1
  • ISSN: 0002-5275
  • E-ISSN: 2352-1244

Abstract

Abstract

Internal and external validity of experimental and quasi-experimental research are both essential in the evaluation of interventions; this is true in such diverse practices as social policy and pharmacology. However, they may trade-off if the quest for internal validity brings about the treatment of contextual variables – that helped to make or fail the intervention – as competing with the intervention instead of necessary for its success. Investment in internal validity takes the form of many types of correction for bias, often obscuring the role of contextual factors.

As helping factors make or break the intervention, they should rather be treated as causal factors of interest no less than the intervention. I claim that, only then, the conclusions of the (quasi)experiment can serve to gain knowledge of working principles in a variety of contexts.

Correction for bias is useful, but only if the evaluation of the success of an intervention is theory driven. Ex ante explanatory hypotheses must be the starting point of evaluation research and testing them the object of it. Thus, the empirical cycle is covered entirely. If no theoretical hypotheses guide the questions of evaluation research, all we will learn is that ‘most interventions sometimes work’, to speak with Pawson and Tilley (1997). What we are left with is little more than meaningless intervention-impact couples that cover half the empirical cycle lacking any cognitive value.

Loading

Article metrics loading...

/content/journals/10.5117/ANTW2017.1.MROL
2017-01-22
2022-05-24
Loading full text...

Full text loading...

/deliver/fulltext/00025275/109/1/08_ANTW2016.4.MROL.html?itemId=/content/journals/10.5117/ANTW2017.1.MROL&mimeType=html&fmt=ahah
http://instance.metastore.ingenta.com/content/journals/10.5117/ANTW2017.1.MROL
Loading
  • Article Type: Research Article
Keyword(s): explanation; external validity; impact evaluation; internal validity; social mechanism
This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error