Qualitative methods and policy evaluation. Studying causal mechanisms through process tracing methods

Journal title RIV Rassegna Italiana di Valutazione
Author/s Simone Busetti
Publishing Year 2016 Issue 2015/62
Language Italian Pages 20 P. 45-64 File size 442 KB
DOI 10.3280/RIV2015-062005
DOI is like a bar code for intellectual property: to have more infomation click here

Below, you can see the article first page

If you want to buy this article in PDF format, you can do it, following the instructions to buy download credits

Article preview

FrancoAngeli is member of Publishers International Linking Association, Inc (PILA), a not-for-profit association which run the CrossRef service enabling links to and from online scholarly content.

The present article aims to contribute to the debate on qualitative methods in policy evaluation. The central claim is that those methods are fundamental in order to uncover and refine our knowledge on why programmes work. The article starts with a brief review of the literature on causal mechanisms, providing a basic definition of mechanisms and discussing their utility in policy evaluation. The article proceeds by defending the methodological advantage of case studies for the formulation of new theories and then presents process tracing as a rigorous methods for drawing within-case inferences. An extended example of a local development programme is used to illustrate the method.

Keywords: Process Tracing, Causal Mechanisms, Qualitative Methods, Realistic Evaluation, Theory-Driven Evaluation, Local Development

  1. Achen, C. H. (2002). “Toward a new political methodology: Microfoundations and ART” Annual Review of Political Science 5.1: 423-450.
  2. Antiseri, D. (1996). Trattato di metodologia delle scienze sociali. UTET Università.
  3. Barca, F. (2008). An agenda for a reformed cohesion policy: A place-based approach to meeting European Union challenges and expectations, --http://ec.europa.eu/regional_policy/archive/policy/future/pdf/report_barca_v0306.pdf Bardach, E. (2004). Presidential Address – The Extrapolation Problem: How Can We Learn from the Experience of Others?. Journal of Policy Analysis and Management, 23: 205-220.
  4. http://ec.europa.eu/regional_policy/archive/policy/future/pdf/report_barca_v0306.pdf Bardach, E. (2004). Presidential Address – The Extrapolation Problem: How Can We Learn from the Experience of Others?. Journal of Policy Analysis and Management, 23: 205-220.
  5. Barzelay, M. (2007). Learning from Second-Hand Experience: Methodology for Extrapolation-Oriented Case Research. Governance, 20, 521-543.
  6. Beach, D. and Pedersen, R. B. (2013). Process-Tracing Methods. Foundations and Guidelines. Ann Arbor: The Michigan University Press.
  7. Bennett, A. and Checkel, J. T. eds. (2015). Process tracing. Cambridge: Cambridge University Press.
  8. Bhaskar, R. (1978). A Realist Theory of Science. London: Routledge.
  9. Bowles, S. and Gintis, H. (2011). A Cooperative Species: Human Reciprocity and its Evolution. Princeton: Princeton University Press.
  10. Brady, H. E., and Collier, D. (2010). eds. Rethinking social inquiry: Diverse tools, shared standards. Rowman & Littlefield Publishers.
  11. Busetti, S., Huete, M., Gonzalez, M. and Merinero, R. (2015) Regenerating cities: which mechanisms to revive local governance?, presented at ICPP, July 1-4, Milano.
  12. Busetti, S. and Dente, B. (2015) Mechanism-based design: Expanding designers’ toolkit, presented at ECPR Joint Sessions 29 March – 4 April, Warsaw.
  13. Chen, H. T. (1990). Theory-driven evaluations. Sage.
  14. Collier, D. (2011). “Understanding Process Tracing.” Political Science and Politics, 44(4):823-830.
  15. Fagan, M. B. (2012). The joint account of mechanistic explanation. Philosophy of Science, (79) 4: 448-472.
  16. Freedman, D. A. (2008). “On types of scientific inquiry: The role of qualitative reasoning” The Oxford handbook of political methodology (2008): 300-318.
  17. handbook of political methodology (2008): 300-318.
  18. Freedman, D. A. (2010). Statistical models and causal inference: a dialogue with the social sciences. Cambridge University Press.
  19. Funnell, S. C., & Rogers, P. J. (2011). Purposeful program theory: Effective use of theories of change and logic models. John Wiley & Sons.
  20. George, A. L., and Bennett, A. (2005). Case studies and theory development in the social sciences. Mit Press.
  21. Gerring, J. (2006). Case study research: principles and practices. Cambridge University Press.
  22. Gerring, J. (2010). Causal Mechanisms: Yes, but… Comparative Political Studies, 43: 1499-1526.
  23. Hedström, P. and Swedberg, R. eds. (1998). Social Mechanisms: An Analytical Approach to Social Theory. Cambridge: Cambridge University Press.
  24. Hill, M. J., and Hupe, P. L. (2002). Implementing public policy: governance in theory and practice. London: Sage.
  25. Howlett, M. (2010). Designing public policies: Principles and instruments. London: Routledge.
  26. King, G., Keohane, R. O., and Verba, S. (1994). Designing social inquiry: Scientific inference in qualitative research. Princeton: Princeton University Press.
  27. Linder, S. H., and Peters, B. G. (1984). From social theory top policy design. Journal of Public Policy, 4: 237–249.
  28. Machamer, P., Darden, L. and Craver, C. F. (2000). Thinking about mechanisms. Philosophy of Science, 67: 1-25.
  29. MacKinnon, D. P. (2008). Introduction to statistical mediation analysis. Routledge.
  30. Mahoney, J. (2003). Tentative answers to questions about causal mechanisms. Annual Meeting of the American Political Science Association, --http://ciece.com.ar/ciece/wpcontent/uploads/Mahoney-James-Tentative-Answers-to-Questions-about-Causal-Mechanisms.pdf
  31. Mayntz, R. (2004). Mechanisms in the analysis of social macro-phenomena. Philosophy of the Social Sciences, 34: 237-259. McAdam, D., Tarrow, S. and Tilly, C. eds. (2001). Dynamics of Contention. Cambridge: Cambridge University Press.
  32. Meier, K. J. and Gill, J. (2000). What Works: A New Approach to Program and Policy Analysis. Boulder, CO: Westview Press.
  33. Overman, E. S. and Boyd, K. J. (1994). Best Practice Research and Bureaucratic Reform. Journal of Public Administration Research and Theory, 4: 67-83.
  34. Pawson, R. (2013). The science of evaluation: a realist manifesto. Sage.
  35. Pawson, R. and Tilley N. (1997). Realistic evaluation. Sage.
  36. Rose, R. (1993). Lesson-drawing in public policy: A guide to learning across time and space. Chatham House Publishers.
  37. Sayer, A. (2000). Realism and Social Science. London: Sage.
  38. Steel, D. (2008). Across the Boundaries. Oxford University press.
  39. Thaler, R. H. and Sunstein, C. R. (2008). Nudge. Yale University Press.
  40. Waldner, D. (2015). “What makes process tracing good? Causal mechanisms, causal inference, and the completeness standard in comparative politics.” in Bennett, Andrew, and Jeffrey T. Checkel, eds. Process tracing. Cambridge University Press.
  41. Yin, R. (1994). Case study research: Design and methods. Beverly Hills.

Simone Busetti, Metodi qualitativi e valutazione delle politiche. Lo studio dei meccanismi causali con il process tracing in "RIV Rassegna Italiana di Valutazione" 62/2015, pp 45-64, DOI: 10.3280/RIV2015-062005