Click here to download

Evaluating the impact of FSE-funded training policies in Piedmont Region: lessons from an empirical research
Journal Title: RIV Rassegna Italiana di Valutazione 
Author/s: Igor Benati, Elena Ragazzi, Lisa Sella 
Year:  2013 Issue: 56-57 Language: Italian 
Pages:  22 Pg. 26-47 FullText PDF:  169 KB
DOI:  10.3280/RIV2013-056003
(DOI is like a bar code for intellectual property: to have more infomation:  clicca qui   and here 


The paper presents an impact assessment of vocational training courses, which the Piedmont Region co-financed by the ESF, both discussing the methodological feasibility and proposing a quasi-experimental evaluation strategy based on the medium-term job placement of vocational training students. The authors illustrate the operational design and the implementation of the assessment, with particular attention to the identification of a proper control sample, finally identified on the basis of the course noshows and drop-outs. The paper proposes an accurate description of gross and net impact evaluation strategies. The gross impact evaluation is carried out through an analysis of the employment outcomes in the mid-term, while the net impact is estimated through net employment differentials between the main and the counterfactual sample, as well as through a multivariate probit analysis, which investigates the effects of individual characteristics on the probability of being employed a year later the end of the course. The selection bias problem is discussed, illustrating the strategy adopted to identify and counteract its effects. In conclusion, the authors distill this research experience through a series of lessons learned about both the methods and the evaluation assessment of training effectiveness. Key words: vocational training; impact evaluation; counterfactual analysis; sampling; multivariate analysis; selection bias.

  1. Friedlander D., Greenberg D.H. e Robins P.K. (1997). Evaluating government training programs for the economically disadvantaged. Journal of Economic Literature 4: 1809-55.
  2. Heckman J.J. (1976). The common structure of statistical models of truncation, sample selection, and limited dependent variables and a simple estimator for such models. Annals of Economic and Social Measurement (NBER) 5, n°4.
  3. Heckman J.J., LaLonde, R.J., e J.A. Smith (1999). The economics and econometrics of active labour market programs. In Ashenfelter O., Card D., a cura di, The Handbook of Labour Economics, vol. 3, Amsterdam: North-Holland.
  4. Hollenbeck K., Huang W.J. (2003). Net Impact and Benefit-Cost Estimates of the Workforce Development System in Washington State. Upjohn Institute Technical Report, n°TR03-018.
  5. Hollenbeck K. (2005). On the Use of Administrative Data for Workforce Development Program Evaluation. ETA Occasional Paper (U.S. Department of Labor, Employment and Training Administration), n 2005-09.
  6. Hollenbeck K., Schroeder D., King C. T. e Huang W.J. (2005). Net Impact Estimates for Services Provided through the Workforce Investment Act. ETA Occasional Paper 2005-2006.
  7. Hollenbeck K., Huang W.J. (2006). Net Impact and Benefit-Cost Estimates of the Workforce Development System in Washington State. Upjohn Institute Technical Report (Upjohn Institute for Employment Research), n°06-020.
  8. Hollenbeck K., Huang W.J. (2007). Workforce Program Performance Indicators for The Commonwealth of Virginia. Upjohn Institute Technical Report (W.E. Upjohn Institute for Employment Research), n°08-024.
  9. IEG (2006). Impact Evaluation Experience of the Independent Evaluation Group of the World Bank. Washington, DC: World Bank.
  10. IReR (2006). Il ruolo del FSE nelle politiche formative regionali. Scenari per il 2006.
  11. http://www.consiglio.regione.lombardia.it/documents/38960/9400/fondo+soc+europeo+sint+consiglio.pdf.
  12. IRPET (2011). Valutazione di impatto degli interventi formativi per i disoccupati e gli inoccupati. Il caso della Toscana, testo disponibile al sito: http://www.irpet.it/storage/pubblicazioneallegato/341_StudixConsiglio%207_11%20completo.pdf.
  13. Antonelli G., Nosvelli M. (2002). Monitoraggio e valutazione delle politiche del lavoro per una “nuova economia”. Bologna: Il Mulino.
  14. ISFOL (2003). Linee guida per la valutazione degli effetti occupazionali del Fondo sociale europeo
  15. Barca F. (2009). An agenda for a Reformed Cohesion Policy. A place-based approach to meeting European Union challenges and expectations, Independent report prepared at the request of Danuta Hübner, Commissioner for Regional Policy, testo disponibile al sito : http://ec.europa.eu/regional_policy/archive/policy/future/pdf/report_barca_v0306.pdf
  16. Battistin E., Rettore. E. (2002). Testing for programme effects in a regression discontinuity design with imperfect compliance. Journal of the Royal Statistical Society. Series A, volume165, n 1: 39-57.
  17. Bell S.H., Orr L.L., Blomquist J.D., e Cain G.G.. (1995) Program Applicants as a Comparison Group in Evaluating Training Programs: Theory and a Test. Kalamazoo, MI: W.E. Upjohn Institute for Employment Research.
  18. 2000-2006. Roma: ISFOL, Struttura nazionale di valutazione Fse.
  19. Bellio R., Gori B. (2003). Impact evaluation of job training programs: selection bias in multilevel models. Journal of Applied Statistics, 8: 893-907.
  20. Benati, I., Ragazzi, E., Santanera, E., Sella, L. (2013). Gli esiti occupazionali delle politiche formative in Piemonte – 2° rapporto annuale di placement 2012 – Indagine su qualificati e specializzati nell’anno 2011. Torino : Regione Piemonte.
  21. Kluve J. (2010). The effectiveness of European active labor market programs. Labor Economics 17: 904-918.
  22. Lalla M. (2003). Il disegno della seconda indagine sulle condizioni economiche e sociali delle famiglie nella Provincia di Modena. Modena: Università degli Studi di Modena, Materiali di discussione.
  23. Lalla M., Fiorani G. (2004). Strategia di campionamento per l’indagine sulla valutazione dei corsi di formazione. http://www.capp.unimo.it/pubbl/altrepubbl/archivio/LallaFioraniCampionamentoIsfol.pdf.
  24. Lauro C., Ragazzi E. (2011). Sussidiarietà e.. Istruzione e Formazione Professionale. Rapporto sulla Sussidiarietà 2010. Milano: Mondadori Education S.p.A..
  25. Berliri C., Pappalardo C. (2001). La misurazione dell'impatto occupazionale dei programmi formativi, testo disponibile al sito : http://www.lavoro.gov.it/NR/rdonlyres/49AEFE8C-46E6-46CB-920A-A340C39ECEAE/0/012_misurazione_impatto.pdf
  26. Levy P.S., Lemeshow S. (2008). Sampling of populations. Methods and applications, Fourth edition. Hoboken: Wiley.
  27. Martini A., Garibaldi P. (1993). L'informazione statistica per il monitoraggio e la valutazione degli interventi di politica del lavoro. Economia e Lavoro, 3.
  28. Berliri C., Bulgarelli A. e Pappalardo C. (2002). Valutazione della qualità della formazione professionale attraverso la stima di occupabilità. Lavoro e Relazioni Industriali, 1: 25-54.
  29. Martini A., Sisti M. (2009). Valutare il successo delle politiche pubbliche. Metodi e casi. Il Mulino.
  30. Berliri C., De Vincenzi R. e Villante C. (2003). Linee guida per la valutazione degli effetti occupazionali del Fondo sociale europeo 2000-2006. Metodologie per la valutazione di programma. Roma: ISFOL.
  31. Burtless G., Greenberg D. (2004). Evaluating Workforce Program Using Experimental Methods. 2004 National Workforce Investment Colloquium. Arlington, VA.
  32. Ragazzi, E., Nosvelli, M., Sella, L. (2012). Gli esiti occupazionali delle politiche formative in Piemonte – 1° rapporto annuale di placement 2011 – Indagine su qualificati e specializzati nell’anno 2010. Torino: CNR-Ceris and Regione Piemonte.
  33. Card D., Kluve J. e Weber A. (2010). Active Labour Market Policy Evaluations: a Meta-Analysis. The Economic Journal 120: F452-77.
  34. Ragazzi, E., Sella, L. (2013a). Una valutazione di impatto delle politiche formative regionali : il caso piemontese. Working paper Cnr-Ceris, N. 15/2013.
  35. Ragazzi E., Sella L. (2013b). Migration and work: the cohesive role of vocational training policies. Working Paper Ceris-Cnr, N. 16/2013.
  36. Rosenbaum P.R., Rubin D.B. (1983). The Central Role of the Propensity Score in Observational Studies for Causal Effects. Biometrika, 70: 41–55.
  37. Centra M., Falorsi D. a cura di (2007). Strategie di campionamento per il monitoraggio e la valutazione delle politiche. Roma: ISFOL.
  38. Sestito P. (2002). Il mercato del lavoro in Italia: com’è, come sta cambiando. Bari: Laterza.
  39. CGD (2006). When Will We Ever Learn? Washington, DC: Center for Global Development.
  40. Sianesi, B. (2008). Differential effects of active labour market programs for the unemployed. Labour Economics 15: 370-99.
  41. White H. (2008). Of Probits and Participation: The Use of Mixed Methods in Quantitative Impact Evaluation. NONIE Working Paper, n°7.
  42. Cicchitelli G., Herzel A. e Montanari G. E. (1992). Il campionamento statistico. Bologna: Il Mulino. Ciravegna D., Favro-Paris M., Matto M. e Ragazzi E. (1995). La valutazione delle politiche attive del lavoro: esperienze a confronto. Torino: Utet Libreria.
  43. White H. (2009). Theory-based Impact Evaluation: Principles and Practice. 3ie Working Paper, n 3.
  44. White H. (2010). A Contribution to Current Debates in Impact Evaluation. Evaluation 16, n°2: 153-164.
  45. Cochran W.G. (1977). Sampling Techniques, III ed. New York: John Wiley & Sons.
  46. White H. (2011). Impact evaluation. The experience of the Independent Evaluation Group of the World Bank. Independent Evaluation Group, The World Bank.
  47. Falavigna G., Ragazzi E., Sella L. (2013) Parcours Formatifs et Entrée dans le Marché du Travail pour les Femmes. Analyse des Différences Homme-Femme dans le Cas des Politiques de Formation en Piémont, Working paper Cnr-Ceris, N. 13/2013.
  48. Fondazione Brodolini, Istitutoper la Ricerca Sociale (2010) Attività di valutazione in itinere
  49. del POR Marche FSE ob.2 2007/2013, testo disponibile al sito: http://www.europa.marche.it/Portals/0/Documenti/valutazione-programmaoperativo/Rapporto%20di%20valutazione%202010_POR%20Marche%20FSE%202007_2013.pdf

Igor Benati, Elena Ragazzi, Lisa Sella, Evaluating the impact of FSE-funded training policies in Piedmont Region: lessons from an empirical research in "RIV Rassegna Italiana di Valutazione" 56-57/2013, pp. 26-47, DOI:10.3280/RIV2013-056003

   

FrancoAngeli is a member of Publishers International Linking Association a not for profit orgasnization wich runs the CrossRef service, enabing links to and from online scholarly content