Evaluating the impact of FSE-funded training policies in Piedmont Region: lessons from an empirical research

Journal title RIV Rassegna Italiana di Valutazione
Author/s Igor Benati, Elena Ragazzi, Lisa Sella
Publishing Year 2014 Issue 2013/56-57
Language Italian Pages 22 P. 26-47 File size 169 KB
DOI 10.3280/RIV2013-056003
DOI is like a bar code for intellectual property: to have more infomation click here

Below, you can see the article first page

If you want to buy this article in PDF format, you can do it, following the instructions to buy download credits

Article preview

FrancoAngeli is member of Publishers International Linking Association, Inc (PILA), a not-for-profit association which run the CrossRef service enabling links to and from online scholarly content.

The paper presents an impact assessment of vocational training courses, which the Piedmont Region co-financed by the ESF, both discussing the methodological feasibility and proposing a quasi-experimental evaluation strategy based on the medium-term job placement of vocational training students. The authors illustrate the operational design and the implementation of the assessment, with particular attention to the identification of a proper control sample, finally identified on the basis of the course noshows and drop-outs. The paper proposes an accurate description of gross and net impact evaluation strategies. The gross impact evaluation is carried out through an analysis of the employment outcomes in the mid-term, while the net impact is estimated through net employment differentials between the main and the counterfactual sample, as well as through a multivariate probit analysis, which investigates the effects of individual characteristics on the probability of being employed a year later the end of the course. The selection bias problem is discussed, illustrating the strategy adopted to identify and counteract its effects. In conclusion, the authors distill this research experience through a series of lessons learned about both the methods and the evaluation assessment of training effectiveness. Key words: vocational training; impact evaluation; counterfactual analysis; sampling; multivariate analysis; selection bias.

  1. Friedlander D., Greenberg D.H. e Robins P.K. (1997). Evaluating government training programs for the economically disadvantaged. Journal of Economic Literature 4: 1809-55.
  2. Heckman J.J. (1976). The common structure of statistical models of truncation, sample selection, and limited dependent variables and a simple estimator for such models. Annals of Economic and Social Measurement (NBER) 5, n°4.
  3. Heckman J.J., LaLonde, R.J., e J.A. Smith (1999). The economics and econometrics of active labour market programs. In Ashenfelter O., Card D., a cura di, The Handbook of Labour Economics, vol. 3, Amsterdam: North-Holland.
  4. Hollenbeck K., Huang W.J. (2003). Net Impact and Benefit-Cost Estimates of the Workforce Development System in Washington State. Upjohn Institute Technical Report, n°TR03-018.
  5. Hollenbeck K. (2005). On the Use of Administrative Data for Workforce Development Program Evaluation. ETA Occasional Paper (U.S. Department of Labor, Employment and Training Administration), n 2005-09.
  6. Hollenbeck K., Schroeder D., King C. T. e Huang W.J. (2005). Net Impact Estimates for Services Provided through the Workforce Investment Act. ETA Occasional Paper 2005-2006.
  7. Hollenbeck K., Huang W.J. (2006). Net Impact and Benefit-Cost Estimates of the Workforce Development System in Washington State. Upjohn Institute Technical Report (Upjohn Institute for Employment Research), n°06-020.
  8. Hollenbeck K., Huang W.J. (2007). Workforce Program Performance Indicators for The Commonwealth of Virginia. Upjohn Institute Technical Report (W.E. Upjohn Institute for Employment Research), n°08-024.
  9. IEG (2006). Impact Evaluation Experience of the Independent Evaluation Group of the World Bank. Washington, DC: World Bank.
  10. IReR (2006). Il ruolo del FSE nelle politiche formative regionali. Scenari per il 2006.
  11. http://www.consiglio.regione.lombardia.it/documents/38960/9400/fondo+soc+europeo+sint+consiglio.pdf.
  12. IRPET (2011). Valutazione di impatto degli interventi formativi per i disoccupati e gli inoccupati. Il caso della Toscana, testo disponibile al sito: http://www.irpet.it/storage/pubblicazioneallegato/341_StudixConsiglio%207_11%20completo.pdf.
  13. ISFOL (2003). Linee guida per la valutazione degli effetti occupazionali del Fondo sociale europeo
  14. 2000-2006. Roma: ISFOL, Struttura nazionale di valutazione Fse.
  15. Kluve J. (2010). The effectiveness of European active labor market programs. Labor Economics 17: 904-918.
  16. Lalla M. (2003). Il disegno della seconda indagine sulle condizioni economiche e sociali delle famiglie nella Provincia di Modena. Modena: Università degli Studi di Modena, Materiali di discussione.
  17. Lalla M., Fiorani G. (2004). Strategia di campionamento per l’indagine sulla valutazione dei corsi di formazione. http://www.capp.unimo.it/pubbl/altrepubbl/archivio/LallaFioraniCampionamentoIsfol.pdf.
  18. Lauro C., Ragazzi E. (2011). Sussidiarietà e.. Istruzione e Formazione Professionale. Rapporto sulla Sussidiarietà 2010. Milano: Mondadori Education S.p.A..
  19. Levy P.S., Lemeshow S. (2008). Sampling of populations. Methods and applications, Fourth edition. Hoboken: Wiley.
  20. Martini A., Garibaldi P. (1993). L'informazione statistica per il monitoraggio e la valutazione degli interventi di politica del lavoro. Economia e Lavoro, 3.
  21. Martini A., Sisti M. (2009). Valutare il successo delle politiche pubbliche. Metodi e casi. Il Mulino.
  22. Ragazzi, E., Nosvelli, M., Sella, L. (2012). Gli esiti occupazionali delle politiche formative in Piemonte – 1° rapporto annuale di placement 2011 – Indagine su qualificati e specializzati nell’anno 2010. Torino: CNR-Ceris and Regione Piemonte.
  23. Ragazzi, E., Sella, L. (2013a). Una valutazione di impatto delle politiche formative regionali : il caso piemontese. Working paper Cnr-Ceris, N. 15/2013.
  24. Ragazzi E., Sella L. (2013b). Migration and work: the cohesive role of vocational training policies. Working Paper Ceris-Cnr, N. 16/2013.
  25. Rosenbaum P.R., Rubin D.B. (1983). The Central Role of the Propensity Score in Observational Studies for Causal Effects. Biometrika, 70: 41–55.
  26. Sestito P. (2002). Il mercato del lavoro in Italia: com’è, come sta cambiando. Bari: Laterza.
  27. Sianesi, B. (2008). Differential effects of active labour market programs for the unemployed. Labour Economics 15: 370-99.
  28. White H. (2008). Of Probits and Participation: The Use of Mixed Methods in Quantitative Impact Evaluation. NONIE Working Paper, n°7.
  29. White H. (2009). Theory-based Impact Evaluation: Principles and Practice. 3ie Working Paper, n 3.
  30. White H. (2010). A Contribution to Current Debates in Impact Evaluation. Evaluation 16, n°2: 153-164.
  31. White H. (2011). Impact evaluation. The experience of the Independent Evaluation Group of the World Bank. Independent Evaluation Group, The World Bank.
  32. Antonelli G., Nosvelli M. (2002). Monitoraggio e valutazione delle politiche del lavoro per una “nuova economia”. Bologna: Il Mulino.
  33. Barca F. (2009). An agenda for a Reformed Cohesion Policy. A place-based approach to meeting European Union challenges and expectations, Independent report prepared at the request of Danuta Hübner, Commissioner for Regional Policy, testo disponibile al sito : http://ec.europa.eu/regional_policy/archive/policy/future/pdf/report_barca_v0306.pdf
  34. Battistin E., Rettore. E. (2002). Testing for programme effects in a regression discontinuity design with imperfect compliance. Journal of the Royal Statistical Society. Series A, volume165, n 1: 39-57.
  35. Bell S.H., Orr L.L., Blomquist J.D., e Cain G.G.. (1995) Program Applicants as a Comparison Group in Evaluating Training Programs: Theory and a Test. Kalamazoo, MI: W.E. Upjohn Institute for Employment Research.
  36. Bellio R., Gori B. (2003). Impact evaluation of job training programs: selection bias in multilevel models. Journal of Applied Statistics, 8: 893-907.
  37. Benati, I., Ragazzi, E., Santanera, E., Sella, L. (2013). Gli esiti occupazionali delle politiche formative in Piemonte – 2° rapporto annuale di placement 2012 – Indagine su qualificati e specializzati nell’anno 2011. Torino : Regione Piemonte.
  38. Berliri C., Pappalardo C. (2001). La misurazione dell'impatto occupazionale dei programmi formativi, testo disponibile al sito : http://www.lavoro.gov.it/NR/rdonlyres/49AEFE8C-46E6-46CB-920A-A340C39ECEAE/0/012_misurazione_impatto.pdf
  39. Berliri C., Bulgarelli A. e Pappalardo C. (2002). Valutazione della qualità della formazione professionale attraverso la stima di occupabilità. Lavoro e Relazioni Industriali, 1: 25-54.
  40. Berliri C., De Vincenzi R. e Villante C. (2003). Linee guida per la valutazione degli effetti occupazionali del Fondo sociale europeo 2000-2006. Metodologie per la valutazione di programma. Roma: ISFOL.
  41. Burtless G., Greenberg D. (2004). Evaluating Workforce Program Using Experimental Methods. 2004 National Workforce Investment Colloquium. Arlington, VA.
  42. Card D., Kluve J. e Weber A. (2010). Active Labour Market Policy Evaluations: a Meta-Analysis. The Economic Journal 120: F452-77.
  43. Centra M., Falorsi D. a cura di (2007). Strategie di campionamento per il monitoraggio e la valutazione delle politiche. Roma: ISFOL.
  44. CGD (2006). When Will We Ever Learn? Washington, DC: Center for Global Development.
  45. Cicchitelli G., Herzel A. e Montanari G. E. (1992). Il campionamento statistico. Bologna: Il Mulino. Ciravegna D., Favro-Paris M., Matto M. e Ragazzi E. (1995). La valutazione delle politiche attive del lavoro: esperienze a confronto. Torino: Utet Libreria.
  46. Cochran W.G. (1977). Sampling Techniques, III ed. New York: John Wiley & Sons.
  47. Falavigna G., Ragazzi E., Sella L. (2013) Parcours Formatifs et Entrée dans le Marché du Travail pour les Femmes. Analyse des Différences Homme-Femme dans le Cas des Politiques de Formation en Piémont, Working paper Cnr-Ceris, N. 13/2013.
  48. Fondazione Brodolini, Istitutoper la Ricerca Sociale (2010) Attività di valutazione in itinere
  49. del POR Marche FSE ob.2 2007/2013, testo disponibile al sito: http://www.europa.marche.it/Portals/0/Documenti/valutazione-programmaoperativo/Rapporto%20di%20valutazione%202010_POR%20Marche%20FSE%202007_2013.pdf

  • Including adolescent migrants in school through VET approach: evidence from a pilot action in Italy Valentina Lamonica, Elena Ragazzi, Lisa Sella, in Empirical Research in Vocational Education and Training 6/2020
    DOI: 10.1186/s40461-020-00092-x
  • I dati amministrativi per la valutazione delle politiche: riscontri dall'esperienza piemontese sul FSE Elena Ragazzi, Lisa Sella, in RIV Rassegna Italiana di Valutazione 60/2015 pp.123
    DOI: 10.3280/RIV2014-060008
  • Données administratives et évaluation des politiques régionales Elena Ragazzi, Lisa Sella, in Revue d’Économie Régionale & Urbaine /2018 pp.509
    DOI: 10.3917/reru.182.0509

Igor Benati, Elena Ragazzi, Lisa Sella, Valutare l’impatto della formazione professionale sull’inserimento lavorativo: lezioni da una ricerca in Regione Piemonte in "RIV Rassegna Italiana di Valutazione" 56-57/2013, pp 26-47, DOI: 10.3280/RIV2013-056003