Click here to download

Evaluation of training providers for a new governance of the training system for the unemployed: a proposal for Italian Regions
Journal Title: RIV Rassegna Italiana di Valutazione 
Author/s: Elena Cappellini, Silvia Duranti, Valentina Patacchini, Carla Rampichini, Nicola Sciclone 
Year:  2016 Issue: 65 Language: English 
Pages:  17 Pg. 27-43 FullText PDF:  641 KB
DOI:  10.3280/RIV2016-065003
(DOI is like a bar code for intellectual property: to have more infomation:  clicca qui   and here 


This paper proposes for the Italian context a governance framework, which relies on training providers’ evaluation to regulate the market of agencies and efficiently allocate resources between them. The proposed model is based on three steps, which are described in the paper. The first step consists in the creation of a profiling system that summarizes the level of disadvantage in the labour market of each trainee, based on his probability of (re)employment, estimated on a series of personal characteristics. Such a tool is necessary to correctly evaluate net performance of training operators and to prevent creaming or cherry peaking phenomena. As a second step, the paper proposes the creation of a rating system of providers based on their net performance in terms of employment outcomes; in particular, an econometric approach based on multilevel modelling has been adopted to obtain an aggregation of training providers according to their high, low or medium performance level. As a third step, the paper shows the hypothetical new allocation of resources based on the reward of best performers in terms of employment outcomes, comparing it to the actual one.
Keywords: Rating, Multilevel model, Performance measurement, Training providers, Unemployed.

  1. Gori E., Mealli F., Rampichini C. (1993). Indicatori di efficienza ed efficacia per la valutazione dell’attività di formazione professionale. Statistica. Anno LIII, n. 3.
  2. Goldstein, H. (2003), Multilevel statistical models. London: Arnold.
  3. Gori, E. (2000). La valutazione dei corsi di formazione professionale in Lombardia, Lavoro e Relazioni Industriali, 1n. , pp. 95-109.
  4. Arifil (2013), La Dote Unica Lavoro Il sistema delle fasce ad intensità di aiuto Descrizione della metodologia, Newsletter Arifl N.2 - Ottobre 2013. --Available at: http://www.lavoro.regione.lombardia.it/shared/ccurl/316/991/dgr%20dul_20131004.pdf.
  5. Australian Governament-Disability Employment Services (2013), DES Star Ratings Meth-odology Advice. --Available at: https://docs.employment.gov.au/system/files/doc/other/ disability_employment_services_star_ratings_methodology_advice.pdf
  6. Ballarino G., Checchi D., Fiorio C., Iacus S., Leonardi M. and Porro G. (2011). La valutazione dell’efficacia del "sistema delle doti" della Regione Lombardia: modelli statistici e criticità nella progettazione. Rassegna Italiana di Valutazione, 49: 39-76., DOI: 10.3280/RIV2011-049004.
  7. Berkhof J. and Snijders T. A. B. (2001). Variance Component Testing in Multilevel Models, Journal of Educational and Behavioral Statistics, 26 (2): 133-152., DOI: 10.3102/10769986026002133
  8. Bratti, M. and Checchi D. (2013). Re-testing PISA Students One Year Later: On School Value Added Estimation Using OECD-PISA. IZA Discussion Papers 7722, Institute for the Study of Labor.
  9. Cipollone, P., Montanaro, P. and Sestito P. (2010). Value-Added Measures in Italian High Schools: Problems and Findings. Giornale degli Economisti, 69 (2): 81-114.
  10. Conti E., Duranti S., Sciclone N, and Rampichini C. (2016). The future has early roots: learning outcomes and school effectiveness in Tuscany’s primary education system. In Coppola, G. and O'Higgins, Youth and the Crisis: unemployment, education and health, London: Routledge.
  11. De Simone, G. and Gavosto A. (2013). Patterns of Value-Added Creation in the Transition from Primary to Lower Secondary Education in Italy. FGA Working Paper n. 47, Fondazione Giovanni Agnelli (Turin).
  12. Finn, D. (2009), Differential pricing in contracted out employment programmes: review of international evidence. In: Research report . Department for Work and Pensions.
  13. Grilli, L. and Rampichini, C. (2009). Multilevel models for the evaluation of educational institutions: a review. In Bini M., Monari P., Piccolo D., Salmaso L., Statistical Methods for the Evaluation of Educational Services and Quality of Products. Heidelberg: Physica-Verlag HD.
  14. Hasluck, C. (2004), Targeting Services in the Individual Customer Strategy: the role of profiling. A review of research evidence, Report for Jobcentre Plus,Warwick.
  15. Lam, M. (2007), Performance measures for welfare-to-work programmes: The relevance of Australian star ratings to the UK, Work Directions UK, London.
  16. O’Connell, P. J., MCGuinness, S., Kely, E., Walsh, J. (2009). National profiling of the unemployed in Ireland. Research series number 10, The Economic snd Social Research Institute, Dublin.
  17. OECD (2005), “Labour Market Programmes and Activation strategies: Evaluating the Impacts”, in OECD Employment Outlook, OECD Publishing.
  18. Paccagnella, O. (2006), Comparing vocational training courses through a discrete-time multilevel hazard model, Statistical Modelling, 6: 119–139.
  19. Raudenbush S. and Willms, J. (1995), The estimation of school effects, Journal of Educational and Behavioral Statistics, 20: 307-335.
  20. Regione Toscana, Giunta Regionale, Osservatorio Regionale del mercato del lavoro (1997). Monitoraggio e valutazione ex post dell'attività di formazione professionale- Anno formativo 1993-94. Flash Lavoro, Quaderni 46. Regione Toscana.
  21. Rudolph, H. and Konle-Seidl, R. (2005), Profiling for Better Services . Report on the European Profiling Seminar. Nuremberg, January 12-14.
  22. StataCorp (2013), Multilevel Mixed-Effects Reference Manual, Stata: Release 13. Statistical Software. College Station, TX: StataCorp LP.
  23. Struyven, L. and Steurs, G. (2005), Design and redesign of a quasi-market for the reintegration of jobseekers: empirical evidence from Australia and the Netherlands, Journal of European Social Policy, 15 (3): 211–29.
  24. Wooldridge J. M. (2013), "A Binary Dependent Variable: The Linear Probability Model". In Wooldridge J. M. Introductory Econometrics: A Modern Approach, Mason, OH: South-Western.
  25. Goldstein, H. (1997) Methods in School Effectiveness Research, School Effectiveness & School Improvement, 8 (4): 369-395.

Elena Cappellini, Silvia Duranti, Valentina Patacchini, Carla Rampichini, Nicola Sciclone, in "RIV Rassegna Italiana di Valutazione" 65/2016, pp. 27-43, DOI:10.3280/RIV2016-065003

   

FrancoAngeli is a member of Publishers International Linking Association a not for profit orgasnization wich runs the CrossRef service, enabing links to and from online scholarly content