School-level factors and student performance in the Iea studies. An example from Timss

Journal title CADMO
Author/s Elisa Caponera, Bruno Losito
Publishing Year 2016 Issue 2015/2
Language English Pages 20 P. 7-26 File size 92 KB
DOI 10.3280/CAD2015-002003
DOI is like a bar code for intellectual property: to have more infomation click here

Below, you can see the article first page

If you want to buy this article in PDF format, you can do it, following the instructions to buy download credits

Article preview

FrancoAngeli is member of Publishers International Linking Association, Inc (PILA), a not-for-profit association which run the CrossRef service enabling links to and from online scholarly content.

Iea international comparative studies traditionally include the use of background questionnaires. Data collected through those questionnaires are central to both international reports and secondary analyses, as they allow to better contextualize student results in the cognitive tests and help identify the school and classroom factors that have a direct or indirect impact on student performance. A systematic review of the literature on Pirls, Timss, and Iccs was conducted upstream, to identify those school, teacher, and classroom factors which are potentially useful predictors of student performance. Such a review highlighted that it is exceedingly difficult to draw causal inferences, as well as to find strong associations between process-related school variables and student achievement. The type of constructs and variables used in the questionnaire development, the way these constructs and variables are operationally defined, the self-reported nature of the collected data, and the kind of data analyses carried out all contribute to explain that difficulty. In order to verify whether the impact of specific school and teacher characteristics varies as a function of the socioeconomic status of students at the school level, a hierarchical multilevel analysis of Timss 2011 data was conducted. Data from the European countries particvipating in the survey were included in the analyses.The analysis measured what proportion of the variance was actually explained by the factors included in the model and whether the impact of the same factors varies in relation to the school socioeconomic background. A separate analysis was conducted for each considered country and the same multi-level regression model was used first on the schools as a whole, and then treating schools with high and low socioeconomic backgrounds (based on average student Ses at school level) as two distinct groups. In most countries, results showed the influence of socioeconomic status at school level for all three groups of schools - all schools, high Ses schools, and low Ses schools. Furthermore, results showed that school and teacher characteristics have different impacts across countries and in relation to school socioeconomic backgrounds.

Keywords: Timss, Pirls, Iccs, school factors, contextual questionnaires

  1. Akiba, M., LeTendre, G.K., Scribner, J.P. (2007), “Teacher Quality, Opportunity Gap, and National Achievement in 46 Countries”, Educational Researcher, 36 (7), pp. 369-387.
  2. Akyüz, G., Berberoglu, G. (2010), “Teacher and Classroom Characteristics and Their Relation to Mathematics Achievement of the Student in the Timss”, New Horizons in Education, 58 (1), pp. 77-95.
  3. Baird, K. (2008), An International Investigation into the Relationship between School Resources, Policy, and Math Performance among Low Socioeconomic Status Students, 3rd Iea International Research Conference 18-20 September, Taipei, Chinese Taipei
  4. Caponera, E., Losito, B. (2011), The Roles of Schools and Communities in Civic and Citizenships Education, AERA Annual Meeting, 8-18 April, New Orleans.
  5. Caponera, E., Losito, B., Mirti, P. (2012), Civic Participation at School and School-based Community Participation, AERA Annual Meeting, 13-17 April, Vancouver.
  6. Chiu, M.M., Xihua, Z. (2008), “Family and Motivation Effects on Mathematics Achievement: Analyses of Students in 41 Countries”, Learning and Instruction, 18 (4), pp. 321-336.
  7. Coleman, J.S. (1975), “Methods and Results in the Iea Studies of Effects of School on Learning”, Review of Educational Research, 45 (3), pp. 335-386.
  8. Coleman, J.S., Campbell, E.Q., Hobson, C.J., McPartland, J., Mood, A.M., Weinfeld, F.D., York, R. (1966), Equality and Educational Opportunity, Washington, DC: US Congressional Printing Office.
  9. Dodeen, H., Hilal, M. (2012), “The Effect of Teacher’s Qualification Practices, and Perceptions on Student Achievement in Timss Mathematics: A Comparison of Two Countries”, International Journal of Testing, 12, pp. 61-77.
  10. Drent M., Meelissen M.R.M., Van der Kleij F.M. (2013), “The Contribution of Timss to the Link between School and Classroom Factors and Student Achievement”, Journal of Curriculum Studies, 45 (2), pp. 198-224.
  11. Goe, L. (2007), The Link between Teacher Quality and Student Outcomes: A Research Synthesis, Washington, DC: National Comprehensive Center for Teacher Quality. Iea (International Association for The Evaluation of Educational Achievement) (1998), Iea Guidebook. Activities Institutions and People. Amsterdam: International Association for the Evaluation of Educational Achievement (Iea).
  12. Ismail, N.A., Awang, H. (2008), “Assessing the Effects of Students’ Characteristics and Attitudes on Mathematics Performance”, Problems of Education in the 21st Century, 9, pp. 34-41.
  13. Levpušček, M.P., Zupančič, M., Sočan, G. (2013), “Predicting Achievement in Mathematics in Adolescent Students. The Role of Individual and Social Factors”, The Journal of Early Adolescence, 33 (4), pp. 523-551.
  14. Luschei, T.F., Chudgar A. (2011), “Teacher, Student Achievement and National Income: A Cross National Examination of Relationships and Interactions”, Prospects, 41, pp. 507-533.
  15. Martin, M.O., Mullis, I.V., Gregory, K.D., Hoyle, C., Shen, C. (2000), Effective Schools in Science and Mathematics: Iea’s Third International Mathematics and Science Study. Chestnut Hill: Timss & Pirls International Study Center, Lynch School of Education, Boston College.
  16. Martin, M.O., Mullis, I.V. (2013), Methods and Procedures in Timss and Pirls 2011. Chestnut Hill, MA: Timss & Pirls International Study Center, Lynch School of Education, Boston College; Amsterdam: International Association for the Evaluation of Educational Achievement (Iea).
  17. McConney, A., Perry, L.B. (2010), “Socioeconomic Status, Self-efficacy, and Mathematics Achievement in Australia: A Secondary Analysis”, Educational Research for Policy and Practice, 9 (2), pp. 77-91.
  18. Wiberg, M., Rolfsman, E. (2013), “School Effectiveness in Science in Sweden and Norway Viewed from a Timss Perspective”, Utbildning och Demokrati, 22 (3), pp. 69-84.
  19. Mullis, I.V., Martin, M.O., Foy, P., Arora, A. (2012a), Timss 2011 International Results in Mathematics. Amsterdam: International Association for the Evaluation of Educational Achievement (Iea).
  20. Mullis, I.V., Martin, M.O., Foy, P., Drucker, K.T. (2012b), Pirls 2011 International Results in Reading. Amsterdam: International Association for the Evaluation of Educational Achievement (Iea).
  21. Oecd (2005), School Factors Related to Quality and Equity. Results from PISA 2000. Paris: Oecd.
  22. Peaker, G.F. (1975), An Empirical Study of Education in Twenty-One Countries: A Technical Report. Stockholm: Almqvist & Wiksell International.
  23. Phan, H.T. (2008), “Correlates of Mathematics Achievement in Developed and Developing Countries: An Hlm Analysis of Timss 2003 Eighth-grade Mathematics Ccores”, Graduate Theses and Dissertations.
  24. Postlethwaite, N. (1967), School Organization and Student Achievement: A Study Based on Achievement in Mathematics in Twelve Countries. Stockholm: Almqvist & Wiksell International.
  25. Postlethwaite, T.N., Ross, K.N. (1992), Effective Schools in Reading. Implication for Educational Planners. Amsterdam: International Association for the Evaluation of Educational Achievement (Iea). Rivkin, S.G., Hanushek, E.A., Kain, J.F. (2005), “Teachers, Schools and Academic Achievement”, Econometrica, 73 (2), pp. 417-458.
  26. Sandoval-Hernández, A., Castejón, A., Aghakasiri, P. (2014), “A Comparison of School Effectiveness Factors for Socially Advantaged and Disadvantaged Students in ten European Countries in Timss 2011”, Šolsko polje, pp. 61-96.
  27. Schagen, I., Twist, L. (2008), Adding Value to Pirls by combining with National Data and using Sophisticated Modeling Techniques, 3rd Iea International Research Conference 18-20 September, Taipei, Chinese Taipei. Schulz, W., Ainley, J., Fraillon, J., Kerr, D., Losito, B. (2010), Iccs 2009 International
  28. Report: Civic Knowledge, Attitudes, and Engagement among Lower-secondary School Students in 38 Countries. Amsterdam: International Association for the Evaluation of Educational Achievement (Iea).
  29. Schulz, W., Fraillon, J., Ainley, J., Van De Gaer, E. (2011), Multi-level Analysis of Factors Explaining Differences in Civic Knowledge, AERA Annual Meeting, 8-18 April, New Orleans.
  30. Shepherd, D. (2013), A Question of Efficiency: Decomposing South African reading Test Scores using Pirls 2006, Stellenbosch University, Department of Economics Working Papers (20/2013).
  31. Sirin, R. (2005), “Socioeconomic Status and Academic Achievement: A Meta-analytic Review of Research”, Review of Educational Research, 75 (3), pp. 417-453.
  32. Sturman, L., Lin, Y. (2011), “Exploring the Mathematics Gap: Timss 2007”, RicercaAzione, 3 (1), pp. 43-58.
  33. Torney-Purta, J., Lehmann, R., Oswald, H., Schulz, W. (2001), Citizenship and Education in Twenty-eight Countries. Civic Knowledge and Engagement at Age Fourteen. Amsterdam: International Association for the Evaluation of Educational Achievement (Iea).
  34. Van Daal, V.H., Begnum, A.C., Solheim, R.G., Adèr, H.J. (2006), “Secondary Analysis of Pirls 2001 Norwegian data1”, in The Second Iea International Research Conference: Proceedings of the IRC-2006. Amsterdam: International Association for the Evaluation of Educational Achievement (Iea), vol. 2, pp. 177-190.
  35. Walker, D.A. (1976), The Iea Six Subject Survey: An Empirical Study of Education in Twenty-One Countries. Amsterdam: International Association for the Evaluation of Educational Achievement (Iea).
  36. Wiberg, M., Rolfsman, E., Laukaityte, I. (2013), School Effectiveness in Mathematics in Sweden and Norway 2003, 2007 and 2011, 5th Iea International Research Conference 26-28 June, Singapore.

Elisa Caponera, Bruno Losito, School-level factors and student performance in the Iea studies. An example from Timss in "CADMO" 2/2015, pp 7-26, DOI: 10.3280/CAD2015-002003