How Journalists and Researchers Communicate Results of International Large-Scale Assessments

Journal title CADMO
Author/s Oren Pizmony-Levy, Judith Torney-Purta
Publishing Year 2018 Issue 2018/1
Language English Pages 15 P. 51-65 File size 177 KB
DOI 10.3280/CAD2018-001007
DOI is like a bar code for intellectual property: to have more infomation click here

Below, you can see the article first page

If you want to buy this article in PDF format, you can do it, following the instructions to buy download credits

Article preview

FrancoAngeli is member of Publishers International Linking Association, Inc (PILA), a not-for-profit association which run the CrossRef service enabling links to and from online scholarly content.

Organizations conducting international large-scale assessments (ILSAs), such as PISA and TIMSS, rely on the media to disseminate the results. Ex¬amination of the nature of media coverage of ILSAs is limited, however. The paper presents a multi-country analysis of media coverage of OECD-PISA 2012. Using a standardized protocol and samples of news articles from 20 countries, we show how newspapers reduce the complexity of ILSAs into a simple story of international competition. The paper also documents that the findings in subject areas such as the IEA’s civic education studies rarely receive attention from journalists. These studies rely on the initial reports and also on secondary analysis of their data disseminated through channels such as scholarly journal articles. We consider the balance between these approaches as ways to engage the public, educators and education policy makers using the concept of communities of practice.

Keywords: International assessments; education journalists; mathematics education; science education; civic education; IEA; OECD.

  1. Bradburn, N.M., Gilford, D.M. (1990), A Framework and Principles for International Comparative Studies in Education. Washington (DC): National Academies Press.
  2. DeBoer, J. (2010), “Why the Fireworks? Theoretical Perspectives on the Explosion in International Assessments”, International Perspectives on Education and Society, 13, pp. 297-330.
  3. Dixon, R., Arndt, C., Mullers, M., Vakkuri, J., Engblom‐Pelkkala, K., Hood, C. (2013), “A Lever for Improvement or a Magnet for Blame? Press and Political Responses to International Educational Rankings in Four EU Countries”, Public Administration, 91, pp. 484-505.
  4. Ferree, M.M., Gamson, W.A., Rucht, D., Gerhards, J. (2002), Shaping Abortion Discourse: Democracy and the Public Sphere in Germany and the United States. New York: Cambridge University Press.
  5. Garcia-Cabrero, B., Sandoval-Hernandez, B., Treviño-Villarreal, E., Diazgranados-Ferrans, S., Perez-Martinez, M. (eds) (2018), Civics and Citizenship. Theoretical Models and Experiences in Latin America. Rotterdam: Sense Publishers.
  6. Green Saraisky, N. (2016), “Analyzing Public Discourse: Using Media Content Analysis to understand the Policy Process”, Current Issues in Comparative Education, 18 (1), pp. 26-41.
  7. Knodel, P., Martens, K., Niemann, D. (2013), “PISA as an Ideational Roadmap for Policy Change: Exploring Germany and England in a Comparative Perspective”, Globalisation, Societies and Education, 11 (3), pp. 421-441.
  8. Knowles, R., Torney-Purta, J., Barber, C. (2018), “Enhancing Citizenship Learning with International Comparative Research: Analyses of IEA Civic Education Datasets”, Citizenship Teaching and Learning, 13, pp. 7-30, https://doi.org/10.1386/ctl.13.1.7_1.
  9. Lave, J., Wenger, E. (1991), Situated Learning: Legitimate Peripheral Participation. Cambridge: Cambridge University Press.
  10. Lenkeit, J., Chan, J., Hopfenbeck, T.N., Baird, J.-A. (2015), “A Review of the Representation of PIRLS Related Research in Scientific Journals”, Educational Research Review, 16, pp. 102-115.
  11. Martens, K., Niemann, D. (2013), “When do Numbers count? The Differential Impact of the PISA Rating and Ranking on Education Policy in Germany and the US”, German Politics, 22 (3), pp. 314-332.
  12. Mislevy, R. (1995), “What can we learn from International Assessments?”, Educational Evaluation and Policy Analysis, 17, pp. 419-437.
  13. National Research Council (2002), Methodological Advances in Cross-national Surveys of Educational Achievement. Washington (DC): National Academies Press.
  14. National Research Council (2003), Understanding Others, Educating ourselves: Getting more from International Comparative Studies in Education. Washington (DC): National Academies Press.
  15. Owens, T.L. (2013), “Thinking beyond League Tables: A Review of Key PISA Research Questions”, in H.D. Meyer, A. Benavot (eds). PISA, Power, and Policy: The Emergence of Global Educational Governance. Oxford (UK): Symposium Books Ltd.
  16. Papanastasiou, C., Papanastasiou, E.C. (2011), “IEA International Research Conferences (IRC) from 2004 to 2008”, in C. Papanastasiou, T. Plomp, E.C. Papanastasiou (eds), IEA 1958-2008: 50 Years of Experiences and Memories. Nicosia (Cyprus): Cultural Center of the Kykkos Monastery.
  17. Pizmony-Levy, O. (2017), “Big Comparisons, Little Knowledge: Public Engagement with PISA in the United States and Israel”, International Perspectives on Education and Society, 31, pp. 125-156. Pizmony-Levy, O. (forthcoming), “Compare globally, interpret locally: International Assessments and News Media in Israel”, Globalisation, Societies and Education.
  18. Pizmony-Levy, O., Harvey, J.H., Schmidt, W., Noonan, R., Engel, L.J., Feuer, M., Chatterji, M., Torney-Purta, J. (2014), “On the Merits of, and Myths about, International Assessments”, Quality Assurance in Education, 22 (4), pp. 319-338.
  19. Pons, X. (2011), “What do we really learn from PISA? The Sociology of Its Reception in Three European Countries (2001-2008)”, European Journal of Education, 46 (4), pp. 540-548.
  20. Ramirez, F.O., Luo, X., Schofer, E., Meyer, J.W. (2006), “Student Achievement and National Economic Growth”, American Journal of Education, 113 (1), pp. 1-29.
  21. Reichert, F., Chen, J., Torney-Purta, J. (2018), “Profiles of Adolescents’ Perceptions of Democratic Classroom Climate and Students’ Influence: The Effect of School and Community Contexts”, Journal of Youth and Adolescence (online first), pp. 1-20,
  22. Schmidt, W., Huang, R.T., Cogan, L.S., Solone, M. (2018), Schooling across the Globe: What we have learned from 60 Years of Mathematics and Science International Assessments. Cambridge (UK): Cambridge University Press, in press.
  23. Schulz, W., Ainley, J., Fraillon, J., Kerr, D., Losito, B. (2010), ICCS 2009 International Report: Civic Knowledge, Attitudes, and Engagement among Lower-Secondary School Students in 38 Countries. Amsterdam (The Netherlands): International Association for the Evaluation of Educational Achievement (IEA).
  24. Singer, J.D., Braun, H.I. (2018), “Testing International Education Assessments”, Science, 360 (6384), pp. 38-40.
  25. Singer, J.D., Braun, H.I., Chudowsky, N. (eds) (2018), International Education Assessments: Cautions, Conundrums, and Common Sense. Washington (DC): National Academy of Education.
  26. Stack, M. (2007), “Representing School Success and Failure: Media Coverage of International Tests”, Policy Futures in Education, 5 (1), pp. 100-110.
  27. Steiner-Khamsi, G. (2003), “The Politics of League Tables”, Journal of Social Science Education, 2 (1), pp. 1-6.
  28. Takayama, K. (2007), “A Nation at Risk Crosses the Pacific: Transnational Borrowing of the US Crisis Discourse in the Debate on Education Reform in Japan”, Comparative Education Review, 51 (4), pp. 423-446.
  29. Toots, A., Lauri, T. (2015), “Institutional and Contextual Factors of Quality in Civic and Citizenship Education: Exploring Possibilities of Qualitative Comparative Analysis”, Comparative Education, 51 (2), pp. 247-275.
  30. Torney-Purta, J. (1990), “International Comparative Research in Education: Its Role in Educational Improvement in the US”, Educational Researcher, 19, pp. 32-35.
  31. Torney-Purta, J., Lehmann, R., Oswald, H., Schulz, W. (2001), Citizenship and Education in Twenty-eight Countries: Civic Knowledge and Engagement at Age 14. Amsterdam (The Netherlands): International Association for the Evaluation of Educational Achievement (IEA).
  32. Entman, R.M. (1993), “Framing: Toward Clarification of a Fractured Paradigm”, Journal of Communication, 43, pp. 51-58.

  • Local meanings of international student assessments: an analysis of media discourses of PISA in China, 2010-2016 Zi Hu, in Compare: A Journal of Comparative and International Education /2022 pp.419
    DOI: 10.1080/03057925.2020.1775553
  • The Opt-Out Movement and the Reform Agenda in U.S. Schools Oren Pizmony-Levy, Bob Lingard, David Hursh, in Teachers College Record: The Voice of Scholarship in Education /2021 pp.1
    DOI: 10.1177/016146812112300501
  • The perceived quality, fairness of and corruption in education in Europe Bram Spruyt, Filip Van Droogenbroeck, Leandros Kavadias, in Oxford Review of Education /2024 pp.272
    DOI: 10.1080/03054985.2022.2136152
  • Differenze di genere e misconcezioni nell'operare con le percentuali: evidenze dalle prove INVALSI Chiara Giberti, in CADMO 2/2019 pp.97
    DOI: 10.3280/CAD2018-002007

Oren Pizmony-Levy, Judith Torney-Purta, How Journalists and Researchers Communicate Results of International Large-Scale Assessments in "CADMO" 1/2018, pp 51-65, DOI: 10.3280/CAD2018-001007