The questionnaire on factual and political knowledge: a review of the literature

Journal title SOCIOLOGIA E RICERCA SOCIALE
Author/s Federica Cagnoli
Publishing Year 2024 Issue 2024/133
Language English Pages 21 P. 46-66 File size 252 KB
DOI 10.3280/SR2024-133003
DOI is like a bar code for intellectual property: to have more infomation click here

Below, you can see the article first page

If you want to buy this article in PDF format, you can do it, following the instructions to buy download credits

Article preview

FrancoAngeli is member of Publishers International Linking Association, Inc (PILA), a not-for-profit association which run the CrossRef service enabling links to and from online scholarly content.

Political and factual knowledge are central concepts for political attitudes, civic competence, and the like. Although they have been studied for decades and employed as dependent or independent variables, a significant theme has not been analysed in detail: The construction of knowledge questionnaires. Through a lit- erature review, this article contributes to this discussion by presenting issues in questionnaires that hinder the study of this knowledge. Several significant themes have emerged to help implement questionnaires, ranging from the knowledge gender gap to online misbehaviour. Yet, the literature also emphasises the need for delving into some of these issues and including different countries in the analysis

  1. Aapor – American Association for Public Opinion Research (2022), Best Practices for Survey Research, pp. 1-9, available at -- https://aapor.org/wp-content/uploads/2023/06/Sur-vey-Best-Practices.pdf.
  2. M. Abrajano (2015), «Reexamining the “Racial Gap” in Political Knowledge», The Journal of Politics, 77, 1, pp. 44-54, DOI: 10.1086/678767
  3. A. Al-Bahrani, J. Weathers, D. Patel (2019), «Racial Differences in the Returns to Financial Lit- eracy Education», Journal of Consumer Affairs, 53, 2, pp. 572-99,
  4. J. Barabas, J. Jerit, W. Pollock, C. Rainey (2014), «The Question(s) of Political Knowledge», American Political Science Review, 108, 4, pp. 840-55, DOI: 10.1017/S0003055414000392
  5. F. Biolcati, F. Martire (2018), «La survey tra crisi e innovazione», Sociologia e ricerca sociale, 39, 116, pp. 8-19, DOI: 10.3280/SR2018-116002
  6. J. Jerit, J. Barabas, T Bolsen (2006), «Citizens, Knowledge, and the Information Environ- ment», American Journal of Political Science, 50, 2, pp. 266-82,
  7. S. Booth-Kewley, G.E. Larson, D.K. Miyoshi (2007), «Social desirability effects on comput- erized and paper-and-pencil questionnaires», Computers in Human Behavior, 23, 1, pp. 463-77,
  8. J.D. Brown (2012), «Understanding the better than average effect: Motives (still) matter», Per- sonality and Social Psychology Bulletin, 38, pp. 209-19, DOI: 10.1177/0146167211432763
  9. C.M. Burnett (2016), «Exploring the difference in participants’ factual knowledge between online and in-person survey modes», Research & Politics, 3, 2, available at DOI: 10.1177/2053168016654326
  10. N. Burns, K.L. Schlozman, S. Verba (2001), The Private Roots of Public Action, Cam- bridge-London, Harvard University Press, DOI: 10.4159/9780674029088
  11. S. Clifford, J. Jerit (2016), «Cheating on Political Knowledge Questions in Online Surveys: An Assessment of the Problem and Solutions», Public Opinion Quarterly, 80, 4, pp. 858-87,
  12. C.J. Cohen, M.D. Luttig (2020), «Reconceptualizing Political Knowledge: Race, Ethnic- ity, and Carceral Violence», Perspectives on Politics, 18, 3, pp. 805-18, DOI: 10.1017/S1537592718003857
  13. L.J. Cronbach (1946), «Response Sets and Test Validity», Educational and Psychological Measurement, 6, 4, pp. 475-94, DOI: 10.1177/001316444600600405
  14. M. DeBell (2022), «Measuring Political Knowledge and Not Search Proficiency in Online Sur- veys», International Journal of Public Opinion Research, 34, 1, p. edac002,
  15. M.X. Delli Carpini, S. Keeter (1993), «Measuring Political Knowledge: Putting First Things First», American Journal of Political Science, 37, 4, pp. 1179–1206, available at DOI: 10.2307/2111549
  16. M.X. Delli Carpini, S. Keeter (1996), What Americans know about politics and why it matters, New Haven, Yale University Press.
  17. K. Dolan (2011), «Do women and men know different things? Measuring gender differ- ences in political knowledge», The Journal of Politics, 73, 1, pp. 97-107, DOI: 10.1017/S0022381610000897
  18. J.K. Dow (2009), «Gender Differences in Political Knowledge: Distinguishing Characteris- tics-Based and Returns-Based Differences», Political Behavior, 31, 1, pp. 117-36,
  19. J. Ehrlinger, D. Dunning (2003), «How chronic self-views influence (and potentially mislead) estimates of performance», Journal of Personality and Social Psychology, 84, pp. 5-17, DOI: 10.1037/0022-3514.84.1.5
  20. G. Hempel (1952), Fundamentals of concept formation in empirical science, Chicago, University of Chicago Press; tr. it. La formazione dei concetti e delle teorie nella scienza em- pirica, Milano, Feltrinelli, 1961.
  21. C.G. Hempel (1966), Philosophy of Natural Science, Englewood Cliffs, Prentice-Hall; tr. it.
  22. Filosofia delle scienze naturali, Bologna, il Mulino, 1980.
  23. C.G. Hempel, P. Oppenheim (1948), «Studies in the logic of explanation», Philosophy of science, 15, 2, pp. 135-75, DOI: 10.1086/286983
  24. F. Leonardi (1981), «La dissoluzione dello strutturalismo olistico», Sociologia e ricerca socia- le, 2, 6, pp. 7-35.
  25. R. Leroux (2020), «Raymond Boudon: genèse d’un projet scientifique», Revue européenne des science sociales, 58, 1, pp. 209-20,
  26. C. Lombardo (2018), Un realismo «pane e burro»?, in A. Fasanella, C. Lombardo (a c. di), Tra la logica della scienza e la pratica della ricerca. Lezioni dalla storia e dalla metodologia della scienza, Milano, FrancoAngeli.
  27. E. Mach (1883), Die Mechanik in ihrer entwicklung historisch-kritisch dargenstellt, Leipzig, Brockhaus; tr. it. La meccanica nel suo sviluppo storico-criticofo, Torino, Boringhieri, 1968.
  28. R. Pawson (2009), On the Shoulders of Merton: Boudon as The Modern Guardian of Middle- Range Theory, in M. Cherkaoui, P. Hamilton (eds.), Raymond Boudon: A Life in Sociology, Oxford, Bardwell Press.
  29. H. Poincaré (1902), La Science et l’hypotèse, Paris, Flammarion; tr. it. La scienza e l’ipotesi, Roma, Signorelli, 1976.
  30. K. Popper (1935), Logik der Forschung. Zur Erkenntnistheorie der modernen Naturwissen- schaft, Wien, Julius Springer Verlag; tr. it. La logica della scoperta scientifica. Il carattere autocorrettivo della scienza, Torino, Einaudi, 1984.
  31. M. Priarolo (2011), Il determinismo. Storia di un’idea, Roma, Carocci.
  32. G. Simmel (1890), Über soziale Differenzierung. Soziologische und psychologische Untersu- chungen, Leipzig, Duncker & Humblot; tr. it. La differenziazione sociale, Bari, Laterza, 1982.
  33. G. Simmel (1907), Die Probleme der Geschichtsphilosophie. Eine erkenntnistheoretische Stu- die, Leipzig, Duncker & Humblot; tr. it. I problemi della filosofia della storia, Casale Mon- ferrato, Marietti, 1982.
  34. R. Swedberg (2018), «How to use Max Weber’s ideal type in sociological analysis», Journal of Classical Sociology, 18, 3, pp. 181-96, DOI: 10.1177/1468795X17743643
  35. M. Weber (1904), Die «Objektivität» sozialwissenschaftlicher und sozialpolitischer Erkennt- nis, in M. Weber (1922), Gesammelte Aufsatze zur Wissenschaftlicher, Tübingen, Verlag
  36. J.C.B. Mohr; tr. it. L’«oggettività» conoscitiva della scienza sociale e della politica sociale, in Il metodo delle scienze storico-sociali, Torino, Einaudi, 1967.
  37. M. Weber (1922), Wirtschaft und Gesellschaft, Tübingen, Verlag J.C.B. Mohr; tr. it. Economia e società, Milano, Comunità, 1961.
  38. M. Ferrín, M. Fraile, G. García-Albacete (2017), «The gender gap in political knowledge: Is it all about guessing? An experimental approach», International Journal of Public Opinion Research, 29, 1, pp. 111-32,
  39. M. Ferrín, M. Fraile, G. García-Albacete (2018), «Is it simply gender? Content, format, and time in political knowledge measures», Politics & Gender, 14, 2, pp. 162–185, available at DOI: 10.1017/S1743923X1700023X
  40. A.T. Fiore, C. Cheshire, L. Shaw Taylor, G.A. Mendelsohn (2014), «Incentives to participate in online research: an experimental examination of “surprise” incentives», in Proceedings of the Sigchi Conference on Human Factors in Computing Systems, New York, Association for Computing Machinery (Chi ‘14), pp. 3433-42, DOI: 10.1145/2556288.2557418
  41. J. Fitzgerald (2013), «What does “political” mean to you?», Political Behavior, 35, 3, pp. 453- 79,
  42. B. Frijns, A. Gilbert, A. Tourani-Rad (2014), «Learning by doing: the role of financial expe- rience in financial literacy», Journal of Public Policy, 34, 1, pp. 123-54, DOI: 10.1017/S0143814X13000275
  43. A. Gooch, L. Vavreck (2019), «How Face-to-Face Interviews and Cognitive Skill Affect Item Non-Response: A Randomized Experiment Assigning Mode of Interview», Political Sci- ence Research and Methods, 7, 1, pp. 143-62,
  44. T. Gummer, T. Kunz (2022), «Relying on External Information Sources When Answering Knowledge Questions in Web Surveys», Sociological Methods & Research, 51, 2, pp. 816- 36, DOI: 10.1177/0049124119882470
  45. A.L. Holbrook, J.A. Krosnick (2010), «Social desirability bias in voter turnout reports: Tests using the item count technique», Public Opinion Quarterly, 74, 1, pp. 37-67,
  46. C. Jensen, J.P.F. Thomsen (2014), «Self-reported cheating in web surveys on political knowl- edge», Quality & Quantity, 48, 6, pp. 3343-54,
  47. S.A. Jessee (2017), «“Don’t know” responses, personality, and the measurement of political knowledge», Political Science Research and Methods, 5, 4, pp. 711-31,
  48. D. Kahneman (2003), «A perspective on judgment and choice: Mapping bounded rationality»,
  49. American Psychologist, 58, pp. 697-720, DOI: 10.1037/0003-066X.58.9.697
  50. Y. Krupnikov, S. Piston, N.M. Bauer (2016), «Saving Face: Identifying Voter Responses to Black Candidates and Female Candidates», Political Psychology, 37, 2, pp. 253-73,
  51. M. Kuhn, M. Schularick, U.I. Steins (2020), «Income and Wealth Inequality in America, 1949–
  52. 2016», Journal of Political Economy, 128, 9, pp. 3469-519, DOI: 10.1086/708815
  53. D.L. Lasorsa (2009), «Political interest, political knowledge, and evaluations of political news sources: their interplay in producing context effects», Journalism and Mass Communica- tion Quarterly, 86, 3, pp. 533-44.
  54. M.K. Lizotte, A.H. Sidman (2009), «Explaining the Gender Gap in Political Knowledge», Pol- itics & Gender, 5, 2, pp. 127-51, DOI: 10.1017/S1743923X09000130
  55. R.C. Luskin, J.G. Bullock (2011), «“Don’t know” means “don’t know”: dk responses and the public’s level of political knowledge», The Journal of Politics, 73, 2, pp. 547-57, DOI: 10.1017/S0022381611000132
  56. A. Marradi (2019), Tutti redigono questionari: ma è davvero così facile?, Milano, FrancoAngeli.
  57. M.K. Miller (2019), «Who knows more about politics? A dual explanation for the gender gap», American Politics Research, 47, 1, pp. 174-88, DOI: 10.1177/1532673X18803890
  58. D. Moher, A. Liberati, J. Tetzlaff, D.G. Altman, Prisma Group (2010), «Preferred reporting items for systematic reviews and meta-analyses: the Prisma statement», International Jour- nal of Surgery, 8, 5, pp. 336-41,
  59. J.J. Mondak (2001), «Developing valid knowledge scales», American Journal of Political Sci- ence, 45, 1, pp. 224-38, DOI: 10.2307/2669369
  60. J.J. Mondak, M.R. Anderson (2004), «The knowledge gap: a reexamination of gender-based differences in political knowledge», The Journal of Politics, 66, 2, pp. 492-512,
  61. J.J Mondak, B.C. Davis (2001), «Asked and answered: knowledge levels when we will not take “Don’t know” for an answer», Political Behavior, 23, 3, pp. 199-224, DOI: 10.1023/A:1015015227594
  62. S. Munzert, P. Selb (2017), «Measuring political knowledge in web-based surveys: an experi- mental validation of visual versus verbal instruments», Social Science Computer Review, 35, 2, pp. 167-83, DOI: 10.1177/0894439315616325
  63. R. Nadeau, R.G. Niemi (1995), «Educated guesses: the process of answering factual knowledge questions in surveys», Public Opinion Quarterly, 59, 3, pp. 323-46, DOI: 10.1086/269480
  64. A. Paivio (1971), Imagery and Verbal Processes, New York, Holt, Rinehart, and Winston.
  65. D.L. Paulhus, P.D. Harms, M.N. Bruce, D.C. Lysy (2003), «The over-claiming technique: Measuring self-enhancement independent of ability», Journal of Personality and Social Psychology, 84, 4, pp. 890-904, DOI: 10.1037/0022-3514.84.4.890
  66. R. Pavsic, M.C. Pitrone (2003), Come conoscere opinioni ed atteggiamenti, Acireale-Roma, Bonanno.
  67. R. Pavsic, M.C. Pitrone (2010), «La forza della Forced Choice», Sociologia e ricerca sociale, 31, 92, pp. 79-102, DOI: 10.3280/SRS2010-092005
  68. M.C. Pitrone, F. Marconi, M. Palmieri (2015), «Dalla standardizzazione formale a quella dei significati nella somministrazione del questionario», Studi di sociologia, 53, 3, pp. 255-74, DOI: 10.1400/236421
  69. M. Prior (2014), «Visual Political Knowledge: A Different Road to Competence?», The Journal of Politics, 76, 1, pp. 41-57, DOI: 10.1017/S0022381613001096
  70. M. Prior, A. Lupia (2008), «Money, Time, and Political Knowledge: Distinguishing Quick Re- call and Political Learning Skills», American Journal of Political Science, 52, 1, pp. 169- 83,
  71. M. Prior, G. Sood, K. Khanna (2015), «You Cannot be Serious: The Impact of Accuracy Incen- tives on Partisan Bias in Reports of Economic Perceptions», Quarterly Journal of Political Science, 10, 4, pp. 489–518, available at DOI: 10.1561/100.00014127
  72. M.E. Sanchez, G. Morchio (1992), «Probing “Don’t know” answers: Effects on survey estimates
  73. and variable relationships», Public Opinion Quarterly, 56, 4, pp. 454-74, DOI: 10.1086/269337
  74. B.F. Schaffner, C. Roche (2017), «Misinformation and motivated reasoning: responses to eco- nomic news in a politicized environment», Public Opinion Quarterly, 81, 1, pp. 86-110,
  75. N. Schwarz, H. Schuman (1997), «Political knowledge, attribution, and inferred interest in politics: The operation of buffer items», International Journal of Public Opinion Research, 9, 2, pp. 191-5,
  76. H.C. Shulman, F.J. Boster (2014), «Effect of test-taking venue and response format on po- litical knowledge tests», Communication Methods and Measures, 8, 3, pp. 177-89, DOI: 10.1080/19312458.2014.937526
  77. B. Smith, S. Clifford, J. Jerit (2020), «Trends: How internet search undermines the validity of political knowledge measures», Political Research Quarterly, 73, 1, pp. 141-55, DOI: 10.1177/1065912919882101
  78. D. Stiers, M. Hooghe (2021), «A picture is worth a thousand words. A visual test of political knowledge: Does it reduce the effect of age and gender?», International Journal of Public Opinion Research, 33, 1, pp. 137-46,
  79. G. Strube (1987), Answering Survey Questions: The Role of Memory, in H.J. Hippler, N. Schwarz, S. Sudman (eds.), Social Information Processing and Survey Methodology, New York, Springer (Recent Research in Psychology), DOI: 10.1007/978-1-4612-4798-2_5
  80. P. Sturgis, N. Allum, P. Smith (2008), «An Experiment on the Measurement of Political Knowl- edge in Surveys», Public Opinion Quarterly, 72, 1, pp. 90-102,
  81. H. Style, J. Jerit (2020), «Does it Matter if Respondents Look up Answers to Political Knowl- edge Questions?», Public Opinion Quarterly, 84, 3, pp. 760-75,
  82. P. Tolochko, H. Song, H. Boomgaarden (2019), «“That Looks Hard!”: Effects of Objective and Perceived Textual Complexity on Factual and Structural Political Knowledge», Political Communication, 36, 4, pp. 609-28, DOI: 10.1080/10584609.2019.1631919
  83. R. Tourangeau, M.P. Couper, F. Conrad (2004), «Spacing, position, and order: Interpretive heuristics for visual features of survey questions», Public Opinion Quarterly, 68, 3, pp. 368-93,
  84. T. Tsai, C. Lin (2017), «Modeling guessing components in the measurement of political knowl- edge», Political Analysis, 25, 4, pp. 483-504,
  85. A. Tversky, D. Kahneman (1992), «Advances in prospect theory: Cumulative representation of uncertainty», Journal of Risk and Uncertainty, 5, 4, pp. 297-323, DOI: 10.1007/BF00122574
  86. D.L. Vannette, J.A. Krosnick (2018), The Palgrave Handbook of Survey Research, Provo, Pal- grave Macmillan, DOI: 10.1007/978-3-319-54395-6_53
  87. C. Vezzoni, R. Ladini (2017), «Thou shalt not cheat: How to reduce internet use in web surveys on political knowledge», Italian Political Science Review/Rivista Italiana di Scienza Polit- ica, 47, 3, pp. 251-65,
  88. A.F. Ward (2013), «Supernormal: How the Internet is changing our memories and our minds», Psychological Inquiry, 24, 4, pp. 341-48, DOI: 10.1080/1047840X.2013.850148
  89. E. Zechmeister, M. Corral (2010), «El variado significado de “izquierda” y “derecha” en Améri- ca Latina», Perspectivas desde el Barómetro de las Américas, 38, pp. 1-10.
  90. Y. Zhu, G. He, L. Gao (2022), «Complementarity or substitution? The interaction effects be- tween knowledge and trust on public attitudes toward genetic modification», International Journal of Public Opinion Research, 34, 3, pp. 1-11,

Federica Cagnoli, The questionnaire on factual and political knowledge: a review of the literature in "SOCIOLOGIA E RICERCA SOCIALE " 133/2024, pp 46-66, DOI: 10.3280/SR2024-133003