Email this article Gli anni di Eco. Riflessioni sull’uso di prove strutturate con risposte chiuse e aperte a margine di una ricerca sulla comprensione della lettura
Abstract
Eco’s Age. Reflections on the Use of Structured Tests with Open Ended and Multiple Choice Items Linked to a Study on Reading Comprehension
This study stems from a broader work aiming to validate a reading comprehension test for final year high school students; the work stands as a stimulus for reflection on the use of structured tests to assess reading comprehension skills and, in particular, analyses the relationship between the different areas of assessment of reading comprehension processes and question types (in open-ended versus multiple choice items). By analysing an open-ended question, we discuss the possibility of assessing the mental processes involved in reading and their relations with students’ encyclopaedic knowledge. A great many studies have demonstrated how prior knowledge is one of the main variables explaining reading skills (20-70% of variance in a test of reading comprehension) and that excluding it can distort measures of reading literacy. It appears that in addition to the methodological rigor needed to construct valid and reliable tests, there is need for an approach to more fully understand and to more deeply consider all the solutions that strategic and skilled readers implement and put in place in order to completely comprehend a text.
Keywords
Full Text:
PDFReferences
Afflerbach, P., Pearson, P. D., & Paris, S. G. (2008). Clarifying differences between reading skills and reading strategies. The Reading Teacher, 61(5), 364-373.
Bottani, N. (2011). L’ossessionante ripetizione dei test sulla comprensione della lettura. Education 2.0. http://www.educationduepuntozero.it/didattica-e-apprendimento/ossessionante-ripetizione-test-comprensione-lettura-404092826.shtml.
Campbell, J. R., Kelly, D. K., Mullis, I. V. S., Martin, M. O., & Sainsbury, M. (2001). PIRLS 2001 Assessment framework and specifications (2nd ed., March).
Cresswel, J., & Vayssettes, S. (2006). Assessing scientific, reading and mathematical literacy: A framework for PISA 2006. OECD Pub.
De Luca, M., & Lucisano, P. (2011). Item analisi fra modello e realta. Giornale Italiano della Ricerca Educativa, 4, 85-96.
Dewey, J. (1939). Teoria della valutazione (1a ed.). Firenze: La Nuova Italia.
Dochy, F. J. R. C. (1994). Prior knowledge and learning. In T. Husen & T. N. Postlethwaite (Eds.), International encyclopedia of education (2nd ed., pp. 4698-4702). Oxford - New York: Pergamon Press.
Dochy, F. J. R. C., Segers, M., & Buehl, M. M. (1999). The relation between assessment practices and outcomes of studies: The case of research on prior knowledge. Review of Educational Research, 69, Summer, 145-186.
Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data. Cambridge: EUA Massachusetts Institute of Technology.
Feyerabend, P. K. (1975). Contro il metodo. Abbozzo di una teoria anarchica della conoscenza. Milano: Feltrinelli.
Frederiksen, N. (1984). The real Test Bias. Influences of testing on teaching and learning. American Psychologist, 39(3), 193-202.
Gallina, V. (2011). Il piacere di leggere. Education 2.0, 4 Marzo.
Giannarelli, R. (1977). Indagine IEA e mastery learning. Annali della Pubblica Istruzione, 23, Marzo-Aprile.
Gorman, T. P., Purves, A., & Degenhart, R. E. (Eds.). (1988). The IEA study of written composition I: The international writing tasks and scoring scales. Oxford: Pergamon Press.
Invalsi (2011). Quadro di riferimento della prova di italiano Sistema Nazionale di Valutazione. http://www.invalsi.it/snv2012/documenti/QDR/QdR_Italiano.pdf.
Katz, S., Lautenschlager, G. J., Blackburn, A. B., & Harris, F. H. (1990). Answering reading comprehension items without passages on SAT. Psychological Science, 1, 122-127.
Kintsch, W. (1988). The role of knowledge in discourse comprehension: A construction-integration model. Psychological Review, 95(2), 163-182.
Kintsch, W. (1998). Comprehension. A paradigm for cognition. Cambridge: Cambridge University Press.
Kintsch, W., & Dijck, T. A. van (1983). Strategies of discourse comprehension. New York: New York Academy Press.
Kucan, L., & Beck, I. L. (1997). Thinking aloud and reading comprehension research: Inquiry, instruction, and social interaction. Review of Educational Research, 67(3), 271-299.
Lucisano, P. (1989). Lettura e comprensione. Torino: Loescher.
Lucisano, P. (2003). Validita e affidabilita delle pratiche valutative: a proposito del progetto pilota 2. Cadmo, 2, 37-57.
Lumbelli, L. (1989). Fenomenologia dello scrivere chiaro. Roma: Editori Riuniti.
Lumbelli, L. (1996). Focusing on text comprehension as a problem-solving task. A fostering project for culturally deprived children. In C. Cornoldi & J. Oakhill (Eds.), Reading comprehension difficulties. Processes and intervention (pp. 301- 330). Mahwah, NJ: Erlbaum.
Lumbelli, L.. (2009). La comprensione come problema. Roma - Bari: Laterza.
McNamara, D. S., & Kintsch, W. (1996). Learning from texts: Effects if prior knowledge and text coherence. Discourse Processes, 22, 247-288.
Moncada, S. M., & Moncada, T. P. (2010). Assessing student learning with conventional multiple-choice exams: Design and implementation considerations for business faculty. International Journal of Education Research, 5(2), 15-29.
Mullis, I. V. S., Kennedy, A. M., Martin, M. O., & Sainsbury, M. (2006). PIRLS 2006 Assessment framework and specifications (2nd ed., February).
Mullis, I. V. S., Martin, M. O., Kennedy, A. M., Trong, K. L., & Sainsbury, M. (2009). PIRLS 2011 Assessment framework. Chestnut Hill, MA.
Organisation for Economic Co-operation and Development (2010). PISA 2009 Assessment framework: Key competencies in reading, mathematics and science. OECD Pub.
Ozuru, Y., Best, R., Bell, C., Witherspoon, A., & McNamara, D. S. (2007). Influence of question format and text availability on the assessment of expository text comprehension. Cognition and Instruction, 25, 399-438.
Pearson, P. D., Barr, R., Kamil, M. L., & Mosenthal, P. (Eds.). (1984). Handbook of reading research. New York: Longman.
Pearson, P. D., &. Fielding, L. (1991). Comprehension instruction. In R. Barr, M. L. Kamil, P. Mosenthal, &. P. D. Pearson (Eds.), Handbook of reading research, Vol. 2 (pp. 815-860). New York: Longman.
Pearson, P. D., Garavaglia, D., Lycke, K., Roberts. E., Danridge, J., & Hamm, D. (1999). The impact of item format on the depth of students’ cognitive engagement. Technical Report. Washington, DC: American Institute for Research.
Pirsig, R. M. (1974). Lo Zen e l’arte della manutenzione della motocicletta. Milano: Adelphi.
Postlethwaite, T. N., Husen, T., Laeng, M., Bellacicco, A., & Visalberghi, A. (1977). Misurazione del rendimento scolastico: indagine IEA e situazione italiana. Roma: Le Monnier.
Postlethwaite, T. N., & Ross, K. N. (1992). Effective schools in reading: Implications for educational planners. An exploratory study. The IEA Study of Reading Literacy II. Hambourg: IEA.
Pressley, M., Ghatala, E. S., Woloshyn, V., & Pirie, J. (1990). Sometimes adults miss the main ideas and do not realize it: Confidence in responses to short-answer and multiple-choice comprehension questions. Reading Research Quarterly, 25(3), Summer, 232-249.
Purves, A. C. (Ed.). (1992). The IEA study of written composition II: Education and performance in fourteen countries. Oxford: Pergamon Press.
Rauch, D. P., & Hartig, J. (2010). Multiple-choice versus open-ended response formats of reading test items: A two-dimensional IRT analysis. Psychological Test and Assessment Modeling, 52(4), 354-379.
Shapiro, A. M. (2004). How including prior knowledge as a subject variable may change outcomes of learning research. American Educational Research Journal, 41(1), 159-189.
Topping, K., Valtin, R., Roller, C., Brozo, W., & Lourdes Dionosos, M. (2003). Policy and practice implications of the Program for International Student Assessment (PISA) 2000. Report of the International Reading Association PISA Task Force.
Trivellato, U., & Zuliani, A. (1977). Le determinanti della riuscita scolastica in Italia: alcuni primi risultati dell’indagine IEA, con particolare riferimento all’influenza dell’ambiente familiare e dei fattori scolastici. Firenze: Le Monnier - Cede.
Warwick, J., Bush, M., & Jennings, S. (2010). Analysis and evaluation of liberal (free-choice) multiple-choice tests. Innovations in Teaching & Learning in Information & Computer Sciences, 9(2), 51-62.
DOI: https://doi.org/10.7358/ecps-2013-007-intr
Copyright (©) 2014 Journal of Educational, Cultural and Psychological Studies (ECPS Journal) – Editorial format and Graphical layout: copyright (©) LED Edizioni Universitarie
Journal of Educational, Cultural and Psychological Studies (ECPS)
Registered by Tribunale di Milano (19/05/2010 n. 278)
Online ISSN 2037-7924 - Print ISSN 2037-7932
Research Laboratory on Didactics and Evaluation - Department of Education - "Roma Tre" University
Executive Editor: Gaetano Domenici - Associate Executive Editor & Managing Editor: Valeria Biasci
Editorial Board: Eleftheria Argyropoulou - Massimo Baldacci - Joao Barroso - Richard Bates - Christofer Bezzina - Paolo Bonaiuto - Lucia Boncori - Pietro Boscolo - Sara Bubb - Carlo Felice Casula - Jean-Émile Charlier - Lucia Chiappetta Cajola - Carmela Covato - Jean-Louis Derouet - Peter Early - Franco Frabboni - Constance Katz - James Levin - Pietro Lucisano - Roberto Maragliano - Romuald Normand - Michael Osborne - Donatella Palomba - Michele Pellerey - Clotilde Pontecorvo - Vitaly V. Rubtzov - Jaap Scheerens - Noah W. Sobe - Francesco Susi - Giuseppe Spadafora - Pat Thomson
Editorial Staff: Fabio Alivernini - Guido Benvenuto - Anna Maria Ciraci - Massimiliano Fiorucci - Luca Mallia - Massimo Margottini - Giovanni Moretti - Carla Roverselli
Editorial Secretary:Nazarena Patrizi
© 2001 LED Edizioni Universitarie di Lettere Economia Diritto