Email this article Improving Reading Comprehension and Summarising Skills in Primary School: A Quasi-Experimental Study
Abstract
MIGLIORARE LA COMPRENSIONE DEL TESTO E LE CAPACITÀ DI SINTESI NELLA SCUOLA PRIMARIA: UNO STUDIO QUASI-SPERIMENTALE
Abstract
The paper reports the results of the evaluation of a programme aimed at improving reading comprehension and summarising skills of fourth graders through a quasi-experimental study conducted with 671 students (421 in the experimental group and 250 in the control group) in Italian schools. Students assigned to the experimental group received three months of the intervention while students in the control group continued with regular teacher practice. Results showed a statistically significant difference between the two conditions on reading comprehension and summarising skills. Students included in the experimental group outperformed students in the control group in both the measures used (dppc2 = 0.32 in the Summarising Test and dppc2 = 0.54 in the Summary Qualitative Assessment). No differences were found between students with different proficiency vocabulary levels in the experimental group. The implications for research practice and limitations of the study are discussed.
Keywords
Full Text:
PDFReferences
Calvani, A., & Chiappetta Cajola, L. (Eds.). (2019). Strategie efficaci per la comprensione del testo. Il Reciprocal Teaching. Firenze: S.Ap.I.E. Scientifica.
Chall, J. S., & Jacobs, V. A. (2003). The classic study on poor children's fourth-grade slump. American Educator, 27(1), 14-15.
Cheung, A. C., & Slavin, R. E. (2016). How methodological features affect effect sizes in education. Educational Researcher, 45(5), 283-292.
https://doi.org/10.3102/0013189X16656615
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
Cook, T. D., Campbell, D. T., & Shadish, W. (2002). Experimental and quasi-experimental designs for generalized causal inference, Vol. 1195. Boston, MA: Houghton Mifflin.
De Beni, R., Cornoldi, C., Carretti, B., & Meneghetti, C. (2003). Nuova guida alla comprensione del testo, Vol. 1: Introduzione teorica generale al programma: le prove criteriali livello A e B. Trento: Erickson.
de Boer, H., Donker, A., & van der Werf, M. (2014). Effects of the attributes of educational interventions on students' academic performance: A meta-analysis. Review of Educational Research, 84(4), 509-545.
https://doi.org/10.3102/0034654314540006
Galloway, A. M. (2003). Improving reading comprehension through metacognitive strategy instruction: Evaluating the evidence for the effectiveness of the reciprocal teaching procedure. Doctoral dissertation, University of Nebraska-Lincoln, NE.
Hothorn, T., & Zeileis, A. (2015). Partykit: A modular toolkit for recursive partytioning in R. Journal of Machine Learning Research, 16(1), 3905-3909.
Johnson, D. W., & Johnson, R. T. (1999). Making cooperative learning work. Theory into Practice, 38(2), 67-73.
https://doi.org/10.1080/00405849909543834
Kintsch, W. (1998). Comprehension: A paradigm for cognition. Cambridge: Cambridge University Press.
Kirk, R. E. (1996). Practical significance: A concept whose time has come. Educational and Psychological Measurement, 56(5), 746-759.
https://doi.org/10.1177/0013164496056005002
Kraft, M. A. (2020). Interpreting effect sizes of education interventions. Educational Researcher, 49(4), 241-253.
https://doi.org/10.3102/0013189X20912798
Lee, S. H., & Tsai, S. F. (2017). Experimental intervention research on students with specific poor comprehension: A systematic review of treatment outcomes. Reading and Writing, 30(4), 917-943.
https://doi.org/10.1007/s11145-016-9697-x
Levy, K. J. (1980). A Monte Carlo study of analysis of covariance under violations of the assumptions of normality and equal regression slopes. Educational and Psychological Measurement, 40(4), 835-840.
https://doi.org/10.1177/001316448004000404
Lipsey, M. W., Puzio, K., Yun, C., Hebert, M. A., Steinka-Fry, K., Cole, M. W., & Busick, M. D. (2012). Translating the statistical representation of the effects of education interventions into more readily interpretable forms. Washington, DC: National Center for Special Education Research.
Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. London: Sage.
Menichetti, L. (2018). Valutare la capacità di riassumere. Il Summarising Test, uno strumento per la scuola primaria. Journal of Educational, Cultural and Psychological Studies (ECPS), 18, 369-396.
https://doi.org/10.7358/ecps-2018-018-meni
Menichetti, L., & Bertolini, C. (2019). Prova qualitativa per la valutazione della capacità di riassunto. Il Summary Qualitative Assessment (SQA). In A. Calvani & L. Chiappetta Cajola (a cura di), Strategie efficaci per la comprensione del testo. Il Reciprocal Teaching (pp. 431-462). Firenze: S.Ap.I.E. Scientifca.
Montesano, L. (2020). Vocabolario e comprensione del testo. Uno strumento per la valutazione del lessico nella scuola Primaria. Firenze: S.Ap.I.E. Scientifca.
NAEP - National Assessment of Educational Progress (2019). NAEP report card: 2019 NAEP reading assessment.
https://www.nationsreportcard.gov/highlights/reading/2019/
National Center for Educational Statistics (2019). National assessment of educational progress. Washington, DC: National Center for Educational Statistics.
Neitzel, A. J., Lake, C., Pellegrini, M., & Slavin, R. E. (2022). A synthesis of quantitative research on programmes for struggling readers in elementary schools. Reading Research Quarterly, 57(1), 149-179.
https://doi.org/10.1002/rrq.379
NICHD - National Institute of Child Health and Human Development (2000). Report of the National Reading Panel. Teaching children to read: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction (NIH Publication No. 00-4769). Washington, DC: U.S. Government Printing Office.
Oczkus, L. D. (2018). Reciprocal teaching at work: Powerful strategies and lessons for improving reading comprehension. ASCD.
Palincsar, A. S. (2013). Reciprocal teaching. In J. Hattie & E. M. Anderman (Eds.), International guide to student achievement (pp. 369-371). London - New York: Routledge.
Palincsar, A. S., & Brown, A. L. (1984). Reciprocal teaching of comprehension fostering and comprehension-monitoring activities. Cognition and Instruction, 1(2), 117-175.
https://doi.org/10.1207/s1532690xci0102_1
Pečjak, S., & Pirc, T. (2018). Developing summarizing skills in 4th grade students: Intervention programme effects. International Electronic Journal of Elementary Education, 19(5), 571-581. doi: 10.26822/iejee.2018541306.
https://doi.org/10.26822/iejee.2018541306
Pellegrini, M., Inns, A., Lake, C., & Slavin, R. E. (2019). Effects of researcher-made vs. independent measures on outcomes of experiments in education. Paper presented at the Annual Meeting of the Society for Research on Educational Effectiveness, Washington, DC.
R Core Team (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing.
Rizzo, A. L., & Traversetti, M. (2021). Il programma RC-RT per la comprensione della lettura. Percorso didattico evidence based per la scuola primaria. Guida per gli insegnanti. Firenze: S.Ap.I.E.
Rizzo, A. L., Traversetti, M., & Pellegrini, M. (2023). Potenziare la comprensione del testo. Roma: Carocci.
Rosenshine, B., & Meister, C. (1994). Reciprocal teaching: A review of the research. Review of Educational Research, 64(4), 479-530.
https://doi.org/10.3102/00346543064004479
Shaver, J. P. (1993). What statistical significance testing is, and what it is not. Journal of Experimental Education, 61(4), 293-316.
https://doi.org/10.1080/00220973.1993.10806592
Swanson, E., Stevens, E. A., Scammacca, N. K., Capin, P., Stewart, A. A., & Austin, C. R. (2017). The impact of tier 1 reading instruction on reading outcomes for students in grades 4-12: A meta-analysis. Reading and Writing, 30(8), 1639-1665.
https://doi.org/10.1007/s11145-017-9743-3
Thurstone, T. G., & Thurstone, L. L. (1965). P.M.A. Primary Mental Abilities. Science Research Associates.
Tressoldi, P. E., & Zamperlin, C. (2007). La valutazione della comprensione del testo. Proposta di una batteria di approfondimento. Psicologia clinica dello sviluppo, 11(2), 271-290.
van Dijk, T. A., & Kintsch, W. (1978). Toward a model of text comprehension and production. Psychological Review, 85, 363-394.
https://doi.org/10.1037/0033-295X.85.5.363
Wolf, R. (2021). Average differences in effect sizes by outcome measure type (WWC 2021). Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, What Works Clearinghouse.
Zeileis, A., Köll, S., & Graham, N. (2020). Various versatile variances: An object-oriented implementation of clustered covariances in R. Journal of Statistical Software, 95, 1-36.
https://doi.org/10.18637/jss.v095.i01
DOI: https://doi.org/10.7358/ecps-2023-028-calv
Copyright (©) 2023 Antonio Calvani, Antonio Marzano, Lorena Montesano, Marta Pellegrini, Amalia Lavinia Rizzo, Marianna Traversetti, Giuliano Vivanet – Editorial format and Graphical layout: copyright (©) LED Edizioni Universitarie
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Journal of Educational, Cultural and Psychological Studies (ECPS)
Registered by Tribunale di Milano (19/05/2010 n. 278)
Online ISSN 2037-7924 - Print ISSN 2037-7932
Research Laboratory on Didactics and Evaluation - Department of Education - "Roma Tre" University
Executive Editor: Gaetano Domenici - Associate Executive Editor & Managing Editor: Valeria Biasci
Editorial Board: Eleftheria Argyropoulou - Massimo Baldacci - Joao Barroso - Richard Bates - Christofer Bezzina - Paolo Bonaiuto - Lucia Boncori - Pietro Boscolo - Sara Bubb - Carlo Felice Casula - Jean-Émile Charlier - Lucia Chiappetta Cajola - Carmela Covato - Jean-Louis Derouet - Peter Early - Franco Frabboni - Constance Katz - James Levin - Pietro Lucisano - Roberto Maragliano - Romuald Normand - Michael Osborne - Donatella Palomba - Michele Pellerey - Clotilde Pontecorvo - Vitaly V. Rubtzov - Jaap Scheerens - Noah W. Sobe - Francesco Susi - Giuseppe Spadafora - Pat Thomson
Editorial Staff: Fabio Alivernini - Guido Benvenuto - Anna Maria Ciraci - Massimiliano Fiorucci - Luca Mallia - Massimo Margottini - Giovanni Moretti - Carla Roverselli
Editorial Secretary:Nazarena Patrizi
© 2001 LED Edizioni Universitarie di Lettere Economia Diritto