Costruzione di una banca di item per la stima dell’abilità in matematica con prove adattative multilivello
Abstract
The article describes the process of constructing an item bank aimed at implementing a computer-based MultiStage adaptive Test (MST) for the estimation of the mathematical ability of second-grade secondary school students. The multilevel adaptive tests are briefly introduced and the main steps of the bank construction process are described: the definition of the object of the test, the selection of the items downstream of the pretest operations, assuming that the data are adapted to a IRT model with one parameter, and the verification of the uni-dimensionality of the bank as a whole. The article also highlights some of the difficulties that can be encountered, such as being able to obtain adequate coverage of the test’s object or the range of the ability. The process described was overall successful and sufficiently general to be able to adapt to different needs, such as the construction of parallel linear tests or traditional adaptive tests (CAT – Computer-based Adaptive Test), aimed not only at summative or system assessment, but also, if the dimensions of the bank allow it, to formative evaluation.
Keywords
Full Text:
PDFReferences
Barbaranelli C., Natali N. (2005). I test psicologici: teorie e modelli psicometrici. Carocci editore SpA, Roma
Choppin B. (1976). Developments In Item Banking. First European Contact Workshop, Windsor, UK.
Comrey A.L., Lee H.B. (1992). A First Course in Factor Analysis. Lawrence Erlbaum Associates, Hillsdale (NJ), 2a ed. (trad.it. Introduzione all’analisi fattoriale. LED, Milano 1995)
Hattie J. (1985). Methodological Review: Assessing Unidimensionality of Tests and Items. Applied Psychological Measurement, 9, pp. 139 – 64
Hu L., Bentler P.M. (1999). Cutoff criteria in fix indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), pp. 1 – 55
Gallucci M., Leone L. (2012). Modelli statistici per le scienze sociali. Pearson Italia, Milano – Torino
Mcdonald R.P. (1981). The Dimensionality of Tests and Items. British Journal of Mathematical and Statistical Psychology, 34, pp. 100 - 117
Muthén B. (1983). Latent Variable Structural Equation Modeling with Categorical Data. Journal of Econometrics, 22, pp. 48 -65
Muthén B. (1989). Latent Variable Modeling in Heterogeneous Populations. Psychometrika, 54, pp. 557 -585
Muthén, L.K. and Muthén, B.O. (1998-2010). Mplus User’s Guide. Sixth Edition. Los Angeles, CA: Muthén & Muthén
Nunnally J.C., Bernstein I.H. (1994). Psychometric Theory. McGraw – Hill, New York
Steiger J. H. (1990). Structural Model Evaluation and Modification: An Interval Estimation Approach. Multivariate Behavioral Research, 25, pp. 173 – 180
Steiger J. H., Lind J. M. (1980). Statistically Based Tests for the Number of Common Factors, relazione presentata all’Annual Meeting of the Psychometric Society, Iowa City (IA)
R. K. Hambleton, H. Swaminathan, H. J. Rogers (1991). Fundamentals of Item Response Theory. Sage Publications, Inc. 1991, London
E.Botta, C. Lasorsa (2017). La migrazione delle prove Invalsi di matematica da PPT a CBT. Uno studio sulle prove di pre-test per la II superiore. Giornale Italiano della Ricerca Educativa, n.19, Dicembre 2017, Salerno
A. Agresti, B. Finlay (2012). Metodi statistici di base e avanzati per le scienze sociali. Pearson, 2012, Milano
XCalibreTM, Item Response Theory Calibration Software User Manual. 2014, Assessment System Corporation
D. Magis, D.Yan & A. von Davier (2017). Computerized Adptive and Multistage Testing with R, using packages catR and mstR. Springer International Publishing, 2017
Veldkamp, B. P. (2014). Item pool design and maintenance for multistage testing. In D. Yan, A.A. von Davier, Lewis C., Computerized multistage testing: Theory and applications (pp. 39-54). New York: CRC Press
Wandall J. (2009). National Tests in Denmark, CAT as a Pedagogic Tool. The transition to Computer-Based Assessment, JRC Scientific and Technical Reports, UE, 2009
DOI: https://doi.org/10.7358/ecps-2018-018-bott
Copyright (©) 2018 Journal of Educational, Cultural and Psychological Studies (ECPS Journal) – Editorial format and Graphical layout: copyright (©) LED Edizioni Universitarie
Journal of Educational, Cultural and Psychological Studies (ECPS)
Registered by Tribunale di Milano (19/05/2010 n. 278)
Online ISSN 2037-7924 - Print ISSN 2037-7932
Research Laboratory on Didactics and Evaluation - Department of Education - "Roma Tre" University
Executive Editor: Gaetano Domenici - Associate Executive Editor & Managing Editor: Valeria Biasci
Editorial Board: Eleftheria Argyropoulou - Massimo Baldacci - Joao Barroso - Richard Bates - Christofer Bezzina - Paolo Bonaiuto - Lucia Boncori - Pietro Boscolo - Sara Bubb - Carlo Felice Casula - Jean-Émile Charlier - Lucia Chiappetta Cajola - Carmela Covato - Jean-Louis Derouet - Peter Early - Franco Frabboni - Constance Katz - James Levin - Pietro Lucisano - Roberto Maragliano - Romuald Normand - Michael Osborne - Donatella Palomba - Michele Pellerey - Clotilde Pontecorvo - Vitaly V. Rubtzov - Jaap Scheerens - Noah W. Sobe - Francesco Susi - Giuseppe Spadafora - Pat Thomson
Editorial Staff: Fabio Alivernini - Guido Benvenuto - Anna Maria Ciraci - Massimiliano Fiorucci - Luca Mallia - Massimo Margottini - Giovanni Moretti - Carla Roverselli
Editorial Secretary:Nazarena Patrizi
© 2001 LED Edizioni Universitarie di Lettere Economia Diritto