Led On Line
Presentazione - About us
Novita' - What's new
E-Journals
E-books
Lededizioni Home Page Ricerca - Search
Catalogo - Catalogue
Per contattarci - Contacts
Per gli Autori - For the Authors
Statistiche - Statistics
Cookie Policy
Privacy Policy

Costruzione di una banca di item per la stima dell’abilità in matematica con prove adattative multilivello

Emanuela Botta

Abstract


The article describes the process of constructing an item bank aimed at implementing a computer-based MultiStage adaptive Test (MST) for the estimation of the mathematical ability of second-grade secondary school students. The multilevel adaptive tests are briefly introduced and the main steps of the bank construction process are described: the definition of the object of the test, the selection of the items downstream of the pretest operations, assuming that the data are adapted to a IRT model with one parameter, and the verification of the uni-dimensionality of the bank as a whole. The article also highlights some of the difficulties that can be encountered, such as being able to obtain adequate coverage of the test’s object or the range of the ability. The process described was overall successful and sufficiently general to be able to adapt to different needs, such as the construction of parallel linear tests or traditional adaptive tests (CAT – Computer-based Adaptive Test), aimed not only at summative or system assessment, but also, if the dimensions of the bank allow it, to formative evaluation.


Keywords


Assessment; Computer Based Test (CBT); Item banking; Math ability; MultiStage adaptive Test (MST)

Full Text:

PDF

References


Barbaranelli C., Natali N. (2005). I test psicologici: teorie e modelli psicometrici. Carocci editore SpA, Roma

Choppin B. (1976). Developments In Item Banking. First European Contact Workshop, Windsor, UK.

Comrey A.L., Lee H.B. (1992). A First Course in Factor Analysis. Lawrence Erlbaum Associates, Hillsdale (NJ), 2a ed. (trad.it. Introduzione all’analisi fattoriale. LED, Milano 1995)

Hattie J. (1985). Methodological Review: Assessing Unidimensionality of Tests and Items. Applied Psychological Measurement, 9, pp. 139 – 64

Hu L., Bentler P.M. (1999). Cutoff criteria in fix indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), pp. 1 – 55

Gallucci M., Leone L. (2012). Modelli statistici per le scienze sociali. Pearson Italia, Milano – Torino

Mcdonald R.P. (1981). The Dimensionality of Tests and Items. British Journal of Mathematical and Statistical Psychology, 34, pp. 100 - 117

Muthén B. (1983). Latent Variable Structural Equation Modeling with Categorical Data. Journal of Econometrics, 22, pp. 48 -65

Muthén B. (1989). Latent Variable Modeling in Heterogeneous Populations. Psychometrika, 54, pp. 557 -585

Muthén, L.K. and Muthén, B.O. (1998-2010). Mplus User’s Guide. Sixth Edition. Los Angeles, CA: Muthén & Muthén

Nunnally J.C., Bernstein I.H. (1994). Psychometric Theory. McGraw – Hill, New York

Steiger J. H. (1990). Structural Model Evaluation and Modification: An Interval Estimation Approach. Multivariate Behavioral Research, 25, pp. 173 – 180

Steiger J. H., Lind J. M. (1980). Statistically Based Tests for the Number of Common Factors, relazione presentata all’Annual Meeting of the Psychometric Society, Iowa City (IA)

R. K. Hambleton, H. Swaminathan, H. J. Rogers (1991). Fundamentals of Item Response Theory. Sage Publications, Inc. 1991, London

E.Botta, C. Lasorsa (2017). La migrazione delle prove Invalsi di matematica da PPT a CBT. Uno studio sulle prove di pre-test per la II superiore. Giornale Italiano della Ricerca Educativa, n.19, Dicembre 2017, Salerno

A. Agresti, B. Finlay (2012). Metodi statistici di base e avanzati per le scienze sociali. Pearson, 2012, Milano

XCalibreTM, Item Response Theory Calibration Software User Manual. 2014, Assessment System Corporation

D. Magis, D.Yan & A. von Davier (2017). Computerized Adptive and Multistage Testing with R, using packages catR and mstR. Springer International Publishing, 2017

Veldkamp, B. P. (2014). Item pool design and maintenance for multistage testing. In D. Yan, A.A. von Davier, Lewis C., Computerized multistage testing: Theory and applications (pp. 39-54). New York: CRC Press

Wandall J. (2009). National Tests in Denmark, CAT as a Pedagogic Tool. The transition to Computer-Based Assessment, JRC Scientific and Technical Reports, UE, 2009




DOI: https://doi.org/10.7358/ecps-2018-018-bott



 


Journal of Educational, Cultural and Psychological Studies (ECPS)
Registered by Tribunale di Milano (19/05/2010 n. 278)
Online ISSN 2037-7924 - Print ISSN 2037-7932

Research Laboratory on Didactics and Evaluation - Department of Education - "Roma Tre" University


Executive Editor: Gaetano Domenici - Managing  Editor: Valeria Biasci
Editorial Board: Giuditta Alessandrini - Eleftheria Argyropoulou - Massimo Baldacci - Joao Barroso - Richard Bates - Christofer Bezzina - Paolo Bonaiuto - Lucia Boncori - Pietro Boscolo - Sara Bubb  - Carlo Felice Casula - Jean-Émile Charlier - Lucia Chiappetta Cajola - Carmela Covato - Jean-Louis Derouet - Peter Early - Franco Frabboni - Constance Katz - James Levin - Pietro Lucisano  - Roberto Maragliano - Romuald Normand - Michael Osborne - Donatella Palomba - Michele Pellerey - Clotilde Pontecorvo - Vitaly V. Rubtzov - Jaap Scheerens - Noah W. Sobe - Francesco Susi - Giuseppe Spadafora - Pat Thomson
Editorial Staff: Fabio Alivernini - Guido Benvenuto - Anna Maria Ciraci - Massimiliano Fiorucci - Luca Mallia - Massimo Margottini - Giovanni Moretti - Carla Roverselli 
Editorial Secretary:
Nazarena Patrizi