Email this article Validazione di uno strumento per valutare la partecipazione alle attività extracurriculari in area STEM. Il questionario Science Activities Evaluation Engagement (SAEE)
Abstract
In this study, we present a new questionnaire, the Science Activities Evaluation Engagement (SAEE) instrument, for the evaluation of the students’ engagement in STEM oriented extra-curricular activities. The questionnaire was administered to about 1000 secondary school students who participated in the activities of the Piano Nazionale Lauree Scientifiche in Biology, Chemistry and Physics. Through an exploratory and confirmatory factor analysis, it was possible to validate a four-factor structure of the instrument: Satisfaction with the followed activities; Utility of the activities; Difficulties in following the activities; Involvement of close people. The obtained factor structure shows a good model fit, with each of the obtained scales showing an excellent reliability. Criterion validity was established through the academic motivation scale. The proposed instrument shows also an adequate convergent validity and a sufficient discriminant validity. Implications of the study for the evaluation of Third Mission activities of the Italian universities are also briefly discussed.
Keywords
Full Text:
PDFReferences
Alivernini, F., & Lucidi, F. (2008). The Academic Motivation Scale (AMS): Facto-rial structure, invariance, and validity in the Italian context. TPM-Testing, Psychometrics, Methodology in Applied Psychology, 15(4), 211-220.
ANVUR - Agenzia Nazionale di Valutazione della Università e della Ricerca (2020). Modalità di conferimento dei casi studio per la Terza Missione. https://www.anvur.it/wp-content/uploads/2021/02/Modalita-conferimento-dei-casi-studio.pdf
Appleton, J. J., Christenson, S. L., Kim, D., & Reschly, A. L. (2006). Measuring cognitive and psychological engagement: Validation of the Student En-gagement Instrument. Journal of School Psychology, 44(5), 427-445.
https://doi.org/10.1016/j.jsp.2006.04.002
Ben-Eliyahu, A., Moore, D., Dorph, R., & Schunn, C. D. (2018). Investigating the multidimensionality of engagement: Affective, behavioral, and cognitive engagement across science activities and contexts. Contemporary Educational Psychology, 53, 87-105.
https://doi.org/10.1016/j.cedpsych.2018.01.002
Carini, R. M., Kuh, G. D., & Klein, S. P. (2006). Student engagement and student learning: Testing the linkages. Research in Higher Education, 47(1), 1-32.
https://doi.org/10.1007/s11162-005-8150-9
Cera, R., Mancini, M., & Antonietti, A. (2013). Relationships between metacogni-tion, self-efficacy and self-regulation in learning. Journal of Educational, Cul-tural and Psychological Studies, 7, 115-141.
https://doi.org/10.7358/ecps-2013-007-cera
Corno, L., & Mandinach, E. B. (1983). The role of cognitive engagement in class-room learning and motivation. Educational Psychologist, 18(2), 88-108.
https://doi.org/10.1080/00461528309529266
Deci, E., & Ryan, R. (1985). Intrinsic motivation and self-determination in human behavior. New York: Springer Science & Business Media.
https://doi.org/10.1007/978-1-4899-2271-7
PMid:3841237
Esposito, G., Marôco, J., Passeggia, R., Pepicelli, G., & Freda, M. F. (2021). The Italian validation of the University Student Engagement Inventory. Euro-pean Journal of Higher Education.
https://doi.org/10.1080/21568235.2021.1875018
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Po-tential of the concept, state of the evidence. Review of Educational Research, 74(1), 59-109.
https://doi.org/10.3102/00346543074001059
Fredricks, J., McColskey, W., Meli, J., Mordica, J., Montrosse, B., & Mooney, K. (2011). Measuring student engagement in upper elementary through high school: A description of 21 instruments. Issues & Answers report, REL 2011, 098. Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory Southeast. http://ies.ed.gov/ncee/edlabs.
Fredricks, J. A., & McColskey, W. (2012). The measurement of student engage-ment: A comparative analysis of various methods and student self-report in-struments. Handbook of Research on Student Engagement, 763-782.
https://doi.org/10.1007/978-1-4614-2018-7_37
Mameli, C., & Passini, S. (2017). Measuring four-dimensional engagement in school: A validation of the Student Engagement Scale and of the Agentic Engagement Scale. TPM-Testing, Psychometrics, Methodology in Applied Psychology, 24(4), 527-541.
https://doi.org/10.1037/t81235-000
Manganelli, S., Alivernini, F., Mallia, L., & Biasi, V. (2015). The development and psychometric properties of the «Self-Regulated Knowledge Scale - Universi-ty» (SRKS-U). Journal of Educational, Cultural and Psychological Studies, 12, 235-254.
https://doi.org/10.7358/ecps-2015-012-mang
Matsunaga, M. (2008). Item parceling in structural equation modeling: A primer. Communication Methods and Measures, 2(4), 260-293.
https://doi.org/10.1080/19312450802458935
Noam, G. G., Allen, P. J., Sonnert, G., & Sadler, P. M. (2020). The common in-strument: An assessment to measure and communicate youth science en-gagement in out-of-school time. International Journal of Science Education, Part B, 10(4), 295-318.
https://doi.org/10.1080/21548455.2020.1840644
Reeve, J., & Tseng, C.-M. (2011). Agency as a fourth aspect of students' engage-ment during learning activities. Contemporary Educational Psychology, 36(4), 257-267.
https://doi.org/10.1016/j.cedpsych.2011.05.002
Rönkkö, M., & Cho, E. (2020). An updated guideline for assessing discriminant validity. Organizational Research Methods.
https://doi.org/10.1177/1094428120968614
Ryan, R. M., & Deci, E. L. (2020). Intrinsic and extrinsic motivation from a self-determination theory perspective: Definitions, theory, practices, and future directions. Contemporary Educational Psychology, 61, 101860.
https://doi.org/10.1016/j.cedpsych.2020.101860
Schreiber, J. B., Nora, A., Stage, F. K., Barlow, E. A., & King, J. (2006). Reporting structural equation modeling and confirmatory factor analysis results: A re-view. Journal of Educational Research, 99(6), 323-338.
https://doi.org/10.3200/JOER.99.6.323-338
Sinatra, G. M., Heddy, B. C., & Lombardi, D. (2015). The challenges of defining and measuring student engagement in science. Educational Psychologist, 50(1), 1-13.
https://doi.org/10.1080/00461520.2014.1002924
Wang, M.-T., Fredricks, J. A., Ye, F., Hofkens, T. L., & Linn, J. S. (2016). The math and science engagement scales: Scale development, validation, and psychometric properties. Learning and Instruction, 43, 16-26.
https://doi.org/10.1016/j.learninstruc.2016.01.008
Wigfield, A., Eccles, J. S., Fredricks, J. A., Simpkins, S., Roeser, R. W., & Schiefele, U. (2015). Development of achievement motivation and engagement. In R. M. Lerner (Ed.), Handbook of child psychology and developmental science.
https://doi.org/10.1002/9781118963418.childpsy316
DOI: https://doi.org/10.7358/ecps-2021-024-test
Copyright (©) 2021 Italo Testa – Editorial format and Graphical layout: copyright (©) LED Edizioni Universitarie
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Journal of Educational, Cultural and Psychological Studies (ECPS)
Registered by Tribunale di Milano (19/05/2010 n. 278)
Online ISSN 2037-7924 - Print ISSN 2037-7932
Research Laboratory on Didactics and Evaluation - Department of Education - "Roma Tre" University
Executive Editor: Gaetano Domenici - Associate Executive Editor & Managing Editor: Valeria Biasci
Editorial Board: Eleftheria Argyropoulou - Massimo Baldacci - Joao Barroso - Richard Bates - Christofer Bezzina - Paolo Bonaiuto - Lucia Boncori - Pietro Boscolo - Sara Bubb - Carlo Felice Casula - Jean-Émile Charlier - Lucia Chiappetta Cajola - Carmela Covato - Jean-Louis Derouet - Peter Early - Franco Frabboni - Constance Katz - James Levin - Pietro Lucisano - Roberto Maragliano - Romuald Normand - Michael Osborne - Donatella Palomba - Michele Pellerey - Clotilde Pontecorvo - Vitaly V. Rubtzov - Jaap Scheerens - Noah W. Sobe - Francesco Susi - Giuseppe Spadafora - Pat Thomson
Editorial Staff: Fabio Alivernini - Guido Benvenuto - Anna Maria Ciraci - Massimiliano Fiorucci - Luca Mallia - Massimo Margottini - Giovanni Moretti - Carla Roverselli
Editorial Secretary:Nazarena Patrizi
© 2001 LED Edizioni Universitarie di Lettere Economia Diritto