Email this article Progettare e valutare con il supporto dell’intelligenza artificiale: elementi per un approccio critico all’uso dei chatbot
Abstract
DESIGNING AND ASSESSING WITH THE SUPPORT OF ARTIFICIAL INTELLIGENCE: ELEMENTS FOR A CRITICAL APPROACH TO THE USE OF CHATBOTS
Abstract
This paper explores the critical integration of artificial intelligence (AI), specifically focusing on using chatbots in training design and learning assessment, aiming to uncover both the potential and challenges in educational and training contexts. Through two exploratory empirical studies – one centered on the use of ChatGPT in training design and the other on its application in school learning assessments – the analysis examines the perceptions of teachers and students. The findings reveal that chatbots, such as ChatGPT, can significantly reduce the workload of teachers and future training designers, improve access to educational resources, and provide timely feedback. However, concerns emerge regarding technological dependency and superficial learning, with ethical and pedagogical implications that warrant a critical examination of the pedagogical effectiveness of AI tools. The paper concludes by proposing strategies for AI’s ethical and thoughtful integration in education, promoting a balance between technology and reflective, critical educational practice.
Keywords
Full Text:
PDFReferences
Arbanas, G. (2024). ChatGPT and other chatbots in psychiatry. Archives of Psychiatry Research: An International Journal, 60(2), 137-142.
https://doi.org/10.20471/june.2024.60.02.07
Ayeni, O.O., Al Hamad, N.M., & Chisom, O.N. (2024). AI in education: A review of personalized learning and educational technology. GSC Advanced Research Reviews, 18(2), 261-271.
https://doi.org/10.30574/gscarr.2024.18.2.0062
Bærøe, K., Miyata-Sturm, A., & Henden, E. (2020). How to achieve trustworthy artificial intelligence for health. Bulletin of the World Health Organization, 98(4), 257-262.
http://dx.doi.org/10.2471/BLT.19.237289
Calonghi, L. (1972). Valutazione delle composizioni scritte. Indicazioni docimologiche e psicometriche pratiche. Roma: Armando.
Chen, L., Chen, P., & Lin, Z. (2020). Artificial intelligence in education: A review. IEEE Access, 8, 75264-75278.
https://doi.org/10.1109/ACCESS.2020.2988510
Følstad, A., & Brandtzaeg, P.B. (2017). Chatbots and the new world of HCI. Interactions, 24(4), 38-42.
https://doi.org/10.1145/3085558
Giroux, H.A. (2014). Educazione e crisi dei valori pubblici. Le sfide per insegnanti, studenti ed educazione pubblica. Brescia: La Scuola.
Goralski, M.A., & Tan, T.K. (2020). Artificial intelligence and sustainable development. The International Journal of Management Education, 18(1), 100330.
https://doi.org/10.1016/j.ijme.2019.100330
Hallal, K., Hamdan, R., & Tlais, S. (2023). Exploring the potential of AI-Chatbots in organic chemistry: An assessment of ChatGPT and Bard. Computers and Education: Artificial Intelligence, 5, 100170.
https://doi.org/10.1016/j.caeai.2023.100170
Khreisat, M.N., Khilani, D., & Rusho, M.A. (2024). Ethical implications of AI integration in educational decision making: Systematic review. Educational Administration: Theory and Practice, 30(5), 8521-8527.
https://doi.org/10.53555/kuey.v30i5.4406
Kim, T.W. (2023). Application of artificial intelligence chatbots, including ChatGPT, in education, scholarly work, programming, and content generation and its prospects: A narrative review. Journal of Educational Evaluation for Health Professions, 20.
https://doi.org/10.3352/jeehp.2023.20.38
Labazde, L., Grigolia, M., & Machaidze, L. (2023). Role of AI chatbots in education: Systematic literature review. International Journal of Educational Technology in Higher Education, 20, 1-17.
Limna, P., Kraiwanit, T., & Jangjarat, K. (2023). The use of ChatGPT in the digital era: Perspectives on chatbot implementation. Journal of Applied Research, 6(1), 1-10.
https://doi.org/10.37074/jalt.2023.6.1.32
Lozic, E., & Štular, B. (2023). Fluent but not factual: A comparative analysis of ChatGPT and other AI chatbots’ proficiency and originality in scientific writing for humanities. Future Internet, 15(10), 336.
https://doi.org/10.3390/fi15100336
Martínez-Comesana, M., Rigueira-Díaz, X., Larrañaga-Janeiro, A.M.-T., Ocarranza-Prado, I., & Kreibel, D. (2023). Impact of artificial intelligence on assessment methods in primary and secondary education: Systematic literature review. Revista de Psicodidáctica, 28(3), 93-103.
Maslej, N., Fattorini, L., Perrault, R., Parli, V., Reuel, A., Brynjolfsson, E., Etchemendy, J., Ligett, K., Lyons, T., Manyika, J., Niebles, J.C., Shoham, Y., Wald, R., & Clark, J. (2024). The AI Index 2024 annual report. Stanford University, Institute for Human-Centered AI, AI Index Steering Committee.
Okonkwo, C.W., & Ade-Ibijola, A. (2021). Chatbots applications in education: A systematic review. Computers and Education: Artificial Intelligence, 2, 100033.
https://doi.org/10.1016/j.caeai.2021.100033
Rabardel, P. (2001). Instrument mediated activity in situations. In People and Computers XV: Interaction without Frontiers. Joint Proceedings of HCI 2001 and IHM 2001 (pp. 17-30). London: Springer.
Rane, N., Choudhary, S., & Rane, J. (2023). Education 4.0 and 5.0: Integrating artificial intelligence (AI) for personalized and adaptive learning. Journal of Artificial Intelligence and Robotics, 1(1), 29-43.
http://dx.doi.org/10.2139/ssrn.4638365
Sarosa, M., Kusumawadhani, M., & Suyono, A. (2021). The effectiveness of chatbot as an online learning method on active and reflective learning styles. Multicultural Education, 7(9), 92-100.
http://dx.doi.org/10.5281/zenodo.5484411
Shawar, B.A., & Atwell, E. (2007). Chatbots: Are they really useful? Journal for Language Technology and Computational Linguistics, 22(1), 29-49.
Smutny, P., & Schreiberova, P. (2020). Chatbots for learning: A review of educational chatbots for the Facebook Messenger. Computers & Education, 151, 103862.
https://doi.org/10.1016/j.compedu.2020.103862
Stebbins, R.A. (2001). Exploratory research in the social sciences. Thousand Oaks, CA: Sage.
Williams, R.T. (2024). The ethical implications of using generative chatbots in higher education. Frontiers in Education, 8, 1331607.
https://doi.org/10.3389/feduc.2023.1331607
Williamson, B., & Eynon, R. (2020). Historical threads, missing links, and future directions in AI in education. Learning, Media and Technology, 45(3), 76-89.
https://doi.org/10.1080/17439884.2020.1798995
Winkler, R., & Söllner, M. (2018). Unleashing the potential of chatbots in education: A state-of-the-art analysis. Academy of Management Proceedings, 1, 15903.
https://doi.org/10.5465/AMBPP.2018.15903abstract
DOI: https://doi.org/10.7358/ecps-2024-030-marc
Copyright (©) 2025 Massimo Marcuccio, Maria Elena Tassinari, Vanessa Lo Turco – Editorial format and Graphical layout: copyright (©) LED Edizioni Universitarie
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Journal of Educational, Cultural and Psychological Studies (ECPS)
Registered by Tribunale di Milano (19/05/2010 n. 278)
Online ISSN 2037-7924 - Print ISSN 2037-7932
Research Laboratory on Didactics and Evaluation - Department of Education - "Roma Tre" University
Executive Editor: Gaetano Domenici - Associate Executive Editor & Managing Editor: Valeria Biasci
Editorial Board: Eleftheria Argyropoulou - Massimo Baldacci - Joao Barroso - Richard Bates - Christofer Bezzina - Paolo Bonaiuto - Lucia Boncori - Pietro Boscolo - Sara Bubb - Carlo Felice Casula - Jean-Émile Charlier - Lucia Chiappetta Cajola - Carmela Covato - Jean-Louis Derouet - Peter Early - Franco Frabboni - Constance Katz - James Levin - Pietro Lucisano - Roberto Maragliano - Romuald Normand - Michael Osborne - Donatella Palomba - Michele Pellerey - Clotilde Pontecorvo - Vitaly V. Rubtzov - Jaap Scheerens - Noah W. Sobe - Francesco Susi - Giuseppe Spadafora - Pat Thomson
Editorial Staff: Fabio Alivernini - Guido Benvenuto - Anna Maria Ciraci - Massimiliano Fiorucci - Luca Mallia - Massimo Margottini - Giovanni Moretti - Carla Roverselli
Editorial Secretary:Nazarena Patrizi
© 2001 LED Edizioni Universitarie di Lettere Economia Diritto