Email this article Artificial Intelligence to Enhance Qualitative Research: Methodological Reflections on a Pilot Study
Abstract
L’INTELLIGENZA ARTIFICIALE PER POTENZIARE LA RICERCA QUALITATIVA: RIFLESSIONI METODOLOGICHE SU UNO STUDIO PILOTA
Abstract
Qualitative analysis is essential in research across diverse fields, offering in-depth insights that often cannot be captured through quantitative methods. However, managing large volumes of qualitative data presents challenges, including its labour intensive nature and the potential for interpretive biases. In this study, we introduce and show a methodology step by step that integrates artificial intelligence (AI) in the analysis of qualitative data, with a focus on textual responses extracted from survey questions. Specifically, our approach employs AI techniques, utilizing Word2Vec for word embedding extraction and K-Means clustering to streamline the analysis of qualitative textual data, while ultimately integrating the researcher’s interpretation of the identified clusters to improve the relevance of the analysis. Moreover, the present article discusses the relevance and significance of this approach as well as its ethical and methodological challenges by means of an empirical illustration taken from a study on teachers’ sensemaking regarding a range of different educational activities.
Keywords
Full Text:
PDFReferences
Abram, M.D., Mancini, K.T., & Parker, R.D. (2020). Methods to integrate Natural Language Processing into qualitative research. International Journal of Qualitative Methods, 19.
https://doi.org/10.1177/1609406920984608
Bholowalia, P., & Kumar, A. (2014). EBK-means: A clustering technique based on Elbow Method and k-means in WSN. International Journal of Computer Applications, 105(9).
Christou, P.A. (2023). How to use artificial intelligence (AI) as a resource, methodological and analysis tool in qualitative research? Qualitative Report, 28(7).
Church, K.W. (2017). Word2Vec. Natural Language Engineering, 23(1), 155-162.
Clarke, N., Foltz, P., & Garrard, P. (2020). How to do things with (thousands of) words: Computational approaches to discourse analysis in Alzheimer’s disease. Cortex: A Journal Devoted to the Study of the Nervous System and Behavior, 129, 446-463.
https://doi.org/10.1016/j.cortex.2020.05.001
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37-46.
https://doi.org/10.1177/001316446002000104
Creswell, J.W., & Poth, C.N. (2017). Qualitative inquiry and research design: Choosing among five approaches (4th ed.). London: Sage.
Dey, I. (2003). Qualitative data analysis: A user friendly guide for social scientists. London: Routledge.
Fleiss, J.L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, 76(5), 378-382.
https://doi.org/10.1037/h0031619
Hasan, B.M.S., & Abdulazeez, A.M. (2021). A review of principal component analysis algorithm for dimensionality reduction. Journal of Soft Computing and Data Mining, 2(1), 20-30.
Jafari, F., & Keykha, A. (2024). Identifying the opportunities and challenges of artificial intelligence in higher education: A qualitative study. Journal of Applied Research in Higher Education, 16(4), 1228-1245.
Jiang, A.Q., Sablayrolles, A., Mensch, A., Bamford, C., Chaplot, D.S., Casas, D.D.L., …, & Sayed, W.E. (2023). Mistral 7B. arXiv preprint.
https://doi.org/10.48550/arXiv.2310.06825
Manning, C.D. (2022). Human language understanding & reasoning. Dædalus, 151(2), 127-138.
https://doi.org/10.1162/daed_a_01905
Natural Language Processing (2020).
https://www.ibm.com/cloud/learn/natural-language-processing
Pedreschi, D., Giannotti, F., Guidotti, R., Monreale, A., Ruggieri, S., & Turini, F. (2019). Meaningful explanations of black box AI decision systems. Proceedings of the AAAI (Association for the Advancement of Artificial Intelligence)Conference on Artificial Intelligence, 33(1, July), 9780-9784.
Rahutomo, F., Kitasuka, T., & Aritsugi, M. (2012). Semantic cosine similarity. International Student Conference on Advanced Science and Technology – ICAST. Proceedings, 4(1, October), 1. University of Seoul (South Korea).
Reimers, N., & Gurevych, I. (2019). Sentence-bert: Sentence embeddings using siamese bert-networks. arXiv preprint.
https://doi.org/10.48550/arXiv.1908.10084
Ritella, G., Loperfido, F.F., De Giglio, G., Scurani, A., & Ligorio, M.B. (2022). Adopting educational robotics and coding to open dialogic spaces in lower secondary education. Dialogic Pedagogy: A Journal for Studies of Dialogic Education, 10, DT41-DT58.
Valdenegro, D. (2023). A large language models digest for social scientist. SocArXiv.
https://doi.org/10.31235/osf.io/m74vs
Wang, Z., Xie, Q., Ding, Z., Feng, Y., & Xia, R. (2023). Is ChatGPT a good sentiment analyzer? A preliminary study. arXiv, 2304.04339.
DOI: https://doi.org/10.7358/ecps-2024-030-luon
Copyright (©) 2025 Maria Luongo, Michela Ponticorvo, Maria Beatrice Ligorio, Pietro Crescenzo, Giuseppe Ritella – Editorial format and Graphical layout: copyright (©) LED Edizioni Universitarie
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Journal of Educational, Cultural and Psychological Studies (ECPS)
Registered by Tribunale di Milano (19/05/2010 n. 278)
Online ISSN 2037-7924 - Print ISSN 2037-7932
Research Laboratory on Didactics and Evaluation - Department of Education - "Roma Tre" University
Executive Editor: Gaetano Domenici - Associate Executive Editor & Managing Editor: Valeria Biasci
Editorial Board: Eleftheria Argyropoulou - Massimo Baldacci - Joao Barroso - Richard Bates - Christofer Bezzina - Paolo Bonaiuto - Lucia Boncori - Pietro Boscolo - Sara Bubb - Carlo Felice Casula - Jean-Émile Charlier - Lucia Chiappetta Cajola - Carmela Covato - Jean-Louis Derouet - Peter Early - Franco Frabboni - Constance Katz - James Levin - Pietro Lucisano - Roberto Maragliano - Romuald Normand - Michael Osborne - Donatella Palomba - Michele Pellerey - Clotilde Pontecorvo - Vitaly V. Rubtzov - Jaap Scheerens - Noah W. Sobe - Francesco Susi - Giuseppe Spadafora - Pat Thomson
Editorial Staff: Fabio Alivernini - Guido Benvenuto - Anna Maria Ciraci - Massimiliano Fiorucci - Luca Mallia - Massimo Margottini - Giovanni Moretti - Carla Roverselli
Editorial Secretary:Nazarena Patrizi
© 2001 LED Edizioni Universitarie di Lettere Economia Diritto