AI in learning assessment: application in a master's program XI Taller Internacional “La transformación digital y las tecnologías de avanzada en la Educación Superior”
Article Sidebar
Main Article Content
Abstract
Artificial intelligence (AI) is transforming educational processes, particularly in the assessment of learning in graduate programs. This study analyzes the results obtained by implementing an AI tool to evaluate the pedagogical process in the course "ICT, Society, and University," part of the master's program "Technologies in Educational Processes" at the Technological University of Havana CUJAE. Methods such as analytical-synthetic, hypothetical-deductive, percentage analysis, and the non-parametric Wilcoxon signed-rank test were used to compare grades assigned by the AI and the instructor within the same group. The results show no statistically significant differences between the two sets of evaluations, although it was observed that the instructor adjusts grades in collaboration with students, raising reflections on the human role in this process. Additionally, the advantages and challenges of integrating AI into educational assessment are explored, highlighting its ability to personalize feedback and enhance continuous learning monitoring. These findings underscore AI's potential to optimize assessment in master's programs while emphasizing the need to balance its use with human intervention. This work contributes to the discussion on how emerging technologies can strengthen pedagogical processes in higher education, offering a critical perspective on their implementation and the benefits they can bring to graduate-level training.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
References
Armas, C., Iglesias, J., & García, M. (2024). La IA en la evaluación de posgrado. Resultados en la Maestría "Las Tecnologías en los Procesos Educativos" de la CUJAE. [ IV Seminario Internacional Educación y TAC: IA e interdisciplinariedad]. https://docs.google.com/presentation/d/1rRrRpr8omMEPtuvIx_0gwORw_iPMTyPo/edit?pli=1#slide=id.p14
Baidoo Anu, D., & Owusu Ansah, L. (2023). Education in the Era of Generative Artificial Intelligence (AI): Understanding the Potential Benefits of ChatGPT in Promoting Teaching and Learning (SSRN Scholarly Paper No. 4337484). Social Science Research Network. https://doi.org/10.2139/ssrn.4337484
Bansal. P. (2024). Prompt Engineering Importance and Applicability with Generative AI. Journal of Computer and Communications, 12(10), 14-23. https://doi.org/10.4236/jcc.2024.1210002
Bernaza Rodríguez, G. (2015). Construyendo ideas pedagógicas sobre el posgrado desde el enfoque Histórico-cultural. Perfiles Educativos, XLI(163), 5p. https://doi.org/10.22201/IISUE.24486167E.2019.163.59308
Bolaño García, M., & Duarte Acosta, N. (2023). Una revisión sistemática del uso de la inteligencia artificial en la educación. Revista Colombiana de Cirugía, 39(1), 51-63. https://www.redalyc.org/journal/3555/355577357005
Dai, Ch., & Ke, F. (2022). Educational applications of artificial intelligence in simulation-based learning: A systematic mapping review. Computers and Education: Artificial Intelligence, 3, undefined-undefined. https://doi.org/10.1016/j.caeai.2022.100087
EDUCASE. (2024). 2024 EDUCAUSE Horizon Report Teaching and Learning Edition EDUCAUSE Library. https://library.educause.edu/resources/2024/5/2024-educause-horizon-report-teaching-and-learning-edition
García Delgado, A., & Oliver Cuello, R. (2009). Interacción entre la evaluación continua y la autoevaluación formativa: La potenciación del aprendizaje autónomo. Revista de Docencia Universitaria, 7(4). https://revistas.um.es/redu/article/view/92581
Lara Andino,A., Sacatoro Toaquiza, J., León Vinueza, A., & Jarrín Trujillo, G. (2024). La evaluación, la inteligencia artificial y otras tecnologías de vanguardia en Educación General Básica Superior. Prometeo Conocimiento Científico, 3(2), 1-14. https://doi.org/10.55204/pcc.v4i1.e85
Lentz, A., Siy, J., & Carraccio, C. (2021). AI-ssessment: Towards Assessment As a Sociotechnical System for Learning. Academic Medicine, 96(Supplement_1), S87-S88. https://doi.org/10.1097/ACM.0000000000004104
Medina Fonseca, C. (2016). La unidad de análisis como herramienta metodológica de la práctica Psico-Educativa en la escuela. Entornos, 29(2), 1-6. https://dialnet.unirioja.es/servlet/articulo?codigo=6937137
Organización de las Naciones Unidas. (2024). Objetivos de Desarrollo Sostenible. Objetivo 4.https://www.un.org/sustainabledevelopment/es/education
Resolución No. 140-19.- Reglamento de la Educación de Posgrado de la República de Cuba (2019). https://cuba.vlex.com/vid/resolucion-no-140-19-810750577
Saleem, F., Ullah, Z., Fakieh, B., & Kateb, F. (2021). Sistema inteligente de apoyo a la decisión para predecir el rendimiento del estudiante en e-learning utilizando aprendizaje automático en conjunto. Matemáticas, 9(17). https://doi.org/10.3390/math9172078
Santos Baranda, J., & Armas Velasco, C. (2020). La integración de las tecnologías de la información y la comunicación en los procesos fomativos universitarios. 12mo Congreso Universidad, La Habana. https://www.researchgate.net/publication/341756794_LA_INTEGRACION_DE_LAS_TECNOLOGIAS_DE_LA_INFORMACION_Y_LA_COMUNICACION_EN_LOS_PROCESOS_FORMATIVOS_UNIVERSITARIOS
