Engaging Teachers in Assessment Design: RubricaBot as a Reflective Mediator for Assessment Literacy and AI Literacy
Parole chiave:
assessment literacy, AI literacy, generative artificial intelligence, rubric-based assessment, teacher educationAbstract
Generative Artificial Intelligence is increasingly entering assessment practices, raising questions about how teachers engage with AI-generated responses while retaining professional judgement. This study investigates teachers’ perceptions of RubricaBot, a chatbot designed to support rubric construction. A total of 956 participants enrolled in teacher qualification programmes first received training on rubric-based assessment, then constructed a rubric related to their own teaching context and subsequently used RubricaBot to review it. A post-activity questionnaire examined assessment practices, perceptions of autonomous rubric design, and the usefulness, ease of use, limitations, reflective potential, and formative value of RubricaBot. Autonomous rubric construction was perceived as moderately demanding. Participants with previous assessment-specific training reported significantly greater confidence, ease in defining criteria and levels, rapidity, and perceived structure of the process. RubricaBot was generally perceived as useful, easy to use, and supportive of reflection, while concerns about reliability and contextual adequacy remained. The findings suggest that AI-supported rubric design may provide a useful setting for integrating assessment literacy and AI literacy while preserving teachers’ responsibility for assessment decisions.
Riferimenti bibliografici
Bearman, M., Tai, J., Dawson, P., Boud, D., & Ajjawi, R. (2024). Developing evaluative judgement for a time of generative artificial intelligence. Assessment & Evaluation in Higher Education, 49(6), 893–905. https://doi.org/10.1080/02602938.2024.2335321
Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21(1), 5–31. https://doi.org/10.1007/s11092-008-9068-5
Brookhart, S. M. (2018). Appropriate criteria: Key to effective rubrics. Frontiers in Education, 3, Article 22. https://doi.org/10.3389/feduc.2018.00022
Cui, Y., Meng, Y., & Tang, L. (2025). Reconsidering teacher assessment literacy in GenAI-enhanced environments: A scoping review. Teaching and Teacher Education, 165, 105163. https://doi.org/10.1016/j.tate.2025.105163
Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319–340. https://doi.org/10.2307/249008
di Padova, M., Basta, A., Tinterri, A., & Dipace, A. (2026). RubricaBot: Un supporto intelligente alla progettazione valutativa nella formazione dei docenti. In L. Giannandrea, F. Gratani, & L. M. Capolla (Eds.), Valutazione e Intelligenza Artificiale. Prospettive didattiche, etiche e metodologiche (pp. 311–324). Pensa Evolution.
Panadero, E., & Jonsson, A. (2013). The use of scoring rubrics for formative assessment purposes revisited: A review. Educational Research Review, 9, 129–144. https://doi.org/10.1016/j.edurev.2013.01.002
Pastore, S., & Andrade, H. L. (2019). Teacher assessment literacy: A three-dimensional model. Teaching and Teacher Education, 84, 128–138. https://doi.org/10.1016/j.tate.2019.05.003
Prilop, C. N., Mah, D.-K., Jacobsen, L. J., Hansen, R. R., Weber, K. E., & Hoya, F. (2025). Generative AI in teacher education: Educators’ perceptions of transformative potentials and the triadic nature of AI literacy explored through AI-enhanced methods. Computers and Education: Artificial Intelligence, 9, 100471. https://doi.org/10.1016/j.caeai.2025.100471
Rondonotti, M., & Emanuel, F. (2025). Assessment literacy e formazione continua: Le posture valutative del persona-le docente. Pedagogia Oggi, 23(2), 226–233. https://doi.org/10.7346/PO-022025-27
Sperling, K., Stenberg, C.-J., McGrath, C., Åkerfeldt, A., Heintz, F., & Stenliden, L. (2024). In search of artificial intelligence (AI) literacy in teacher education: A scoping review. Computers and Education Open, 6, 100169. https://doi.org/10.1016/j.caeo.2024.100169
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: To-ward a unified view. MIS Quarterly, 27(3), 425–478. https://doi.org/10.2307/30036540
Xia, Q., Weng, X., Ouyang, F., Lin, T.-J., & Chiu, T. K. F. (2024). A scoping review on how generative artificial intelligence transforms assessment in higher education. International Journal of Educational Technology in Higher Education, 21, Article 40. https://doi.org/10.1186/s41239-024-00468-z
##submission.downloads##
Pubblicato
Come citare
Fascicolo
Sezione
Licenza
Copyright (c) 2026 Federica Emanuel, Marco Rondonotti, Angelo Basta, Paolo Raviolo

Questo lavoro è fornito con la licenza Creative Commons Attribuzione - Non commerciale - Non opere derivate 4.0 Internazionale.