Engaging Teachers in Assessment Design: RubricaBot as a Reflective Mediator for Assessment Literacy and AI Literacy

Autori

  • Federica Emanuel eCampus University
  • Marco Rondonotti eCampus University
  • Angelo Basta eCampus University
  • Paolo Raviolo eCampus University

Parole chiave:

assessment literacy, AI literacy, generative artificial intelligence, rubric-based assessment, teacher education

Abstract

Generative Artificial Intelligence is increasingly entering assessment practices, raising questions about how teachers engage with AI-generated responses while retaining professional judgement. This study investigates teachers’ perceptions of RubricaBot, a chatbot designed to support rubric construction. A total of 956 participants enrolled in teacher qualification programmes first received training on rubric-based assessment, then constructed a rubric related to their own teaching context and subsequently used RubricaBot to review it. A post-activity questionnaire examined assessment practices, perceptions of autonomous rubric design, and the usefulness, ease of use, limitations, reflective potential, and formative value of RubricaBot. Autonomous rubric construction was perceived as moderately demanding. Participants with previous assessment-specific training reported significantly greater confidence, ease in defining criteria and levels, rapidity, and perceived structure of the process. RubricaBot was generally perceived as useful, easy to use, and supportive of reflection, while concerns about reliability and contextual adequacy remained. The findings suggest that AI-supported rubric design may provide a useful setting for integrating assessment literacy and AI literacy while preserving teachers’ responsibility for assessment decisions.

Riferimenti bibliografici

Bearman, M., Tai, J., Dawson, P., Boud, D., & Ajjawi, R. (2024). Developing evaluative judgement for a time of generative artificial intelligence. Assessment & Evaluation in Higher Education, 49(6), 893–905. https://doi.org/10.1080/02602938.2024.2335321

Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21(1), 5–31. https://doi.org/10.1007/s11092-008-9068-5

Brookhart, S. M. (2018). Appropriate criteria: Key to effective rubrics. Frontiers in Education, 3, Article 22. https://doi.org/10.3389/feduc.2018.00022

Cui, Y., Meng, Y., & Tang, L. (2025). Reconsidering teacher assessment literacy in GenAI-enhanced environments: A scoping review. Teaching and Teacher Education, 165, 105163. https://doi.org/10.1016/j.tate.2025.105163

Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319–340. https://doi.org/10.2307/249008

di Padova, M., Basta, A., Tinterri, A., & Dipace, A. (2026). RubricaBot: Un supporto intelligente alla progettazione valutativa nella formazione dei docenti. In L. Giannandrea, F. Gratani, & L. M. Capolla (Eds.), Valutazione e Intelligenza Artificiale. Prospettive didattiche, etiche e metodologiche (pp. 311–324). Pensa Evolution.

Panadero, E., & Jonsson, A. (2013). The use of scoring rubrics for formative assessment purposes revisited: A review. Educational Research Review, 9, 129–144. https://doi.org/10.1016/j.edurev.2013.01.002

Pastore, S., & Andrade, H. L. (2019). Teacher assessment literacy: A three-dimensional model. Teaching and Teacher Education, 84, 128–138. https://doi.org/10.1016/j.tate.2019.05.003

Prilop, C. N., Mah, D.-K., Jacobsen, L. J., Hansen, R. R., Weber, K. E., & Hoya, F. (2025). Generative AI in teacher education: Educators’ perceptions of transformative potentials and the triadic nature of AI literacy explored through AI-enhanced methods. Computers and Education: Artificial Intelligence, 9, 100471. https://doi.org/10.1016/j.caeai.2025.100471

Rondonotti, M., & Emanuel, F. (2025). Assessment literacy e formazione continua: Le posture valutative del persona-le docente. Pedagogia Oggi, 23(2), 226–233. https://doi.org/10.7346/PO-022025-27

Sperling, K., Stenberg, C.-J., McGrath, C., Åkerfeldt, A., Heintz, F., & Stenliden, L. (2024). In search of artificial intelligence (AI) literacy in teacher education: A scoping review. Computers and Education Open, 6, 100169. https://doi.org/10.1016/j.caeo.2024.100169

Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: To-ward a unified view. MIS Quarterly, 27(3), 425–478. https://doi.org/10.2307/30036540

Xia, Q., Weng, X., Ouyang, F., Lin, T.-J., & Chiu, T. K. F. (2024). A scoping review on how generative artificial intelligence transforms assessment in higher education. International Journal of Educational Technology in Higher Education, 21, Article 40. https://doi.org/10.1186/s41239-024-00468-z

##submission.downloads##

Pubblicato

2026-11-19

Come citare

Emanuel, F., Rondonotti, M., Basta, A., & Raviolo, P. (2026). Engaging Teachers in Assessment Design: RubricaBot as a Reflective Mediator for Assessment Literacy and AI Literacy . Journal of Inclusive Methodology and Technology in Learning and Teaching, 6(3). Recuperato da https://www.inclusiveteaching.it/index.php/inclusiveteaching/article/view/812

Puoi leggere altri articoli dello stesso autore/i