Supporting Instructional Design in Higher Education with Reliable AI-Generated Courseware
Parole chiave:
Generative Artificial Intelligence, Instructional Design, Course Authoring, Large Language Models, Multi-Agent SystemsAbstract
Large language models can substantially accelerate the production of teaching materials, yet generating an entire university course requires more than producing individual pieces of educational text. Learning outcomes, syllabus structure, assessments, slides, and lecture scripts must remain mutually consistent and reflect the intended learners, teaching context, and instructional strategy. In this study, we investigate whether making these instructional decisions explicit before content generation can improve the quality and robustness of AI-generated courseware. We evaluate a structured course-authoring pipeline that combines a typed course specification, course-level instructional planning, schema-constrained lesson generation, and deterministic courseware compilation. The pipeline is compared with prior works using the same university course specifications. Four generator models are evaluated by four shared large-language-model judges using a fixed rubric covering learning objectives, syllabus, assessments, slides, and scripts. The structured pipeline improves the overall judged quality for every generator. The largest improvements concern learning objectives, syllabus organization, and assessment quality. Improvements are also consistently positive across disciplines. These findings provide evidence that explicit instructional representations can strengthen the coherence and practical reliability of AI-supported course authoring, while reinforcing the need for instructor oversight.
Riferimenti bibliografici
Bennett, S., Agostinho, S., & Lockyer, L. (2017). The process of designing for learning: Understanding university teachers' design work. Educational Technology Research and Development, 65(1), 125–145. DOI 10.1007/s11423-016-9469-y.
Biggs, J. (1996). Enhancing teaching through constructive alignment. Higher Education, 32, 347–364. DOI 10.1007/BF00138871.
Branch, R. M. (2009). Instructional design: The ADDIE approach. Springer. DOI 10.1007/978-0-387-09506-6.
Davis, R. O., & Lee, Y. J. (2024). Prompt: ChatGPT, create my course, please! Education Sciences, 14(1), 24. DOI 10.3390/educsci14010024.
Fan, H., Chen, G., Wang, X., & Peng, Z. (2024). LessonPlanner: Assisting novice teachers to prepare pedagogy-driven lesson plans with large language models. Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology, Article 146, 1–20. DOI 10.1145/3654777.3676390.
Gavin, M., & McGrath-Champ, S. (2024). Teacher workload and the organisation of work: A research agenda for a post-pandemic future. Labour & Industry, 34(1), 88–99. DOI 10.1080/10301763.2024.2357891.
Hu, B., Zhu, J., Pei, Y., & Gu, X. (2025). Exploring the potential of LLM to enhance teaching plans through teaching simulation. npj Science of Learning, 10, Article 7. DOI 10.1038/s41539-025-00300-x.
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, Article 102274. DOI 10.1016/j.lindif.2023.102274.
Quality Matters. (2023). QM Higher Education Rubric, Seventh Edition. Quality Matters.
Wang, S., Xu, T., Li, H., Zhang, C., Liang, J., Tang, J., Yu, P. S., & Wen, Q. (2024). Large language models for education: A survey and outlook. arXiv.
Yao, H., Xu, W., Turnau, J., Kellam, N., & Wei, H. (2026). Instructional Agents: Reducing teaching faculty workload through multi-agent instructional design. In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers) (pp. 4087–4109). Association for Computational Linguistics. DOI 10.18653/v1/2026.eacl-long.191.
Zawacki-Richter, O., Bai, J. Y. H., Lee, K., Slagter van Tryon, P. J., & Prinsloo, P. (2024). New advances in artificial intelligence applications in higher education? International Journal of Educational Technology in Higher Education, 21, Article 32. DOI 10.1186/s41239-024-00464-3.
Zhang, Z., Zhang-Li, D., Yu, J., Gong, L., Zhou, J., Hao, Z., Jiang, J., Cao, J., Liu, H., Liu, Z., Hou, L., & Li, J. (2024). Simulating classroom education with LLM-empowered agents. arXiv.
Zheng, L., Chiang, W.-L., Sheng, Y., Zhuang, S., Wu, Z., Zhuang, Y., Lin, Z., Li, Z., Li, D., Xing, E. P., Zhang, H., Gonzalez, J. E., & Stoica, I. (2023). Judging LLM-as-a-judge with MT-Bench and Chatbot Arena. Advances in Neural Information Processing Systems, 36.
##submission.downloads##
Pubblicato
Come citare
Fascicolo
Sezione
Licenza
Copyright (c) 2026 Ludovico Boratto, Marco Cabras, Salvatore Mario Carta, Mirko Marras

Questo lavoro è fornito con la licenza Creative Commons Attribuzione - Non commerciale - Non opere derivate 4.0 Internazionale.