Research and Practice in Technology Enhanced Learning | 2026
Authors: Dai Y.; Flanagan B.; Ogata H.
DOI: 10.58459/rptel.2026.21004
Journal: Research and Practice in Technology Enhanced Learning
Year: 2026
Publisher: Asia-Pacific Society for Computers in Education
Document Type: Article
Open Access: All Open Access; Gold Open Access; Green Open Access
Cited by: 0
To make accurate predictions, complex artificial intelligence techniques are being adopted in intelligent systems. It leads to the need for explanations, helping users understand how the model works. Beyond this original purpose, explanations in educational intelligent systems have been found to increase students' awareness, perceived usefulness, and acceptance of the recommendations. Can we ensure a model makes accurate predictions and has effects of explanations at the same time? Though it is commonly considered that complex models are accurate but difficult to interpret, it remains debatable whether there is a trade-off between the accuracy and explainability of such models. In this study, we explore the relationships between accuracy and explainability of different models for recommending math quizzes in the context of formative assessment. Focusing on three recommender models-an inherently explainable model (Naïve CE), a black-box model (MF), and an integrated model (CE+MF), we compared the accuracy using a large-scale real-world dataset and evaluated the explanations in a semi-interactive questionnaire survey. We found that: 1) There was a trade-off between accuracy and explainability given the specific context. 2) The explainability did not demonstrate consistent trends among different aspects. Especially, perceived understandability did not indicate the perceived usefulness in math learning and the behavioral intention to use the system. 3) The integrated model displayed a balanced level of accuracy and explainability, which implies the feasibility to develop an explainable educational recommender system by improving the accuracy of an inherently explainable model. © The Author(s). 2025.
Accuracy; Explainability; Math quizzes; Matrix factorization; Recommender systems