The Effects of Explanations in Automated Essay Scoring Systems on Student Trust and Motivation

Rianne Conijn, Patricia K. Kahr, Chris C. P. Snijders

Journal of Learning Analytics 2023 article cited by 76

importance 4/10 partially solved Explainable Artificial Intelligence (XAI) education technology stage: research

It was unknown how explanations in automated essay scoring systems affect students' trust and motivation.

Student trust in AI grading affects acceptance and fairness of AI use in education.

User study testing full-text global explanations and an accuracy statement in an automated essay scoring system, designed via needs-elicitation and explainable AI guidelines.

Both explanation types had no effect on student trust or motivation versus no explanations; the gap between self-estimated and system grade showed a larger effect (abstract truncated).

Shows explanations alone did not increase student trust or motivation in AI essay scoring.

Venue Journal of Learning Analytics
Published 2023
Work type article
Authors Rianne Conijn, Patricia K. Kahr, Chris C. P. Snijders
Citations 76 (OpenAlex, at import time)
References 79
Model or method not stated in source
Organization not stated in source
Primary source https://doi.org/10.18608/jla.2023.7801
Open access diamond
Keywords explainable AI, automated essay scoring, student trust, motivation, education
4 / 10

real but narrower advance

Trust and fairness in AI grading is a real education concern, but the study is narrow and the abstract states no scale of impact.

Basis: inferred. Judged from the source text, which gives no explicit scale. Stated scale: not stated in source. Method and limits.

# Paper Year Citations Importance
1 Automated language essay scoring systems: a literature review
Mohamed Abdellatif Hussein, Hesham Hassan, Mohammad Nassef
2019 179
5
2 Examining Deep Learning Architectures for Crime Classification and Prediction
Panagiotis Stalidis, Theodoros Semertzidis, Petros Daras
2021 20
5
3 Automated Essay Scoring Using Transformer Models
Sabrina Ludwig, Christian Mayer, Christopher Hansen, Kerstin Eilers, S...
2021 9
4
4 Hybrid Approach to Automated Essay Scoring: Integrating Deep Learning Embeddings with Handcrafted Linguistic Features for Improved Accuracy
Muhammad Faseeh, Abdul Jaleel, Naeem Iqbal, Anwar Ghani, Akmalbek Bobo...
2024 39
4
5 EssayGAN: Essay Data Augmentation Based on Generative Adversarial Networks for Automated Essay Scoring
Yo-Han Park, Yong‐Seok Choi, Cheon-Young Park, Kong-Joo Lee
2022 17
4