Confident Teacher, Confident Student? A Novel User Study Design for Investigating the Didactic Potential of Explanations and their Impact on Uncertainty

• Published in: arXiv.org
• Main Authors: Chiaburu, Teodor, Haußer, Frank, Bießmann, Felix
• Format: Paper
• Language: English
• Published: Ithaca Cornell University Library, arXiv.org 10.09.2024
• Subjects: Annotations; Artificial intelligence; Biological effects; Collaboration; Design analysis; Design of experiments; Didacticism; Explainable artificial intelligence; Human performance; Performance evaluation; Task complexity; Taxonomy; Uncertainty; Visual effects; Visual tasks

Evaluating the quality of explanations in Explainable Artificial Intelligence (XAI) is to this day a challenging problem, with ongoing debate in the research community. While some advocate for establishing standardized offline metrics, others emphasize the importance of human-in-the-loop (HIL) evalu...