Attribution rollout: a new way to interpret visual transformer

• Published in: Journal of ambient intelligence and humanized computing Vol. 14; no. 1; pp. 163 - 173
• Main Authors: Xu, Li, Yan, Xin, Ding, Weiyue, Liu, Zechao
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01.01.2023; Springer Nature B.V
• Subjects: Algorithms; Artificial Intelligence; Back propagation; Computational Intelligence; Computer vision; Decision making; Engineering; Methods; Natural language processing; Original Research; Robotics and Automation; Transformers; User Interfaces and Human Computer Interaction; Visualization; Vision transformer; Integrated gradients; Interpretability; Attention

Transformer-based models are dominating the field of natural language processing and are becoming increasingly popular in the field of computer vision. However, the black box characteristics of transformers seriously hamper their application in certain fields. Prior work relies on the raw attention...