Does controller sound contain valuable information for video game scene analysis? Case study by character identification of Super Smash Bros. Ultimate

Understanding of gameplay can enhance the experience and entertainment of video game. In this study, we propose to utilize the sound generated by a controller for analyzing the information of gameplay. Controller sound is a user-friendly feature related to gameplay because it can be very easily reco...

Full description

Saved in:
Bibliographic Details
Published inAcoustical Science and Technology Vol. 45; no. 2; pp. 113 - 116
Main Authors Saito, Yuki, Yatabe, Kohei, Shogun
Format Journal Article
LanguageEnglish
Published Tokyo ACOUSTICAL SOCIETY OF JAPAN 01.03.2024
Japan Science and Technology Agency
Subjects
Computer & video games
Controller sound
Controllers
Neural networks
Scene analysis
Super Smash Bros. Ultimate
Video game scene analysis
Online AccessGet full text

Cover

More Information
Summary:Understanding of gameplay can enhance the experience and entertainment of video game. In this study, we propose to utilize the sound generated by a controller for analyzing the information of gameplay. Controller sound is a user-friendly feature related to gameplay because it can be very easily recorded. As a first step of the research, we performed identification of characters of Super Smash Bros. Ultimate only from controller sound as an example task for examining whether controller sound contains valuable information. The results showed that our model achieved 79% accuracy for identification of five characters only using the controller sound.
ISSN:1346-3969
1347-5177
DOI:10.1250/ast.e23.67