Real-time Animation Generation and Control on Rigged Models via Large Language Models

We introduce a novel method for real-time animation control and generation on rigged models using natural language input. First, we embed a large language model (LLM) in Unity to output structured texts that can be parsed into diverse and realistic animations. Second, we illustrate LLM's potent...

Full description

Saved in:
Bibliographic Details
Main Authors Huang, Han, De La Torre, Fernanda, Fang, Cathy Mengying, Banburski-Fahey, Andrzej, Amores, Judith, Lanier, Jaron
Format Journal Article
LanguageEnglish
Published 26.10.2023
Subjects
Computer Science - Artificial Intelligence
Computer Science - Graphics
Online AccessGet full text

Cover

More Information
Summary:We introduce a novel method for real-time animation control and generation on rigged models using natural language input. First, we embed a large language model (LLM) in Unity to output structured texts that can be parsed into diverse and realistic animations. Second, we illustrate LLM's potential to enable flexible state transition between existing animations. We showcase the robustness of our approach through qualitative results on various rigged models and motions.
DOI:10.48550/arxiv.2310.17838