Ubiq-Genie: Leveraging External Frameworks for Enhanced Social VR Experiences

• Published in: 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) pp. 497 - 501
• Main Authors: Numan, Nels, Giunchi, Daniele, Congdon, Benjamin, Steed, Anthony
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.03.2023
• Subjects: Collaboration; Computer architecture; Conferences; generative artificial intelligence; open source; Prototypes; social virtual reality; system architecture; Systems architecture; Three-dimensional displays; Virtual reality
• DOI: 10.1109/VRW58643.2023.00108

This paper describes the Ubiq-Genie framework for integrating external frameworks with the Ubiq social VR platform. The proposed architecture is modular, allowing for easy integration of services and providing mechanisms to offload computationally intensive processes to a server. To showcase the capabilities of the framework, we present two prototype applications: 1) a voice- and gesture-controlled texture generation method based on Stable Diffusion 2.0 and 2) an embodied conversational agent based on ChatGPT. This work aims to demonstrate the potential of integrating external frameworks into social VR for the creation of new types of collaborative experiences.