AI-driven Family Interaction Over Melded Space and Time

Computer-mediated interaction services connect people over a distance. However, we address that those people are often "locked in a frame"-which includes an interaction mode, a point in time, or a context of either person. We observe that such lock-ins make it difficult to shape the intera...

Full description

Saved in:
Bibliographic Details
Published inIEEE pervasive computing Vol. 22; no. 1; pp. 1 - 10
Main Authors Kang, Bumsoo, Kang, Seungwoo, Hwang, Inseok
Format Journal Article
LanguageEnglish
Published New York IEEE 01.01.2023
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects
Avatars
Equivalence
Object oriented modeling
Real-time systems
Robots
Semantics
Servers
Synchronization
Online AccessGet full text
ISSN1536-1268
1558-2590
DOI10.1109/MPRV.2022.3232620

Cover

More Information
Summary:Computer-mediated interaction services connect people over a distance. However, we address that those people are often "locked in a frame"-which includes an interaction mode, a point in time, or a context of either person. We observe that such lock-ins make it difficult to shape the interaction to be mutually symmetric. In this article, we propose a semantic-equivalent melding of space and time to provide a new form of empathetic interaction. We present HomeMeld and MomentMeld, which aim to meld space and time by applying AI, respectively. HomeMeld provides a sense of living together to a family living apart with AI-driven autonomous robotic avatars. MomentMeld utilizes an ensemble of visual AI to create interaction topics by matching semantic-equivalent photos. In-the-wild experiments reveal that HomeMeld and MomentMeld open new possibilities for empathetic interaction. Finally, we introduce a new interaction service leveraging technical synergy of HomeMeld and MomentMeld.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1536-1268
1558-2590
DOI:10.1109/MPRV.2022.3232620