Offloading Visual-Inertial Odometry for Low Power Extended Reality

Power consumption is a constraint in designing all-day wear extended reality (XR) devices. To reduce power consumption, we present a novel end-to-end XR system with visual-inertial odometry (VIO) offloaded to a remote server. Even with long network latency, the system produces an end-to-end XR exper...

Full description

Saved in:
Bibliographic Details
Published in2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) pp. 793 - 794
Main Authors Jiang, Qinjun, Huzaifa, Muhammad, Sentosa, William, Zhang, Jeffrey, Gao, Steven, Pang, Yihan, Godfrey, Brighten, Adve, Sarita
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.03.2023
Subjects
Cloud Computing
Conferences
Extended reality
Human-centered computing-Virtual reality-Human-centered computing-Mixed/augmented reality
Power demand
Servers
Three-dimensional displays
User interfaces
VR/AR
Wireless Network
X reality
Online AccessGet full text

Cover

Abstract Power consumption is a constraint in designing all-day wear extended reality (XR) devices. To reduce power consumption, we present a novel end-to-end XR system with visual-inertial odometry (VIO) offloaded to a remote server. Even with long network latency, the system produces an end-to-end XR experience comparable to a system without offloading while providing significant power savings. This latency and bandwidth-resilient nature of head tracking is a new and surprising result.
AbstractList Power consumption is a constraint in designing all-day wear extended reality (XR) devices. To reduce power consumption, we present a novel end-to-end XR system with visual-inertial odometry (VIO) offloaded to a remote server. Even with long network latency, the system produces an end-to-end XR experience comparable to a system without offloading while providing significant power savings. This latency and bandwidth-resilient nature of head tracking is a new and surprising result.
Author Godfrey, Brighten
Huzaifa, Muhammad
Jiang, Qinjun
Pang, Yihan
Gao, Steven
Zhang, Jeffrey
Sentosa, William
Adve, Sarita
Author_xml – sequence: 1
  givenname: Qinjun
  surname: Jiang
  fullname: Jiang, Qinjun
  email: qinjunj2@illinois.edu
  organization: University of Illinois Urbana-Champaign,USA
– sequence: 2
  givenname: Muhammad
  surname: Huzaifa
  fullname: Huzaifa, Muhammad
  email: huzaifa2@illinois.edu
  organization: University of Illinois Urbana-Champaign,USA
– sequence: 3
  givenname: William
  surname: Sentosa
  fullname: Sentosa, William
  email: sentosa2@illinois.edu
  organization: University of Illinois Urbana-Champaign,USA
– sequence: 4
  givenname: Jeffrey
  surname: Zhang
  fullname: Zhang, Jeffrey
  email: jfzhang2@illinois.edu
  organization: University of Illinois Urbana-Champaign,USA
– sequence: 5
  givenname: Steven
  surname: Gao
  fullname: Gao, Steven
  email: hongyig3@illinois.edu
  organization: University of Illinois Urbana-Champaign,USA
– sequence: 6
  givenname: Yihan
  surname: Pang
  fullname: Pang, Yihan
  email: yihanp2@illinois.edu
  organization: University of Illinois Urbana-Champaign,USA
– sequence: 7
  givenname: Brighten
  surname: Godfrey
  fullname: Godfrey, Brighten
  email: pbg@illinois.edu
  organization: University of Illinois Urbana-Champaign,USA
– sequence: 8
  givenname: Sarita
  surname: Adve
  fullname: Adve, Sarita
  email: sadve@illinois.edu
  organization: University of Illinois Urbana-Champaign,USA
BookMark eNotjMtKAzEUQCPoQmu_QBf5gRmTm3nkLrVUWxgYKVqX5c7kRgLTiaQjtX9vQTfnLA6cG3E5xpGFuNMq11rhw3bzUdqqMDkoMLk6Ay_EHGu0plSmsAbhWjy13g-RXBg_5TYcvmnI1iOnKdAgWxf3PKWT9DHJJh7lazxyksufiUfHTm6YhjCdbsWVp-HA83_PxPvz8m2xypr2Zb14bLIAqpgyrFl7AEb0CL3rO-Ku04SltkXtulIbUrUDrIiAHULHZKu-17ZHqMFaMxP3f9_AzLuvFPaUTjuttLLVOf8CazZIag
CODEN IEEPAD
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/VRW58643.2023.00239
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
EISBN 9798350348392
EndPage 794
ExternalDocumentID 10108688
Genre orig-research
GrantInformation_xml – fundername: National Science Foundation
  grantid: 2120464,2217144
  funderid: 10.13039/100000001
GroupedDBID 6IE
6IL
CBEJK
RIE
RIL
ID FETCH-LOGICAL-i204t-97e1f22e99f92cdcbaebb1a951847db513a07d296aa2ed92bea86cc18c9272883
IEDL.DBID RIE
IngestDate Thu Jan 18 11:14:44 EST 2024
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i204t-97e1f22e99f92cdcbaebb1a951847db513a07d296aa2ed92bea86cc18c9272883
PageCount 2
ParticipantIDs ieee_primary_10108688
PublicationCentury 2000
PublicationDate 2023-March
PublicationDateYYYYMMDD 2023-03-01
PublicationDate_xml – month: 03
  year: 2023
  text: 2023-March
PublicationDecade 2020
PublicationTitle 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)
PublicationTitleAbbrev VRW
PublicationYear 2023
Publisher IEEE
Publisher_xml – name: IEEE
Score 1.8699328
Snippet Power consumption is a constraint in designing all-day wear extended reality (XR) devices. To reduce power consumption, we present a novel end-to-end XR system...
SourceID ieee
SourceType Publisher
StartPage 793
SubjectTerms Cloud Computing
Conferences
Extended reality
Human-centered computing-Virtual reality-Human-centered computing-Mixed/augmented reality
Power demand
Servers
Three-dimensional displays
User interfaces
VR/AR
Wireless Network
X reality
Title Offloading Visual-Inertial Odometry for Low Power Extended Reality
URI https://ieeexplore.ieee.org/document/10108688
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3PS8MwGA1uJ08qTvxNDl5bm6xNk6uyMUW3MdzcbSTpFxjOVmaL6F9vknaKguAtlEDafCnvS_Le9xC60JBk0iibuXEW2w0KF4EUMQ90GnNIibFryt3o3g_ZYBrfzpN5I1b3WhgA8OQzCF3T3-Vnha7cUZn9w50vEOct1LI7t1qs1VQSIpG4nE0eEztiN3SW4KGXbf7wTPGQ0d9Bw81gNVPkKaxKFeqPX3UY__02u6jzrc7D4y_c2UNbkO-jq5Exq8IT4vFs-VrJVXCTO860XOFRVjxDuX7HNkHFd8UbHjtrNNxrzr_xBHwy3kHTfu_hehA0_gjBkkZxGYgUiKEUhDCC6kwrCUoRaXMmCzmZSkhXRmlGBZOSQiaoAsmZ1oRrQVPnMnyA2nmRwyHCyvZmEbWdOI0VY4rEWnbTxBhpoY2QI9RxE7B4qUtgLDbffvzH8xO07YJQk7VOUbtcV3Bm0btU5z5qn3FJmyw
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1bS8MwGA06H_RJxYl38-Br65L1krwqG5vuxtjm3kaSfgFxtjJbRH-9SdopCoJvIQRyazlfknO-g9CVgjARWprIjUWBOaAw7gkeME_FAYOYaPNN2Rfd_iDqTIO7eTivxOpOCwMAjnwGvi26t_wkU4W9KjN_uPUFYmwTbRngD2kp16pyCZEGv56NH0LTZ9O3puC-E27-cE1xoNHeRYN1dyVX5Mkvcumrj1-ZGP89nj1U_9bn4dEX8uyjDUgP0M1Q62XmKPF49vhaiKXXTS1rWizxMMmeIV-9YxOi4l72hkfWHA23qhtwPAYXjtfRtN2a3Ha8yiHBe6SNIPd4DERTCpxrTlWipAApiTBRkwGdRIakKRpxQnkkBIWEUwmCRUoRpjiNrc_wIaqlWQpHCEvTOmpQ04jRQEaRJIESzTjUWhhwI-QY1e0CLF7KJBiL9dxP_qi_RNudSb-36HUH96dox25ISd06Q7V8VcC5wfJcXrgd_AS9bJ52
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2023+IEEE+Conference+on+Virtual+Reality+and+3D+User+Interfaces+Abstracts+and+Workshops+%28VRW%29&rft.atitle=Offloading+Visual-Inertial+Odometry+for+Low+Power+Extended+Reality&rft.au=Jiang%2C+Qinjun&rft.au=Huzaifa%2C+Muhammad&rft.au=Sentosa%2C+William&rft.au=Zhang%2C+Jeffrey&rft.date=2023-03-01&rft.pub=IEEE&rft.spage=793&rft.epage=794&rft_id=info:doi/10.1109%2FVRW58643.2023.00239&rft.externalDocID=10108688