Detecting input in artificial reality systems based on a pinch and pull gesture

An artificial reality system is described that renders, presents, and controls user interface elements within an artificial reality environment, and performs actions in response to one or more detected gestures of the user. In one example, an artificial reality system comprises an image capture devi...

Full description

Saved in:
Bibliographic Details
Main Authors Varga, Adam Tibor, Fox, Barrett, Ravasz, Jonathan, Tickner, Simon Charles, Stevens, Jasper, Spurlock, Jennifer Lynn, Pinchon, Etienne, Ellis, Robert, Sorge-Toomey, Kyle Eric
Format Patent
LanguageEnglish
Published 24.09.2024
Subjects
CALCULATING
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
OPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
OPTICS
PHYSICS
Online AccessGet full text

Cover

More Information
Summary:An artificial reality system is described that renders, presents, and controls user interface elements within an artificial reality environment, and performs actions in response to one or more detected gestures of the user. In one example, an artificial reality system comprises an image capture device configured to capture image data representative of a physical environment; a head-mounted display (HMD) configured to output artificial reality content; a gesture detector configured to identify, from the image data, a gesture comprising a motion of two fingers from a hand to form a pinching configuration and a subsequent pulling motion while in the pinching configuration; a user interface (UI) engine configured to generate a UI input element in response to identifying the gesture; and a rendering engine configured to render the UI input element as an overlay to at least some of the artificial reality content.
Bibliography:Application Number: US202217658982