Visual tracking of peripheral devices

• Main Authors: Nienstedt, Zachary C, Edwin, Lionel Ernest, Browy, Eric C, Liraz Lidji, Ron, Miller, Samuel A, Freedman, Barak, Welch, William Hudson
• Format: Patent
• Language: English
• Published: 21.05.2020
• Subjects: AMUSEMENTS; CARD, BOARD, OR ROULETTE GAMES; GAMES; GAMES NOT OTHERWISE PROVIDED FOR; HUMAN NECESSITIES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; OPTICAL ELEMENTS, SYSTEMS, OR APPARATUS; OPTICS; PHYSICS; SPORTS; VIDEO GAMES

Disclosed is a method of performing localization of a handheld device with respect to a wearable device, the method comprising: obtaining, by a sensor mounted to the handheld device, handheld data indicative of movement of the handheld device; obtaining, by an imaging device mounted to a first device, fiducial data indicative of movement of the handheld device, wherein the first device is either the handheld device or the wearable device, and wherein obtaining the fiducial data includes: capturing, by the imaging device, a fiducial image containing a number of fiducials affixed to a second device different than the first device, wherein the second device is either the handheld device or the wearable device; determining the number of fiducials contained in the fiducial image; and updating at least one of a position and an orientation of the handheld device using the fiducial data and the handheld data based on the number of fiducials contained in the fiducial image.