System and method for generating user inputs for a video game

• Main Authors: Uberti, David Erwan Damien, Bradley, Timothy Edward
• Format: Patent
• Language: English
• Published: 19.09.2023
• Subjects: AMUSEMENTS; CALCULATING; CARD, BOARD, OR ROULETTE GAMES; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; ELECTRIC DIGITAL DATA PROCESSING; GAMES; GAMES NOT OTHERWISE PROVIDED FOR; HUMAN NECESSITIES; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; PHYSICS; SPORTS; VIDEO GAMES

A system for generating video game inputs is provided. The system comprises an input unit operable to obtain images of a passive non-luminous object being held by a user as a video games controller. The system also comprises an object detector and object pose detector for detecting the object and its respective pose in the obtained images. The pose detector is configured to detect the pose of the object based on at least one of a (i) contour detection operation and (ii) the output of a machine learning model that has been trained to detect the poses of passive non-luminous objects in images. A user input generator is configured to generate user inputs based on the detected changes in pose of the passive non-luminous object and to transmit these to a video game unit at which a video game is being executed. A corresponding method is also provided.