Orientation determination based on both image and inertial measurement unit

• Main Authors: KURBANEV, RAVIL RUSTMOVICH, GUBODULIN, RATMIR LASSILEVICH, GUSEV ALEXEY ANDREEVICH, GANGALOV, DANIIL OLEGOVICH, ERIVANTCEV VIKTOR VLADIMIROVICH, KARTASHOV ALEXEY IVANOVICH, LOBANOV ALEXANDER SERGEEVICH
• Format: Patent
• Language: Chinese; English
• Published: 13.05.2022
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; ELECTRIC DIGITAL DATA PROCESSING; PHYSICS

A system for tracking an orientation of a part of a user based on both an image and an inertial measurement unit (IMU). For example, the system receives an image showing a portion of a user wearing a sensor module. The system receives a first set of orientation measurements generated by sensor modules attached to some portions of a user. The system determines, from the image, a second set of orientation measurements for one or more features of the portion of the user. The system provides a first set of orientation measurements and a second set of orientation measurements as inputs to an artificial neural network, the artificial neural network is configured to predict orientation measurements of one or more other sites of the user to be measured by an additional sensor module if the additional sensor module is to be attached to the other sites of the user. 一种用于基于图像和惯性测量单元(IMU)两者跟踪用户的部位的取向的系统。例如，该系统接收示出穿戴传感器模块的用户的一部分的图像。该系统接收由附接到用户的一些部位的传感器模块生成的取向测量结果的第一集合。该系统从图像中确定用户的部分的一个或多个特征的取向测量结果的第二集合。该系统提供所述取向测量结果的第一集合和所