INTERPRETING DISCRETE TASKS FROM COMPLEX INSTRUCTIONS FOR ROBOTIC SYSTEMS AND APPLICATIONS

• Main Authors: Kumar, Ratin, Sah, Shagan, Fox, Dieter, Paxton, Christopher Jason
• Format: Patent
• Language: English
• Published: 21.09.2023
• Subjects: CHAMBERS PROVIDED WITH MANIPULATION DEVICES; CONTROL OR REGULATING SYSTEMS IN GENERAL; CONTROLLING; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; HAND TOOLS; MANIPULATORS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS ORELEMENTS; PERFORMING OPERATIONS; PHYSICS; PORTABLE POWER-DRIVEN TOOLS; REGULATING; TRANSPORTING

Approaches provide for performance of a complex (e.g., compound) task that may involve multiple discrete tasks not obvious from an instruction to perform the complex task. A set of conditions for an environment can be determined using captured image data, and the instruction analyzed to determine a set of final conditions to exist in the environment after performance of the instruction. These initial and end conditions are used to determine a sequence of discrete tasks to be performed to cause a robot or automated device to perform the instruction. This can involve use of a symbolic or visual planner in at least some embodiments, as well as a search of possible sequences of actions available for the robot or automated device. A robot can be caused to perform the sequence of discrete tasks, and feedback provided such that the sequence of tasks can be modified as appropriate.