SYSTEMS AND METHODS FOR CONTROLLING PALLETS IN A MANUFACTURING ENVIRONMENT USING REINFORCEMENT LEARNING

• Main Authors: Maske, Harshal, Filev, Dimitar Petrov, Birley, Jim, Bennett, Robert, Upadhyay, Devesh, Miller, Justin
• Format: Patent
• Language: English
• Published: 22.06.2023
• Subjects: CALCULATING; COMPUTING; COUNTING; DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FORADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORYOR FORECASTING PURPOSES; GYROSCOPIC INSTRUMENTS; MEASURING; MEASURING DISTANCES, LEVELS OR BEARINGS; NAVIGATION; PHOTOGRAMMETRY OR VIDEOGRAMMETRY; PHYSICS; SURVEYING; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE,COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTINGPURPOSES, NOT OTHERWISE PROVIDED FOR; TESTING

A method includes obtaining sensor data from a plurality of sensors disposed at a plurality of routing control locations of an environment, where the sensor data is indicative of a number of a plurality of pallets at the plurality of routing control locations. The method includes calculating a plurality of difference values based on the sensor data, calculating a transient production value based on the sensor data and a transient objective function, and calculating a steady state production value based on the sensor data and a steady state objective function. The method includes generating a state vector based on the plurality of difference values, the transient production value, and the steady state production value, and defining a set of routes for a set of pallets from among the plurality of pallets based on the state vector and a digital twin of the environment.