SYSTEMS AND METHODS FOR DETERMINING A COMBINATION OF SENSOR MODALITIES BASED ON ENVIRONMENTAL CONDITIONS

• Main Authors: MILKOWSKI, Arthur, LAY, Norman K, MATHEW, Shawn N, MIANZO, Lawrence A
• Format: Patent
• Language: English
• Published: 05.09.2024
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; MEASURING; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS; MEASURING LENGTH, THICKNESS OR SIMILAR LINEARDIMENSIONS; PHYSICS; TESTING

A method for determining a wear or loss condition of a ground engaging tool (GET). The method includes receiving imaging data and environmental data from a plurality of sensors, the plurality of sensors includes a plurality of imaging sensors of different modalities. The method also includes determining network selection weights for each of a plurality of deep learning networks based on the imaging data or environmental data, wherein each of the plurality of deep learning networks utilizes a different respective combination of one or more of the plurality of imaging sensors as inputs. The method further includes determining at least one physical dimension of at least one portion of the GET using one or more of the plurality of deep learning networks based on the network selection weights. The wear or loss condition of the GET is determined based on the at least one physical dimension.