Neural radiation field-based structure three-dimensional model updating method, apparatus and device, and medium

• Main Authors: CHEN WEILE, XU YANG, ZHENG XIAODONG, FAN YUNLEI, BAO YUEQUAN, MA KAICHEN, DAI XIHUA, YANG ZHENLIANG
• Format: Patent
• Language: Chinese; English
• Published: 19.07.2024
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL; PHYSICS

The invention discloses a neural radiation field-based structure three-dimensional model updating method, apparatus and device, and a medium. The method comprises the steps of establishing a motion structure recovery module; establishing a color and volume density estimation neural network model rendered by the damaged structure scene; training the model based on a volume rendering technology; for a to-be-rendered image, predicting a color value and a volume density value of each sampling point by using the trained model; pixel point color values of the to-be-rendered image are generated by adopting a volume rendering technology, and pixel blocks with predicted color values are combined together to generate a new view angle image; for the new damaged structure image, a motion structure recovery module is adopted to transform a camera center coordinate and a direction vector into a world coordinate system; and adding the new damaged structure image into the damaged structure image data set, and retraining the