Full Waveform Inversion Using the Hypergradient Descent Method

Optimizing step length or learning rate is crucial for efficient gradient-based inversions, including seismic full waveform inversions and deep learning. Hypergradient descent methods, initially proposed for deep learning, update hyperparameters using gradient descent techniques. We applied the hype...

Full description

Saved in:
Bibliographic Details
Published inEconomic and Environmental Geology Vol. 57; no. 6; pp. 665 - 680
Main Authors Jo, Jun Hyeon, Ha, Wansoo
Format Journal Article
LanguageEnglish
Published 대한자원환경지질학회 31.12.2024
Subjects
Online AccessGet full text

Cover

Loading…
More Information
Summary:Optimizing step length or learning rate is crucial for efficient gradient-based inversions, including seismic full waveform inversions and deep learning. Hypergradient descent methods, initially proposed for deep learning, update hyperparameters using gradient descent techniques. We applied the hypergradient descent method to update the step length in full waveform inversion. While this approach still requires selecting an appropriate learning rate for hypergradient descent, it eliminates the need to manually tune and schedule the step length in full waveform inversion. We implemented the hypergradient descent method with the Adam optimizer to invert seismic data and compared the results to those obtained using a line search method. Numerical examples demonstrated that the hypergradient descent method accelerated full waveform inversion and produced results comparable to those from the conventional line search method. KCI Citation Count: 0
ISSN:1225-7281
2288-7962
DOI:10.9719/EEG.2024.57.6.665