GPU memory usage optimization for backward propagation in deep network training - Hong, Ding-Yong; Tsai, Tzu-Hsien; Wang, Ning; Liu, Pangfeng; Wu, Jan-Jan (Journal of parallel and distributed computing, 2025)
Keywords: Checkpointing; Deep learning; Dynamic programming; Memory pressure; Memory usage optimization; Deep learning; Checkpointing; Memory usage optimization; Dynamic programming; Memory pressure