Learned Scheduling of LDPC Decoders Based on Multi-armed Bandits

• Published in: 2020 IEEE International Symposium on Information Theory (ISIT) pp. 2789 - 2794
• Main Authors: Habib, Salman, Beemer, Allison, Kliewer, Jorg
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.06.2020
• ISSN: 2157-8117
• DOI: 10.1109/ISIT44484.2020.9174337

The multi-armed bandit (MAB) problem refers to the dilemma encountered by a gambler when deciding which arm of a multi-armed slot machine to pull in order to maximize the total reward earned in a sequence of pulls. In this paper, we model the scheduling of a node-wise sequential LDPC decoder as a Markov decision process, where the underlying Tanner graph is viewed as a slot machine with multiple arms corresponding to the check nodes. A fictitious gambler decides which check node to pull (schedule) next by observing a reward associated with each pull. This interaction enables the gambler to discover an optimized scheduling policy that aims to reach a codeword output by propagating the fewest possible messages. Based on this policy, we contrive a novel MAB-based node-wise scheduling (MABNS) algorithm to perform sequential decoding of LDPC codes. Simulation results show that the MAB-NS scheme, aided by an appropriate scheduling policy, outperforms traditional scheduling schemes in terms of complexity and bit error probability.