Design of fully interpretable neural networks for digital coherent demodulation

• Published in: Optics express Vol. 30; no. 20; pp. 35526 - 35538
• Main Authors: Huang, Xiatao, Jiang, Wenshan, Yi, Xingwen, Zhang, Jing, Jin, Taowei, Zhang, Qianwu, Xu, Bo, Qiu, Kun
• Format: Journal Article
• Language: English
• Published: 26.09.2022
• ISSN: 1094-4087; 1094-4087
• DOI: 10.1364/OE.472406

In this paper, we propose a digital coherent demodulation architecture using fully interpretable deep neural networks (NNs). We show that all the conventional coherent digital signal processing (DSP) is deeply unfolded into a well-structured NN so that the established training algorithms in machine learning can be applied. In contrast to adding or replacing certain algorithms of existing DSP in coherent receivers, we replace all the coherent demodulation algorithms with a fully interpretable NN (FINN), making the whole NN interpretable. The FINN is modular and flexible to add or drop modules, including chromatic dispersion compensation (CDC), the digital back-propagation (DBP) algorithm for fiber nonlinearity compensation, carrier recovery and residual impairments. The resulted FINN can be quickly initialized by straightforwardly referring to the conventional DSP, and can also enjoy further performance enhancement in the nonlinear fiber transmissions by NN. We conduct a 132-Gb/s polarization multiplexed (PM)-16QAM transmission experiment over 600-km standard single mode fiber. The experimental results show that without fiber nonlinearity compensation, FINN-CDC obtains less than 0.06-dB SNR gain than chromatic dispersion compensation (CDC). However, with fiber nonlinearity compensation, 2-steps per span FINN-DBP (FINN-2sps-DBP) and FINN-1sps-DBP bring about 0.59-dB and 0.53-dB SNR improvement compared with the conventional 2sps-DBP and 1sps-DBP, respectively.