An Upper Bound on the Error Induced by Saddlepoint Approximations—Applications to Information Theory

• Published in: Entropy (Basel, Switzerland) Vol. 22; no. 6; p. 690
• Main Authors: Anade, Dadja, Gorce, Jean-Marie, Mary, Philippe, Perlaza, Samir M.
• Format: Journal Article
• Language: English
• Published: MDPI 20.06.2020; MDPI AG
• Subjects: memoryless channels; saddlepoint approximation; sums of independent and identically random variables
• ISSN: 1099-4300; 1099-4300
• DOI: 10.3390/e22060690

This paper introduces an upper bound on the absolute difference between: ( a ) the cumulative distribution function (CDF) of the sum of a finite number of independent and identically distributed random variables with finite absolute third moment; and ( b ) a saddlepoint approximation of such CDF. This upper bound, which is particularly precise in the regime of large deviations, is used to study the dependence testing (DT) bound and the meta converse (MC) bound on the decoding error probability (DEP) in point-to-point memoryless channels. Often, these bounds cannot be analytically calculated and thus lower and upper bounds become particularly useful. Within this context, the main results include, respectively, new upper and lower bounds on the DT and MC bounds. A numerical experimentation of these bounds is presented in the case of the binary symmetric channel, the additive white Gaussian noise channel, and the additive symmetric α -stable noise channel.