On Privacy Amplification, Lossy Compression, and Their Duality to Channel Coding

• Published in: IEEE transactions on information theory Vol. 64; no. 12; pp. 7792 - 7801
• Main Author: Renes, Joseph M.
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.12.2018; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Amplification; Channel coding; Channels; Codes; Coding; Decoding; Divergence; Error correcting codes; Error correction; information security; Information theory; Matrix codes; Privacy; Probability distribution; Protocols; random number generation; Random variables; rate-distortion; Simulation; source coding; Task analysis; Testing
• ISSN: 0018-9448; 1557-9654
• DOI: 10.1109/TIT.2018.2865386

We examine the task of privacy amplification from information-theoretic and coding-theoretic points of view. In the former, we give a one-shot characterization of the optimal rate of privacy amplification against classical adversaries in terms of the optimal type-II error in asymmetric hypothesis testing. The converse significantly improves on previous bounds based on smooth min-entropy by Watanabe and Hayashi <xref ref-type="bibr" rid="ref7">[7] and turns out to be equivalent to a recent formulation in terms of the <inline-formula> <tex-math notation="LaTeX">E_\gamma </tex-math></inline-formula> divergence by Yang et al. <xref ref-type="bibr" rid="ref9">[9] . In the latter, we show that the protocols for privacy amplification based on linear codes can be easily repurposed for channel simulation. Combined with the known relations between channel simulation and lossy source coding, this implies that the privacy amplification can be understood as a basic primitive for both channel simulation and lossy compression. Applied to symmetric channels or lossy compression settings, our construction leads to protocols of the optimal rate in the asymptotic i.i.d. limit. Finally, appealing to the notion of channel duality recently detailed by us in <xref ref-type="bibr" rid="ref15">[15] , we show that the linear error-correcting codes for symmetric channels with quantum output can be transformed into linear lossy source coding schemes for classical variables arising from the dual channel. This explains a "curious duality" in these problems for the (self-dual) erasure channel observed by Martinian and Yedidia <xref ref-type="bibr" rid="ref16">[16] and partly anticipates recent results on optimal lossy compression by polar and low-density generator matrix codes.