The Double-Sided Information Bottleneck Function

• Published in: Entropy (Basel, Switzerland) Vol. 24; no. 9; p. 1321
• Main Authors: Dikshtein, Michael, Ordentlich, Or, Shamai (Shitz), Shlomo
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.09.2022; MDPI
• Subjects: Algorithms; biclustering; Bivariate analysis; Channels; Clustering; Codes; Correlation; Data compression; Gene expression; Hypothesis testing; information bottleneck; Information sources; lossy compression; Optimization; Pattern recognition; Random variables; remote source coding
• ISSN: 1099-4300; 1099-4300
• DOI: 10.3390/e24091321

A double-sided variant of the information bottleneck method is considered. Let (X,Y) be a bivariate source characterized by a joint pmf PXY. The problem is to find two independent channels PU|X and PV|Y (setting the Markovian structure U→X→Y→V), that maximize I(U;V) subject to constraints on the rel...