On calculating Sakrison's rate distortion function for classes of parameterized sources

• Published in: IEEE transactions on information theory Vol. 41; no. 4; pp. 1160 - 1163
• Main Author: Wolfe, L.B.
• Format: Journal Article
• Language: English
• Published: New York, NY IEEE 01.07.1995; Institute of Electrical and Electronics Engineers; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Applied sciences; Communications; Distortion measurement; Entropy; Exact sciences and technology; Extraterrestrial measurements; Government; Information analysis; Information technology; Information theory; Information, signal and communications theory; Minimax techniques; Q measurement; Rate-distortion; Telecommunications and information theory; Computational methods; Algorithms; Channel capacity; Minimax method; Information rate; Entropy; Signal reconstruction; Signal distortion; Information theory
• ISSN: 0018-9448; 1557-9654
• DOI: 10.1109/18.391262

Sakrison extended Shannon's notion of the rate distortion function to parameterized classes of sources by taking a minimax approach and defining a measure of the minimum rate required for information reconstruction subject to a prescribed fidelity level D. Unfortunately, calculation of Sakrison's rate distortion function may be very difficult because analytic solutions do not generally exist and there has been a lack of a constructive method for finding the rate. However, an approach presented in this correspondence may be used to calculate an approximation to Sakrison's rate distortion function for classes of sources with a finite, discrete input space and a continuous parameter space. The approach gives rise to an algorithm which is shown to be convergent and numerical examples are studied.< >