A Unifying Variational Perspective on Some Fundamental Information Theoretic Inequalities Academic Article

abstract

• This paper proposes a unifying variational approach for proving and extending some fundamental information theoretic inequalities. Fundamental information theory results such as maximization of differential entropy, minimization of Fisher information (Cramr-Rao inequality), worst additive noise lemma, entropy power inequality, and extremal entropy inequality are interpreted as functional problems and proved within the framework of calculus of variations. Several applications and possible extensions of the proposed results are briefly mentioned. 1963-2012 IEEE.

authors

• Qaraqe, Khalid
• Serpedin, Erchin

published proceedings

• IEEE TRANSACTIONS ON INFORMATION THEORY

author list (cited authors)

• Park, S., Serpedin, E., & Qaraqe, K.

citation count

• 2

complete list of authors

• Park, Sangwoo||Serpedin, Erchin||Qaraqe, Khalid

publication date

• November 2013

publisher

• Institute of Electrical and Electronics Engineers (IEEE)  Publisher

published in

• IEEE TRANSACTIONS ON INFORMATION THEORY  Journal

keywords

• Calculus Of Variations
• Entropy Power Inequality
• Extremal Entropy Inequality
• Maximizing Entropy
• Minimizing Fisher Information
• Worst Additive Noise

Digital Object Identifier (DOI)

• 10.1109/TIT.2013.2274514

start page

• 7132

end page

• 7148

volume

• 59

issue

• 11

user-defined tag

• 10 Reduced Inequalities