Universal Estimation of Information Measures for Analog Sources (Foundations and Trends in Communications and Information Theory)

Wang, Qing/ Kulkarni, Sanjeev R./ Verdú, Sergio

ISBN 10: 1601982305 / ISBN 13: 9781601982308

Editore: Now Publishers Inc, 2009

Riguardo questo articolo

104 pages. 9.00x6.10x0.30 inches. In Stock. Codice articolo x-1601982305

Dati bibliografici

Titolo: Universal Estimation of Information Measures...

Casa editrice: Now Publishers Inc

Data di pubblicazione: 2009

Legatura: Paperback

Condizione: Brand New

Descrizione articolo

Riassunto:

Entropy, mutual information and divergence measure the randomness, dependence and dissimilarity, respectively, of random objects. In addition to their prominent role in information theory, they have found numerous applications, among others, in probability theory statistics, physics, chemistry, molecular biology, ecology, bioinformatics, neuroscience, machine learning, linguistics, and finance. Many of these applications require a universal estimate of information measures which does not assume knowledge of the statistical properties of the observed data. Over the past few decades, several nonparametric algorithms have been proposed to estimate information measures. Universal Estimation of Information Measures for Analog Sources presents a comprehensive survey of universal estimation of information measures for memoryless analog (real-valued or real vector-valued) sources with an emphasis on the estimation of mutual information and divergence and their applications. The book reviews the consistency of the universal algorithms and the corresponding sufficient conditions as well as their speed of convergence. Universal Estimation of Information Measures for Analog Sources provides a comprehensive review of an increasingly important topic in Information Theory. It will be of interest to students, practitioners and researchers working in Information Theory.