Handbook of Differential Entropy
1st Edition
Published on 14. November 2013
Book
Hardback
244 pages
978-1-4665-8316-0 (ISBN)
Description
One of the main issues in communications theory is measuring the ultimate data compression possible using the concept of entropy. While differential entropy may seem to be a simple extension of the discrete case, it is a more complex measure that often requires a more careful treatment.
Handbook of Differential Entropy provides a comprehensive introduction to the subject for researchers and students in information theory. Unlike related books, this one brings together background material, derivations, and applications of differential entropy.
The handbook first reviews probability theory as it enables an understanding of the core building block of entropy. The authors then carefully explain the concept of entropy, introducing both discrete and differential entropy. They present detailed derivations of differential entropy for numerous probability models and discuss challenges with interpreting and deriving differential entropy. They also show how differential entropy varies as a function of the model variance.
Focusing on the application of differential entropy in several areas, the book describes common estimators of parametric and nonparametric differential entropy as well as properties of the estimators. It then uses the estimated differential entropy to estimate radar pulse delays when the corrupting noise source is non-Gaussian and to develop measures of coupling between dynamical system components.
Handbook of Differential Entropy provides a comprehensive introduction to the subject for researchers and students in information theory. Unlike related books, this one brings together background material, derivations, and applications of differential entropy.
The handbook first reviews probability theory as it enables an understanding of the core building block of entropy. The authors then carefully explain the concept of entropy, introducing both discrete and differential entropy. They present detailed derivations of differential entropy for numerous probability models and discuss challenges with interpreting and deriving differential entropy. They also show how differential entropy varies as a function of the model variance.
Focusing on the application of differential entropy in several areas, the book describes common estimators of parametric and nonparametric differential entropy as well as properties of the estimators. It then uses the estimated differential entropy to estimate radar pulse delays when the corrupting noise source is non-Gaussian and to develop measures of coupling between dynamical system components.
More details
Language
English
Place of publication
Bosa Roca
United States
Publishing group
Taylor & Francis Inc
Target group
College/higher education
Illustrations
89 s/w Abbildungen, 10 s/w Tabellen
10 Tables, black and white; 89 Illustrations, black and white
Dimensions
Height: 234 mm
Width: 156 mm
Weight
492 gr
ISBN-13
978-1-4665-8316-0 (9781466583160)
Copyright in bibliographic data and cover images is held by Nielsen Book Services Limited or by the publishers or by their respective licensors: all rights reserved.
Schweitzer Classification
Other editions
Additional editions
Joseph Victor Michalowicz | Jonathan M. Nichols | Frank Bucholtz
Handbook of Differential Entropy
Book
09/2018
1st Edition
CRC Press
€96.30
Shipment within 10-20 days
Joseph Victor Michalowicz | Jonathan M. Nichols | Frank Bucholtz
Handbook of Differential Entropy
E-Book
11/2013
1st Edition
Chapman & Hall/CRC
€89.49
Available for download
Joseph Victor Michalowicz | Jonathan M. Nichols | Frank Bucholtz
Handbook of Differential Entropy
E-Book
11/2013
1st Edition
Chapman and Hall
€89.99
Available for download
Persons
Joseph V. Michalowicz is a consultant with Sotera Defense Solutions. He retired from the U.S. Naval Research Laboratory as head of the Sensor and Data Processing Section in the Optical Sciences Division. He has published extensively in the areas of mathematical modeling, probability and statistics, signal detection, multispectral infrared sensors, and category theory. He received a Ph.D. in mathematics with a minor in electrical engineering from the Catholic University of America.
Jonathan M. Nichols is a member of the Maritime Sensing Section in the Optical Sciences Division at the U.S. Naval Research Laboratory. His research interests include signal and image processing, parameter estimation, and the modeling and analysis of infrared imaging devices. He received a Ph.D. in mechanical engineering from Duke University.
Frank Bucholtz is head of the Advanced Photonics Section at the U.S. Naval Research Laboratory. He has published in the areas of microwave signal processing and microwave photonics, fiber optic sensors, micro-optical devices, nonlinear dynamics and chaos, hyperspectral imaging systems, and information theory. His current research focuses on optical components for digital communications. He received a Ph.D. in physics from Brown University.
Jonathan M. Nichols is a member of the Maritime Sensing Section in the Optical Sciences Division at the U.S. Naval Research Laboratory. His research interests include signal and image processing, parameter estimation, and the modeling and analysis of infrared imaging devices. He received a Ph.D. in mechanical engineering from Duke University.
Frank Bucholtz is head of the Advanced Photonics Section at the U.S. Naval Research Laboratory. He has published in the areas of microwave signal processing and microwave photonics, fiber optic sensors, micro-optical devices, nonlinear dynamics and chaos, hyperspectral imaging systems, and information theory. His current research focuses on optical components for digital communications. He received a Ph.D. in physics from Brown University.
Content
Probability in Brief. The Concept of Entropy. Entropy for Discrete Probability Distributions. Differential Entropies for Probability Distributions. Differential Entropy as a Function of Variance. Applications of Differential Entropy. Appendices. Bibliography.