| |
Shop
| |  |
|
Best Sellers | | Home Elements of Information Theory 2nd Edition (Wiley Series in Telecommunications and Signal Processing) | |
|  | |  | | | Elements of Information Theory 2nd Edition (Wiley Series in Telecommunications and Signal Processing) | | | | | SKU:
ACOMMP2_book_new_0471241954 | | In Stock | | Availability:
Usually ships in 1 business days | | | | | | The latest edition of this classic is updated with new problem sets and material
The Second Edition of this fundamental textbook maintains the book's tradition of clear, thought-provoking instruction. Readers are provided once again with an instructive mix of mathematics, physics, statistics, and information theory.
All the essential topics in information theory are covered in detail, including entropy, data compression, channel capacity, rate distortion, network information theory, and hypothesis testing. The authors provide readers with a solid understanding of the underlying theory and applications. Problem sets and a telegraphic summary at the end of each chapter further assist readers. The historical notes that follow each chapter recap the main points.
The Second Edition features:
* Chapters reorganized to improve teaching
* 200 new problems
* New material on source coding, portfolio theory, and feedback capacity
* Updated references
Now current and enhanced, the Second Edition of Elements of Information Theory remains the ideal textbook for upper-level undergraduate and graduate courses in electrical engineering, statistics, and telecommunications.An Instructor's Manual presenting detailed solutions to all the problems in the book is available from the Wiley editorial department. | | | |
List Price:
| $111.00 | |
Our Price:
| $78.77
& this item ships for FREE with Super Saver Shipping.
| |
You Save:
| $32.23 (29%)
|
| | |
|
| | Product Promotions | | |
| | Product Details | | Author: | Thomas M. Cover | | Hardcover: | 776 pages | | Publisher: | Wiley-Interscience | | Publication Date: | July 18, 2006 | | Language: | English | | ISBN: | 0471241954 | | Product Length: | 9.28 inches | | Product Width: | 6.34 inches | | Product Height: | 1.56 inches | | Product Weight: | 2.58 pounds | | Package Length: | 9.3 inches | | Package Width: | 6.2 inches | | Package Height: | 1.7 inches | | Package Weight: | 2.6 pounds | | Average Customer Rating: |  based on 15 reviews |
| |
| | Customer Reviews | Average Customer Review: ( 15 customer reviews )
Write an online review and share your thoughts with other customers.
Most Helpful Customer Reviews
62 of 63 found the following review helpful:
 An Excellent Introduction to Information Theory May 16, 2008
By A Reader
I am writing this review in response to some confusion and unfairness I see in other reviews. Cover and Thomas have written a unique and ambitious introduction to a fascinating and complex subject; their book must be judged fairly and not compared to other books that have entirely different goals.
Claude Shannon provided a working definition of "information" in his seminal 1948 paper, A Mathematical Theory of Communication. Shannon's interest in that and subsequent papers was the attainment of reliable communication in noisy channels. The definition of information that Shannon gave was perfectly fitted to this task; indeed, it is easily shown that in the context studied by Shannon, the only meaningful measure of information content that will apply to random variables with known distribution must be (up to a multiplicative constant) of the now-familiar form h(p) = log(1/p).
However, Shannon freely admitted that his definition of information was limited in scope and was never envisioned as being universal. Shannon deliberately avoided the "murkier" aspects of human communication in framing his definitions; problematic themes such as knowledge, semantics, motivations and intentions of the sender and/or receiver, etc., were avoided altogether.
For several decades, Information Theory continued to exist as a subset of the theory of reliable communication. Some classical and highly regarded texts on the subject are Gallager, Ash, Viterbi and Omura, and McEliece. For those whose interest in Information Theory is motivated largely by questions from the field of digital communications, these texts remain unrivalled standards; Gallager, in particular, is so highly regarded by those who learned from it that it is still described as superior to many of its more recent, up-to-date successors.
In recent decades, Information Theory has been applied to problems from across a wide array of academic disciplines. Physicists have been forced to clarify the extent to which information is conserved in order to completely understand black hole dynamics; biologists have found extensive use of Information Theoretic concepts in understanding the human genome; computer scientists have applied Information Theory to complex issues in computational vs. descriptive complexity (the Mandelbrot set, which has been called the most complex set in all of mathematics, is actually extremely simple from the point of view of Kolmogorov complexity); and John von Neumann's brilliant creation, game theory, which has been called "a universal language for the unification of the behavioral sciences," is intimately coupled to Information Theory, perhaps in ways that have not yet been fully appreciated or explored.
Cover and Thomas' book "Elements of Information Theory" is written for the reader who is interested in these eclectic and exciting applications of Information Theory. This book does NOT treat Information Theory as a subset of reliable communication theory; therefore, the book is NOT written as a competitor for Gallager's classic text. Critics who ask
for a more thorough treatment of rate distortion theory or convolutional codes are criticizing the authors for failing to include topics that are not even central to their goals for the text!
A very selective list of some of the more interesting topics that Cover and Thomas study includes: (1) the Asymptotic Equipartition Property and its consequences for data compression; (2) Information Theory and gambling; (3) Kolmogorov complexity and Chaitin's Omega; (4) Information Theory and statistics; and (5) Information Theory and the stock market. Item (4) on this list is only briefly introduced in Cover and Thomas's book, and appropriately so; however, readers who wish to pursue the fascinating subject of Fischer Information further should consider B. Roy Frieden's book Physics from Fisher Information: A Unification. Frieden identifies a principle of "extreme physical information" as a unifying theme across all of physics, deriving such classic equations as the Klein-Gordon equation, Maxwell's equations, and Einstein's field equations for general relativity from this information-theoretic principle.
This last point is quite typical of Cover and Thomas's book. I participated in a faculty seminar on Information Thoery at my university a few years ago, in which we studied Cover and Thomas as our primary source. We were a diverse group, drawn from five different academic disciplines, and we all found that Cover and Thomas repeatedly introduced us to exciting and unexpected applications of Information Theory, always sending us to the journals for further, more in-depth study.
Cover and Thomas' book has become an established favorite in university courses on information theory. In truth, the book has few competitors. Interested readers looking for additional references might also consider David MacKay's book Information Theory, Inference, and Learning Algorithms, which has as a primary goal the use of information theory in the study of Neural Networks and learning algorithms. George Klir's book Uncertainty and Information considers many alternative measures of information/uncertainty, moving far beyond the classical log(1/p) measure of Shannon and the context in which it arose. Jan Kahre's iconoclastic book The Mathematical Theory of Information is an intriguing alternative in which the so-called Law of Diminishing Information is elevated to primary axiomatic status in deriving measures of information content. I alluded to some of the "murkier" issues of human communication earlier; readers who wish to study some of those issues will find Yehoshua Bar-Hillel's book Language and Information a useful source.
In conclusion, I highly recommend Cover and Thomas' book on Information Theory. It is currently unrivalled as a rigorous introduction to applications of Information Theory across the curriculum. As a person who used to work in the general area of signals analysis, I resist all comparisons of Cover and Thomas' book with the classic text of Gallager; the books have vastly different goals and very little overlap.
9 of 9 found the following review helpful:
Updated, reorganized, expanded Second Edition Mar 24, 2007
By John Matlock
"Gunny"
The preface of this book says, 'This is intended to be a simple and accessible book on information theory.' That's true, but it is aimed at the senior year or early graduate level where a theoretical background is needed for computer science, communications engineering, applied mathematics or similar fields. The mathematical nature of the book says that the student should at least have a background through calculus and a couple of upper level courses in statistics/probability. After all, Information Theory is generally considered to be a branch of applied mathematics.
On the whole, the writing style of the book (other than the equasions) is rather light and entertaining. For instance his discussion on the similarities between gambling and data compression brings a rather complex notion down something we can identify - that's before he gets into the math of course.
One complaint about the first edition of the book was that it didn't have enough problems for the student. This has been solved by the addition of a couple of hundred additional problems. There is also a dedicated web site for this book with more material, including solutions to selected problems.
11 of 13 found the following review helpful:
 A good survey of Information Theory Feb 08, 2007
By Desperate Scholar
Elements of Information Theory was the book I used in graduate school. It takes a topical approach to the subject from standard topics like source and channel coding, esoteric concepts like Kolmogorov complexity, to applied topics like how to get rich by applying Information theory to horse racing and the stock market. Overall I thought it was a good book. It is well written and exposes the grandure of subject. However what it provides in bredth it takes away in depth. Several topics, including fundemental ones like entropy, while well illustrated are not at all motivated - they are just given as definitions. In this I feel Galleghers book is superior. Also there is a real dearth of problems, its unusual to do all the problems in a book and feel you have not done enough to understand the material. Many a time I found myself scouring the web for more problems to augment the ones provided. So if you are looking for a broad view of the subject of information theory, this is the book to buy. If you are looking for a deeper understanding of the fundamental topics get Gallegher.
1 of 1 found the following review helpful:
Excellent with the right background May 09, 2010
By Max
This textbook was used in a class I took in information theory for upper-division undergraduates and first-year graduate students. The book relies on a solid understanding of probability and a reasonable level of mathematical maturity. I took the class after two years of probability and a year of analysis, and found the proofs very easy to follow. The problems ranged from easy to slightly involved; all helped illustrate subtleties the reader might otherwise miss. The book doesn't use any particularly advanced mathematics, but people who aren't as familiar with proofs may struggle with the seemingly endless number of small "tricks" used. Some exposure to analysis helps here.
1 of 1 found the following review helpful:
Very good book but... Jun 27, 2009
By MathEnthusiast
"Peccavi"
Very good book with some minor issues. The authors do a great job of making most of the material accessible to a person with an understanding of basic probability. In my humble opinion, the chapters on Gaussian Channel (Ch9) and Network Information Theory (Ch15) need more exposition. Other chapters are very well explained. Occasionally deep statements are made without much explanation and amplification. It is upto the reader to figure out explanations for these statements. Some of the problems are repeated. Most of the problems are easy and as another reviewer pointed out, the book might benefit with the addition of some more thought provoking problems. However a great book for learning information theory.
See all 15 customer reviews on Amazon.com
| |
| |
| |  | |  |
|
Recently Viewed | You may also like ... |
