Distributed Source Coding

Distributed source coding is one of the key enablers for efficient cooperative communication. The potential applications range from wireless sensor networks, ad-hoc networks, and surveillance networks, to robust low-complexity video coding, stereo/Multiview video coding, HDTV, hyper-spectral and multispectral imaging, and biometrics. The book is divided into three sections: theory, algorithms, and applications. Part one covers the background of information theory with an emphasis on DSC; part two discusses designs of algorithmic solutions for DSC problems, covering the three most important DSC problems: Slepian-Wolf, Wyner-Ziv, and MT source coding; and part three is dedicated to a variety of potential DSC applications. Key features: Clear explanation of distributed source coding theory and algorithms including both lossless and lossy designs. Rich applications of distributed source coding, which covers multimedia communication and data security applications. Self-contained content for beginners from basic information theory to practical code implementation. The book provides fundamental knowledge for engineers and computer scientists to access the topic of distributed source coding. It is also suitable for senior undergraduate and first year graduate students in electrical engineering; computer engineering; signal processing; image/video processing; and information theory and communications.

The advent of wireless sensor technology and ad-hoc networks has made DSC a major field of interest. Edited and written by the leading players in the field, this book presents the latest theory, algorithms and applications, making it the definitive reference on DSC for systems designers and implementers, researchers, and graduate students. This book gives a clear understanding of the performance limits of distributed source coders for specific classes of sources and presents the design and application of practical algorithms for realistic scenarios. Material covered includes the use of standard channel codes, such as LDPC and Turbo codes, to DSC, and discussion of the suitability of compressed sensing for distributed compression of sparse signals. Extensive applications are presented and include distributed video coding, microphone arrays and securing biometric data. This book is a great resource covering the breadth and depth of distributed source coding that’s appropriate for everyone from theoreticians to practitioners. – Richard Baraniuk, Rice University *Clear explanation of the principles of distributed source coding (DSC), a technology that has applications in sensor networks, ad-hoc networks, and distributed wireless video systems for surveillance *Edited and written by the leading players in the field, providing a complete and authoritative reference *Contains all the latest theory, practical algorithms for DSC design and the most recently developed applications

The advent of wireless sensor technology and ad-hoc networks has made DSC a major field of interest. Edited and written by the leading players in the field, this book presents the latest theory, algorithms and applications, making it the definitive reference on DSC for systems designers and implementers, researchers, and graduate students. This book gives a clear understanding of the performance limits of distributed source coders for specific classes of sources and presents the design and application of practical algorithms for realistic scenarios. Material covered includes the use of standard channel codes, such as LDPC and Turbo codes, to DSC, and discussion of the suitability of compressed sensing for distributed compression of sparse signals. Extensive applications are presented and include distributed video coding, microphone arrays and securing biometric data. This book is a great resource covering the breadth and depth of distributed source coding that’s appropriate for everyone from theoreticians to practitioners. – Richard Baraniuk, Rice University *Clear explanation of the principles of distributed source coding (DSC), a technology that has applications in sensor networks, ad-hoc networks, and distributed wireless video systems for surveillance *Edited and written by the leading players in the field, providing a complete and authoritative reference *Contains all the latest theory, practical algorithms for DSC design and the most recently developed applications

Emphasizes source coding techniques that have become relevant for video coding in recent years. For illustrating the concepts and efficiency of the basic sources coding techniques, the authors provide numerous examples and experimental results for simple model sources.

The most efficient compression scheme found, with a DAG representation in the form of a chain, corresponds to a successive decoding procedure. Extending this idea, we find corresponding successive schemes for multiple description, broadcast channel encoding and multiple access channel decoding.

Presents a review of eleven of the fundamental issues in multi-user information theory. Each chapter is devoted to one particular issue and follows the same structure and starts with a problem description and then describes solutions to the problem for general and specific cases.

This book constitutes the refereed proceedings of the 17th International Symposium on Applied Algebra, Algebraic Algorithms and Error-Correcting Codes, AAECC-17, held in Bangalore, India, in December 2007. Among the subjects addressed are block codes, including list-decoding algorithms; algebra and codes: rings, fields, algebraic geometry codes; algebra: rings and fields, polynomials, permutations, lattices; cryptography: cryptanalysis and complexity; computational algebra.

This second edition provides easy access to important concepts, issues and technology trends in the field of multimedia technologies, systems, techniques, and applications. Over 1,100 heavily-illustrated pages — including 80 new entries — present concise overviews of all aspects of software, systems, web tools and hardware that enable video, audio and developing media to be shared and delivered electronically.

The communication chain is constituted by a source and a recipient, separated by a transmission channel which may represent a portion of cable, an optical fiber, a radio channel, or a satellite link. Whatever the channel, the processing blocks implemented in the communication chain have the same foundation. This book aims to itemize. In this first volume, after having presented the base of the information theory, we will study the source coding techniques with and without loss. Then we analyze the correcting codes for block errors, convutional and concatenated used in current systems.

Although it's true that image compression research is a mature field, continued improvements in computing power and image representation tools keep the field spry. Faster processors enable previously intractable compression algorithms and schemes, and certainly the demand for highly portable high-quality images will not abate. Document and Image Compression highlights the current state of the field along with the most probable and promising future research directions for image coding. Organized into three broad sections, the book examines the currently available techniques, future directions, and techniques for specific classes of images. It begins with an introduction to multiresolution image representation, advanced coding and modeling techniques, and the basics of perceptual image coding. This leads to discussions of the JPEG 2000 and JPEG-LS standards, lossless coding, and fractal image compression. New directions are highlighted that involve image coding and representation paradigms beyond the wavelet-based framework, the use of redundant dictionaries, the distributed source coding paradigm, and novel data-hiding techniques. The book concludes with techniques developed for classes of images where the general-purpose algorithms fail, such as for binary images and shapes, compound documents, remote sensing images, medical images, and VLSI layout image data. Contributed by international experts, Document and Image Compression gathers the latest and most important developments in image coding into a single, convenient, and authoritative source.

An important text that offers an in-depth guide to how information theory sets the boundaries for data communication In an accessible and practical style, Information and Communication Theory explores the topic of information theory and includes concrete tools that are appropriate for real-life communication systems. The text investigates the connection between theoretical and practical applications through a wide-variety of topics including an introduction to the basics of probability theory, information, (lossless) source coding, typical sequences as a central concept, channel coding, continuous random variables, Gaussian channels, discrete input continuous channels, and a brief look at rate distortion theory. The author explains the fundamental theory together with typical compression algorithms and how they are used in reality. He moves on to review source coding and how much a source can be compressed, and also explains algorithms such as the LZ family with applications to e.g. zip or png. In addition to exploring the channel coding theorem, the book includes illustrative examples of codes. This comprehensive text: Provides an adaptive version of Huffman coding that estimates source distribution Contains a series of problems that enhance an understanding of information presented in the text Covers a variety of topics including optimal source coding, channel coding, modulation and much more Includes appendices that explore probability distributions and the sampling theorem Written for graduate and undergraduate students studying information theory, as well as professional engineers, master’s students, Information and Communication Theory offers an introduction to how information theory sets the boundaries for data communication.

A handbook on recent advancements and the state of the art in array processing and sensor Networks Handbook on Array Processing and Sensor Networks provides readers with a collection of tutorial articles contributed by world-renowned experts on recent advancements and the state of the art in array processing and sensor networks. Focusing on fundamental principles as well as applications, the handbook provides exhaustive coverage of: wavelets; spatial spectrum estimation; MIMO radio propagation; robustness issues in sensor array processing; wireless communications and sensing in multi-path environments using multi-antenna transceivers; implicit training and array processing for digital communications systems; unitary design of radar waveform diversity sets; acoustic array processing for speech enhancement; acoustic beamforming for hearing aid applications; undetermined blind source separation using acoustic arrays; array processing in astronomy; digital 3D/4D ultrasound imaging technology; self-localization of sensor networks; multi-target tracking and classification in collaborative sensor networks via sequential Monte Carlo; energy-efficient decentralized estimation; sensor data fusion with application to multi-target tracking; distributed algorithms in sensor networks; cooperative communications; distributed source coding; network coding for sensor networks; information-theoretic studies of wireless networks; distributed adaptive learning mechanisms; routing for statistical inference in sensor networks; spectrum estimation in cognitive radios; nonparametric techniques for pedestrian tracking in wireless local area networks; signal processing and networking via the theory of global games; biochemical transport modeling, estimation, and detection in realistic environments; and security and privacy for sensor networks. Handbook on Array Processing and Sensor Networks is the first book of its kind and will appeal to researchers, professors, and graduate students in array processing, sensor networks, advanced signal processing, and networking.

This book gives a review of the principles, methods and techniques of important and emerging research topics and technologies in Channel Coding, including theory, algorithms, and applications. Edited by leading people in the field who, through their reputation, have been able to commission experts to write on a particular topic. With this reference source you will: Quickly grasp a new area of research Understand the underlying principles of a topic and its applications Ascertain how a topic relates to other areas and learn of the research issues yet to be resolved Quick tutorial reviews of important and emerging topics of research in Channel Coding Presents core principles in Channel Coding theory and shows their applications Reference content on core principles, technologies, algorithms and applications Comprehensive references to journal articles and other literature on which to build further, more specific and detailed knowledge

An introduction to the theory and techniques for achieving high quality network communication with the best possible bandwidth economy, this book focuses on network information flow with fidelity. Covering both lossless and lossy source reconstruction, it is illustrated throughout with real-world applications, including sensor networks and multimedia communications. Practical algorithms are presented, developing novel techniques for tackling design problems in joint network-source coding via collaborative multiple description coding, progressive coding, diversity routing and network coding. With systematic introductions to the basic theories of distributed source coding, network coding and multiple description coding, this is an ideal self-contained resource for researchers and students in information theory and network theory.

The collaborative nature of industrial wireless sensor networks (IWSNs) brings several advantages over traditional wired industrial monitoring and control systems, including self-organization, rapid deployment, flexibility, and inherent intelligent processing. In this regard, IWSNs play a vital role in creating more reliable, efficient, and productive industrial systems, thus improving companies’ competitiveness in the marketplace. Industrial Wireless Sensor Networks: Applications, Protocols, and Standards examines the current state of the art in industrial wireless sensor networks and outlines future directions for research. What Are the Main Challenges in Developing IWSN Systems? Featuring contributions by researchers around the world, this book explores the software and hardware platforms, protocols, and standards that are needed to address the unique challenges posed by IWSN systems. It offers an in-depth review of emerging and already deployed IWSN applications and technologies, and outlines technical issues and design objectives. In particular, the book covers radio technologies, energy harvesting techniques, and network and resource management. It also discusses issues critical to industrial applications, such as latency, fault tolerance, synchronization, real-time constraints, network security, and cross-layer design. A chapter on standards highlights the need for specific wireless communication standards for industrial applications. A Starting Point for Further Research Delving into wireless sensor networks from an industrial perspective, this comprehensive work provides readers with a better understanding of the potential advantages and research challenges of IWSN applications. A contemporary reference for anyone working at the cutting edge of industrial automation, communication systems, and networks, it will inspire further exploration in this promising research area.

This volume contains the Proceedings of the 2nd International Workshop on Information Processing in Sensor Networks (IPSN 2003). The workshop was held at the Palo Alto Research Center (PARC), Palo Alto, California, on April 22–23, 2003. Informationprocessinginsensornetworksisaninterdisciplinaryresearcharea with deep connections to signal processing, networking and protocols, databases and information management, as well as distributed algorithms. Because of - vances in MEMS microsensors, wireless networking, and embedded processing, ad hoc networks of sensors are becoming increasingly available for commercial andmilitaryapplicationssuchasenvironmentalmonitoring(e.g.,tra?c,habitat, security), industrial sensing and diagnostics (e.g., factories, appliances), inf- structure maintenance (e.g., power grids, water distribution, waste disposal), and battle?eld awareness (e.g., multitarget tracking). From the engineering and computing point of view, sensor networks have become a rich source of problems in communication protocols, sensor tasking and control, sensor fusion, distributed databases and algorithms, probabilistic reasoning, system/software architecture, design methodologies, and evaluation metrics. This workshop took a systemic approach to address crosslayer issues, from the physical sensor layer to the sensor signal processing and networking levels and then all the way to the applications. Following the successful 1st Workshop on Collaborative Signal and Inf- mation Processing in Sensor Networks at PARC in 2001, this new workshop brought together researchers from academia, industry, and government to p- sent and discuss recent work concerning various aspects of sensor networks such as information organization, querying, routing, and self-organization, with an emphasis on the high-level information processing tasks that these networks are designed to perform.