Rate Distortion Theory

14,000,000 Leading Edge Experts on the ideXlab platform

Scan Science and Technology

Contact Leading Edge Experts & Companies

Scan Science and Technology

Contact Leading Edge Experts & Companies

The Experts below are selected from a list of 5592 Experts worldwide ranked by ideXlab platform

Alexander C Loui - One of the best experts on this subject based on the ideXlab platform.

  • a content based video fast forward playback method using video time density function and Rate Distortion Theory
    International Conference on Multimedia and Expo, 2011
    Co-Authors: Junfeng Jiang, Xiaoping Zhang, Alexander C Loui
    Abstract:

    In this paper, we propose a new video summary method using video time density function (VTDF) and Rate Distortion Theory. The whole system has two main modules, processing and playing. In the processing part, we apply VTDF to describe the temporal dynamics of video data first. A VTDF-based temporal quantization method is then developed to find the best quanta and partition in time domain. The optimal quanta are used to extract the representative video frames. A temporal mean square error (TMSE) is introduced by using Rate-Distortion Theory to evaluate the quantization performance. In the playing module, we develop a video player to only play all sampled frames in its intelligent fast-forward mode. The built video player can allow users to do fast-forward playback based on the semantic video content, which demonstRates the feasibility of proposed method in practice.

  • ICME - A content-based video fast-forward playback method using video time density function and Rate Distortion Theory
    2011 IEEE International Conference on Multimedia and Expo, 2011
    Co-Authors: Junfeng Jiang, Xiaoping Zhang, Alexander C Loui
    Abstract:

    In this paper, we propose a new video summary method using video time density function (VTDF) and Rate Distortion Theory. The whole system has two main modules, processing and playing. In the processing part, we apply VTDF to describe the temporal dynamics of video data first. A VTDF-based temporal quantization method is then developed to find the best quanta and partition in time domain. The optimal quanta are used to extract the representative video frames. A temporal mean square error (TMSE) is introduced by using Rate-Distortion Theory to evaluate the quantization performance. In the playing module, we develop a video player to only play all sampled frames in its intelligent fast-forward mode. The built video player can allow users to do fast-forward playback based on the semantic video content, which demonstRates the feasibility of proposed method in practice.

Junfeng Jiang - One of the best experts on this subject based on the ideXlab platform.

  • a content based video fast forward playback method using video time density function and Rate Distortion Theory
    International Conference on Multimedia and Expo, 2011
    Co-Authors: Junfeng Jiang, Xiaoping Zhang, Alexander C Loui
    Abstract:

    In this paper, we propose a new video summary method using video time density function (VTDF) and Rate Distortion Theory. The whole system has two main modules, processing and playing. In the processing part, we apply VTDF to describe the temporal dynamics of video data first. A VTDF-based temporal quantization method is then developed to find the best quanta and partition in time domain. The optimal quanta are used to extract the representative video frames. A temporal mean square error (TMSE) is introduced by using Rate-Distortion Theory to evaluate the quantization performance. In the playing module, we develop a video player to only play all sampled frames in its intelligent fast-forward mode. The built video player can allow users to do fast-forward playback based on the semantic video content, which demonstRates the feasibility of proposed method in practice.

  • ICME - A content-based video fast-forward playback method using video time density function and Rate Distortion Theory
    2011 IEEE International Conference on Multimedia and Expo, 2011
    Co-Authors: Junfeng Jiang, Xiaoping Zhang, Alexander C Loui
    Abstract:

    In this paper, we propose a new video summary method using video time density function (VTDF) and Rate Distortion Theory. The whole system has two main modules, processing and playing. In the processing part, we apply VTDF to describe the temporal dynamics of video data first. A VTDF-based temporal quantization method is then developed to find the best quanta and partition in time domain. The optimal quanta are used to extract the representative video frames. A temporal mean square error (TMSE) is introduced by using Rate-Distortion Theory to evaluate the quantization performance. In the playing module, we develop a video player to only play all sampled frames in its intelligent fast-forward mode. The built video player can allow users to do fast-forward playback based on the semantic video content, which demonstRates the feasibility of proposed method in practice.

Toby Berger - One of the best experts on this subject based on the ideXlab platform.

  • Multiterminal Rate-Distortion Theory revisited
    2008 46th Annual Allerton Conference on Communication Control and Computing, 2008
    Co-Authors: Toby Berger
    Abstract:

    The problem of determining the region of achievable Rates and Distortions for multiterminal lossy source coding remains unsolved. We revisit the case in which two discrete-alphabet sources are to be sepaRately encoded and communicated to a common decoder. Inner and outer bounds to the admissible Rate region for this problem, which were obtained over thirty years ago by Berger and Tung and by Omura and Housewright and of late have come to be widely referred to as BTinner and BTouter. BTinner has yet to be improved upon and has been conjectured to be tight in some works. Although it is widely believed that the inner and outer bound do not coincide in most problems in which the two sources are not statistically independent, even this has been established only in limited families of special cases. We provide some fresh insights into the nature of optimum encoders and especially of optimum decoders for multitermainal lossy source coding. Also, we describe computations in progress for the special case of correlated symmetric binary sources and Hamming Distortion measures aimed at generating a counterexample to the tightness of BTinner.

  • Rate Distortion Theory
    Encyclopedia of Telecommunications, 2003
    Co-Authors: Toby Berger
    Abstract:

    Rate-Distortion Theory is the branch of information Theory that treats compressing the data produced by an information source down to a specified encoding Rate that is strictly less than the source's entropy. This necessarily entails some lossiness, or Distortion, between the original source data and the best approximation thereto that can be produced on the basis of the encoder's output bits. Rate-Distortion Theory was introduced in the seminal works written in 1948 and 1959 by C. E. Shannon, the founder of information Theory. We describe Shannon's contribution and then trace its subsequent development worldwide. Heavier than usual emphasis is placed on the concept of “matching” a channel to a source in the Rate-Distortion sense, and also on the analogous matching of a source to a channel. Experimental evidence has been mounting in support of the hypothesis that living organisms often simultaneously achieve both of these matchings when processing their sensory inputs, thereby eliminating the need for the complex encoding and decoding operations that are needed in order to produce an information-theoretically optimum system in the absence of such double matching. Keywords: Rate-Distortion; lossy source coding; Distortion measure; Shannon; joint source-channel coding; bioinformation Theory

  • Encyclopedia of Telecommunications - Rate-Distortion Theory
    Wiley Encyclopedia of Telecommunications, 2003
    Co-Authors: Toby Berger
    Abstract:

    Rate-Distortion Theory is the branch of information Theory that treats compressing the data produced by an information source down to a specified encoding Rate that is strictly less than the source's entropy. This necessarily entails some lossiness, or Distortion, between the original source data and the best approximation thereto that can be produced on the basis of the encoder's output bits. Rate-Distortion Theory was introduced in the seminal works written in 1948 and 1959 by C. E. Shannon, the founder of information Theory. We describe Shannon's contribution and then trace its subsequent development worldwide. Heavier than usual emphasis is placed on the concept of “matching” a channel to a source in the Rate-Distortion sense, and also on the analogous matching of a source to a channel. Experimental evidence has been mounting in support of the hypothesis that living organisms often simultaneously achieve both of these matchings when processing their sensory inputs, thereby eliminating the need for the complex encoding and decoding operations that are needed in order to produce an information-theoretically optimum system in the absence of such double matching. Keywords: Rate-Distortion; lossy source coding; Distortion measure; Shannon; joint source-channel coding; bioinformation Theory

  • Quantum Rate-Distortion Theory for I.I.D. Sources
    arXiv: Quantum Physics, 2000
    Co-Authors: I. Devetak, Toby Berger
    Abstract:

    We formulate quantum Rate-Distortion Theory in the most general setting where classical side information is included in the tradeoff. Using a natural Distortion measure based on entanglement fidelity and specializing to the case of an unrestricted classical side channel, we find the exact quantum Rate-Distortion function for a source of isotropic qubits. An upper bound we believe to be exact is found in the case of biased sources. We establish that in this scenario optimal Rate-Distortion codes produce no entropy exchange with the environment of any individual qubit.

  • Lossy source coding
    IEEE Transactions on Information Theory, 1998
    Co-Authors: Toby Berger, Jerry D. Gibson
    Abstract:

    Lossy coding of speech, high-quality audio, still images, and video is commonplace today. However, in 1948, few lossy compression systems were in service. Shannon introduced and developed the Theory of source coding with a fidelity criterion, also called Rate-Distortion Theory. For the first 25 years of its existence, Rate-Distortion Theory had relatively little impact on the methods and systems actually used to compress real sources. Today, however, Rate-Distortion theoretic concepts are an important component of many lossy compression techniques and standards. We chronicle the development of Rate-Distortion Theory and provide an overview of its influence on the practice of lossy source coding.

Xiaoping Zhang - One of the best experts on this subject based on the ideXlab platform.

  • a content based video fast forward playback method using video time density function and Rate Distortion Theory
    International Conference on Multimedia and Expo, 2011
    Co-Authors: Junfeng Jiang, Xiaoping Zhang, Alexander C Loui
    Abstract:

    In this paper, we propose a new video summary method using video time density function (VTDF) and Rate Distortion Theory. The whole system has two main modules, processing and playing. In the processing part, we apply VTDF to describe the temporal dynamics of video data first. A VTDF-based temporal quantization method is then developed to find the best quanta and partition in time domain. The optimal quanta are used to extract the representative video frames. A temporal mean square error (TMSE) is introduced by using Rate-Distortion Theory to evaluate the quantization performance. In the playing module, we develop a video player to only play all sampled frames in its intelligent fast-forward mode. The built video player can allow users to do fast-forward playback based on the semantic video content, which demonstRates the feasibility of proposed method in practice.

  • ICME - A content-based video fast-forward playback method using video time density function and Rate Distortion Theory
    2011 IEEE International Conference on Multimedia and Expo, 2011
    Co-Authors: Junfeng Jiang, Xiaoping Zhang, Alexander C Loui
    Abstract:

    In this paper, we propose a new video summary method using video time density function (VTDF) and Rate Distortion Theory. The whole system has two main modules, processing and playing. In the processing part, we apply VTDF to describe the temporal dynamics of video data first. A VTDF-based temporal quantization method is then developed to find the best quanta and partition in time domain. The optimal quanta are used to extract the representative video frames. A temporal mean square error (TMSE) is introduced by using Rate-Distortion Theory to evaluate the quantization performance. In the playing module, we develop a video player to only play all sampled frames in its intelligent fast-forward mode. The built video player can allow users to do fast-forward playback based on the semantic video content, which demonstRates the feasibility of proposed method in practice.

Paul Cuff - One of the best experts on this subject based on the ideXlab platform.

  • Rate-Distortion Theory for Secrecy Systems
    IEEE Transactions on Information Theory, 2014
    Co-Authors: Curt Schieler, Paul Cuff
    Abstract:

    Secrecy in communication systems is measured herein by the Distortion that an adversary incurs. The transmitter and receiver share secret key, which they use to encrypt communication and ensure Distortion at an adversary. A model is considered in which an adversary not only intercepts the communication from the transmitter to the receiver, but also potentially has side information. In particular, the adversary may have causal or noncausal access to a signal that is correlated with the source sequence or the receiver's reconstruction sequence. The main contribution is the characterization of the optimal tradeoff among communication Rate, secret key Rate, Distortion at the adversary, and Distortion at the legitimate receiver. It is demonstRated that causal side information at the adversary plays a pivotal role in this tradeoff. It is also shown that measures of secrecy based on normalized equivocation are a special case of the framework.

  • The Likelihood Encoder for Source Coding
    arXiv: Information Theory, 2013
    Co-Authors: Paul Cuff, Eva C. Song
    Abstract:

    The likelihood encoder with a random codebook is demonstRated as an effective tool for source coding. Coupled with a soft covering lemma (associated with channel resolvability), likelihood encoders yield simple achievability proofs for known results, such as Rate-Distortion Theory. They also produce a tractable analysis for secure Rate-Distortion Theory and strong coordination.

  • Rate-Distortion Theory for secrecy systems
    2013 IEEE International Symposium on Information Theory, 2013
    Co-Authors: Curt Schieler, Paul Cuff
    Abstract:

    In this work, secrecy in communication systems is measured by the Distortion incurred by the worst-case adversary. The transmitter and receiver share secret key, which they use to encrypt communication and cause Distortion at an adversary. In our model, we assume that an adversary not only intercepts the communication between the transmitter and receiver, but also may have access to noisy observations of the system. For example, the adversary may have causal access to a signal that is correlated with the source sequence or with the output of the receiver. Our main contribution is the solution of the optimal tradeoff among communication Rate, secret key Rate, Distortion at the adversary, and Distortion at the legitimate receiver. We demonstRate that side information at the adversary plays a pivotal role, and provide a number of examples that motivate and give insight into our results.

  • Rate-Distortion Theory for Secrecy Systems
    arXiv: Information Theory, 2013
    Co-Authors: Curt Schieler, Paul Cuff
    Abstract:

    Secrecy in communication systems is measured herein by the Distortion that an adversary incurs. The transmitter and receiver share secret key, which they use to encrypt communication and ensure Distortion at an adversary. A model is considered in which an adversary not only intercepts the communication from the transmitter to the receiver, but also potentially has side information. Specifically, the adversary may have causal or noncausal access to a signal that is correlated with the source sequence or the receiver's reconstruction sequence. The main contribution is the characterization of the optimal tradeoff among communication Rate, secret key Rate, Distortion at the adversary, and Distortion at the legitimate receiver. It is demonstRated that causal side information at the adversary plays a pivotal role in this tradeoff. It is also shown that measures of secrecy based on normalized equivocation are a special case of the framework.

  • ISIT - Rate-Distortion Theory for secrecy systems
    2013 IEEE International Symposium on Information Theory, 2013
    Co-Authors: Curt Schieler, Paul Cuff
    Abstract:

    In this work, secrecy in communication systems is measured by the Distortion incurred by the worst-case adversary. The transmitter and receiver share secret key, which they use to encrypt communication and cause Distortion at an adversary. In our model, we assume that an adversary not only intercepts the communication between the transmitter and receiver, but also may have access to noisy observations of the system. For example, the adversary may have causal access to a signal that is correlated with the source sequence or with the output of the receiver. Our main contribution is the solution of the optimal tradeoff among communication Rate, secret key Rate, Distortion at the adversary, and Distortion at the legitimate receiver. We demonstRate that side information at the adversary plays a pivotal role, and provide a number of examples that motivate and give insight into our results.