Bankruptcy blog

February 28, 2008

List of information theory topics

Filed under: Uncategorized — admin @ 11:11 am

This is a list of information theory topics, by Wikipedia page.

Mathematical Theory of Communication

  • algorithmic information theory
  • arithmetic encoding
  • channel capacity
  • Communication Theory of Secrecy Systems
  • conditional entropy
  • conditional quantum entropy
  • confusion and diffusion
  • cross entropy
  • data compression
  • entropy encoding
  • Fisher information
  • Hick’s law
  • Hirchman uncertainty
  • Huffman encoding
  • information bottleneck method
  • information entropy
  • information theoretic security
  • information theory
  • joint entropy
  • Kullback-Leibler divergence
  • lossless data compression
  • negentropy
  • principle of maximum entropy
  • quantum information science
  • range encoding
  • redundancy
  • Rényi entropy
  • self-information
  • Shannon limit
  • Shannon’s law
  • Shannon’s theorem
  • No Comments »

    No comments yet.

    RSS feed for comments on this post. TrackBack URL

    Leave a comment

    You must be logged in to post a comment.

    Powered by WordPress