CalcPath

Contents / Information Theory

Information Theory

The mathematical study of the quantification, storage, and communication of information.

19 chapters·1610 practice questions·Your progress

Contents

  1. 1.
    Entropy, Joint and Conditional Entropy

    Not read·0 / 133 correct

  2. 2.
    Mutual Information and Relative Entropy

    Not read·0 / 66 correct

  3. 3.
    Entropy Rates and the AEP

    Not read·0 / 66 correct

  4. 4.
    Source Coding and the Entropy Bound

    Not read·0 / 66 correct

  5. 5.
    Huffman and Shannon–Fano Codes

    Not read·0 / 66 correct

  6. 6.
    Arithmetic, Lempel–Ziv and Universal Coding

    Not read·0 / 99 correct

  7. 7.
    Channel Capacity and the Coding Theorem

    Not read·0 / 99 correct

  8. 8.
    Linear and Hamming Codes

    Not read·0 / 66 correct

  9. 9.
    Modern Codes: LDPC, Polar and Turbo

    Not read·0 / 110 correct

  10. 10.
    Rate–Distortion Theory

    Not read·0 / 110 correct

  11. 11.
    Quantization

    Not read·0 / 66 correct

  12. 12.
    Distributed Source Coding and Side Information

    Not read·0 / 110 correct

  13. 13.
    Multiple-Access and Broadcast Channels

    Not read·0 / 72 correct

  14. 14.
    Network Coding and Common Randomness

    Not read·0 / 87 correct

  15. 15.
    Algorithmic Information Theory

    Not read·0 / 100 correct

  16. 16.
    Quantum States and Von Neumann Entropy

    Not read·0 / 63 correct

  17. 17.
    Quantum Channels, Holevo and Capacity

    Not read·0 / 65 correct

  18. 18.
    Secret Sharing and Secure Computation

    Not read·0 / 90 correct

  19. 19.
    Differential Privacy

    Not read·0 / 76 correct