ICTS:32731

Information Theory and its applications in Combinatorics and Computation

(2025). Information Theory and its applications in Combinatorics and Computation. SciVideos. https://scivideos.org/icts-tifr/32731

Information Theory and its applications in Combinatorics and Computation. SciVideos, Sep. 07, 2025, https://scivideos.org/icts-tifr/32731 

          @misc{ scivideos_ICTS:32731,
            doi = {},
            url = {https://scivideos.org/icts-tifr/32731},
            author = {},
            keywords = {},
            language = {en},
            title = {Information Theory and its applications in Combinatorics and Computation},
            publisher = {},
            year = {2025},
            month = {sep},
            note = {ICTS:32731 see, \url{https://scivideos.org/icts-tifr/32731}}
          }
Jaikumar Radhakrishnan
Talk numberICTS:32731
Source RepositoryICTS-TIFR

Abstract

Shannon entropy 

We will review the problem of information compression and show the role that entropy of a probability distribution plays in it. We will analyse compression in the one-shot and the iid settings, leading up to Shannon’s source-coding theorem.

Key concepts: Prefix-free encoding, typical sequences, rate of a code.