ICTS:32731

Information Theory and its applications in Combinatorics and Computation

APA

(2025). Information Theory and its applications in Combinatorics and Computation. SciVideos. https://scivideos.org/index.php/icts-tifr/32731

MLA

Information Theory and its applications in Combinatorics and Computation. SciVideos, Sep. 07, 2025, https://scivideos.org/index.php/icts-tifr/32731

BibTex

          @misc{ scivideos_ICTS:32731,
            doi = {},
            url = {https://scivideos.org/index.php/icts-tifr/32731},
            author = {},
            keywords = {},
            language = {en},
            title = {Information Theory and its applications in Combinatorics and Computation},
            publisher = {},
            year = {2025},
            month = {sep},
            note = {ICTS:32731 see, \url{https://scivideos.org/index.php/icts-tifr/32731}}
          }
          
Jaikumar Radhakrishnan
Talk numberICTS:32731
Source RepositoryICTS-TIFR

Abstract

Shannon entropy 

We will review the problem of information compression and show the role that entropy of a probability distribution plays in it. We will analyse compression in the one-shot and the iid settings, leading up to Shannon’s source-coding theorem.

Key concepts: Prefix-free encoding, typical sequences, rate of a code.