Information Theory and its applications in Combinatorics and Computation
APA
(2025). Information Theory and its applications in Combinatorics and Computation. SciVideos. https://scivideos.org/index.php/icts-tifr/32731
MLA
Information Theory and its applications in Combinatorics and Computation. SciVideos, Sep. 07, 2025, https://scivideos.org/index.php/icts-tifr/32731
BibTex
@misc{ scivideos_ICTS:32731,
doi = {},
url = {https://scivideos.org/index.php/icts-tifr/32731},
author = {},
keywords = {},
language = {en},
title = {Information Theory and its applications in Combinatorics and Computation},
publisher = {},
year = {2025},
month = {sep},
note = {ICTS:32731 see, \url{https://scivideos.org/index.php/icts-tifr/32731}}
}
Jaikumar Radhakrishnan
Talk numberICTS:32731
Source RepositoryICTS-TIFR
Abstract
Shannon entropy
We will review the problem of information compression and show the role that entropy of a probability distribution plays in it. We will analyse compression in the one-shot and the iid settings, leading up to Shannon’s source-coding theorem.
Key concepts: Prefix-free encoding, typical sequences, rate of a code.