Skip to main content

One doc tagged with "perplexity"

View all tags

Data Compression Fundamentals

Shannon's source coding theorem, Huffman coding, arithmetic coding, lossless vs lossy compression, and why language model perplexity is a compression measure.