ai-tutorialsbasicsinformation-bottleneck
The Information Bottleneck Explained: What a Representation Is For
The information bottleneck for practitioners: what it means to keep only the bits that predict, why the binned compression phase in our experiment tracks the activation function rather than learning, why every information-plane number depends on its binning while the exact one for a finite input does not, and how the same equation — not the same explanation, and with β multiplying the opposite term — shows up in a VAE's collapsed latent.
Oct 16, 2026•67 min read
